-- Logs begin at Sat 2022-09-10 20:01:15 UTC, end at Sat 2022-09-10 22:12:23 UTC. -- Sep 10 20:36:50.946661 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 10 20:36:50.955471 ncdv-master-1 devstack@n-api.service[129360]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 10 20:36:50 2022] *** Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: nodename: ncdv-master-1 Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: machine: x86_64 Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: clock source: unix Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: pcre jit disabled Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: detected number of CPU cores: 4 Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: current working directory: / Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: detected binary path: /usr/bin/uwsgi-core Sep 10 20:36:50.957458 ncdv-master-1 devstack@n-api.service[129360]: your processes number limit is 47680 Sep 10 20:36:50.958291 ncdv-master-1 devstack@n-api.service[129360]: your memory page size is 4096 bytes Sep 10 20:36:50.958291 ncdv-master-1 devstack@n-api.service[129360]: detected max file descriptor number: 2048 Sep 10 20:36:50.958291 ncdv-master-1 devstack@n-api.service[129360]: lock engine: pthread robust mutexes Sep 10 20:36:50.958291 ncdv-master-1 devstack@n-api.service[129360]: thunder lock: enabled Sep 10 20:36:50.958291 ncdv-master-1 devstack@n-api.service[129360]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 10 20:36:50.958291 ncdv-master-1 devstack@n-api.service[129360]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 10 20:36:51.002709 ncdv-master-1 devstack@n-api.service[129360]: Python main interpreter initialized at 0x556c988679c0 Sep 10 20:36:51.002709 ncdv-master-1 devstack@n-api.service[129360]: python threads support enabled Sep 10 20:36:51.002709 ncdv-master-1 devstack@n-api.service[129360]: your server socket listen backlog is limited to 100 connections Sep 10 20:36:51.002709 ncdv-master-1 devstack@n-api.service[129360]: your mercy for graceful operations on workers is 90 seconds Sep 10 20:36:51.003071 ncdv-master-1 devstack@n-api.service[129360]: mapped 403077 bytes (393 KB) for 2 cores Sep 10 20:36:51.003149 ncdv-master-1 devstack@n-api.service[129360]: *** Operational MODE: preforking *** Sep 10 20:36:51.003377 ncdv-master-1 devstack@n-api.service[129360]: *** uWSGI is running in multiple interpreter mode *** Sep 10 20:36:51.003377 ncdv-master-1 devstack@n-api.service[129360]: spawned uWSGI master process (pid: 129360) Sep 10 20:36:51.003566 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 10 20:36:51.004921 ncdv-master-1 devstack@n-api.service[129360]: spawned uWSGI worker 1 (pid: 129361, cores: 1) Sep 10 20:36:51.004921 ncdv-master-1 devstack@n-api.service[129360]: spawned uWSGI worker 2 (pid: 129362, cores: 1) Sep 10 20:36:51.004921 ncdv-master-1 devstack@n-api.service[129360]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 10 20:36:52.309216 ncdv-master-1 devstack@n-api.service[129362]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 20:36:52.320725 ncdv-master-1 devstack@n-api.service[129361]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 20:36:52.991615 ncdv-master-1 devstack@n-api.service[129362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:36:52.991615 ncdv-master-1 devstack@n-api.service[129362]: from cryptography.utils import int_from_bytes Sep 10 20:36:52.991932 ncdv-master-1 devstack@n-api.service[129362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:36:52.991932 ncdv-master-1 devstack@n-api.service[129362]: from cryptography.utils import int_from_bytes Sep 10 20:36:52.994708 ncdv-master-1 devstack@n-api.service[129361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:36:52.994708 ncdv-master-1 devstack@n-api.service[129361]: from cryptography.utils import int_from_bytes Sep 10 20:36:52.995149 ncdv-master-1 devstack@n-api.service[129361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:36:52.995149 ncdv-master-1 devstack@n-api.service[129361]: from cryptography.utils import int_from_bytes Sep 10 20:36:55.592806 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 20:36:55.593365 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 20:36:55.593596 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 20:36:55.593991 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 20:36:55.594179 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 20:36:55.594538 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 20:36:55.594637 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 20:36:55.594730 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.594943 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.595032 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 20:36:55.595265 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.595351 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 20:36:55.595564 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 20:36:55.595664 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.595904 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.595999 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.596218 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.596330 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.596540 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.596643 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.596861 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.596948 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.597190 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.597276 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.597448 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.597545 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.597766 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.597868 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.598130 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.598240 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.598455 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.598543 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.598714 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.598809 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.599031 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.599131 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.599356 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.599453 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.599668 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.599771 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.599976 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.600083 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.600283 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.600371 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.600600 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.600794 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.600913 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.601219 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.601344 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.601526 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.601620 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.601859 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.602057 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.602234 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.602367 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.602517 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.602672 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.602829 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.602983 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.603153 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.603319 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.603440 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.603634 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.603756 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.603942 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.604063 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.604278 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.605026 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.605126 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.605355 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.605516 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.605671 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.605806 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.606020 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.606124 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.606442 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.606572 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.606757 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.606854 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.607071 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.607172 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.607403 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.607492 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.607730 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.607817 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.608039 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.608154 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.608372 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.608473 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.608690 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.608784 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.608998 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.609111 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.609321 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.609423 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.609627 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.609723 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.609973 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.610128 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.610271 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.610375 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.610570 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.610658 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.610877 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.610967 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.611178 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.611272 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.611429 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.611517 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.611737 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.611826 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.612059 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.612146 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.612309 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.612432 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.612614 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.612713 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.612934 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.613028 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.613184 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.613286 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.613507 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.613609 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.613802 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.613926 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.614076 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.614175 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.614397 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.614485 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.614718 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.614816 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.615026 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.615123 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.615333 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.615430 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.615639 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.615725 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.615943 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.616029 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.616247 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.616333 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.616555 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.616657 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.616861 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.616956 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.617165 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.617261 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.617478 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.617572 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.617795 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.617896 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.618139 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.618271 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.618450 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.618564 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.618756 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.618860 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.619097 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.619192 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.619390 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.619485 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.619698 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.619787 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.620106 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.620272 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.620423 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.620525 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.620733 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.620857 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.621054 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.621171 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.621373 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.621471 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.621680 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.621792 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.622008 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.622151 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.622314 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.622463 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.622634 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.622730 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.622958 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.623054 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.623261 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.623357 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.623512 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.623608 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.623812 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.623909 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.624115 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.624217 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.624433 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.624534 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.624736 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.624830 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.625038 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.625133 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.625341 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.625440 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.625643 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.625749 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.625970 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.626111 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.626274 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.626415 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.626593 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.626741 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.626875 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.627008 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.627165 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.627308 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.627468 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.627612 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.627777 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.627932 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.628070 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.628205 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.628366 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.628508 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.628669 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.628760 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.628988 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.629132 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.629301 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.629398 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.629603 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.629689 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.629929 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.630034 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.630242 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.630414 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.630571 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.630717 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.630852 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.630989 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.631129 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.631276 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.631431 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.631576 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.631753 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.632308 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.632308 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.632555 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.632644 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.632727 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.632920 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.633020 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.633117 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.633199 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.633279 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.633407 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.633535 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.633631 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.633855 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.633959 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.634160 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.634300 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.634448 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.634582 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.634729 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.634872 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.635036 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.635175 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.635341 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.635491 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.635685 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.635824 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.635994 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.636178 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.636382 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.636529 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.636707 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.636841 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.637031 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.637168 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.637342 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.637561 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.637654 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.637736 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.637967 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.638061 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.638293 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.638393 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.638616 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.638759 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.638902 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.639034 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.639227 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:36:55.639347 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.639562 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.639651 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.639897 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.639984 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.640228 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.640340 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.640547 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.640644 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.640857 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.640942 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.641172 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.641270 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.641499 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.641585 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.641810 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.641958 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.642163 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.642262 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.642460 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.642550 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.642769 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.642904 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.643081 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.643172 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.643393 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.643490 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.643710 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.643799 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.644028 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.644344 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.644488 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.644637 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.644774 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.644959 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.645101 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.645289 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.645421 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.645611 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.645767 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.645939 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.646026 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.646247 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.646336 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.646578 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.646675 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.646900 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.646990 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.647211 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.647316 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.647540 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.647635 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.647855 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.647944 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.648168 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.648268 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.648480 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.648568 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.648804 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.648900 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.649117 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.649207 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.649431 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.649539 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.649741 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.649863 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.650080 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.650179 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.650396 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.650492 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.650707 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.650803 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.651017 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.651106 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.651862 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.652018 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.652189 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.652374 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.652676 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.652764 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.653007 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.653155 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.653304 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.653394 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.653615 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.653711 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.653953 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.654048 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.654282 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.654369 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.654602 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.654698 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.654915 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.655003 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.655230 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.655326 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.655542 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.655630 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.655848 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.655938 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.656159 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.656302 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.656468 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.656623 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.656780 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.656936 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.657088 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.657246 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.657409 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.657551 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.657740 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.657906 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.658103 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.658192 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.658443 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.658553 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.658753 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.658850 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.659067 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.659158 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.659379 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.659531 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.659692 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.659788 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.660004 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.660098 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.660314 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.660411 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.660621 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.660743 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.660926 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.661013 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.661228 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.661398 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.661539 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.661635 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.661871 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.661963 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.662169 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.662258 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.662487 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.662583 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.662795 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.662881 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.663099 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.663224 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.663409 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.663497 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.663714 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.663800 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.664021 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.664117 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.664329 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.664416 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.664635 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.664723 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.664944 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.665033 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.665253 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.665339 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.665561 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.665661 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.665912 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.666004 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.666224 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.666312 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.666533 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.666638 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.667422 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.667523 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.667759 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.668054 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.668142 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.668368 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.668462 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.668674 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.668761 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.668982 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.669079 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.669286 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.669375 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.669597 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.669684 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.669931 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.670043 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.670238 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.670324 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.670540 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.670627 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.670841 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.670940 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.671148 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.671235 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.671452 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.671540 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.671753 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.671864 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.672053 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.672142 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.672354 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.672449 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.672654 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.672755 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.672973 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.673060 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.673278 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.673365 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.673578 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.673668 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.673903 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.673992 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.674205 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.674305 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.674559 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.674648 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.674863 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.674952 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.675189 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.675275 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.675502 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.675592 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.675815 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.675915 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.676128 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.676216 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.676437 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.676533 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.676752 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.676840 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.677061 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.677161 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.677369 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.677457 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.677677 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.677775 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.678009 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.678108 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.678326 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.678416 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.678635 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.678732 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.678939 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.679035 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.679256 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.679355 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.679598 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.679721 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.679939 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.680037 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.680257 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.680343 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.680569 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.680665 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.680880 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.680975 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.681196 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.681285 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.681507 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.681596 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.681838 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.681932 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.682153 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.682251 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.682509 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.682601 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.682873 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.682968 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.683190 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.683322 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.683509 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.683612 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.683817 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.683905 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.684124 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.684210 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.684440 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.684533 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.684749 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.684838 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.685055 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.685141 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.685359 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.685487 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.685683 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.685779 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.686020 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.686163 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.686442 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.686656 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.686656 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.686918 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.687056 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.687192 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.687327 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.687471 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.687620 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.687753 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.687890 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.688025 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.688168 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.688316 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.688451 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.688585 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.688720 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.688853 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.689020 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.689167 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.689358 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.689496 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.689632 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.689764 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.689942 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.690085 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.690222 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.690359 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.690534 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.690678 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.690894 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.690984 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.691116 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.691258 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.691424 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.691563 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.691734 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.691885 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.692027 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.692171 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.692329 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.692481 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.692616 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.692751 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.692925 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.693063 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.693241 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.693386 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.693554 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.693690 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.693889 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.693998 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.694200 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.694305 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.694504 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.694603 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.694806 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.694893 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.695126 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.695229 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.695436 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.695523 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.695738 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.695825 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.696039 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.696134 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.696342 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.696429 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.696656 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.696742 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.696974 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.697062 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.697275 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.697361 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.697580 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.697711 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.697925 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.698511 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.698767 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.698869 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.699077 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.699164 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.699385 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.699474 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.699694 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.699781 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.700004 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.700102 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.700316 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.700536 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.700629 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.700720 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.700918 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.701020 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.701229 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.701325 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.701536 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.701624 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.701863 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.702038 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.702184 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.702321 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.702481 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.702575 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.702787 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.703060 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.703160 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.703384 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.703479 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.703707 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.703816 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.704007 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.704101 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.704350 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.704569 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.704668 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.704902 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.704999 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.705215 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.705304 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.705532 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.705619 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.705917 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.706019 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.706232 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.706334 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.706545 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.706641 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.706853 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.706943 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.707167 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.707264 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.707466 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.707553 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.707773 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.707868 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.708077 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.708165 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.708382 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.708469 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.708685 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.708774 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.708991 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.709079 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.709295 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.709397 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.709601 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.709702 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.709936 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.710031 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.710244 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.710342 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.710549 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.710637 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.710852 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.710940 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.711171 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.711306 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.711476 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.711577 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.711779 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.711866 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.712082 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.712177 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.712384 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.712480 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.712708 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.712797 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.713018 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.713106 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.713319 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.713414 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.713623 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.714379 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.714492 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.714643 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.715136 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.715291 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.715430 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.715565 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.715758 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.715906 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.716120 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.716260 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.716403 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.716545 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.716691 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.716826 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.716971 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.717109 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.717258 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.717425 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.717575 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.717717 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.717908 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.718045 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.718182 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.718344 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.718491 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.718646 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.718782 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.718966 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.719112 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.719250 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.719387 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.719561 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.719736 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.719870 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.720014 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.720157 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.720299 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.720450 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.720600 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.720736 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.720876 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.721043 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.721180 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.721349 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.721492 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.721652 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.721788 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.721988 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.722133 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.722279 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.722424 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.722595 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.722728 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.722902 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.723053 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.723197 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.723334 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.723480 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.723618 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.723792 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.723953 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.724088 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.724219 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.724373 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.724508 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.724690 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.724837 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.724972 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.725130 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.725261 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.725404 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.725561 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.725710 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.725892 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.726038 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.726199 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.726351 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.726497 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.726632 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.726776 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.726912 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.727101 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.727244 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.727398 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.727546 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.727683 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.727820 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.727999 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.728134 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.728289 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.728425 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.728562 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.728697 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.728868 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.729005 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.729177 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.729324 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.729518 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.729814 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.730007 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.730154 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.730243 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.730436 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.730572 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.730740 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.730877 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.731048 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.731187 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.731355 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.731506 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.731650 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.731791 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.731937 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.732073 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.732218 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.732353 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.732521 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.732655 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.732825 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.732970 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.733147 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.733291 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.733456 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.733602 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.733743 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.733898 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.734077 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.734237 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.734372 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.734512 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.734710 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.734844 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.735016 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.735150 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.735321 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.735461 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.735640 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.735774 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.735951 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.736085 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.736266 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.736410 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.736571 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.736704 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.736876 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.737009 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.737191 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.737323 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.737499 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.737633 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.737807 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.737981 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.738126 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.738272 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.738437 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.738575 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.738727 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.738859 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.739032 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.739171 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.739362 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.739500 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.739669 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.739804 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.739977 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.740076 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.740292 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.740414 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.740604 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.740702 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.740914 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.741003 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.741217 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.741304 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.741523 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.741619 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.741850 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.741941 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.742162 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.742261 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.742469 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.742567 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.742775 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.742862 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.743079 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.743166 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.743383 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.743486 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.743691 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.743785 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.744000 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.744126 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.744294 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.744379 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.744596 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.744686 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.744921 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.745008 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.745245 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.745335 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.745555 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.745653 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.745901 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.745993 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.746213 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.746312 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.746517 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.746614 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.746825 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.746914 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.747128 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.747225 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.747437 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.747525 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.747744 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.747842 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.748065 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.748160 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.748369 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.748459 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.748764 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.748921 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.749069 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.749170 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.749382 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.749471 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.749690 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.749787 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.750023 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.750113 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.750335 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.750423 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.750636 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.750743 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.750959 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.751047 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.751267 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.751355 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.751573 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.751706 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.751879 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.751967 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.752204 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.752345 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.752507 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.752598 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.752818 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.752906 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.753142 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.753231 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.753447 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.753543 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.753751 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.753861 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.754082 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.754332 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.754442 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.754648 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.754737 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.754961 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.755051 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.755287 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.755402 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.755612 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.755701 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.755940 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.756057 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.756249 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.756402 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.756566 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.756716 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.756877 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.757025 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.757203 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.757349 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.757529 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.757672 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.757871 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.758049 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.758196 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.758355 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.758505 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.758671 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.758832 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.758983 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.759157 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.759315 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.759472 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.759638 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.759796 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.759949 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.760218 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.760369 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.761085 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.761506 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.761606 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.761741 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.761812 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.762062 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.762062 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.762323 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.762461 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.762594 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.762728 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.762870 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.763017 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.763152 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.763287 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.763424 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.763559 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.763706 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.763841 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.763975 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.764110 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.764269 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.764416 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.764576 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.764715 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.764887 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.765076 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.765220 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.765372 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.765517 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.765660 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.765795 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.765953 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.766122 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.766272 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.766434 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.766574 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.766742 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.766890 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.767033 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.767181 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.767323 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.767458 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.767627 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.767766 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.767950 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.768089 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.768254 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.768390 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.768576 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.768715 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.768890 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.769031 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.769205 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.769296 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.769524 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.769612 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.769871 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.769966 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.770173 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.770261 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.770480 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.770567 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.770785 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.770875 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.771090 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.771225 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.771393 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.771496 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.771736 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.771826 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.772042 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.772135 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.772355 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.772452 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.772673 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.772781 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.772998 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.773087 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.773306 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.773402 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.773610 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.773712 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.773946 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.774039 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.774254 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.774357 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.774560 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.774650 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.774865 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.774955 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.775172 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.775268 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.775475 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.775564 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.775775 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.775862 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.776076 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.776235 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.776917 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.777055 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.777225 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.777362 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.777530 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.777695 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.777869 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.778036 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.778164 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.778345 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.778468 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.778652 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.778770 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.778957 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.779095 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.779301 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.779392 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.779608 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.779704 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.779947 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.780103 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.780259 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.780414 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.780587 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.780718 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.780911 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.781009 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.781228 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.781353 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.781545 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.781659 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.781888 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.782022 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.782207 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.782335 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.782524 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.782661 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.782842 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.782979 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.783154 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.783294 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.783480 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.783610 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.783796 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.783924 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.784116 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.784238 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.784550 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.784638 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.784863 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.785003 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.785172 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.785264 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.785486 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.785575 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.785799 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.785982 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.786139 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.786227 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.786484 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.786658 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.786798 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.786987 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.787111 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.787303 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.787425 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.787614 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.787738 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.787927 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.788068 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.788240 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.788391 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.788550 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.788718 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.788863 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.789054 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.789173 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.789374 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.789472 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.789690 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.789780 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.790034 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.790134 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.790353 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.790450 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.790712 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.790806 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.791036 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.791124 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.791346 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.791495 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.791666 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.791794 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.792105 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.792192 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.792429 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.792518 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.792791 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.792882 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.793108 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.793290 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.793417 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.793614 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.793766 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.793959 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.794077 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.794275 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.794394 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.794586 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.794704 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.794904 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.795014 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.795220 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.795331 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.795545 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.795636 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.795881 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.795971 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.796204 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.796294 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.796522 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.796610 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.796834 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.796939 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.797150 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.797237 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.797482 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.797671 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.797803 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.798015 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.798144 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.798352 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.798448 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.798680 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.798769 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.799007 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.799272 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.799369 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.799596 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.799693 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.799932 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.800030 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.800240 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.800330 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.800549 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.800646 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.800861 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.800951 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.801176 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.801263 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.801480 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.801576 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.801799 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.801952 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.802135 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.802261 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.802439 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.802528 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.802744 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.802840 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.803048 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.803145 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.803373 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.803583 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.803682 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.803935 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.804039 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.804254 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.804344 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.804569 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.804658 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.804894 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.805102 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.805214 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.805450 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.805551 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.805768 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.805905 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.806122 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.806219 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.806446 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.806545 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.806760 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.806848 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.807065 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.807152 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.807388 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.807484 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.807821 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.807916 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.808135 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.808226 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.808455 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.808542 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.808771 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.808862 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.809081 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.809168 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.809390 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.809487 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.809699 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.809787 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.810036 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.810136 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.810341 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.810430 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.810650 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.810736 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.810952 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.811055 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.811261 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.811349 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.811568 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.811665 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.811870 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.811966 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.812174 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.812262 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.812483 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.812623 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.812785 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.812933 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.813071 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.813207 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.813379 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.813519 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.813682 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.813781 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.814018 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.814109 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.814327 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.814415 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.814637 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.814727 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.814942 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.815042 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.815254 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.815346 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.815557 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.815652 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.815878 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.815966 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.816188 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.816282 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.816511 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.816599 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.816816 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.816910 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.817121 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.817217 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.817440 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.817530 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.817752 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.817861 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.818102 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.818323 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.818465 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.818667 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.818756 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.818995 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.819085 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.819336 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.819434 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.819673 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.819868 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.819986 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.820203 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.820301 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.820524 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.820614 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.820860 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.820951 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.821194 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.821292 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.821501 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.821597 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.821807 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.821936 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.822135 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.822226 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.822446 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.822534 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.822753 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.822840 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.823576 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.823673 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.823888 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.823974 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.824187 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.824270 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.824492 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.824583 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.824799 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.824938 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.825129 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.825233 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.825415 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.825503 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.825723 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.825812 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.826055 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.826159 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.826365 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.826462 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.826674 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.826771 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.826984 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.827083 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.827294 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.827383 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.827609 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.827699 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.827921 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.828009 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.828233 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.828331 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.828545 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.828634 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.828856 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.828946 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.829174 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.829264 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.829494 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.829588 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.829807 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.829944 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.830138 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.830226 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.830450 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.830768 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.830864 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.831101 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.831190 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.831415 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.831503 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.831722 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.831812 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.832051 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.832381 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.832476 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.832709 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.832815 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.833024 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.833115 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.833346 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.833434 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.833660 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.833757 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.834010 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.834100 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.834342 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.834432 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.834660 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.834750 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.834985 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.835073 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.835292 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.835387 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.835603 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.835732 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.835911 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.836008 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.836228 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.836326 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.836548 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.836644 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.836861 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.836957 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.837168 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.837264 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.837472 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.837560 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.837784 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.837893 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.838111 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.838213 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.838417 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.838506 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.838778 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.839516 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.839610 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.839708 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.840207 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.840341 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.840517 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.840612 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.840823 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.840959 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.841129 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.841217 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.841435 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.841522 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.841742 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.841880 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.842075 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.842165 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.842388 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.842478 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.842690 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.842779 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.843044 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.843140 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.843297 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.843384 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.843602 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.843699 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.843907 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.844005 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.844210 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.844305 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.844515 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.844604 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.844818 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.844907 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.845123 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.845226 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.845427 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.845524 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.845763 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.845871 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.846103 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.846204 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.846429 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.846517 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.846752 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.846847 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.847062 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.847388 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.847627 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.847754 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.847950 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.848066 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.848293 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.848386 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.848613 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.848708 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.848927 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.849023 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.849243 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.849332 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.849559 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.849659 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.849901 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.849996 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.850222 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.850325 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.850552 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.850640 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.850862 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.850952 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.851173 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.851272 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.851500 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.851590 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.851821 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.851923 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.852134 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.852221 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.852457 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.852544 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.852773 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.852870 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.853098 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.853188 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.853411 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.853499 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.853721 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.853818 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.854059 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.854147 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.854403 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.854502 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.854721 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.854957 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.855054 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.855310 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.855398 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.855629 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.855726 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.855946 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.856046 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.856264 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.856354 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.856579 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.856675 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.856893 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.856983 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.857211 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.857340 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.857531 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.857620 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.857879 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.857970 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.858213 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.858337 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.858529 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.858620 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.858857 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.858946 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.859194 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.859289 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.859512 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.859602 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.859829 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.859918 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.860139 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.860305 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.860397 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 20:36:55.860479 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.860788 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.861102 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.861410 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:36:55.861656 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 20:36:55.927437 ncdv-master-1 devstack@n-api.service[129362]: INFO dbcounter [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Registered counter for database nova_api Sep 10 20:36:55.928281 ncdv-master-1 devstack@n-api.service[129361]: INFO dbcounter [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Registered counter for database nova_api Sep 10 20:36:55.947417 ncdv-master-1 devstack@n-api.service[129362]: DEBUG oslo_db.sqlalchemy.engines [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:36:55.949758 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_db.sqlalchemy.engines [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:36:55.954783 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writer thread running {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:36:55.956230 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writer thread running {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:36:56.010349 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.context [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) {{(pid=129362) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 20:36:56.012518 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.context [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) {{(pid=129361) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 20:36:56.014873 ncdv-master-1 devstack@n-api.service[129362]: DEBUG oslo_concurrency.lockutils [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:36:56.015348 ncdv-master-1 devstack@n-api.service[129362]: DEBUG oslo_concurrency.lockutils [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:36:56.016333 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:36:56.016802 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:36:56.016904 ncdv-master-1 devstack@n-api.service[129362]: DEBUG oslo_concurrency.lockutils [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:36:56.017630 ncdv-master-1 devstack@n-api.service[129362]: DEBUG oslo_concurrency.lockutils [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:36:56.018086 ncdv-master-1 devstack@n-api.service[129362]: DEBUG oslo_concurrency.lockutils [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:36:56.018387 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:36:56.019120 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:36:56.019564 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:36:56.020075 ncdv-master-1 devstack@n-api.service[129362]: DEBUG oslo_concurrency.lockutils [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:36:56.021526 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:36:56.022082 ncdv-master-1 devstack@n-api.service[129362]: INFO dbcounter [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Registered counter for database nova_cell0 Sep 10 20:36:56.023535 ncdv-master-1 devstack@n-api.service[129361]: INFO dbcounter [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Registered counter for database nova_cell0 Sep 10 20:36:56.027969 ncdv-master-1 devstack@n-api.service[129362]: INFO dbcounter [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Registered counter for database nova_cell1 Sep 10 20:36:56.028396 ncdv-master-1 devstack@n-api.service[129361]: INFO dbcounter [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Registered counter for database nova_cell1 Sep 10 20:36:56.035798 ncdv-master-1 devstack@n-api.service[129362]: DEBUG oslo_db.sqlalchemy.engines [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:36:56.036981 ncdv-master-1 devstack@n-api.service[129362]: DEBUG oslo_db.sqlalchemy.engines [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:36:56.038989 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_db.sqlalchemy.engines [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:36:56.044660 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writer thread running {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:36:56.045298 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_db.sqlalchemy.engines [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:36:56.045988 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writer thread running {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:36:56.051227 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writer thread running {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:36:56.186911 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writer thread running {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:36:56.191271 ncdv-master-1 devstack@n-api.service[129362]: INFO dbcounter [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Registered counter for database nova_cell0 Sep 10 20:36:56.195814 ncdv-master-1 devstack@n-api.service[129361]: INFO dbcounter [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Registered counter for database nova_cell0 Sep 10 20:36:56.201011 ncdv-master-1 devstack@n-api.service[129362]: DEBUG oslo_db.sqlalchemy.engines [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:36:56.203508 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_db.sqlalchemy.engines [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:36:56.205501 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writer thread running {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:36:56.207867 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writer thread running {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:36:56.663415 ncdv-master-1 devstack@n-api.service[129361]: WARNING keystonemiddleware.auth_token [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 20:36:56.664460 ncdv-master-1 devstack@n-api.service[129362]: WARNING keystonemiddleware.auth_token [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 20:36:56.671344 ncdv-master-1 devstack@n-api.service[129361]: WARNING keystonemiddleware.auth_token [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 20:36:56.672533 ncdv-master-1 devstack@n-api.service[129362]: WARNING keystonemiddleware.auth_token [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 20:36:56.895531 ncdv-master-1 devstack@n-api.service[129362]: WARNING keystonemiddleware.auth_token [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 20:36:56.898190 ncdv-master-1 devstack@n-api.service[129361]: WARNING keystonemiddleware.auth_token [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 20:36:56.902081 ncdv-master-1 devstack@n-api.service[129362]: WARNING keystonemiddleware.auth_token [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 20:36:56.904888 ncdv-master-1 devstack@n-api.service[129361]: WARNING keystonemiddleware.auth_token [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 20:36:56.907365 ncdv-master-1 devstack@n-api.service[129362]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556c988679c0 pid: 129362 (default app) Sep 10 20:36:56.909405 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:36:56.910223 ncdv-master-1 devstack@n-api.service[129361]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556c988679c0 pid: 129361 (default app) Sep 10 20:36:56.910597 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-2e3d2d14-e905-482a-af36-1b24560aa833 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Sep 10 20:36:56.911203 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Sat Sep 10 20:36:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:38:24.893459 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:24.894641 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Sep 10 20:38:24.898017 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:38:24.906589 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writing DB stats nova_api:SELECT=3 {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:24.907574 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writing DB stats nova_cell0:SELECT=3 {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:24.908859 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writing DB stats nova_cell1:SELECT=3 {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:24.909634 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:25.778560 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-dfa3883e-afa4-4a14-9ecc-60016f87afde admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:25.811413 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-dfa3883e-afa4-4a14-9ecc-60016f87afde admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.909966 Sep 10 20:38:25.812240 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Sep 10 20:38:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:38:28.884231 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:28.885240 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-b8cfaca5-a483-4e20-8fd0-4199ca8dd0ca None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 10 20:38:28.885643 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:38:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:38:29.319089 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-c7e05a4c-bf9b-4fc3-b891-d9c471553950 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256}} {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:29.365941 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-c7e05a4c-bf9b-4fc3-b891-d9c471553950 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.473905 Sep 10 20:38:29.366610 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Sep 10 20:38:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:38:29.380628 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writing DB stats nova_api:SELECT=3 {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:29.381877 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writing DB stats nova_cell0:SELECT=3 {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:29.383716 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writing DB stats nova_cell1:SELECT=3 {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:29.384453 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:29.598552 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-1775add3-7ee0-46a9-a8fc-361b91eaa511 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:29.675942 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-1775add3-7ee0-46a9-a8fc-361b91eaa511 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.300299 Sep 10 20:38:29.676417 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1336 bytes} [Sat Sep 10 20:38:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:38:32.678180 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-c7e05a4c-bf9b-4fc3-b891-d9c471553950 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:32.680346 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-c7e05a4c-bf9b-4fc3-b891-d9c471553950 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002758 Sep 10 20:38:32.686285 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:38:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:38:33.573862 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-dcd1dead-e5ab-46fd-865e-f57df9e1e22e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:33.622040 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-dcd1dead-e5ab-46fd-865e-f57df9e1e22e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.933319 Sep 10 20:38:33.635668 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-aaffa4bb-bff2-4315-b44a-c6683e4d77ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:33.640151 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Sep 10 20:38:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:38:33.683348 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-aaffa4bb-bff2-4315-b44a-c6683e4d77ae admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051907 Sep 10 20:38:33.702367 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1336 bytes} [Sat Sep 10 20:38:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:38:37.102166 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-dcd1dead-e5ab-46fd-865e-f57df9e1e22e admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:37.103173 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-dcd1dead-e5ab-46fd-865e-f57df9e1e22e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001805 Sep 10 20:38:37.103569 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:38:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:38:37.562756 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-25ff43d9-0be4-4dbf-bc37-1b92f9159fde admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "name": "ds1G", "disk": 10, "ram": 1024, "swap": 0}} {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:37.582678 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-25ff43d9-0be4-4dbf-bc37-1b92f9159fde admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472501 Sep 10 20:38:37.583501 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Sep 10 20:38:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:38:37.595721 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-1a04262c-fa08-4242-92a9-3545a67560bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:37.621893 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-1a04262c-fa08-4242-92a9-3545a67560bc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029848 Sep 10 20:38:37.622789 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1336 bytes} [Sat Sep 10 20:38:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:38:40.774262 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-25ff43d9-0be4-4dbf-bc37-1b92f9159fde admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:40.775393 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-25ff43d9-0be4-4dbf-bc37-1b92f9159fde admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Sep 10 20:38:40.775808 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:38:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:38:41.208076 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-6fa492cd-ae44-478b-8f31-4b1747c346d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "swap": 0}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:41.229177 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-6fa492cd-ae44-478b-8f31-4b1747c346d7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446860 Sep 10 20:38:41.229851 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Sep 10 20:38:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:38:41.242927 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-f192c5fc-bfa7-42a8-b334-2c1da97997c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:41.274726 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-f192c5fc-bfa7-42a8-b334-2c1da97997c6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036283 Sep 10 20:38:41.275570 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1336 bytes} [Sat Sep 10 20:38:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:38:44.384986 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-6fa492cd-ae44-478b-8f31-4b1747c346d7 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:44.386034 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-6fa492cd-ae44-478b-8f31-4b1747c346d7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 10 20:38:44.386638 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:38:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:38:44.853428 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-6f7442e1-addf-4816-914a-622fc1a858c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:44.875111 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-6f7442e1-addf-4816-914a-622fc1a858c9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482211 Sep 10 20:38:44.875821 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Sep 10 20:38:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 20:38:44.888452 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-bfdd5165-8c0e-4b66-a509-8fd2e9512049 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:44.914778 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-bfdd5165-8c0e-4b66-a509-8fd2e9512049 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029962 Sep 10 20:38:44.918384 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1336 bytes} [Sat Sep 10 20:38:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:38:47.993794 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-6f7442e1-addf-4816-914a-622fc1a858c9 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:47.994912 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-6f7442e1-addf-4816-914a-622fc1a858c9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Sep 10 20:38:47.995329 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:38:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:38:48.434742 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-2b04a904-a8b8-4329-bb47-56d8ee174e12 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:48.460309 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-2b04a904-a8b8-4329-bb47-56d8ee174e12 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458469 Sep 10 20:38:48.460859 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Sep 10 20:38:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:38:51.444489 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-6f7442e1-addf-4816-914a-622fc1a858c9 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:51.446253 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-6f7442e1-addf-4816-914a-622fc1a858c9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002193 Sep 10 20:38:51.446964 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:38:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:38:51.894014 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-008508d6-c593-49f0-84f1-4b5e632f38f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:51.915023 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-008508d6-c593-49f0-84f1-4b5e632f38f1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.461428 Sep 10 20:38:51.915602 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Sep 10 20:38:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:38:51.930575 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-62cae69e-82cc-46b7-ae0f-8633c6806823 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:51.963313 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-62cae69e-82cc-46b7-ae0f-8633c6806823 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038357 Sep 10 20:38:51.964082 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1333 bytes} [Sat Sep 10 20:38:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:38:55.116259 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-008508d6-c593-49f0-84f1-4b5e632f38f1 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:55.122287 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-008508d6-c593-49f0-84f1-4b5e632f38f1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002281 Sep 10 20:38:55.122287 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:38:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:38:55.531981 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-a2a6cad2-dc32-458d-a46f-33d8725ffb2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:55.538249 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:38:55.552582 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-a2a6cad2-dc32-458d-a46f-33d8725ffb2b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.428568 Sep 10 20:38:55.553143 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Sep 10 20:38:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 20:38:55.566049 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-3585b651-c31b-4bb7-8af9-fe2d4058208e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:55.588704 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-3585b651-c31b-4bb7-8af9-fe2d4058208e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026676 Sep 10 20:38:55.589304 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1333 bytes} [Sat Sep 10 20:38:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:38:58.578054 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-a2a6cad2-dc32-458d-a46f-33d8725ffb2b admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:38:58.579065 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-a2a6cad2-dc32-458d-a46f-33d8725ffb2b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 10 20:38:58.579468 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:38:59.058570 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-77eb03b5-8dd6-44c1-a930-bdfc608165eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "swap": 0, "name": "m1.medium"}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:59.079415 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-77eb03b5-8dd6-44c1-a930-bdfc608165eb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.492793 Sep 10 20:38:59.080108 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Sep 10 20:38:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:38:59.111151 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-bb764c91-2e24-40cb-9908-80deabb7dca5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:38:59.156576 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-bb764c91-2e24-40cb-9908-80deabb7dca5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066625 Sep 10 20:38:59.158223 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1333 bytes} [Sat Sep 10 20:38:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:39:02.132943 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-77eb03b5-8dd6-44c1-a930-bdfc608165eb admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:02.133992 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-77eb03b5-8dd6-44c1-a930-bdfc608165eb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 10 20:39:02.134698 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:02.582926 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-5ca90081-3229-4335-849b-539515fdd3bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:39:02.606189 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-5ca90081-3229-4335-849b-539515fdd3bb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.464827 Sep 10 20:39:02.607417 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Sep 10 20:39:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:39:02.619789 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-bc7d33ac-1f25-44c9-99ea-ff474400e1a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:39:02.626015 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:39:02.648068 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-bc7d33ac-1f25-44c9-99ea-ff474400e1a0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032454 Sep 10 20:39:02.648654 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1333 bytes} [Sat Sep 10 20:39:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:39:05.641884 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-5ca90081-3229-4335-849b-539515fdd3bb admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:05.643604 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-5ca90081-3229-4335-849b-539515fdd3bb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002191 Sep 10 20:39:05.644234 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:39:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:06.138016 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-836e4568-3be8-4f6d-b417-6a7fd500c1bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "ram": 16384, "name": "m1.xlarge"}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:39:06.161588 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-836e4568-3be8-4f6d-b417-6a7fd500c1bc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.509579 Sep 10 20:39:06.176950 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-52656ef7-763f-42c1-ac3b-ab1f84d8169d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:39:06.182077 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Sep 10 20:39:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:39:06.208691 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-52656ef7-763f-42c1-ac3b-ab1f84d8169d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034958 Sep 10 20:39:06.210702 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1333 bytes} [Sat Sep 10 20:39:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:39:25.454872 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-836e4568-3be8-4f6d-b417-6a7fd500c1bc admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:25.455886 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-836e4568-3be8-4f6d-b417-6a7fd500c1bc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 10 20:39:25.456288 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:39:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:25.467547 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:39:25.849739 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-6645e4aa-f45a-4f1c-8a2f-79913183dc86 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:25.868338 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-6645e4aa-f45a-4f1c-8a2f-79913183dc86 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405549 Sep 10 20:39:25.868869 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Sep 10 20:39:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:39:27.779131 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-836e4568-3be8-4f6d-b417-6a7fd500c1bc admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:27.780137 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-836e4568-3be8-4f6d-b417-6a7fd500c1bc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 10 20:39:27.780532 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Sep 10 20:39:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:28.357490 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-e23c3d6a-3b0c-4bb9-bcbd-ca4b83a5d355 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:28.362798 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.wsgi [None req-e23c3d6a-3b0c-4bb9-bcbd-ca4b83a5d355 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-e23c3d6a-3b0c-4bb9-bcbd-ca4b83a5d355 admin admin] Request method failure captured: Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: Accept: application/json Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: Accept-Encoding: gzip, deflate Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: Connection: keep-alive Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: Content-Length: 0 Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: Host: 10.222.0.33 Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: Openstack-Api-Version: compute 2.92 Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: Openstack-System-Scope: None Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: User-Agent: python-novaclient Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Auth-Token: gAAAAABjHPX_mBfXXVECd2mjD3XGP9SB9y3oc1xmPbYH2YZ4uO9swhRjW8h2sLfchB4zg8TB9-3mPok-QT1FFosEYCx3MjU_yeLPBXehSveCJTxt_XjWUdaulmT1QkSRc6iXOtdoZWoxb2cn7LRS3cUyQlrvrrrvqnceFmtlalEI4dxV85SKUzE Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Domain-Id: None Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Domain-Name: None Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Identity-Status: Confirmed Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Is-Admin-Project: True Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Domain-Id: default Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Domain-Name: Default Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Name: admin Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Role: member,admin,reader Sep 10 20:39:28.389273 ncdv-master-1 devstack@n-api.service[129362]: X-Roles: member,admin,reader Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff6cfd9ba910450d96d6133cd5225f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff6cfd9ba910450d96d6133cd5225f2f"}]}] Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: X-Tenant: admin Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: X-Tenant-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: X-Tenant-Name: admin Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: X-User: admin Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: X-User-Domain-Id: default Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: X-User-Domain-Name: Default Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: X-User-Id: cd34ffbc794a4c04a8a5c4f195b6d3b6 Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: X-User-Name: admin Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: method: > Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: exception: Flavor 42 could not be found. Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: action_args: {'id': '42'} Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:39:28.391022 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:28.392247 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:28.393672 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-e23c3d6a-3b0c-4bb9-bcbd-ca4b83a5d355 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=129362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:39:28.395096 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-e23c3d6a-3b0c-4bb9-bcbd-ca4b83a5d355 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.420304 Sep 10 20:39:28.395096 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Sep 10 20:39:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:39:28.400951 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-685260d8-05a4-4df0-adf3-67dd7ebc0208 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:28.412007 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:39:28.423081 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-685260d8-05a4-4df0-adf3-67dd7ebc0208 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025689 Sep 10 20:39:28.423566 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Sep 10 20:39:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:39:28.434307 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-c435ad45-7bbf-49cc-9f48-479fe650e874 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:28.456236 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-c435ad45-7bbf-49cc-9f48-479fe650e874 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026546 Sep 10 20:39:28.456761 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Sep 10 20:39:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:39:28.467558 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-11b864af-191f-47b2-9ecc-d14d35b86afd admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:28.473140 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.wsgi [None req-11b864af-191f-47b2-9ecc-d14d35b86afd admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-11b864af-191f-47b2-9ecc-d14d35b86afd admin admin] Request method failure captured: Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: Accept: application/json Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: Accept-Encoding: gzip, deflate Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: Connection: keep-alive Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: Content-Length: 0 Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: Host: 10.222.0.33 Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: Openstack-Api-Version: compute 2.92 Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: Openstack-System-Scope: None Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: User-Agent: python-novaclient Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Auth-Token: gAAAAABjHPX_mBfXXVECd2mjD3XGP9SB9y3oc1xmPbYH2YZ4uO9swhRjW8h2sLfchB4zg8TB9-3mPok-QT1FFosEYCx3MjU_yeLPBXehSveCJTxt_XjWUdaulmT1QkSRc6iXOtdoZWoxb2cn7LRS3cUyQlrvrrrvqnceFmtlalEI4dxV85SKUzE Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Domain-Id: None Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Domain-Name: None Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Identity-Status: Confirmed Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Is-Admin-Project: True Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Domain-Id: default Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Domain-Name: Default Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Name: admin Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Role: member,admin,reader Sep 10 20:39:28.476463 ncdv-master-1 devstack@n-api.service[129361]: X-Roles: member,admin,reader Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff6cfd9ba910450d96d6133cd5225f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff6cfd9ba910450d96d6133cd5225f2f"}]}] Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: X-Tenant: admin Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: X-Tenant-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: X-Tenant-Name: admin Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: X-User: admin Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: X-User-Domain-Id: default Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: X-User-Domain-Name: Default Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: X-User-Id: cd34ffbc794a4c04a8a5c4f195b6d3b6 Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: X-User-Name: admin Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: method: > Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: exception: Flavor 42 could not be found. Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: action_args: {'id': '42'} Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:39:28.477761 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:28.478602 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:28.479938 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-11b864af-191f-47b2-9ecc-d14d35b86afd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=129361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:39:28.481277 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-11b864af-191f-47b2-9ecc-d14d35b86afd admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014698 Sep 10 20:39:28.481277 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Sep 10 20:39:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:39:30.265163 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-c435ad45-7bbf-49cc-9f48-479fe650e874 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:30.266220 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-c435ad45-7bbf-49cc-9f48-479fe650e874 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 10 20:39:30.266653 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Sep 10 20:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:30.798883 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-85285ae1-2a92-4bcb-aacc-f4d5d1bf66e5 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:30.804585 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.wsgi [None req-85285ae1-2a92-4bcb-aacc-f4d5d1bf66e5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-85285ae1-2a92-4bcb-aacc-f4d5d1bf66e5 admin admin] Request method failure captured: Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: Accept: application/json Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: Accept-Encoding: gzip, deflate Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: Connection: keep-alive Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: Content-Length: 0 Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: Host: 10.222.0.33 Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: Openstack-Api-Version: compute 2.92 Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: Openstack-System-Scope: None Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: User-Agent: python-novaclient Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Auth-Token: gAAAAABjHPYCJODIW6BIS7tvr1Mw2K-ptc54qXw-wTue7Ci4sORK_ieoUsvRAl_T_qvlytYOdvir1cC0-_vH8oZvgF3MvUiW5rwQsfcxpITY-XydUjX73bjwR1jEJUe5GCP9_FfjbhbpmHTrNB6Hbj58dFkxT6WStD1OKdmFO3MtG42X8C3iUeY Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Domain-Id: None Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Domain-Name: None Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Identity-Status: Confirmed Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Is-Admin-Project: True Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Domain-Id: default Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Domain-Name: Default Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Name: admin Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Role: member,admin,reader Sep 10 20:39:30.806137 ncdv-master-1 devstack@n-api.service[129361]: X-Roles: member,admin,reader Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff6cfd9ba910450d96d6133cd5225f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff6cfd9ba910450d96d6133cd5225f2f"}]}] Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: X-Tenant: admin Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: X-Tenant-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: X-Tenant-Name: admin Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: X-User: admin Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: X-User-Domain-Id: default Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: X-User-Domain-Name: Default Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: X-User-Id: cd34ffbc794a4c04a8a5c4f195b6d3b6 Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: X-User-Name: admin Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: method: > Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: exception: Flavor 84 could not be found. Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: action_args: {'id': '84'} Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:39:30.807708 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:30.808717 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:30.810259 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-85285ae1-2a92-4bcb-aacc-f4d5d1bf66e5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=129361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:39:30.811616 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-85285ae1-2a92-4bcb-aacc-f4d5d1bf66e5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393756 Sep 10 20:39:30.811616 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Sep 10 20:39:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:39:30.817065 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-8e6b9d0f-d2d5-475e-958b-c584e34138d7 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:30.835324 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-8e6b9d0f-d2d5-475e-958b-c584e34138d7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021777 Sep 10 20:39:30.835854 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Sep 10 20:39:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:39:30.845574 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-d984f1e2-5275-4966-8f57-d42f47f8df89 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:30.861477 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-d984f1e2-5275-4966-8f57-d42f47f8df89 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019376 Sep 10 20:39:30.862024 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Sep 10 20:39:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:39:30.872047 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-9a114b87-4778-4e83-b2dd-6d0fbfa87436 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:30.876991 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.wsgi [None req-9a114b87-4778-4e83-b2dd-6d0fbfa87436 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-9a114b87-4778-4e83-b2dd-6d0fbfa87436 admin admin] Request method failure captured: Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: Accept: application/json Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: Accept-Encoding: gzip, deflate Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: Connection: keep-alive Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: Content-Length: 0 Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: Host: 10.222.0.33 Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: Openstack-Api-Version: compute 2.92 Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: Openstack-System-Scope: None Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: User-Agent: python-novaclient Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Auth-Token: gAAAAABjHPYCJODIW6BIS7tvr1Mw2K-ptc54qXw-wTue7Ci4sORK_ieoUsvRAl_T_qvlytYOdvir1cC0-_vH8oZvgF3MvUiW5rwQsfcxpITY-XydUjX73bjwR1jEJUe5GCP9_FfjbhbpmHTrNB6Hbj58dFkxT6WStD1OKdmFO3MtG42X8C3iUeY Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Domain-Id: None Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Domain-Name: None Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Identity-Status: Confirmed Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Is-Admin-Project: True Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Domain-Id: default Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Domain-Name: Default Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Name: admin Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Role: member,admin,reader Sep 10 20:39:30.878548 ncdv-master-1 devstack@n-api.service[129362]: X-Roles: member,admin,reader Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff6cfd9ba910450d96d6133cd5225f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff6cfd9ba910450d96d6133cd5225f2f"}]}] Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: X-Tenant: admin Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: X-Tenant-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: X-Tenant-Name: admin Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: X-User: admin Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: X-User-Domain-Id: default Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: X-User-Domain-Name: Default Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: X-User-Id: cd34ffbc794a4c04a8a5c4f195b6d3b6 Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: X-User-Name: admin Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: method: > Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: exception: Flavor 84 could not be found. Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: action_args: {'id': '84'} Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:39:30.880174 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:30.881102 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:30.882246 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-9a114b87-4778-4e83-b2dd-6d0fbfa87436 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=129362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:39:30.883246 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-9a114b87-4778-4e83-b2dd-6d0fbfa87436 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011642 Sep 10 20:39:30.883246 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Sep 10 20:39:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:39:32.666286 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-d984f1e2-5275-4966-8f57-d42f47f8df89 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:32.667210 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-d984f1e2-5275-4966-8f57-d42f47f8df89 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 10 20:39:32.667607 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Sep 10 20:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:33.235657 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-ec0e38ac-fffe-4b99-9874-0b30e5c35fd8 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:33.241496 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.wsgi [None req-ec0e38ac-fffe-4b99-9874-0b30e5c35fd8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-ec0e38ac-fffe-4b99-9874-0b30e5c35fd8 admin admin] Request method failure captured: Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: Accept: application/json Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: Accept-Encoding: gzip, deflate Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: Connection: keep-alive Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: Content-Length: 0 Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: Host: 10.222.0.33 Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: Openstack-Api-Version: compute 2.92 Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: Openstack-System-Scope: None Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: User-Agent: python-novaclient Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Auth-Token: gAAAAABjHPYE7RGchMc-bSKaqFX07JXbR7QoyOzwAIr50fdH2fnWyhgMFR3OfxCMdC-Z1j0eg4WUnVlnJIObr1bvccRrs3vd0jvL4-yG4L1rN52rNGKAzTAbX71DTSh7U2UXncwX3Dzxf2FHcjlyA_0JYNLc62uT2JHJwpvf0S1QhauQUgoWXYU Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Domain-Id: None Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Domain-Name: None Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Identity-Status: Confirmed Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Is-Admin-Project: True Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Domain-Id: default Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Domain-Name: Default Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Project-Name: admin Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Role: member,admin,reader Sep 10 20:39:33.242994 ncdv-master-1 devstack@n-api.service[129362]: X-Roles: member,admin,reader Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff6cfd9ba910450d96d6133cd5225f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff6cfd9ba910450d96d6133cd5225f2f"}]}] Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: X-Tenant: admin Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: X-Tenant-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: X-Tenant-Name: admin Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: X-User: admin Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: X-User-Domain-Id: default Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: X-User-Domain-Name: Default Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: X-User-Id: cd34ffbc794a4c04a8a5c4f195b6d3b6 Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: X-User-Name: admin Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: method: > Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: exception: Flavor 451 could not be found. Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: action_args: {'id': '451'} Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:39:33.244277 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:33.245090 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: ERROR nova.api.openstack.wsgi Sep 10 20:39:33.246341 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-ec0e38ac-fffe-4b99-9874-0b30e5c35fd8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=129362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:39:33.247640 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-ec0e38ac-fffe-4b99-9874-0b30e5c35fd8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.399637 Sep 10 20:39:33.247640 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Sep 10 20:39:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:39:33.254056 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-7beec47d-6a16-4c63-be91-62f37744be4c admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:33.269585 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-7beec47d-6a16-4c63-be91-62f37744be4c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019180 Sep 10 20:39:33.270145 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Sep 10 20:39:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:39:33.280157 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:33.295340 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018648 Sep 10 20:39:33.295856 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Sep 10 20:39:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:39:33.305372 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-72452ad2-7f17-405b-8dec-8eaf7ce58655 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:33.310357 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.wsgi [None req-72452ad2-7f17-405b-8dec-8eaf7ce58655 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-72452ad2-7f17-405b-8dec-8eaf7ce58655 admin admin] Request method failure captured: Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: Accept: application/json Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: Accept-Encoding: gzip, deflate Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: Connection: keep-alive Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: Content-Length: 0 Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: Host: 10.222.0.33 Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: Openstack-Api-Version: compute 2.92 Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: Openstack-System-Scope: None Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: User-Agent: python-novaclient Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Auth-Token: gAAAAABjHPYE7RGchMc-bSKaqFX07JXbR7QoyOzwAIr50fdH2fnWyhgMFR3OfxCMdC-Z1j0eg4WUnVlnJIObr1bvccRrs3vd0jvL4-yG4L1rN52rNGKAzTAbX71DTSh7U2UXncwX3Dzxf2FHcjlyA_0JYNLc62uT2JHJwpvf0S1QhauQUgoWXYU Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Domain-Id: None Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Domain-Name: None Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Identity-Status: Confirmed Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Is-Admin-Project: True Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Domain-Id: default Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Domain-Name: Default Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Project-Name: admin Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Role: member,admin,reader Sep 10 20:39:33.311830 ncdv-master-1 devstack@n-api.service[129361]: X-Roles: member,admin,reader Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff6cfd9ba910450d96d6133cd5225f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff6cfd9ba910450d96d6133cd5225f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff6cfd9ba910450d96d6133cd5225f2f"}]}] Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: X-Tenant: admin Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: X-Tenant-Id: ff6cfd9ba910450d96d6133cd5225f2f Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: X-Tenant-Name: admin Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: X-User: admin Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: X-User-Domain-Id: default Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: X-User-Domain-Name: Default Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: X-User-Id: cd34ffbc794a4c04a8a5c4f195b6d3b6 Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: X-User-Name: admin Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: method: > Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: exception: Flavor 451 could not be found. Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: action_args: {'id': '451'} Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:39:33.313400 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:33.314281 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: ERROR nova.api.openstack.wsgi Sep 10 20:39:33.315338 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-72452ad2-7f17-405b-8dec-8eaf7ce58655 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=129361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:39:33.316379 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-72452ad2-7f17-405b-8dec-8eaf7ce58655 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011713 Sep 10 20:39:33.316379 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Sep 10 20:39:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 10 20:39:35.100579 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:35.101578 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 10 20:39:35.102001 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Sep 10 20:39:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:35.644937 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-0dd70f36-7650-4704-95cc-d844dfe1074f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:39:35.666631 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-0dd70f36-7650-4704-95cc-d844dfe1074f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.416581 Sep 10 20:39:35.667640 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Sat Sep 10 20:39:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:39:37.461248 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:37.462291 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 10 20:39:37.462696 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Sep 10 20:39:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:37.998638 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-b6ce2817-abb1-4fd5-9fd1-141c05ead034 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:39:38.017381 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-b6ce2817-abb1-4fd5-9fd1-141c05ead034 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.403434 Sep 10 20:39:38.017971 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Sat Sep 10 20:39:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:39:39.799229 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:39.800271 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 10 20:39:39.800702 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Sep 10 20:39:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:40.332088 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-6b53ca75-7c0c-4fed-ae7d-5034798051c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:39:40.352193 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-6b53ca75-7c0c-4fed-ae7d-5034798051c6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402347 Sep 10 20:39:40.352735 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Sat Sep 10 20:39:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:39:42.133374 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:42.134495 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Sep 10 20:39:42.134891 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Sep 10 20:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:42.666381 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-f51a619b-d2c0-4ee8-9609-8edde62e5341 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:39:42.685737 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-f51a619b-d2c0-4ee8-9609-8edde62e5341 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402811 Sep 10 20:39:42.686310 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Sat Sep 10 20:39:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:39:44.600586 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:44.601924 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001811 Sep 10 20:39:44.602326 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Sep 10 20:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:39:45.140333 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-eff0eeea-665d-4d06-8a1b-3c3c4f2e981d admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:39:45.160665 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-eff0eeea-665d-4d06-8a1b-3c3c4f2e981d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.409621 Sep 10 20:39:45.161876 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Sat Sep 10 20:39:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:40:51.140578 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:40:51.141594 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-d0cecb82-dd70-44b2-ad11-a540c8cecf81 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 10 20:40:51.142027 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 931 bytes} [Sat Sep 10 20:40:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:40:51.149565 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:40:51.533589 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-ffc78fec-cd22-43b4-9a91-7e5966038702 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:40:51.554827 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-ffc78fec-cd22-43b4-9a91-7e5966038702 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406627 Sep 10 20:40:51.555294 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Sep 10 20:40:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:40:51.576557 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writing DB stats nova_api:SELECT=14 {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:40:51.580310 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-4fe7c7bf-547c-4a8e-9357-1cba72d94fb7 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:40:51.588219 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-4fe7c7bf-547c-4a8e-9357-1cba72d94fb7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013055 Sep 10 20:40:51.588735 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1283 bytes} [Sat Sep 10 20:40:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:40:51.601357 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-afe3b46c-5693-4793-8746-2131e7535b03 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:40:51.608608 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-afe3b46c-5693-4793-8746-2131e7535b03 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011748 Sep 10 20:40:51.609117 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1286 bytes} [Sat Sep 10 20:40:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:40:51.620289 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-77d15471-28e9-4967-a7f6-5aa5c4740031 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:40:51.627339 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-77d15471-28e9-4967-a7f6-5aa5c4740031 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010621 Sep 10 20:40:51.627846 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1286 bytes} [Sat Sep 10 20:40:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:40:51.639001 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-def3a8e0-ad7b-472f-bbf2-c35c9f823f8d admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:40:51.646639 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-def3a8e0-ad7b-472f-bbf2-c35c9f823f8d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011068 Sep 10 20:40:51.647160 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1283 bytes} [Sat Sep 10 20:40:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:46:25.426844 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-77d15471-28e9-4967-a7f6-5aa5c4740031 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:46:25.427856 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-77d15471-28e9-4967-a7f6-5aa5c4740031 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 10 20:46:25.428255 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Sep 10 20:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:46:25.576991 ncdv-master-1 devstack@n-api.service[129361]: DEBUG dbcounter [-] [129361] Writing DB stats nova_api:SELECT=6 {{(pid=129361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:46:25.723543 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-e77f06c1-4251-4335-836b-4debc51f76dc admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:46:25.728109 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-e77f06c1-4251-4335-836b-4debc51f76dc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:46:25.728615 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-e77f06c1-4251-4335-836b-4debc51f76dc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:46:25.729039 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-e77f06c1-4251-4335-836b-4debc51f76dc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:46:25.729745 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-e77f06c1-4251-4335-836b-4debc51f76dc admin admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:46:25.730214 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-e77f06c1-4251-4335-836b-4debc51f76dc admin admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:46:25.730630 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-e77f06c1-4251-4335-836b-4debc51f76dc admin admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:46:25.768203 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-e77f06c1-4251-4335-836b-4debc51f76dc admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.191921 Sep 10 20:46:25.768754 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Sep 10 20:46:25 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:46:27.409288 ncdv-master-1 devstack@n-api.service[129362]: DEBUG nova.api.openstack.wsgi [None req-77d15471-28e9-4967-a7f6-5aa5c4740031 admin admin] Calling method '>' {{(pid=129362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:46:27.410327 ncdv-master-1 devstack@n-api.service[129362]: INFO nova.api.openstack.requestlog [None req-77d15471-28e9-4967-a7f6-5aa5c4740031 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 10 20:46:27.410723 ncdv-master-1 devstack@n-api.service[129362]: [pid: 129362|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Sep 10 20:46:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:46:27.615978 ncdv-master-1 devstack@n-api.service[129361]: DEBUG nova.api.openstack.wsgi [None req-9cb1e0ff-07c4-4bfc-8397-a45cfe448dd8 admin admin] Calling method '>' {{(pid=129361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:46:27.619600 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-9cb1e0ff-07c4-4bfc-8397-a45cfe448dd8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:46:27.620205 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-9cb1e0ff-07c4-4bfc-8397-a45cfe448dd8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:46:27.620625 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-9cb1e0ff-07c4-4bfc-8397-a45cfe448dd8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:46:27.621325 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-9cb1e0ff-07c4-4bfc-8397-a45cfe448dd8 admin admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:46:27.621757 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-9cb1e0ff-07c4-4bfc-8397-a45cfe448dd8 admin admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:46:27.622187 ncdv-master-1 devstack@n-api.service[129361]: DEBUG oslo_concurrency.lockutils [None req-9cb1e0ff-07c4-4bfc-8397-a45cfe448dd8 admin admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:46:27.645656 ncdv-master-1 devstack@n-api.service[129361]: INFO nova.api.openstack.requestlog [None req-9cb1e0ff-07c4-4bfc-8397-a45cfe448dd8 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.085988 Sep 10 20:46:27.646243 ncdv-master-1 devstack@n-api.service[129361]: [pid: 129361|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Sep 10 20:46:27 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:47:15.902358 ncdv-master-1 devstack@n-api.service[129360]: Sat Sep 10 20:47:15 2022 - graceful shutdown triggered... Sep 10 20:47:15.902907 ncdv-master-1 devstack@n-api.service[129362]: Gracefully killing worker 2 (pid: 129362)... Sep 10 20:47:15.902594 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 10 20:47:15.903757 ncdv-master-1 devstack@n-api.service[129361]: Gracefully killing worker 1 (pid: 129361)... Sep 10 20:47:16.037745 ncdv-master-1 devstack@n-api.service[129362]: DEBUG dbcounter [-] [129362] Writing DB stats nova_api:SELECT=4 {{(pid=129362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:47:16.903176 ncdv-master-1 devstack@n-api.service[129360]: worker 1 buried after 1 seconds Sep 10 20:47:16.903176 ncdv-master-1 devstack@n-api.service[129360]: worker 2 buried after 1 seconds Sep 10 20:47:16.903781 ncdv-master-1 devstack@n-api.service[129360]: goodbye to uWSGI. Sep 10 20:47:16.904703 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 10 20:47:16.905322 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 10 20:47:16.908098 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 10 20:47:16.935089 ncdv-master-1 devstack@n-api.service[145754]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 10 20:47:16 2022] *** Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: nodename: ncdv-master-1 Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: machine: x86_64 Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: clock source: unix Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: pcre jit disabled Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: detected number of CPU cores: 4 Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: current working directory: / Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: detected binary path: /usr/bin/uwsgi-core Sep 10 20:47:16.937073 ncdv-master-1 devstack@n-api.service[145754]: your processes number limit is 47680 Sep 10 20:47:16.938025 ncdv-master-1 devstack@n-api.service[145754]: your memory page size is 4096 bytes Sep 10 20:47:16.938025 ncdv-master-1 devstack@n-api.service[145754]: detected max file descriptor number: 2048 Sep 10 20:47:16.938025 ncdv-master-1 devstack@n-api.service[145754]: lock engine: pthread robust mutexes Sep 10 20:47:16.938025 ncdv-master-1 devstack@n-api.service[145754]: thunder lock: enabled Sep 10 20:47:16.938025 ncdv-master-1 devstack@n-api.service[145754]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 10 20:47:16.938025 ncdv-master-1 devstack@n-api.service[145754]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 10 20:47:16.988329 ncdv-master-1 devstack@n-api.service[145754]: Python main interpreter initialized at 0x5599c2fd99c0 Sep 10 20:47:16.988329 ncdv-master-1 devstack@n-api.service[145754]: python threads support enabled Sep 10 20:47:16.988329 ncdv-master-1 devstack@n-api.service[145754]: your server socket listen backlog is limited to 100 connections Sep 10 20:47:16.988630 ncdv-master-1 devstack@n-api.service[145754]: your mercy for graceful operations on workers is 90 seconds Sep 10 20:47:16.988718 ncdv-master-1 devstack@n-api.service[145754]: mapped 403077 bytes (393 KB) for 2 cores Sep 10 20:47:16.988799 ncdv-master-1 devstack@n-api.service[145754]: *** Operational MODE: preforking *** Sep 10 20:47:16.989024 ncdv-master-1 devstack@n-api.service[145754]: *** uWSGI is running in multiple interpreter mode *** Sep 10 20:47:16.989024 ncdv-master-1 devstack@n-api.service[145754]: spawned uWSGI master process (pid: 145754) Sep 10 20:47:16.989231 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 10 20:47:16.989961 ncdv-master-1 devstack@n-api.service[145754]: spawned uWSGI worker 1 (pid: 145771, cores: 1) Sep 10 20:47:16.992660 ncdv-master-1 devstack@n-api.service[145754]: spawned uWSGI worker 2 (pid: 145772, cores: 1) Sep 10 20:47:16.992868 ncdv-master-1 devstack@n-api.service[145754]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 10 20:47:18.325651 ncdv-master-1 devstack@n-api.service[145772]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 20:47:18.326258 ncdv-master-1 devstack@n-api.service[145771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 20:47:19.098400 ncdv-master-1 devstack@n-api.service[145771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:47:19.098400 ncdv-master-1 devstack@n-api.service[145771]: from cryptography.utils import int_from_bytes Sep 10 20:47:19.098686 ncdv-master-1 devstack@n-api.service[145772]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:47:19.098686 ncdv-master-1 devstack@n-api.service[145772]: from cryptography.utils import int_from_bytes Sep 10 20:47:19.098856 ncdv-master-1 devstack@n-api.service[145771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:47:19.098856 ncdv-master-1 devstack@n-api.service[145771]: from cryptography.utils import int_from_bytes Sep 10 20:47:19.099022 ncdv-master-1 devstack@n-api.service[145772]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 20:47:19.099022 ncdv-master-1 devstack@n-api.service[145772]: from cryptography.utils import int_from_bytes Sep 10 20:47:21.603692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 20:47:21.604291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 20:47:21.604566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 20:47:21.604843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 20:47:21.605098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 20:47:21.605484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.605811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.606155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.606476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.606803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.607114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.607429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.607752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.608077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.608339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.608655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.608977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.609298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.609605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.609936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.610262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.610560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 20:47:21.610939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.611056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 20:47:21.611142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.611215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.611435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 20:47:21.611654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.611791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 20:47:21.613149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 20:47:21.613291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.613371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.613453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.613526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.613651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.613735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.613814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.613930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.614006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.614086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.614166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.614244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.614325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.614397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.614475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.614558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.614631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.614979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.615221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.615445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.615674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.615892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.616098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.616318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.616548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.616775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.616996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.617208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.617426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.617643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.617882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.618112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.618361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.618583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.618799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.619017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.619235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.619458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.619674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.619890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.620114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.620357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.620542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.620542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.620857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.621037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.621189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.621362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.621642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.621805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.622034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.622184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.622337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.622488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.622656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.623477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.623645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.623792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.623792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.624073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.624229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.624380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.624524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.624677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.625457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.625636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.625789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.626011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.626168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.626325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.626485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.626485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.626771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.626914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.627058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.627208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.627363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.627513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.627669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.627820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.627969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.628128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.628282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.628435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.628577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.628729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.628891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.629122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.629278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.629423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.629565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.629726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.629887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.630056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.630209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.630352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.630493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.630645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.630797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.630953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.631103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.631247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.631389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.631543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.631745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.631897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.632040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.632040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.632312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.632466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.632618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.632618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.632910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.632910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.633754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.634527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.634788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.634947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.635102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.635251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.635405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.635673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.635830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.635980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.636131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.636275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.636427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.636579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.636734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.636885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.637029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.637178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.637330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.637488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.637639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.637807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.638029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.638183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.638336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.638491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.638652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.638803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.638947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.639096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.639253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.639253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.639526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.639679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.639821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.639973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.640130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.640273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.640414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.640579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.640729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.640879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.641038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.641187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.641338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.641488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.641631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.641869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.642029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.642186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.642329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.642471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.642623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.642781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.642924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.643074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.643847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.644009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.644160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.644318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.644478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.644629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.644894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.645048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.645191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.645352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.645497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.645764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.645999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.646147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.646295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.646446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.646596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.646746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.646905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.647048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.647198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.647425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.647595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.647753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.647896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.648046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.648188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.648330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.648473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.648623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.648776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.648930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.649081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.649081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.649369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.650385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.650566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.650721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.650884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.651101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.651400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.651400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.651699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.651888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.652036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.652191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.652344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.652499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.652649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.652801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.652956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.653100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.653243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.653998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.654166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.654327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.654473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.654617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.654761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.654930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.655377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.655589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.655750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.655750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.656135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.656280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.656424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.656582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.656727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.656876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.657020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.657170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.657313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.657636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.657788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.657788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.658107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.658250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.658413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.658564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.658707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.658849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.658990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.659133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.659302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.659598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.659764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.659910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.660068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.660226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.660381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.660526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.660676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.660820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.660968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.661198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.661344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.661486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.661652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.661796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.661993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.662154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.662298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.662441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.662584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.662733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.662882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.663034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.663184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 20:47:21.663327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.663493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.664257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.664419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.664579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.664738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.664882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.665025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.665239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.665419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.665691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.665912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.666196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.666355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.666512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.666663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.666816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.666973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.667125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.667269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.667412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.667562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.667719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.667871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.668015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.668164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.668308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.668468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.668621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.668764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.668916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.669066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.669217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.669366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.669523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.669675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.669843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.669996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.670139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.670304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.670472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.670624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.670774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.670916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.671060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.671215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.671359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.671510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.671653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.671794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.671986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.672145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.672299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.672449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.672593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.672742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.672892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.673044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.673189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.673332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.673481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.673630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.673790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.673790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.674705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.674861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.675013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.675163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.675318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.675463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.675605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.675859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.676018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.676182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.676432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.676593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.676737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.676886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.677050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.677195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.677353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.677503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.677655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.677799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.678017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.678162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.678316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.678469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.678618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.678762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.678905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.679067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.679217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.679369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.679520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.679713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.679863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.680016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.680187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.680340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.680485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.680634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.681344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.681526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.681678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.681837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.682036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.682200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.682344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.682497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.682642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.682799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.682943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.683086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.683238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.683382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.683543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.683688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.683831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.683992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.684743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.684902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.685046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.685190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.685332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.685483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.685640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.685793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.686192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.686561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.686727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.686873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.687067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.687212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.687355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.687507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.687650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.687815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.687967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.688112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.688262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.688413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.688568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.688730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.688885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.689029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.689171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.689315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.689457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.689609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.689753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.689917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.690064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.690219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.690373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.690607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.690763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.690915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.691059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.691211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.691361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.691516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.691655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.691803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.691803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.691803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.692275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.692440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.692440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.692718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.692868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.692868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.693148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.693291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.693433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.693584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.693857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.694011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.694717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.694879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.695042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.695195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.695338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.695489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.695646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.695791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.695943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.696095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.696352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.697259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.698115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.698281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.698450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.698614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.698772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.698937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.699098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.699257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.699418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.699576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.699734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.699893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.700052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.700210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.700363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.700520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.700693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.700858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.701009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.701009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.701315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.701467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.701625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.701776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.701964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.701964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.702326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.702491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.702668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.702826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.702826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.703120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.703278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.703278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.703588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.703738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.703895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.704046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.704196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.704956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.705147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.705328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.705487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.705648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.705648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.705988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.706141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.706299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.706564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.706731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.706890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.707049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.707209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.707359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.707520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.707670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.707829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.707993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.708160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.708400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.708556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.708715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.708866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.709030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.709182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.709331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.709490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.709660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.709864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.710035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.710187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.710343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.710501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.710501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.710804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.710962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.711128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.711286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.711436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.711594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.711768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.711928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.712731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.712892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.713044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.713201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.713534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.713696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.713874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.714044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.714202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.714361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.714554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.715266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.715419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.715568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.715718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.715878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.716039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.716192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.716342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.716500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.716754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.716921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.716921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.717230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.717389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.717549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.717708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.717932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.718097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.718249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.718417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.718905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.719070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.719231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.719382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.719539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.719701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.719851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.720010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.720168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.720319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.720476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.720637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.720794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.720954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.721111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.721272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.721272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.721575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.721747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.721943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.722099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.722257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.722415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.722565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.722766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.722932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.723091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.723248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.723400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.723557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.723733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.723891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.724048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.724206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.724503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.724682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.725447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.725610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.725610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.725976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.726141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.726292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.726454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.726617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.726617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.727027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.727027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.727331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.727497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.727754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.727754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.728555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.728817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.728982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.729141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.729291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.729455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.729614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.729772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.729946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.730097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.730257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.730417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.730577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.730735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.730894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.731052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.731211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.731369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.731530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.731686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.731848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.731999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.732154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.732399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.732566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.732726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.732921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.733087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.733245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.733410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.733567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.733735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.733910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.734068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.734230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.734391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.734549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.734699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.734857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.735549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.735721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.735880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.736031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.736193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.736344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.736494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.736494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.736795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.736795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.737192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.737192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.737486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.737654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.737814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.737998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.738161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.738324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.738488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.738646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.738646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.739088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.739240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.739401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.739567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.739718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.739876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.740034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.740194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.740194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.740503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.740654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.740804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.740963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.741113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.741264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.741420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.741570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.741738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.741935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.742090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.742242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.742411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.742561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.742717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.742883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.743769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.743933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.744085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.744251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.744411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.744570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.744728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.744889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.745082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.745883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.746051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.746203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.746203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.746509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.746675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.746834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.746991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.747143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.747426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.747587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.747749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.747913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.748137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.748137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.748430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.748582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.748741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.749121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.749289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.749441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.749599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.749765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.749959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.750121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.750283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.750435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.750592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.750830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.750993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.751145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.751303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.751454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.751454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.751454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.751914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.752084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.752351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.752545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.752700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.752866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.752866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.753236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.753396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.753546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.753711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.753893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.754059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.754210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.754368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.754534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.754924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.755095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.755248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.756206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.756378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.756540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.756701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.756852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.756944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.757040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.757137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.757232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.757329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.757572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.757671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.757765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.757868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.757971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.758067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.758154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.758249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.758336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.758429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.758526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.758647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.758737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.758827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.758827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.759325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.759438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.759529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.759779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.759924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.760056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.760187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.760327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.760458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.760594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.760732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.760732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.760992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.761123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.761253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.761389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.761520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.761655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.761802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.762030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.762163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.762293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.762429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.762520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.762620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.762753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.768538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.768688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.768820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.768930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.769037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.769126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.769222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.769309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.769395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.769500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.769591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.769676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.769770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.769981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.770993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.771078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.771171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.771267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.771356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.771442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.771536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.772228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.772505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.772609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.772699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.772883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.772982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.773071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.773164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.773306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.773438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.773713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.774006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.774150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.774412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.777977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.778374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.778454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.778538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.778622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.778704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.778786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.778860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.778936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.779996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.780957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.781984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.782057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.782128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.782211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.782646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.782646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.782646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.782646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.783189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.783468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.783626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.783783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.783943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.784101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.784260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.784409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.784564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.784732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.784888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.785044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.785205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.785363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.785520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.785668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.785870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.786029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.786029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.786328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.786477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.786648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.786851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.787002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.787165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.787323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.787475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.787623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.787779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.787958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.788109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.788265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.788424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.788592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.788759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.788925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.789086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.789235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.789383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.789533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.789688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.789871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.791314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.791573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.791833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.792001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.792162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.792331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.792488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.792639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.792795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.792943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.793100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.793100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.793457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.793613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.793770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.793961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.794119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.794294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.794458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.794608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.794771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.794928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.795077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.795330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.795490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.795604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.795733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.796095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.796248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.796450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.796587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.796700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.796844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.796975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.797086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.797278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.797408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.797531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.797658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.797971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.797971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.797971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.797971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.798437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.798577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.798761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.798883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.798995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.799113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.799248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.799372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.799508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.799709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.800695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.800850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.801093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.801244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.801471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.801612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.801612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.801935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.801935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.802182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.802182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.802422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.802549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.802689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.802818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.802952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.803088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.803219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.803219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.803517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.803649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.803787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.803924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.804053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.804191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.804191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.804191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.804191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.804682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.804809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.804946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.805102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.805226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.805362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.805500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.805629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.805767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.805941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.806111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.806324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.806537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.806837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.806978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.807107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.807246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.807385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.808061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.808209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.808342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.808470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.808599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.808735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.808865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.809002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.809140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.809281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.809421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.809551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.809688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.809845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.809978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.810106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.810248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.810378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.810378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.810680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.810879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.811019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.811225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.811360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.811505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.811635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.811762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.811899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.812043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.812263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.812409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.812541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.812541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.812541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.812916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.813053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.813200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.813331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.813467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.813467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.813774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.813952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.814091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.814221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.814221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.847391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.847621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.847782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.847960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.848131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.848131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.848522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.848673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.849593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.849593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.850145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.850366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.850682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.851004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.851175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.851335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.851492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.851645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.851926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.852204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.852498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.852836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.854255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.854450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.854620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.855035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.855318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.855614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.855893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.856184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.856374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.856583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.856780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.857996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.858102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.858163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.858218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.858361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.858497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.858571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.858686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.858796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.858905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.858984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.859084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.859188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.859395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.859395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.859707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.859782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.859940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.860055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.860179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.860307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.866626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.866806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.866892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.866965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.867964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.868040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.868121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.868253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.868402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.868510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.868605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.868699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.868844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.868926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.868995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.869072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.869142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.869225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.869422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.869422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.869603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.869685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.869755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.869892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.869966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.870925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.871926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.872186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.872284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.872416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.872517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.872619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.872793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.873020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.873174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.873281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.873380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.873475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.873586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.873671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.873742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.873810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.873944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.874888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.875002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.875084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.875156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.875156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.875280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.875348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.875515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.875663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.875751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.875884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.876981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.877096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.877193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.877398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.877503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.877600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.877677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.877677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.877677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.877677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.878195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.878296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.878392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.878499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.878700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.878797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.878870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.879010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.879169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.879314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.879406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.879478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.879559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.879723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.879822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.879915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.880975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.881965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.882913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.883945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.884969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.885941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.886948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.887874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.888897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.889927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.890897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.891949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.892973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.893897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.894980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.895989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.896940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.897986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.898939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.899010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.899078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.899155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.899155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.899155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.899155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.899391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.899460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.899529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=145771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 20:47:21.900533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.900533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.901667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.902373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.902373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.902373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.902373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.902373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.902373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.902373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.902373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.903608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.904263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.904263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 20:47:21.904263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=145772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 20:47:21.952463 ncdv-master-1 devstack@n-api.service[145771]: INFO dbcounter [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Registered counter for database nova_api Sep 10 20:47:21.967833 ncdv-master-1 devstack@n-api.service[145772]: INFO dbcounter [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Registered counter for database nova_api Sep 10 20:47:21.974387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_db.sqlalchemy.engines [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=145771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:47:21.984828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writer thread running {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:47:21.988681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_db.sqlalchemy.engines [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=145772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:47:21.996195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writer thread running {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:47:22.045386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.context [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) {{(pid=145771) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 20:47:22.049327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:47:22.049813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:47:22.051401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:47:22.052162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:47:22.052609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:47:22.054649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:47:22.056632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.context [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) {{(pid=145772) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 20:47:22.057621 ncdv-master-1 devstack@n-api.service[145771]: INFO dbcounter [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Registered counter for database nova_cell0 Sep 10 20:47:22.060762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:47:22.061258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:47:22.062371 ncdv-master-1 devstack@n-api.service[145771]: INFO dbcounter [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Registered counter for database nova_cell1 Sep 10 20:47:22.062903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:47:22.063695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:47:22.064153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:47:22.066369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:47:22.068407 ncdv-master-1 devstack@n-api.service[145772]: INFO dbcounter [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Registered counter for database nova_cell0 Sep 10 20:47:22.069499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_db.sqlalchemy.engines [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=145771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:47:22.072740 ncdv-master-1 devstack@n-api.service[145772]: INFO dbcounter [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Registered counter for database nova_cell1 Sep 10 20:47:22.074446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writer thread running {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:47:22.079318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_db.sqlalchemy.engines [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=145771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:47:22.082575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_db.sqlalchemy.engines [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=145772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:47:22.084065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_db.sqlalchemy.engines [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=145772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:47:22.096228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writer thread running {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:47:22.097541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writer thread running {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:47:22.227544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writer thread running {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:47:22.236956 ncdv-master-1 devstack@n-api.service[145771]: INFO dbcounter [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Registered counter for database nova_cell0 Sep 10 20:47:22.244292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_db.sqlalchemy.engines [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=145771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:47:22.248991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writer thread running {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:47:22.251688 ncdv-master-1 devstack@n-api.service[145772]: INFO dbcounter [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Registered counter for database nova_cell0 Sep 10 20:47:22.258465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_db.sqlalchemy.engines [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=145772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 20:47:22.264330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writer thread running {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 20:47:22.693668 ncdv-master-1 devstack@n-api.service[145771]: WARNING keystonemiddleware.auth_token [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 20:47:22.702381 ncdv-master-1 devstack@n-api.service[145771]: WARNING keystonemiddleware.auth_token [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 20:47:22.709078 ncdv-master-1 devstack@n-api.service[145772]: WARNING keystonemiddleware.auth_token [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 20:47:22.717406 ncdv-master-1 devstack@n-api.service[145772]: WARNING keystonemiddleware.auth_token [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 20:47:22.931871 ncdv-master-1 devstack@n-api.service[145771]: WARNING keystonemiddleware.auth_token [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 20:47:22.937925 ncdv-master-1 devstack@n-api.service[145771]: WARNING keystonemiddleware.auth_token [None req-abe48a6d-f8d4-49b8-b745-0633ca0e7520 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 20:47:22.943186 ncdv-master-1 devstack@n-api.service[145771]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5599c2fd99c0 pid: 145771 (default app) Sep 10 20:47:22.945931 ncdv-master-1 devstack@n-api.service[145772]: WARNING keystonemiddleware.auth_token [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 20:47:22.952836 ncdv-master-1 devstack@n-api.service[145772]: WARNING keystonemiddleware.auth_token [None req-76f8b8be-a351-494b-b66f-8d2aa36cdd08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 20:47:22.957957 ncdv-master-1 devstack@n-api.service[145772]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5599c2fd99c0 pid: 145772 (default app) Sep 10 20:48:03.763470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:03.765234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:03.766258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:03.767214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:05.288414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '.version_select at 0x7f99466a04c0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:05.297094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) {{(pid=145771) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 10 20:48:05.298029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:05.298696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:05.299107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:05.327044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:05.327541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:05.328091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:05.342807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:05.343671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:05.344638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:05.351575 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9ea82621-7928-40bb-a3ec-afe50ad8b538 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.600926 Sep 10 20:48:05.352820 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1/1] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Sep 10 20:48:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:05.646209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-97802ed8-9be7-4796-bd84-14b6f09b421f tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1258390587", "name": "tempest-test_aggregate-506065354"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:05.693059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.aggregate [None req-97802ed8-9be7-4796-bd84-14b6f09b421f tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Generated uuid 109df5a8-76e7-421c-9bff-2c59ff99cd4c for aggregate {{(pid=145772) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:05.703538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:05.704754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:05.705601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:05.707424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:05.828348 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-97802ed8-9be7-4796-bd84-14b6f09b421f tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.458439 Sep 10 20:48:05.829270 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1/2] 10.222.0.33 () {60 vars in 1165 bytes} [Sat Sep 10 20:48:05 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:05.841247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91d2da50-6a79-43a6-bfeb-03990af7b4d9 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:05.870305 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91d2da50-6a79-43a6-bfeb-03990af7b4d9 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.032779 Sep 10 20:48:05.884978 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:48:05 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:05.891347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-66a7e2ed-5825-4272-8c1d-08d9e77d0015 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:05.920658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66a7e2ed-5825-4272-8c1d-08d9e77d0015 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:05.921255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66a7e2ed-5825-4272-8c1d-08d9e77d0015 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:05.921944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66a7e2ed-5825-4272-8c1d-08d9e77d0015 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:06.804475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-43c03383-8e3f-4165-883d-2e88bb0bc679 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:06.813660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43c03383-8e3f-4165-883d-2e88bb0bc679 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:06.814879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43c03383-8e3f-4165-883d-2e88bb0bc679 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:06.815495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43c03383-8e3f-4165-883d-2e88bb0bc679 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:06.816404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43c03383-8e3f-4165-883d-2e88bb0bc679 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:06.817043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43c03383-8e3f-4165-883d-2e88bb0bc679 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:06.817620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43c03383-8e3f-4165-883d-2e88bb0bc679 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:06.878560 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-43c03383-8e3f-4165-883d-2e88bb0bc679 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.691554 Sep 10 20:48:06.879704 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3/4] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Sep 10 20:48:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:48:07.115451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Calling method '.version_select at 0x7f994651e310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:07.120250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.121039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.121710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.152501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.153068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.153576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.194834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.195353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.195870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.209502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.210339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.210976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.224863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.225263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.225905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.232779 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-77cd3385-ac6e-4e4c-ac97-67e5f0eef1df tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 0.351896 Sep 10 20:48:07.233602 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 4/5] 10.222.0.33 () {60 vars in 1243 bytes} [Sat Sep 10 20:48:06 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:48:07.248053 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-66a7e2ed-5825-4272-8c1d-08d9e77d0015 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 1.361654 Sep 10 20:48:07.248750 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2/6] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:05 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:07.304890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a028175-a217-4d68-bf87-c0a95aea8e77 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:07.307900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a028175-a217-4d68-bf87-c0a95aea8e77 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.308808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a028175-a217-4d68-bf87-c0a95aea8e77 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.310431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a028175-a217-4d68-bf87-c0a95aea8e77 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.311954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a028175-a217-4d68-bf87-c0a95aea8e77 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.312538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a028175-a217-4d68-bf87-c0a95aea8e77 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.313736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a028175-a217-4d68-bf87-c0a95aea8e77 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.355578 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a028175-a217-4d68-bf87-c0a95aea8e77 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.120670 Sep 10 20:48:07.356978 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 5/7] 10.222.0.33 () {58 vars in 1164 bytes} [Sat Sep 10 20:48:07 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:07.395679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Calling method '.version_select at 0x7f9945c26f70>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:07.406138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) {{(pid=145772) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 10 20:48:07.406950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.407429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.407865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.423972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.424758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.425208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.437516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.437917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.438925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.439965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-78538bbd-6fc7-4a53-aee3-65dabd316d24 tempest-FlavorsV255TestJSON-836041490 tempest-FlavorsV255TestJSON-836041490-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1172243228", "id": 346311386, "os-flavor-access:is_public": "True"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:07.445756 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0503ee3-d3d4-415f-82a0-41932a10f563 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.195264 Sep 10 20:48:07.446460 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3/8] 10.222.0.33 () {60 vars in 1208 bytes} [Sat Sep 10 20:48:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:48:07.503800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Calling method '.version_select at 0x7f9945c37160>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:07.510779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.511562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.512202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.518156 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-78538bbd-6fc7-4a53-aee3-65dabd316d24 tempest-FlavorsV255TestJSON-836041490 tempest-FlavorsV255TestJSON-836041490-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.159044 Sep 10 20:48:07.519163 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 6/9] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:48:07 2022] POST /compute/v2.1/flavors => generated 446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:07.524027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Calling method '.version_select at 0x7f9946466790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:07.529059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.529597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.530090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.531160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.531851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.532512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.544877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.545054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.545379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.545810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.545987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.546640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.553340 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8085361f-e547-4539-a726-e9f7711c7e94 tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.105677 Sep 10 20:48:07.554510 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 4/10] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Sep 10 20:48:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:07.560459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f9b2f83-b9e4-4640-9437-5e8996d3d959 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:07.562532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f9b2f83-b9e4-4640-9437-5e8996d3d959 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.563204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f9b2f83-b9e4-4640-9437-5e8996d3d959 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.563820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f9b2f83-b9e4-4640-9437-5e8996d3d959 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.564754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f9b2f83-b9e4-4640-9437-5e8996d3d959 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.565387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f9b2f83-b9e4-4640-9437-5e8996d3d959 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.566064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f9b2f83-b9e4-4640-9437-5e8996d3d959 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.568467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.569236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.569751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.588622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.589290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.589740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.601642 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f9b2f83-b9e4-4640-9437-5e8996d3d959 tempest-AZAdminV2TestJSON-1920990553 tempest-AZAdminV2TestJSON-1920990553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 702 microversion: 2.1 time: 0.045925 Sep 10 20:48:07.613136 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 5/11] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Sep 10 20:48:07 2022] GET /compute/v2.1/os-availability-zone/detail => generated 702 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:07.630282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.631160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.631851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.642831 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-31ad5ea2-c3fe-4be7-a172-412ed820e529 tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.122449 Sep 10 20:48:07.643977 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 7/12] 10.222.0.33 () {60 vars in 1222 bytes} [Sat Sep 10 20:48:07 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:07.708433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-504496909", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "availability_zone": "tempest-test_az-1258390587"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:07.758064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.759297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.760344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.761256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.761986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.762656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:07.887375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab677217-2ecc-44e7-b497-280101b9fb88 tempest-FlavorsV255TestJSON-944582895 tempest-FlavorsV255TestJSON-944582895-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:07.942641 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab677217-2ecc-44e7-b497-280101b9fb88 tempest-FlavorsV255TestJSON-944582895 tempest-FlavorsV255TestJSON-944582895-project] 10.222.0.33 "GET /compute/v2.1/flavors/346311386" status: 200 len: 446 microversion: 2.55 time: 0.293654 Sep 10 20:48:07.943376 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 8/13] 10.222.0.33 () {60 vars in 1196 bytes} [Sat Sep 10 20:48:07 2022] GET /compute/v2.1/flavors/346311386 => generated 446 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:07.950244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3f0d746-bde7-4e21-ba48-7f86bed00f1c tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Calling method '.version_select at 0x7f9946428b80>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:07.952980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3f0d746-bde7-4e21-ba48-7f86bed00f1c tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:07.953637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3f0d746-bde7-4e21-ba48-7f86bed00f1c tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:07.954296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3f0d746-bde7-4e21-ba48-7f86bed00f1c tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:08.007420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3f0d746-bde7-4e21-ba48-7f86bed00f1c tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:08.007926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3f0d746-bde7-4e21-ba48-7f86bed00f1c tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:08.008371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3f0d746-bde7-4e21-ba48-7f86bed00f1c tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:08.025513 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3f0d746-bde7-4e21-ba48-7f86bed00f1c tempest-HypervisorAdminV228Test-887138064 tempest-HypervisorAdminV228Test-887138064-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.080879 Sep 10 20:48:08.037949 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 9/14] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Sep 10 20:48:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:08.037949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-75abfefb-9983-47bf-8704-0644dfb9a83c tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Calling method '.version_select at 0x7f99464465e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:08.047369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75abfefb-9983-47bf-8704-0644dfb9a83c tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:08.047941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75abfefb-9983-47bf-8704-0644dfb9a83c tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:08.048399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75abfefb-9983-47bf-8704-0644dfb9a83c tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:08.092204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75abfefb-9983-47bf-8704-0644dfb9a83c tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:08.092710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75abfefb-9983-47bf-8704-0644dfb9a83c tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:08.093153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75abfefb-9983-47bf-8704-0644dfb9a83c tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:08.112430 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-75abfefb-9983-47bf-8704-0644dfb9a83c tempest-HypervisorAdminV253TestBase-1992018451 tempest-HypervisorAdminV253TestBase-1992018451-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1e1d01bd-0245-423e-9dec-a0f15954c0ed" status: 200 len: 791 microversion: 2.53 time: 0.085135 Sep 10 20:48:08.116465 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 10/15] 10.222.0.33 () {60 vars in 1298 bytes} [Sat Sep 10 20:48:08 2022] GET /compute/v2.1/os-hypervisors/1e1d01bd-0245-423e-9dec-a0f15954c0ed => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:08.128260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f32a6651-2abc-4e55-b8ec-13bc2f7775c4 tempest-FlavorsV255TestJSON-836041490 tempest-FlavorsV255TestJSON-836041490-project-admin] Action: 'update', calling method: .version_select at 0x7f9946a5c1f0>, body: {"flavor": {"description": "new"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:08.225488 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f32a6651-2abc-4e55-b8ec-13bc2f7775c4 tempest-FlavorsV255TestJSON-836041490 tempest-FlavorsV255TestJSON-836041490-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/346311386" status: 200 len: 447 microversion: 2.55 time: 0.107786 Sep 10 20:48:08.240423 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 11/16] 10.222.0.33 () {62 vars in 1216 bytes} [Sat Sep 10 20:48:08 2022] PUT /compute/v2.1/flavors/346311386 => generated 447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:08.247620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8dd5ddf4-0de2-4311-bcd9-5621ca2ff23e tempest-FlavorsV255TestJSON-944582895 tempest-FlavorsV255TestJSON-944582895-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:08.331537 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8dd5ddf4-0de2-4311-bcd9-5621ca2ff23e tempest-FlavorsV255TestJSON-944582895 tempest-FlavorsV255TestJSON-944582895-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.088786 Sep 10 20:48:08.332554 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 12/17] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Sep 10 20:48:08 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:48:08.357928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ffc55e4e-07ba-47c1-8ac8-73fcbae5c1cb tempest-FlavorsV255TestJSON-944582895 tempest-FlavorsV255TestJSON-944582895-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:08.391590 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ffc55e4e-07ba-47c1-8ac8-73fcbae5c1cb tempest-FlavorsV255TestJSON-944582895 tempest-FlavorsV255TestJSON-944582895-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.041518 Sep 10 20:48:08.393258 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 13/18] 10.222.0.33 () {60 vars in 1166 bytes} [Sat Sep 10 20:48:08 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:48:08.414961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2bc0c648-b48e-40f7-8761-1ac4ee48335c tempest-FlavorsV255TestJSON-836041490 tempest-FlavorsV255TestJSON-836041490-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:08.464404 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2bc0c648-b48e-40f7-8761-1ac4ee48335c tempest-FlavorsV255TestJSON-836041490 tempest-FlavorsV255TestJSON-836041490-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/346311386" status: 202 len: 0 microversion: 2.55 time: 0.054665 Sep 10 20:48:08.467303 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 14/19] 10.222.0.33 () {60 vars in 1199 bytes} [Sat Sep 10 20:48:08 2022] DELETE /compute/v2.1/flavors/346311386 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:48:08.486922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-35348dbf-5481-498e-bed5-63067ccdd7ee tempest-FlavorsV255TestJSON-836041490 tempest-FlavorsV255TestJSON-836041490-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:08.583052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:48:08.589720 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-35348dbf-5481-498e-bed5-63067ccdd7ee tempest-FlavorsV255TestJSON-836041490 tempest-FlavorsV255TestJSON-836041490-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.115217 Sep 10 20:48:08.601246 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 15/20] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Sep 10 20:48:08 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:48:09.642523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:48:09.643503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:48:09.643940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:48:09.644542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:48:09.645151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:48:09.672285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:09.675927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:09.676722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:09.677804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:09.682855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:09.683652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:09.741173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Getting quotas for project 5f6c275f77df48e196553dbc20db8ed9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:48:09.751779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Getting quotas for user 736fcd7811e341468d7080da18b011ea and project 5f6c275f77df48e196553dbc20db8ed9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:48:09.767026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:48:09.770621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:48:09.889062 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea4761be-2311-416e-abca-1494785d35df tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.274456 Sep 10 20:48:09.895292 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 6/21] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:48:09.904215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5930248a-514d-49a5-b352-702ef180ff6f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:09.905465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5930248a-514d-49a5-b352-702ef180ff6f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:11.237900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5930248a-514d-49a5-b352-702ef180ff6f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:11.270036 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5930248a-514d-49a5-b352-702ef180ff6f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1242 microversion: 2.1 time: 1.371396 Sep 10 20:48:11.270948 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 16/22] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:09 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1242 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:12.300560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1dd8beac-e4bf-4e42-a49e-3176de5a9b6a tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:12.301793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1dd8beac-e4bf-4e42-a49e-3176de5a9b6a tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:12.344726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dd8beac-e4bf-4e42-a49e-3176de5a9b6a tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:12.350918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dd8beac-e4bf-4e42-a49e-3176de5a9b6a tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:12.352613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dd8beac-e4bf-4e42-a49e-3176de5a9b6a tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:12.358262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dd8beac-e4bf-4e42-a49e-3176de5a9b6a tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:12.363254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dd8beac-e4bf-4e42-a49e-3176de5a9b6a tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:12.363968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dd8beac-e4bf-4e42-a49e-3176de5a9b6a tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:12.755291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1dd8beac-e4bf-4e42-a49e-3176de5a9b6a tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:12.792293 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1dd8beac-e4bf-4e42-a49e-3176de5a9b6a tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1234 microversion: 2.1 time: 0.496619 Sep 10 20:48:12.806092 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 7/23] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:12 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1234 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:13.821892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3e7eaef-24da-41f2-988d-77da02a235a3 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:13.823232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b3e7eaef-24da-41f2-988d-77da02a235a3 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:13.843911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e7eaef-24da-41f2-988d-77da02a235a3 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:13.848347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e7eaef-24da-41f2-988d-77da02a235a3 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:13.848810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e7eaef-24da-41f2-988d-77da02a235a3 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:13.851644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e7eaef-24da-41f2-988d-77da02a235a3 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:13.854244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e7eaef-24da-41f2-988d-77da02a235a3 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:13.855021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e7eaef-24da-41f2-988d-77da02a235a3 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:14.156239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b3e7eaef-24da-41f2-988d-77da02a235a3 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:14.177900 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b3e7eaef-24da-41f2-988d-77da02a235a3 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1296 microversion: 2.1 time: 0.357754 Sep 10 20:48:14.178850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 17/24] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:13 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1296 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:15.203876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bd64a80b-6ac2-4bc5-9903-798fb071498e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:15.205167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bd64a80b-6ac2-4bc5-9903-798fb071498e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:15.221426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd64a80b-6ac2-4bc5-9903-798fb071498e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:15.225367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd64a80b-6ac2-4bc5-9903-798fb071498e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:15.227956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd64a80b-6ac2-4bc5-9903-798fb071498e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:15.228832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd64a80b-6ac2-4bc5-9903-798fb071498e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:15.234811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd64a80b-6ac2-4bc5-9903-798fb071498e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:15.236504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd64a80b-6ac2-4bc5-9903-798fb071498e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:15.480531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bd64a80b-6ac2-4bc5-9903-798fb071498e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:15.502374 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bd64a80b-6ac2-4bc5-9903-798fb071498e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1296 microversion: 2.1 time: 0.300733 Sep 10 20:48:15.518814 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 8/25] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:15 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1296 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:16.528396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4fc0df4e-4b3b-464f-87ac-d4ca0d97f0e4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:16.529266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4fc0df4e-4b3b-464f-87ac-d4ca0d97f0e4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:16.549574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fc0df4e-4b3b-464f-87ac-d4ca0d97f0e4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:16.550115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fc0df4e-4b3b-464f-87ac-d4ca0d97f0e4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:16.550710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fc0df4e-4b3b-464f-87ac-d4ca0d97f0e4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:16.551439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fc0df4e-4b3b-464f-87ac-d4ca0d97f0e4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:16.551895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fc0df4e-4b3b-464f-87ac-d4ca0d97f0e4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:16.552327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fc0df4e-4b3b-464f-87ac-d4ca0d97f0e4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:17.216334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4fc0df4e-4b3b-464f-87ac-d4ca0d97f0e4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:17.225857 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4fc0df4e-4b3b-464f-87ac-d4ca0d97f0e4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.701998 Sep 10 20:48:17.242331 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 18/26] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:16 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:17.950967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a6a71a0-2164-469d-b099-d95d2002579c tempest-FlavorMetadataValidation-1594768825 tempest-FlavorMetadataValidation-1594768825-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1411061937", "id": 814709408, "os-flavor-access:is_public": "True"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:18.048106 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a6a71a0-2164-469d-b099-d95d2002579c tempest-FlavorMetadataValidation-1594768825 tempest-FlavorMetadataValidation-1594768825-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.714854 Sep 10 20:48:18.058235 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 9/27] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:48:17 2022] POST /compute/v2.1/flavors => generated 468 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:18.073640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0020577f-fe73-4f78-bc39-b6369df874d4 tempest-FlavorMetadataValidation-1594768825 tempest-FlavorMetadataValidation-1594768825-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:18.270515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dfdfed3d-03e7-47c0-9705-9b056ba79af0 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:18.271542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dfdfed3d-03e7-47c0-9705-9b056ba79af0 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:18.289225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfdfed3d-03e7-47c0-9705-9b056ba79af0 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:18.290738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfdfed3d-03e7-47c0-9705-9b056ba79af0 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:18.293802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfdfed3d-03e7-47c0-9705-9b056ba79af0 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:18.295744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfdfed3d-03e7-47c0-9705-9b056ba79af0 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:18.299667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfdfed3d-03e7-47c0-9705-9b056ba79af0 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:18.301395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfdfed3d-03e7-47c0-9705-9b056ba79af0 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:18.611029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:18.665445 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0020577f-fe73-4f78-bc39-b6369df874d4 tempest-FlavorMetadataValidation-1594768825 tempest-FlavorMetadataValidation-1594768825-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/814709408/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.596700 Sep 10 20:48:18.668514 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 19/28] 10.222.0.33 () {62 vars in 1262 bytes} [Sat Sep 10 20:48:18 2022] POST /compute/v2.1/flavors/814709408/os-extra_specs => generated 62 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:19.122623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dfdfed3d-03e7-47c0-9705-9b056ba79af0 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:19.131678 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dfdfed3d-03e7-47c0-9705-9b056ba79af0 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.868287 Sep 10 20:48:19.140809 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 10/29] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:18 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:19.160891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a6be152e-3c37-42d8-9246-d0623da3ded7 tempest-FlavorMetadataValidation-1594768825 tempest-FlavorMetadataValidation-1594768825-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:19.241545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9430775-26d4-4549-b453-c6ee74fa9f30 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Calling method '.version_select at 0x7f994637e9d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:19.244562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a9430775-26d4-4549-b453-c6ee74fa9f30 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '2cb680a77e4549499bf8f2616686d147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137b68e3885041a6bac6f4a55d96cf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:19.254528 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a6be152e-3c37-42d8-9246-d0623da3ded7 tempest-FlavorMetadataValidation-1594768825 tempest-FlavorMetadataValidation-1594768825-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/814709408" status: 202 len: 0 microversion: 2.86 time: 0.106697 Sep 10 20:48:19.259537 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 11/30] 10.222.0.33 () {60 vars in 1199 bytes} [Sat Sep 10 20:48:19 2022] DELETE /compute/v2.1/flavors/814709408 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9430775-26d4-4549-b453-c6ee74fa9f30 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Request method failure captured: Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgOswuZ0Lh1TYzstREPsW-JP0Tu6DgxQim4G4xd-rK6N7TKmanidQO5nktwouBslGc_Vg_E1GcU4ISIS7NmGWsZyhAno7CJfQ01KqkKzQg5niqGL5MJCa-eF-G-lPaxWaEkJCBMkp_c7wAlJQ747VFO6bE8D-A6CP9keJzTqB5YPPM Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 137b68e3885041a6bac6f4a55d96cf92 Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:48:19.265656 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/137b68e3885041a6bac6f4a55d96cf92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/137b68e3885041a6bac6f4a55d96cf92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_137b68e3885041a6bac6f4a55d96cf92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/137b68e3885041a6bac6f4a55d96cf92"}]}] Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 137b68e3885041a6bac6f4a55d96cf92 Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HypervisorAdminNegativeTestJSON-1529658980-project Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2cb680a77e4549499bf8f2616686d147 Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980-project Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: action_args: {} Sep 10 20:48:19.267228 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:48:19.268229 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 10 20:48:19.270460 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:19.272834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9430775-26d4-4549-b453-c6ee74fa9f30 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:19.272834 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9430775-26d4-4549-b453-c6ee74fa9f30 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.598614 Sep 10 20:48:19.281349 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 20/31] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Sep 10 20:48:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 612 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:48:19.415316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b5278330-eabe-4b8a-a074-8245f01e5aa4 tempest-QuotaClassesAdmin257Test-249807628 tempest-QuotaClassesAdmin257Test-249807628-project-admin] Calling method '.version_select at 0x7f9945ae2f70>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:19.422966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-674201491", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:19.451280 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b5278330-eabe-4b8a-a074-8245f01e5aa4 tempest-QuotaClassesAdmin257Test-249807628 tempest-QuotaClassesAdmin257Test-249807628-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.191718 Sep 10 20:48:19.455064 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 12/32] 10.222.0.33 () {60 vars in 1226 bytes} [Sat Sep 10 20:48:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:19.467848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-55014a4b-2931-4830-a685-a796f9100ae6 tempest-FlavorMetadataValidation-1594768825 tempest-FlavorMetadataValidation-1594768825-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:19.553902 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-55014a4b-2931-4830-a685-a796f9100ae6 tempest-FlavorMetadataValidation-1594768825 tempest-FlavorMetadataValidation-1594768825-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.097500 Sep 10 20:48:19.574493 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 13/33] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Sep 10 20:48:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:48:19.579691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:48:19.584458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7036f29a-c7c0-4fc0-b676-e67a632ce4d3 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Calling method '.version_select at 0x7f9945a28430>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:19.589897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7036f29a-c7c0-4fc0-b676-e67a632ce4d3 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '2cb680a77e4549499bf8f2616686d147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137b68e3885041a6bac6f4a55d96cf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7036f29a-c7c0-4fc0-b676-e67a632ce4d3 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Request method failure captured: Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgOswuZ0Lh1TYzstREPsW-JP0Tu6DgxQim4G4xd-rK6N7TKmanidQO5nktwouBslGc_Vg_E1GcU4ISIS7NmGWsZyhAno7CJfQ01KqkKzQg5niqGL5MJCa-eF-G-lPaxWaEkJCBMkp_c7wAlJQ747VFO6bE8D-A6CP9keJzTqB5YPPM Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 137b68e3885041a6bac6f4a55d96cf92 Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:48:19.602921 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/137b68e3885041a6bac6f4a55d96cf92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/137b68e3885041a6bac6f4a55d96cf92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_137b68e3885041a6bac6f4a55d96cf92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/137b68e3885041a6bac6f4a55d96cf92"}]}] Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 137b68e3885041a6bac6f4a55d96cf92 Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HypervisorAdminNegativeTestJSON-1529658980-project Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2cb680a77e4549499bf8f2616686d147 Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980-project Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: action_args: {} Sep 10 20:48:19.605125 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:48:19.605861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 10 20:48:19.606947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:19.607881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7036f29a-c7c0-4fc0-b676-e67a632ce4d3 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:19.607881 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7036f29a-c7c0-4fc0-b676-e67a632ce4d3 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.031150 Sep 10 20:48:19.626558 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 14/34] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:48:19 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:48:19.650882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e9f68715-60f5-4da2-afe9-85bceebed202 tempest-QuotaClassesAdmin257Test-249807628 tempest-QuotaClassesAdmin257Test-249807628-project-admin] Action: 'update', calling method: .version_select at 0x7f99459c7820>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:20.194743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:20.567509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=12,nova_api:DELETE=3,nova_api:UPDATE=5 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:20.715480 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e9f68715-60f5-4da2-afe9-85bceebed202 tempest-QuotaClassesAdmin257Test-249807628 tempest-QuotaClassesAdmin257Test-249807628-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.087219 Sep 10 20:48:20.724264 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 15/35] 10.222.0.33 () {62 vars in 1247 bytes} [Sat Sep 10 20:48:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:20.748817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6cec233c-2155-4928-8c22-38a7042dba57 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Calling method '.version_select at 0x7f9946dfbd30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:20.753556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6cec233c-2155-4928-8c22-38a7042dba57 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '2cb680a77e4549499bf8f2616686d147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137b68e3885041a6bac6f4a55d96cf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6cec233c-2155-4928-8c22-38a7042dba57 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Request method failure captured: Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgOswuZ0Lh1TYzstREPsW-JP0Tu6DgxQim4G4xd-rK6N7TKmanidQO5nktwouBslGc_Vg_E1GcU4ISIS7NmGWsZyhAno7CJfQ01KqkKzQg5niqGL5MJCa-eF-G-lPaxWaEkJCBMkp_c7wAlJQ747VFO6bE8D-A6CP9keJzTqB5YPPM Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 137b68e3885041a6bac6f4a55d96cf92 Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:48:20.760584 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/137b68e3885041a6bac6f4a55d96cf92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/137b68e3885041a6bac6f4a55d96cf92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_137b68e3885041a6bac6f4a55d96cf92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/137b68e3885041a6bac6f4a55d96cf92"}]}] Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 137b68e3885041a6bac6f4a55d96cf92 Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HypervisorAdminNegativeTestJSON-1529658980-project Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2cb680a77e4549499bf8f2616686d147 Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980-project Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: action_args: {} Sep 10 20:48:20.762007 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:48:20.762825 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 10 20:48:20.763974 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:20.765021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6cec233c-2155-4928-8c22-38a7042dba57 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:20.765325 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6cec233c-2155-4928-8c22-38a7042dba57 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.039804 Sep 10 20:48:20.766377 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 16/36] 10.222.0.33 () {58 vars in 1179 bytes} [Sat Sep 10 20:48:20 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:48:20.787755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ef234d6c-f441-4865-ae42-6758cbeb1228 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:20.792384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ef234d6c-f441-4865-ae42-6758cbeb1228 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:20.819356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef234d6c-f441-4865-ae42-6758cbeb1228 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:20.819878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef234d6c-f441-4865-ae42-6758cbeb1228 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:20.820333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef234d6c-f441-4865-ae42-6758cbeb1228 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:20.827291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef234d6c-f441-4865-ae42-6758cbeb1228 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:20.827869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef234d6c-f441-4865-ae42-6758cbeb1228 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:20.828389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef234d6c-f441-4865-ae42-6758cbeb1228 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:21.063041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:48:21.064070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:48:21.064729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:48:21.065381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:48:21.066932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:48:21.105039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:21.105464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:21.105944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:21.106680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:21.107139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:21.107574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:21.490628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ef234d6c-f441-4865-ae42-6758cbeb1228 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:21.505063 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ef234d6c-f441-4865-ae42-6758cbeb1228 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.737062 Sep 10 20:48:21.521328 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 17/37] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:20 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:21.536772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Getting quotas for project 35ef1b5d5dba4e3c93d8bb622ff79c5e. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:48:21.560835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Getting quotas for user 5aab292e925940568e9e5db8b6910f45 and project 35ef1b5d5dba4e3c93d8bb622ff79c5e. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:48:21.593238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:48:21.603985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:48:21.619500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-5259be93-7855-4062-9000-42a62a23a03c req-ed4e3dd4-7a31-41d1-a774-78c094029437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5119493a-5eb3-44c8-9686-4ad614bf2686", "tag": "19c987e4-aeb3-4c2e-bae3-505f5ec166e2"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:21.658524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5259be93-7855-4062-9000-42a62a23a03c req-ed4e3dd4-7a31-41d1-a774-78c094029437 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:21.659038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5259be93-7855-4062-9000-42a62a23a03c req-ed4e3dd4-7a31-41d1-a774-78c094029437 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:21.662762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5259be93-7855-4062-9000-42a62a23a03c req-ed4e3dd4-7a31-41d1-a774-78c094029437 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:21.722486 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-5259be93-7855-4062-9000-42a62a23a03c req-ed4e3dd4-7a31-41d1-a774-78c094029437 service nova] Creating event network-changed:19c987e4-aeb3-4c2e-bae3-505f5ec166e2 for instance 5119493a-5eb3-44c8-9686-4ad614bf2686 on nch2-master-1 Sep 10 20:48:21.724368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5259be93-7855-4062-9000-42a62a23a03c req-ed4e3dd4-7a31-41d1-a774-78c094029437 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 20:48:21.724736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5259be93-7855-4062-9000-42a62a23a03c req-ed4e3dd4-7a31-41d1-a774-78c094029437 service nova] Acquired lock "compute-rpcapi-router" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 20:48:21.725860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e529329-7b43-489d-99c4-3d48884c11b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:21.728799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e529329-7b43-489d-99c4-3d48884c11b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:21.729255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e529329-7b43-489d-99c4-3d48884c11b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:21.730220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e529329-7b43-489d-99c4-3d48884c11b5 None None] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:21.730954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e529329-7b43-489d-99c4-3d48884c11b5 None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:21.731412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e529329-7b43-489d-99c4-3d48884c11b5 None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:21.779543 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.compute.rpcapi [None req-0e529329-7b43-489d-99c4-3d48884c11b5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 10 20:48:21.780783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e529329-7b43-489d-99c4-3d48884c11b5 None None] Releasing lock "compute-rpcapi-router" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 20:48:21.839905 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0e529329-7b43-489d-99c4-3d48884c11b5 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317284 Sep 10 20:48:21.845742 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 18/38] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:21.853811 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c064f4ff-27b4-4724-a294-1d3f5a0fb54d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.570740 Sep 10 20:48:21.855918 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 21/39] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:48:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:48:21.860432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-077ac8bf-7da4-40cc-b5c0-ed09a66d6105 tempest-QuotaClassesAdmin257Test-249807628 tempest-QuotaClassesAdmin257Test-249807628-project-admin] Calling method '.version_select at 0x7f9945a28940>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:21.905694 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-077ac8bf-7da4-40cc-b5c0-ed09a66d6105 tempest-QuotaClassesAdmin257Test-249807628 tempest-QuotaClassesAdmin257Test-249807628-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.058286 Sep 10 20:48:21.915177 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 19/40] 10.222.0.33 () {60 vars in 1226 bytes} [Sat Sep 10 20:48:21 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:21.947998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1071d1e8-57f2-4ed1-918c-6294c9a11e69 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:21.954018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1071d1e8-57f2-4ed1-918c-6294c9a11e69 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:22.358155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1071d1e8-57f2-4ed1-918c-6294c9a11e69 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:22.415838 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1071d1e8-57f2-4ed1-918c-6294c9a11e69 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1218 microversion: 2.1 time: 0.496027 Sep 10 20:48:22.416456 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 20/41] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:21 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1218 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:22.418949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Calling method '.version_select at 0x7f99461d1ee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:22.421543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:22.422298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:22.422958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:22.450601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c9b4ed1-283a-4aae-8f92-5d4b63d01e69 tempest-QuotaClassesAdmin257Test-249807628 tempest-QuotaClassesAdmin257Test-249807628-project-admin] Action: 'update', calling method: .version_select at 0x7f9945a28d30>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:22.463334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:22.465105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:22.465975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:22.466785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:22.500095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:22.503159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:22.504630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:22.532596 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5608a66f-fca5-420d-98c9-c5cdcc468c0b tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.675180 Sep 10 20:48:22.538002 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 22/42] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:48:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:22.563939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ff93d86-c945-4a08-9695-773975022519 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:22.565814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ff93d86-c945-4a08-9695-773975022519 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:22.581866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ff93d86-c945-4a08-9695-773975022519 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:22.584775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ff93d86-c945-4a08-9695-773975022519 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:22.586861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ff93d86-c945-4a08-9695-773975022519 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:22.587687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ff93d86-c945-4a08-9695-773975022519 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:22.589210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ff93d86-c945-4a08-9695-773975022519 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:22.591595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ff93d86-c945-4a08-9695-773975022519 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:22.708996 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c9b4ed1-283a-4aae-8f92-5d4b63d01e69 tempest-QuotaClassesAdmin257Test-249807628 tempest-QuotaClassesAdmin257Test-249807628-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.289958 Sep 10 20:48:22.712586 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 21/43] 10.222.0.33 () {62 vars in 1247 bytes} [Sat Sep 10 20:48:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:22.775734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8d253af-9f15-4e80-b614-5f332b206fdc tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Calling method '.version_select at 0x7f99459d6a60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:22.794658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d8d253af-9f15-4e80-b614-5f332b206fdc tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '2cb680a77e4549499bf8f2616686d147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137b68e3885041a6bac6f4a55d96cf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8d253af-9f15-4e80-b614-5f332b206fdc tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Request method failure captured: Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgOswuZ0Lh1TYzstREPsW-JP0Tu6DgxQim4G4xd-rK6N7TKmanidQO5nktwouBslGc_Vg_E1GcU4ISIS7NmGWsZyhAno7CJfQ01KqkKzQg5niqGL5MJCa-eF-G-lPaxWaEkJCBMkp_c7wAlJQ747VFO6bE8D-A6CP9keJzTqB5YPPM Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 137b68e3885041a6bac6f4a55d96cf92 Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:48:22.804742 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/137b68e3885041a6bac6f4a55d96cf92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/137b68e3885041a6bac6f4a55d96cf92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_137b68e3885041a6bac6f4a55d96cf92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/137b68e3885041a6bac6f4a55d96cf92"}]}] Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 137b68e3885041a6bac6f4a55d96cf92 Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HypervisorAdminNegativeTestJSON-1529658980-project Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2cb680a77e4549499bf8f2616686d147 Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980-project Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '1'} Sep 10 20:48:22.806495 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:48:22.807149 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 10 20:48:22.808253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.809420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8d253af-9f15-4e80-b614-5f332b206fdc tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:22.811584 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d8d253af-9f15-4e80-b614-5f332b206fdc tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.096595 Sep 10 20:48:22.816509 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 22/44] 10.222.0.33 () {58 vars in 1173 bytes} [Sat Sep 10 20:48:22 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 102 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:48:22.835924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-782d539a-1e97-4ae0-b610-3cf36255e29c tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Calling method '.version_select at 0x7f99459d3430>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:22.845643 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-782d539a-1e97-4ae0-b610-3cf36255e29c tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] HTTP exception thrown: Hypervisor with ID 'b2be1673-8b0e-459e-babc-35a64efb0e6d' could not be found. Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-782d539a-1e97-4ae0-b610-3cf36255e29c tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Request method failure captured: Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hypervisors/b2be1673-8b0e-459e-babc-35a64efb0e6d/uptime HTTP/1.1 Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgSl0uMSN5HedTqouTxFQUke2s-8xh1VjX56dqdUa_KU5Ee5ZnlXqDM7p9kZGIFuwTSNbod7Yv0xsvXr4cQXJ_XnW3ULyI2jK4wkudrKiGyARvMUydDB0R-O8Zc-L-jZK-znxw-aF8ULl7M-YngCrjTNMnN0kbperPv3-NPIvbZ-vE Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 6f0a69129cee4059b288fa530eb3c195 Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-750818833 Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:48:22.852279 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6f0a69129cee4059b288fa530eb3c195"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6f0a69129cee4059b288fa530eb3c195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6f0a69129cee4059b288fa530eb3c195", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6f0a69129cee4059b288fa530eb3c195"}]}] Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-750818833 Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 6f0a69129cee4059b288fa530eb3c195 Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-750818833 Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4826a2055974462f9251416540a7212c Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: exception: Hypervisor with ID 'b2be1673-8b0e-459e-babc-35a64efb0e6d' could not be found. Sep 10 20:48:22.853731 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b2be1673-8b0e-459e-babc-35a64efb0e6d'} Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b2be1673-8b0e-459e-babc-35a64efb0e6d' Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 10 20:48:22.854480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b2be1673-8b0e-459e-babc-35a64efb0e6d' could not be found. Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:22.855557 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.856815 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:22.856815 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:22.856815 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:22.856815 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:48:22.856815 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:48:22.856815 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b2be1673-8b0e-459e-babc-35a64efb0e6d' could not be found. Sep 10 20:48:22.856815 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:22.856815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-782d539a-1e97-4ae0-b610-3cf36255e29c tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Returning 404 to user: Hypervisor with ID 'b2be1673-8b0e-459e-babc-35a64efb0e6d' could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:22.859080 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-782d539a-1e97-4ae0-b610-3cf36255e29c tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/b2be1673-8b0e-459e-babc-35a64efb0e6d/uptime" status: 404 len: 123 microversion: 2.1 time: 0.037946 Sep 10 20:48:22.866101 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 23/45] 10.222.0.33 () {58 vars in 1278 bytes} [Sat Sep 10 20:48:22 2022] GET /compute/v2.1/os-hypervisors/b2be1673-8b0e-459e-babc-35a64efb0e6d/uptime => generated 123 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:48:22.873208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Calling method '.version_select at 0x7f9946dfbdc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:22.900017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:22.900521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:22.900977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:22.941444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:22.941969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:22.942422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:22.989715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:22.999297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:22.999781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:23.006549 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-266c2037-b023-4a6a-8fec-4e7922f93dee tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.139268 Sep 10 20:48:23.007158 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 24/46] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:48:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:23.025392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae41f76f-d516-4db0-8f53-0b53dbe83110 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Calling method '.version_select at 0x7f99459d6a60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:23.027413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ae41f76f-d516-4db0-8f53-0b53dbe83110 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '2cb680a77e4549499bf8f2616686d147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137b68e3885041a6bac6f4a55d96cf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae41f76f-d516-4db0-8f53-0b53dbe83110 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Request method failure captured: Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgOswuZ0Lh1TYzstREPsW-JP0Tu6DgxQim4G4xd-rK6N7TKmanidQO5nktwouBslGc_Vg_E1GcU4ISIS7NmGWsZyhAno7CJfQ01KqkKzQg5niqGL5MJCa-eF-G-lPaxWaEkJCBMkp_c7wAlJQ747VFO6bE8D-A6CP9keJzTqB5YPPM Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 137b68e3885041a6bac6f4a55d96cf92 Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:48:23.028989 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/137b68e3885041a6bac6f4a55d96cf92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/137b68e3885041a6bac6f4a55d96cf92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_137b68e3885041a6bac6f4a55d96cf92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/137b68e3885041a6bac6f4a55d96cf92"}]}] Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 137b68e3885041a6bac6f4a55d96cf92 Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980 Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HypervisorAdminNegativeTestJSON-1529658980-project Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2cb680a77e4549499bf8f2616686d147 Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1529658980-project Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '1'} Sep 10 20:48:23.030143 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:48:23.030860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 10 20:48:23.031806 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.032751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae41f76f-d516-4db0-8f53-0b53dbe83110 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:23.032751 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ae41f76f-d516-4db0-8f53-0b53dbe83110 tempest-HypervisorAdminNegativeTestJSON-1529658980 tempest-HypervisorAdminNegativeTestJSON-1529658980-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015471 Sep 10 20:48:23.042181 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 25/47] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:48:23.047003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f2301e7-4044-4a62-99d9-e58a0f4d98e8 tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Calling method '.version_select at 0x7f99459d38b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:23.048611 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-2f2301e7-4044-4a62-99d9-e58a0f4d98e8 tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] HTTP exception thrown: Hypervisor with ID '20863e00-e134-4cc6-b041-5808c0dffe88' could not be found. Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f2301e7-4044-4a62-99d9-e58a0f4d98e8 tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Request method failure captured: Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hypervisors/20863e00-e134-4cc6-b041-5808c0dffe88 HTTP/1.1 Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgSl0uMSN5HedTqouTxFQUke2s-8xh1VjX56dqdUa_KU5Ee5ZnlXqDM7p9kZGIFuwTSNbod7Yv0xsvXr4cQXJ_XnW3ULyI2jK4wkudrKiGyARvMUydDB0R-O8Zc-L-jZK-znxw-aF8ULl7M-YngCrjTNMnN0kbperPv3-NPIvbZ-vE Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 6f0a69129cee4059b288fa530eb3c195 Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-750818833 Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:48:23.050343 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6f0a69129cee4059b288fa530eb3c195"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6f0a69129cee4059b288fa530eb3c195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6f0a69129cee4059b288fa530eb3c195", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6f0a69129cee4059b288fa530eb3c195"}]}] Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-750818833 Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 6f0a69129cee4059b288fa530eb3c195 Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-750818833 Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4826a2055974462f9251416540a7212c Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: exception: Hypervisor with ID '20863e00-e134-4cc6-b041-5808c0dffe88' could not be found. Sep 10 20:48:23.051382 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '20863e00-e134-4cc6-b041-5808c0dffe88'} Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '20863e00-e134-4cc6-b041-5808c0dffe88' Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 10 20:48:23.051996 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:48:23.053137 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '20863e00-e134-4cc6-b041-5808c0dffe88' could not be found. Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '20863e00-e134-4cc6-b041-5808c0dffe88' could not be found. Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f2301e7-4044-4a62-99d9-e58a0f4d98e8 tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] Returning 404 to user: Hypervisor with ID '20863e00-e134-4cc6-b041-5808c0dffe88' could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:23.054130 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f2301e7-4044-4a62-99d9-e58a0f4d98e8 tempest-HypervisorAdminNegativeTestJSON-750818833 tempest-HypervisorAdminNegativeTestJSON-750818833-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/20863e00-e134-4cc6-b041-5808c0dffe88" status: 404 len: 123 microversion: 2.1 time: 0.008351 Sep 10 20:48:23.058900 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 26/48] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Sep 10 20:48:23 2022] GET /compute/v2.1/os-hypervisors/20863e00-e134-4cc6-b041-5808c0dffe88 => generated 123 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:48:23.241068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1ff93d86-c945-4a08-9695-773975022519 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:23.260905 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ff93d86-c945-4a08-9695-773975022519 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.712765 Sep 10 20:48:23.262319 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 23/49] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:22 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:23.442168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07b41d9f-6773-4561-9310-d924f584fa97 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:23.443365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-07b41d9f-6773-4561-9310-d924f584fa97 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:23.731615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-07b41d9f-6773-4561-9310-d924f584fa97 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:23.741514 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-07b41d9f-6773-4561-9310-d924f584fa97 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1218 microversion: 2.1 time: 0.303853 Sep 10 20:48:23.767467 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 27/50] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:23 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1218 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:24.295447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7fe06936-4bfe-4ffa-a3e4-b4898a255fbf tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:24.297226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7fe06936-4bfe-4ffa-a3e4-b4898a255fbf tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:24.308289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fe06936-4bfe-4ffa-a3e4-b4898a255fbf tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:24.316170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fe06936-4bfe-4ffa-a3e4-b4898a255fbf tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:24.318292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fe06936-4bfe-4ffa-a3e4-b4898a255fbf tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:24.322224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fe06936-4bfe-4ffa-a3e4-b4898a255fbf tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:24.324402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fe06936-4bfe-4ffa-a3e4-b4898a255fbf tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:24.325925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fe06936-4bfe-4ffa-a3e4-b4898a255fbf tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:24.771094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a2b759ac-a803-4042-a5f2-6eb105ed071c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:24.772016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a2b759ac-a803-4042-a5f2-6eb105ed071c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:24.793267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2b759ac-a803-4042-a5f2-6eb105ed071c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:24.796307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2b759ac-a803-4042-a5f2-6eb105ed071c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:24.797019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2b759ac-a803-4042-a5f2-6eb105ed071c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:24.798899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2b759ac-a803-4042-a5f2-6eb105ed071c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:24.803812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2b759ac-a803-4042-a5f2-6eb105ed071c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:24.804805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2b759ac-a803-4042-a5f2-6eb105ed071c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:24.983862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a2b759ac-a803-4042-a5f2-6eb105ed071c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:25.002871 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a2b759ac-a803-4042-a5f2-6eb105ed071c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1270 microversion: 2.1 time: 0.235862 Sep 10 20:48:25.003535 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 28/51] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:24 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:25.249493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7fe06936-4bfe-4ffa-a3e4-b4898a255fbf tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:25.273036 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7fe06936-4bfe-4ffa-a3e4-b4898a255fbf tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.986874 Sep 10 20:48:25.292697 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 24/52] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:24 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:26.036454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d05c3db-b1e7-49a0-ae6c-c0927e160a4e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:26.037818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d05c3db-b1e7-49a0-ae6c-c0927e160a4e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:26.062816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d05c3db-b1e7-49a0-ae6c-c0927e160a4e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:26.063380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d05c3db-b1e7-49a0-ae6c-c0927e160a4e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:26.063839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d05c3db-b1e7-49a0-ae6c-c0927e160a4e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:26.070677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d05c3db-b1e7-49a0-ae6c-c0927e160a4e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:26.071194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d05c3db-b1e7-49a0-ae6c-c0927e160a4e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:26.073849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d05c3db-b1e7-49a0-ae6c-c0927e160a4e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:26.301195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e7020fde-28c0-48b7-a35d-6bcb93586f08 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:26.302528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e7020fde-28c0-48b7-a35d-6bcb93586f08 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:26.311267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7020fde-28c0-48b7-a35d-6bcb93586f08 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:26.320596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7020fde-28c0-48b7-a35d-6bcb93586f08 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:26.339418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7020fde-28c0-48b7-a35d-6bcb93586f08 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:26.340529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7020fde-28c0-48b7-a35d-6bcb93586f08 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:26.344134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7020fde-28c0-48b7-a35d-6bcb93586f08 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:26.347611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7020fde-28c0-48b7-a35d-6bcb93586f08 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:26.353899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d05c3db-b1e7-49a0-ae6c-c0927e160a4e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:26.366657 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d05c3db-b1e7-49a0-ae6c-c0927e160a4e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1276 microversion: 2.1 time: 0.337670 Sep 10 20:48:26.393226 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 29/53] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:26 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1276 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:27.102782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e7020fde-28c0-48b7-a35d-6bcb93586f08 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:27.137919 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e7020fde-28c0-48b7-a35d-6bcb93586f08 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.840718 Sep 10 20:48:27.140004 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 25/54] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:26 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:27.401679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96e5db2f-c79c-4f8a-94b5-3aa64005d946 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:27.403398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96e5db2f-c79c-4f8a-94b5-3aa64005d946 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:27.415166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96e5db2f-c79c-4f8a-94b5-3aa64005d946 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:27.422280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96e5db2f-c79c-4f8a-94b5-3aa64005d946 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:27.423036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96e5db2f-c79c-4f8a-94b5-3aa64005d946 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:27.424110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96e5db2f-c79c-4f8a-94b5-3aa64005d946 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:27.425365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96e5db2f-c79c-4f8a-94b5-3aa64005d946 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:27.431084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96e5db2f-c79c-4f8a-94b5-3aa64005d946 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:27.678931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-96e5db2f-c79c-4f8a-94b5-3aa64005d946 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:27.691805 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96e5db2f-c79c-4f8a-94b5-3aa64005d946 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1276 microversion: 2.1 time: 0.294572 Sep 10 20:48:27.692543 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 30/55] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:27 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1276 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:28.175960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6a0c82a1-255b-407c-a549-5400328f8b22 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:28.175960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6a0c82a1-255b-407c-a549-5400328f8b22 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:28.184376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a0c82a1-255b-407c-a549-5400328f8b22 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:28.186229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a0c82a1-255b-407c-a549-5400328f8b22 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:28.190586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a0c82a1-255b-407c-a549-5400328f8b22 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:28.191874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a0c82a1-255b-407c-a549-5400328f8b22 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:28.195920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a0c82a1-255b-407c-a549-5400328f8b22 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:28.198384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a0c82a1-255b-407c-a549-5400328f8b22 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:28.569779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6a0c82a1-255b-407c-a549-5400328f8b22 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:28.605783 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6a0c82a1-255b-407c-a549-5400328f8b22 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.440810 Sep 10 20:48:28.620039 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 31/56] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:28 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:28.638503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c3ed5c0-ba02-43ab-9da4-1888de681279 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:28.662047 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c3ed5c0-ba02-43ab-9da4-1888de681279 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.936701 Sep 10 20:48:28.663439 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 26/57] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:48:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:28.718912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fad32a7e-3ad9-439c-93c7-707685cec217 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:28.720114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fad32a7e-3ad9-439c-93c7-707685cec217 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:28.733430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad32a7e-3ad9-439c-93c7-707685cec217 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:28.734245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad32a7e-3ad9-439c-93c7-707685cec217 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:28.734851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad32a7e-3ad9-439c-93c7-707685cec217 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:28.735708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad32a7e-3ad9-439c-93c7-707685cec217 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:28.736306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad32a7e-3ad9-439c-93c7-707685cec217 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:28.736877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad32a7e-3ad9-439c-93c7-707685cec217 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:29.108463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fad32a7e-3ad9-439c-93c7-707685cec217 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:29.122160 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fad32a7e-3ad9-439c-93c7-707685cec217 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.407500 Sep 10 20:48:29.122754 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 27/58] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:28 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:48:29.474741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c89901cf-ae2a-4cb2-99ec-ae9548c05490 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-2023971292", "id": 1345878817, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:29.536744 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c89901cf-ae2a-4cb2-99ec-ae9548c05490 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.861720 Sep 10 20:48:29.547181 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 32/59] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:48:28 2022] POST /compute/v2.1/flavors => generated 425 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:29.553306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b37d64a1-ed23-438a-91b5-bde4223d0756 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:29.573687 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b37d64a1-ed23-438a-91b5-bde4223d0756 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024157 Sep 10 20:48:29.580212 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 28/60] 10.222.0.33 () {58 vars in 1182 bytes} [Sat Sep 10 20:48:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 20:48:29.587582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-abe9e266-4d0d-432b-814e-1ed7d8fd85d2 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-884352033", "id": 1216379191, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:29.638323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f16b23d8-ab4e-468c-9cc8-9187011c007d tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:29.639366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f16b23d8-ab4e-468c-9cc8-9187011c007d tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:29.656501 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-abe9e266-4d0d-432b-814e-1ed7d8fd85d2 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.071624 Sep 10 20:48:29.658072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16b23d8-ab4e-468c-9cc8-9187011c007d tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:29.661289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16b23d8-ab4e-468c-9cc8-9187011c007d tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:29.662680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16b23d8-ab4e-468c-9cc8-9187011c007d tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:29.664013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16b23d8-ab4e-468c-9cc8-9187011c007d tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:29.665079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16b23d8-ab4e-468c-9cc8-9187011c007d tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:29.666348 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 33/61] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:48:29 2022] POST /compute/v2.1/flavors => generated 424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:29.666985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16b23d8-ab4e-468c-9cc8-9187011c007d tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:29.672336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-55990f55-9a92-4949-901d-23942de115e5 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:29.691657 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-55990f55-9a92-4949-901d-23942de115e5 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022513 Sep 10 20:48:29.703152 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 34/62] 10.222.0.33 () {58 vars in 1182 bytes} [Sat Sep 10 20:48:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:48:29.710103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1ef3deaf-48d9-437a-a8bb-f9c1e1a76760 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Action: 'create', calling method: .version_select at 0x7f99459d3a60>, body: {"keypair": {"name": "tempest-keypair-272195699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIASAqX8Jdu7YwLuyeBOwbQFXSi5AZolmt1cYWC9GieHysjc3UDJTf7v1LlZlbGq+PUVJENs9u3txktb3U1z3jiD71jtfqQPwOHEasWPwsNdK/sQJOxF0lv33uUoXjJVUg=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:29.750708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-1ef3deaf-48d9-437a-a8bb-f9c1e1a76760 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Getting quotas for project d44361bde7c94fb6b01d992a8df306bb. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:48:29.761873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-1ef3deaf-48d9-437a-a8bb-f9c1e1a76760 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Getting quotas for user a020e015186b4c32950c2d4edd26374e and project d44361bde7c94fb6b01d992a8df306bb. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:48:29.827661 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1ef3deaf-48d9-437a-a8bb-f9c1e1a76760 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122365 Sep 10 20:48:29.829628 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 35/63] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:48:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:29.944722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f16b23d8-ab4e-468c-9cc8-9187011c007d tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:29.959242 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f16b23d8-ab4e-468c-9cc8-9187011c007d tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.330034 Sep 10 20:48:29.960589 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 29/64] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:29 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:30.146616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d33694a1-3684-44c5-8ec7-31741e81044a tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:30.147228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d33694a1-3684-44c5-8ec7-31741e81044a tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:30.163784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d33694a1-3684-44c5-8ec7-31741e81044a tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:30.168135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d33694a1-3684-44c5-8ec7-31741e81044a tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:30.168676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d33694a1-3684-44c5-8ec7-31741e81044a tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:30.172623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d33694a1-3684-44c5-8ec7-31741e81044a tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:30.173754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d33694a1-3684-44c5-8ec7-31741e81044a tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:30.174732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d33694a1-3684-44c5-8ec7-31741e81044a tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:30.665282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d33694a1-3684-44c5-8ec7-31741e81044a tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:30.678322 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d33694a1-3684-44c5-8ec7-31741e81044a tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.535763 Sep 10 20:48:30.703141 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 36/65] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:30 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:30.984431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5949f364-b3b7-46e5-87fc-6e5155941440 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:30.985759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5949f364-b3b7-46e5-87fc-6e5155941440 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:31.001033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5949f364-b3b7-46e5-87fc-6e5155941440 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:31.001540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5949f364-b3b7-46e5-87fc-6e5155941440 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:31.002029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5949f364-b3b7-46e5-87fc-6e5155941440 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:31.002760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5949f364-b3b7-46e5-87fc-6e5155941440 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:31.003225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5949f364-b3b7-46e5-87fc-6e5155941440 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:31.015907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5949f364-b3b7-46e5-87fc-6e5155941440 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:31.466258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:31.582822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:31.717163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-06507616-0e22-419a-9ee1-d9e86572f303 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:31.718508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-06507616-0e22-419a-9ee1-d9e86572f303 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:31.728506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06507616-0e22-419a-9ee1-d9e86572f303 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:31.729727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06507616-0e22-419a-9ee1-d9e86572f303 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:31.730914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06507616-0e22-419a-9ee1-d9e86572f303 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:31.732043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06507616-0e22-419a-9ee1-d9e86572f303 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:31.732813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06507616-0e22-419a-9ee1-d9e86572f303 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:31.734515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06507616-0e22-419a-9ee1-d9e86572f303 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:31.780258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:32.081839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-06507616-0e22-419a-9ee1-d9e86572f303 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:32.102294 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-06507616-0e22-419a-9ee1-d9e86572f303 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.393737 Sep 10 20:48:32.115057 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 37/66] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:31 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:32.403863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5949f364-b3b7-46e5-87fc-6e5155941440 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:32.416038 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5949f364-b3b7-46e5-87fc-6e5155941440 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 1.436173 Sep 10 20:48:32.420896 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 30/67] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:30 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:32.785195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-80f8fe32-77fb-462c-a1a2-34136c7bcb7e req-76e88a9f-b467-47d0-8283-cccc66a94be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc1d5b2-4eff-42cc-a465-634307e9e709", "tag": "1a068c83-2810-4505-a299-728cb8f0897d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:32.832657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-80f8fe32-77fb-462c-a1a2-34136c7bcb7e req-76e88a9f-b467-47d0-8283-cccc66a94be3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:32.836168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-80f8fe32-77fb-462c-a1a2-34136c7bcb7e req-76e88a9f-b467-47d0-8283-cccc66a94be3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:32.840527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-80f8fe32-77fb-462c-a1a2-34136c7bcb7e req-76e88a9f-b467-47d0-8283-cccc66a94be3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:32.885139 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-80f8fe32-77fb-462c-a1a2-34136c7bcb7e req-76e88a9f-b467-47d0-8283-cccc66a94be3 service nova] Creating event network-changed:1a068c83-2810-4505-a299-728cb8f0897d for instance 1fc1d5b2-4eff-42cc-a465-634307e9e709 on nch1-master-1 Sep 10 20:48:32.899829 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-80f8fe32-77fb-462c-a1a2-34136c7bcb7e req-76e88a9f-b467-47d0-8283-cccc66a94be3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133820 Sep 10 20:48:32.909407 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 38/68] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:33.130319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f97067b9-ba9e-4d24-a4b2-93eb1653e4e3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:33.131262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f97067b9-ba9e-4d24-a4b2-93eb1653e4e3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:33.156742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f97067b9-ba9e-4d24-a4b2-93eb1653e4e3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:33.162581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f97067b9-ba9e-4d24-a4b2-93eb1653e4e3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:33.165722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f97067b9-ba9e-4d24-a4b2-93eb1653e4e3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:33.169338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f97067b9-ba9e-4d24-a4b2-93eb1653e4e3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:33.173916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f97067b9-ba9e-4d24-a4b2-93eb1653e4e3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:33.177668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f97067b9-ba9e-4d24-a4b2-93eb1653e4e3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:33.445894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3a1b2454-7a42-4bab-aac6-57838dbc84f9 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:33.447530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3a1b2454-7a42-4bab-aac6-57838dbc84f9 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:33.475061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a1b2454-7a42-4bab-aac6-57838dbc84f9 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:33.476434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a1b2454-7a42-4bab-aac6-57838dbc84f9 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:33.478190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a1b2454-7a42-4bab-aac6-57838dbc84f9 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:33.480139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a1b2454-7a42-4bab-aac6-57838dbc84f9 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:33.483020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a1b2454-7a42-4bab-aac6-57838dbc84f9 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:33.486219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a1b2454-7a42-4bab-aac6-57838dbc84f9 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:33.738104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f97067b9-ba9e-4d24-a4b2-93eb1653e4e3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:33.749470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:33.761777 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f97067b9-ba9e-4d24-a4b2-93eb1653e4e3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.636770 Sep 10 20:48:33.762405 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 31/69] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:33 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:33.837532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a1b2454-7a42-4bab-aac6-57838dbc84f9 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:33.846436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:33.850017 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3a1b2454-7a42-4bab-aac6-57838dbc84f9 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.408924 Sep 10 20:48:33.858135 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 39/70] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:33 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:48:34.145272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0f16539e-3bec-4df4-8b91-802f10fb9d8b tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Action: 'create', calling method: .version_select at 0x7f99461e40d0>, body: {"keypair": {"name": "tempest-keypair-862508572", "type": "ssh", "user_id": "4d9dac03431042fdb0471dd37639e70d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAYGRN2EfJMYBMYZcvwfSpuyEYkpKMxi3eZm//09+ubab4XQ/kXmR6FGn4gixUFs37juX/sc9Q1vH3Gvsq4fx2trm28lYX/SnBNieTP40EWJolHsIw7OMt7NiNd5nthbQ=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:34.261045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1682061790", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "1216379191", "adminPass": "***", "networks": [{"uuid": "5e87cad0-4417-4e0d-9afb-caf4350c61cd"}], "security_groups": [{"name": "tempest-securitygroup--1980315777"}], "key_name": "tempest-keypair-272195699", "user_data": "}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:34.274681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-0f16539e-3bec-4df4-8b91-802f10fb9d8b tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Getting quotas for project 8e3a52bb0e284901a617bc95fdeda3e6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:48:34.304255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-0f16539e-3bec-4df4-8b91-802f10fb9d8b tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Getting quotas for user e56a8d8d4a384d9fa32951e5ec4a07ba and project 8e3a52bb0e284901a617bc95fdeda3e6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:48:34.451312 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0f16539e-3bec-4df4-8b91-802f10fb9d8b tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.645302 Sep 10 20:48:34.452620 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 32/71] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Sep 10 20:48:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 648 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 10 20:48:34.465818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c97b0200-068b-4f53-8a74-52948513d8be tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Action: 'create', calling method: .version_select at 0x7f99461d1f70>, body: {"keypair": {"name": "tempest-keypair-540131304", "type": "ssh", "user_id": "4d9dac03431042fdb0471dd37639e70d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4EY9zpSYp3d/95OZ9IWoVkBp0zlChS93vPVRpxNv9uvDbsmJ5+ngPR18Xep9+abZfNTliPEzAoGjvI1rb0MqCeFECcHSvMoIeXacxHG0/u1p8NamfSMY3k6Sy7uiNxQw=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:34.507282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c97b0200-068b-4f53-8a74-52948513d8be tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Getting quotas for project 8e3a52bb0e284901a617bc95fdeda3e6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:48:34.517064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c97b0200-068b-4f53-8a74-52948513d8be tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Getting quotas for user e56a8d8d4a384d9fa32951e5ec4a07ba and project 8e3a52bb0e284901a617bc95fdeda3e6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:48:34.572211 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c97b0200-068b-4f53-8a74-52948513d8be tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.110182 Sep 10 20:48:34.573164 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 33/72] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Sep 10 20:48:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 10 20:48:34.589218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-45b827cf-cbaa-4d1f-a68d-bd378078e698 tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Calling method '.version_select at 0x7f99461e48b0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:34.615408 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-45b827cf-cbaa-4d1f-a68d-bd378078e698 tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-862508572?user_id=4d9dac03431042fdb0471dd37639e70d" status: 200 len: 511 microversion: 2.10 time: 0.032607 Sep 10 20:48:34.616553 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 34/73] 10.222.0.33 () {60 vars in 1337 bytes} [Sat Sep 10 20:48:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-862508572?user_id=4d9dac03431042fdb0471dd37639e70d => generated 511 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:34.634460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-24479804-9172-4430-9cd5-47bcb218820c tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Action: 'create', calling method: .version_select at 0x7f99461e4310>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1585590953", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAPrTcKuos/S3M1y7xHAFrTOcInMYHJ2CXlE78sGNSmEdzWNPiQtwt5EE/Pq5aK4hhYs7kBwwGzOgJAAxte9soSBKkq+gE8rAptDNRbVgVCVRFNNEghICCxD5HPYcd3QA=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:34.672316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-24479804-9172-4430-9cd5-47bcb218820c tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Getting quotas for project 8e3a52bb0e284901a617bc95fdeda3e6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:48:34.681465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-24479804-9172-4430-9cd5-47bcb218820c tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Getting quotas for user e56a8d8d4a384d9fa32951e5ec4a07ba and project 8e3a52bb0e284901a617bc95fdeda3e6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:48:34.740734 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-24479804-9172-4430-9cd5-47bcb218820c tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.113178 Sep 10 20:48:34.742027 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 35/74] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Sep 10 20:48:34 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 10 20:48:34.756640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] validate_networks() for [('5e87cad0-4417-4e0d-9afb-caf4350c61cd', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:48:34.985292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b2a8c24d-91f6-4cc1-a716-cd5ed94594e1 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Calling method '.version_select at 0x7f994590f790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:35.092438 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b2a8c24d-91f6-4cc1-a716-cd5ed94594e1 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/64c9116ca73f41289a741b948b6b8a25" status: 200 len: 371 microversion: 2.1 time: 0.348023 Sep 10 20:48:35.093072 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 36/75] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Sep 10 20:48:34 2022] GET /compute/v2.1/os-quota-sets/64c9116ca73f41289a741b948b6b8a25 => generated 371 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:35.106472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1a18436-8d50-49b9-9db9-d0b795e9213c tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Calling method '.version_select at 0x7f99459994c0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:35.112598 ncdv-master-1 devstack@n-api.service[145771]: WARNING oslo_db.sqlalchemy.utils [None req-a1a18436-8d50-49b9-9db9-d0b795e9213c tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 20:48:35.127921 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a1a18436-8d50-49b9-9db9-d0b795e9213c tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs?user_id=4d9dac03431042fdb0471dd37639e70d" status: 200 len: 724 microversion: 2.10 time: 0.024907 Sep 10 20:48:35.129464 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 37/76] 10.222.0.33 () {60 vars in 1259 bytes} [Sat Sep 10 20:48:35 2022] GET /compute/v2.1/os-keypairs?user_id=4d9dac03431042fdb0471dd37639e70d => generated 724 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:35.135804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66263e59-bcf0-42f0-aee2-1000de678916 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:35.136925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-66263e59-bcf0-42f0-aee2-1000de678916 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:35.146122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66263e59-bcf0-42f0-aee2-1000de678916 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:35.146952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66263e59-bcf0-42f0-aee2-1000de678916 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:35.154422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66263e59-bcf0-42f0-aee2-1000de678916 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:35.155722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66263e59-bcf0-42f0-aee2-1000de678916 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:35.156421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66263e59-bcf0-42f0-aee2-1000de678916 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:35.157109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66263e59-bcf0-42f0-aee2-1000de678916 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:35.404322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-66263e59-bcf0-42f0-aee2-1000de678916 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:35.415208 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-66263e59-bcf0-42f0-aee2-1000de678916 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.283415 Sep 10 20:48:35.417964 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 38/77] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:35 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:35.420998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5630e0ca-85db-4f27-86ef-1002ac6d5207 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:35.421926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5630e0ca-85db-4f27-86ef-1002ac6d5207 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:35.433793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5630e0ca-85db-4f27-86ef-1002ac6d5207 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:35.434438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5630e0ca-85db-4f27-86ef-1002ac6d5207 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:35.435033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5630e0ca-85db-4f27-86ef-1002ac6d5207 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:35.435770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5630e0ca-85db-4f27-86ef-1002ac6d5207 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:35.436451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5630e0ca-85db-4f27-86ef-1002ac6d5207 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:35.437032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5630e0ca-85db-4f27-86ef-1002ac6d5207 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:35.636719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5630e0ca-85db-4f27-86ef-1002ac6d5207 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:35.660378 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5630e0ca-85db-4f27-86ef-1002ac6d5207 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.243010 Sep 10 20:48:35.661026 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 39/78] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:35 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:35.667018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-df5a7616-f21d-4718-b947-63177e8931d4 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Action: 'update', calling method: .version_select at 0x7f994596b550>, body: {"quota_set": {"ram": "5120"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:35.779225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df5a7616-f21d-4718-b947-63177e8931d4 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:35.779881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df5a7616-f21d-4718-b947-63177e8931d4 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:35.780440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df5a7616-f21d-4718-b947-63177e8931d4 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:35.782638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df5a7616-f21d-4718-b947-63177e8931d4 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:35.784093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df5a7616-f21d-4718-b947-63177e8931d4 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:35.786510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df5a7616-f21d-4718-b947-63177e8931d4 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:35.872803 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-df5a7616-f21d-4718-b947-63177e8931d4 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/64c9116ca73f41289a741b948b6b8a25" status: 200 len: 328 microversion: 2.1 time: 0.210211 Sep 10 20:48:35.875249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:48:35.876390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:48:35.876883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:48:35.877296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:48:35.877710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:48:35.881140 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 40/79] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:48:35 2022] PUT /compute/v2.1/os-quota-sets/64c9116ca73f41289a741b948b6b8a25 => generated 328 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:35.886300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-270fd83a-a5c9-4c3e-83f1-9638963698c2 tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Calling method '.version_select at 0x7f99462c73a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:35.896018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=7 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:35.897990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:35.899477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:35.900407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:35.901491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:35.914822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:35.915732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:35.917229 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-270fd83a-a5c9-4c3e-83f1-9638963698c2 tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1585590953" status: 204 len: 0 microversion: 2.10 time: 0.034851 Sep 10 20:48:35.922113 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 41/80] 10.222.0.33 () {60 vars in 1325 bytes} [Sat Sep 10 20:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1585590953 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:48:35.927419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-28272f12-806b-4720-b9c4-56d703ea06e5 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:35.945592 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-28272f12-806b-4720-b9c4-56d703ea06e5 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-quota-sets/64c9116ca73f41289a741b948b6b8a25" status: 202 len: 0 microversion: 2.1 time: 0.021876 Sep 10 20:48:35.949697 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 42/81] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 20:48:35 2022] DELETE /compute/v2.1/os-quota-sets/64c9116ca73f41289a741b948b6b8a25 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:48:35.955283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Getting quotas for project d44361bde7c94fb6b01d992a8df306bb. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:48:35.957093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-beaf4b2e-c841-4c8b-a1fd-9980c83b335e tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Calling method '.version_select at 0x7f994591f8b0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:35.969993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Getting quotas for user a020e015186b4c32950c2d4edd26374e and project d44361bde7c94fb6b01d992a8df306bb. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:48:35.994092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:48:35.997802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:48:36.021691 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-beaf4b2e-c841-4c8b-a1fd-9980c83b335e tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540131304?user_id=4d9dac03431042fdb0471dd37639e70d" status: 204 len: 0 microversion: 2.10 time: 0.070327 Sep 10 20:48:36.022508 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 43/82] 10.222.0.33 () {60 vars in 1340 bytes} [Sat Sep 10 20:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540131304?user_id=4d9dac03431042fdb0471dd37639e70d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:48:36.031102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:UPDATE=9,nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:36.033014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ef04b57-1fc7-47b5-8ea5-f8296b5c5d50 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Calling method '.version_select at 0x7f994591ff70>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:36.075557 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4a774df3-1585-4219-8f09-1054f1671c7b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.822571 Sep 10 20:48:36.082844 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 40/83] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:48:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:48:36.095569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4ce1db50-de82-4996-93da-40855f0a01e5 tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] Calling method '.version_select at 0x7f99459d60d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:36.131144 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4ce1db50-de82-4996-93da-40855f0a01e5 tempest-KeyPairsV210TestJSON-53060135 tempest-KeyPairsV210TestJSON-53060135-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-862508572?user_id=4d9dac03431042fdb0471dd37639e70d" status: 204 len: 0 microversion: 2.10 time: 0.046745 Sep 10 20:48:36.131970 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 41/84] 10.222.0.33 () {60 vars in 1340 bytes} [Sat Sep 10 20:48:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-862508572?user_id=4d9dac03431042fdb0471dd37639e70d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:48:36.152669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3fd0475-04e5-46bc-9d23-d31a9c6698ba tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:36.159577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3fd0475-04e5-46bc-9d23-d31a9c6698ba tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:36.203297 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ef04b57-1fc7-47b5-8ea5-f8296b5c5d50 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/64c9116ca73f41289a741b948b6b8a25" status: 200 len: 371 microversion: 2.1 time: 0.179875 Sep 10 20:48:36.211360 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 44/85] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Sep 10 20:48:36 2022] GET /compute/v2.1/os-quota-sets/64c9116ca73f41289a741b948b6b8a25 => generated 371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:36.279044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f3fd0475-04e5-46bc-9d23-d31a9c6698ba tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:36.298664 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3fd0475-04e5-46bc-9d23-d31a9c6698ba tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1264 microversion: 2.1 time: 0.165380 Sep 10 20:48:36.299264 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 42/86] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:36 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:36.440475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c75ab7e1-5baa-46ef-91bb-5739ecabc95e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:36.441114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c75ab7e1-5baa-46ef-91bb-5739ecabc95e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:36.452890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c75ab7e1-5baa-46ef-91bb-5739ecabc95e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:36.455271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c75ab7e1-5baa-46ef-91bb-5739ecabc95e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:36.456868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c75ab7e1-5baa-46ef-91bb-5739ecabc95e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:36.493675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c75ab7e1-5baa-46ef-91bb-5739ecabc95e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:36.498273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c75ab7e1-5baa-46ef-91bb-5739ecabc95e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:36.525869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c75ab7e1-5baa-46ef-91bb-5739ecabc95e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:36.567828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6181b696-2d8a-418d-ac29-cd99debf22ab tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Calling method '.version_select at 0x7f99458e7dc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:36.909698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c75ab7e1-5baa-46ef-91bb-5739ecabc95e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:36.923740 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c75ab7e1-5baa-46ef-91bb-5739ecabc95e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.487759 Sep 10 20:48:36.939286 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 45/87] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:36 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:36.992662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-043add6e-938e-40ca-90db-51b48b3721da tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:36.993922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-043add6e-938e-40ca-90db-51b48b3721da tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:36.998333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:37.009360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-043add6e-938e-40ca-90db-51b48b3721da tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.009360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-043add6e-938e-40ca-90db-51b48b3721da tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.009698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-043add6e-938e-40ca-90db-51b48b3721da tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.011792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-043add6e-938e-40ca-90db-51b48b3721da tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.012650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-043add6e-938e-40ca-90db-51b48b3721da tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.013090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-043add6e-938e-40ca-90db-51b48b3721da tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.150474 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6181b696-2d8a-418d-ac29-cd99debf22ab tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/96b3741511bb4b6d9927841373aaffcf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.586047 Sep 10 20:48:37.162022 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 43/88] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 20:48:36 2022] GET /compute/v2.1/os-quota-sets/96b3741511bb4b6d9927841373aaffcf/defaults => generated 371 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:48:37.325877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa85bc2d-4673-4499-8569-bbbc07a6de11 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:37.326986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aa85bc2d-4673-4499-8569-bbbc07a6de11 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:37.343969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa85bc2d-4673-4499-8569-bbbc07a6de11 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.346070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa85bc2d-4673-4499-8569-bbbc07a6de11 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.347851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa85bc2d-4673-4499-8569-bbbc07a6de11 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.350588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa85bc2d-4673-4499-8569-bbbc07a6de11 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.354321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa85bc2d-4673-4499-8569-bbbc07a6de11 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.354972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa85bc2d-4673-4499-8569-bbbc07a6de11 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.399090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-043add6e-938e-40ca-90db-51b48b3721da tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:37.411012 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-043add6e-938e-40ca-90db-51b48b3721da tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.470217 Sep 10 20:48:37.413526 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 46/89] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:36 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:37.609604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1fe49425-ace0-4e40-870d-49b7503ae19c req-7d5986de-97df-4be3-af20-9fc387ed9e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5119493a-5eb3-44c8-9686-4ad614bf2686", "name": "network-vif-plugged", "status": "completed", "tag": "19c987e4-aeb3-4c2e-bae3-505f5ec166e2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:37.625225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1fe49425-ace0-4e40-870d-49b7503ae19c req-7d5986de-97df-4be3-af20-9fc387ed9e11 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.625966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1fe49425-ace0-4e40-870d-49b7503ae19c req-7d5986de-97df-4be3-af20-9fc387ed9e11 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.626553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1fe49425-ace0-4e40-870d-49b7503ae19c req-7d5986de-97df-4be3-af20-9fc387ed9e11 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.650552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1fe49425-ace0-4e40-870d-49b7503ae19c req-7d5986de-97df-4be3-af20-9fc387ed9e11 service nova] Creating event network-vif-plugged:19c987e4-aeb3-4c2e-bae3-505f5ec166e2 for instance 5119493a-5eb3-44c8-9686-4ad614bf2686 on nch2-master-1 Sep 10 20:48:37.651207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1fe49425-ace0-4e40-870d-49b7503ae19c req-7d5986de-97df-4be3-af20-9fc387ed9e11 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 20:48:37.651770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1fe49425-ace0-4e40-870d-49b7503ae19c req-7d5986de-97df-4be3-af20-9fc387ed9e11 service nova] Acquired lock "compute-rpcapi-router" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 20:48:37.653005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7ca9c4-8717-4dee-9a9d-fbd635525f93 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.653629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7ca9c4-8717-4dee-9a9d-fbd635525f93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.654088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7ca9c4-8717-4dee-9a9d-fbd635525f93 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.654833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7ca9c4-8717-4dee-9a9d-fbd635525f93 None None] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.655454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7ca9c4-8717-4dee-9a9d-fbd635525f93 None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.656045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7ca9c4-8717-4dee-9a9d-fbd635525f93 None None] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.667426 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.compute.rpcapi [None req-be7ca9c4-8717-4dee-9a9d-fbd635525f93 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 10 20:48:37.668994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7ca9c4-8717-4dee-9a9d-fbd635525f93 None None] Releasing lock "compute-rpcapi-router" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 20:48:37.700445 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be7ca9c4-8717-4dee-9a9d-fbd635525f93 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259587 Sep 10 20:48:37.701421 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 47/90] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:48:37.703744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aa85bc2d-4673-4499-8569-bbbc07a6de11 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:37.707332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dcb6cb5e-0484-4759-9228-df6875f53979 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Action: 'update', calling method: .version_select at 0x7f994591f790>, body: {"quota_set": {"ram": "5120"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:37.719874 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aa85bc2d-4673-4499-8569-bbbc07a6de11 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1290 microversion: 2.1 time: 0.394083 Sep 10 20:48:37.734183 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 44/91] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:37 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1290 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:37.775566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcb6cb5e-0484-4759-9228-df6875f53979 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.776231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcb6cb5e-0484-4759-9228-df6875f53979 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.776805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcb6cb5e-0484-4759-9228-df6875f53979 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.777693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcb6cb5e-0484-4759-9228-df6875f53979 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.778313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcb6cb5e-0484-4759-9228-df6875f53979 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.778908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcb6cb5e-0484-4759-9228-df6875f53979 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.835266 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dcb6cb5e-0484-4759-9228-df6875f53979 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/900e5c0658564fdb9f109f03bd66a0e1" status: 200 len: 328 microversion: 2.1 time: 0.132185 Sep 10 20:48:37.836665 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 48/92] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:48:37 2022] PUT /compute/v2.1/os-quota-sets/900e5c0658564fdb9f109f03bd66a0e1 => generated 328 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:37.850395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc56e833-8392-4eec-aed9-5a05103f8179 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Calling method '.version_select at 0x7f9945a28af0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:37.930263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc56e833-8392-4eec-aed9-5a05103f8179 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.933733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc56e833-8392-4eec-aed9-5a05103f8179 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.934563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc56e833-8392-4eec-aed9-5a05103f8179 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.935612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc56e833-8392-4eec-aed9-5a05103f8179 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.936400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc56e833-8392-4eec-aed9-5a05103f8179 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.936935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc56e833-8392-4eec-aed9-5a05103f8179 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.961787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5c7c2fe7-a466-4b39-844f-cdf04fb6a31b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:37.962920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5c7c2fe7-a466-4b39-844f-cdf04fb6a31b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:37.966341 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc56e833-8392-4eec-aed9-5a05103f8179 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/900e5c0658564fdb9f109f03bd66a0e1/detail" status: 200 len: 916 microversion: 2.1 time: 0.120925 Sep 10 20:48:37.967809 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 45/93] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:48:37 2022] GET /compute/v2.1/os-quota-sets/900e5c0658564fdb9f109f03bd66a0e1/detail => generated 916 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:37.982739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c7c2fe7-a466-4b39-844f-cdf04fb6a31b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.983239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c7c2fe7-a466-4b39-844f-cdf04fb6a31b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.983896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c7c2fe7-a466-4b39-844f-cdf04fb6a31b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:37.984632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c7c2fe7-a466-4b39-844f-cdf04fb6a31b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:37.985180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c7c2fe7-a466-4b39-844f-cdf04fb6a31b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:37.985625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c7c2fe7-a466-4b39-844f-cdf04fb6a31b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:38.178652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5c7c2fe7-a466-4b39-844f-cdf04fb6a31b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:38.188438 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5c7c2fe7-a466-4b39-844f-cdf04fb6a31b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.230726 Sep 10 20:48:38.201091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Action: 'update', calling method: .version_select at 0x7f994592faf0>, body: {"quota_set": {"ram": "2048"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:38.204119 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 49/94] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:37 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:38.296221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:38.302207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:38.302709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:38.303498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:38.303967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:38.304402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:38.409591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:38.410628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:38.411810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:38.413012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:38.414294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:38.415114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:38.436166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fc8ea6cd-12ee-4295-9000-794e7c3203ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:38.437012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fc8ea6cd-12ee-4295-9000-794e7c3203ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:38.457242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc8ea6cd-12ee-4295-9000-794e7c3203ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:38.458027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc8ea6cd-12ee-4295-9000-794e7c3203ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:38.458780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc8ea6cd-12ee-4295-9000-794e7c3203ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:38.459700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc8ea6cd-12ee-4295-9000-794e7c3203ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:38.460298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc8ea6cd-12ee-4295-9000-794e7c3203ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:38.461034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc8ea6cd-12ee-4295-9000-794e7c3203ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:38.536977 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8d229ccd-2787-4bf6-a7f1-4679c235ba6d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/900e5c0658564fdb9f109f03bd66a0e1?user_id=2600406ea73648b2acb1e759cf8ba7ce" status: 200 len: 328 microversion: 2.1 time: 0.340021 Sep 10 20:48:38.537637 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 46/95] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Sep 10 20:48:38 2022] PUT /compute/v2.1/os-quota-sets/900e5c0658564fdb9f109f03bd66a0e1?user_id=2600406ea73648b2acb1e759cf8ba7ce => generated 328 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:38.553384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c849daf4-bd0c-4d49-86b5-1a6c9f2256db tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Calling method '.version_select at 0x7f99459d3430>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:38.680148 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c849daf4-bd0c-4d49-86b5-1a6c9f2256db tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/900e5c0658564fdb9f109f03bd66a0e1?user_id=2600406ea73648b2acb1e759cf8ba7ce" status: 200 len: 370 microversion: 2.1 time: 0.132998 Sep 10 20:48:38.681375 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 47/96] 10.222.0.33 () {58 vars in 1323 bytes} [Sat Sep 10 20:48:38 2022] GET /compute/v2.1/os-quota-sets/900e5c0658564fdb9f109f03bd66a0e1?user_id=2600406ea73648b2acb1e759cf8ba7ce => generated 370 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:38.730415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fc8ea6cd-12ee-4295-9000-794e7c3203ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:38.747480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3eee2d2-2a6e-4d2a-8398-ca9c68c84312 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:38.748137 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fc8ea6cd-12ee-4295-9000-794e7c3203ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.315646 Sep 10 20:48:38.751098 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 50/97] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:38 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:38.751860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3eee2d2-2a6e-4d2a-8398-ca9c68c84312 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:38.772713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3eee2d2-2a6e-4d2a-8398-ca9c68c84312 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:38.775091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3eee2d2-2a6e-4d2a-8398-ca9c68c84312 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:38.776241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3eee2d2-2a6e-4d2a-8398-ca9c68c84312 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:38.777161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3eee2d2-2a6e-4d2a-8398-ca9c68c84312 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:38.778113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3eee2d2-2a6e-4d2a-8398-ca9c68c84312 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:38.778950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3eee2d2-2a6e-4d2a-8398-ca9c68c84312 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:38.900224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f3eee2d2-2a6e-4d2a-8398-ca9c68c84312 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:38.910885 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3eee2d2-2a6e-4d2a-8398-ca9c68c84312 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1344 microversion: 2.1 time: 0.171396 Sep 10 20:48:38.914771 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 48/98] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:38 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1344 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:39.216025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85e40709-cf4d-46e7-9969-8e4cd70d1d74 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:39.216661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-85e40709-cf4d-46e7-9969-8e4cd70d1d74 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:39.224082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85e40709-cf4d-46e7-9969-8e4cd70d1d74 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:39.224697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85e40709-cf4d-46e7-9969-8e4cd70d1d74 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:39.225233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85e40709-cf4d-46e7-9969-8e4cd70d1d74 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:39.226103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85e40709-cf4d-46e7-9969-8e4cd70d1d74 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:39.226731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85e40709-cf4d-46e7-9969-8e4cd70d1d74 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:39.227751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85e40709-cf4d-46e7-9969-8e4cd70d1d74 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:39.300125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-51ca1a15-71a8-4799-937f-531a007a178a tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Calling method '.version_select at 0x7f9945947280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:39.714402 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-51ca1a15-71a8-4799-937f-531a007a178a tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/96b3741511bb4b6d9927841373aaffcf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.417986 Sep 10 20:48:39.714995 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 49/99] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 20:48:39 2022] GET /compute/v2.1/os-quota-sets/96b3741511bb4b6d9927841373aaffcf/defaults => generated 371 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:39.728523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-df2eb23d-28fa-4615-9d5d-f9d922062b1d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Action: 'update', calling method: .version_select at 0x7f9945947ca0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:39.745368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-85e40709-cf4d-46e7-9969-8e4cd70d1d74 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:39.762961 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-85e40709-cf4d-46e7-9969-8e4cd70d1d74 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.551681 Sep 10 20:48:39.763587 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 51/100] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:39 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:39.778905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d6985631-bac8-477a-9b32-e899d10a8b06 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:39.780918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d6985631-bac8-477a-9b32-e899d10a8b06 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:39.797359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6985631-bac8-477a-9b32-e899d10a8b06 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:39.798165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6985631-bac8-477a-9b32-e899d10a8b06 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:39.798752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6985631-bac8-477a-9b32-e899d10a8b06 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:39.799819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6985631-bac8-477a-9b32-e899d10a8b06 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:39.800432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6985631-bac8-477a-9b32-e899d10a8b06 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:39.801392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6985631-bac8-477a-9b32-e899d10a8b06 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:39.949860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df2eb23d-28fa-4615-9d5d-f9d922062b1d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:39.951185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df2eb23d-28fa-4615-9d5d-f9d922062b1d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:39.952398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df2eb23d-28fa-4615-9d5d-f9d922062b1d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:39.953310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df2eb23d-28fa-4615-9d5d-f9d922062b1d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:39.953968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df2eb23d-28fa-4615-9d5d-f9d922062b1d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:39.954569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df2eb23d-28fa-4615-9d5d-f9d922062b1d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:40.202316 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-df2eb23d-28fa-4615-9d5d-f9d922062b1d tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/96b3741511bb4b6d9927841373aaffcf" status: 200 len: 329 microversion: 2.1 time: 0.478086 Sep 10 20:48:40.202998 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 50/101] 10.222.0.33 () {60 vars in 1263 bytes} [Sat Sep 10 20:48:39 2022] PUT /compute/v2.1/os-quota-sets/96b3741511bb4b6d9927841373aaffcf => generated 329 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:40.215624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-61e64aa7-c247-4822-9629-e6beb139cfe2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:40.216249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-61e64aa7-c247-4822-9629-e6beb139cfe2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:40.224102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e64aa7-c247-4822-9629-e6beb139cfe2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:40.224612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e64aa7-c247-4822-9629-e6beb139cfe2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:40.225056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e64aa7-c247-4822-9629-e6beb139cfe2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:40.225775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e64aa7-c247-4822-9629-e6beb139cfe2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:40.226273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e64aa7-c247-4822-9629-e6beb139cfe2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:40.227421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e64aa7-c247-4822-9629-e6beb139cfe2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:40.300261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-61e64aa7-c247-4822-9629-e6beb139cfe2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:40.311511 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-61e64aa7-c247-4822-9629-e6beb139cfe2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1344 microversion: 2.1 time: 0.100454 Sep 10 20:48:40.313005 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 51/102] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:40 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:40.320172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-429f927f-1089-44b0-90d7-870d9ef46412 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Action: 'update', calling method: .version_select at 0x7f99459475e0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:40.344816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d6985631-bac8-477a-9b32-e899d10a8b06 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:40.368037 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d6985631-bac8-477a-9b32-e899d10a8b06 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1338 microversion: 2.1 time: 0.591212 Sep 10 20:48:40.371596 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 52/103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:39 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1338 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:48:40.411046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-429f927f-1089-44b0-90d7-870d9ef46412 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:40.411934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-429f927f-1089-44b0-90d7-870d9ef46412 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:40.413778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-429f927f-1089-44b0-90d7-870d9ef46412 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:40.416469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-429f927f-1089-44b0-90d7-870d9ef46412 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:40.418077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-429f927f-1089-44b0-90d7-870d9ef46412 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:40.418524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-429f927f-1089-44b0-90d7-870d9ef46412 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:40.455250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:INSERT=16,nova_api:SELECT=83,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:40.796836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f2fe21db-d6f5-455f-b910-ef0d121abc40 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:40.799893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f2fe21db-d6f5-455f-b910-ef0d121abc40 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:40.807858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2fe21db-d6f5-455f-b910-ef0d121abc40 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:40.808693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2fe21db-d6f5-455f-b910-ef0d121abc40 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:40.809362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2fe21db-d6f5-455f-b910-ef0d121abc40 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:40.810514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2fe21db-d6f5-455f-b910-ef0d121abc40 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:40.811185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2fe21db-d6f5-455f-b910-ef0d121abc40 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:40.811879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2fe21db-d6f5-455f-b910-ef0d121abc40 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:40.956088 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-429f927f-1089-44b0-90d7-870d9ef46412 tempest-QuotasAdminTestJSON-701082686 tempest-QuotasAdminTestJSON-701082686-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/96b3741511bb4b6d9927841373aaffcf" status: 200 len: 329 microversion: 2.1 time: 0.641340 Sep 10 20:48:40.957585 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 52/104] 10.222.0.33 () {60 vars in 1263 bytes} [Sat Sep 10 20:48:40 2022] PUT /compute/v2.1/os-quota-sets/96b3741511bb4b6d9927841373aaffcf => generated 329 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:41.338976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d1a9e731-1dff-4705-af05-f46457f38ca8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:41.340398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d1a9e731-1dff-4705-af05-f46457f38ca8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:41.348330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a9e731-1dff-4705-af05-f46457f38ca8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:41.349193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a9e731-1dff-4705-af05-f46457f38ca8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:41.350429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a9e731-1dff-4705-af05-f46457f38ca8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:41.352155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a9e731-1dff-4705-af05-f46457f38ca8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:41.352803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a9e731-1dff-4705-af05-f46457f38ca8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:41.353408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a9e731-1dff-4705-af05-f46457f38ca8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:41.423777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f2fe21db-d6f5-455f-b910-ef0d121abc40 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:41.433406 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f2fe21db-d6f5-455f-b910-ef0d121abc40 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.643171 Sep 10 20:48:41.454265 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 53/105] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:40 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:41.466443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ebbb10ab-f473-4528-a286-2706cadbe7ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:41.467270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ebbb10ab-f473-4528-a286-2706cadbe7ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:41.475053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebbb10ab-f473-4528-a286-2706cadbe7ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:41.475750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebbb10ab-f473-4528-a286-2706cadbe7ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:41.476497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebbb10ab-f473-4528-a286-2706cadbe7ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:41.478310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebbb10ab-f473-4528-a286-2706cadbe7ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:41.479002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebbb10ab-f473-4528-a286-2706cadbe7ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:41.479629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebbb10ab-f473-4528-a286-2706cadbe7ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:41.620142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d1a9e731-1dff-4705-af05-f46457f38ca8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:41.636180 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d1a9e731-1dff-4705-af05-f46457f38ca8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1412 microversion: 2.1 time: 0.300840 Sep 10 20:48:41.638746 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 53/106] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:41 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1412 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:42.178767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ebbb10ab-f473-4528-a286-2706cadbe7ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:42.187700 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ebbb10ab-f473-4528-a286-2706cadbe7ba tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1487 microversion: 2.1 time: 0.731943 Sep 10 20:48:42.188922 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 54/107] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:41 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1487 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:42.217237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b8263a7d-6901-4ecf-a1de-4fec4f5f82ac tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:42.218863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b8263a7d-6901-4ecf-a1de-4fec4f5f82ac tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:42.234637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8263a7d-6901-4ecf-a1de-4fec4f5f82ac tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:42.239486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8263a7d-6901-4ecf-a1de-4fec4f5f82ac tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:42.241427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8263a7d-6901-4ecf-a1de-4fec4f5f82ac tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:42.244937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8263a7d-6901-4ecf-a1de-4fec4f5f82ac tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:42.245534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8263a7d-6901-4ecf-a1de-4fec4f5f82ac tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:42.246074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8263a7d-6901-4ecf-a1de-4fec4f5f82ac tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:42.470295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25581eff-0f11-43c6-ac37-e9bfe17f80ad tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:42.471453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-25581eff-0f11-43c6-ac37-e9bfe17f80ad tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:42.493293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25581eff-0f11-43c6-ac37-e9bfe17f80ad tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:42.506914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25581eff-0f11-43c6-ac37-e9bfe17f80ad tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:42.507373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25581eff-0f11-43c6-ac37-e9bfe17f80ad tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:42.508668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25581eff-0f11-43c6-ac37-e9bfe17f80ad tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:42.509129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25581eff-0f11-43c6-ac37-e9bfe17f80ad tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:42.509556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25581eff-0f11-43c6-ac37-e9bfe17f80ad tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:42.948250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-25581eff-0f11-43c6-ac37-e9bfe17f80ad tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:42.958831 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-25581eff-0f11-43c6-ac37-e9bfe17f80ad tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.493062 Sep 10 20:48:42.977927 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 55/108] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:42 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:42.985116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2b692d44-a0ab-4903-b2c4-cd14908aa239 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:42.986089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2b692d44-a0ab-4903-b2c4-cd14908aa239 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:42.997765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b692d44-a0ab-4903-b2c4-cd14908aa239 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:42.998414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b692d44-a0ab-4903-b2c4-cd14908aa239 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:42.999070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b692d44-a0ab-4903-b2c4-cd14908aa239 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:42.999971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b692d44-a0ab-4903-b2c4-cd14908aa239 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:43.000430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b692d44-a0ab-4903-b2c4-cd14908aa239 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:43.000855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b692d44-a0ab-4903-b2c4-cd14908aa239 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:43.245870 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b8263a7d-6901-4ecf-a1de-4fec4f5f82ac tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1638 microversion: 2.1 time: 1.037567 Sep 10 20:48:43.262361 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 54/109] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:42 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1638 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:43.268778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b2068ca9-03a0-4215-8bfe-c7278c7455a6 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:43.269494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b2068ca9-03a0-4215-8bfe-c7278c7455a6 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:43.279492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2068ca9-03a0-4215-8bfe-c7278c7455a6 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:43.280598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2068ca9-03a0-4215-8bfe-c7278c7455a6 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:43.285214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2068ca9-03a0-4215-8bfe-c7278c7455a6 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:43.286058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2068ca9-03a0-4215-8bfe-c7278c7455a6 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:43.286697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2068ca9-03a0-4215-8bfe-c7278c7455a6 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:43.287315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2068ca9-03a0-4215-8bfe-c7278c7455a6 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:43.318971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b2068ca9-03a0-4215-8bfe-c7278c7455a6 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:48:43.492939 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b2068ca9-03a0-4215-8bfe-c7278c7455a6 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 204 len: 0 microversion: 2.1 time: 0.227456 Sep 10 20:48:43.498271 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 55/110] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:48:43 2022] DELETE /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 20:48:43.503899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6fafad42-438a-42f8-a2f9-61db155b4901 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:43.504768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6fafad42-438a-42f8-a2f9-61db155b4901 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:43.512615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fafad42-438a-42f8-a2f9-61db155b4901 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:43.513355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fafad42-438a-42f8-a2f9-61db155b4901 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:43.513979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fafad42-438a-42f8-a2f9-61db155b4901 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:43.514875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fafad42-438a-42f8-a2f9-61db155b4901 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:43.515480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fafad42-438a-42f8-a2f9-61db155b4901 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:43.516059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fafad42-438a-42f8-a2f9-61db155b4901 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:43.524547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2b692d44-a0ab-4903-b2c4-cd14908aa239 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:43.539606 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2b692d44-a0ab-4903-b2c4-cd14908aa239 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1412 microversion: 2.1 time: 0.558612 Sep 10 20:48:43.541187 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 56/111] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:42 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1412 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:43.670289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6fafad42-438a-42f8-a2f9-61db155b4901 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:43.678577 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6fafad42-438a-42f8-a2f9-61db155b4901 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1493 microversion: 2.1 time: 0.178923 Sep 10 20:48:43.679167 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 56/112] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:43 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1493 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:43.985066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-313d9523-87c7-4bd5-9388-a69944b2ffda tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:43.985672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-313d9523-87c7-4bd5-9388-a69944b2ffda tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:43.992676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-313d9523-87c7-4bd5-9388-a69944b2ffda tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:43.994013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-313d9523-87c7-4bd5-9388-a69944b2ffda tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:43.994669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-313d9523-87c7-4bd5-9388-a69944b2ffda tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:43.995635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-313d9523-87c7-4bd5-9388-a69944b2ffda tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:43.996177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-313d9523-87c7-4bd5-9388-a69944b2ffda tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:43.996799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-313d9523-87c7-4bd5-9388-a69944b2ffda tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:44.391895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c97e79e9-9d35-4540-a847-2cdb24a64a87 req-150676a1-9187-49a4-8b9d-fe6dc58d0b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023ec8d2-8599-46cf-9dd4-3242411b0762", "tag": "76e5ab12-5706-4c92-bcb5-368b6a237537"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:44.402794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c97e79e9-9d35-4540-a847-2cdb24a64a87 req-150676a1-9187-49a4-8b9d-fe6dc58d0b30 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:44.403271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c97e79e9-9d35-4540-a847-2cdb24a64a87 req-150676a1-9187-49a4-8b9d-fe6dc58d0b30 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:44.404500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c97e79e9-9d35-4540-a847-2cdb24a64a87 req-150676a1-9187-49a4-8b9d-fe6dc58d0b30 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:44.417009 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c97e79e9-9d35-4540-a847-2cdb24a64a87 req-150676a1-9187-49a4-8b9d-fe6dc58d0b30 service nova] Creating event network-changed:76e5ab12-5706-4c92-bcb5-368b6a237537 for instance 023ec8d2-8599-46cf-9dd4-3242411b0762 on nch2-master-1 Sep 10 20:48:44.422494 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c97e79e9-9d35-4540-a847-2cdb24a64a87 req-150676a1-9187-49a4-8b9d-fe6dc58d0b30 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204915 Sep 10 20:48:44.423605 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 57/113] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:44.423848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-313d9523-87c7-4bd5-9388-a69944b2ffda tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:44.433107 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-313d9523-87c7-4bd5-9388-a69944b2ffda tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.451815 Sep 10 20:48:44.433772 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 57/114] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:43 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:44.563476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40ddcb7d-da37-42e7-a4cd-2d3a788af81c tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:44.564569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-40ddcb7d-da37-42e7-a4cd-2d3a788af81c tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:44.576222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40ddcb7d-da37-42e7-a4cd-2d3a788af81c tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:44.576946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40ddcb7d-da37-42e7-a4cd-2d3a788af81c tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:44.577600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40ddcb7d-da37-42e7-a4cd-2d3a788af81c tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:44.578564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40ddcb7d-da37-42e7-a4cd-2d3a788af81c tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:44.580292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40ddcb7d-da37-42e7-a4cd-2d3a788af81c tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:44.580949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40ddcb7d-da37-42e7-a4cd-2d3a788af81c tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:44.704183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d711ad0d-b7b5-4325-baff-a3bb04175d7e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:44.704643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d711ad0d-b7b5-4325-baff-a3bb04175d7e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:44.716295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d711ad0d-b7b5-4325-baff-a3bb04175d7e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:44.716794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d711ad0d-b7b5-4325-baff-a3bb04175d7e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:44.717222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d711ad0d-b7b5-4325-baff-a3bb04175d7e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:44.717955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d711ad0d-b7b5-4325-baff-a3bb04175d7e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:44.718411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d711ad0d-b7b5-4325-baff-a3bb04175d7e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:44.718836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d711ad0d-b7b5-4325-baff-a3bb04175d7e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:45.004846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d711ad0d-b7b5-4325-baff-a3bb04175d7e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:45.018653 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d711ad0d-b7b5-4325-baff-a3bb04175d7e tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1493 microversion: 2.1 time: 0.318473 Sep 10 20:48:45.019554 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 58/115] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:44 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1493 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:45.307946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40ddcb7d-da37-42e7-a4cd-2d3a788af81c tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:45.316762 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40ddcb7d-da37-42e7-a4cd-2d3a788af81c tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1412 microversion: 2.1 time: 0.757442 Sep 10 20:48:45.329258 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 58/116] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:44 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1412 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:45.457670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a3cddeb2-86f1-4cfc-afb9-becc11eb47d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:45.458358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a3cddeb2-86f1-4cfc-afb9-becc11eb47d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:45.467387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cddeb2-86f1-4cfc-afb9-becc11eb47d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:45.469910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cddeb2-86f1-4cfc-afb9-becc11eb47d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:45.470361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cddeb2-86f1-4cfc-afb9-becc11eb47d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:45.471074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cddeb2-86f1-4cfc-afb9-becc11eb47d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:45.474195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cddeb2-86f1-4cfc-afb9-becc11eb47d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:45.475177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cddeb2-86f1-4cfc-afb9-becc11eb47d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:45.853479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3cddeb2-86f1-4cfc-afb9-becc11eb47d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:45.875361 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a3cddeb2-86f1-4cfc-afb9-becc11eb47d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.421739 Sep 10 20:48:45.876178 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 59/117] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:45 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:46.047165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9e16b444-73c1-48c6-89f9-ea4a99d9625f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:46.048994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9e16b444-73c1-48c6-89f9-ea4a99d9625f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:46.072089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e16b444-73c1-48c6-89f9-ea4a99d9625f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:46.072775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e16b444-73c1-48c6-89f9-ea4a99d9625f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:46.073292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e16b444-73c1-48c6-89f9-ea4a99d9625f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:46.074121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e16b444-73c1-48c6-89f9-ea4a99d9625f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:46.075340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e16b444-73c1-48c6-89f9-ea4a99d9625f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:46.076064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e16b444-73c1-48c6-89f9-ea4a99d9625f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:46.356497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-13447d39-b314-4b9b-8cba-f55b4258cdc8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:46.358244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-13447d39-b314-4b9b-8cba-f55b4258cdc8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:46.370362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13447d39-b314-4b9b-8cba-f55b4258cdc8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:46.371473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13447d39-b314-4b9b-8cba-f55b4258cdc8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:46.372120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13447d39-b314-4b9b-8cba-f55b4258cdc8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:46.373763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13447d39-b314-4b9b-8cba-f55b4258cdc8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:46.374715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13447d39-b314-4b9b-8cba-f55b4258cdc8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:46.375743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13447d39-b314-4b9b-8cba-f55b4258cdc8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:46.473724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:46.541390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9e16b444-73c1-48c6-89f9-ea4a99d9625f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:46.563563 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9e16b444-73c1-48c6-89f9-ea4a99d9625f tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1493 microversion: 2.1 time: 0.524252 Sep 10 20:48:46.566567 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 59/118] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:46 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1493 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:46.798236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-613968018", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:46.882911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:48:46.920883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-13447d39-b314-4b9b-8cba-f55b4258cdc8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:46.934268 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-13447d39-b314-4b9b-8cba-f55b4258cdc8 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1412 microversion: 2.1 time: 0.583323 Sep 10 20:48:46.935405 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 60/119] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:46 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1412 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:48:46.946779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dd9b0b14-897f-43dc-8979-8bae38852919 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:46.947402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dd9b0b14-897f-43dc-8979-8bae38852919 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:46.957154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9b0b14-897f-43dc-8979-8bae38852919 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:46.957654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9b0b14-897f-43dc-8979-8bae38852919 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:46.985620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9b0b14-897f-43dc-8979-8bae38852919 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:46.986779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9b0b14-897f-43dc-8979-8bae38852919 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:46.987893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9b0b14-897f-43dc-8979-8bae38852919 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:46.988348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9b0b14-897f-43dc-8979-8bae38852919 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:47.363620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dd9b0b14-897f-43dc-8979-8bae38852919 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:47.375444 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dd9b0b14-897f-43dc-8979-8bae38852919 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.438814 Sep 10 20:48:47.376871 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 61/120] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:46 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:47.394026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f361331a-cf34-4b6b-af36-d65839262353 req-adef80d5-f2a7-4247-929b-22c8e4d3c274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5119493a-5eb3-44c8-9686-4ad614bf2686", "name": "network-vif-deleted", "tag": "19c987e4-aeb3-4c2e-bae3-505f5ec166e2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:47.409639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f361331a-cf34-4b6b-af36-d65839262353 req-adef80d5-f2a7-4247-929b-22c8e4d3c274 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:47.410413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f361331a-cf34-4b6b-af36-d65839262353 req-adef80d5-f2a7-4247-929b-22c8e4d3c274 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:47.411138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f361331a-cf34-4b6b-af36-d65839262353 req-adef80d5-f2a7-4247-929b-22c8e4d3c274 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:47.434247 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f361331a-cf34-4b6b-af36-d65839262353 req-adef80d5-f2a7-4247-929b-22c8e4d3c274 service nova] Creating event network-vif-deleted:19c987e4-aeb3-4c2e-bae3-505f5ec166e2 for instance 5119493a-5eb3-44c8-9686-4ad614bf2686 on nch2-master-1 Sep 10 20:48:47.443243 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f361331a-cf34-4b6b-af36-d65839262353 req-adef80d5-f2a7-4247-929b-22c8e4d3c274 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061242 Sep 10 20:48:47.444523 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 62/121] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:47.596373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9545d87b-1275-4ec1-afbc-91a32d0fbd21 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:47.597482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9545d87b-1275-4ec1-afbc-91a32d0fbd21 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:47.610857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9545d87b-1275-4ec1-afbc-91a32d0fbd21 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:47.611964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9545d87b-1275-4ec1-afbc-91a32d0fbd21 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:47.613739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9545d87b-1275-4ec1-afbc-91a32d0fbd21 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:47.621118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9545d87b-1275-4ec1-afbc-91a32d0fbd21 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:47.622658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9545d87b-1275-4ec1-afbc-91a32d0fbd21 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:47.624066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9545d87b-1275-4ec1-afbc-91a32d0fbd21 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:47.688811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:48:47.690215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:48:47.691013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:48:47.691343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:48:47.691924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:48:47.707599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:47.712780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:47.713817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:47.714893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:47.715740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:47.716289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:47.746424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Getting quotas for project d9204ddaf90a4685a4286c8ebfd76433. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:48:47.755296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Getting quotas for user ffba8e54e6f14960b7f57c5e19d3cfae and project d9204ddaf90a4685a4286c8ebfd76433. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:48:47.775722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:48:47.778660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:48:47.790872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:47.830581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=32 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:47.869942 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e34b4f1f-45c0-4cd0-b057-c79978f7cd11 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302166 Sep 10 20:48:47.871602 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 60/122] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:48:47.899878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-89db12e7-7ee8-4150-985a-8fe3bb585d8d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:47.901506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-89db12e7-7ee8-4150-985a-8fe3bb585d8d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:47.904969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=17,nova_api:UPDATE=15 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:47.916163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9545d87b-1275-4ec1-afbc-91a32d0fbd21 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736fcd7811e341468d7080da18b011ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6c275f77df48e196553dbc20db8ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:47.936844 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9545d87b-1275-4ec1-afbc-91a32d0fbd21 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 200 len: 1451 microversion: 2.1 time: 0.347009 Sep 10 20:48:47.938346 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 63/123] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:47 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 1451 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:48:47.975836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-39a6d8f4-f43a-4f5e-a397-fcefc908abb1 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:47.984636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-39a6d8f4-f43a-4f5e-a397-fcefc908abb1 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:48.008876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39a6d8f4-f43a-4f5e-a397-fcefc908abb1 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:48.009403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39a6d8f4-f43a-4f5e-a397-fcefc908abb1 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:48.009912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39a6d8f4-f43a-4f5e-a397-fcefc908abb1 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:48.019571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39a6d8f4-f43a-4f5e-a397-fcefc908abb1 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:48.025908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39a6d8f4-f43a-4f5e-a397-fcefc908abb1 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:48.026373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39a6d8f4-f43a-4f5e-a397-fcefc908abb1 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:48.076313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-89db12e7-7ee8-4150-985a-8fe3bb585d8d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:48.084963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:48.091376 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-89db12e7-7ee8-4150-985a-8fe3bb585d8d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1222 microversion: 2.1 time: 0.206508 Sep 10 20:48:48.092833 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 61/124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:47 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1222 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:48.389289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-39a6d8f4-f43a-4f5e-a397-fcefc908abb1 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:48.404990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae96a47e-fc3c-4517-82b0-e5f8fd800e28 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:48.405230 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-39a6d8f4-f43a-4f5e-a397-fcefc908abb1 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1412 microversion: 2.1 time: 0.441176 Sep 10 20:48:48.405857 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 64/125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:47 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1412 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:48.406902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ae96a47e-fc3c-4517-82b0-e5f8fd800e28 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:48.421937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae96a47e-fc3c-4517-82b0-e5f8fd800e28 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:48.422444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae96a47e-fc3c-4517-82b0-e5f8fd800e28 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:48.422893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae96a47e-fc3c-4517-82b0-e5f8fd800e28 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:48.428098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae96a47e-fc3c-4517-82b0-e5f8fd800e28 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:48.428825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae96a47e-fc3c-4517-82b0-e5f8fd800e28 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:48.430297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae96a47e-fc3c-4517-82b0-e5f8fd800e28 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:48.819082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ae96a47e-fc3c-4517-82b0-e5f8fd800e28 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:48.829240 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ae96a47e-fc3c-4517-82b0-e5f8fd800e28 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.430380 Sep 10 20:48:48.832678 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 62/126] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:48 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:48.964179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:48.965387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:48.978043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:48.981157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:48.982954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:48.983873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:48.985094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:48.987156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:49.020878 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] HTTP exception thrown: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Request method failure captured: Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 HTTP/1.1 Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgB__Q59lw-XcUE5ObaaudyQ17nMihA8j0LSTUAgXask_qjY9HIWAlz7u9SAMBQkndxckzgjVtEE2Ae4mvqiZaMVHDzRzZwctGjq3a3d1odv4jkHsLgPY6WkGqbUFvcqbDu-gjFJ2KnNQlhSlXqx15kweYg2Nr9vWzxf3xmvxPkdnc Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 5f6c275f77df48e196553dbc20db8ed9 Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminTestJSON-1682510343 Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:48:49.026761 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f6c275f77df48e196553dbc20db8ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f6c275f77df48e196553dbc20db8ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f6c275f77df48e196553dbc20db8ed9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f6c275f77df48e196553dbc20db8ed9"}]}] Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminTestJSON-1682510343 Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 5f6c275f77df48e196553dbc20db8ed9 Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1682510343 Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminTestJSON-1682510343-project Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 736fcd7811e341468d7080da18b011ea Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminTestJSON-1682510343-project Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:48:49.028018 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5119493a-5eb3-44c8-9686-4ad614bf2686'} Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:49.028649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:48:49.031629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:49.034318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Returning 404 to user: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:49.035282 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-85eefeed-a17a-40b8-8b0e-b5e1b5547608 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 404 len: 111 microversion: 2.1 time: 0.078688 Sep 10 20:48:49.036194 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 65/127] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:48 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:48:49.045982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4db79b4-e1c4-48f6-8cef-132463b98603 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:49.071481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4db79b4-e1c4-48f6-8cef-132463b98603 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:49.072320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4db79b4-e1c4-48f6-8cef-132463b98603 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:49.072961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4db79b4-e1c4-48f6-8cef-132463b98603 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:49.127553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-92c2df59-1f62-4100-925f-8f23367bc13b tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:49.128513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-92c2df59-1f62-4100-925f-8f23367bc13b tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:49.138407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92c2df59-1f62-4100-925f-8f23367bc13b tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:49.140879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92c2df59-1f62-4100-925f-8f23367bc13b tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:49.141538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92c2df59-1f62-4100-925f-8f23367bc13b tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:49.143107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92c2df59-1f62-4100-925f-8f23367bc13b tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:49.144981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92c2df59-1f62-4100-925f-8f23367bc13b tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:49.145648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92c2df59-1f62-4100-925f-8f23367bc13b tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:49.370294 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e4db79b4-e1c4-48f6-8cef-132463b98603 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.328539 Sep 10 20:48:49.371482 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 63/128] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:49 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:48:49.382515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ac432f0d-5486-4570-b396-2f9c9f518823 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:49.392762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-92c2df59-1f62-4100-925f-8f23367bc13b tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:49.406835 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-92c2df59-1f62-4100-925f-8f23367bc13b tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1218 microversion: 2.1 time: 0.293478 Sep 10 20:48:49.407712 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 66/129] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:49 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1218 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:49.430980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3ce71ec5-9d1c-4ea2-a48a-6d69f71c0c07 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:49.431873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3ce71ec5-9d1c-4ea2-a48a-6d69f71c0c07 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:49.448320 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ac432f0d-5486-4570-b396-2f9c9f518823 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.069399 Sep 10 20:48:49.460264 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 64/130] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:49 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 20:48:49.475116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce71ec5-9d1c-4ea2-a48a-6d69f71c0c07 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:49.478746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce71ec5-9d1c-4ea2-a48a-6d69f71c0c07 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:49.479412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce71ec5-9d1c-4ea2-a48a-6d69f71c0c07 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:49.480328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce71ec5-9d1c-4ea2-a48a-6d69f71c0c07 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:49.480959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce71ec5-9d1c-4ea2-a48a-6d69f71c0c07 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:49.481091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-886ef827-f0f8-4050-8d5d-0eaa3e3aa7e1 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-831987351"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:49.481703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce71ec5-9d1c-4ea2-a48a-6d69f71c0c07 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:49.488707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.aggregate [None req-886ef827-f0f8-4050-8d5d-0eaa3e3aa7e1 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Generated uuid f0c6f7d2-6540-46f9-b05d-f0e4833d8b41 for aggregate {{(pid=145772) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:49.551437 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-886ef827-f0f8-4050-8d5d-0eaa3e3aa7e1 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.081473 Sep 10 20:48:49.561463 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 65/131] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:48:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:48:49.566325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c9867cd2-e9ca-4e27-805c-646862fb78d6 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:49.596500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9867cd2-e9ca-4e27-805c-646862fb78d6 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:49.596916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9867cd2-e9ca-4e27-805c-646862fb78d6 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:49.597354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9867cd2-e9ca-4e27-805c-646862fb78d6 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:49.871989 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c9867cd2-e9ca-4e27-805c-646862fb78d6 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.309277 Sep 10 20:48:49.873647 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 66/132] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:49 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:49.880782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c36236c6-c803-44f9-a20e-f594d8352d96 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:49.881752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c36236c6-c803-44f9-a20e-f594d8352d96 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:49.890596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36236c6-c803-44f9-a20e-f594d8352d96 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:49.891368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36236c6-c803-44f9-a20e-f594d8352d96 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:49.892121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36236c6-c803-44f9-a20e-f594d8352d96 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:49.893169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36236c6-c803-44f9-a20e-f594d8352d96 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:49.893967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36236c6-c803-44f9-a20e-f594d8352d96 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:49.894625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36236c6-c803-44f9-a20e-f594d8352d96 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:49.971605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3ce71ec5-9d1c-4ea2-a48a-6d69f71c0c07 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:49.986342 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3ce71ec5-9d1c-4ea2-a48a-6d69f71c0c07 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1390 microversion: 2.1 time: 0.561451 Sep 10 20:48:49.994173 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 67/133] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:49 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1390 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:48:50.002982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1bc8ed8b-f0d8-46c4-a587-0dc6e66e21e2 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:50.066770 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1bc8ed8b-f0d8-46c4-a587-0dc6e66e21e2 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.069594 Sep 10 20:48:50.083693 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 68/134] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 20:48:49 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:50.089721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ecbec099-bdee-4e0e-96fd-ce81a3785fd5 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:50.113879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecbec099-bdee-4e0e-96fd-ce81a3785fd5 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:50.114706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecbec099-bdee-4e0e-96fd-ce81a3785fd5 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:50.115349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecbec099-bdee-4e0e-96fd-ce81a3785fd5 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:50.434871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c36236c6-c803-44f9-a20e-f594d8352d96 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:50.446158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:50.479321 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c36236c6-c803-44f9-a20e-f594d8352d96 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.602803 Sep 10 20:48:50.488498 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 67/135] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:49 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:50.497216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-43027f3b-c081-4c74-8bf1-41812896f09e tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:50.497950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-43027f3b-c081-4c74-8bf1-41812896f09e tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:50.520999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43027f3b-c081-4c74-8bf1-41812896f09e tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:50.521589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43027f3b-c081-4c74-8bf1-41812896f09e tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:50.522927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43027f3b-c081-4c74-8bf1-41812896f09e tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:50.524412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43027f3b-c081-4c74-8bf1-41812896f09e tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:50.525151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43027f3b-c081-4c74-8bf1-41812896f09e tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:50.525646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43027f3b-c081-4c74-8bf1-41812896f09e tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:50.736447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-43027f3b-c081-4c74-8bf1-41812896f09e tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:50.753319 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ecbec099-bdee-4e0e-96fd-ce81a3785fd5 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.666618 Sep 10 20:48:50.754060 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 69/136] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:50 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:50.759254 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-43027f3b-c081-4c74-8bf1-41812896f09e tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1280 microversion: 2.1 time: 0.269349 Sep 10 20:48:50.769651 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 68/137] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:50 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1280 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:50.773436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7e9b7bf9-1301-46c6-9cdb-2248a9edae24 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:50.817678 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7e9b7bf9-1301-46c6-9cdb-2248a9edae24 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.053924 Sep 10 20:48:50.818487 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 70/138] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:50 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:48:50.829694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-68b973ed-170e-4c65-8f97-0b809c4d5d9b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-821071146"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:50.834526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.aggregate [None req-68b973ed-170e-4c65-8f97-0b809c4d5d9b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Generated uuid fc25ecc3-b7ee-46f0-a703-8a2684abc602 for aggregate {{(pid=145772) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:50.881638 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-68b973ed-170e-4c65-8f97-0b809c4d5d9b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.055584 Sep 10 20:48:50.884996 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 69/139] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:48:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:50.896222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-243d1ba3-9065-4fe8-bff8-10179832c8ba tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:50.924623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-243d1ba3-9065-4fe8-bff8-10179832c8ba tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:50.925127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-243d1ba3-9065-4fe8-bff8-10179832c8ba tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:50.925598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-243d1ba3-9065-4fe8-bff8-10179832c8ba tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:51.018214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5616d4c-782b-4465-b35f-b0d0d5296fca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:51.018841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e5616d4c-782b-4465-b35f-b0d0d5296fca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:51.041288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5616d4c-782b-4465-b35f-b0d0d5296fca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:51.043895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5616d4c-782b-4465-b35f-b0d0d5296fca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:51.044425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5616d4c-782b-4465-b35f-b0d0d5296fca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:51.045245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5616d4c-782b-4465-b35f-b0d0d5296fca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:51.047816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5616d4c-782b-4465-b35f-b0d0d5296fca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:51.048267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5616d4c-782b-4465-b35f-b0d0d5296fca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:51.172700 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-243d1ba3-9065-4fe8-bff8-10179832c8ba tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.279289 Sep 10 20:48:51.173772 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 71/140] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:50 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:51.178512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-91a93dd2-8343-4909-aed8-aeda3c84f7f5 req-a643b005-6b4e-4fa1-9cf7-08391bc2caa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc1d5b2-4eff-42cc-a465-634307e9e709", "name": "network-vif-plugged", "status": "completed", "tag": "1a068c83-2810-4505-a299-728cb8f0897d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:51.207179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-91a93dd2-8343-4909-aed8-aeda3c84f7f5 req-a643b005-6b4e-4fa1-9cf7-08391bc2caa4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:51.224857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-91a93dd2-8343-4909-aed8-aeda3c84f7f5 req-a643b005-6b4e-4fa1-9cf7-08391bc2caa4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:51.225372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-91a93dd2-8343-4909-aed8-aeda3c84f7f5 req-a643b005-6b4e-4fa1-9cf7-08391bc2caa4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:51.253306 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-91a93dd2-8343-4909-aed8-aeda3c84f7f5 req-a643b005-6b4e-4fa1-9cf7-08391bc2caa4 service nova] Creating event network-vif-plugged:1a068c83-2810-4505-a299-728cb8f0897d for instance 1fc1d5b2-4eff-42cc-a465-634307e9e709 on nch1-master-1 Sep 10 20:48:51.262982 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-91a93dd2-8343-4909-aed8-aeda3c84f7f5 req-a643b005-6b4e-4fa1-9cf7-08391bc2caa4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087768 Sep 10 20:48:51.263609 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 72/141] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:51.285433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9c5d8cf1-a1b2-4ddf-9597-92aae9868963 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:51.303300 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9c5d8cf1-a1b2-4ddf-9597-92aae9868963 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.034338 Sep 10 20:48:51.303894 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 73/142] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:48:51 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:51.316553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09a52ce4-2e26-442d-b8c0-05087b902dcd tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:51.344762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09a52ce4-2e26-442d-b8c0-05087b902dcd tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:51.352703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09a52ce4-2e26-442d-b8c0-05087b902dcd tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:51.353307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09a52ce4-2e26-442d-b8c0-05087b902dcd tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:51.524346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e5616d4c-782b-4465-b35f-b0d0d5296fca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:51.534708 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5616d4c-782b-4465-b35f-b0d0d5296fca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1390 microversion: 2.1 time: 0.521564 Sep 10 20:48:51.536065 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 70/143] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:51 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1390 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:48:51.541723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-236c9158-5a93-4bbe-97f6-88506be92e9d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:51.542731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-236c9158-5a93-4bbe-97f6-88506be92e9d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:51.559502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-236c9158-5a93-4bbe-97f6-88506be92e9d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:51.560308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-236c9158-5a93-4bbe-97f6-88506be92e9d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:51.565513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-236c9158-5a93-4bbe-97f6-88506be92e9d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:51.580100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-236c9158-5a93-4bbe-97f6-88506be92e9d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:51.580923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-236c9158-5a93-4bbe-97f6-88506be92e9d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:51.581616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-236c9158-5a93-4bbe-97f6-88506be92e9d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:51.596666 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09a52ce4-2e26-442d-b8c0-05087b902dcd tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.283926 Sep 10 20:48:51.597754 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 74/144] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:51.642691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c7737ed8-425c-4c62-865c-70ff4eb8b587 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:51.713939 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c7737ed8-425c-4c62-865c-70ff4eb8b587 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.107309 Sep 10 20:48:51.714917 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 75/145] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:51 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:48:51.728456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dc9137a9-d3bf-4517-90c1-753b9cd5daa4 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-573548313"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:51.737376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-dc9137a9-d3bf-4517-90c1-753b9cd5daa4 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Generated uuid aa7fe6e3-786f-4f24-9141-6a455804d1c2 for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:51.810517 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dc9137a9-d3bf-4517-90c1-753b9cd5daa4 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.085371 Sep 10 20:48:51.811172 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 76/146] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:48:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:51.830145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-49a2876b-8556-436c-b1da-7aa2ef66c69a tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:51.830888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-49a2876b-8556-436c-b1da-7aa2ef66c69a tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:51.832861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:51.863771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49a2876b-8556-436c-b1da-7aa2ef66c69a tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:51.864547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49a2876b-8556-436c-b1da-7aa2ef66c69a tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:51.865010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49a2876b-8556-436c-b1da-7aa2ef66c69a tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:51.865928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49a2876b-8556-436c-b1da-7aa2ef66c69a tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:51.877998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49a2876b-8556-436c-b1da-7aa2ef66c69a tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:51.879278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49a2876b-8556-436c-b1da-7aa2ef66c69a tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:52.135855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-236c9158-5a93-4bbe-97f6-88506be92e9d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:52.154831 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-236c9158-5a93-4bbe-97f6-88506be92e9d tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.617413 Sep 10 20:48:52.170438 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 71/147] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:51 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:52.182655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b5d4a05a-77a2-4fb7-b7a1-b518414b8ad0 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:52.205488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5d4a05a-77a2-4fb7-b7a1-b518414b8ad0 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:52.206031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5d4a05a-77a2-4fb7-b7a1-b518414b8ad0 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:52.206476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5d4a05a-77a2-4fb7-b7a1-b518414b8ad0 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:52.375303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-49a2876b-8556-436c-b1da-7aa2ef66c69a tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:52.399645 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-49a2876b-8556-436c-b1da-7aa2ef66c69a tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1280 microversion: 2.1 time: 0.582141 Sep 10 20:48:52.422563 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 77/148] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:51 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1280 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:52.530912 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b5d4a05a-77a2-4fb7-b7a1-b518414b8ad0 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.358405 Sep 10 20:48:52.531935 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 72/149] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:52 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:52.544963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-30f4e4da-6d98-4f18-9524-9fb39d12d0d1 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:52.563511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3c1010f2-61a8-4180-be45-c3f8164e57bf tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:52.564316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3c1010f2-61a8-4180-be45-c3f8164e57bf tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:52.580064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30f4e4da-6d98-4f18-9524-9fb39d12d0d1 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:52.581733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c1010f2-61a8-4180-be45-c3f8164e57bf tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:52.584561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c1010f2-61a8-4180-be45-c3f8164e57bf tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:52.585304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30f4e4da-6d98-4f18-9524-9fb39d12d0d1 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:52.586404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c1010f2-61a8-4180-be45-c3f8164e57bf tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:52.588507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c1010f2-61a8-4180-be45-c3f8164e57bf tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:52.588804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30f4e4da-6d98-4f18-9524-9fb39d12d0d1 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:52.592107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c1010f2-61a8-4180-be45-c3f8164e57bf tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:52.593700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c1010f2-61a8-4180-be45-c3f8164e57bf tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:52.915444 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-30f4e4da-6d98-4f18-9524-9fb39d12d0d1 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.374879 Sep 10 20:48:52.920929 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 78/150] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:52 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:52.937604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bcee5061-278e-43af-aaf4-cf863c93aacd tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:53.006862 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bcee5061-278e-43af-aaf4-cf863c93aacd tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.079354 Sep 10 20:48:53.008117 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 79/151] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:52 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:48:53.018995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2e748562-da1a-42df-a232-c9cc25dc8bb2 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2007635889"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:53.026032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-2e748562-da1a-42df-a232-c9cc25dc8bb2 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Generated uuid 90d5e85f-07ac-43e5-852f-a5af80c0e750 for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:53.100401 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2e748562-da1a-42df-a232-c9cc25dc8bb2 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.084860 Sep 10 20:48:53.104355 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 80/152] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:48:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:48:53.109570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3056a1e3-060f-4b6c-add7-3e4b9aa7ef53 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1327759439"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:53.118783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-3056a1e3-060f-4b6c-add7-3e4b9aa7ef53 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Generated uuid a52b0893-3ef7-4660-a9c4-43b53ba8b1a3 for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:53.155794 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3056a1e3-060f-4b6c-add7-3e4b9aa7ef53 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.049931 Sep 10 20:48:53.158849 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 81/153] 10.222.0.33 () {62 vars in 1205 bytes} [Sat Sep 10 20:48:53 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:53.200636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d98f09cd-71f0-493a-a77e-a042b3bfd12b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:53.248687 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d98f09cd-71f0-493a-a77e-a042b3bfd12b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.069885 Sep 10 20:48:53.249324 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 82/154] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:53 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:48:53.256735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-64e7a17c-213a-4f90-afed-704d083665f4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:53.259381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-64e7a17c-213a-4f90-afed-704d083665f4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:53.269168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64e7a17c-213a-4f90-afed-704d083665f4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:53.269683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64e7a17c-213a-4f90-afed-704d083665f4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:53.270393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64e7a17c-213a-4f90-afed-704d083665f4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:53.271410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64e7a17c-213a-4f90-afed-704d083665f4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:53.271910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64e7a17c-213a-4f90-afed-704d083665f4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:53.272388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64e7a17c-213a-4f90-afed-704d083665f4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:53.311686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3c1010f2-61a8-4180-be45-c3f8164e57bf tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:53.329708 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3c1010f2-61a8-4180-be45-c3f8164e57bf tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1390 microversion: 2.1 time: 0.770639 Sep 10 20:48:53.331244 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 73/155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:52 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1390 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:48:53.339852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7aab46d0-8044-48f1-8ec4-f7270337f6c7 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-177979333"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:53.637399 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7aab46d0-8044-48f1-8ec4-f7270337f6c7 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.304802 Sep 10 20:48:53.638404 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 74/156] 10.222.0.33 () {62 vars in 1210 bytes} [Sat Sep 10 20:48:53 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:53.652744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e3bed81-2ebf-4c76-8152-28ce56c616d6 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:53.669506 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-2e3bed81-2ebf-4c76-8152-28ce56c616d6 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e3bed81-2ebf-4c76-8152-28ce56c616d6 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Request method failure captured: Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgDCJyo-NlUhHTykNkwYsO4TJStz5NgJqOCBtAdv6ZjTn2PnzWr88VInOxSkaL803kiWrSkliRnexvNgOSpuVBw2As1R62eziUVYwop365xDlnQhdKnNowjdlNSj1Q-USMwq4jTXw0-WEfedLhmQ94w7f1oUfDsAGClyKI_E3QhyX8 Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c8dfd36f32b9446d9fcb8551c253e3c9 Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:48:53.691630 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8dfd36f32b9446d9fcb8551c253e3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8dfd36f32b9446d9fcb8551c253e3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8dfd36f32b9446d9fcb8551c253e3c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8dfd36f32b9446d9fcb8551c253e3c9"}]}] Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c8dfd36f32b9446d9fcb8551c253e3c9 Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AggregatesAdminTestJSON-574737172-project-admin Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1e75f8b01c4a4939b7f8c2086e3974e5 Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AggregatesAdminTestJSON-574737172-project-admin Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: exception: Aggregate 5 could not be found. Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5'} Sep 10 20:48:53.693044 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:53.693940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Sep 10 20:48:53.695917 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:53.697775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e3bed81-2ebf-4c76-8152-28ce56c616d6 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:53.698674 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e3bed81-2ebf-4c76-8152-28ce56c616d6 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.059324 Sep 10 20:48:53.699399 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 75/157] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 20:48:53 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:48:53.704358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-719ece63-3d43-4b53-8ddd-7a1e488bc759 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:53.705111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-719ece63-3d43-4b53-8ddd-7a1e488bc759 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:53.719176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-719ece63-3d43-4b53-8ddd-7a1e488bc759 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:53.719952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-719ece63-3d43-4b53-8ddd-7a1e488bc759 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:53.720400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-719ece63-3d43-4b53-8ddd-7a1e488bc759 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:53.721126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-719ece63-3d43-4b53-8ddd-7a1e488bc759 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:53.721587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-719ece63-3d43-4b53-8ddd-7a1e488bc759 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:53.734645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-719ece63-3d43-4b53-8ddd-7a1e488bc759 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:53.952912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-64e7a17c-213a-4f90-afed-704d083665f4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:53.965160 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-64e7a17c-213a-4f90-afed-704d083665f4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1318 microversion: 2.1 time: 0.714518 Sep 10 20:48:53.970144 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 83/158] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:53 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:53.977801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9cdd9de5-2053-4814-ae39-246a182bd12e tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:54.000449 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9cdd9de5-2053-4814-ae39-246a182bd12e tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.026917 Sep 10 20:48:54.004180 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 84/159] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Sep 10 20:48:53 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:54.013547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-862db6b1-df63-4ba4-a7d4-2fe3759ed6f3 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:54.045657 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-862db6b1-df63-4ba4-a7d4-2fe3759ed6f3 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-862db6b1-df63-4ba4-a7d4-2fe3759ed6f3 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Request method failure captured: Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgDCJyo-NlUhHTykNkwYsO4TJStz5NgJqOCBtAdv6ZjTn2PnzWr88VInOxSkaL803kiWrSkliRnexvNgOSpuVBw2As1R62eziUVYwop365xDlnQhdKnNowjdlNSj1Q-USMwq4jTXw0-WEfedLhmQ94w7f1oUfDsAGClyKI_E3QhyX8 Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c8dfd36f32b9446d9fcb8551c253e3c9 Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:48:54.055969 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8dfd36f32b9446d9fcb8551c253e3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8dfd36f32b9446d9fcb8551c253e3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8dfd36f32b9446d9fcb8551c253e3c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8dfd36f32b9446d9fcb8551c253e3c9"}]}] Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c8dfd36f32b9446d9fcb8551c253e3c9 Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminTestJSON-574737172-project-admin Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1e75f8b01c4a4939b7f8c2086e3974e5 Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminTestJSON-574737172-project-admin Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: exception: Aggregate 5 could not be found. Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5'} Sep 10 20:48:54.057469 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:48:54.059296 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:54.060408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:54.061669 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:54.061669 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:48:54.061669 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:48:54.061669 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Sep 10 20:48:54.061669 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:54.061669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-862db6b1-df63-4ba4-a7d4-2fe3759ed6f3 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:54.061669 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-862db6b1-df63-4ba4-a7d4-2fe3759ed6f3 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.053132 Sep 10 20:48:54.066797 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 85/160] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:54 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:48:54.073281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a261ea51-3332-4e73-8f2e-16e1a3d740ec tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:54.088948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a261ea51-3332-4e73-8f2e-16e1a3d740ec tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:54.089789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a261ea51-3332-4e73-8f2e-16e1a3d740ec tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:54.090643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a261ea51-3332-4e73-8f2e-16e1a3d740ec tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:54.414671 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a261ea51-3332-4e73-8f2e-16e1a3d740ec tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 313 microversion: 2.41 time: 0.346165 Sep 10 20:48:54.421044 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 86/161] 10.222.0.33 () {62 vars in 1232 bytes} [Sat Sep 10 20:48:54 2022] POST /compute/v2.1/os-aggregates/6/action => generated 313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:54.435468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-736d7d60-748d-4a4f-98e6-facc51a37f4b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-430016580", "name": "tempest-test_aggregate-1322615869"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:54.475041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-736d7d60-748d-4a4f-98e6-facc51a37f4b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Generated uuid 10e71167-2b95-4da9-a829-6f7cd8adce06 for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:54.530254 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-736d7d60-748d-4a4f-98e6-facc51a37f4b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.105583 Sep 10 20:48:54.537403 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 87/162] 10.222.0.33 () {60 vars in 1165 bytes} [Sat Sep 10 20:48:54 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:54.538316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d90813d3-f9e2-4255-99e6-5045bac7515b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:54.539956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d90813d3-f9e2-4255-99e6-5045bac7515b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:54.549136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d90813d3-f9e2-4255-99e6-5045bac7515b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:54.550345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d90813d3-f9e2-4255-99e6-5045bac7515b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:54.550345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d90813d3-f9e2-4255-99e6-5045bac7515b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:54.552518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d90813d3-f9e2-4255-99e6-5045bac7515b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:54.553115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d90813d3-f9e2-4255-99e6-5045bac7515b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:54.553754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d90813d3-f9e2-4255-99e6-5045bac7515b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:54.654535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-719ece63-3d43-4b53-8ddd-7a1e488bc759 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:54.667719 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-719ece63-3d43-4b53-8ddd-7a1e488bc759 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1322 microversion: 2.1 time: 0.964948 Sep 10 20:48:54.669251 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 76/163] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:53 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1322 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:54.678918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5eef7144-aef6-4800-a729-ef0d8559d8e7 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:54.722880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eef7144-aef6-4800-a729-ef0d8559d8e7 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:54.723289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eef7144-aef6-4800-a729-ef0d8559d8e7 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:54.723627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eef7144-aef6-4800-a729-ef0d8559d8e7 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:55.032870 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5eef7144-aef6-4800-a729-ef0d8559d8e7 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.360932 Sep 10 20:48:55.034294 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 77/164] 10.222.0.33 () {62 vars in 1232 bytes} [Sat Sep 10 20:48:54 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:48:55.040563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f0cac7a4-9258-4e07-9cbe-884f2b0b2c7e tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:55.103731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d90813d3-f9e2-4255-99e6-5045bac7515b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:55.112424 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d90813d3-f9e2-4255-99e6-5045bac7515b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1390 microversion: 2.1 time: 0.579774 Sep 10 20:48:55.117062 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f0cac7a4-9258-4e07-9cbe-884f2b0b2c7e tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.081275 Sep 10 20:48:55.118488 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 88/165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:54 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1390 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:55.124098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-befc9a50-484f-4bff-a064-c7cd9a6dee27 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:55.124976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-befc9a50-484f-4bff-a064-c7cd9a6dee27 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:55.138131 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 78/166] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:55 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:48:55.156686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e8e23ef-3abd-4b15-b65d-50b767d895f3 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:55.157227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-befc9a50-484f-4bff-a064-c7cd9a6dee27 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:55.158026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-befc9a50-484f-4bff-a064-c7cd9a6dee27 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:55.158613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-befc9a50-484f-4bff-a064-c7cd9a6dee27 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:55.159480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-befc9a50-484f-4bff-a064-c7cd9a6dee27 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:55.160078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-befc9a50-484f-4bff-a064-c7cd9a6dee27 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:55.160659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-befc9a50-484f-4bff-a064-c7cd9a6dee27 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:55.186100 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e8e23ef-3abd-4b15-b65d-50b767d895f3 tempest-AggregatesAdminTestV241-1341536733 tempest-AggregatesAdminTestV241-1341536733-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.038839 Sep 10 20:48:55.187752 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 79/167] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Sep 10 20:48:55 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:55.206862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4755cadf-2ae6-4410-96b8-eb85ba1dd822 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:55.216823 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-4755cadf-2ae6-4410-96b8-eb85ba1dd822 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4755cadf-2ae6-4410-96b8-eb85ba1dd822 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Request method failure captured: Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgDCJyo-NlUhHTykNkwYsO4TJStz5NgJqOCBtAdv6ZjTn2PnzWr88VInOxSkaL803kiWrSkliRnexvNgOSpuVBw2As1R62eziUVYwop365xDlnQhdKnNowjdlNSj1Q-USMwq4jTXw0-WEfedLhmQ94w7f1oUfDsAGClyKI_E3QhyX8 Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c8dfd36f32b9446d9fcb8551c253e3c9 Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:48:55.220763 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8dfd36f32b9446d9fcb8551c253e3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8dfd36f32b9446d9fcb8551c253e3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8dfd36f32b9446d9fcb8551c253e3c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8dfd36f32b9446d9fcb8551c253e3c9"}]}] Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c8dfd36f32b9446d9fcb8551c253e3c9 Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AggregatesAdminTestJSON-574737172-project-admin Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1e75f8b01c4a4939b7f8c2086e3974e5 Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AggregatesAdminTestJSON-574737172-project-admin Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: exception: Aggregate 7 could not be found. Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '7'} Sep 10 20:48:55.222461 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.223208 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 10 20:48:55.224345 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.228944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4755cadf-2ae6-4410-96b8-eb85ba1dd822 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:55.230169 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4755cadf-2ae6-4410-96b8-eb85ba1dd822 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.041032 Sep 10 20:48:55.235522 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 80/168] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 20:48:55 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:48:55.242456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc1a985a-3279-4d7f-aacf-506b28d4736c tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:55.262525 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-fc1a985a-3279-4d7f-aacf-506b28d4736c tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc1a985a-3279-4d7f-aacf-506b28d4736c tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Request method failure captured: Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgDCJyo-NlUhHTykNkwYsO4TJStz5NgJqOCBtAdv6ZjTn2PnzWr88VInOxSkaL803kiWrSkliRnexvNgOSpuVBw2As1R62eziUVYwop365xDlnQhdKnNowjdlNSj1Q-USMwq4jTXw0-WEfedLhmQ94w7f1oUfDsAGClyKI_E3QhyX8 Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c8dfd36f32b9446d9fcb8551c253e3c9 Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:48:55.264559 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8dfd36f32b9446d9fcb8551c253e3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8dfd36f32b9446d9fcb8551c253e3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8dfd36f32b9446d9fcb8551c253e3c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8dfd36f32b9446d9fcb8551c253e3c9"}]}] Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c8dfd36f32b9446d9fcb8551c253e3c9 Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-574737172 Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AggregatesAdminTestJSON-574737172-project-admin Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1e75f8b01c4a4939b7f8c2086e3974e5 Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AggregatesAdminTestJSON-574737172-project-admin Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: exception: Aggregate 7 could not be found. Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '7'} Sep 10 20:48:55.265761 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:48:55.266532 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.268895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:55.270613 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:55.270613 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:48:55.270613 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:48:55.270613 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 10 20:48:55.270613 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.277502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc1a985a-3279-4d7f-aacf-506b28d4736c tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:55.278779 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc1a985a-3279-4d7f-aacf-506b28d4736c tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.041775 Sep 10 20:48:55.279489 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 81/169] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:55 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:48:55.292348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-052b7248-8eb5-4562-bd4f-46cab1355a4d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1022588010"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:55.298213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.aggregate [None req-052b7248-8eb5-4562-bd4f-46cab1355a4d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Generated uuid 1b78b54d-ecad-4cb8-b50e-041ae07b46cb for aggregate {{(pid=145772) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:55.332904 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-052b7248-8eb5-4562-bd4f-46cab1355a4d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052026 Sep 10 20:48:55.334141 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 82/170] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:48:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:55.341396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-260a342d-e071-413f-9503-d09c791b3c2b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-727062943"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:55.346268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.aggregate [None req-260a342d-e071-413f-9503-d09c791b3c2b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Generated uuid cc7a39d6-9f59-4b7d-b403-dfa08ee20e40 for aggregate {{(pid=145772) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:55.393481 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-260a342d-e071-413f-9503-d09c791b3c2b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.058084 Sep 10 20:48:55.395346 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 83/171] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:48:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:55.402533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-65a10ce9-e266-4cc2-a076-231e8e7eea52 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:55.417123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65a10ce9-e266-4cc2-a076-231e8e7eea52 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:55.417788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65a10ce9-e266-4cc2-a076-231e8e7eea52 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:55.418389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65a10ce9-e266-4cc2-a076-231e8e7eea52 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:55.428028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:55.528039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-befc9a50-484f-4bff-a064-c7cd9a6dee27 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:55.549624 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-befc9a50-484f-4bff-a064-c7cd9a6dee27 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1467 microversion: 2.1 time: 0.426933 Sep 10 20:48:55.568010 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 89/172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:55 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1467 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:55.579828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1b80457a-5453-47cd-a38e-526966b8696f tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:55.615397 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1b80457a-5453-47cd-a38e-526966b8696f tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 226 microversion: 2.1 time: 0.045475 Sep 10 20:48:55.615951 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 90/173] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 20:48:55 2022] GET /compute/v2.1/os-aggregates/9 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:55.654680 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-65a10ce9-e266-4cc2-a076-231e8e7eea52 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.257968 Sep 10 20:48:55.664259 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 84/174] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:55 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:55.671106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-266db872-2cae-4422-bd66-78759981036e tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:55.731242 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-266db872-2cae-4422-bd66-78759981036e tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 264 microversion: 2.1 time: 0.065057 Sep 10 20:48:55.733908 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 85/175] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:55 2022] POST /compute/v2.1/os-aggregates/9/action => generated 264 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:55.744124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-478201fd-3dd0-4317-b373-0b1317999097 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:55.757985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-478201fd-3dd0-4317-b373-0b1317999097 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:55.758772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-478201fd-3dd0-4317-b373-0b1317999097 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:55.759397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-478201fd-3dd0-4317-b373-0b1317999097 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:55.812211 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-478201fd-3dd0-4317-b373-0b1317999097 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] HTTP exception thrown: Aggregate 8 already has host nch2-master-1. Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-478201fd-3dd0-4317-b373-0b1317999097 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Request method failure captured: Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 39 Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgGobIF0tCBOjGU76gpoCzN_c0hgGBmh3PTc8qCAH6X0d6SNrJY9nVEQGa-xX1Rh8vSUnTgDBbQqZ2MhBAKEnTljRN-PNRkvI6h46AQOjC-BSb0y1rVYaLg1BBDj2Dmu2_lHQK63f4jHgBjmR2ijcYR0YtNFwkm4xAIKnyQ7UQMFTs Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:48:55.886853 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a825f49753c4baaa6661e82f2c30df7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a825f49753c4baaa6661e82f2c30df7"}]}] Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f794e66e441b4e489ea613b164ed6b29 Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: {"add_host": {"host": "nch2-master-1"}} Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:48:55.888387 ncdv-master-1 devstack@n-api.service[145772]: exception: Aggregate 8 already has host nch2-master-1. Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '8', 'body': {'add_host': {'host': 'nch2-master-1'}}} Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result.read() Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 20:48:55.889090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-8' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi session.flush() Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 20:48:55.890926 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 20:48:55.892200 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 20:48:55.898987 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result.read() Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-8' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 10, 20, 48, 55, 785648), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 8}] Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.901401 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 8 already has host nch2-master-1. Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.903239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 8 already has host nch2-master-1. Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:48:55.907027 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:48:55.914113 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 already has host nch2-master-1. Sep 10 20:48:55.914113 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:55.914113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-478201fd-3dd0-4317-b373-0b1317999097 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Returning 409 to user: Aggregate 8 already has host nch2-master-1. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:55.914113 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-478201fd-3dd0-4317-b373-0b1317999097 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/8/action" status: 409 len: 95 microversion: 2.1 time: 0.156242 Sep 10 20:48:55.914113 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 86/176] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:55 2022] POST /compute/v2.1/os-aggregates/8/action => generated 95 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 10 20:48:55.914113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0d59f78e-1c1d-45d5-9742-f701cefa3565 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:55.914113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0d59f78e-1c1d-45d5-9742-f701cefa3565 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:55.916815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d59f78e-1c1d-45d5-9742-f701cefa3565 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:55.918317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d59f78e-1c1d-45d5-9742-f701cefa3565 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:55.918830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d59f78e-1c1d-45d5-9742-f701cefa3565 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:55.919875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d59f78e-1c1d-45d5-9742-f701cefa3565 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:55.920640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d59f78e-1c1d-45d5-9742-f701cefa3565 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:55.921137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d59f78e-1c1d-45d5-9742-f701cefa3565 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:56.046543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-996296731", "block_migration": true, "disk_over_commit": false}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:56.050770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:56.072251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:56.075441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:56.078376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:56.079240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:56.080312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:56.081135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:56.678843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lazy-loading 'flavor' on Instance uuid 1fc1d5b2-4eff-42cc-a465-634307e9e709 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:48:56.701615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0d59f78e-1c1d-45d5-9742-f701cefa3565 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:56.733089 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0d59f78e-1c1d-45d5-9742-f701cefa3565 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1322 microversion: 2.1 time: 0.838333 Sep 10 20:48:56.735101 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 87/177] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:55 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1322 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:56.750724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-025c9666-05c4-40ea-8d61-367c68dcb23b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:56.792192 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-025c9666-05c4-40ea-8d61-367c68dcb23b tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.052819 Sep 10 20:48:56.793389 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 88/178] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 20:48:56 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:56.804747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ebaf362f-c3f9-42ca-8a0c-6ac56ac45ce4 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:56.828316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebaf362f-c3f9-42ca-8a0c-6ac56ac45ce4 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:56.829053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebaf362f-c3f9-42ca-8a0c-6ac56ac45ce4 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:56.829355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Going to try to live migrate instance to tempest-host-996296731 {{(pid=145771) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 20:48:56.830346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebaf362f-c3f9-42ca-8a0c-6ac56ac45ce4 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:56.853393 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] HTTP exception thrown: Compute host tempest-host-996296731 could not be found. Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Request method failure captured: Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709/action HTTP/1.1 Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 106 Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgSx3T4UTdD2EubvPUGGLUf2P5WeeERqFUVlc5f0yBpJOWQh_gFhqNcSytq5KhCugG6jf_-HACuMbv_jnaD7pvEqGcm1EjzshkdG_ASdBeRmNFzgbv2nmiN356iMUFkjmL8BupoTEOAIVyChGhbm--o4Vf3XbCc3LAyLkmOAGGqYHE Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 1b12288ef70e4b38b128866c7f2efd47 Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-LiveMigrationNegativeTest-646811673 Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:48:56.869810 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b12288ef70e4b38b128866c7f2efd47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b12288ef70e4b38b128866c7f2efd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b12288ef70e4b38b128866c7f2efd47", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b12288ef70e4b38b128866c7f2efd47"}]}] Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-LiveMigrationNegativeTest-646811673 Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 1b12288ef70e4b38b128866c7f2efd47 Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-646811673 Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-LiveMigrationNegativeTest-646811673-project-admin Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 35c7c4e102e94a5c92d52b94099d50b5 Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-LiveMigrationNegativeTest-646811673-project-admin Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: {"os-migrateLive": {"host": "tempest-host-996296731", "block_migration": true, "disk_over_commit": false}} Sep 10 20:48:56.871212 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: exception: Compute host tempest-host-996296731 could not be found. Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '1fc1d5b2-4eff-42cc-a465-634307e9e709', 'body': {'os-migrateLive': {'host': 'tempest-host-996296731', 'block_migration': True, 'disk_over_commit': False}}} Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 20:48:56.871867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-996296731 could not be found. Sep 10 20:48:56.873035 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-996296731 could not be found. Sep 10 20:48:56.875881 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-996296731 could not be found. Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Returning 400 to user: Compute host tempest-host-996296731 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:56.878345 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6b523d25-1024-4726-a123-5a964e918b54 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709/action" status: 400 len: 99 microversion: 2.1 time: 1.245589 Sep 10 20:48:56.903459 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 91/179] 10.222.0.33 () {60 vars in 1279 bytes} [Sat Sep 10 20:48:55 2022] POST /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709/action => generated 99 bytes in 1274 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:48:56.908949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a4fde611-747f-43fa-8a88-14f1ab816bf5 req-a95c1841-96ca-4c38-8f5a-af4ab6abb796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023ec8d2-8599-46cf-9dd4-3242411b0762", "name": "network-vif-plugged", "status": "completed", "tag": "76e5ab12-5706-4c92-bcb5-368b6a237537"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:56.976669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a4fde611-747f-43fa-8a88-14f1ab816bf5 req-a95c1841-96ca-4c38-8f5a-af4ab6abb796 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:56.977861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a4fde611-747f-43fa-8a88-14f1ab816bf5 req-a95c1841-96ca-4c38-8f5a-af4ab6abb796 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:56.978310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a4fde611-747f-43fa-8a88-14f1ab816bf5 req-a95c1841-96ca-4c38-8f5a-af4ab6abb796 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:57.002205 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a4fde611-747f-43fa-8a88-14f1ab816bf5 req-a95c1841-96ca-4c38-8f5a-af4ab6abb796 service nova] Creating event network-vif-plugged:76e5ab12-5706-4c92-bcb5-368b6a237537 for instance 023ec8d2-8599-46cf-9dd4-3242411b0762 on nch2-master-1 Sep 10 20:48:57.010522 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a4fde611-747f-43fa-8a88-14f1ab816bf5 req-a95c1841-96ca-4c38-8f5a-af4ab6abb796 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105374 Sep 10 20:48:57.011338 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 92/180] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:57.033876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29cbbda6-8bf6-424d-99b9-150de89fe8f3 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:57.034704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-29cbbda6-8bf6-424d-99b9-150de89fe8f3 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:57.046369 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ebaf362f-c3f9-42ca-8a0c-6ac56ac45ce4 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.251492 Sep 10 20:48:57.047304 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 89/181] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Sep 10 20:48:56 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:57.060619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29cbbda6-8bf6-424d-99b9-150de89fe8f3 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:57.061287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29cbbda6-8bf6-424d-99b9-150de89fe8f3 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:57.062536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29cbbda6-8bf6-424d-99b9-150de89fe8f3 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:57.065819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29cbbda6-8bf6-424d-99b9-150de89fe8f3 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:57.066480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29cbbda6-8bf6-424d-99b9-150de89fe8f3 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:57.067054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29cbbda6-8bf6-424d-99b9-150de89fe8f3 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:57.476084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-29cbbda6-8bf6-424d-99b9-150de89fe8f3 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:57.485538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:57.490716 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-29cbbda6-8bf6-424d-99b9-150de89fe8f3 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1390 microversion: 2.1 time: 0.477002 Sep 10 20:48:57.492913 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 93/182] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:57 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1390 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:57.499018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-21150534-c6f7-469f-9a61-98b5bc0b249f tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:57.579126 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-21150534-c6f7-469f-9a61-98b5bc0b249f tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.084720 Sep 10 20:48:57.580011 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 94/183] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:57 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:48:57.588154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dadc5b05-3ac7-46d4-9ea1-2b59244fc211 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:57.589358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dadc5b05-3ac7-46d4-9ea1-2b59244fc211 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:57.600657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1114335961", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "d1056f7d-9b49-496a-b2dd-0515a9a2e934"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:57.603588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dadc5b05-3ac7-46d4-9ea1-2b59244fc211 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:57.604440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dadc5b05-3ac7-46d4-9ea1-2b59244fc211 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:57.605229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dadc5b05-3ac7-46d4-9ea1-2b59244fc211 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:57.606601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dadc5b05-3ac7-46d4-9ea1-2b59244fc211 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:57.607333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dadc5b05-3ac7-46d4-9ea1-2b59244fc211 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:57.608237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dadc5b05-3ac7-46d4-9ea1-2b59244fc211 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:57.712552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] validate_networks() for [('d1056f7d-9b49-496a-b2dd-0515a9a2e934', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:48:57.730459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=15 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:57.938447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dadc5b05-3ac7-46d4-9ea1-2b59244fc211 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:57.958573 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dadc5b05-3ac7-46d4-9ea1-2b59244fc211 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1467 microversion: 2.1 time: 0.376938 Sep 10 20:48:57.975660 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 95/184] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:57 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1467 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:57.975660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a2176367-cf50-4b3d-be37-0a6356d40d57 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:58.016986 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a2176367-cf50-4b3d-be37-0a6356d40d57 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.054286 Sep 10 20:48:58.017591 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 96/185] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:48:57 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:48:58.023828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-97751ee1-029a-44c1-80a2-a71bdfbb095b req-02c2e029-953e-4ac5-89dc-94b0bdd8f80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6c810a-a866-4b29-b720-c315990efec6", "tag": "4dbad661-7d36-4057-8164-bff97ab5b452"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:58.067997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-97751ee1-029a-44c1-80a2-a71bdfbb095b req-02c2e029-953e-4ac5-89dc-94b0bdd8f80f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:58.077697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-97751ee1-029a-44c1-80a2-a71bdfbb095b req-02c2e029-953e-4ac5-89dc-94b0bdd8f80f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:58.078979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-97751ee1-029a-44c1-80a2-a71bdfbb095b req-02c2e029-953e-4ac5-89dc-94b0bdd8f80f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:58.108693 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-97751ee1-029a-44c1-80a2-a71bdfbb095b req-02c2e029-953e-4ac5-89dc-94b0bdd8f80f service nova] Creating event network-changed:4dbad661-7d36-4057-8164-bff97ab5b452 for instance 6e6c810a-a866-4b29-b720-c315990efec6 on nch1-master-1 Sep 10 20:48:58.121604 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-97751ee1-029a-44c1-80a2-a71bdfbb095b req-02c2e029-953e-4ac5-89dc-94b0bdd8f80f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102747 Sep 10 20:48:58.126698 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 97/186] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:58.132978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9855a689-9472-4fef-ad62-29e6f387cfbc tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-613968982", "availability_zone": "tempest-test_az-309573868"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:58.140635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-9855a689-9472-4fef-ad62-29e6f387cfbc tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Generated uuid c3a0132c-e2b1-4f27-9daa-f7897c742907 for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:58.200834 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9855a689-9472-4fef-ad62-29e6f387cfbc tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.070499 Sep 10 20:48:58.201951 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 98/187] 10.222.0.33 () {60 vars in 1165 bytes} [Sat Sep 10 20:48:58 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:58.221523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8103b96e-f9d2-4ce6-a934-be83bcad8638 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:58.222294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8103b96e-f9d2-4ce6-a934-be83bcad8638 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:58.256697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8103b96e-f9d2-4ce6-a934-be83bcad8638 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:58.256697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8103b96e-f9d2-4ce6-a934-be83bcad8638 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:58.256697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8103b96e-f9d2-4ce6-a934-be83bcad8638 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:58.257121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8103b96e-f9d2-4ce6-a934-be83bcad8638 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:58.257537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8103b96e-f9d2-4ce6-a934-be83bcad8638 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:58.258092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8103b96e-f9d2-4ce6-a934-be83bcad8638 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:58.419399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:58.586216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8103b96e-f9d2-4ce6-a934-be83bcad8638 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:58.606467 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8103b96e-f9d2-4ce6-a934-be83bcad8638 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1322 microversion: 2.1 time: 0.403341 Sep 10 20:48:58.607209 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 99/188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:58 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:58.625802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6633839a-89e1-4c76-80b3-0eaf7527b96b tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-821487412"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:58.638313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-6633839a-89e1-4c76-80b3-0eaf7527b96b tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Generated uuid 43438937-842b-457e-ac60-c67583e9a2fb for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:48:58.670919 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6633839a-89e1-4c76-80b3-0eaf7527b96b tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060844 Sep 10 20:48:58.671840 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 100/189] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:48:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:58.692968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-040294cf-7525-48ea-8023-0b69ea143d96 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-613968982_new", "availability_zone": "tempest-test_az-309573868_new"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:58.843554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:48:58.864999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-040294cf-7525-48ea-8023-0b69ea143d96 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:58.872779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-040294cf-7525-48ea-8023-0b69ea143d96 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:58.873263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-040294cf-7525-48ea-8023-0b69ea143d96 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:58.953109 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-040294cf-7525-48ea-8023-0b69ea143d96 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 334 microversion: 2.1 time: 0.268993 Sep 10 20:48:58.955044 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 101/190] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Sep 10 20:48:58 2022] PUT /compute/v2.1/os-aggregates/10 => generated 334 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:58.962883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1154156652", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:58.971691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:48:58.971691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:48:58.972585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:48:58.973693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:48:58.974003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:48:58.999108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:58.999857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:59.000614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:59.001594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:59.002881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:59.004591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:59.031584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Getting quotas for project 89075fefc8ea47c78d4ff7364e12ffde. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:48:59.037287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Getting quotas for user dd431fc2d9834bea8df807edb91771ee and project 89075fefc8ea47c78d4ff7364e12ffde. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:48:59.057488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:48:59.059873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:48:59.060848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:48:59.145667 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-545300c5-e85e-4d20-a876-5a4785f70c73 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.097204 Sep 10 20:48:59.146728 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 90/191] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:48:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2099 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 20:48:59.156571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c71b9a9-0a8e-401b-800d-251c1f94aab4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:59.157403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c71b9a9-0a8e-401b-800d-251c1f94aab4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:48:59.188626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c71b9a9-0a8e-401b-800d-251c1f94aab4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:59.189321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c71b9a9-0a8e-401b-800d-251c1f94aab4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:59.189943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c71b9a9-0a8e-401b-800d-251c1f94aab4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:59.190819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c71b9a9-0a8e-401b-800d-251c1f94aab4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:59.191593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c71b9a9-0a8e-401b-800d-251c1f94aab4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:59.192867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c71b9a9-0a8e-401b-800d-251c1f94aab4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:59.386259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c71b9a9-0a8e-401b-800d-251c1f94aab4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:59.403610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c71b9a9-0a8e-401b-800d-251c1f94aab4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1589 microversion: 2.1 time: 0.255676 Sep 10 20:48:59.404206 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 91/192] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:48:59 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1589 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:48:59.714559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:48:59.715150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:48:59.715874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:48:59.716995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:48:59.717953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:48:59.754804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:59.755598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:59.759187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:59.761867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:48:59.762948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:48:59.763655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:48:59.810473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Getting quotas for project 35ef1b5d5dba4e3c93d8bb622ff79c5e. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:48:59.834152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Getting quotas for user 5aab292e925940568e9e5db8b6910f45 and project 35ef1b5d5dba4e3c93d8bb622ff79c5e. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:48:59.873428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:48:59.876217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:48:59.918889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0e7efefc-1a4b-4ac7-a272-26ea5fcd555d tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:48:59.923735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0e7efefc-1a4b-4ac7-a272-26ea5fcd555d tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'ea55e45cd1b94a41baed5bb35ce324f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64caaddd046d4282a6c5dccf553eb5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0e7efefc-1a4b-4ac7-a272-26ea5fcd555d tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Request method failure captured: Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 39 Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgDlchoXCDesf6M1Ta3upB4s8kcWUyP1OiqCvMj8ZUfcupoG9nrexQAUecolF-qmBWmI2QxlwrP4wPUrEJKwgSreXEjWmhkOcs5IFdoPjn_zqqUE-P8SqJC5OzeZTzhbX14ASL6KeeqGjKpgvBsafinlC8bnFWLLppSmBPc6EcBOsM Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:48:59.928975 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64caaddd046d4282a6c5dccf553eb5ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64caaddd046d4282a6c5dccf553eb5ea"}]}] Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ea55e45cd1b94a41baed5bb35ce324f8 Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: {"add_host": {"host": "nch2-master-1"}} Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:48:59.930529 ncdv-master-1 devstack@n-api.service[145772]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '11', 'body': {'add_host': {'host': 'nch2-master-1'}}} Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:48:59.931260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 10 20:48:59.932633 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:48:59.939227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0e7efefc-1a4b-4ac7-a272-26ea5fcd555d tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:48:59.940317 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0e7efefc-1a4b-4ac7-a272-26ea5fcd555d tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/11/action" status: 403 len: 118 microversion: 2.1 time: 0.520988 Sep 10 20:48:59.942568 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 92/193] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Sep 10 20:48:59 2022] POST /compute/v2.1/os-aggregates/11/action => generated 118 bytes in 538 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:48:59.949628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8674aa34-67c4-4dc7-94f7-39884267e153 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:59.970934 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8674aa34-67c4-4dc7-94f7-39884267e153 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 551 microversion: 2.1 time: 0.025889 Sep 10 20:48:59.975735 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 93/194] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:48:59 2022] GET /compute/v2.1/os-aggregates => generated 551 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:48:59.987871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe072e37-afa6-449f-9983-0b2c3b95590b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:48:59.989178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fe072e37-afa6-449f-9983-0b2c3b95590b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:00.000278 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d0aa372-5b7d-4a01-8850-db7f3c406ca8 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043449 Sep 10 20:49:00.007859 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 102/195] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:48:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:49:00.035609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-202ed4a3-4209-4cfe-aa46-cc99b30f8e04 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:00.042694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-202ed4a3-4209-4cfe-aa46-cc99b30f8e04 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:00.063898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202ed4a3-4209-4cfe-aa46-cc99b30f8e04 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:00.064424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202ed4a3-4209-4cfe-aa46-cc99b30f8e04 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:00.068207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202ed4a3-4209-4cfe-aa46-cc99b30f8e04 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:00.071673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202ed4a3-4209-4cfe-aa46-cc99b30f8e04 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:00.072220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202ed4a3-4209-4cfe-aa46-cc99b30f8e04 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:00.072662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202ed4a3-4209-4cfe-aa46-cc99b30f8e04 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:00.372921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fe072e37-afa6-449f-9983-0b2c3b95590b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:00.383955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fe072e37-afa6-449f-9983-0b2c3b95590b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:00.385864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fe072e37-afa6-449f-9983-0b2c3b95590b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:00.388698 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fe072e37-afa6-449f-9983-0b2c3b95590b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1262 microversion: 2.25 time: 0.409745 Sep 10 20:49:00.410577 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 94/196] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:48:59 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1262 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:00.427142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb1abe9d-de8b-4142-ab1f-1aab7c68c5d4 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:00.427768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bb1abe9d-de8b-4142-ab1f-1aab7c68c5d4 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:00.442039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb1abe9d-de8b-4142-ab1f-1aab7c68c5d4 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:00.442543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb1abe9d-de8b-4142-ab1f-1aab7c68c5d4 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:00.442983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb1abe9d-de8b-4142-ab1f-1aab7c68c5d4 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:00.447081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb1abe9d-de8b-4142-ab1f-1aab7c68c5d4 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:00.458648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb1abe9d-de8b-4142-ab1f-1aab7c68c5d4 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:00.458830 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-202ed4a3-4209-4cfe-aa46-cc99b30f8e04 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.441809 Sep 10 20:49:00.459511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb1abe9d-de8b-4142-ab1f-1aab7c68c5d4 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:00.469214 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 103/197] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 20:49:00 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762/os-interface => generated 284 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:00.475080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e589f115-1df9-40ca-8552-f99adc73d030 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:00.529976 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e589f115-1df9-40ca-8552-f99adc73d030 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.058085 Sep 10 20:49:00.531613 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 104/198] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:00 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:49:00.558093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91636689-5e4d-4a03-88b0-6d037aa64c41 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:00.639154 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91636689-5e4d-4a03-88b0-6d037aa64c41 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.105218 Sep 10 20:49:00.647193 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 105/199] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:00 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:49:00.658088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dc81a7ca-f298-4ee2-b063-cc79ccc397d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:00.659638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dc81a7ca-f298-4ee2-b063-cc79ccc397d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:00.807650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dc81a7ca-f298-4ee2-b063-cc79ccc397d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:00.822210 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dc81a7ca-f298-4ee2-b063-cc79ccc397d7 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1219 microversion: 2.1 time: 0.169617 Sep 10 20:49:00.825322 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 106/200] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:00 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:00.841884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f52a6e4-c0c1-4968-affb-a78881390911 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1459315817"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:00.846861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-3f52a6e4-c0c1-4968-affb-a78881390911 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Generated uuid ee5f31a7-1602-4784-9ca5-79db01cddf36 for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:49:00.890577 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f52a6e4-c0c1-4968-affb-a78881390911 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066187 Sep 10 20:49:00.891392 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 107/201] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:49:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:00.906070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-44c56670-dd46-474b-b718-8c63dffb9421 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1117727296"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:00.918397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-44c56670-dd46-474b-b718-8c63dffb9421 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Generated uuid 7c3d2126-55ea-4147-a948-11b39e569fe2 for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:49:00.967813 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-44c56670-dd46-474b-b718-8c63dffb9421 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.075479 Sep 10 20:49:00.975552 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 108/202] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:49:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:00.990430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-488491672"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:01.014673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:01.015278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:01.015596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:01.036217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:01.036714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:01.043956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:01.063309 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-488491672 could not be found. Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Request method failure captured: Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 57 Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgGobIF0tCBOjGU76gpoCzN_c0hgGBmh3PTc8qCAH6X0d6SNrJY9nVEQGa-xX1Rh8vSUnTgDBbQqZ2MhBAKEnTljRN-PNRkvI6h46AQOjC-BSb0y1rVYaLg1BBDj2Dmu2_lHQK63f4jHgBjmR2ijcYR0YtNFwkm4xAIKnyQ7UQMFTs Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:01.065660 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a825f49753c4baaa6661e82f2c30df7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a825f49753c4baaa6661e82f2c30df7"}]}] Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: f794e66e441b4e489ea613b164ed6b29 Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: {"add_host": {"host": "tempest-nonexist_host-488491672"}} Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:01.066975 ncdv-master-1 devstack@n-api.service[145771]: exception: Compute host tempest-nonexist_host-488491672 could not be found. Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-488491672'}}} Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-488491672' is not mapped to any cell Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.067805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 10 20:49:01.070159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-488491672 could not be found. Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-488491672 could not be found. Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.071365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.072521 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.072521 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.072521 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.072521 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:01.072521 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:01.072521 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-488491672 could not be found. Sep 10 20:49:01.072521 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.072521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-488491672 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:01.072521 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7a617289-16ea-4122-aca7-6789b437ce2e tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 110 microversion: 2.1 time: 0.087043 Sep 10 20:49:01.072521 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 109/203] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Sep 10 20:49:00 2022] POST /compute/v2.1/os-aggregates/12/action => generated 110 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:01.078029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e8aa5417-694c-457f-ace1-0cae2bc7ff92 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:01.102768 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e8aa5417-694c-457f-ace1-0cae2bc7ff92 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.033729 Sep 10 20:49:01.110359 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 110/204] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:49:01 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:01.114387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-50011762-63e8-46ec-b4ab-d1ad291c2e17 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:01.146949 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-50011762-63e8-46ec-b4ab-d1ad291c2e17 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.041234 Sep 10 20:49:01.149900 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 111/205] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:01 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:49:01.158670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8aacaf12-cbb7-4a6f-9de0-80e21c600734 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:01.195987 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8aacaf12-cbb7-4a6f-9de0-80e21c600734 tempest-AggregatesAdminTestJSON-574737172 tempest-AggregatesAdminTestJSON-574737172-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.043192 Sep 10 20:49:01.201935 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 112/206] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:01 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:49:01.209370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b09d8d16-5aaa-4241-85d5-519d1d231c0a tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b09d8d16-5aaa-4241-85d5-519d1d231c0a tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Request method failure captured: Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 283 Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgGobIF0tCBOjGU76gpoCzN_c0hgGBmh3PTc8qCAH6X0d6SNrJY9nVEQGa-xX1Rh8vSUnTgDBbQqZ2MhBAKEnTljRN-PNRkvI6h46AQOjC-BSb0y1rVYaLg1BBDj2Dmu2_lHQK63f4jHgBjmR2ijcYR0YtNFwkm4xAIKnyQ7UQMFTs Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:01.227277 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:01.228824 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a825f49753c4baaa6661e82f2c30df7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a825f49753c4baaa6661e82f2c30df7"}]}] Sep 10 20:49:01.228824 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:01.228824 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:01.228824 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:01.228824 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:01.228824 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:01.228824 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:01.228824 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: f794e66e441b4e489ea613b164ed6b29 Sep 10 20:49:01.228824 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:01.228824 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:01.229654 ncdv-master-1 devstack@n-api.service[145771]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 10 20:49:01.229654 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:01.229654 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:49:01.229654 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 10 20:49:01.229654 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:01.229654 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.229654 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:49:01.229654 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:49:01.229654 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:49:01.229654 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:01.230434 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.231659 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.232629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:49:01.232629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:49:01.232629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:49:01.232629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.232629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b09d8d16-5aaa-4241-85d5-519d1d231c0a tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:01.235851 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b09d8d16-5aaa-4241-85d5-519d1d231c0a tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.032382 Sep 10 20:49:01.238454 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 113/207] 10.222.0.33 () {60 vars in 1165 bytes} [Sat Sep 10 20:49:01 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:49:01.250607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:01.251531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:01.262984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:01.264560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:01.266108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:01.267098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:01.268110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:01.269170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:01.304671 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] HTTP exception thrown: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Request method failure captured: Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 HTTP/1.1 Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgB__Q59lw-XcUE5ObaaudyQ17nMihA8j0LSTUAgXask_qjY9HIWAlz7u9SAMBQkndxckzgjVtEE2Ae4mvqiZaMVHDzRzZwctGjq3a3d1odv4jkHsLgPY6WkGqbUFvcqbDu-gjFJ2KnNQlhSlXqx15kweYg2Nr9vWzxf3xmvxPkdnc Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 5f6c275f77df48e196553dbc20db8ed9 Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminTestJSON-1682510343 Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:01.307285 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f6c275f77df48e196553dbc20db8ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f6c275f77df48e196553dbc20db8ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f6c275f77df48e196553dbc20db8ed9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f6c275f77df48e196553dbc20db8ed9"}]}] Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminTestJSON-1682510343 Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 5f6c275f77df48e196553dbc20db8ed9 Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1682510343 Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminTestJSON-1682510343-project Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 736fcd7811e341468d7080da18b011ea Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminTestJSON-1682510343-project Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:49:01.308964 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5119493a-5eb3-44c8-9686-4ad614bf2686'} Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:01.309742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:49:01.311141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.312713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Returning 404 to user: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:01.312713 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f3f0759-d69e-4c41-a358-473516e984b4 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 404 len: 111 microversion: 2.1 time: 0.072246 Sep 10 20:49:01.312713 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 114/208] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:49:01 2022] DELETE /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:01.349089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca8e6bdc-5d81-4208-81d5-7bf8c0cff7f2 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca8e6bdc-5d81-4208-81d5-7bf8c0cff7f2 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Request method failure captured: Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 27 Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgGobIF0tCBOjGU76gpoCzN_c0hgGBmh3PTc8qCAH6X0d6SNrJY9nVEQGa-xX1Rh8vSUnTgDBbQqZ2MhBAKEnTljRN-PNRkvI6h46AQOjC-BSb0y1rVYaLg1BBDj2Dmu2_lHQK63f4jHgBjmR2ijcYR0YtNFwkm4xAIKnyQ7UQMFTs Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:01.359880 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a825f49753c4baaa6661e82f2c30df7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a825f49753c4baaa6661e82f2c30df7"}]}] Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: f794e66e441b4e489ea613b164ed6b29 Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: {"aggregate": {"name": ""}} Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:01.361368 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi '' Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:01.362111 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 20:49:01.363317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.367757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca8e6bdc-5d81-4208-81d5-7bf8c0cff7f2 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:01.368993 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ca8e6bdc-5d81-4208-81d5-7bf8c0cff7f2 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.051649 Sep 10 20:49:01.369741 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 115/209] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:49:01 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:49:01.384643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:01.387542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] [instance: 5119493a-5eb3-44c8-9686-4ad614bf2686] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:01.405253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:01.409433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:01.411304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:01.412310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:01.412782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:01.413232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:01.457919 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] HTTP exception thrown: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Request method failure captured: Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 HTTP/1.1 Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgB__Q59lw-XcUE5ObaaudyQ17nMihA8j0LSTUAgXask_qjY9HIWAlz7u9SAMBQkndxckzgjVtEE2Ae4mvqiZaMVHDzRzZwctGjq3a3d1odv4jkHsLgPY6WkGqbUFvcqbDu-gjFJ2KnNQlhSlXqx15kweYg2Nr9vWzxf3xmvxPkdnc Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 5f6c275f77df48e196553dbc20db8ed9 Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminTestJSON-1682510343 Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:01.462553 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f6c275f77df48e196553dbc20db8ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5f6c275f77df48e196553dbc20db8ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5f6c275f77df48e196553dbc20db8ed9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5f6c275f77df48e196553dbc20db8ed9"}]}] Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminTestJSON-1682510343 Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 5f6c275f77df48e196553dbc20db8ed9 Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1682510343 Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminTestJSON-1682510343-project Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 736fcd7811e341468d7080da18b011ea Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminTestJSON-1682510343-project Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:49:01.464030 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5119493a-5eb3-44c8-9686-4ad614bf2686'} Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:01.465313 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. Sep 10 20:49:01.466429 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.470658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] Returning 404 to user: Instance 5119493a-5eb3-44c8-9686-4ad614bf2686 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:01.472533 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-56984323-43b2-4fc7-9017-51df610cdd14 tempest-AggregatesAdminTestJSON-1682510343 tempest-AggregatesAdminTestJSON-1682510343-project] 10.222.0.33 "GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686" status: 404 len: 111 microversion: 2.1 time: 0.096341 Sep 10 20:49:01.479064 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 116/210] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:01 2022] GET /compute/v2.1/servers/5119493a-5eb3-44c8-9686-4ad614bf2686 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:01.486477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3529044-bd7c-4072-a5d3-64ed36e53507 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-530729670"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:01.500194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e3529044-bd7c-4072-a5d3-64ed36e53507 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'ea55e45cd1b94a41baed5bb35ce324f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64caaddd046d4282a6c5dccf553eb5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3529044-bd7c-4072-a5d3-64ed36e53507 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Request method failure captured: Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 59 Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgDlchoXCDesf6M1Ta3upB4s8kcWUyP1OiqCvMj8ZUfcupoG9nrexQAUecolF-qmBWmI2QxlwrP4wPUrEJKwgSreXEjWmhkOcs5IFdoPjn_zqqUE-P8SqJC5OzeZTzhbX14ASL6KeeqGjKpgvBsafinlC8bnFWLLppSmBPc6EcBOsM Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:01.505073 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64caaddd046d4282a6c5dccf553eb5ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64caaddd046d4282a6c5dccf553eb5ea"}]}] Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ea55e45cd1b94a41baed5bb35ce324f8 Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: {"aggregate": {"name": "tempest-test_aggregate-530729670"}} Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:01.506423 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-530729670'}}} Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:01.507348 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:01.508492 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 10 20:49:01.512580 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:01.512580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3529044-bd7c-4072-a5d3-64ed36e53507 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:01.512580 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3529044-bd7c-4072-a5d3-64ed36e53507 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.025896 Sep 10 20:49:01.514459 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 117/211] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:49:01 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:01.529252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:01.530125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:01.548894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:01.549488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:01.550590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:01.551473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:01.553060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:01.555956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:01.917300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:01.935105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:01.936494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:01.937858 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-055a8884-6ebe-4c70-b908-12a7f7c7a1a6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1322 microversion: 2.25 time: 0.421971 Sep 10 20:49:01.959024 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 118/212] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:01 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:01.970060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-363fe3eb-c696-492d-baac-3dae3127edf9 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1553560016"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:01.974119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-363fe3eb-c696-492d-baac-3dae3127edf9 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Generated uuid c7011e43-4397-4a20-a54d-e28c4f79796e for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:49:02.022223 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-363fe3eb-c696-492d-baac-3dae3127edf9 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061943 Sep 10 20:49:02.032395 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 119/213] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:49:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:02.039238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5d322a57-e8fc-4f9a-85be-c0df155928b2 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:02.039985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5d322a57-e8fc-4f9a-85be-c0df155928b2 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:02.049725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d322a57-e8fc-4f9a-85be-c0df155928b2 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:02.050336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d322a57-e8fc-4f9a-85be-c0df155928b2 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:02.050772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d322a57-e8fc-4f9a-85be-c0df155928b2 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:02.052597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d322a57-e8fc-4f9a-85be-c0df155928b2 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:02.053069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d322a57-e8fc-4f9a-85be-c0df155928b2 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:02.054809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d322a57-e8fc-4f9a-85be-c0df155928b2 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:02.259897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5d322a57-e8fc-4f9a-85be-c0df155928b2 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:02.274182 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5d322a57-e8fc-4f9a-85be-c0df155928b2 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1271 microversion: 2.1 time: 0.240310 Sep 10 20:49:02.297563 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 120/214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:02 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:02.304235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2cb1411f-81f8-4256-8301-15b8c22ec32c tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1553560016"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:02.308790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-2cb1411f-81f8-4256-8301-15b8c22ec32c tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Generated uuid ac0888d3-1f68-4829-91a8-00cedce0fdc2 for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:49:02.310004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bb1abe9d-de8b-4142-ab1f-1aab7c68c5d4 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:02.320786 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-2cb1411f-81f8-4256-8301-15b8c22ec32c tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1553560016 already exists. Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2cb1411f-81f8-4256-8301-15b8c22ec32c tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Request method failure captured: Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 60 Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgGobIF0tCBOjGU76gpoCzN_c0hgGBmh3PTc8qCAH6X0d6SNrJY9nVEQGa-xX1Rh8vSUnTgDBbQqZ2MhBAKEnTljRN-PNRkvI6h46AQOjC-BSb0y1rVYaLg1BBDj2Dmu2_lHQK63f4jHgBjmR2ijcYR0YtNFwkm4xAIKnyQ7UQMFTs Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:02.322936 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a825f49753c4baaa6661e82f2c30df7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a825f49753c4baaa6661e82f2c30df7"}]}] Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: f794e66e441b4e489ea613b164ed6b29 Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: {"aggregate": {"name": "tempest-test_aggregate-1553560016"}} Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:02.324063 ncdv-master-1 devstack@n-api.service[145771]: exception: Aggregate tempest-test_aggregate-1553560016 already exists. Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1553560016'}}} Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 10 20:49:02.324772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1553560016 already exists. Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:02.326343 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1553560016 already exists. Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1553560016 already exists. Sep 10 20:49:02.328383 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.329734 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bb1abe9d-de8b-4142-ab1f-1aab7c68c5d4 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1322 microversion: 2.1 time: 1.912457 Sep 10 20:49:02.329734 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 95/215] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:00 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1322 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:02.330738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2cb1411f-81f8-4256-8301-15b8c22ec32c tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1553560016 already exists. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:02.331764 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2cb1411f-81f8-4256-8301-15b8c22ec32c tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.032844 Sep 10 20:49:02.339092 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 121/216] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:49:02 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:02.343622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7b0a2896-e016-4424-ba8e-8da4dab25054 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:02.401155 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7b0a2896-e016-4424-ba8e-8da4dab25054 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.058518 Sep 10 20:49:02.401792 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 96/217] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:02 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 20:49:02.413989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7bd55785-9494-4658-abec-cd1b59c9448d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-647385388"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:02.417879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-7bd55785-9494-4658-abec-cd1b59c9448d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Generated uuid 05e86571-01e4-4ad0-8e97-6b25ed6aa0be for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:49:02.465120 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7bd55785-9494-4658-abec-cd1b59c9448d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057896 Sep 10 20:49:02.466090 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 122/218] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:49:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:02.480697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb06af4d-e30e-49fe-99ea-2f0e1b309523 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:02.482310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bb06af4d-e30e-49fe-99ea-2f0e1b309523 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'ea55e45cd1b94a41baed5bb35ce324f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64caaddd046d4282a6c5dccf553eb5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb06af4d-e30e-49fe-99ea-2f0e1b309523 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Request method failure captured: Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgDlchoXCDesf6M1Ta3upB4s8kcWUyP1OiqCvMj8ZUfcupoG9nrexQAUecolF-qmBWmI2QxlwrP4wPUrEJKwgSreXEjWmhkOcs5IFdoPjn_zqqUE-P8SqJC5OzeZTzhbX14ASL6KeeqGjKpgvBsafinlC8bnFWLLppSmBPc6EcBOsM Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:49:02.485132 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64caaddd046d4282a6c5dccf553eb5ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64caaddd046d4282a6c5dccf553eb5ea"}]}] Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ea55e45cd1b94a41baed5bb35ce324f8 Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 10 20:49:02.486359 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '15'} Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:02.487007 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.488047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb06af4d-e30e-49fe-99ea-2f0e1b309523 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:02.495173 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bb06af4d-e30e-49fe-99ea-2f0e1b309523 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.015904 Sep 10 20:49:02.496854 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 97/219] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:02 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:02.511011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c654e1ad-d164-4c84-bd85-c3af5604c133 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:02.551068 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c654e1ad-d164-4c84-bd85-c3af5604c133 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.046128 Sep 10 20:49:02.552043 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 123/220] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:02 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:49:02.563135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-982a29a0-e5a9-4911-84a6-4e121036c84f tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:02.592852 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-982a29a0-e5a9-4911-84a6-4e121036c84f tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-982a29a0-e5a9-4911-84a6-4e121036c84f tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Request method failure captured: Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgGobIF0tCBOjGU76gpoCzN_c0hgGBmh3PTc8qCAH6X0d6SNrJY9nVEQGa-xX1Rh8vSUnTgDBbQqZ2MhBAKEnTljRN-PNRkvI6h46AQOjC-BSb0y1rVYaLg1BBDj2Dmu2_lHQK63f4jHgBjmR2ijcYR0YtNFwkm4xAIKnyQ7UQMFTs Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:49:02.594840 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a825f49753c4baaa6661e82f2c30df7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a825f49753c4baaa6661e82f2c30df7"}]}] Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f794e66e441b4e489ea613b164ed6b29 Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: exception: Aggregate -1 could not be found. Sep 10 20:49:02.596256 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '-1'} Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 20:49:02.597145 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.598274 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.599379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.599379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.599379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:02.599379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:02.599379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 10 20:49:02.599379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.599379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-982a29a0-e5a9-4911-84a6-4e121036c84f tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:02.599379 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-982a29a0-e5a9-4911-84a6-4e121036c84f tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.037439 Sep 10 20:49:02.603965 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 98/221] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:02 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:02.614834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6bde7afb-f37c-4d63-a013-86b9f696a28c tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2079614956"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:02.619599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-6bde7afb-f37c-4d63-a013-86b9f696a28c tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Generated uuid 8f525be9-bb2d-4468-a43e-7de27f261f78 for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:49:02.724414 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6bde7afb-f37c-4d63-a013-86b9f696a28c tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.114423 Sep 10 20:49:02.725238 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 124/222] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:49:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:02.737791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34e32365-5ad2-4b51-857a-c49949953776 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:02.739356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-34e32365-5ad2-4b51-857a-c49949953776 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'ea55e45cd1b94a41baed5bb35ce324f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64caaddd046d4282a6c5dccf553eb5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34e32365-5ad2-4b51-857a-c49949953776 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Request method failure captured: Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgDlchoXCDesf6M1Ta3upB4s8kcWUyP1OiqCvMj8ZUfcupoG9nrexQAUecolF-qmBWmI2QxlwrP4wPUrEJKwgSreXEjWmhkOcs5IFdoPjn_zqqUE-P8SqJC5OzeZTzhbX14ASL6KeeqGjKpgvBsafinlC8bnFWLLppSmBPc6EcBOsM Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:49:02.740971 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64caaddd046d4282a6c5dccf553eb5ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64caaddd046d4282a6c5dccf553eb5ea"}]}] Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ea55e45cd1b94a41baed5bb35ce324f8 Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 10 20:49:02.743484 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '16'} Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:02.744282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.745524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34e32365-5ad2-4b51-857a-c49949953776 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:02.750655 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-34e32365-5ad2-4b51-857a-c49949953776 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.013360 Sep 10 20:49:02.751336 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 99/223] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:49:02 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:02.772077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4ce5b19b-806a-4d19-b391-443c76f297c5 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:02.825481 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4ce5b19b-806a-4d19-b391-443c76f297c5 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.060354 Sep 10 20:49:02.827549 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 125/224] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:02 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:49:02.837683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-adcdda22-781c-492d-9e3a-e225d7542031 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:02.847905 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-adcdda22-781c-492d-9e3a-e225d7542031 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-adcdda22-781c-492d-9e3a-e225d7542031 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Request method failure captured: Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgGobIF0tCBOjGU76gpoCzN_c0hgGBmh3PTc8qCAH6X0d6SNrJY9nVEQGa-xX1Rh8vSUnTgDBbQqZ2MhBAKEnTljRN-PNRkvI6h46AQOjC-BSb0y1rVYaLg1BBDj2Dmu2_lHQK63f4jHgBjmR2ijcYR0YtNFwkm4xAIKnyQ7UQMFTs Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:49:02.851652 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a825f49753c4baaa6661e82f2c30df7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a825f49753c4baaa6661e82f2c30df7"}]}] Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f794e66e441b4e489ea613b164ed6b29 Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: exception: Aggregate -1 could not be found. Sep 10 20:49:02.853041 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '-1'} Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.854400 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 10 20:49:02.855451 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.861052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-adcdda22-781c-492d-9e3a-e225d7542031 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:02.862201 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-adcdda22-781c-492d-9e3a-e225d7542031 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029705 Sep 10 20:49:02.863355 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 100/225] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:49:02 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:02.879910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c314bf87-9a24-49bf-a996-2bac29e78d0a tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:02.886197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c314bf87-9a24-49bf-a996-2bac29e78d0a tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'ea55e45cd1b94a41baed5bb35ce324f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64caaddd046d4282a6c5dccf553eb5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c314bf87-9a24-49bf-a996-2bac29e78d0a tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Request method failure captured: Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgDlchoXCDesf6M1Ta3upB4s8kcWUyP1OiqCvMj8ZUfcupoG9nrexQAUecolF-qmBWmI2QxlwrP4wPUrEJKwgSreXEjWmhkOcs5IFdoPjn_zqqUE-P8SqJC5OzeZTzhbX14ASL6KeeqGjKpgvBsafinlC8bnFWLLppSmBPc6EcBOsM Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:02.889908 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64caaddd046d4282a6c5dccf553eb5ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64caaddd046d4282a6c5dccf553eb5ea"}]}] Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ea55e45cd1b94a41baed5bb35ce324f8 Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 10 20:49:02.892099 ncdv-master-1 devstack@n-api.service[145771]: action_args: {} Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:02.892887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 10 20:49:02.894075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:02.896624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c314bf87-9a24-49bf-a996-2bac29e78d0a tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:02.899669 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c314bf87-9a24-49bf-a996-2bac29e78d0a tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.028970 Sep 10 20:49:02.900787 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 126/226] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:49:02 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:02.914189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b0d82e7e-ee95-49af-8c6b-f2f054fc48da tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2005552069"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:02.921431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.aggregate [None req-b0d82e7e-ee95-49af-8c6b-f2f054fc48da tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Generated uuid d9bf090a-4f99-46b4-9c7b-dc2fbf7b5cbf for aggregate {{(pid=145772) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:49:02.979449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:02.980075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:03.002604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:03.003130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:03.003810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:03.004319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:03.007545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:03.008397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:03.018349 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b0d82e7e-ee95-49af-8c6b-f2f054fc48da tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.110889 Sep 10 20:49:03.029327 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 101/227] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:49:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:03.046304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1d9115cf-6b9f-4be7-be4b-1f885518dcee tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:03.077506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d9115cf-6b9f-4be7-be4b-1f885518dcee tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:03.078214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d9115cf-6b9f-4be7-be4b-1f885518dcee tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:03.079125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d9115cf-6b9f-4be7-be4b-1f885518dcee tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:03.229869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:03.245055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:03.247388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:03.250796 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b0c09356-c1cc-4fdc-a5ac-2404806a0dd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1320 microversion: 2.25 time: 0.288880 Sep 10 20:49:03.262088 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 127/228] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:02 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:03.303860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d4699a0f-4b4c-4976-b461-34f451b38007 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:03.305786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4699a0f-4b4c-4976-b461-34f451b38007 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:03.310608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=8,nova_api:DELETE=12 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:03.317924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4699a0f-4b4c-4976-b461-34f451b38007 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:03.318617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4699a0f-4b4c-4976-b461-34f451b38007 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:03.319139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4699a0f-4b4c-4976-b461-34f451b38007 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:03.320255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4699a0f-4b4c-4976-b461-34f451b38007 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:03.320729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4699a0f-4b4c-4976-b461-34f451b38007 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:03.321225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4699a0f-4b4c-4976-b461-34f451b38007 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:03.344224 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1d9115cf-6b9f-4be7-be4b-1f885518dcee tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.312949 Sep 10 20:49:03.346634 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 102/229] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Sep 10 20:49:03 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:03.358045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1d7be09-7272-4c41-b00a-3818114d1b27 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:03.360062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e1d7be09-7272-4c41-b00a-3818114d1b27 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:03.370185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d7be09-7272-4c41-b00a-3818114d1b27 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:03.371057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d7be09-7272-4c41-b00a-3818114d1b27 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:03.372249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d7be09-7272-4c41-b00a-3818114d1b27 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:03.373273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d7be09-7272-4c41-b00a-3818114d1b27 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:03.374111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d7be09-7272-4c41-b00a-3818114d1b27 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:03.375004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d7be09-7272-4c41-b00a-3818114d1b27 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:03.530572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d4699a0f-4b4c-4976-b461-34f451b38007 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:03.540112 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d4699a0f-4b4c-4976-b461-34f451b38007 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1277 microversion: 2.1 time: 0.241166 Sep 10 20:49:03.541048 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 128/230] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:03 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:49:03.546639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e2c787fe-9a4b-4dfd-bc6b-0829a0740013 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:03.550668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e2c787fe-9a4b-4dfd-bc6b-0829a0740013 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'ea55e45cd1b94a41baed5bb35ce324f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64caaddd046d4282a6c5dccf553eb5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e2c787fe-9a4b-4dfd-bc6b-0829a0740013 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Request method failure captured: Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 42 Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgDlchoXCDesf6M1Ta3upB4s8kcWUyP1OiqCvMj8ZUfcupoG9nrexQAUecolF-qmBWmI2QxlwrP4wPUrEJKwgSreXEjWmhkOcs5IFdoPjn_zqqUE-P8SqJC5OzeZTzhbX14ASL6KeeqGjKpgvBsafinlC8bnFWLLppSmBPc6EcBOsM Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:03.552522 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64caaddd046d4282a6c5dccf553eb5ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64caaddd046d4282a6c5dccf553eb5ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64caaddd046d4282a6c5dccf553eb5ea"}]}] Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 64caaddd046d4282a6c5dccf553eb5ea Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458 Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ea55e45cd1b94a41baed5bb35ce324f8 Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1253061458-project Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: {"remove_host": {"host": "nch2-master-1"}} Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:03.553748 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch2-master-1'}}} Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:03.555277 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 10 20:49:03.556295 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.559342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e2c787fe-9a4b-4dfd-bc6b-0829a0740013 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:03.560430 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e2c787fe-9a4b-4dfd-bc6b-0829a0740013 tempest-AggregatesAdminNegativeTestJSON-1253061458 tempest-AggregatesAdminNegativeTestJSON-1253061458-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.018234 Sep 10 20:49:03.561193 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 129/231] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Sep 10 20:49:03 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:03.571222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bdcb4046-e1bd-4c2b-9a8b-154c33fa566d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:03.589317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdcb4046-e1bd-4c2b-9a8b-154c33fa566d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:03.589960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdcb4046-e1bd-4c2b-9a8b-154c33fa566d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:03.590548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdcb4046-e1bd-4c2b-9a8b-154c33fa566d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:03.747626 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bdcb4046-e1bd-4c2b-9a8b-154c33fa566d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.181021 Sep 10 20:49:03.748493 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 130/232] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Sep 10 20:49:03 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:49:03.764329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5c5f20e2-cb8a-42fa-ad6b-1407cfdfc9da tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:03.807194 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5c5f20e2-cb8a-42fa-ad6b-1407cfdfc9da tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.048223 Sep 10 20:49:03.813405 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 131/233] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:03 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:49:03.823151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-333df6d9-83e6-4f6b-ac91-dfd8375a9703 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-618593374"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:03.829909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-333df6d9-83e6-4f6b-ac91-dfd8375a9703 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Generated uuid ca91ae40-72db-4a84-bd2e-804aa5ac644f for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 20:49:03.872161 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-333df6d9-83e6-4f6b-ac91-dfd8375a9703 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053927 Sep 10 20:49:03.882760 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 132/234] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 20:49:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:03.888343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:03.904768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:03.905161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:03.905723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:03.916908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:03.917465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:03.918485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:03.935750 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.compute.aggregates [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 10 20:49:03.937169 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Request method failure captured: Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 42 Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgGobIF0tCBOjGU76gpoCzN_c0hgGBmh3PTc8qCAH6X0d6SNrJY9nVEQGa-xX1Rh8vSUnTgDBbQqZ2MhBAKEnTljRN-PNRkvI6h46AQOjC-BSb0y1rVYaLg1BBDj2Dmu2_lHQK63f4jHgBjmR2ijcYR0YtNFwkm4xAIKnyQ7UQMFTs Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:03.940129 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3a825f49753c4baaa6661e82f2c30df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3a825f49753c4baaa6661e82f2c30df7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3a825f49753c4baaa6661e82f2c30df7"}]}] Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 3a825f49753c4baaa6661e82f2c30df7 Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-366863151 Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: f794e66e441b4e489ea613b164ed6b29 Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: {"remove_host": {"host": "nonexist_host"}} Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:03.941356 ncdv-master-1 devstack@n-api.service[145771]: exception: Cannot remove host nonexist_host in aggregate 18 Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 10 20:49:03.942166 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 10 20:49:03.943402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.944947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:03.946641 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:03.946641 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:03.946641 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:03.946641 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:03.946641 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Sep 10 20:49:03.946641 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:03.946641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:03.948518 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-07b9f31e-c396-4753-b9a3-f774a8373202 tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.064631 Sep 10 20:49:03.949531 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 133/235] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Sep 10 20:49:03 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:03.966729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ec5e02f5-49a8-4f17-a7a9-f31fd861e10d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:04.025578 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ec5e02f5-49a8-4f17-a7a9-f31fd861e10d tempest-AggregatesAdminNegativeTestJSON-366863151 tempest-AggregatesAdminNegativeTestJSON-366863151-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.069824 Sep 10 20:49:04.027115 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 134/236] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:49:03 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 20:49:04.278741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:04.281502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:04.305064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:04.305585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:04.306121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:04.306862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:04.307344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:04.307754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:04.561460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:04.568013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:04.569568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:04.576582 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-65a252d4-80b4-46d7-ba26-8bc7807b41c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1320 microversion: 2.25 time: 0.301708 Sep 10 20:49:04.581020 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 135/237] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:04 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1320 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:04.587731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7326048b-1761-44b8-95ab-cc328c5c5ecc tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:04.588601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7326048b-1761-44b8-95ab-cc328c5c5ecc tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:04.595714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7326048b-1761-44b8-95ab-cc328c5c5ecc tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:04.596444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7326048b-1761-44b8-95ab-cc328c5c5ecc tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:04.597040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7326048b-1761-44b8-95ab-cc328c5c5ecc tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:04.598099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7326048b-1761-44b8-95ab-cc328c5c5ecc tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:04.598810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7326048b-1761-44b8-95ab-cc328c5c5ecc tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:04.599392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7326048b-1761-44b8-95ab-cc328c5c5ecc tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:04.716459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7326048b-1761-44b8-95ab-cc328c5c5ecc tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:04.725283 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7326048b-1761-44b8-95ab-cc328c5c5ecc tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1277 microversion: 2.1 time: 0.142978 Sep 10 20:49:04.730562 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 136/238] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:04 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:04.938420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1d7be09-7272-4c41-b00a-3818114d1b27 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:04.955390 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1d7be09-7272-4c41-b00a-3818114d1b27 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1322 microversion: 2.1 time: 1.606476 Sep 10 20:49:04.956682 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 103/239] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:03 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1322 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:05.176250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a6138df-c71f-470e-a212-66d5a28184ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:05.177112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4a6138df-c71f-470e-a212-66d5a28184ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:05.189944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a6138df-c71f-470e-a212-66d5a28184ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:05.192665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a6138df-c71f-470e-a212-66d5a28184ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:05.193327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a6138df-c71f-470e-a212-66d5a28184ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:05.195415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a6138df-c71f-470e-a212-66d5a28184ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:05.202617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a6138df-c71f-470e-a212-66d5a28184ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:05.203405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a6138df-c71f-470e-a212-66d5a28184ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:05.462365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a79d6cd7-bd47-4139-a8ad-3db16c92145c req-906ec19c-f3f3-49f7-86a1-662562bc8e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023ec8d2-8599-46cf-9dd4-3242411b0762", "tag": "76e5ab12-5706-4c92-bcb5-368b6a237537"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:05.502261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a79d6cd7-bd47-4139-a8ad-3db16c92145c req-906ec19c-f3f3-49f7-86a1-662562bc8e59 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:05.502826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a79d6cd7-bd47-4139-a8ad-3db16c92145c req-906ec19c-f3f3-49f7-86a1-662562bc8e59 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:05.505846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a79d6cd7-bd47-4139-a8ad-3db16c92145c req-906ec19c-f3f3-49f7-86a1-662562bc8e59 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:05.531094 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a79d6cd7-bd47-4139-a8ad-3db16c92145c req-906ec19c-f3f3-49f7-86a1-662562bc8e59 service nova] Creating event network-changed:76e5ab12-5706-4c92-bcb5-368b6a237537 for instance 023ec8d2-8599-46cf-9dd4-3242411b0762 on nch2-master-1 Sep 10 20:49:05.548877 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a79d6cd7-bd47-4139-a8ad-3db16c92145c req-906ec19c-f3f3-49f7-86a1-662562bc8e59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091132 Sep 10 20:49:05.551528 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 104/240] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:49:05.608849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:05.609958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:05.623740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:05.624528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:05.625327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:05.627757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:05.628408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:05.632428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:05.926816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4a6138df-c71f-470e-a212-66d5a28184ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:05.942773 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a6138df-c71f-470e-a212-66d5a28184ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 200 len: 1589 microversion: 2.1 time: 0.770058 Sep 10 20:49:05.943650 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 137/241] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:05 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 1589 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:05.956584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62d31d2b-9b6a-4b20-92ce-04331cd2d426 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:05.957847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62d31d2b-9b6a-4b20-92ce-04331cd2d426 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:05.969901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:05.978613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62d31d2b-9b6a-4b20-92ce-04331cd2d426 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:05.980496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62d31d2b-9b6a-4b20-92ce-04331cd2d426 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:05.981105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62d31d2b-9b6a-4b20-92ce-04331cd2d426 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:05.982627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62d31d2b-9b6a-4b20-92ce-04331cd2d426 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:05.985263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:05.985841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62d31d2b-9b6a-4b20-92ce-04331cd2d426 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:05.986699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62d31d2b-9b6a-4b20-92ce-04331cd2d426 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:05.988297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:05.989446 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09affac5-7b15-46c2-a1ef-3c094764497c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.386403 Sep 10 20:49:06.012523 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 105/242] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:05 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:49:06.019823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-081ae092-1b07-4d57-98a6-0732030af4ac tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:06.020447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-081ae092-1b07-4d57-98a6-0732030af4ac tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:06.036013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-081ae092-1b07-4d57-98a6-0732030af4ac tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:06.036517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-081ae092-1b07-4d57-98a6-0732030af4ac tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:06.036959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-081ae092-1b07-4d57-98a6-0732030af4ac tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:06.037677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-081ae092-1b07-4d57-98a6-0732030af4ac tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:06.038221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-081ae092-1b07-4d57-98a6-0732030af4ac tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:06.039170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-081ae092-1b07-4d57-98a6-0732030af4ac tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:06.740643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-081ae092-1b07-4d57-98a6-0732030af4ac tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:06.765215 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-081ae092-1b07-4d57-98a6-0732030af4ac tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1322 microversion: 2.1 time: 0.750799 Sep 10 20:49:06.767420 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 106/243] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:06 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1322 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:06.775415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ba309e74-9a95-499e-94b6-9e96593766b4 req-78c95634-5e1f-4487-95b2-628fe48da367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6c810a-a866-4b29-b720-c315990efec6", "name": "network-vif-plugged", "status": "completed", "tag": "4dbad661-7d36-4057-8164-bff97ab5b452"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:06.810823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ba309e74-9a95-499e-94b6-9e96593766b4 req-78c95634-5e1f-4487-95b2-628fe48da367 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:06.811525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ba309e74-9a95-499e-94b6-9e96593766b4 req-78c95634-5e1f-4487-95b2-628fe48da367 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:06.812161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ba309e74-9a95-499e-94b6-9e96593766b4 req-78c95634-5e1f-4487-95b2-628fe48da367 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:06.843603 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ba309e74-9a95-499e-94b6-9e96593766b4 req-78c95634-5e1f-4487-95b2-628fe48da367 service nova] Creating event network-vif-plugged:4dbad661-7d36-4057-8164-bff97ab5b452 for instance 6e6c810a-a866-4b29-b720-c315990efec6 on nch1-master-1 Sep 10 20:49:06.852395 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ba309e74-9a95-499e-94b6-9e96593766b4 req-78c95634-5e1f-4487-95b2-628fe48da367 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083434 Sep 10 20:49:06.854499 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 107/244] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:06.950962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-62d31d2b-9b6a-4b20-92ce-04331cd2d426 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:06.969380 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62d31d2b-9b6a-4b20-92ce-04331cd2d426 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1319 microversion: 2.1 time: 1.019934 Sep 10 20:49:06.994808 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 138/245] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:05 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1319 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:07.018540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:07.020044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:07.031482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:07.033349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:07.034815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:07.037017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:07.040989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:07.041726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:07.727760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:07.730385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:07.739303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:07.741951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:07.744519 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a75f746f-30d4-49ea-8f4b-deb2974483f9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.730960 Sep 10 20:49:07.745441 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 108/246] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:07 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:49:07.788997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9ae09427-42be-4228-9b0f-38d6c5773207 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:07.790009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9ae09427-42be-4228-9b0f-38d6c5773207 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:07.797921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ae09427-42be-4228-9b0f-38d6c5773207 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:07.798475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ae09427-42be-4228-9b0f-38d6c5773207 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:07.798961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ae09427-42be-4228-9b0f-38d6c5773207 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:07.799754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ae09427-42be-4228-9b0f-38d6c5773207 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:07.800218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ae09427-42be-4228-9b0f-38d6c5773207 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:07.810939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ae09427-42be-4228-9b0f-38d6c5773207 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:08.004515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-30c86653-26a2-4616-a667-07209c97a762 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:08.005117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-30c86653-26a2-4616-a667-07209c97a762 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:08.014345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30c86653-26a2-4616-a667-07209c97a762 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:08.014839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30c86653-26a2-4616-a667-07209c97a762 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:08.015357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30c86653-26a2-4616-a667-07209c97a762 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:08.019141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30c86653-26a2-4616-a667-07209c97a762 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:08.019721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30c86653-26a2-4616-a667-07209c97a762 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:08.020068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30c86653-26a2-4616-a667-07209c97a762 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:08.408759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-30c86653-26a2-4616-a667-07209c97a762 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:08.422994 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-30c86653-26a2-4616-a667-07209c97a762 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1319 microversion: 2.1 time: 0.420361 Sep 10 20:49:08.425134 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 109/247] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:07 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:08.701156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-808023bc-ff22-4b3c-87d7-aed1671f3e20 req-90f35384-12b2-45f0-88aa-b3b6b9e28fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e5c032-830c-485e-95db-6ce8a67b1872", "tag": "77555f73-bd32-4402-a6df-d676567f9a43"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:08.737558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-808023bc-ff22-4b3c-87d7-aed1671f3e20 req-90f35384-12b2-45f0-88aa-b3b6b9e28fab service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:08.746408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-808023bc-ff22-4b3c-87d7-aed1671f3e20 req-90f35384-12b2-45f0-88aa-b3b6b9e28fab service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:08.747531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-808023bc-ff22-4b3c-87d7-aed1671f3e20 req-90f35384-12b2-45f0-88aa-b3b6b9e28fab service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:08.758999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9ae09427-42be-4228-9b0f-38d6c5773207 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:08.773621 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9ae09427-42be-4228-9b0f-38d6c5773207 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1322 microversion: 2.1 time: 0.986331 Sep 10 20:49:08.779293 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-808023bc-ff22-4b3c-87d7-aed1671f3e20 req-90f35384-12b2-45f0-88aa-b3b6b9e28fab service nova] Creating event network-changed:77555f73-bd32-4402-a6df-d676567f9a43 for instance 71e5c032-830c-485e-95db-6ce8a67b1872 on nch2-master-1 Sep 10 20:49:08.785028 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-808023bc-ff22-4b3c-87d7-aed1671f3e20 req-90f35384-12b2-45f0-88aa-b3b6b9e28fab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091395 Sep 10 20:49:08.786215 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 110/249] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:49:08.786392 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 139/249] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:07 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1322 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:08.797553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:08.798235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:08.818172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:08.818672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:08.823760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:08.824623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:08.825953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:08.826408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:09.185308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:09.218120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:09.222659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:09.224127 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8bfd0e9a-6543-443f-b19b-9729ec0140bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.436489 Sep 10 20:49:09.236425 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 140/250] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:08 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:09.411228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:09.417275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3cbdfef9-537c-427b-ab2b-d56820837b34 req-4c0663e8-5063-47c5-b1b0-94eef2aae9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43267b6f-f7b1-4d07-b8a7-74dfc0230123", "tag": "12bf93d1-569d-4e5b-8031-79e10f749c7a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:09.450639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f7aba26-aaa3-4fa5-9421-cc01e67121f0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:09.451897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f7aba26-aaa3-4fa5-9421-cc01e67121f0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:09.455990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3cbdfef9-537c-427b-ab2b-d56820837b34 req-4c0663e8-5063-47c5-b1b0-94eef2aae9c0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:09.457268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3cbdfef9-537c-427b-ab2b-d56820837b34 req-4c0663e8-5063-47c5-b1b0-94eef2aae9c0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:09.462150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3cbdfef9-537c-427b-ab2b-d56820837b34 req-4c0663e8-5063-47c5-b1b0-94eef2aae9c0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:09.465161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f7aba26-aaa3-4fa5-9421-cc01e67121f0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:09.467781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f7aba26-aaa3-4fa5-9421-cc01e67121f0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:09.468489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f7aba26-aaa3-4fa5-9421-cc01e67121f0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:09.469453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f7aba26-aaa3-4fa5-9421-cc01e67121f0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:09.474228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f7aba26-aaa3-4fa5-9421-cc01e67121f0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:09.482427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f7aba26-aaa3-4fa5-9421-cc01e67121f0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:09.516274 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3cbdfef9-537c-427b-ab2b-d56820837b34 req-4c0663e8-5063-47c5-b1b0-94eef2aae9c0 service nova] Creating event network-changed:12bf93d1-569d-4e5b-8031-79e10f749c7a for instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 on nch2-master-1 Sep 10 20:49:09.530965 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3cbdfef9-537c-427b-ab2b-d56820837b34 req-4c0663e8-5063-47c5-b1b0-94eef2aae9c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120493 Sep 10 20:49:09.531579 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 111/251] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:09.800213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5a28f38-f3c8-43a6-95fb-0403b111dddd tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:09.801204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5a28f38-f3c8-43a6-95fb-0403b111dddd tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:09.810540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5a28f38-f3c8-43a6-95fb-0403b111dddd tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:09.814839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5a28f38-f3c8-43a6-95fb-0403b111dddd tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:09.815532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5a28f38-f3c8-43a6-95fb-0403b111dddd tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:09.817309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5a28f38-f3c8-43a6-95fb-0403b111dddd tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:09.819181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5a28f38-f3c8-43a6-95fb-0403b111dddd tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:09.821707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5a28f38-f3c8-43a6-95fb-0403b111dddd tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:09.895189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f7aba26-aaa3-4fa5-9421-cc01e67121f0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:09.900390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:09.908101 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f7aba26-aaa3-4fa5-9421-cc01e67121f0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1319 microversion: 2.1 time: 0.462016 Sep 10 20:49:09.915405 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 141/252] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:09 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:10.376951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:10.651498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5a28f38-f3c8-43a6-95fb-0403b111dddd tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:10.661618 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5a28f38-f3c8-43a6-95fb-0403b111dddd tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1472 microversion: 2.1 time: 0.865684 Sep 10 20:49:10.667010 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 112/253] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:09 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1472 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:49:10.673781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:10.674849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:10.686308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:10.687035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:10.687717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:10.688739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:10.689377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:10.690137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:10.728714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c374d1e-8fc6-48d7-81db-37931dc4f570 tempest-AZAdminNegativeTestJSON-1040744245 tempest-AZAdminNegativeTestJSON-1040744245-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:10.731632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4c374d1e-8fc6-48d7-81db-37931dc4f570 tempest-AZAdminNegativeTestJSON-1040744245 tempest-AZAdminNegativeTestJSON-1040744245-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'e754ce3854f2458b98dc0438028ebc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '247a7ee43ba84bcc9152a6bce650b52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c374d1e-8fc6-48d7-81db-37931dc4f570 tempest-AZAdminNegativeTestJSON-1040744245 tempest-AZAdminNegativeTestJSON-1040744245-project] Request method failure captured: Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhEu-wDew3xOcV8QS-qxiPDfLzBWQ15rYGuDkd1xgQE0zROLPwn4UgXhk2ekd6LWOZqS794Z60WkoxuSfDYmFg850iuIhdz5gVcwScicZbNR8SDIoXdWcU_WR3whOnv6aqUIpDpIbU2ikXPvNA1RjV-F7sPp9aAV8ClqvtQuzi-6_g Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 247a7ee43ba84bcc9152a6bce650b52e Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1040744245 Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:10.735439 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/247a7ee43ba84bcc9152a6bce650b52e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/247a7ee43ba84bcc9152a6bce650b52e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_247a7ee43ba84bcc9152a6bce650b52e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/247a7ee43ba84bcc9152a6bce650b52e"}]}] Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AZAdminNegativeTestJSON-1040744245 Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 247a7ee43ba84bcc9152a6bce650b52e Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1040744245 Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AZAdminNegativeTestJSON-1040744245-project Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e754ce3854f2458b98dc0438028ebc54 Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AZAdminNegativeTestJSON-1040744245-project Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 10 20:49:10.736682 ncdv-master-1 devstack@n-api.service[145771]: action_args: {} Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:10.737379 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 10 20:49:10.738402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:10.744881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c374d1e-8fc6-48d7-81db-37931dc4f570 tempest-AZAdminNegativeTestJSON-1040744245 tempest-AZAdminNegativeTestJSON-1040744245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:10.746093 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c374d1e-8fc6-48d7-81db-37931dc4f570 tempest-AZAdminNegativeTestJSON-1040744245 tempest-AZAdminNegativeTestJSON-1040744245-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.538900 Sep 10 20:49:10.746851 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 142/254] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Sep 10 20:49:10 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 540 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:10.756511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:10.758095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:10.767699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:10.769085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:10.770799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:10.776150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:10.782694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:10.783342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:10.818149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:10.853104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Request method failure captured: Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6/diagnostics HTTP/1.1 Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgs_CarbCMukm5YfSK3w5N3J3mJo-VkaH1V-RdxFxuhxVAt142TtuBglW_KneXP0XkwIpjxVUhZ-NqrfwLoOryQiomUEIwG3lnZLs4RI6f0lIemgXCflhVZmH05KyTigQwpiZopax5SZuO9moiPLOoe09t0rqcB7rqqEoue6ypZCo4 Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d9204ddaf90a4685a4286c8ebfd76433 Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1194648581 Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:10.859990 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d9204ddaf90a4685a4286c8ebfd76433"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d9204ddaf90a4685a4286c8ebfd76433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d9204ddaf90a4685a4286c8ebfd76433", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d9204ddaf90a4685a4286c8ebfd76433"}]}] Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1194648581 Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d9204ddaf90a4685a4286c8ebfd76433 Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1194648581 Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerDiagnosticsNegativeTest-1194648581-project Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ffba8e54e6f14960b7f57c5e19d3cfae Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1194648581-project Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:10.861175 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'server_id': '6e6c810a-a866-4b29-b720-c315990efec6'} Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:10.861865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 10 20:49:10.862964 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:10.866475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:10.867765 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-41ef52fe-c707-4102-8757-6b3e9477bbd8 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.118543 Sep 10 20:49:10.873459 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 143/255] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:49:10 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6/diagnostics => generated 117 bytes in 125 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:10.879999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-57f384d2-61b6-4235-b84b-b34e0504d595 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:10.880829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-57f384d2-61b6-4235-b84b-b34e0504d595 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:10.888832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57f384d2-61b6-4235-b84b-b34e0504d595 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:10.889754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57f384d2-61b6-4235-b84b-b34e0504d595 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:10.890561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57f384d2-61b6-4235-b84b-b34e0504d595 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:10.891614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57f384d2-61b6-4235-b84b-b34e0504d595 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:10.892298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57f384d2-61b6-4235-b84b-b34e0504d595 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:10.893051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57f384d2-61b6-4235-b84b-b34e0504d595 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:10.938408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-57f384d2-61b6-4235-b84b-b34e0504d595 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:49:11.060002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:11.075042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:11.078650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:11.081028 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c4b2645-90f2-4806-9ffe-cc836071288f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.412800 Sep 10 20:49:11.086242 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 113/256] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:10 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:11.098360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7036714-e3a6-4c8a-8760-9fa9899f47d0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:11.104158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f7036714-e3a6-4c8a-8760-9fa9899f47d0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:11.120558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:11.144215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7036714-e3a6-4c8a-8760-9fa9899f47d0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:11.144721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7036714-e3a6-4c8a-8760-9fa9899f47d0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:11.145159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7036714-e3a6-4c8a-8760-9fa9899f47d0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:11.148147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7036714-e3a6-4c8a-8760-9fa9899f47d0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:11.148736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7036714-e3a6-4c8a-8760-9fa9899f47d0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:11.149170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7036714-e3a6-4c8a-8760-9fa9899f47d0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:11.200696 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-57f384d2-61b6-4235-b84b-b34e0504d595 tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 204 len: 0 microversion: 2.1 time: 0.324527 Sep 10 20:49:11.204486 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 144/257] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:49:10 2022] DELETE /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 20:49:11.517183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca7460d2-5bec-48e8-8e5a-f4e1c36afb5c tempest-FlavorsV261TestJSON-104572128 tempest-FlavorsV261TestJSON-104572128-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1509967604", "id": 880579722, "os-flavor-access:is_public": "True"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:11.556146 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ca7460d2-5bec-48e8-8e5a-f4e1c36afb5c tempest-FlavorsV261TestJSON-104572128 tempest-FlavorsV261TestJSON-104572128-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.350013 Sep 10 20:49:11.582273 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 145/258] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:49:11 2022] POST /compute/v2.1/flavors => generated 465 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:49:11.588989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1459ade9-a86e-4f68-aae2-6d072bc0211d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:11.590101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1459ade9-a86e-4f68-aae2-6d072bc0211d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:11.599580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1459ade9-a86e-4f68-aae2-6d072bc0211d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:11.603835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7036714-e3a6-4c8a-8760-9fa9899f47d0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:11.618363 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f7036714-e3a6-4c8a-8760-9fa9899f47d0 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1319 microversion: 2.1 time: 0.529640 Sep 10 20:49:11.618922 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 114/259] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:11 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:11.635815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1459ade9-a86e-4f68-aae2-6d072bc0211d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:11.636401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1459ade9-a86e-4f68-aae2-6d072bc0211d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:11.641706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1459ade9-a86e-4f68-aae2-6d072bc0211d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:11.642254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1459ade9-a86e-4f68-aae2-6d072bc0211d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:11.642711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1459ade9-a86e-4f68-aae2-6d072bc0211d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:11.930261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85892e19-bb28-4ef4-a186-ec0422331c29 tempest-FlavorsV261TestJSON-118990320 tempest-FlavorsV261TestJSON-118990320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:11.940008 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-85892e19-bb28-4ef4-a186-ec0422331c29 tempest-FlavorsV261TestJSON-118990320 tempest-FlavorsV261TestJSON-118990320-project] 10.222.0.33 "GET /compute/v2.1/flavors/880579722" status: 200 len: 465 microversion: 2.61 time: 0.304789 Sep 10 20:49:11.940569 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 115/260] 10.222.0.33 () {60 vars in 1196 bytes} [Sat Sep 10 20:49:11 2022] GET /compute/v2.1/flavors/880579722 => generated 465 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:49:11.967810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1cf21294-837b-4c33-9c64-d8a505330ae1 tempest-FlavorsV261TestJSON-104572128 tempest-FlavorsV261TestJSON-104572128-project-admin] Action: 'update', calling method: .version_select at 0x7f9946a5a940>, body: {"flavor": {"description": "new"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:12.040773 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1cf21294-837b-4c33-9c64-d8a505330ae1 tempest-FlavorsV261TestJSON-104572128 tempest-FlavorsV261TestJSON-104572128-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/880579722" status: 200 len: 466 microversion: 2.61 time: 0.079178 Sep 10 20:49:12.045450 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 116/261] 10.222.0.33 () {62 vars in 1216 bytes} [Sat Sep 10 20:49:11 2022] PUT /compute/v2.1/flavors/880579722 => generated 466 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:49:12.056622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1459ade9-a86e-4f68-aae2-6d072bc0211d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:12.061646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39f978a2-9cba-4032-94eb-7366e3349814 tempest-FlavorsV261TestJSON-118990320 tempest-FlavorsV261TestJSON-118990320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:12.067436 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1459ade9-a86e-4f68-aae2-6d072bc0211d tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1478 microversion: 2.1 time: 0.483684 Sep 10 20:49:12.085296 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 146/262] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:11 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1478 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:12.116988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:12.117672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:12.123977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:12.124460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:12.124892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:12.125593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:12.126102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:12.126665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:12.128372 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-39f978a2-9cba-4032-94eb-7366e3349814 tempest-FlavorsV261TestJSON-118990320 tempest-FlavorsV261TestJSON-118990320-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.072709 Sep 10 20:49:12.129706 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 117/263] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Sep 10 20:49:12 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:12.155829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5e7c76d-4896-4ddf-8f5b-3a04027899ac tempest-FlavorsV261TestJSON-118990320 tempest-FlavorsV261TestJSON-118990320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:12.186773 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5e7c76d-4896-4ddf-8f5b-3a04027899ac tempest-FlavorsV261TestJSON-118990320 tempest-FlavorsV261TestJSON-118990320-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.036171 Sep 10 20:49:12.191165 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 118/264] 10.222.0.33 () {60 vars in 1166 bytes} [Sat Sep 10 20:49:12 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:12.206806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b1fe8c93-3cf9-485e-82f3-0f57d88ab8bc tempest-FlavorsV261TestJSON-104572128 tempest-FlavorsV261TestJSON-104572128-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:12.240443 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b1fe8c93-3cf9-485e-82f3-0f57d88ab8bc tempest-FlavorsV261TestJSON-104572128 tempest-FlavorsV261TestJSON-104572128-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/880579722" status: 202 len: 0 microversion: 2.61 time: 0.037806 Sep 10 20:49:12.244727 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 119/265] 10.222.0.33 () {60 vars in 1199 bytes} [Sat Sep 10 20:49:12 2022] DELETE /compute/v2.1/flavors/880579722 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:49:12.264786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-01b82113-3ab4-4062-a488-c2bcb5fb53e5 tempest-FlavorsV261TestJSON-104572128 tempest-FlavorsV261TestJSON-104572128-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:12.306451 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-01b82113-3ab4-4062-a488-c2bcb5fb53e5 tempest-FlavorsV261TestJSON-104572128 tempest-FlavorsV261TestJSON-104572128-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.052739 Sep 10 20:49:12.307108 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 120/266] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Sep 10 20:49:12 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:12.648210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c441f91-5384-44b2-910e-bbb3ced1c89e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:12.648992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c441f91-5384-44b2-910e-bbb3ced1c89e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:12.670437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c441f91-5384-44b2-910e-bbb3ced1c89e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:12.673524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c441f91-5384-44b2-910e-bbb3ced1c89e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:12.674805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c441f91-5384-44b2-910e-bbb3ced1c89e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:12.675757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c441f91-5384-44b2-910e-bbb3ced1c89e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:12.676574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c441f91-5384-44b2-910e-bbb3ced1c89e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:12.677726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c441f91-5384-44b2-910e-bbb3ced1c89e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:12.774624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:12.785856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:12.792824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:12.794557 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c52ab0eb-415c-49a6-98f8-ca447a40d4bb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.683626 Sep 10 20:49:12.818721 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 147/267] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:12 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:13.094144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f5b31dbc-97f2-4087-bd54-a362c148ba6f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:13.095864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f5b31dbc-97f2-4087-bd54-a362c148ba6f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:13.112947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5b31dbc-97f2-4087-bd54-a362c148ba6f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:13.113626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5b31dbc-97f2-4087-bd54-a362c148ba6f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:13.114168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5b31dbc-97f2-4087-bd54-a362c148ba6f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:13.114858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5b31dbc-97f2-4087-bd54-a362c148ba6f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:13.115324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5b31dbc-97f2-4087-bd54-a362c148ba6f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:13.115758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5b31dbc-97f2-4087-bd54-a362c148ba6f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:13.540131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c441f91-5384-44b2-910e-bbb3ced1c89e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:13.551118 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c441f91-5384-44b2-910e-bbb3ced1c89e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1319 microversion: 2.1 time: 0.908797 Sep 10 20:49:13.551714 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 121/268] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:12 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1319 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:13.622889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f5b31dbc-97f2-4087-bd54-a362c148ba6f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:13.632339 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f5b31dbc-97f2-4087-bd54-a362c148ba6f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1478 microversion: 2.1 time: 0.543291 Sep 10 20:49:13.654481 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 148/269] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:13 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1478 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:49:13.831228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:13.833301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:13.855280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:13.856949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:13.858284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:13.861266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:13.863341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:13.865064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:13.917899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:13.958257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1309903967", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:14.052864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:49:14.298131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:14.310644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:14.314611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:14.315828 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-28afc1b8-7c6d-4001-b92b-fce455a626fb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.494789 Sep 10 20:49:14.316419 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 149/270] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:13 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:14.575130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fba764df-5d67-43d4-ad67-46d4ad49317e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:14.576041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fba764df-5d67-43d4-ad67-46d4ad49317e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:14.582322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fba764df-5d67-43d4-ad67-46d4ad49317e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:14.583044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fba764df-5d67-43d4-ad67-46d4ad49317e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:14.583692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fba764df-5d67-43d4-ad67-46d4ad49317e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:14.584576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fba764df-5d67-43d4-ad67-46d4ad49317e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:14.585979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fba764df-5d67-43d4-ad67-46d4ad49317e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:14.586826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fba764df-5d67-43d4-ad67-46d4ad49317e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:14.781161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fba764df-5d67-43d4-ad67-46d4ad49317e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:14.793295 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fba764df-5d67-43d4-ad67-46d4ad49317e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1319 microversion: 2.1 time: 0.221768 Sep 10 20:49:14.794462 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 150/271] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:14 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:49:14.799725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6992bb63-9726-49df-bd09-265b53161d3f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:14.800410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6992bb63-9726-49df-bd09-265b53161d3f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:14.818573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6992bb63-9726-49df-bd09-265b53161d3f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:14.819938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6992bb63-9726-49df-bd09-265b53161d3f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:14.820622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6992bb63-9726-49df-bd09-265b53161d3f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:14.821723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6992bb63-9726-49df-bd09-265b53161d3f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:14.822417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6992bb63-9726-49df-bd09-265b53161d3f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:14.822996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6992bb63-9726-49df-bd09-265b53161d3f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:15.053331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6992bb63-9726-49df-bd09-265b53161d3f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:15.063005 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6992bb63-9726-49df-bd09-265b53161d3f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1478 microversion: 2.1 time: 0.267052 Sep 10 20:49:15.066613 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 151/272] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:14 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1478 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:15.239660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:49:15.240160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:49:15.240749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:49:15.241371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:49:15.241790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:49:15.262828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:15.263716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:15.264698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:15.266039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:15.266766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:15.267553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:15.345688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:15.346876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:15.354683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Getting quotas for project 5cc9f18c8fd44fca98cda3832b60b26d. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:49:15.356008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:15.360791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:15.361255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:15.362022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:15.366445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:15.367110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:15.371468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Getting quotas for user 365336e9f59e4b65ae0a05554776b0ff and project 5cc9f18c8fd44fca98cda3832b60b26d. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:49:15.393338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:49:15.395688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:49:15.533216 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f4b53f2a-7dbd-4a9a-bfeb-ec707f5f5e04 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.873554 Sep 10 20:49:15.533910 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 122/273] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:49:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:49:15.556467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ff8c1362-ce40-44e8-803a-6e5c3f257474 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:15.557331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ff8c1362-ce40-44e8-803a-6e5c3f257474 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:15.759977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ff8c1362-ce40-44e8-803a-6e5c3f257474 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:15.769474 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ff8c1362-ce40-44e8-803a-6e5c3f257474 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1220 microversion: 2.1 time: 0.227876 Sep 10 20:49:15.779546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:15.786135 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 123/274] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:15 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1220 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:15.798581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:15.806464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b45b4a29-21d4-45c1-9a51-270997d37ffe req-d309ee7e-1c30-4f8f-95a3-8e6efee69330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6c810a-a866-4b29-b720-c315990efec6", "name": "network-vif-deleted", "tag": "4dbad661-7d36-4057-8164-bff97ab5b452"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:15.834685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b45b4a29-21d4-45c1-9a51-270997d37ffe req-d309ee7e-1c30-4f8f-95a3-8e6efee69330 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:15.835948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b45b4a29-21d4-45c1-9a51-270997d37ffe req-d309ee7e-1c30-4f8f-95a3-8e6efee69330 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:15.836124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:15.836722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b45b4a29-21d4-45c1-9a51-270997d37ffe req-d309ee7e-1c30-4f8f-95a3-8e6efee69330 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:15.837279 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-214f6ba4-9176-4bfe-a8b4-e7f98054868d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.496483 Sep 10 20:49:15.853418 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 152/275] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:15 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:49:15.861458 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b45b4a29-21d4-45c1-9a51-270997d37ffe req-d309ee7e-1c30-4f8f-95a3-8e6efee69330 service nova] Creating event network-vif-deleted:4dbad661-7d36-4057-8164-bff97ab5b452 for instance 6e6c810a-a866-4b29-b720-c315990efec6 on nch1-master-1 Sep 10 20:49:15.872470 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b45b4a29-21d4-45c1-9a51-270997d37ffe req-d309ee7e-1c30-4f8f-95a3-8e6efee69330 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079788 Sep 10 20:49:15.876147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8979f29-bb0f-4757-9cbb-995f18876af5 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:15.876606 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 124/276] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:15.879613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8979f29-bb0f-4757-9cbb-995f18876af5 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:15.906321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8979f29-bb0f-4757-9cbb-995f18876af5 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:15.906950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8979f29-bb0f-4757-9cbb-995f18876af5 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:15.909010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8979f29-bb0f-4757-9cbb-995f18876af5 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:15.909868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8979f29-bb0f-4757-9cbb-995f18876af5 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:15.915581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8979f29-bb0f-4757-9cbb-995f18876af5 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:15.916145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8979f29-bb0f-4757-9cbb-995f18876af5 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:16.078079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b5455dda-1c38-42cc-aa04-792262b6aa0a req-56ad0701-cd1b-4d82-b638-284274def8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43267b6f-f7b1-4d07-b8a7-74dfc0230123", "name": "network-vif-plugged", "status": "completed", "tag": "12bf93d1-569d-4e5b-8031-79e10f749c7a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:16.096155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b5455dda-1c38-42cc-aa04-792262b6aa0a req-56ad0701-cd1b-4d82-b638-284274def8d8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:16.097293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b5455dda-1c38-42cc-aa04-792262b6aa0a req-56ad0701-cd1b-4d82-b638-284274def8d8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:16.104114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b5455dda-1c38-42cc-aa04-792262b6aa0a req-56ad0701-cd1b-4d82-b638-284274def8d8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:16.121581 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b5455dda-1c38-42cc-aa04-792262b6aa0a req-56ad0701-cd1b-4d82-b638-284274def8d8 service nova] Creating event network-vif-plugged:12bf93d1-569d-4e5b-8031-79e10f749c7a for instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 on nch2-master-1 Sep 10 20:49:16.141498 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b5455dda-1c38-42cc-aa04-792262b6aa0a req-56ad0701-cd1b-4d82-b638-284274def8d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062027 Sep 10 20:49:16.142301 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 125/277] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:49:16.156095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:16.157104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:16.232565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:16.233070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:16.234376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:16.238355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:16.241856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:16.243813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:16.434108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:16.434998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:16.435707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:16.436421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lazy-loading 'fault' on Instance uuid 6e6c810a-a866-4b29-b720-c315990efec6 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:16.654455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba8e54e6f14960b7f57c5e19d3cfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9204ddaf90a4685a4286c8ebfd76433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:16.667193 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-36ed3f5b-1d64-4a36-a815-e83603963cfe tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 200 len: 1312 microversion: 2.1 time: 0.523386 Sep 10 20:49:16.670359 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 126/278] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:16 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 1312 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:16.800263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d550a83-a4bf-4cd9-b631-cbb3b9171428 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:16.801230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d550a83-a4bf-4cd9-b631-cbb3b9171428 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:16.814837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d550a83-a4bf-4cd9-b631-cbb3b9171428 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:16.816028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d550a83-a4bf-4cd9-b631-cbb3b9171428 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:16.816814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d550a83-a4bf-4cd9-b631-cbb3b9171428 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:16.818638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d550a83-a4bf-4cd9-b631-cbb3b9171428 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:16.819371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d550a83-a4bf-4cd9-b631-cbb3b9171428 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:16.820409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d550a83-a4bf-4cd9-b631-cbb3b9171428 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:16.902318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d550a83-a4bf-4cd9-b631-cbb3b9171428 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:16.912135 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d550a83-a4bf-4cd9-b631-cbb3b9171428 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1216 microversion: 2.1 time: 0.117032 Sep 10 20:49:16.914148 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 127/279] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:16 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:49:16.921313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:16.922534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:16.931161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:16.934324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:16.935584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:16.936655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:16.939377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:16.940053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:17.045258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8979f29-bb0f-4757-9cbb-995f18876af5 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:17.056657 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8979f29-bb0f-4757-9cbb-995f18876af5 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1319 microversion: 2.1 time: 1.201208 Sep 10 20:49:17.059206 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 153/280] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:15 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1319 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:17.258471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:17.267835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:17.269897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:17.271250 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5f3fbc9-ade4-44e5-b73a-e48550060cef tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.355861 Sep 10 20:49:17.271998 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 128/281] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:16 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:17.695658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:17.696347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] [instance: 6e6c810a-a866-4b29-b720-c315990efec6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:17.714607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:17.715148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:17.718109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:17.723696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:17.723696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:17.723696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:17.762739 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] HTTP exception thrown: Instance 6e6c810a-a866-4b29-b720-c315990efec6 could not be found. Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Request method failure captured: Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 HTTP/1.1 Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgs_CarbCMukm5YfSK3w5N3J3mJo-VkaH1V-RdxFxuhxVAt142TtuBglW_KneXP0XkwIpjxVUhZ-NqrfwLoOryQiomUEIwG3lnZLs4RI6f0lIemgXCflhVZmH05KyTigQwpiZopax5SZuO9moiPLOoe09t0rqcB7rqqEoue6ypZCo4 Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d9204ddaf90a4685a4286c8ebfd76433 Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1194648581 Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:17.767564 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d9204ddaf90a4685a4286c8ebfd76433"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d9204ddaf90a4685a4286c8ebfd76433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d9204ddaf90a4685a4286c8ebfd76433", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d9204ddaf90a4685a4286c8ebfd76433"}]}] Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1194648581 Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d9204ddaf90a4685a4286c8ebfd76433 Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1194648581 Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerDiagnosticsNegativeTest-1194648581-project Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ffba8e54e6f14960b7f57c5e19d3cfae Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1194648581-project Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 6e6c810a-a866-4b29-b720-c315990efec6 could not be found. Sep 10 20:49:17.769019 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '6e6c810a-a866-4b29-b720-c315990efec6'} Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6c810a-a866-4b29-b720-c315990efec6 could not be found. Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:17.769933 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6c810a-a866-4b29-b720-c315990efec6 could not be found. Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6c810a-a866-4b29-b720-c315990efec6 could not be found. Sep 10 20:49:17.771507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:17.774563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] Returning 404 to user: Instance 6e6c810a-a866-4b29-b720-c315990efec6 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:17.776771 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9235a80f-592a-45fa-99b9-bb574edec80f tempest-ServerDiagnosticsNegativeTest-1194648581 tempest-ServerDiagnosticsNegativeTest-1194648581-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6" status: 404 len: 111 microversion: 2.1 time: 0.085716 Sep 10 20:49:17.777698 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 154/282] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:17 2022] GET /compute/v2.1/servers/6e6c810a-a866-4b29-b720-c315990efec6 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:17.940505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d77405c-5b47-40f6-9c99-3ca1de7eb4e6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:17.941079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7d77405c-5b47-40f6-9c99-3ca1de7eb4e6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:17.949880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d77405c-5b47-40f6-9c99-3ca1de7eb4e6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:17.950385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d77405c-5b47-40f6-9c99-3ca1de7eb4e6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:17.950821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d77405c-5b47-40f6-9c99-3ca1de7eb4e6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:17.951529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d77405c-5b47-40f6-9c99-3ca1de7eb4e6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:17.952000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d77405c-5b47-40f6-9c99-3ca1de7eb4e6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:17.952422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d77405c-5b47-40f6-9c99-3ca1de7eb4e6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:18.081900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-87f89003-80fe-432c-9893-f7d7468067e1 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:18.083148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-87f89003-80fe-432c-9893-f7d7468067e1 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:18.093131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87f89003-80fe-432c-9893-f7d7468067e1 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:18.097025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87f89003-80fe-432c-9893-f7d7468067e1 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:18.102211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87f89003-80fe-432c-9893-f7d7468067e1 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:18.103226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87f89003-80fe-432c-9893-f7d7468067e1 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:18.103868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87f89003-80fe-432c-9893-f7d7468067e1 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:18.104456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87f89003-80fe-432c-9893-f7d7468067e1 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:18.135867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7d77405c-5b47-40f6-9c99-3ca1de7eb4e6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:18.145010 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7d77405c-5b47-40f6-9c99-3ca1de7eb4e6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1278 microversion: 2.1 time: 0.208226 Sep 10 20:49:18.157873 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 129/283] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:17 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:18.297514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:18.299449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:18.315322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:18.318394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:18.320509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:18.323077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:18.324207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:18.325662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:18.480786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87f89003-80fe-432c-9893-f7d7468067e1 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:18.489496 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-87f89003-80fe-432c-9893-f7d7468067e1 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1469 microversion: 2.1 time: 0.411620 Sep 10 20:49:18.494196 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 155/284] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:18 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1469 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:18.718060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:18.732183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:18.736383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:18.739995 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9cf02bad-a1ab-42c8-9478-43643d276a3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.447041 Sep 10 20:49:18.740757 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 130/285] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:18 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:49:18.752250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3b88f724-369e-4939-9041-32d4d6b108cd tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:18.753065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3b88f724-369e-4939-9041-32d4d6b108cd tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:18.768758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88f724-369e-4939-9041-32d4d6b108cd tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:18.769587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88f724-369e-4939-9041-32d4d6b108cd tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:18.770800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88f724-369e-4939-9041-32d4d6b108cd tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:18.776489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88f724-369e-4939-9041-32d4d6b108cd tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:18.777199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88f724-369e-4939-9041-32d4d6b108cd tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:18.777792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88f724-369e-4939-9041-32d4d6b108cd tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:18.986858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-3b88f724-369e-4939-9041-32d4d6b108cd tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lazy-loading 'flavor' on Instance uuid 43267b6f-f7b1-4d07-b8a7-74dfc0230123 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:19.107773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-402d2437-bab2-40cd-a604-5bf4a71c88fe tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1133309851", "id": 161411319, "os-flavor-access:is_public": "False"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:19.144619 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-402d2437-bab2-40cd-a604-5bf4a71c88fe tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.648911 Sep 10 20:49:19.148992 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 156/286] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:49:18 2022] POST /compute/v2.1/flavors => generated 436 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:19.162480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-45e05b01-9161-46b1-aeca-0f01eafb5046 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "465cb86fae594c0d97c43f087a2db0b5"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:19.340771 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3b88f724-369e-4939-9041-32d4d6b108cd tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123/action" status: 202 len: 0 microversion: 2.1 time: 0.596026 Sep 10 20:49:19.348324 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 131/287] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:49:18 2022] POST /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:49:19.377880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-074a5edf-dfe9-4eed-8f49-b346ea44be40 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:19.381379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-074a5edf-dfe9-4eed-8f49-b346ea44be40 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:19.397665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-074a5edf-dfe9-4eed-8f49-b346ea44be40 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:19.400530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-074a5edf-dfe9-4eed-8f49-b346ea44be40 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:19.400994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-074a5edf-dfe9-4eed-8f49-b346ea44be40 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:19.403741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-074a5edf-dfe9-4eed-8f49-b346ea44be40 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:19.404289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-074a5edf-dfe9-4eed-8f49-b346ea44be40 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:19.404734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-074a5edf-dfe9-4eed-8f49-b346ea44be40 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:19.671680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-074a5edf-dfe9-4eed-8f49-b346ea44be40 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:19.686811 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-074a5edf-dfe9-4eed-8f49-b346ea44be40 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1278 microversion: 2.1 time: 0.334723 Sep 10 20:49:19.690903 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 132/288] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:19 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1278 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:19.698470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1d4a22c3-71ff-4fa2-abd2-aa4d753c094b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:19.702344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1d4a22c3-71ff-4fa2-abd2-aa4d753c094b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:19.718515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d4a22c3-71ff-4fa2-abd2-aa4d753c094b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:19.721017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d4a22c3-71ff-4fa2-abd2-aa4d753c094b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:19.722593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d4a22c3-71ff-4fa2-abd2-aa4d753c094b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:19.726545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d4a22c3-71ff-4fa2-abd2-aa4d753c094b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:19.727497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d4a22c3-71ff-4fa2-abd2-aa4d753c094b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:19.728463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d4a22c3-71ff-4fa2-abd2-aa4d753c094b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:19.952554 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-45e05b01-9161-46b1-aeca-0f01eafb5046 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/161411319/action" status: 200 len: 96 microversion: 2.1 time: 0.794696 Sep 10 20:49:19.953911 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 157/289] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Sep 10 20:49:19 2022] POST /compute/v2.1/flavors/161411319/action => generated 96 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:49:19.967951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5a425609-d19e-4229-9a9c-1c344edd87bf req-c20f0366-d29f-4f04-afa1-ebea92ac7666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e5c032-830c-485e-95db-6ce8a67b1872", "name": "network-vif-plugged", "status": "completed", "tag": "77555f73-bd32-4402-a6df-d676567f9a43"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:19.989381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5a425609-d19e-4229-9a9c-1c344edd87bf req-c20f0366-d29f-4f04-afa1-ebea92ac7666 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:19.990091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5a425609-d19e-4229-9a9c-1c344edd87bf req-c20f0366-d29f-4f04-afa1-ebea92ac7666 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:19.990599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5a425609-d19e-4229-9a9c-1c344edd87bf req-c20f0366-d29f-4f04-afa1-ebea92ac7666 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:20.004111 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5a425609-d19e-4229-9a9c-1c344edd87bf req-c20f0366-d29f-4f04-afa1-ebea92ac7666 service nova] Creating event network-vif-plugged:77555f73-bd32-4402-a6df-d676567f9a43 for instance 71e5c032-830c-485e-95db-6ce8a67b1872 on nch2-master-1 Sep 10 20:49:20.013253 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5a425609-d19e-4229-9a9c-1c344edd87bf req-c20f0366-d29f-4f04-afa1-ebea92ac7666 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057914 Sep 10 20:49:20.014131 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 158/290] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:20.021229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:20.033698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:20.046517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:20.047519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:20.048192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:20.049397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:20.050211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:20.050874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:20.331400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:20.348615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:20.350153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:20.352110 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ef48bbf8-d6bd-441d-a21d-36e36facab6e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.336452 Sep 10 20:49:20.352513 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 159/291] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:20 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:20.664410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bd146c9e-8ce7-4d50-969a-cd05c9b18f84 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Calling method '.version_select at 0x7f9945572430>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:20.669083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd146c9e-8ce7-4d50-969a-cd05c9b18f84 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:20.669666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd146c9e-8ce7-4d50-969a-cd05c9b18f84 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:20.670213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd146c9e-8ce7-4d50-969a-cd05c9b18f84 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:20.671054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd146c9e-8ce7-4d50-969a-cd05c9b18f84 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:20.671602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd146c9e-8ce7-4d50-969a-cd05c9b18f84 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:20.672114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd146c9e-8ce7-4d50-969a-cd05c9b18f84 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:20.703110 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bd146c9e-8ce7-4d50-969a-cd05c9b18f84 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.341709 Sep 10 20:49:20.703712 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 160/292] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Sep 10 20:49:20 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:20.708880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66a77d62-5e84-4079-92d5-11e5381b46ca tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "465cb86fae594c0d97c43f087a2db0b5"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:20.733011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1d4a22c3-71ff-4fa2-abd2-aa4d753c094b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:20.741796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:20.753642 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1d4a22c3-71ff-4fa2-abd2-aa4d753c094b tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1477 microversion: 2.1 time: 1.060950 Sep 10 20:49:20.770447 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 133/293] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:19 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1477 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:20.770447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-90febb53-81d2-4905-bf7f-30b3a0d3b2ec tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:20.776495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-90febb53-81d2-4905-bf7f-30b3a0d3b2ec tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:20.791735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90febb53-81d2-4905-bf7f-30b3a0d3b2ec tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:20.792703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90febb53-81d2-4905-bf7f-30b3a0d3b2ec tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:20.793331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90febb53-81d2-4905-bf7f-30b3a0d3b2ec tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:20.794524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90febb53-81d2-4905-bf7f-30b3a0d3b2ec tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:20.795463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90febb53-81d2-4905-bf7f-30b3a0d3b2ec tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:20.796073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90febb53-81d2-4905-bf7f-30b3a0d3b2ec tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:20.935250 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-66a77d62-5e84-4079-92d5-11e5381b46ca tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] HTTP exception thrown: Flavor access already exists for flavor 20 and project 465cb86fae594c0d97c43f087a2db0b5 combination. Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66a77d62-5e84-4079-92d5-11e5381b46ca tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Request method failure captured: Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/flavors/161411319/action HTTP/1.1 Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 67 Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhNs5Ih-OxQO5TceLelvi9Tq46FWgykeiYtyUKbKbi7G3yXkLJ-kONK4GurGEwx7UxuCLj5h7eDQIvMKFlcVa4cS7deSg1jO5F57rBBrm8gSI0pmYcAfRjvjQjhzk-iIS4sjPPild03oDT9LKwk975Pf0xxPUNfupgfW5isTjWn394 Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 55523014277a49d4b3f455ac5f7becf8 Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2055522332 Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:20.951245 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/55523014277a49d4b3f455ac5f7becf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/55523014277a49d4b3f455ac5f7becf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_55523014277a49d4b3f455ac5f7becf8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/55523014277a49d4b3f455ac5f7becf8"}]}] Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2055522332 Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 55523014277a49d4b3f455ac5f7becf8 Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2055522332 Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 224d1f0c976e45018d6c24c6d4e6744c Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: {"addTenantAccess": {"tenant": "465cb86fae594c0d97c43f087a2db0b5"}} Sep 10 20:49:20.952876 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: exception: Flavor access already exists for flavor 20 and project 465cb86fae594c0d97c43f087a2db0b5 combination. Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '161411319', 'body': {'addTenantAccess': {'tenant': '465cb86fae594c0d97c43f087a2db0b5'}}} Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result.read() Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 20:49:20.953710 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '20-465cb86fae594c0d97c43f087a2db0b5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi session.flush() Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 20:49:20.954775 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 20:49:20.955842 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 20:49:20.957766 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result.read() Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '20-465cb86fae594c0d97c43f087a2db0b5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 10, 20, 49, 20, 929603), 'updated_at': None, 'flavor_id': 20, 'project_id': '465cb86fae594c0d97c43f087a2db0b5'}] Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:20.960182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 20 and project 465cb86fae594c0d97c43f087a2db0b5 combination. Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:20.962272 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 20 and project 465cb86fae594c0d97c43f087a2db0b5 combination. Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:20.965451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:20.968386 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 20 and project 465cb86fae594c0d97c43f087a2db0b5 combination. Sep 10 20:49:20.968386 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:20.972635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66a77d62-5e84-4079-92d5-11e5381b46ca tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Returning 409 to user: Flavor access already exists for flavor 20 and project 465cb86fae594c0d97c43f087a2db0b5 combination. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:20.976915 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-66a77d62-5e84-4079-92d5-11e5381b46ca tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/161411319/action" status: 409 len: 152 microversion: 2.1 time: 0.269717 Sep 10 20:49:20.978050 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 161/294] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Sep 10 20:49:20 2022] POST /compute/v2.1/flavors/161411319/action => generated 152 bytes in 273 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:21.216285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-90febb53-81d2-4905-bf7f-30b3a0d3b2ec tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:21.226444 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-90febb53-81d2-4905-bf7f-30b3a0d3b2ec tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1320 microversion: 2.1 time: 0.458972 Sep 10 20:49:21.230675 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 134/295] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:20 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1320 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:21.237706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-19741b8f-6fff-4e67-8c80-998314fce8d9 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "465cb86fae594c0d97c43f087a2db0b5"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:21.260270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db5a55d8-fa14-44d4-8118-e37fd2e27de4 tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Calling method '.version_select at 0x7f9945573940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.264312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-db5a55d8-fa14-44d4-8118-e37fd2e27de4 tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a80a5386c470486e836eadbda8957dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96346a9cc8fc416fb0bdc356308280ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db5a55d8-fa14-44d4-8118-e37fd2e27de4 tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Request method failure captured: Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhOdssNMKijWK4X9oZvrza0dPgwCMy525ujAmn2Ohv3cANo31jOoAlboLF2W9kSq62zFUbQb_LvRv2LEMeL3ndbxOq4_ILPtDBuVnnLa8fT_8gbwHkdDDp-sE-56fZvQYctClWL9jpQUx-o3EV9loNFNPYDsGv21EPUtS1_tT66_gk Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:21.266535 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_96346a9cc8fc416fb0bdc356308280ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/96346a9cc8fc416fb0bdc356308280ab"}]}] Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a80a5386c470486e836eadbda8957dcd Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: action_args: {} Sep 10 20:49:21.267703 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:21.268451 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 10 20:49:21.269564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.270619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db5a55d8-fa14-44d4-8118-e37fd2e27de4 tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.270619 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-db5a55d8-fa14-44d4-8118-e37fd2e27de4 tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.288973 Sep 10 20:49:21.274127 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 162/296] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Sep 10 20:49:20 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 295 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:21.282888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ef0e935-ef0f-4f4c-96a3-7d750962a20a tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Calling method '.version_select at 0x7f99452325e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.299335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0ef0e935-ef0f-4f4c-96a3-7d750962a20a tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a80a5386c470486e836eadbda8957dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96346a9cc8fc416fb0bdc356308280ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ef0e935-ef0f-4f4c-96a3-7d750962a20a tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Request method failure captured: Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhOdssNMKijWK4X9oZvrza0dPgwCMy525ujAmn2Ohv3cANo31jOoAlboLF2W9kSq62zFUbQb_LvRv2LEMeL3ndbxOq4_ILPtDBuVnnLa8fT_8gbwHkdDDp-sE-56fZvQYctClWL9jpQUx-o3EV9loNFNPYDsGv21EPUtS1_tT66_gk Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:21.301286 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_96346a9cc8fc416fb0bdc356308280ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/96346a9cc8fc416fb0bdc356308280ab"}]}] Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a80a5386c470486e836eadbda8957dcd Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'ncdv-master-1'} Sep 10 20:49:21.302813 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:21.304109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 10 20:49:21.305742 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.306906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ef0e935-ef0f-4f4c-96a3-7d750962a20a tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.306906 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0ef0e935-ef0f-4f4c-96a3-7d750962a20a tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.030273 Sep 10 20:49:21.314282 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 163/297] 10.222.0.33 () {58 vars in 1191 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:21.320286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7f8182c8-9272-4d39-aaf8-8178cba62341 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Calling method '.version_select at 0x7f9945240160>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.340706 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-7f8182c8-9272-4d39-aaf8-8178cba62341 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7f8182c8-9272-4d39-aaf8-8178cba62341 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Request method failure captured: Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhPHwI2tHI4_JpwMQ1QW4fVYIpACFSf3hKj9gi2Tiu-EY24CKBZuVt7gqG2tpAn1VNBztPiV_GCfWmTTDre8-1j17nsHhZDENh0miTuXTxjnXEofnTVChtYH-HJ_QzcCWadRgITa3qZVAJoiW7UueGJ7k0m0Eb5yAah_YtjxNZyQns Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:21.343588 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b407799c2326425692dfc1c7a521762a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b407799c2326425692dfc1c7a521762a"}]}] Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d8d290b0936a4b6cab5a340b3231d1de Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'nonexistent_hostname'} Sep 10 20:49:21.345705 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:21.346777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 10 20:49:21.348101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.349351 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.352239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7f8182c8-9272-4d39-aaf8-8178cba62341 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.357073 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7f8182c8-9272-4d39-aaf8-8178cba62341 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.041200 Sep 10 20:49:21.357879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 164/298] 10.222.0.33 () {58 vars in 1212 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:21.385501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae6168b6-5696-4d82-9dbb-b1cfc3b5bc85 tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Calling method '.version_select at 0x7f9945232550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.392619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae6168b6-5696-4d82-9dbb-b1cfc3b5bc85 tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a80a5386c470486e836eadbda8957dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96346a9cc8fc416fb0bdc356308280ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae6168b6-5696-4d82-9dbb-b1cfc3b5bc85 tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Request method failure captured: Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhOdssNMKijWK4X9oZvrza0dPgwCMy525ujAmn2Ohv3cANo31jOoAlboLF2W9kSq62zFUbQb_LvRv2LEMeL3ndbxOq4_ILPtDBuVnnLa8fT_8gbwHkdDDp-sE-56fZvQYctClWL9jpQUx-o3EV9loNFNPYDsGv21EPUtS1_tT66_gk Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:21.396040 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_96346a9cc8fc416fb0bdc356308280ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/96346a9cc8fc416fb0bdc356308280ab"}]}] Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a80a5386c470486e836eadbda8957dcd Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'ncdv-master-1'} Sep 10 20:49:21.398483 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:21.399349 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 10 20:49:21.400706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.403182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae6168b6-5696-4d82-9dbb-b1cfc3b5bc85 tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.406827 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae6168b6-5696-4d82-9dbb-b1cfc3b5bc85 tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.030572 Sep 10 20:49:21.409911 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 165/299] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:21.420271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.423731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:21.429237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=5,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:21.438031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:21.440337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:21.446655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:21.450274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:21.452107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:21.452940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:21.604270 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-19741b8f-6fff-4e67-8c80-998314fce8d9 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/161411319/action" status: 200 len: 21 microversion: 2.1 time: 0.369074 Sep 10 20:49:21.606566 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 135/300] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Sep 10 20:49:21 2022] POST /compute/v2.1/flavors/161411319/action => generated 21 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:49:21.616621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-55e89a7e-b32b-466c-b7db-2693adc8e9c9 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Calling method '.version_select at 0x7f99455ea9d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.630909 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-55e89a7e-b32b-466c-b7db-2693adc8e9c9 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-55e89a7e-b32b-466c-b7db-2693adc8e9c9 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Request method failure captured: Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhPHwI2tHI4_JpwMQ1QW4fVYIpACFSf3hKj9gi2Tiu-EY24CKBZuVt7gqG2tpAn1VNBztPiV_GCfWmTTDre8-1j17nsHhZDENh0miTuXTxjnXEofnTVChtYH-HJ_QzcCWadRgITa3qZVAJoiW7UueGJ7k0m0Eb5yAah_YtjxNZyQns Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:49:21.635496 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b407799c2326425692dfc1c7a521762a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b407799c2326425692dfc1c7a521762a"}]}] Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d8d290b0936a4b6cab5a340b3231d1de Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'nonexistent_hostname'} Sep 10 20:49:21.637007 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.637903 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.639192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.646888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-55e89a7e-b32b-466c-b7db-2693adc8e9c9 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.646888 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-55e89a7e-b32b-466c-b7db-2693adc8e9c9 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.030667 Sep 10 20:49:21.646888 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 136/301] 10.222.0.33 () {58 vars in 1191 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:21.651143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-749fc01d-6f5c-4345-bb6b-ee84bc8ca758 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.714851 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-749fc01d-6f5c-4345-bb6b-ee84bc8ca758 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/161411319" status: 202 len: 0 microversion: 2.1 time: 0.069203 Sep 10 20:49:21.715352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:21.715976 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 137/302] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:49:21 2022] DELETE /compute/v2.1/flavors/161411319 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:49:21.724354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa91c0c7-3a5b-421d-81af-bd93c449072d tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Calling method '.version_select at 0x7f994542d700>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.730809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:21.732891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:21.734236 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ce46a1be-3fac-49c2-ae0f-d0a463f89d7b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1362 microversion: 2.25 time: 0.323105 Sep 10 20:49:21.735233 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 166/303] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:21.739720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f226f44f-4bba-4dde-a29f-a924df548ac8 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.742538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aa91c0c7-3a5b-421d-81af-bd93c449072d tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a80a5386c470486e836eadbda8957dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96346a9cc8fc416fb0bdc356308280ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa91c0c7-3a5b-421d-81af-bd93c449072d tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Request method failure captured: Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhOdssNMKijWK4X9oZvrza0dPgwCMy525ujAmn2Ohv3cANo31jOoAlboLF2W9kSq62zFUbQb_LvRv2LEMeL3ndbxOq4_ILPtDBuVnnLa8fT_8gbwHkdDDp-sE-56fZvQYctClWL9jpQUx-o3EV9loNFNPYDsGv21EPUtS1_tT66_gk Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:49:21.744180 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_96346a9cc8fc416fb0bdc356308280ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/96346a9cc8fc416fb0bdc356308280ab"}]}] Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a80a5386c470486e836eadbda8957dcd Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'ncdv-master-1'} Sep 10 20:49:21.745429 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:21.746348 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 10 20:49:21.747592 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.748684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa91c0c7-3a5b-421d-81af-bd93c449072d tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.748684 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aa91c0c7-3a5b-421d-81af-bd93c449072d tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.030763 Sep 10 20:49:21.751422 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 138/304] 10.222.0.33 () {58 vars in 1197 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:21.769705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59829a55-2e2d-4ebe-bb83-1175634211ee tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Calling method '.version_select at 0x7f9945818820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.785558 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f226f44f-4bba-4dde-a29f-a924df548ac8 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.048780 Sep 10 20:49:21.786545 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 167/305] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:21.796114 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-59829a55-2e2d-4ebe-bb83-1175634211ee tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59829a55-2e2d-4ebe-bb83-1175634211ee tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Request method failure captured: Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhPHwI2tHI4_JpwMQ1QW4fVYIpACFSf3hKj9gi2Tiu-EY24CKBZuVt7gqG2tpAn1VNBztPiV_GCfWmTTDre8-1j17nsHhZDENh0miTuXTxjnXEofnTVChtYH-HJ_QzcCWadRgITa3qZVAJoiW7UueGJ7k0m0Eb5yAah_YtjxNZyQns Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:49:21.798100 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b407799c2326425692dfc1c7a521762a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b407799c2326425692dfc1c7a521762a"}]}] Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d8d290b0936a4b6cab5a340b3231d1de Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'nonexistent_hostname'} Sep 10 20:49:21.799256 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:21.799989 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 10 20:49:21.801020 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59829a55-2e2d-4ebe-bb83-1175634211ee tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59829a55-2e2d-4ebe-bb83-1175634211ee tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.038151 Sep 10 20:49:21.802071 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 139/306] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:21.812889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-630cc6c3-4371-4bdb-bae0-edf7b59d63da tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.813521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-630cc6c3-4371-4bdb-bae0-edf7b59d63da tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:21.828639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dd9f8283-0616-4e1c-9734-606f7fd70ccb tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Calling method '.version_select at 0x7f9945232ee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.829777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-630cc6c3-4371-4bdb-bae0-edf7b59d63da tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:21.830321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-630cc6c3-4371-4bdb-bae0-edf7b59d63da tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:21.830769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-630cc6c3-4371-4bdb-bae0-edf7b59d63da tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:21.831701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-630cc6c3-4371-4bdb-bae0-edf7b59d63da tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:21.831933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-630cc6c3-4371-4bdb-bae0-edf7b59d63da tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:21.832368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-630cc6c3-4371-4bdb-bae0-edf7b59d63da tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:21.838308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dd9f8283-0616-4e1c-9734-606f7fd70ccb tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a80a5386c470486e836eadbda8957dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96346a9cc8fc416fb0bdc356308280ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dd9f8283-0616-4e1c-9734-606f7fd70ccb tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Request method failure captured: Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhOdssNMKijWK4X9oZvrza0dPgwCMy525ujAmn2Ohv3cANo31jOoAlboLF2W9kSq62zFUbQb_LvRv2LEMeL3ndbxOq4_ILPtDBuVnnLa8fT_8gbwHkdDDp-sE-56fZvQYctClWL9jpQUx-o3EV9loNFNPYDsGv21EPUtS1_tT66_gk Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:21.839088 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_96346a9cc8fc416fb0bdc356308280ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/96346a9cc8fc416fb0bdc356308280ab"}]}] Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a80a5386c470486e836eadbda8957dcd Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'ncdv-master-1'} Sep 10 20:49:21.840389 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:21.841336 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 10 20:49:21.842623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.844165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dd9f8283-0616-4e1c-9734-606f7fd70ccb tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.844165 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dd9f8283-0616-4e1c-9734-606f7fd70ccb tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.020099 Sep 10 20:49:21.844581 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 168/307] 10.222.0.33 () {58 vars in 1194 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:21.849773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b94836d6-22f8-42e8-947e-9905e084f865 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1043782670", "id": 658055394, "os-flavor-access:is_public": "True"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:21.881557 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b94836d6-22f8-42e8-947e-9905e084f865 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.035418 Sep 10 20:49:21.890345 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 169/308] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:49:21 2022] POST /compute/v2.1/flavors => generated 435 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:21.895639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fc29b1c0-cca1-4aa5-a251-183ad451f4de tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Calling method '.version_select at 0x7f99454e0af0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.906809 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-fc29b1c0-cca1-4aa5-a251-183ad451f4de tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fc29b1c0-cca1-4aa5-a251-183ad451f4de tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Request method failure captured: Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhPHwI2tHI4_JpwMQ1QW4fVYIpACFSf3hKj9gi2Tiu-EY24CKBZuVt7gqG2tpAn1VNBztPiV_GCfWmTTDre8-1j17nsHhZDENh0miTuXTxjnXEofnTVChtYH-HJ_QzcCWadRgITa3qZVAJoiW7UueGJ7k0m0Eb5yAah_YtjxNZyQns Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:21.908935 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b407799c2326425692dfc1c7a521762a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b407799c2326425692dfc1c7a521762a"}]}] Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d8d290b0936a4b6cab5a340b3231d1de Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'nonexistent_hostname'} Sep 10 20:49:21.910155 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:21.910942 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 10 20:49:21.911982 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:21.913848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.918141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fc29b1c0-cca1-4aa5-a251-183ad451f4de tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.919261 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fc29b1c0-cca1-4aa5-a251-183ad451f4de tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.027687 Sep 10 20:49:21.919897 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 170/309] 10.222.0.33 () {58 vars in 1215 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:21.932469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f38287e-5c2b-4b22-86b2-7283645d054d tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:21.940231 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5f38287e-5c2b-4b22-86b2-7283645d054d tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f38287e-5c2b-4b22-86b2-7283645d054d tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Request method failure captured: Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/flavors/658055394/os-flavor-access HTTP/1.1 Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhNs5Ih-OxQO5TceLelvi9Tq46FWgykeiYtyUKbKbi7G3yXkLJ-kONK4GurGEwx7UxuCLj5h7eDQIvMKFlcVa4cS7deSg1jO5F57rBBrm8gSI0pmYcAfRjvjQjhzk-iIS4sjPPild03oDT9LKwk975Pf0xxPUNfupgfW5isTjWn394 Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 55523014277a49d4b3f455ac5f7becf8 Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2055522332 Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:21.941539 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/55523014277a49d4b3f455ac5f7becf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/55523014277a49d4b3f455ac5f7becf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_55523014277a49d4b3f455ac5f7becf8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/55523014277a49d4b3f455ac5f7becf8"}]}] Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2055522332 Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 55523014277a49d4b3f455ac5f7becf8 Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2055522332 Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 224d1f0c976e45018d6c24c6d4e6744c Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: exception: Access list not available for public flavors. Sep 10 20:49:21.942786 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'flavor_id': '658055394'} Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 10 20:49:21.943482 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.945366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f38287e-5c2b-4b22-86b2-7283645d054d tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.945366 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f38287e-5c2b-4b22-86b2-7283645d054d tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/658055394/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.016284 Sep 10 20:49:21.946780 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 171/310] 10.222.0.33 () {58 vars in 1206 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/flavors/658055394/os-flavor-access => generated 91 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:21.952951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d0941dce-0946-4e96-b24b-bbb6a2574c2a tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Action: 'update', calling method: .version_select at 0x7f9945573940>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d0941dce-0946-4e96-b24b-bbb6a2574c2a tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Request method failure captured: Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 51 Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhPHwI2tHI4_JpwMQ1QW4fVYIpACFSf3hKj9gi2Tiu-EY24CKBZuVt7gqG2tpAn1VNBztPiV_GCfWmTTDre8-1j17nsHhZDENh0miTuXTxjnXEofnTVChtYH-HJ_QzcCWadRgITa3qZVAJoiW7UueGJ7k0m0Eb5yAah_YtjxNZyQns Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:21.956764 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b407799c2326425692dfc1c7a521762a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b407799c2326425692dfc1c7a521762a"}]}] Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d8d290b0936a4b6cab5a340b3231d1de Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: {"status": "enable", "maintenance_mode": "invalid"} Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:49:21.958099 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'disable', Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'Enable', Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'Disable', Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance: Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.958878 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:21.962389 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:21.965408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:21.965408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:49:21.965408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:49:21.965408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 20:49:21.965408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:21.965408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d0941dce-0946-4e96-b24b-bbb6a2574c2a tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:21.965408 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d0941dce-0946-4e96-b24b-bbb6a2574c2a tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.010049 Sep 10 20:49:21.966864 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 172/311] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Sep 10 20:49:21 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:49:21.988744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2fb77da2-a42a-4d04-8738-fa3c66fcd702 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:22.035881 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2fb77da2-a42a-4d04-8738-fa3c66fcd702 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/658055394" status: 202 len: 0 microversion: 2.1 time: 0.067766 Sep 10 20:49:22.040971 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 173/312] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:49:21 2022] DELETE /compute/v2.1/flavors/658055394 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:49:22.057420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4cea21a1-a471-4632-ae95-a6e041b0bcf8 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Action: 'update', calling method: .version_select at 0x7f9945232550>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4cea21a1-a471-4632-ae95-a6e041b0bcf8 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Request method failure captured: Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 51 Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhPHwI2tHI4_JpwMQ1QW4fVYIpACFSf3hKj9gi2Tiu-EY24CKBZuVt7gqG2tpAn1VNBztPiV_GCfWmTTDre8-1j17nsHhZDENh0miTuXTxjnXEofnTVChtYH-HJ_QzcCWadRgITa3qZVAJoiW7UueGJ7k0m0Eb5yAah_YtjxNZyQns Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:22.061729 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b407799c2326425692dfc1c7a521762a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b407799c2326425692dfc1c7a521762a"}]}] Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d8d290b0936a4b6cab5a340b3231d1de Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: {"status": "invalid", "maintenance_mode": "enable"} Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:49:22.063146 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'disable', Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'Enable', Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'Disable', Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance: Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.063929 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.065425 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:22.066896 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:22.066896 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:49:22.066896 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:49:22.066896 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 20:49:22.066896 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.070784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4cea21a1-a471-4632-ae95-a6e041b0bcf8 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:22.072052 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4cea21a1-a471-4632-ae95-a6e041b0bcf8 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.029714 Sep 10 20:49:22.072824 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 174/313] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Sep 10 20:49:22 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:49:22.088925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f548cea2-35b6-495a-9d7e-7edecdaa61f3 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:22.125206 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f548cea2-35b6-495a-9d7e-7edecdaa61f3 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.037704 Sep 10 20:49:22.126103 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 175/314] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:49:22 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:22.131158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f091cac0-7f41-49c0-ad69-4fd681cda39f tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Action: 'update', calling method: .version_select at 0x7f9945232700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:22.135022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f091cac0-7f41-49c0-ad69-4fd681cda39f tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a80a5386c470486e836eadbda8957dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96346a9cc8fc416fb0bdc356308280ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f091cac0-7f41-49c0-ad69-4fd681cda39f tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Request method failure captured: Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 50 Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhOdssNMKijWK4X9oZvrza0dPgwCMy525ujAmn2Ohv3cANo31jOoAlboLF2W9kSq62zFUbQb_LvRv2LEMeL3ndbxOq4_ILPtDBuVnnLa8fT_8gbwHkdDDp-sE-56fZvQYctClWL9jpQUx-o3EV9loNFNPYDsGv21EPUtS1_tT66_gk Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:22.136902 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96346a9cc8fc416fb0bdc356308280ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_96346a9cc8fc416fb0bdc356308280ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/96346a9cc8fc416fb0bdc356308280ab"}]}] Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 96346a9cc8fc416fb0bdc356308280ab Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776597453 Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a80a5386c470486e836eadbda8957dcd Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776597453-project Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: {"status": "enable", "maintenance_mode": "enable"} Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 10 20:49:22.138183 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:22.138954 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 10 20:49:22.140020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.146337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f091cac0-7f41-49c0-ad69-4fd681cda39f tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:22.147676 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f091cac0-7f41-49c0-ad69-4fd681cda39f tempest-HostsAdminNegativeTestJSON-1776597453 tempest-HostsAdminNegativeTestJSON-1776597453-project] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.020205 Sep 10 20:49:22.158958 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 176/315] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Sep 10 20:49:22 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:22.166367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9aed8403-e37f-420a-bfd0-23478481c0e6 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1105281188", "id": 118309901, "os-flavor-access:is_public": "False"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:22.200404 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9aed8403-e37f-420a-bfd0-23478481c0e6 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.039961 Sep 10 20:49:22.201107 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 177/316] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:49:22 2022] POST /compute/v2.1/flavors => generated 436 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:22.206053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-47660074-3354-4983-8aa6-3e1cc24d3ded tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Action: 'update', calling method: .version_select at 0x7f99454d3f70>, body: {"status": null, "maintenance_mode": null} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-47660074-3354-4983-8aa6-3e1cc24d3ded tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Request method failure captured: Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 42 Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhPHwI2tHI4_JpwMQ1QW4fVYIpACFSf3hKj9gi2Tiu-EY24CKBZuVt7gqG2tpAn1VNBztPiV_GCfWmTTDre8-1j17nsHhZDENh0miTuXTxjnXEofnTVChtYH-HJ_QzcCWadRgITa3qZVAJoiW7UueGJ7k0m0Eb5yAah_YtjxNZyQns Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:22.210802 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b407799c2326425692dfc1c7a521762a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b407799c2326425692dfc1c7a521762a"}]}] Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d8d290b0936a4b6cab5a340b3231d1de Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: {"status": null, "maintenance_mode": null} Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 10 20:49:22.212203 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'disable', Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'Enable', Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'Disable', Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance: Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi None Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:22.212957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:22.214312 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:22.215317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:49:22.215317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:49:22.215317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 10 20:49:22.215317 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.224338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-47660074-3354-4983-8aa6-3e1cc24d3ded tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:22.226199 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-47660074-3354-4983-8aa6-3e1cc24d3ded tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.023194 Sep 10 20:49:22.232031 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 178/317] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Sep 10 20:49:22 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:49:22.313620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-630cc6c3-4371-4bdb-bae0-edf7b59d63da tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:22.323501 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-630cc6c3-4371-4bdb-bae0-edf7b59d63da tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1460 microversion: 2.1 time: 0.521995 Sep 10 20:49:22.338597 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 140/318] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:21 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1460 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:22.347258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-24b398b3-180b-429d-9105-a79d919b7542 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Action: 'update', calling method: .version_select at 0x7f9945662160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:22.352329 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.hosts [None req-24b398b3-180b-429d-9105-a79d919b7542 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Enabling host nonexistent_hostname. Sep 10 20:49:22.361070 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-24b398b3-180b-429d-9105-a79d919b7542 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-24b398b3-180b-429d-9105-a79d919b7542 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Request method failure captured: Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 50 Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhPHwI2tHI4_JpwMQ1QW4fVYIpACFSf3hKj9gi2Tiu-EY24CKBZuVt7gqG2tpAn1VNBztPiV_GCfWmTTDre8-1j17nsHhZDENh0miTuXTxjnXEofnTVChtYH-HJ_QzcCWadRgITa3qZVAJoiW7UueGJ7k0m0Eb5yAah_YtjxNZyQns Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:49:22.363509 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b407799c2326425692dfc1c7a521762a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b407799c2326425692dfc1c7a521762a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b407799c2326425692dfc1c7a521762a"}]}] Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: b407799c2326425692dfc1c7a521762a Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-371316031 Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d8d290b0936a4b6cab5a340b3231d1de Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HostsAdminNegativeTestJSON-371316031-project-admin Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: {"status": "enable", "maintenance_mode": "enable"} Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:22.364698 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 20:49:22.365474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:22.367010 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 20:49:22.368095 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.370747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-24b398b3-180b-429d-9105-a79d919b7542 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:22.373020 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-24b398b3-180b-429d-9105-a79d919b7542 tempest-HostsAdminNegativeTestJSON-371316031 tempest-HostsAdminNegativeTestJSON-371316031-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.033097 Sep 10 20:49:22.374448 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 141/319] 10.222.0.33 () {60 vars in 1211 bytes} [Sat Sep 10 20:49:22 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:22.394573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-898700c8-d804-4c3a-946a-5a2cac4d0e52 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:22.395286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-898700c8-d804-4c3a-946a-5a2cac4d0e52 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:22.416302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-898700c8-d804-4c3a-946a-5a2cac4d0e52 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:22.416809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-898700c8-d804-4c3a-946a-5a2cac4d0e52 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:22.417253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-898700c8-d804-4c3a-946a-5a2cac4d0e52 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:22.418012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-898700c8-d804-4c3a-946a-5a2cac4d0e52 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:22.418474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-898700c8-d804-4c3a-946a-5a2cac4d0e52 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:22.418903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-898700c8-d804-4c3a-946a-5a2cac4d0e52 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:22.619290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db01de0d-0e25-4ab5-9931-5a41aa2cbd85 tempest-FlavorsAccessNegativeTestJSON-648461107 tempest-FlavorsAccessNegativeTestJSON-648461107-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "465cb86fae594c0d97c43f087a2db0b5"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:22.622474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-db01de0d-0e25-4ab5-9931-5a41aa2cbd85 tempest-FlavorsAccessNegativeTestJSON-648461107 tempest-FlavorsAccessNegativeTestJSON-648461107-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '811d70e726fd4aebb9a475d0feb1153d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465cb86fae594c0d97c43f087a2db0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db01de0d-0e25-4ab5-9931-5a41aa2cbd85 tempest-FlavorsAccessNegativeTestJSON-648461107 tempest-FlavorsAccessNegativeTestJSON-648461107-project] Request method failure captured: Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/flavors/118309901/action HTTP/1.1 Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 67 Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhLLks4zhN1IpuuI6-91vHaN_5ebk-xs4eJ2ctAAIeDeuVcMQxyDlM57flvY63lKU5AAB9F4M30AgT4w-0QuSrOwqp8C_gUteEiq-KKjlSPhKd0cUmREHuIV0XTkFJSQVlcnwJWogAYBErwVb0RkFQy1N3dskBHfgPFVLWdb3vg6_k Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 465cb86fae594c0d97c43f087a2db0b5 Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-648461107 Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:22.628090 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/465cb86fae594c0d97c43f087a2db0b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/465cb86fae594c0d97c43f087a2db0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_465cb86fae594c0d97c43f087a2db0b5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/465cb86fae594c0d97c43f087a2db0b5"}]}] Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-648461107 Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 465cb86fae594c0d97c43f087a2db0b5 Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-648461107 Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsAccessNegativeTestJSON-648461107-project Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 811d70e726fd4aebb9a475d0feb1153d Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-648461107-project Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: {"addTenantAccess": {"tenant": "465cb86fae594c0d97c43f087a2db0b5"}} Sep 10 20:49:22.629273 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '118309901', 'body': {'addTenantAccess': {'tenant': '465cb86fae594c0d97c43f087a2db0b5'}}} Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:22.630039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 10 20:49:22.631065 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:22.632869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db01de0d-0e25-4ab5-9931-5a41aa2cbd85 tempest-FlavorsAccessNegativeTestJSON-648461107 tempest-FlavorsAccessNegativeTestJSON-648461107-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:22.632869 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-db01de0d-0e25-4ab5-9931-5a41aa2cbd85 tempest-FlavorsAccessNegativeTestJSON-648461107 tempest-FlavorsAccessNegativeTestJSON-648461107-project] 10.222.0.33 "POST /compute/v2.1/flavors/118309901/action" status: 403 len: 130 microversion: 2.1 time: 0.396156 Sep 10 20:49:22.634537 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 179/320] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Sep 10 20:49:22 2022] POST /compute/v2.1/flavors/118309901/action => generated 130 bytes in 402 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:22.644521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a71f3a42-c4d4-49a9-a279-1262b21a0de8 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:22.645390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a71f3a42-c4d4-49a9-a279-1262b21a0de8 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:22.654002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a71f3a42-c4d4-49a9-a279-1262b21a0de8 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:22.654723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a71f3a42-c4d4-49a9-a279-1262b21a0de8 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:22.655600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a71f3a42-c4d4-49a9-a279-1262b21a0de8 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:22.656612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a71f3a42-c4d4-49a9-a279-1262b21a0de8 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:22.657220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a71f3a42-c4d4-49a9-a279-1262b21a0de8 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:22.657797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a71f3a42-c4d4-49a9-a279-1262b21a0de8 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:22.764530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-898700c8-d804-4c3a-946a-5a2cac4d0e52 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:22.774723 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-898700c8-d804-4c3a-946a-5a2cac4d0e52 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1320 microversion: 2.1 time: 0.395946 Sep 10 20:49:22.775318 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 142/321] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:22 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:22.800791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6227e47e-0946-4959-b48c-a7c6fb1bed19 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:22.854378 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6227e47e-0946-4959-b48c-a7c6fb1bed19 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/118309901" status: 202 len: 0 microversion: 2.1 time: 0.075144 Sep 10 20:49:22.854616 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 143/322] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:49:22 2022] DELETE /compute/v2.1/flavors/118309901 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:49:22.876361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:22.885441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:22.898590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=10,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:22.913571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:22.914681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:22.916729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:22.920135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:22.920908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:22.921496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:23.289568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:23.298987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:23.312888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:23.312888 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35e832df-98c8-4577-9725-1ccdc00194da tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1558 microversion: 2.25 time: 0.451843 Sep 10 20:49:23.324575 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 144/323] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:22 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1558 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:23.338068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a65c313-097c-4351-a53e-85b6c9ac0d79 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:23.340836 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a71f3a42-c4d4-49a9-a279-1262b21a0de8 tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1611 microversion: 2.1 time: 0.701267 Sep 10 20:49:23.369716 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4a65c313-097c-4351-a53e-85b6c9ac0d79 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.043798 Sep 10 20:49:23.370980 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 180/324] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:22 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1611 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:23.379234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1ff74df0-0c95-44d5-831c-a6545b7b5e69 req-2f942fee-a154-4315-99bb-9affcc46ad8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c591752-6514-4202-a477-4d70ffac9dea", "tag": "85975908-75b8-4ec4-b772-fb849da98946"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:23.384610 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 145/325] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:49:23 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:23.394957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1ff74df0-0c95-44d5-831c-a6545b7b5e69 req-2f942fee-a154-4315-99bb-9affcc46ad8d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:23.395793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1ff74df0-0c95-44d5-831c-a6545b7b5e69 req-2f942fee-a154-4315-99bb-9affcc46ad8d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:23.396390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1ff74df0-0c95-44d5-831c-a6545b7b5e69 req-2f942fee-a154-4315-99bb-9affcc46ad8d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:23.402108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:23.416809 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1ff74df0-0c95-44d5-831c-a6545b7b5e69 req-2f942fee-a154-4315-99bb-9affcc46ad8d service nova] Creating event network-changed:85975908-75b8-4ec4-b772-fb849da98946 for instance 9c591752-6514-4202-a477-4d70ffac9dea on nch1-master-1 Sep 10 20:49:23.430764 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1ff74df0-0c95-44d5-831c-a6545b7b5e69 req-2f942fee-a154-4315-99bb-9affcc46ad8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058298 Sep 10 20:49:23.437017 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 181/326] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:23.451476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9561c171-9566-4e60-8917-aebe9ad8058b tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:23.464324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9561c171-9566-4e60-8917-aebe9ad8058b tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:23.464974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9561c171-9566-4e60-8917-aebe9ad8058b tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:23.465436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9561c171-9566-4e60-8917-aebe9ad8058b tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:23.466243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9561c171-9566-4e60-8917-aebe9ad8058b tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:23.466802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9561c171-9566-4e60-8917-aebe9ad8058b tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:23.467124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9561c171-9566-4e60-8917-aebe9ad8058b tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:23.516576 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9561c171-9566-4e60-8917-aebe9ad8058b tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.076768 Sep 10 20:49:23.525110 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 182/327] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Sep 10 20:49:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:23.530971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-593a6e6c-b47a-400d-bab7-724ad8f32ebc tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1697109311", "id": 768692536, "os-flavor-access:is_public": "False"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:23.563346 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-593a6e6c-b47a-400d-bab7-724ad8f32ebc tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.039584 Sep 10 20:49:23.568214 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 183/328] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:49:23 2022] POST /compute/v2.1/flavors => generated 436 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:23.580610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:23.583786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:23.592348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:23.594733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:23.595527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:23.596354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:23.597332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:23.604052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:23.643513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Lazy-loading 'flavor' on Instance uuid 43267b6f-f7b1-4d07-b8a7-74dfc0230123 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:23.661790 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 while it is in vm_state suspended Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Request method failure captured: Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123/action HTTP/1.1 Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 97 Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgSx3T4UTdD2EubvPUGGLUf2P5WeeERqFUVlc5f0yBpJOWQh_gFhqNcSytq5KhCugG6jf_-HACuMbv_jnaD7pvEqGcm1EjzshkdG_ASdBeRmNFzgbv2nmiN356iMUFkjmL8BupoTEOAIVyChGhbm--o4Vf3XbCc3LAyLkmOAGGqYHE Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 1b12288ef70e4b38b128866c7f2efd47 Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-LiveMigrationNegativeTest-646811673 Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:23.664615 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b12288ef70e4b38b128866c7f2efd47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b12288ef70e4b38b128866c7f2efd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b12288ef70e4b38b128866c7f2efd47", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b12288ef70e4b38b128866c7f2efd47"}]}] Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-LiveMigrationNegativeTest-646811673 Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 1b12288ef70e4b38b128866c7f2efd47 Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-646811673 Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-LiveMigrationNegativeTest-646811673-project-admin Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 35c7c4e102e94a5c92d52b94099d50b5 Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-LiveMigrationNegativeTest-646811673-project-admin Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} Sep 10 20:49:23.666123 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: exception: Cannot 'os-migrateLive' instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 while it is in vm_state suspended Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '43267b6f-f7b1-4d07-b8a7-74dfc0230123', 'body': {'os-migrateLive': {'host': 'nch1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 10 20:49:23.666799 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:23.667836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 while it is in vm_state suspended Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 while it is in vm_state suspended Sep 10 20:49:23.668906 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:23.670597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 while it is in vm_state suspended {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:23.670597 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e262e17b-79e2-4ecf-84d7-7f9d80ff9eda tempest-LiveMigrationNegativeTest-646811673 tempest-LiveMigrationNegativeTest-646811673-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123/action" status: 409 len: 155 microversion: 2.1 time: 0.097162 Sep 10 20:49:23.670597 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 184/329] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:49:23 2022] POST /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123/action => generated 155 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:49:23.688748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da22e326-2749-410c-a8f8-8b4144b43fc4 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "465cb86fae594c0d97c43f087a2db0b5"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:23.815487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c6dc30b-6820-4e5b-a1ec-0bad4dfc507b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:23.816311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c6dc30b-6820-4e5b-a1ec-0bad4dfc507b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:23.825577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c6dc30b-6820-4e5b-a1ec-0bad4dfc507b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:23.826222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c6dc30b-6820-4e5b-a1ec-0bad4dfc507b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:23.826735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c6dc30b-6820-4e5b-a1ec-0bad4dfc507b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:23.827675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c6dc30b-6820-4e5b-a1ec-0bad4dfc507b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:23.828266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c6dc30b-6820-4e5b-a1ec-0bad4dfc507b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:23.828772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c6dc30b-6820-4e5b-a1ec-0bad4dfc507b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:23.891765 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da22e326-2749-410c-a8f8-8b4144b43fc4 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/768692536/action" status: 200 len: 96 microversion: 2.1 time: 0.216433 Sep 10 20:49:23.892539 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 185/330] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Sep 10 20:49:23 2022] POST /compute/v2.1/flavors/768692536/action => generated 96 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:49:23.898090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d86af375-2cc6-4bc3-8bf9-2b740c388527 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:23.898958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d86af375-2cc6-4bc3-8bf9-2b740c388527 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:23.905142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d86af375-2cc6-4bc3-8bf9-2b740c388527 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:23.905633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d86af375-2cc6-4bc3-8bf9-2b740c388527 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:23.906102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d86af375-2cc6-4bc3-8bf9-2b740c388527 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:23.906802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d86af375-2cc6-4bc3-8bf9-2b740c388527 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:23.908234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d86af375-2cc6-4bc3-8bf9-2b740c388527 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:23.908987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d86af375-2cc6-4bc3-8bf9-2b740c388527 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:23.935954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d86af375-2cc6-4bc3-8bf9-2b740c388527 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:49:24.029683 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d86af375-2cc6-4bc3-8bf9-2b740c388527 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "DELETE /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 204 len: 0 microversion: 2.1 time: 0.135700 Sep 10 20:49:24.030567 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 186/331] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:49:23 2022] DELETE /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:49:24.098978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-468026913", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": "none"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:24.156123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:49:24.156553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:49:24.157030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:49:24.157443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:49:24.157880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:49:24.167125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:24.167616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:24.168053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:24.168957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:24.169246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:24.169673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:24.189034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Getting quotas for project cda0d7766e3e4ddfa7471f9c9196745a. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:49:24.193976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Getting quotas for user 9232c6fb834f4f68a260f5e10212f891 and project cda0d7766e3e4ddfa7471f9c9196745a. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:49:24.207606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:49:24.210159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:49:24.264985 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-758d1b4f-b260-44e3-b02f-b86575c5d6eb tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.229646 Sep 10 20:49:24.275595 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 187/332] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 241 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 20:49:24.281406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-28a0f8c2-4058-46d6-a875-ac60c2f81565 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:24.282311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-28a0f8c2-4058-46d6-a875-ac60c2f81565 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:24.292069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28a0f8c2-4058-46d6-a875-ac60c2f81565 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:24.292777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28a0f8c2-4058-46d6-a875-ac60c2f81565 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:24.293370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28a0f8c2-4058-46d6-a875-ac60c2f81565 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:24.294266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28a0f8c2-4058-46d6-a875-ac60c2f81565 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:24.295324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28a0f8c2-4058-46d6-a875-ac60c2f81565 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:24.295975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28a0f8c2-4058-46d6-a875-ac60c2f81565 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:24.534819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28a0f8c2-4058-46d6-a875-ac60c2f81565 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:24.544868 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-28a0f8c2-4058-46d6-a875-ac60c2f81565 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1320 microversion: 2.1 time: 0.268025 Sep 10 20:49:24.559597 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 188/333] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:24 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1320 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:24.567393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4b58e416-0ae8-4238-b714-7a6f5427fe58 tempest-FlavorsAccessNegativeTestJSON-648461107 tempest-FlavorsAccessNegativeTestJSON-648461107-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "465cb86fae594c0d97c43f087a2db0b5"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:24.571826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b58e416-0ae8-4238-b714-7a6f5427fe58 tempest-FlavorsAccessNegativeTestJSON-648461107 tempest-FlavorsAccessNegativeTestJSON-648461107-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '811d70e726fd4aebb9a475d0feb1153d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465cb86fae594c0d97c43f087a2db0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:24.572528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-4c6dc30b-6820-4e5b-a1ec-0bad4dfc507b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid 71e5c032-830c-485e-95db-6ce8a67b1872 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4b58e416-0ae8-4238-b714-7a6f5427fe58 tempest-FlavorsAccessNegativeTestJSON-648461107 tempest-FlavorsAccessNegativeTestJSON-648461107-project] Request method failure captured: Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/flavors/768692536/action HTTP/1.1 Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 70 Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhLLks4zhN1IpuuI6-91vHaN_5ebk-xs4eJ2ctAAIeDeuVcMQxyDlM57flvY63lKU5AAB9F4M30AgT4w-0QuSrOwqp8C_gUteEiq-KKjlSPhKd0cUmREHuIV0XTkFJSQVlcnwJWogAYBErwVb0RkFQy1N3dskBHfgPFVLWdb3vg6_k Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 465cb86fae594c0d97c43f087a2db0b5 Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-648461107 Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:24.573945 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/465cb86fae594c0d97c43f087a2db0b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/465cb86fae594c0d97c43f087a2db0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_465cb86fae594c0d97c43f087a2db0b5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/465cb86fae594c0d97c43f087a2db0b5"}]}] Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-648461107 Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 465cb86fae594c0d97c43f087a2db0b5 Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-648461107 Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsAccessNegativeTestJSON-648461107-project Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 811d70e726fd4aebb9a475d0feb1153d Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-648461107-project Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: {"removeTenantAccess": {"tenant": "465cb86fae594c0d97c43f087a2db0b5"}} Sep 10 20:49:24.575289 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '768692536', 'body': {'removeTenantAccess': {'tenant': '465cb86fae594c0d97c43f087a2db0b5'}}} Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can( Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:24.576046 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 10 20:49:24.577169 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:24.580615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4b58e416-0ae8-4238-b714-7a6f5427fe58 tempest-FlavorsAccessNegativeTestJSON-648461107 tempest-FlavorsAccessNegativeTestJSON-648461107-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:24.583040 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4b58e416-0ae8-4238-b714-7a6f5427fe58 tempest-FlavorsAccessNegativeTestJSON-648461107 tempest-FlavorsAccessNegativeTestJSON-648461107-project] 10.222.0.33 "POST /compute/v2.1/flavors/768692536/action" status: 403 len: 133 microversion: 2.1 time: 0.022153 Sep 10 20:49:24.588587 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 189/334] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Sep 10 20:49:24 2022] POST /compute/v2.1/flavors/768692536/action => generated 133 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:24.595056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4ed742bd-501d-4351-b995-bd6aa32bd6fb tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:24.595946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4ed742bd-501d-4351-b995-bd6aa32bd6fb tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:24.604464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed742bd-501d-4351-b995-bd6aa32bd6fb tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:24.605216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed742bd-501d-4351-b995-bd6aa32bd6fb tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:24.605876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed742bd-501d-4351-b995-bd6aa32bd6fb tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:24.606783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed742bd-501d-4351-b995-bd6aa32bd6fb tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:24.607429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed742bd-501d-4351-b995-bd6aa32bd6fb tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:24.608043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed742bd-501d-4351-b995-bd6aa32bd6fb tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:24.691357 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c6dc30b-6820-4e5b-a1ec-0bad4dfc507b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 2051 microversion: 2.25 time: 1.302366 Sep 10 20:49:24.692258 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 146/335] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:23 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 2051 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:24.712897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4a1f855-41f2-4394-8c35-ff676e3473b4 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:24.717334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e4a1f855-41f2-4394-8c35-ff676e3473b4 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:24.838631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4a1f855-41f2-4394-8c35-ff676e3473b4 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:24.854143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4a1f855-41f2-4394-8c35-ff676e3473b4 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:24.856660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4a1f855-41f2-4394-8c35-ff676e3473b4 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:24.871117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4ed742bd-501d-4351-b995-bd6aa32bd6fb tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:24.878308 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e4a1f855-41f2-4394-8c35-ff676e3473b4 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "PUT /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1358 microversion: 2.75 time: 0.182826 Sep 10 20:49:24.882048 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 147/336] 10.222.0.33 () {62 vars in 1297 bytes} [Sat Sep 10 20:49:24 2022] PUT /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:24.889475 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4ed742bd-501d-4351-b995-bd6aa32bd6fb tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1466 microversion: 2.1 time: 0.299336 Sep 10 20:49:24.891063 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 190/337] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:24 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1466 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:24.895600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-edffa938-1539-41dd-a907-a8cf5526b937 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:24.896798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-edffa938-1539-41dd-a907-a8cf5526b937 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:24.901800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4531f7cf-6587-4c92-bde7-e0e4dff58e99 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "465cb86fae594c0d97c43f087a2db0b5"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:24.912532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edffa938-1539-41dd-a907-a8cf5526b937 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:24.920671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edffa938-1539-41dd-a907-a8cf5526b937 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:24.921489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edffa938-1539-41dd-a907-a8cf5526b937 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:24.922567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edffa938-1539-41dd-a907-a8cf5526b937 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:24.923407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edffa938-1539-41dd-a907-a8cf5526b937 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:24.923846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edffa938-1539-41dd-a907-a8cf5526b937 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:25.129519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-edffa938-1539-41dd-a907-a8cf5526b937 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid 71e5c032-830c-485e-95db-6ce8a67b1872 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:25.188060 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-edffa938-1539-41dd-a907-a8cf5526b937 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 2051 microversion: 2.25 time: 0.295882 Sep 10 20:49:25.202133 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 191/338] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:24 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 2051 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:25.210434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:25.212653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:25.222108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:25.223028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:25.223669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:25.224432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:25.224650 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4531f7cf-6587-4c92-bde7-e0e4dff58e99 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/768692536/action" status: 200 len: 21 microversion: 2.1 time: 0.341215 Sep 10 20:49:25.225544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:25.226607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:25.231039 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 148/339] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Sep 10 20:49:24 2022] POST /compute/v2.1/flavors/768692536/action => generated 21 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:49:25.237653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b81eabe4-604c-4198-9df2-b7d6ef30e664 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:25.242435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81eabe4-604c-4198-9df2-b7d6ef30e664 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:25.243294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81eabe4-604c-4198-9df2-b7d6ef30e664 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:25.243979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81eabe4-604c-4198-9df2-b7d6ef30e664 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:25.245508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81eabe4-604c-4198-9df2-b7d6ef30e664 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:25.246494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81eabe4-604c-4198-9df2-b7d6ef30e664 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:25.247131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81eabe4-604c-4198-9df2-b7d6ef30e664 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:25.299585 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b81eabe4-604c-4198-9df2-b7d6ef30e664 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.067296 Sep 10 20:49:25.308811 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 149/340] 10.222.0.33 () {60 vars in 1217 bytes} [Sat Sep 10 20:49:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:49:25.314134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ef2297b4-9586-4e7d-a948-a692c0505885 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:25.338233 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ef2297b4-9586-4e7d-a948-a692c0505885 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/768692536" status: 202 len: 0 microversion: 2.1 time: 0.034986 Sep 10 20:49:25.339462 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 150/341] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:49:25 2022] DELETE /compute/v2.1/flavors/768692536 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:49:25.345317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:25.348328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:25.355050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:25.355750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:25.356294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:25.357553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:25.358126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:25.358776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:25.367209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:25.375969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:25.377698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:25.386588 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-905c37e5-4680-4da1-99e2-e5c1efc9a89c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1362 microversion: 2.75 time: 0.183144 Sep 10 20:49:25.387768 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 192/342] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:25 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:25.392429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-794485f0-79f3-438c-a248-ac613f71c03a tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:25.417277 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-794485f0-79f3-438c-a248-ac613f71c03a tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.028155 Sep 10 20:49:25.418485 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 193/343] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:49:25 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:25.439513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-50c85946-3158-498a-8afa-d1e3a910a5fb tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1048827207", "id": 1863071318, "os-flavor-access:is_public": "False"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:25.453472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'flavor' on Instance uuid 71e5c032-830c-485e-95db-6ce8a67b1872 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:25.461391 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-50c85946-3158-498a-8afa-d1e3a910a5fb tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.025589 Sep 10 20:49:25.463235 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 194/344] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:49:25 2022] POST /compute/v2.1/flavors => generated 439 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:25.477264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Going to try to live migrate instance to nch1-master-1 {{(pid=145772) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 20:49:25.478679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-554c5d20-5568-48b4-9bc9-52004ec24b66 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5fe10f8794e44897a983f3164f81e0bf"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:25.732732 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-554c5d20-5568-48b4-9bc9-52004ec24b66 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] HTTP exception thrown: Flavor access not found for 24 / 5fe10f8794e44897a983f3164f81e0bf combination. Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-554c5d20-5568-48b4-9bc9-52004ec24b66 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Request method failure captured: Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/flavors/1863071318/action HTTP/1.1 Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 70 Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhNs5Ih-OxQO5TceLelvi9Tq46FWgykeiYtyUKbKbi7G3yXkLJ-kONK4GurGEwx7UxuCLj5h7eDQIvMKFlcVa4cS7deSg1jO5F57rBBrm8gSI0pmYcAfRjvjQjhzk-iIS4sjPPild03oDT9LKwk975Pf0xxPUNfupgfW5isTjWn394 Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 55523014277a49d4b3f455ac5f7becf8 Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2055522332 Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:25.739398 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/55523014277a49d4b3f455ac5f7becf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/55523014277a49d4b3f455ac5f7becf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_55523014277a49d4b3f455ac5f7becf8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/55523014277a49d4b3f455ac5f7becf8"}]}] Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2055522332 Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 55523014277a49d4b3f455ac5f7becf8 Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2055522332 Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 224d1f0c976e45018d6c24c6d4e6744c Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: {"removeTenantAccess": {"tenant": "5fe10f8794e44897a983f3164f81e0bf"}} Sep 10 20:49:25.740633 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: exception: Flavor access not found for 24 / 5fe10f8794e44897a983f3164f81e0bf combination. Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '1863071318', 'body': {'removeTenantAccess': {'tenant': '5fe10f8794e44897a983f3164f81e0bf'}}} Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 10 20:49:25.741318 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 24 / 5fe10f8794e44897a983f3164f81e0bf combination. Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 24 / 5fe10f8794e44897a983f3164f81e0bf combination. Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:25.742326 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:25.743393 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:25.743393 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:25.743393 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:25.743393 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:25.743393 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 24 / 5fe10f8794e44897a983f3164f81e0bf combination. Sep 10 20:49:25.743393 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:25.744967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-554c5d20-5568-48b4-9bc9-52004ec24b66 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Returning 404 to user: Flavor access not found for 24 / 5fe10f8794e44897a983f3164f81e0bf combination. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:25.748310 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-554c5d20-5568-48b4-9bc9-52004ec24b66 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1863071318/action" status: 404 len: 124 microversion: 2.1 time: 0.276087 Sep 10 20:49:25.749946 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 195/345] 10.222.0.33 () {60 vars in 1200 bytes} [Sat Sep 10 20:49:25 2022] POST /compute/v2.1/flavors/1863071318/action => generated 124 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:49:25.759362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8d751a37-2de7-4359-a044-0c43d471dc7e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:25.759982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8d751a37-2de7-4359-a044-0c43d471dc7e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:25.766277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d751a37-2de7-4359-a044-0c43d471dc7e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:25.766819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d751a37-2de7-4359-a044-0c43d471dc7e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:25.767261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d751a37-2de7-4359-a044-0c43d471dc7e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:25.768033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d751a37-2de7-4359-a044-0c43d471dc7e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:25.768555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d751a37-2de7-4359-a044-0c43d471dc7e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:25.769025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d751a37-2de7-4359-a044-0c43d471dc7e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:25.932651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8d751a37-2de7-4359-a044-0c43d471dc7e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:25.941503 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8d751a37-2de7-4359-a044-0c43d471dc7e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1320 microversion: 2.1 time: 0.190051 Sep 10 20:49:25.943069 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 196/346] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:25 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1320 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:25.949447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-13d1d5ae-48dc-4157-a21e-5bec4c7916f4 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:25.987383 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-13d1d5ae-48dc-4157-a21e-5bec4c7916f4 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1863071318" status: 202 len: 0 microversion: 2.1 time: 0.042393 Sep 10 20:49:25.992951 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 197/347] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 20:49:25 2022] DELETE /compute/v2.1/flavors/1863071318 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:49:25.999100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d32b97ac-6553-41c0-93ca-abad97684fee tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:25.999807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d32b97ac-6553-41c0-93ca-abad97684fee tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:26.017378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32b97ac-6553-41c0-93ca-abad97684fee tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:26.018166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32b97ac-6553-41c0-93ca-abad97684fee tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:26.019309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32b97ac-6553-41c0-93ca-abad97684fee tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:26.021239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32b97ac-6553-41c0-93ca-abad97684fee tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:26.023113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32b97ac-6553-41c0-93ca-abad97684fee tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:26.023616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32b97ac-6553-41c0-93ca-abad97684fee tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:26.202502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d32b97ac-6553-41c0-93ca-abad97684fee tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:26.212366 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d32b97ac-6553-41c0-93ca-abad97684fee tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1466 microversion: 2.1 time: 0.217998 Sep 10 20:49:26.212952 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 198/348] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:25 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1466 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:26.222490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e9ce4bc9-cdca-4064-9393-903d73760544 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:26.231851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:26.263200 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e9ce4bc9-cdca-4064-9393-903d73760544 tempest-FlavorsAccessNegativeTestJSON-2055522332 tempest-FlavorsAccessNegativeTestJSON-2055522332-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.048403 Sep 10 20:49:26.270653 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 199/349] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:49:26 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:26.418392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:26.419383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:26.427331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:26.428105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:26.428768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:26.429779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:26.430475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:26.431132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:26.511029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:26.520674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:26.522558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:26.528552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-234ed1c8-2665-41db-8142-72fc8d2383df tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1362 microversion: 2.75 time: 0.116391 Sep 10 20:49:26.529347 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 200/350] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:26 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1362 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:49:26.738754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0990cbb6-f95c-4902-affc-3f703d127aca req-102f6dc7-dcb1-4b26-aaa0-da3e68667ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43267b6f-f7b1-4d07-b8a7-74dfc0230123", "name": "network-vif-deleted", "tag": "12bf93d1-569d-4e5b-8031-79e10f749c7a"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:26.760739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0990cbb6-f95c-4902-affc-3f703d127aca req-102f6dc7-dcb1-4b26-aaa0-da3e68667ac5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:26.761229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0990cbb6-f95c-4902-affc-3f703d127aca req-102f6dc7-dcb1-4b26-aaa0-da3e68667ac5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:26.761665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0990cbb6-f95c-4902-affc-3f703d127aca req-102f6dc7-dcb1-4b26-aaa0-da3e68667ac5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:26.802290 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0990cbb6-f95c-4902-affc-3f703d127aca req-102f6dc7-dcb1-4b26-aaa0-da3e68667ac5 service nova] Creating event network-vif-deleted:12bf93d1-569d-4e5b-8031-79e10f749c7a for instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 on nch2-master-1 Sep 10 20:49:26.823978 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0990cbb6-f95c-4902-affc-3f703d127aca req-102f6dc7-dcb1-4b26-aaa0-da3e68667ac5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086847 Sep 10 20:49:26.827069 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 201/351] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:49:26.983532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ef669f5e-0834-43ac-9080-91b02351431e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:26.984909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ef669f5e-0834-43ac-9080-91b02351431e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:26.991906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef669f5e-0834-43ac-9080-91b02351431e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:26.992756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef669f5e-0834-43ac-9080-91b02351431e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:26.993425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef669f5e-0834-43ac-9080-91b02351431e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:26.995223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef669f5e-0834-43ac-9080-91b02351431e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:26.995914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef669f5e-0834-43ac-9080-91b02351431e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:26.996567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef669f5e-0834-43ac-9080-91b02351431e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:27.230799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ef669f5e-0834-43ac-9080-91b02351431e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:27.247249 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ef669f5e-0834-43ac-9080-91b02351431e tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1320 microversion: 2.1 time: 0.277501 Sep 10 20:49:27.248432 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 202/352] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:26 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:27.255699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:27.257673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:27.266682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:27.267572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:27.268856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:27.270523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:27.271223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:27.271899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:27.355193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:27.356915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:27.357655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:27.359795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lazy-loading 'fault' on Instance uuid 43267b6f-f7b1-4d07-b8a7-74dfc0230123 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:27.448534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:27.465350 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-92879956-5a90-4637-87d7-05923266d41c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 200 len: 1309 microversion: 2.1 time: 0.213575 Sep 10 20:49:27.468136 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 203/353] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:27 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 1309 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:27.560587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:27.561855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:27.577504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:27.579133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:27.579808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:27.582812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:27.584023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:27.585741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:27.883462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:27.894990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:27.897725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:27.904023 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b833287f-1bbe-4676-87af-af7416603d62 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1410 microversion: 2.75 time: 0.348852 Sep 10 20:49:27.904879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 204/354] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:27 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1410 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:28.284445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1379e459-23da-4992-912e-851b8a7be247 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:28.285978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1379e459-23da-4992-912e-851b8a7be247 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:28.307550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1379e459-23da-4992-912e-851b8a7be247 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:28.308216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1379e459-23da-4992-912e-851b8a7be247 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:28.308749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1379e459-23da-4992-912e-851b8a7be247 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:28.310678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1379e459-23da-4992-912e-851b8a7be247 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:28.311155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1379e459-23da-4992-912e-851b8a7be247 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:28.311591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1379e459-23da-4992-912e-851b8a7be247 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:28.824608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1379e459-23da-4992-912e-851b8a7be247 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:28.832486 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1379e459-23da-4992-912e-851b8a7be247 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1320 microversion: 2.1 time: 0.553158 Sep 10 20:49:28.833057 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 205/355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:28 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1320 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:29.033704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19d22f1a-1330-4c4e-a4ea-6b8b8eacdb87 tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338 tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:29.037896 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-19d22f1a-1330-4c4e-a4ea-6b8b8eacdb87 tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338 tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19d22f1a-1330-4c4e-a4ea-6b8b8eacdb87 tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338 tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338-project-admin] Request method failure captured: Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhYcWggO_pDDhfq2kjed3EcXm6FbaMt4zN9mtHcnmi2_9Gyj4SZAdUeXPUt8SGFa4tD_1fw-kGWNpJGw9UeQtRqBTT5BxAeIi-bgq5de1-F6Hw88T8dyHswfrX9KeqQFwh-sSJeCnkC6OVOt3V3GkIJhIYX5rBOmIGPNk0c0OP147Q Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 17323cb776504d8a95ca8e8e4cc0c027 Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338 Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:49:29.047066 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17323cb776504d8a95ca8e8e4cc0c027"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17323cb776504d8a95ca8e8e4cc0c027"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17323cb776504d8a95ca8e8e4cc0c027", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17323cb776504d8a95ca8e8e4cc0c027"}]}] Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338 Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 17323cb776504d8a95ca8e8e4cc0c027 Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338 Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338-project-admin Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: c48a6852b33241abb96d0d1eef56ab01 Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338-project-admin Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:29.048317 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid timestamp for date invalid_time Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'invalid_time'} Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:29.049081 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 10 20:49:29.051404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.056423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19d22f1a-1330-4c4e-a4ea-6b8b8eacdb87 tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338 tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:29.057557 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-19d22f1a-1330-4c4e-a4ea-6b8b8eacdb87 tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338 tempest-InstanceUsageAuditLogNegativeTestJSON-1457753338-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.223480 Sep 10 20:49:29.059880 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 206/356] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Sep 10 20:49:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 226 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:49:29.079956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:29.080558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 43267b6f-f7b1-4d07-b8a7-74dfc0230123] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:29.102392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.102939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.103389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.110847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.111407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.111873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.130707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:29.149652 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b8c3ed11-b0fc-4486-bc1b-92321026ca62 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872/action" status: 202 len: 0 microversion: 2.25 time: 3.808617 Sep 10 20:49:29.150631 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 151/357] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:49:25 2022] POST /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872/action => generated 0 bytes in 3811 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:49:29.152634 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] HTTP exception thrown: Instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 could not be found. Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Request method failure captured: Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 HTTP/1.1 Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgPZOlU8qWkDuxoipyx6qqVvNjEZTo6rfj4hzJthWVd2XFC6b814U5YtOZGfirwERzuSFG_8OjTrrbVBRET0K03kBB6ud-sj5_hvvac4PN_uaDaW2QLHZFfj45FLZTD0_mHxfLwmW7tVn5FO4NChS46Vmm6g3YQfzHYRyiTVqNQIbM Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 35ef1b5d5dba4e3c93d8bb622ff79c5e Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-LiveMigrationNegativeTest-1703926881 Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:29.154933 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/35ef1b5d5dba4e3c93d8bb622ff79c5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/35ef1b5d5dba4e3c93d8bb622ff79c5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_35ef1b5d5dba4e3c93d8bb622ff79c5e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/35ef1b5d5dba4e3c93d8bb622ff79c5e"}]}] Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-LiveMigrationNegativeTest-1703926881 Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 35ef1b5d5dba4e3c93d8bb622ff79c5e Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1703926881 Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-LiveMigrationNegativeTest-1703926881-project Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5aab292e925940568e9e5db8b6910f45 Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-LiveMigrationNegativeTest-1703926881-project Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 could not be found. Sep 10 20:49:29.156382 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '43267b6f-f7b1-4d07-b8a7-74dfc0230123'} Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 could not be found. Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:29.157237 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 could not be found. Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 could not be found. Sep 10 20:49:29.159267 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.160903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Returning 404 to user: Instance 43267b6f-f7b1-4d07-b8a7-74dfc0230123 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:29.160903 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-14566771-4611-41e1-ac22-3047f747f1a4 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123" status: 404 len: 111 microversion: 2.1 time: 0.094383 Sep 10 20:49:29.160903 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 207/358] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:29 2022] GET /compute/v2.1/servers/43267b6f-f7b1-4d07-b8a7-74dfc0230123 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:29.163870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:29.167073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:29.180710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.185167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.185847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.187196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.187196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.192030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.341325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:29.353415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:29.355407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:29.360901 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c7d4d17-dcbc-480e-a7c7-19db753bd275 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1416 microversion: 2.75 time: 0.205931 Sep 10 20:49:29.375108 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 152/359] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:29 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1416 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:29.390580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:29.391474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:29.400122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.400785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.401892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.402920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.403736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.404329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.434864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a8194f6-ce34-4e8c-b26e-0b40bc6d08e1 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:29.442293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7a8194f6-ce34-4e8c-b26e-0b40bc6d08e1 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'b38cb38ebf554156bac4eba0ad92ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b0e78e2b4c4d179016abee029d4f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a8194f6-ce34-4e8c-b26e-0b40bc6d08e1 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project] Request method failure captured: Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhWcb72hHdCWnLaHIQppSEyDoLDMtUjZWELSNPgUmb4lNANEwNu7lMOfHbmrNqQyjgQ5uXXnU-ewcSJaw8TRfNAMFrEk-H0DNI_CbKeKioMkS7mOMm-n0e10RQa9bBizAYOWnY1zq5lA9bgKq1YJfj1WoDvf2MQLk3QfXQ_iLcuBG8 Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 47b0e78e2b4c4d179016abee029d4f57 Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:49:29.454291 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:49:29.456015 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47b0e78e2b4c4d179016abee029d4f57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47b0e78e2b4c4d179016abee029d4f57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_47b0e78e2b4c4d179016abee029d4f57", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/47b0e78e2b4c4d179016abee029d4f57"}]}] Sep 10 20:49:29.456015 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 Sep 10 20:49:29.456015 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 47b0e78e2b4c4d179016abee029d4f57 Sep 10 20:49:29.456015 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 Sep 10 20:49:29.456015 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project Sep 10 20:49:29.456015 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:49:29.456015 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:49:29.456015 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: b38cb38ebf554156bac4eba0ad92ab95 Sep 10 20:49:29.456015 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project Sep 10 20:49:29.456015 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: action_args: {} Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:29.456683 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 10 20:49:29.457991 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.461164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a8194f6-ce34-4e8c-b26e-0b40bc6d08e1 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:29.464130 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7a8194f6-ce34-4e8c-b26e-0b40bc6d08e1 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.303193 Sep 10 20:49:29.468811 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 208/360] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Sep 10 20:49:29 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 308 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:29.500753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b64ee4aa-626f-4206-b89a-8c5986be7d8e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:29.501845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b64ee4aa-626f-4206-b89a-8c5986be7d8e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:29.524753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b64ee4aa-626f-4206-b89a-8c5986be7d8e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.524753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b64ee4aa-626f-4206-b89a-8c5986be7d8e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.524753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b64ee4aa-626f-4206-b89a-8c5986be7d8e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.529203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b64ee4aa-626f-4206-b89a-8c5986be7d8e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.532667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b64ee4aa-626f-4206-b89a-8c5986be7d8e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.534088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b64ee4aa-626f-4206-b89a-8c5986be7d8e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.600353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b64ee4aa-626f-4206-b89a-8c5986be7d8e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:49:29.691615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:29.705903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:29.707645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:29.708792 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d9b61ad1-f43f-4096-a8f8-69ba15b3bccf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 0.332451 Sep 10 20:49:29.712935 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 153/361] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:29 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:29.736452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9565253-b15d-4353-8b8f-9d8c6f2e2ace tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:29.738734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f9565253-b15d-4353-8b8f-9d8c6f2e2ace tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'b38cb38ebf554156bac4eba0ad92ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b0e78e2b4c4d179016abee029d4f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9565253-b15d-4353-8b8f-9d8c6f2e2ace tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project] Request method failure captured: Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10%2020:49:29 HTTP/1.1 Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhWcb72hHdCWnLaHIQppSEyDoLDMtUjZWELSNPgUmb4lNANEwNu7lMOfHbmrNqQyjgQ5uXXnU-ewcSJaw8TRfNAMFrEk-H0DNI_CbKeKioMkS7mOMm-n0e10RQa9bBizAYOWnY1zq5lA9bgKq1YJfj1WoDvf2MQLk3QfXQ_iLcuBG8 Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 47b0e78e2b4c4d179016abee029d4f57 Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:49:29.741214 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:49:29.742713 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47b0e78e2b4c4d179016abee029d4f57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47b0e78e2b4c4d179016abee029d4f57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_47b0e78e2b4c4d179016abee029d4f57", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/47b0e78e2b4c4d179016abee029d4f57"}]}] Sep 10 20:49:29.742713 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 Sep 10 20:49:29.742713 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 47b0e78e2b4c4d179016abee029d4f57 Sep 10 20:49:29.742713 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 Sep 10 20:49:29.742713 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project Sep 10 20:49:29.742713 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:29.742713 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:29.742713 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: b38cb38ebf554156bac4eba0ad92ab95 Sep 10 20:49:29.742713 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project Sep 10 20:49:29.742713 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2022-09-10 20:49:29'} Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:49:29.743399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 10 20:49:29.744722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:29.746571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9565253-b15d-4353-8b8f-9d8c6f2e2ace tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:29.748007 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f9565253-b15d-4353-8b8f-9d8c6f2e2ace tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966 tempest-InstanceUsageAuditLogNegativeTestJSON-1802768966-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10 20:49:29" status: 403 len: 128 microversion: 2.1 time: 0.020121 Sep 10 20:49:29.749145 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 154/362] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 20:49:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10%2020%3A49%3A29 => generated 128 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:29.759886 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b64ee4aa-626f-4206-b89a-8c5986be7d8e tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 204 len: 0 microversion: 2.1 time: 0.282489 Sep 10 20:49:29.761151 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 209/363] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:49:29 2022] DELETE /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:49:29.775070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-efc47ab5-c890-4779-9d9f-0d4042321ca3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:29.775925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-efc47ab5-c890-4779-9d9f-0d4042321ca3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:29.786413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efc47ab5-c890-4779-9d9f-0d4042321ca3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.786909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efc47ab5-c890-4779-9d9f-0d4042321ca3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.787345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efc47ab5-c890-4779-9d9f-0d4042321ca3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.788426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efc47ab5-c890-4779-9d9f-0d4042321ca3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.789404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efc47ab5-c890-4779-9d9f-0d4042321ca3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.790013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efc47ab5-c890-4779-9d9f-0d4042321ca3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.877802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9bd9afa5-7423-4b54-aec7-9191d0b8f0d7 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:29.882553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9bd9afa5-7423-4b54-aec7-9191d0b8f0d7 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:29.897989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bd9afa5-7423-4b54-aec7-9191d0b8f0d7 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.900288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bd9afa5-7423-4b54-aec7-9191d0b8f0d7 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.901069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bd9afa5-7423-4b54-aec7-9191d0b8f0d7 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:29.906192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bd9afa5-7423-4b54-aec7-9191d0b8f0d7 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:29.906692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bd9afa5-7423-4b54-aec7-9191d0b8f0d7 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:29.907239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bd9afa5-7423-4b54-aec7-9191d0b8f0d7 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:30.123839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-efc47ab5-c890-4779-9d9f-0d4042321ca3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:30.138652 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-efc47ab5-c890-4779-9d9f-0d4042321ca3 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1473 microversion: 2.1 time: 0.372360 Sep 10 20:49:30.140587 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 155/364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:29 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1473 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:30.186185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9bd9afa5-7423-4b54-aec7-9191d0b8f0d7 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:30.198930 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9bd9afa5-7423-4b54-aec7-9191d0b8f0d7 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1320 microversion: 2.1 time: 0.342686 Sep 10 20:49:30.199649 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 210/365] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:29 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1320 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:30.393861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:30.395345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:30.404628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:30.405714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:30.406742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:30.407692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:30.408359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:30.409015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:30.542231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:30.552481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:30.554312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:30.560850 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-31b21495-c08e-46a0-83c9-79c76f4bf85f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1416 microversion: 2.75 time: 0.172377 Sep 10 20:49:30.561771 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 156/366] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:30 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1416 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:30.742497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:30.743199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:30.750414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:30.751042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:30.751839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:30.752646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:30.753199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:30.754564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:30.934995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:30.945029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:30.947186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:30.949711 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-64735342-8024-4d12-9d60-f805411a05ec tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 0.212087 Sep 10 20:49:30.950673 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 211/367] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:30 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:31.168268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b24e5dbd-18a4-4800-8f4d-4d4246a5ab66 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:31.169071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b24e5dbd-18a4-4800-8f4d-4d4246a5ab66 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:31.191195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24e5dbd-18a4-4800-8f4d-4d4246a5ab66 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:31.192244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24e5dbd-18a4-4800-8f4d-4d4246a5ab66 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:31.192812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24e5dbd-18a4-4800-8f4d-4d4246a5ab66 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:31.195579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24e5dbd-18a4-4800-8f4d-4d4246a5ab66 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:31.196087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24e5dbd-18a4-4800-8f4d-4d4246a5ab66 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:31.197072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24e5dbd-18a4-4800-8f4d-4d4246a5ab66 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:31.200605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-598fcf46-adbf-499c-999f-9b036c01763d req-1d6d4a0d-1e8e-4ddc-ac09-3baa22a78b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c591752-6514-4202-a477-4d70ffac9dea", "name": "network-vif-plugged", "status": "completed", "tag": "85975908-75b8-4ec4-b772-fb849da98946"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:31.223038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-598fcf46-adbf-499c-999f-9b036c01763d req-1d6d4a0d-1e8e-4ddc-ac09-3baa22a78b7e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:31.224020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-598fcf46-adbf-499c-999f-9b036c01763d req-1d6d4a0d-1e8e-4ddc-ac09-3baa22a78b7e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:31.225750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-598fcf46-adbf-499c-999f-9b036c01763d req-1d6d4a0d-1e8e-4ddc-ac09-3baa22a78b7e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:31.243174 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-598fcf46-adbf-499c-999f-9b036c01763d req-1d6d4a0d-1e8e-4ddc-ac09-3baa22a78b7e service nova] Creating event network-vif-plugged:85975908-75b8-4ec4-b772-fb849da98946 for instance 9c591752-6514-4202-a477-4d70ffac9dea on nch1-master-1 Sep 10 20:49:31.249188 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-598fcf46-adbf-499c-999f-9b036c01763d req-1d6d4a0d-1e8e-4ddc-ac09-3baa22a78b7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052444 Sep 10 20:49:31.250416 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 212/368] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:49:31.255775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d1dc7d45-4161-4dc8-b66f-2e840db2d043 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:31.257324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d1dc7d45-4161-4dc8-b66f-2e840db2d043 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:31.265167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1dc7d45-4161-4dc8-b66f-2e840db2d043 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:31.265989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1dc7d45-4161-4dc8-b66f-2e840db2d043 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:31.266537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1dc7d45-4161-4dc8-b66f-2e840db2d043 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:31.268276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1dc7d45-4161-4dc8-b66f-2e840db2d043 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:31.269016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1dc7d45-4161-4dc8-b66f-2e840db2d043 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:31.269809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1dc7d45-4161-4dc8-b66f-2e840db2d043 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:31.454997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d1dc7d45-4161-4dc8-b66f-2e840db2d043 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:31.455245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b24e5dbd-18a4-4800-8f4d-4d4246a5ab66 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:31.466380 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b24e5dbd-18a4-4800-8f4d-4d4246a5ab66 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1473 microversion: 2.1 time: 0.304437 Sep 10 20:49:31.466528 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d1dc7d45-4161-4dc8-b66f-2e840db2d043 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1320 microversion: 2.1 time: 0.214643 Sep 10 20:49:31.482574 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 213/369] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:31 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:31.483493 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 157/370] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:31 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1473 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:31.593688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:31.597191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:31.608280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:31.609287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:31.609960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:31.611357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:31.612496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:31.613366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:31.705931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:31.722241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:31.723713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:31.733392 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-773c73d9-d314-461d-adb0-26071a83ac99 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1416 microversion: 2.75 time: 0.146744 Sep 10 20:49:31.734471 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 214/371] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:31 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:31.985494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:31.986477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:31.994135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:31.994967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:31.995878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:31.997079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:31.997707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:31.998446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:32.179966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:32.189498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:32.191225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:32.192381 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-caacca49-aad3-4b9f-a6db-4c483256aa16 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 0.212794 Sep 10 20:49:32.193479 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 158/372] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:31 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:32.495483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-75050012-0322-463d-be26-39c04e446a86 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:32.504238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:32.505580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:32.509957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-75050012-0322-463d-be26-39c04e446a86 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:32.514592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:32.515339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:32.516040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:32.517131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:32.517391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75050012-0322-463d-be26-39c04e446a86 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:32.517853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:32.518251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75050012-0322-463d-be26-39c04e446a86 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:32.518613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:32.519107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75050012-0322-463d-be26-39c04e446a86 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:32.519973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75050012-0322-463d-be26-39c04e446a86 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:32.520733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75050012-0322-463d-be26-39c04e446a86 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:32.521565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75050012-0322-463d-be26-39c04e446a86 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:32.710375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-75050012-0322-463d-be26-39c04e446a86 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:32.718761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:32.723890 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-75050012-0322-463d-be26-39c04e446a86 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1473 microversion: 2.1 time: 0.233879 Sep 10 20:49:32.725525 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 159/373] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:32 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1473 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:32.742140 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1320 microversion: 2.1 time: 0.252149 Sep 10 20:49:32.748865 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 215/374] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:32 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1320 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:32.762318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:32.762933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:32.769054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:32.769447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:32.769903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:32.770786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:32.771571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:32.772210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:32.861375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:32.863868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:32.872089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:32.872982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:32.873852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:32.874022 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ec7dec8-78fc-46c0-b4a0-460f5750ca39 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001265 Sep 10 20:49:32.881975 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 216/375] 10.222.0.33 () {56 vars in 886 bytes} [Sat Sep 10 20:49:32 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Sep 10 20:49:32.882176 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d5310d77-519a-40b0-80f6-e2a6a4c9881d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1416 microversion: 2.75 time: 0.120790 Sep 10 20:49:32.882176 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 160/376] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:32 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1416 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:33.220951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:33.221581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:33.228533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:33.229088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:33.229473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:33.230225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:33.230680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:33.231404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:33.473181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:33.483407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:33.485476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:33.487330 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0aabbfb-781a-41cc-8bc7-e98814575547 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 0.271291 Sep 10 20:49:33.488559 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 217/377] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:33 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:33.749157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e2d2fdc-56eb-4ae1-adff-eac33aa3ba6c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:33.750450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e2d2fdc-56eb-4ae1-adff-eac33aa3ba6c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:33.759481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e2d2fdc-56eb-4ae1-adff-eac33aa3ba6c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:33.759481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e2d2fdc-56eb-4ae1-adff-eac33aa3ba6c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:33.759481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e2d2fdc-56eb-4ae1-adff-eac33aa3ba6c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:33.760121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e2d2fdc-56eb-4ae1-adff-eac33aa3ba6c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:33.761135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e2d2fdc-56eb-4ae1-adff-eac33aa3ba6c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:33.761135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e2d2fdc-56eb-4ae1-adff-eac33aa3ba6c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:33.772644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9df43914-af9d-4fd5-9d9a-dde60ab5ba85 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:33.774624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9df43914-af9d-4fd5-9d9a-dde60ab5ba85 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:33.789510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9df43914-af9d-4fd5-9d9a-dde60ab5ba85 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:33.790820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9df43914-af9d-4fd5-9d9a-dde60ab5ba85 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:33.791517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9df43914-af9d-4fd5-9d9a-dde60ab5ba85 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:33.792459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9df43914-af9d-4fd5-9d9a-dde60ab5ba85 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:33.793209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9df43914-af9d-4fd5-9d9a-dde60ab5ba85 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:33.793886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9df43914-af9d-4fd5-9d9a-dde60ab5ba85 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:33.995023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9df43914-af9d-4fd5-9d9a-dde60ab5ba85 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:34.004074 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9df43914-af9d-4fd5-9d9a-dde60ab5ba85 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1320 microversion: 2.1 time: 0.241241 Sep 10 20:49:34.005272 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 218/378] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:33 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1320 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:34.011786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:34.012667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:34.024812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.025639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:34.026967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:34.028689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.029336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:34.029853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:34.048927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6e2d2fdc-56eb-4ae1-adff-eac33aa3ba6c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:34.057387 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e2d2fdc-56eb-4ae1-adff-eac33aa3ba6c tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1473 microversion: 2.1 time: 0.313028 Sep 10 20:49:34.082002 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 161/379] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:33 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:34.127030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:34.143018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:34.144701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:34.162436 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f3a38ce8-f444-45d7-bb42-cede087b0ce7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1437 microversion: 2.75 time: 0.154818 Sep 10 20:49:34.165277 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 219/380] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:34 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1437 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:34.195379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:34.198885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:34.207232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.207893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:34.208529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:34.210029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.211276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:34.211850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:34.321074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:49:34.321584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:49:34.322371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:49:34.323094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:49:34.323685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:49:34.437998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:34.447973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.448466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:34.448907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:34.449747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.450525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:34.451094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:34.465964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:34.466862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:34.602546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:34.616988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:34.619907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:34.626641 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-141a8e3b-cea4-4730-9dc0-6545e9c00d96 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "POST /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a/action" status: 202 len: 1494 microversion: 2.75 time: 0.437158 Sep 10 20:49:34.628005 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 162/381] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:49:34 2022] POST /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a/action => generated 1494 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 20:49:34.634490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:34.635354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:34.643647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.644877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:34.645968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:34.649094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.650013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:34.650918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:34.705181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1902430721", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": "none"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:34.780939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:49:34.782234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:49:34.783184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:49:34.783906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:49:34.784601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:49:34.795982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.796740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:34.797330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:34.798860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.799836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:34.800444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:34.822979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Getting quotas for project c82fb214ece04574bf521a45ba055bdf. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:49:34.828966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Getting quotas for user 7721fd95d802434d905b50d23eaad9b7 and project c82fb214ece04574bf521a45ba055bdf. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:49:34.843482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:49:34.843722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=10 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:34.847150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:49:34.945396 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-155fa362-e8f3-43bd-bb3e-0f77234c2f4c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.485980 Sep 10 20:49:34.969176 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 220/382] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:49:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 20:49:34.975397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a2d07ce7-f108-46b5-816a-0bbbfe20b2ca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:34.982446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a2d07ce7-f108-46b5-816a-0bbbfe20b2ca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:34.999006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d07ce7-f108-46b5-816a-0bbbfe20b2ca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:34.999906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d07ce7-f108-46b5-816a-0bbbfe20b2ca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:35.000730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d07ce7-f108-46b5-816a-0bbbfe20b2ca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:35.003987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d07ce7-f108-46b5-816a-0bbbfe20b2ca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:35.004908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d07ce7-f108-46b5-816a-0bbbfe20b2ca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:35.005246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:35.005656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d07ce7-f108-46b5-816a-0bbbfe20b2ca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:35.038508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:35.043183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:35.047982 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-afd14f33-e4c6-484b-b7c4-6a2f02b3a78f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 0.416548 Sep 10 20:49:35.047982 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 163/383] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:34 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:35.066379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:35.067524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a2d07ce7-f108-46b5-816a-0bbbfe20b2ca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:49:35.071238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:35.081896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:35.088931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:35.089764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:35.090785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:35.091460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:35.092120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:35.243124 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a2d07ce7-f108-46b5-816a-0bbbfe20b2ca tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "DELETE /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 204 len: 0 microversion: 2.1 time: 0.271165 Sep 10 20:49:35.244631 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 221/384] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:49:34 2022] DELETE /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:49:35.256667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:35.260860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0784509f-48f5-459a-81e6-761b3abc3fce tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:35.263210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0784509f-48f5-459a-81e6-761b3abc3fce tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:35.364783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:35.386779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:35.391507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:35.416740 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4b845a0a-217a-4d43-a0c5-7ce864c83a10 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.367883 Sep 10 20:49:35.417326 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 164/385] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:35 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:35.429094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cf439e84-7ae8-40ec-b250-ddf59e188b51 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:35.437321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cf439e84-7ae8-40ec-b250-ddf59e188b51 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:35.460515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf439e84-7ae8-40ec-b250-ddf59e188b51 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:35.463963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf439e84-7ae8-40ec-b250-ddf59e188b51 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:35.464597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf439e84-7ae8-40ec-b250-ddf59e188b51 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:35.465483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf439e84-7ae8-40ec-b250-ddf59e188b51 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:35.475768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf439e84-7ae8-40ec-b250-ddf59e188b51 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:35.476479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf439e84-7ae8-40ec-b250-ddf59e188b51 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:35.532333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0784509f-48f5-459a-81e6-761b3abc3fce tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:35.540303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0784509f-48f5-459a-81e6-761b3abc3fce tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:35.541762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0784509f-48f5-459a-81e6-761b3abc3fce tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:35.548698 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0784509f-48f5-459a-81e6-761b3abc3fce tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1454 microversion: 2.91 time: 0.302249 Sep 10 20:49:35.549945 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 222/386] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:35 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1454 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:35.579107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be329e8a-700f-43c1-aef4-8d3ab7db4f23 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:35.579752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-be329e8a-700f-43c1-aef4-8d3ab7db4f23 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:35.590568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be329e8a-700f-43c1-aef4-8d3ab7db4f23 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:35.591510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be329e8a-700f-43c1-aef4-8d3ab7db4f23 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:35.592428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be329e8a-700f-43c1-aef4-8d3ab7db4f23 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:35.594274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be329e8a-700f-43c1-aef4-8d3ab7db4f23 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:35.595308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be329e8a-700f-43c1-aef4-8d3ab7db4f23 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:35.595883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be329e8a-700f-43c1-aef4-8d3ab7db4f23 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:35.701630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-be329e8a-700f-43c1-aef4-8d3ab7db4f23 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab292e925940568e9e5db8b6910f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef1b5d5dba4e3c93d8bb622ff79c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:35.711622 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be329e8a-700f-43c1-aef4-8d3ab7db4f23 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 200 len: 1303 microversion: 2.1 time: 0.160168 Sep 10 20:49:35.712999 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 223/387] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:35 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 1303 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:35.718945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-588109113", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "1345878817", "adminPass": "***", "networks": [{"uuid": "5e87cad0-4417-4e0d-9afb-caf4350c61cd"}], "security_groups": [{"name": "tempest-securitygroup--1980315777"}], "key_name": "tempest-keypair-272195699", "user_data": "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:35.874790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] validate_networks() for [('5e87cad0-4417-4e0d-9afb-caf4350c61cd', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:49:36.411937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:49:36.414017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:49:36.414701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:49:36.415264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:49:36.417230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:49:36.435346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:36.436341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:36.436796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:36.438085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:36.438874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:36.439466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:36.471214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Getting quotas for project d44361bde7c94fb6b01d992a8df306bb. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:49:36.479173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Getting quotas for user a020e015186b4c32950c2d4edd26374e and project d44361bde7c94fb6b01d992a8df306bb. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:49:36.501188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:49:36.505650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:49:36.596492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:36.626309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf439e84-7ae8-40ec-b250-ddf59e188b51 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:36.644236 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1fe957f6-c809-4762-8918-7208523c02ee tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.929897 Sep 10 20:49:36.655890 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 224/388] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:49:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:49:36.669225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-6d7f6afe-7d5a-4f73-b2a2-aed88aafd297 req-c5b7891e-8675-4db8-8a8e-c6d41e41cca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc1d5b2-4eff-42cc-a465-634307e9e709", "name": "network-vif-deleted", "tag": "1a068c83-2810-4505-a299-728cb8f0897d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:36.685273 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cf439e84-7ae8-40ec-b250-ddf59e188b51 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1469 microversion: 2.1 time: 1.261337 Sep 10 20:49:36.699309 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 165/389] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:35 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1469 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:36.705176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6d7f6afe-7d5a-4f73-b2a2-aed88aafd297 req-c5b7891e-8675-4db8-8a8e-c6d41e41cca9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:36.706989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6d7f6afe-7d5a-4f73-b2a2-aed88aafd297 req-c5b7891e-8675-4db8-8a8e-c6d41e41cca9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:36.708896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6d7f6afe-7d5a-4f73-b2a2-aed88aafd297 req-c5b7891e-8675-4db8-8a8e-c6d41e41cca9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:36.720351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:36.723776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:36.738162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:36.738891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:36.741288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:36.742506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:36.743913 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-6d7f6afe-7d5a-4f73-b2a2-aed88aafd297 req-c5b7891e-8675-4db8-8a8e-c6d41e41cca9 service nova] Creating event network-vif-deleted:1a068c83-2810-4505-a299-728cb8f0897d for instance 1fc1d5b2-4eff-42cc-a465-634307e9e709 on nch1-master-1 Sep 10 20:49:36.754048 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-6d7f6afe-7d5a-4f73-b2a2-aed88aafd297 req-c5b7891e-8675-4db8-8a8e-c6d41e41cca9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094439 Sep 10 20:49:36.758648 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 225/390] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:36.767991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:36.769048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:36.772385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:36.775588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:36.817742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:36.828227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:36.830013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:36.831492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:36.832613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:36.833206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:37.011679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:37.018918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:37.027916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:37.029368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:37.045774 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6b5a5b90-2ecc-493e-8fc9-73b5ae21aca2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.285856 Sep 10 20:49:37.046728 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 226/391] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:36 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:37.062814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:37.063805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:37.075456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:37.076187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:37.076832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:37.077722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:37.078746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:37.079195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:37.219791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:37.238734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:37.240189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:37.251850 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ba593957-6884-4182-8f4c-fe5f9ddfa626 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1506 microversion: 2.91 time: 0.203957 Sep 10 20:49:37.252635 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 227/392] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:37 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:37.261859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-22c62161-5997-47a4-861e-4ae1a3f55bed tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:37.262723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-22c62161-5997-47a4-861e-4ae1a3f55bed tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:37.351805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-22c62161-5997-47a4-861e-4ae1a3f55bed tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:37.362119 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-22c62161-5997-47a4-861e-4ae1a3f55bed tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1263 microversion: 2.1 time: 0.108118 Sep 10 20:49:37.364983 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 228/393] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:37 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1263 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:37.411232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:37.425961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:37.429147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:37.432640 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-de2a1ce1-fc57-4f76-8e9a-542b66c547c7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 0.731045 Sep 10 20:49:37.435700 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 166/394] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:36 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:37.446593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:37.446736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] [instance: 1fc1d5b2-4eff-42cc-a465-634307e9e709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:37.470230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:37.470899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:37.471258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:37.472040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:37.472664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:37.473109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:37.536887 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] HTTP exception thrown: Instance 1fc1d5b2-4eff-42cc-a465-634307e9e709 could not be found. Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Request method failure captured: Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 HTTP/1.1 Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgPZOlU8qWkDuxoipyx6qqVvNjEZTo6rfj4hzJthWVd2XFC6b814U5YtOZGfirwERzuSFG_8OjTrrbVBRET0K03kBB6ud-sj5_hvvac4PN_uaDaW2QLHZFfj45FLZTD0_mHxfLwmW7tVn5FO4NChS46Vmm6g3YQfzHYRyiTVqNQIbM Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 35ef1b5d5dba4e3c93d8bb622ff79c5e Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-LiveMigrationNegativeTest-1703926881 Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:49:37.547866 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/35ef1b5d5dba4e3c93d8bb622ff79c5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/35ef1b5d5dba4e3c93d8bb622ff79c5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_35ef1b5d5dba4e3c93d8bb622ff79c5e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/35ef1b5d5dba4e3c93d8bb622ff79c5e"}]}] Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-LiveMigrationNegativeTest-1703926881 Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 35ef1b5d5dba4e3c93d8bb622ff79c5e Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1703926881 Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-LiveMigrationNegativeTest-1703926881-project Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5aab292e925940568e9e5db8b6910f45 Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-LiveMigrationNegativeTest-1703926881-project Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 1fc1d5b2-4eff-42cc-a465-634307e9e709 could not be found. Sep 10 20:49:37.549395 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '1fc1d5b2-4eff-42cc-a465-634307e9e709'} Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc1d5b2-4eff-42cc-a465-634307e9e709 could not be found. Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:37.550239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc1d5b2-4eff-42cc-a465-634307e9e709 could not be found. Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc1d5b2-4eff-42cc-a465-634307e9e709 could not be found. Sep 10 20:49:37.551720 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:37.552953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] Returning 404 to user: Instance 1fc1d5b2-4eff-42cc-a465-634307e9e709 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:37.552953 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6d689249-c69f-4537-ab2c-543adc6a0296 tempest-LiveMigrationNegativeTest-1703926881 tempest-LiveMigrationNegativeTest-1703926881-project] 10.222.0.33 "GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709" status: 404 len: 111 microversion: 2.1 time: 0.111409 Sep 10 20:49:37.552953 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 167/395] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:37 2022] GET /compute/v2.1/servers/1fc1d5b2-4eff-42cc-a465-634307e9e709 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:37.839177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-06aeb710-7703-4b0b-a479-a8ad44aa522d tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:37.842444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-06aeb710-7703-4b0b-a479-a8ad44aa522d tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:37.861012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06aeb710-7703-4b0b-a479-a8ad44aa522d tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:37.861796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06aeb710-7703-4b0b-a479-a8ad44aa522d tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:37.866196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06aeb710-7703-4b0b-a479-a8ad44aa522d tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:37.867157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06aeb710-7703-4b0b-a479-a8ad44aa522d tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:37.868303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06aeb710-7703-4b0b-a479-a8ad44aa522d tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:37.870596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06aeb710-7703-4b0b-a479-a8ad44aa522d tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:37.955588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-06aeb710-7703-4b0b-a479-a8ad44aa522d tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:49:38.080902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:38.081526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:38.096712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:38.097334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:38.100744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:38.103911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:38.107346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:38.109734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:38.288394 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-06aeb710-7703-4b0b-a479-a8ad44aa522d tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 204 len: 0 microversion: 2.1 time: 0.920686 Sep 10 20:49:38.289127 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 229/396] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:49:37 2022] DELETE /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 0 bytes in 923 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:49:38.302605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:38.303712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:38.326466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:38.326991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:38.329040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:38.329844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:38.331468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:38.333720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:38.498572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:38.511273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:38.513584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:38.520530 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a009ef9-b115-4b21-8d67-f12057ab62f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1512 microversion: 2.91 time: 0.230238 Sep 10 20:49:38.522583 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 230/397] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:38 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:38.529427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e0cd92e6-6752-4e60-9e9c-593fba265aeb tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:38.530387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e0cd92e6-6752-4e60-9e9c-593fba265aeb tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:38.547711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cd92e6-6752-4e60-9e9c-593fba265aeb tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:38.548757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cd92e6-6752-4e60-9e9c-593fba265aeb tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:38.549444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cd92e6-6752-4e60-9e9c-593fba265aeb tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:38.550497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cd92e6-6752-4e60-9e9c-593fba265aeb tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:38.551668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cd92e6-6752-4e60-9e9c-593fba265aeb tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:38.552351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cd92e6-6752-4e60-9e9c-593fba265aeb tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:38.783439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e0cd92e6-6752-4e60-9e9c-593fba265aeb tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:38.797227 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e0cd92e6-6752-4e60-9e9c-593fba265aeb tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1475 microversion: 2.1 time: 0.269967 Sep 10 20:49:38.798875 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 231/398] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:38 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1475 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:38.823112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c2cf92a-8c6e-4439-83af-26fe910554a4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:38.824242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4c2cf92a-8c6e-4439-83af-26fe910554a4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:38.831997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c2cf92a-8c6e-4439-83af-26fe910554a4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:38.832499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c2cf92a-8c6e-4439-83af-26fe910554a4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:38.832942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c2cf92a-8c6e-4439-83af-26fe910554a4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:38.833727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c2cf92a-8c6e-4439-83af-26fe910554a4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:38.834272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c2cf92a-8c6e-4439-83af-26fe910554a4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:38.834923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c2cf92a-8c6e-4439-83af-26fe910554a4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:38.837344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:38.850883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:38.853013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:38.860398 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d40e7231-d00f-474a-867f-569e5653bec5 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.785237 Sep 10 20:49:38.876627 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 168/399] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:38 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:49:38.902142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:38.904302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:38.916764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:38.917483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:38.918134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:38.919033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:38.919635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:38.920209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:39.024359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4c2cf92a-8c6e-4439-83af-26fe910554a4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:39.054606 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c2cf92a-8c6e-4439-83af-26fe910554a4 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1315 microversion: 2.1 time: 0.240726 Sep 10 20:49:39.071858 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 232/400] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:38 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:39.553814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:39.555123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:39.570363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:39.571249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:39.572148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:39.573245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:39.574253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:39.574953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:39.762626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:39.779580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:39.783197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:39.796867 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b7d58ae0-d9a4-4e01-8b73-8acd679e5bd4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1512 microversion: 2.91 time: 0.248105 Sep 10 20:49:39.799552 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 233/401] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:39 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:49:39.826199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-702624d5-99c3-4eaa-b8a3-8339ecfb5c18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:39.832852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-702624d5-99c3-4eaa-b8a3-8339ecfb5c18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:39.847292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-702624d5-99c3-4eaa-b8a3-8339ecfb5c18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:39.853056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-702624d5-99c3-4eaa-b8a3-8339ecfb5c18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:39.853537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-702624d5-99c3-4eaa-b8a3-8339ecfb5c18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:39.854337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-702624d5-99c3-4eaa-b8a3-8339ecfb5c18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:39.854791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-702624d5-99c3-4eaa-b8a3-8339ecfb5c18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:39.855227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-702624d5-99c3-4eaa-b8a3-8339ecfb5c18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:40.274827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-702624d5-99c3-4eaa-b8a3-8339ecfb5c18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:40.289599 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-702624d5-99c3-4eaa-b8a3-8339ecfb5c18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1475 microversion: 2.1 time: 0.467389 Sep 10 20:49:40.291099 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 234/402] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:39 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1475 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:49:40.313352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:40.316148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:40.324477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:40.325318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:40.325982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:40.327007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:40.329004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:40.329948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:40.487414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:40.503048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:40.506089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:40.509964 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e4cfc7a8-b481-4f12-ae2c-bdb6a8e0d549 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 1.631482 Sep 10 20:49:40.511269 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 169/403] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:38 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:40.518852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d48db9b1-2400-4023-b57c-eda573e29606 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:40.519766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d48db9b1-2400-4023-b57c-eda573e29606 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:40.528153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d48db9b1-2400-4023-b57c-eda573e29606 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:40.529120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d48db9b1-2400-4023-b57c-eda573e29606 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:40.529727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d48db9b1-2400-4023-b57c-eda573e29606 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:40.531327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d48db9b1-2400-4023-b57c-eda573e29606 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:40.532055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d48db9b1-2400-4023-b57c-eda573e29606 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:40.533299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d48db9b1-2400-4023-b57c-eda573e29606 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:40.693945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:40.704848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:40.706557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:40.715284 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0b2d79c7-4fbb-4a2f-ad25-2a179c32e6d9 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.422398 Sep 10 20:49:40.716656 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 235/404] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:40 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:40.722581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-22aa1ee7-e485-443c-b0be-b1772399c724 req-8705d3f2-f0ba-4e65-b08f-5d9e7a3227ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e5c032-830c-485e-95db-6ce8a67b1872", "name": "network-vif-unplugged", "status": "completed", "tag": "77555f73-bd32-4402-a6df-d676567f9a43"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:40.733571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d48db9b1-2400-4023-b57c-eda573e29606 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:40.742221 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d48db9b1-2400-4023-b57c-eda573e29606 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1321 microversion: 2.1 time: 0.228885 Sep 10 20:49:40.746563 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 170/405] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:40 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:40.749334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-22aa1ee7-e485-443c-b0be-b1772399c724 req-8705d3f2-f0ba-4e65-b08f-5d9e7a3227ee service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:40.749935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-22aa1ee7-e485-443c-b0be-b1772399c724 req-8705d3f2-f0ba-4e65-b08f-5d9e7a3227ee service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:40.750568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-22aa1ee7-e485-443c-b0be-b1772399c724 req-8705d3f2-f0ba-4e65-b08f-5d9e7a3227ee service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:40.767131 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-22aa1ee7-e485-443c-b0be-b1772399c724 req-8705d3f2-f0ba-4e65-b08f-5d9e7a3227ee service nova] Creating event network-vif-unplugged:77555f73-bd32-4402-a6df-d676567f9a43 for instance 71e5c032-830c-485e-95db-6ce8a67b1872 on nch2-master-1 Sep 10 20:49:40.773732 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-22aa1ee7-e485-443c-b0be-b1772399c724 req-8705d3f2-f0ba-4e65-b08f-5d9e7a3227ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055291 Sep 10 20:49:40.774382 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 236/406] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:40.831757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:40.832471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:40.842765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:40.843827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:40.845271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:40.846560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:40.848138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:40.848834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:41.021346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:41.031606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:41.038482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:41.049846 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4b56bd59-4cab-4b70-8401-228de27e2c34 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1533 microversion: 2.91 time: 0.224801 Sep 10 20:49:41.066847 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 171/407] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:40 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1533 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:41.299749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-62e2bd95-e64a-47a4-9739-978860d7d859 req-03c5852d-9969-46fd-ae15-1b81e98d091b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c591752-6514-4202-a477-4d70ffac9dea", "name": "network-vif-deleted", "tag": "85975908-75b8-4ec4-b772-fb849da98946"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:41.332929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-62e2bd95-e64a-47a4-9739-978860d7d859 req-03c5852d-9969-46fd-ae15-1b81e98d091b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:41.347131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-62e2bd95-e64a-47a4-9739-978860d7d859 req-03c5852d-9969-46fd-ae15-1b81e98d091b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:41.348129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-62e2bd95-e64a-47a4-9739-978860d7d859 req-03c5852d-9969-46fd-ae15-1b81e98d091b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:41.378736 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-62e2bd95-e64a-47a4-9739-978860d7d859 req-03c5852d-9969-46fd-ae15-1b81e98d091b service nova] Creating event network-vif-deleted:85975908-75b8-4ec4-b772-fb849da98946 for instance 9c591752-6514-4202-a477-4d70ffac9dea on nch1-master-1 Sep 10 20:49:41.395367 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-62e2bd95-e64a-47a4-9739-978860d7d859 req-03c5852d-9969-46fd-ae15-1b81e98d091b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099354 Sep 10 20:49:41.399083 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 172/408] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:49:41.413604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:41.416161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:41.433102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:41.436052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:41.436517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:41.437264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:41.437735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:41.439426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:41.548099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:41.549228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:41.549850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:41.550505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lazy-loading 'fault' on Instance uuid 9c591752-6514-4202-a477-4d70ffac9dea {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:41.783509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1bab154f-6bf3-4d9a-ad13-3fc4c62e7453 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:41.784944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1bab154f-6bf3-4d9a-ad13-3fc4c62e7453 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:41.798441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bab154f-6bf3-4d9a-ad13-3fc4c62e7453 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:41.801531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bab154f-6bf3-4d9a-ad13-3fc4c62e7453 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:41.802336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bab154f-6bf3-4d9a-ad13-3fc4c62e7453 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:41.805985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bab154f-6bf3-4d9a-ad13-3fc4c62e7453 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:41.808149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bab154f-6bf3-4d9a-ad13-3fc4c62e7453 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:41.808803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bab154f-6bf3-4d9a-ad13-3fc4c62e7453 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:41.882149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:41.929055 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-571e8a40-8605-4b9b-839f-a8096491bb99 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 200 len: 1310 microversion: 2.1 time: 0.521004 Sep 10 20:49:41.930202 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 173/409] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:41 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 1310 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:41.935284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:41.935889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:41.953289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:41.954445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:41.955133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:41.956056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:41.957418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:41.958166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:42.068006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-1bab154f-6bf3-4d9a-ad13-3fc4c62e7453 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lazy-loading 'services' on Instance uuid 72673474-4355-4d59-a448-2bf591428ba0 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:42.114965 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1bab154f-6bf3-4d9a-ad13-3fc4c62e7453 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1938 microversion: 2.91 time: 1.033697 Sep 10 20:49:42.119871 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 237/410] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:41 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1938 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:42.131649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:42.133785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:42.154759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:42.155291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:42.158016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:42.158801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:42.159885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:42.161666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:42.316668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:42.333370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:42.339601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:42.358369 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-433eabfc-c736-404c-9edc-3ace4eba6a5e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.232086 Sep 10 20:49:42.388317 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 238/411] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:42 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:42.400498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-de8e4650-8e3f-4fed-ba66-2afd8c26a49b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:42.401635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-de8e4650-8e3f-4fed-ba66-2afd8c26a49b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:42.427038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de8e4650-8e3f-4fed-ba66-2afd8c26a49b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:42.428514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de8e4650-8e3f-4fed-ba66-2afd8c26a49b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:42.440601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de8e4650-8e3f-4fed-ba66-2afd8c26a49b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:42.441682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de8e4650-8e3f-4fed-ba66-2afd8c26a49b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:42.442598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de8e4650-8e3f-4fed-ba66-2afd8c26a49b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:42.447897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de8e4650-8e3f-4fed-ba66-2afd8c26a49b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:42.624503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-de8e4650-8e3f-4fed-ba66-2afd8c26a49b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:42.640584 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-de8e4650-8e3f-4fed-ba66-2afd8c26a49b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1321 microversion: 2.1 time: 0.250107 Sep 10 20:49:42.641812 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 239/412] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:42 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:42.661288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f828715d-c797-438f-81ec-da1d6987316a tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:42.662843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f828715d-c797-438f-81ec-da1d6987316a tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:42.698223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f828715d-c797-438f-81ec-da1d6987316a tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:42.703206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f828715d-c797-438f-81ec-da1d6987316a tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:42.704102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f828715d-c797-438f-81ec-da1d6987316a tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:42.707905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f828715d-c797-438f-81ec-da1d6987316a tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:42.711743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f828715d-c797-438f-81ec-da1d6987316a tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:42.712488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f828715d-c797-438f-81ec-da1d6987316a tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:42.921111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:42.929712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:42.937183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:42.938630 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-11321ab6-724d-4b1d-a3fd-f9c89f49d142 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 1.007346 Sep 10 20:49:42.954638 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 174/413] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:41 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:42.980742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-af8b6ab9-40e8-402c-8f52-8fe0cd74dfed req-d0eb33be-7ae0-4406-8b46-a95c5c110829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e5c032-830c-485e-95db-6ce8a67b1872", "tag": "77555f73-bd32-4402-a6df-d676567f9a43"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:43.006482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:43.008061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-af8b6ab9-40e8-402c-8f52-8fe0cd74dfed req-d0eb33be-7ae0-4406-8b46-a95c5c110829 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.008542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-af8b6ab9-40e8-402c-8f52-8fe0cd74dfed req-d0eb33be-7ae0-4406-8b46-a95c5c110829 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.008983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-af8b6ab9-40e8-402c-8f52-8fe0cd74dfed req-d0eb33be-7ae0-4406-8b46-a95c5c110829 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:43.023255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-f828715d-c797-438f-81ec-da1d6987316a tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lazy-loading 'services' on Instance uuid 72673474-4355-4d59-a448-2bf591428ba0 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:43.064361 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f828715d-c797-438f-81ec-da1d6987316a tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1938 microversion: 2.91 time: 0.410718 Sep 10 20:49:43.065370 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-af8b6ab9-40e8-402c-8f52-8fe0cd74dfed req-d0eb33be-7ae0-4406-8b46-a95c5c110829 service nova] Creating event network-changed:77555f73-bd32-4402-a6df-d676567f9a43 for instance 71e5c032-830c-485e-95db-6ce8a67b1872 on nch2-master-1 Sep 10 20:49:43.075146 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-af8b6ab9-40e8-402c-8f52-8fe0cd74dfed req-d0eb33be-7ae0-4406-8b46-a95c5c110829 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102713 Sep 10 20:49:43.076013 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 175/414] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:43.078322 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 240/415] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:42 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1938 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:43.086257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:43.086707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:43.093659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-56776568-3548-4d95-95e6-169e3449e764 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:43.098597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56776568-3548-4d95-95e6-169e3449e764 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.100362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56776568-3548-4d95-95e6-169e3449e764 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.100979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56776568-3548-4d95-95e6-169e3449e764 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:43.101963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56776568-3548-4d95-95e6-169e3449e764 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.102581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56776568-3548-4d95-95e6-169e3449e764 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.103687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56776568-3548-4d95-95e6-169e3449e764 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:43.109351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.109902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.110365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:43.111090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.113959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.114447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:43.149604 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] HTTP exception thrown: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Request method failure captured: Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea HTTP/1.1 Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhHzlOi0BL4O9dIUGz8AnCUPMBn0htSEmSX97ioJkiiYdx0tBpg1yvaIiPH62ENa6HndWeuqlBtEu8kaL2U2DfVOl5yABKACwfqbk444NCFsvsvWvw-CxsaQP2ASCknhkxunY5oStb_3ofport7ekw0w_fPACL0tGDQaiOYXxdvZIE Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:49:43.156186 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cc9f18c8fd44fca98cda3832b60b26d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cc9f18c8fd44fca98cda3832b60b26d"}]}] Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 365336e9f59e4b65ae0a05554776b0ff Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:49:43.157459 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '9c591752-6514-4202-a477-4d70ffac9dea'} Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:49:43.158475 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:49:43.159700 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:49:43.160746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Returning 404 to user: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:49:43.160746 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4a598605-33ee-4ae6-9efb-49ea3d3df1c6 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 404 len: 111 microversion: 2.1 time: 0.079568 Sep 10 20:49:43.162735 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-56776568-3548-4d95-95e6-169e3449e764 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.072120 Sep 10 20:49:43.171021 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 176/416] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:43 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:49:43.172486 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 241/417] 10.222.0.33 () {60 vars in 1217 bytes} [Sat Sep 10 20:49:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:49:43.184101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-750826b8-ab36-429a-a183-67eea15b9b3d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:43.184601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-750826b8-ab36-429a-a183-67eea15b9b3d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:43.229242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-750826b8-ab36-429a-a183-67eea15b9b3d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.241271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-750826b8-ab36-429a-a183-67eea15b9b3d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.242539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-750826b8-ab36-429a-a183-67eea15b9b3d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:43.244991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-750826b8-ab36-429a-a183-67eea15b9b3d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.247113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-750826b8-ab36-429a-a183-67eea15b9b3d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.250069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-750826b8-ab36-429a-a183-67eea15b9b3d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:43.292479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:43.328050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-750826b8-ab36-429a-a183-67eea15b9b3d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lazy-loading 'flavor' on Instance uuid 72673474-4355-4d59-a448-2bf591428ba0 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:43.399018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:43.400005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:43.412492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.413569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.414466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:43.415437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.416132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.418444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:43.805867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:43.822438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:43.834848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:43.851976 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27d70316-aa44-48f6-b1d2-f45aabe5463a tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.456904 Sep 10 20:49:43.853211 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 242/418] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:43 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:43.858330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-959424342", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:43.905162 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-750826b8-ab36-429a-a183-67eea15b9b3d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "POST /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0/action" status: 202 len: 0 microversion: 2.91 time: 0.723431 Sep 10 20:49:43.907595 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 177/419] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:49:43 2022] POST /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:49:43.948908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-926f0a53-d0f2-4c2c-b9ea-3dc9f0d66753 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:43.956195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-926f0a53-d0f2-4c2c-b9ea-3dc9f0d66753 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:43.990247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-926f0a53-d0f2-4c2c-b9ea-3dc9f0d66753 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.991404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-926f0a53-d0f2-4c2c-b9ea-3dc9f0d66753 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.992314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-926f0a53-d0f2-4c2c-b9ea-3dc9f0d66753 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:43.993238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-926f0a53-d0f2-4c2c-b9ea-3dc9f0d66753 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:43.998477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-926f0a53-d0f2-4c2c-b9ea-3dc9f0d66753 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:43.999120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-926f0a53-d0f2-4c2c-b9ea-3dc9f0d66753 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:44.035072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:49:44.614268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-926f0a53-d0f2-4c2c-b9ea-3dc9f0d66753 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:44.627962 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-926f0a53-d0f2-4c2c-b9ea-3dc9f0d66753 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1389 microversion: 2.1 time: 0.718339 Sep 10 20:49:44.630675 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 178/420] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:43 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1389 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:44.652885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:44.654004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:44.662862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:44.663763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:44.664398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:44.665490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:44.666171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:44.666894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:44.953004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:44.973801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:44.976411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:44.988965 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f7d9e713-5eff-49a5-80f1-66e4e89b1145 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.356951 Sep 10 20:49:45.006727 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 179/421] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:44 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:45.015881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:45.016907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:45.024580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:45.025467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:45.026166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:45.027110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:45.027778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:45.028422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:45.384490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:45.394737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:45.398755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:45.404796 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bcc0afa2-2b55-44d0-b4a2-0fc507d543fe tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 0.396677 Sep 10 20:49:45.406488 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 180/422] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:45 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:45.484040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:49:45.484970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:49:45.485532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:49:45.486910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:49:45.487994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:49:45.515327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:45.516387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:45.517086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:45.519290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:45.522242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:45.523893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:45.570590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Getting quotas for project 5cc9f18c8fd44fca98cda3832b60b26d. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:49:45.585523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Getting quotas for user 365336e9f59e4b65ae0a05554776b0ff and project 5cc9f18c8fd44fca98cda3832b60b26d. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:49:45.625848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:49:45.635702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:49:45.701978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-733319301", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:45.761101 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-63fd11e2-2bcc-4e39-ac8c-39db4776b05b tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.906533 Sep 10 20:49:45.765695 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 243/423] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:49:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:49:45.778657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:45.783408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:45.794732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:45.803863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:45.804588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:45.807232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:45.807722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:45.808161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:45.823026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:49:45.829365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:46.386073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:46.406331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:46.408295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:46.444060 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-95479548-117b-4528-be70-2cd932356b51 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.673438 Sep 10 20:49:46.469001 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 244/424] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:45 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:46.493223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d77f064c-a10f-4713-95d5-3ecb6fd1405b req-3b5dfc54-bd8b-4293-99b1-3e9cad83ca14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023ec8d2-8599-46cf-9dd4-3242411b0762", "name": "network-vif-deleted", "tag": "76e5ab12-5706-4c92-bcb5-368b6a237537"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:46.523496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d77f064c-a10f-4713-95d5-3ecb6fd1405b req-3b5dfc54-bd8b-4293-99b1-3e9cad83ca14 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:46.524685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d77f064c-a10f-4713-95d5-3ecb6fd1405b req-3b5dfc54-bd8b-4293-99b1-3e9cad83ca14 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:46.525140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d77f064c-a10f-4713-95d5-3ecb6fd1405b req-3b5dfc54-bd8b-4293-99b1-3e9cad83ca14 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:46.572781 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d77f064c-a10f-4713-95d5-3ecb6fd1405b req-3b5dfc54-bd8b-4293-99b1-3e9cad83ca14 service nova] Creating event network-vif-deleted:76e5ab12-5706-4c92-bcb5-368b6a237537 for instance 023ec8d2-8599-46cf-9dd4-3242411b0762 on nch2-master-1 Sep 10 20:49:46.587264 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d77f064c-a10f-4713-95d5-3ecb6fd1405b req-3b5dfc54-bd8b-4293-99b1-3e9cad83ca14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114032 Sep 10 20:49:46.594049 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 245/425] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:46.612184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-658ad933-b6f4-4369-965c-71537e95979e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:46.620290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-658ad933-b6f4-4369-965c-71537e95979e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:46.634519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-658ad933-b6f4-4369-965c-71537e95979e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:46.635022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-658ad933-b6f4-4369-965c-71537e95979e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:46.635470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-658ad933-b6f4-4369-965c-71537e95979e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:46.636198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-658ad933-b6f4-4369-965c-71537e95979e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:46.636659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-658ad933-b6f4-4369-965c-71537e95979e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:46.637089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-658ad933-b6f4-4369-965c-71537e95979e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:46.942239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-658ad933-b6f4-4369-965c-71537e95979e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:46.964846 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-658ad933-b6f4-4369-965c-71537e95979e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1389 microversion: 2.1 time: 0.369375 Sep 10 20:49:47.002845 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 246/426] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:46 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1389 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:47.019667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a397ef7-6b2d-4358-aac5-04f2c7028518 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:47.023366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7a397ef7-6b2d-4358-aac5-04f2c7028518 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:47.040023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a397ef7-6b2d-4358-aac5-04f2c7028518 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:47.041322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a397ef7-6b2d-4358-aac5-04f2c7028518 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:47.043731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a397ef7-6b2d-4358-aac5-04f2c7028518 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:47.044604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a397ef7-6b2d-4358-aac5-04f2c7028518 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:47.047968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a397ef7-6b2d-4358-aac5-04f2c7028518 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:47.048400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a397ef7-6b2d-4358-aac5-04f2c7028518 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:47.164389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7a397ef7-6b2d-4358-aac5-04f2c7028518 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:47.176841 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7a397ef7-6b2d-4358-aac5-04f2c7028518 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1215 microversion: 2.1 time: 0.172405 Sep 10 20:49:47.177445 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 247/427] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:47 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:47.189915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:47.190544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:47.206178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:47.206996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:47.207446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:47.208168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:47.208625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:47.209667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:47.338932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:47.353855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:47.359632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:47.373560 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f64e31e5-7726-4dcc-8920-1d606f49ec55 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.193449 Sep 10 20:49:47.385688 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 248/428] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:47 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:47.386239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:47.387172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:47.399306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:47.399797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:47.401291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:47.403111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:47.403878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:47.405454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:47.511162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:49:47.513818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:49:47.517869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:49:47.518449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:49:47.520013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:49:47.593005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:47.593681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:47.594421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:47.595673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:47.597936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:47.599245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:47.658857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Getting quotas for project 5580128bff364c858eafedcc84dad425. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:49:47.675123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Getting quotas for user cbabc9a296d14628b649da7d81bc8766 and project 5580128bff364c858eafedcc84dad425. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:49:47.738730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:49:47.750134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:49:47.805280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:47.830957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:47.838956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:47.848293 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-960d5f80-a111-41ee-be84-0ce8c1dc73cf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 0.471994 Sep 10 20:49:47.852296 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 249/429] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:47 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:47.866339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:47.866339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:47.869453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:47.870495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:47.872218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:47.873219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:47.873899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:47.874496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:47.888204 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9229eac0-8743-427a-bf7c-554714dbb287 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.480234 Sep 10 20:49:47.893432 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 181/430] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:49:48.012042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-17f6ef66-1385-4501-bfb9-4f3b7de794d6 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:48.012719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-17f6ef66-1385-4501-bfb9-4f3b7de794d6 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:48.042161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17f6ef66-1385-4501-bfb9-4f3b7de794d6 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:48.043345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17f6ef66-1385-4501-bfb9-4f3b7de794d6 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:48.043824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17f6ef66-1385-4501-bfb9-4f3b7de794d6 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:48.045707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17f6ef66-1385-4501-bfb9-4f3b7de794d6 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:48.046902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17f6ef66-1385-4501-bfb9-4f3b7de794d6 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:48.048399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17f6ef66-1385-4501-bfb9-4f3b7de794d6 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:48.253025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:48.280343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:48.282041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:48.293254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:48.305082 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6a66d4ae-61ba-4ffa-b52a-684f6100e710 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.451056 Sep 10 20:49:48.305082 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 250/431] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:47 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:48.339293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-370539338", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:48.426717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:49:48.784402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-17f6ef66-1385-4501-bfb9-4f3b7de794d6 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:48.796676 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-17f6ef66-1385-4501-bfb9-4f3b7de794d6 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1389 microversion: 2.1 time: 0.789864 Sep 10 20:49:48.797346 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 182/432] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:48 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1389 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:49:48.808412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e2f71e45-51e6-42ed-869b-5ac460606ee8 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:48.810477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e2f71e45-51e6-42ed-869b-5ac460606ee8 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:48.827858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f71e45-51e6-42ed-869b-5ac460606ee8 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:48.828377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f71e45-51e6-42ed-869b-5ac460606ee8 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:48.828796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f71e45-51e6-42ed-869b-5ac460606ee8 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:48.829616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f71e45-51e6-42ed-869b-5ac460606ee8 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:48.830265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f71e45-51e6-42ed-869b-5ac460606ee8 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:48.830840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f71e45-51e6-42ed-869b-5ac460606ee8 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:49.016687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e2f71e45-51e6-42ed-869b-5ac460606ee8 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:49.028151 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e2f71e45-51e6-42ed-869b-5ac460606ee8 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1277 microversion: 2.1 time: 0.229101 Sep 10 20:49:49.028748 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 183/433] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:48 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:49.039196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:49.041736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:49.052405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:49.053623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:49.054121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:49.055049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:49.055737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:49.056360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:49.245457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:49.260278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:49.261895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:49.269179 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e1fae5e-78fa-4fa9-96a7-25c7259c4831 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.239197 Sep 10 20:49:49.270563 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 184/434] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:49 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:49.276133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-63e9c3ba-9e47-478d-8ae7-6c790b61dd45 req-9ddea0da-ec35-4036-99b7-823667105a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2412dd3b-5199-44dc-b883-342893c82804", "tag": "45588a70-346a-4df0-a818-fe5ea133697d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:49.289639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-63e9c3ba-9e47-478d-8ae7-6c790b61dd45 req-9ddea0da-ec35-4036-99b7-823667105a6e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:49.291111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-63e9c3ba-9e47-478d-8ae7-6c790b61dd45 req-9ddea0da-ec35-4036-99b7-823667105a6e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:49.291705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-63e9c3ba-9e47-478d-8ae7-6c790b61dd45 req-9ddea0da-ec35-4036-99b7-823667105a6e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:49.306304 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-63e9c3ba-9e47-478d-8ae7-6c790b61dd45 req-9ddea0da-ec35-4036-99b7-823667105a6e service nova] Creating event network-changed:45588a70-346a-4df0-a818-fe5ea133697d for instance 2412dd3b-5199-44dc-b883-342893c82804 on nch1-master-1 Sep 10 20:49:49.313174 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-63e9c3ba-9e47-478d-8ae7-6c790b61dd45 req-9ddea0da-ec35-4036-99b7-823667105a6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040854 Sep 10 20:49:49.314916 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 185/435] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:49.326458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:49.327882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:49.337156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:49.338863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:49.339625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:49.341564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:49.342681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:49.345903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:49.488094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:49:49.488683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:49:49.489229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:49:49.489750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:49:49.490537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:49:49.510155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:49.512495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:49.513070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:49.515066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:49.516937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:49.520352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:49.563950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Getting quotas for project 5580128bff364c858eafedcc84dad425. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:49:49.577117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Getting quotas for user cbabc9a296d14628b649da7d81bc8766 and project 5580128bff364c858eafedcc84dad425. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:49:49.600314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:49:49.603672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:49:49.703600 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b0a62218-51ca-461c-b5bc-4d5fdc84f70b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.375968 Sep 10 20:49:49.704696 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 251/436] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:49:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:49:49.741449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:49.744524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:49.753875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:49.755111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:49.771908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:49.774706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:49.775773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:49.776933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:50.158334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.167788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.175158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.190992 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c8bf5836-86f5-4291-bbf2-83eef17d276f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.484033 Sep 10 20:49:50.191588 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 252/437] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:49 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:50.196628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2e9e836e-238b-4f65-9c90-9a0502075f41 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:50.197251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2e9e836e-238b-4f65-9c90-9a0502075f41 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:50.330711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.346297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.347854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.354050 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c4c17b40-32b8-45b4-8fdd-2bde6a291a80 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 1.037498 Sep 10 20:49:50.355445 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 186/438] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:49 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:50.367132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9eeafa1a-5790-4e87-b49d-36e6011f744d tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:50.369922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9eeafa1a-5790-4e87-b49d-36e6011f744d tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:50.392320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eeafa1a-5790-4e87-b49d-36e6011f744d tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:50.394002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eeafa1a-5790-4e87-b49d-36e6011f744d tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:50.396076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eeafa1a-5790-4e87-b49d-36e6011f744d tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:50.397788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eeafa1a-5790-4e87-b49d-36e6011f744d tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:50.400475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eeafa1a-5790-4e87-b49d-36e6011f744d tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:50.404513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eeafa1a-5790-4e87-b49d-36e6011f744d tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:50.516527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2e9e836e-238b-4f65-9c90-9a0502075f41 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.531014 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2e9e836e-238b-4f65-9c90-9a0502075f41 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1213 microversion: 2.1 time: 0.338232 Sep 10 20:49:50.531631 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 253/439] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:50 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1213 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:50.559890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6925e857-d2dd-46ef-902b-10e327a55f18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:50.565618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6925e857-d2dd-46ef-902b-10e327a55f18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:50.586503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6925e857-d2dd-46ef-902b-10e327a55f18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:50.587002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6925e857-d2dd-46ef-902b-10e327a55f18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:50.587445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6925e857-d2dd-46ef-902b-10e327a55f18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:50.588155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6925e857-d2dd-46ef-902b-10e327a55f18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:50.588785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6925e857-d2dd-46ef-902b-10e327a55f18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:50.589373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6925e857-d2dd-46ef-902b-10e327a55f18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:50.714792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6925e857-d2dd-46ef-902b-10e327a55f18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.731247 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6925e857-d2dd-46ef-902b-10e327a55f18 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1277 microversion: 2.1 time: 0.177956 Sep 10 20:49:50.733326 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 254/440] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:50 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:50.742478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:50.743192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:50.751054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:50.751730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:50.753191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:50.755153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:50.765102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:50.765813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:50.918499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.934309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.937469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:50.955879 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f308529f-98d5-401e-9c6d-73ed60817bc5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.219172 Sep 10 20:49:50.957205 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 255/441] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:50 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:51.024730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9eeafa1a-5790-4e87-b49d-36e6011f744d tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:51.055079 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9eeafa1a-5790-4e87-b49d-36e6011f744d tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1389 microversion: 2.1 time: 0.698193 Sep 10 20:49:51.056299 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 187/442] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:50 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1389 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:51.225037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:51.227669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:51.251034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:51.253222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:51.256896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:51.258036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:51.259416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:51.260372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:51.385844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:51.387253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:51.398749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:51.400784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:51.401506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:51.403116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:51.403585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:51.404018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:51.407225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:51.417135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:51.422750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:51.439114 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ef079183-1195-420c-a9f9-6c12fe9cf83d tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.219707 Sep 10 20:49:51.442960 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 256/443] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:51 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:51.558845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-159dc8dc-013e-4b1d-ae12-61535e58aa5c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:51.559476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-159dc8dc-013e-4b1d-ae12-61535e58aa5c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:51.570337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159dc8dc-013e-4b1d-ae12-61535e58aa5c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:51.571151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159dc8dc-013e-4b1d-ae12-61535e58aa5c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:51.571740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159dc8dc-013e-4b1d-ae12-61535e58aa5c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:51.572601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159dc8dc-013e-4b1d-ae12-61535e58aa5c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:51.573190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159dc8dc-013e-4b1d-ae12-61535e58aa5c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:51.573761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159dc8dc-013e-4b1d-ae12-61535e58aa5c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:51.824003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-159dc8dc-013e-4b1d-ae12-61535e58aa5c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:51.837363 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-159dc8dc-013e-4b1d-ae12-61535e58aa5c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1217 microversion: 2.1 time: 0.282255 Sep 10 20:49:51.839158 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 257/444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:51 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1217 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:51.850824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9f67eabc-eae5-4edc-b3c8-e4490089e07f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:51.856934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9f67eabc-eae5-4edc-b3c8-e4490089e07f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:51.865183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f67eabc-eae5-4edc-b3c8-e4490089e07f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:51.865725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f67eabc-eae5-4edc-b3c8-e4490089e07f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:51.866383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f67eabc-eae5-4edc-b3c8-e4490089e07f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:51.867138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f67eabc-eae5-4edc-b3c8-e4490089e07f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:51.867593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f67eabc-eae5-4edc-b3c8-e4490089e07f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:51.868019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f67eabc-eae5-4edc-b3c8-e4490089e07f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:52.153536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.167528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.168992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.170229 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-730054f8-744d-4199-9920-c204c72c2768 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 0.790268 Sep 10 20:49:52.172735 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 188/445] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:51 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:49:52.180435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:52.181044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:52.190632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:52.191422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:52.192079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:52.193003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:52.193699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:52.194873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:52.296547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.312407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.316302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.322868 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8efeb4c1-ecb4-4d58-9401-7cd8e1aa89e7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.148721 Sep 10 20:49:52.324814 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 189/446] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:52 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:52.341864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d023f8e7-e24c-4010-88e7-d8c3ce76ed5a tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:52.342807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d023f8e7-e24c-4010-88e7-d8c3ce76ed5a tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:52.351354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d023f8e7-e24c-4010-88e7-d8c3ce76ed5a tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:52.351841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d023f8e7-e24c-4010-88e7-d8c3ce76ed5a tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:52.352560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d023f8e7-e24c-4010-88e7-d8c3ce76ed5a tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:52.362616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d023f8e7-e24c-4010-88e7-d8c3ce76ed5a tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:52.363336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d023f8e7-e24c-4010-88e7-d8c3ce76ed5a tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:52.364553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d023f8e7-e24c-4010-88e7-d8c3ce76ed5a tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:52.378327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9f67eabc-eae5-4edc-b3c8-e4490089e07f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.386278 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9f67eabc-eae5-4edc-b3c8-e4490089e07f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1319 microversion: 2.1 time: 0.544362 Sep 10 20:49:52.386867 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 258/447] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:51 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:52.472696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:52.473225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:52.485782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:52.486305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:52.486760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:52.487465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:52.487922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:52.488348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:52.599156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d023f8e7-e24c-4010-88e7-d8c3ce76ed5a tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.610408 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d023f8e7-e24c-4010-88e7-d8c3ce76ed5a tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1389 microversion: 2.1 time: 0.284100 Sep 10 20:49:52.610994 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 190/448] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:52 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1389 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:52.639304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.653286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.656397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:52.663333 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-33dac8b3-785b-4289-a001-9cb7c19de771 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.194755 Sep 10 20:49:52.664433 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 259/449] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:52 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:52.864223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5c3d03b0-8433-43da-8c7b-136bba0dedb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:52.864837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5c3d03b0-8433-43da-8c7b-136bba0dedb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:52.874825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c3d03b0-8433-43da-8c7b-136bba0dedb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:52.879878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c3d03b0-8433-43da-8c7b-136bba0dedb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:52.880356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c3d03b0-8433-43da-8c7b-136bba0dedb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:52.882007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c3d03b0-8433-43da-8c7b-136bba0dedb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:52.882585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c3d03b0-8433-43da-8c7b-136bba0dedb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:52.883345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c3d03b0-8433-43da-8c7b-136bba0dedb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:53.083515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5c3d03b0-8433-43da-8c7b-136bba0dedb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:53.127071 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5c3d03b0-8433-43da-8c7b-136bba0dedb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1217 microversion: 2.1 time: 0.266135 Sep 10 20:49:53.146062 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 191/450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:52 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1217 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:53.205597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:53.206620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:53.222273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:53.223056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:53.223723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:53.224874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:53.228547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:53.229316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:53.389919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae9f2b03-5643-47a4-a377-06ed54f55f09 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Action: 'create', calling method: .version_select at 0x7f99450e7ee0>, body: {"pool": null} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:53.963453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:53.973382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:53.984527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:53.985771 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e886d601-d742-4f5e-af3f-39c2856c076d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1568 microversion: 2.25 time: 0.785402 Sep 10 20:49:54.005941 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 192/451] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:53 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1568 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:54.005941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:54.005941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:54.022271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:54.022786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:54.028610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:54.029332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:54.029702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:54.030180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:54.069460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:54.402347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:54.425100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:54.427034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:54.435636 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-38ab7885-b034-4031-ac49-531b8b9b3865 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.441934 Sep 10 20:49:54.436994 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 193/452] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:53 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:54.445085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b15a76d6-3467-4110-b438-e7aeece91467 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:54.445960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b15a76d6-3467-4110-b438-e7aeece91467 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:54.452541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15a76d6-3467-4110-b438-e7aeece91467 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:54.453276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15a76d6-3467-4110-b438-e7aeece91467 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:54.453915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15a76d6-3467-4110-b438-e7aeece91467 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:54.454813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15a76d6-3467-4110-b438-e7aeece91467 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:54.455448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15a76d6-3467-4110-b438-e7aeece91467 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:54.456034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15a76d6-3467-4110-b438-e7aeece91467 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:55.360565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b15a76d6-3467-4110-b438-e7aeece91467 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:55.382922 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b15a76d6-3467-4110-b438-e7aeece91467 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1319 microversion: 2.1 time: 0.938760 Sep 10 20:49:55.385051 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 194/453] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:54 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1319 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:55.400739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0384e28f-e86a-4d9f-adf0-14ca9ff12579 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:55.401739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0384e28f-e86a-4d9f-adf0-14ca9ff12579 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:55.420459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0384e28f-e86a-4d9f-adf0-14ca9ff12579 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:55.424017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0384e28f-e86a-4d9f-adf0-14ca9ff12579 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:55.424750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0384e28f-e86a-4d9f-adf0-14ca9ff12579 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:55.426140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0384e28f-e86a-4d9f-adf0-14ca9ff12579 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:55.428730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0384e28f-e86a-4d9f-adf0-14ca9ff12579 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:55.429938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0384e28f-e86a-4d9f-adf0-14ca9ff12579 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:55.883640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0384e28f-e86a-4d9f-adf0-14ca9ff12579 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:55.897556 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0384e28f-e86a-4d9f-adf0-14ca9ff12579 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1389 microversion: 2.1 time: 0.509793 Sep 10 20:49:55.899047 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 195/454] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:55 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1389 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:55.904374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:55.905226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:55.917251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:55.918020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:55.918656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:55.919536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:55.920154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:55.920738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:56.038433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:56.047702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:56.049473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:56.056034 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3f0657fd-d83f-4109-9dca-9468fe24b1f3 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.155611 Sep 10 20:49:56.057207 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 196/455] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:55 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:56.062330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3545b982-f740-4f03-9c32-ea24c857b09b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:56.063197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3545b982-f740-4f03-9c32-ea24c857b09b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:56.070708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3545b982-f740-4f03-9c32-ea24c857b09b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:56.071494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3545b982-f740-4f03-9c32-ea24c857b09b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:56.072124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3545b982-f740-4f03-9c32-ea24c857b09b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:56.073015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3545b982-f740-4f03-9c32-ea24c857b09b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:56.073784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3545b982-f740-4f03-9c32-ea24c857b09b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:56.074460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3545b982-f740-4f03-9c32-ea24c857b09b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:56.229388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3545b982-f740-4f03-9c32-ea24c857b09b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:56.250942 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3545b982-f740-4f03-9c32-ea24c857b09b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1271 microversion: 2.1 time: 0.192238 Sep 10 20:49:56.251544 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 197/456] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:56 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:56.267848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:56.268689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:56.284074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:56.284594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:56.285337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:56.286124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:56.286589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:56.287071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:56.665036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:56.678325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:56.684171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:56.684796 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e96cf17c-94b8-42e7-aef2-f5b353a1addf tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1558 microversion: 2.25 time: 0.432073 Sep 10 20:49:56.689329 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 198/457] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:56 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1558 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:56.700521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:56.705663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:56.719118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:56.719890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:56.720769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:56.721680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:56.722313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:56.722896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:56.822007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:56.836981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:56.839728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:56.847811 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-26b98b42-b66b-40b6-82a2-14b6e0ed77d2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.151455 Sep 10 20:49:56.848585 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 199/458] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:56 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:56.871995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8df8e9be-f920-46ee-820b-c5ec4128bfb6 req-020daa7c-8235-4a9b-8234-1c716a23e660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef", "tag": "9c727297-d15f-4723-a7ae-e66860c9a0d8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:56.886592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8df8e9be-f920-46ee-820b-c5ec4128bfb6 req-020daa7c-8235-4a9b-8234-1c716a23e660 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:56.887531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8df8e9be-f920-46ee-820b-c5ec4128bfb6 req-020daa7c-8235-4a9b-8234-1c716a23e660 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:56.888207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8df8e9be-f920-46ee-820b-c5ec4128bfb6 req-020daa7c-8235-4a9b-8234-1c716a23e660 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:56.903208 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8df8e9be-f920-46ee-820b-c5ec4128bfb6 req-020daa7c-8235-4a9b-8234-1c716a23e660 service nova] Creating event network-changed:9c727297-d15f-4723-a7ae-e66860c9a0d8 for instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef on nch2-master-1 Sep 10 20:49:56.909109 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8df8e9be-f920-46ee-820b-c5ec4128bfb6 req-020daa7c-8235-4a9b-8234-1c716a23e660 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059106 Sep 10 20:49:56.915032 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 200/459] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:56.932800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-2a93b28c-63a8-4b2f-9fcc-b26e37e66ad8 req-952ec1ce-f4b1-49e0-aac6-f5616acf0942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3dd2771-3e57-4798-ab1e-c16e724ad6f4", "tag": "5bf39bf7-b621-4388-8dd2-5fd139920258"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:56.945077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2a93b28c-63a8-4b2f-9fcc-b26e37e66ad8 req-952ec1ce-f4b1-49e0-aac6-f5616acf0942 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:56.946125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2a93b28c-63a8-4b2f-9fcc-b26e37e66ad8 req-952ec1ce-f4b1-49e0-aac6-f5616acf0942 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:56.946919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2a93b28c-63a8-4b2f-9fcc-b26e37e66ad8 req-952ec1ce-f4b1-49e0-aac6-f5616acf0942 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:56.959937 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-2a93b28c-63a8-4b2f-9fcc-b26e37e66ad8 req-952ec1ce-f4b1-49e0-aac6-f5616acf0942 service nova] Creating event network-changed:5bf39bf7-b621-4388-8dd2-5fd139920258 for instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 on nch2-master-1 Sep 10 20:49:56.972186 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-2a93b28c-63a8-4b2f-9fcc-b26e37e66ad8 req-952ec1ce-f4b1-49e0-aac6-f5616acf0942 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055395 Sep 10 20:49:56.973107 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 201/460] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:56.980812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6b7c10b8-6ad9-458a-887e-24c9a736fdc1 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:56.981552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6b7c10b8-6ad9-458a-887e-24c9a736fdc1 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:56.990923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b7c10b8-6ad9-458a-887e-24c9a736fdc1 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:56.990923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b7c10b8-6ad9-458a-887e-24c9a736fdc1 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:56.991372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b7c10b8-6ad9-458a-887e-24c9a736fdc1 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:56.992094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b7c10b8-6ad9-458a-887e-24c9a736fdc1 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:56.992551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b7c10b8-6ad9-458a-887e-24c9a736fdc1 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:56.992977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b7c10b8-6ad9-458a-887e-24c9a736fdc1 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:57.227689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6b7c10b8-6ad9-458a-887e-24c9a736fdc1 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:57.243337 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6b7c10b8-6ad9-458a-887e-24c9a736fdc1 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1319 microversion: 2.1 time: 0.265738 Sep 10 20:49:57.244676 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 202/461] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:56 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:57.255646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42985c5d-210d-4306-88c2-2b0af7924b33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '.version_select at 0x7f994519c1f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:57.274949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42985c5d-210d-4306-88c2-2b0af7924b33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:57.277143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42985c5d-210d-4306-88c2-2b0af7924b33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:57.277584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42985c5d-210d-4306-88c2-2b0af7924b33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:57.304469 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-42985c5d-210d-4306-88c2-2b0af7924b33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.053151 Sep 10 20:49:57.305388 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 203/462] 10.222.0.33 () {60 vars in 1184 bytes} [Sat Sep 10 20:49:57 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:49:57.311578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1d78aa2b-080b-4ca1-a5b4-91ae9f90dbcb tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:57.312198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1d78aa2b-080b-4ca1-a5b4-91ae9f90dbcb tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:57.319904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d78aa2b-080b-4ca1-a5b4-91ae9f90dbcb tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:57.320456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d78aa2b-080b-4ca1-a5b4-91ae9f90dbcb tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:57.320905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d78aa2b-080b-4ca1-a5b4-91ae9f90dbcb tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:57.321622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d78aa2b-080b-4ca1-a5b4-91ae9f90dbcb tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:57.322180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d78aa2b-080b-4ca1-a5b4-91ae9f90dbcb tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:57.322625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d78aa2b-080b-4ca1-a5b4-91ae9f90dbcb tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:57.506669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1d78aa2b-080b-4ca1-a5b4-91ae9f90dbcb tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:57.526277 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1d78aa2b-080b-4ca1-a5b4-91ae9f90dbcb tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1389 microversion: 2.1 time: 0.218800 Sep 10 20:49:57.527070 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 204/463] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:57 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1389 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:57.538143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:57.538759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:57.548235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:57.548680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:57.549126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:57.549940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:57.550353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:57.550793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:57.630853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:57.668211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:57.677377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:57.695685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:57.702832 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bb97971a-0bb8-4640-be73-b180c32644cd tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.174753 Sep 10 20:49:57.726234 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 205/464] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:57 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:57.733884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8dc726aa-e086-4a9e-8bd2-d7b22fd2c739 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:57.734559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8dc726aa-e086-4a9e-8bd2-d7b22fd2c739 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:57.746855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:57.749313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8dc726aa-e086-4a9e-8bd2-d7b22fd2c739 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:57.750104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8dc726aa-e086-4a9e-8bd2-d7b22fd2c739 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:57.750807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8dc726aa-e086-4a9e-8bd2-d7b22fd2c739 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:57.751645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8dc726aa-e086-4a9e-8bd2-d7b22fd2c739 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:57.752363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8dc726aa-e086-4a9e-8bd2-d7b22fd2c739 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:57.752795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8dc726aa-e086-4a9e-8bd2-d7b22fd2c739 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:58.276768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8dc726aa-e086-4a9e-8bd2-d7b22fd2c739 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:58.302889 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8dc726aa-e086-4a9e-8bd2-d7b22fd2c739 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1313 microversion: 2.1 time: 0.575307 Sep 10 20:49:58.308990 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 206/465] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:57 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:58.323007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-22a07054-b82d-4571-9735-26344cce42af tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:58.326132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-22a07054-b82d-4571-9735-26344cce42af tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:58.339219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22a07054-b82d-4571-9735-26344cce42af tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:58.339715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22a07054-b82d-4571-9735-26344cce42af tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:58.340145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22a07054-b82d-4571-9735-26344cce42af tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:58.343247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22a07054-b82d-4571-9735-26344cce42af tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:58.343645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22a07054-b82d-4571-9735-26344cce42af tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:58.344073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22a07054-b82d-4571-9735-26344cce42af tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:58.550204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-22a07054-b82d-4571-9735-26344cce42af tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid 71e5c032-830c-485e-95db-6ce8a67b1872 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:49:58.566372 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-22a07054-b82d-4571-9735-26344cce42af tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 2051 microversion: 2.25 time: 0.255933 Sep 10 20:49:58.566962 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 207/466] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:58 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 2051 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:58.573392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:58.574259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:58.580414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:58.581232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:58.581974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:58.582932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:58.584089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:58.584726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:58.735465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:58.744786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:58.746567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:58.753606 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ffcdfc11-76f0-4281-a84e-d3aff57335f0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.185227 Sep 10 20:49:58.755937 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 208/467] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:58 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:58.761328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b2a4d019-43c0-4548-a624-94fccc772b9c tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:58.762311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b2a4d019-43c0-4548-a624-94fccc772b9c tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:58.768844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2a4d019-43c0-4548-a624-94fccc772b9c tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:58.769466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2a4d019-43c0-4548-a624-94fccc772b9c tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:58.770061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2a4d019-43c0-4548-a624-94fccc772b9c tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:58.771004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2a4d019-43c0-4548-a624-94fccc772b9c tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:58.775324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2a4d019-43c0-4548-a624-94fccc772b9c tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:58.777644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2a4d019-43c0-4548-a624-94fccc772b9c tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:58.941130 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae9f2b03-5643-47a4-a377-06ed54f55f09 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.841423 Sep 10 20:49:58.943628 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 260/468] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 20:49:53 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:49:58.949084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-143056db-e1b6-4321-8a57-94496671fb53 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:58.949941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-143056db-e1b6-4321-8a57-94496671fb53 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:58.973519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-143056db-e1b6-4321-8a57-94496671fb53 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:58.974523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-143056db-e1b6-4321-8a57-94496671fb53 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:58.975732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-143056db-e1b6-4321-8a57-94496671fb53 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:58.976888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-143056db-e1b6-4321-8a57-94496671fb53 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:58.977561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-143056db-e1b6-4321-8a57-94496671fb53 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:58.978505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-143056db-e1b6-4321-8a57-94496671fb53 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:59.075763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b2a4d019-43c0-4548-a624-94fccc772b9c tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:59.085645 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b2a4d019-43c0-4548-a624-94fccc772b9c tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1319 microversion: 2.1 time: 0.327977 Sep 10 20:49:59.086642 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 209/469] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:58 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:59.091576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:59.092178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:59.098424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:59.098914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:59.099404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:59.100449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:59.100909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:59.101336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:59.194193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:59.207988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:59.209852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:59.222095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:59.226363 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fdc6cee2-2a05-40fd-83c7-3de4dc8a642e tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.136329 Sep 10 20:49:59.237855 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 210/470] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:49:59 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:49:59.237855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-449044388", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "d1056f7d-9b49-496a-b2dd-0515a9a2e934"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:49:59.314048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] validate_networks() for [('d1056f7d-9b49-496a-b2dd-0515a9a2e934', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:49:59.378188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-143056db-e1b6-4321-8a57-94496671fb53 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:49:59.388650 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-143056db-e1b6-4321-8a57-94496671fb53 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1389 microversion: 2.1 time: 0.443069 Sep 10 20:49:59.390052 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 261/471] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:58 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1389 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:49:59.395026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cf337d1e-70ce-4607-932f-f0f1d8b23857 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Calling method '.version_select at 0x7f9944fa6ee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:59.543055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=10 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:49:59.881216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:49:59.881936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:49:59.882191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:49:59.886822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:49:59.887719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:49:59.902008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:59.902482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:59.902920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:59.905418 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cf337d1e-70ce-4607-932f-f0f1d8b23857 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/6f95ff5a-20b5-4ed6-a5e5-a7f8614a4d5e" status: 200 len: 141 microversion: 2.1 time: 0.514120 Sep 10 20:49:59.906208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 262/472] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:49:59 2022] GET /compute/v2.1/os-floating-ips/6f95ff5a-20b5-4ed6-a5e5-a7f8614a4d5e => generated 141 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:49:59.912473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c8b5189e-69a9-4df0-9ca2-57e9153a5848 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:49:59.913960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c8b5189e-69a9-4df0-9ca2-57e9153a5848 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:49:59.916681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:59.917171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:59.917610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:59.929266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8b5189e-69a9-4df0-9ca2-57e9153a5848 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:59.929756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8b5189e-69a9-4df0-9ca2-57e9153a5848 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:59.931396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8b5189e-69a9-4df0-9ca2-57e9153a5848 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:59.933227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8b5189e-69a9-4df0-9ca2-57e9153a5848 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:49:59.936055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8b5189e-69a9-4df0-9ca2-57e9153a5848 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:49:59.937544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8b5189e-69a9-4df0-9ca2-57e9153a5848 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:49:59.956357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Getting quotas for project 89075fefc8ea47c78d4ff7364e12ffde. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:49:59.964457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Getting quotas for user dd431fc2d9834bea8df807edb91771ee and project 89075fefc8ea47c78d4ff7364e12ffde. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:49:59.989230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:49:59.994953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:50:00.060561 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c00aaf29-97db-41d1-85b1-ad9aeb75821f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.832235 Sep 10 20:50:00.061938 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 211/473] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:49:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 20:50:00.067498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:00.068143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:00.078985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:00.079570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:00.080184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:00.080797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:00.081284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:00.081723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:00.122319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:00.180620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:00.190158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:00.191766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:00.202870 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e7d80e46-ff73-421b-baff-1343dcbde755 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.139766 Sep 10 20:50:00.203647 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 212/474] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:00 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:00.212516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-9c679c36-5d87-4f81-bc75-dcb89a409d87 req-ffff64b3-c356-4953-920b-e3c16a149a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2412dd3b-5199-44dc-b883-342893c82804", "name": "network-vif-plugged", "status": "completed", "tag": "45588a70-346a-4df0-a818-fe5ea133697d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:00.233899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9c679c36-5d87-4f81-bc75-dcb89a409d87 req-ffff64b3-c356-4953-920b-e3c16a149a39 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:00.234265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9c679c36-5d87-4f81-bc75-dcb89a409d87 req-ffff64b3-c356-4953-920b-e3c16a149a39 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:00.234691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9c679c36-5d87-4f81-bc75-dcb89a409d87 req-ffff64b3-c356-4953-920b-e3c16a149a39 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:00.247778 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-9c679c36-5d87-4f81-bc75-dcb89a409d87 req-ffff64b3-c356-4953-920b-e3c16a149a39 service nova] Creating event network-vif-plugged:45588a70-346a-4df0-a818-fe5ea133697d for instance 2412dd3b-5199-44dc-b883-342893c82804 on nch1-master-1 Sep 10 20:50:00.252534 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-9c679c36-5d87-4f81-bc75-dcb89a409d87 req-ffff64b3-c356-4953-920b-e3c16a149a39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045649 Sep 10 20:50:00.253286 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 213/475] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:00.259078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c1a734b-2f1c-4a52-9093-08e185c1c547 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Calling method '.version_select at 0x7f994511d160>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:00.445187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c8b5189e-69a9-4df0-9ca2-57e9153a5848 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:00.455286 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c8b5189e-69a9-4df0-9ca2-57e9153a5848 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1313 microversion: 2.1 time: 0.547769 Sep 10 20:50:00.457499 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 263/476] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:49:59 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:00.464649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca528b7a-88e4-4539-89d6-3bd791e93295 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:00.465627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ca528b7a-88e4-4539-89d6-3bd791e93295 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:00.524546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=30 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:00.613519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ca528b7a-88e4-4539-89d6-3bd791e93295 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:00.623521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ca528b7a-88e4-4539-89d6-3bd791e93295 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:00.625278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ca528b7a-88e4-4539-89d6-3bd791e93295 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:00.626659 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ca528b7a-88e4-4539-89d6-3bd791e93295 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1261 microversion: 2.25 time: 0.166378 Sep 10 20:50:00.627716 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 264/477] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:00 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:00.633881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a7373217-267a-482f-8a23-aaddb6f7afa2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:00.634730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a7373217-267a-482f-8a23-aaddb6f7afa2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:00.649094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7373217-267a-482f-8a23-aaddb6f7afa2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:00.650020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7373217-267a-482f-8a23-aaddb6f7afa2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:00.650680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7373217-267a-482f-8a23-aaddb6f7afa2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:00.651606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7373217-267a-482f-8a23-aaddb6f7afa2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:00.652324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7373217-267a-482f-8a23-aaddb6f7afa2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:00.653334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7373217-267a-482f-8a23-aaddb6f7afa2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:00.814421 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c1a734b-2f1c-4a52-9093-08e185c1c547 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.560026 Sep 10 20:50:00.815325 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 214/478] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 20:50:00 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:00.820545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:00.821488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:00.828146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:00.828841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:00.829466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:00.830277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:00.830887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:00.831611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:00.930607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:00.942255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:00.945094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:00.952174 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f1ac390b-6fc7-4aa3-b11a-33534b802f87 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.135570 Sep 10 20:50:00.953301 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 215/479] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:00 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:00.959819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b5091128-e8b1-42ae-a581-2a9ad27275ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:00.960844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b5091128-e8b1-42ae-a581-2a9ad27275ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:00.968577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5091128-e8b1-42ae-a581-2a9ad27275ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:00.980546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5091128-e8b1-42ae-a581-2a9ad27275ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:00.983092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5091128-e8b1-42ae-a581-2a9ad27275ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:00.986367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5091128-e8b1-42ae-a581-2a9ad27275ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:00.986981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5091128-e8b1-42ae-a581-2a9ad27275ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:00.987521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5091128-e8b1-42ae-a581-2a9ad27275ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:01.149244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b5091128-e8b1-42ae-a581-2a9ad27275ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:01.157847 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b5091128-e8b1-42ae-a581-2a9ad27275ce tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1389 microversion: 2.1 time: 0.203172 Sep 10 20:50:01.158697 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 216/480] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:00 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1389 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:01.167908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3324ea8a-0250-4507-8824-b2e6a3702c54 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Calling method '.version_select at 0x7f99451b7160>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:01.385878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a7373217-267a-482f-8a23-aaddb6f7afa2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:01.394493 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a7373217-267a-482f-8a23-aaddb6f7afa2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1319 microversion: 2.1 time: 0.765451 Sep 10 20:50:01.395257 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 265/481] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:00 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1319 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:01.410705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-7c9ae903-4a8f-4181-a840-8b6c0e07abdc req-85c39121-de9b-4ce5-a046-74b5419e6328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fdb5cc4-af47-4827-98a3-9e8aa572868b", "tag": "586e8c3f-26b3-4849-a7dc-631285af05c5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:01.436364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7c9ae903-4a8f-4181-a840-8b6c0e07abdc req-85c39121-de9b-4ce5-a046-74b5419e6328 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:01.437110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7c9ae903-4a8f-4181-a840-8b6c0e07abdc req-85c39121-de9b-4ce5-a046-74b5419e6328 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:01.437704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7c9ae903-4a8f-4181-a840-8b6c0e07abdc req-85c39121-de9b-4ce5-a046-74b5419e6328 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:01.452954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:01.463191 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7c9ae903-4a8f-4181-a840-8b6c0e07abdc req-85c39121-de9b-4ce5-a046-74b5419e6328 service nova] Creating event network-changed:586e8c3f-26b3-4849-a7dc-631285af05c5 for instance 2fdb5cc4-af47-4827-98a3-9e8aa572868b on nch1-master-1 Sep 10 20:50:01.469645 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-7c9ae903-4a8f-4181-a840-8b6c0e07abdc req-85c39121-de9b-4ce5-a046-74b5419e6328 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072363 Sep 10 20:50:01.471101 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 266/482] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:01.480794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:01.481715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:01.491014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:01.491693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:01.492335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:01.493522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:01.494192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:01.497944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:01.702136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:01.714443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:01.715964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:01.729906 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b061e4d5-81da-4956-b567-8a9d27592148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.257373 Sep 10 20:50:01.733135 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 267/483] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:01 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:01.750290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-229f010d-1207-4780-b3e0-d9b9eef11550 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:01.750912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-229f010d-1207-4780-b3e0-d9b9eef11550 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:01.762082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-229f010d-1207-4780-b3e0-d9b9eef11550 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:01.771477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-229f010d-1207-4780-b3e0-d9b9eef11550 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:01.772170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-229f010d-1207-4780-b3e0-d9b9eef11550 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:01.773097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-229f010d-1207-4780-b3e0-d9b9eef11550 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:01.773718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-229f010d-1207-4780-b3e0-d9b9eef11550 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:01.774421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-229f010d-1207-4780-b3e0-d9b9eef11550 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:02.259066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-229f010d-1207-4780-b3e0-d9b9eef11550 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:02.278948 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-229f010d-1207-4780-b3e0-d9b9eef11550 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1313 microversion: 2.1 time: 0.544353 Sep 10 20:50:02.280600 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 268/484] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:01 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:02.287273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:02.288285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:02.296069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:02.297067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:02.297787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:02.299277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:02.300509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:02.301627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:02.439936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:02.448875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:02.450378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:02.451528 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a17fe734-e56c-4ba7-890d-c320e9f10f29 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1319 microversion: 2.25 time: 0.169567 Sep 10 20:50:02.473911 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 269/485] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:02 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:02.479864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:02.480697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:02.486947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:02.487667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:02.490786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:02.491777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:02.492401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:02.501626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:02.701906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:02.710558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:02.715585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:02.734740 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1f1ddb4b-a234-4750-90b0-0f1b5cc1cd4f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.254899 Sep 10 20:50:02.735392 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 270/486] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:02 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:02.745208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb0dd8a1-0acb-4466-b09d-1dd7791e504f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:02.749627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fb0dd8a1-0acb-4466-b09d-1dd7791e504f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:02.766820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb0dd8a1-0acb-4466-b09d-1dd7791e504f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:02.767322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb0dd8a1-0acb-4466-b09d-1dd7791e504f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:02.767997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb0dd8a1-0acb-4466-b09d-1dd7791e504f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:02.768933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb0dd8a1-0acb-4466-b09d-1dd7791e504f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:02.769593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb0dd8a1-0acb-4466-b09d-1dd7791e504f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:02.770212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb0dd8a1-0acb-4466-b09d-1dd7791e504f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:02.989059 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3324ea8a-0250-4507-8824-b2e6a3702c54 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/6f95ff5a-20b5-4ed6-a5e5-a7f8614a4d5e" status: 202 len: 0 microversion: 2.1 time: 1.828865 Sep 10 20:50:02.993464 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 217/487] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:50:01 2022] DELETE /compute/v2.1/os-floating-ips/6f95ff5a-20b5-4ed6-a5e5-a7f8614a4d5e => generated 0 bytes in 1834 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:50:03.005423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c9caa1b3-b4f9-4ad8-aa55-a4c0f5523ad9 req-f29be3f0-2c78-41a8-9476-af983bb23f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef", "name": "network-vif-plugged", "status": "completed", "tag": "9c727297-d15f-4723-a7ae-e66860c9a0d8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:03.024638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c9caa1b3-b4f9-4ad8-aa55-a4c0f5523ad9 req-f29be3f0-2c78-41a8-9476-af983bb23f7c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:03.026667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c9caa1b3-b4f9-4ad8-aa55-a4c0f5523ad9 req-f29be3f0-2c78-41a8-9476-af983bb23f7c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:03.027735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c9caa1b3-b4f9-4ad8-aa55-a4c0f5523ad9 req-f29be3f0-2c78-41a8-9476-af983bb23f7c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:03.048446 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c9caa1b3-b4f9-4ad8-aa55-a4c0f5523ad9 req-f29be3f0-2c78-41a8-9476-af983bb23f7c service nova] Creating event network-vif-plugged:9c727297-d15f-4723-a7ae-e66860c9a0d8 for instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef on nch2-master-1 Sep 10 20:50:03.058556 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c9caa1b3-b4f9-4ad8-aa55-a4c0f5523ad9 req-f29be3f0-2c78-41a8-9476-af983bb23f7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057350 Sep 10 20:50:03.060585 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 218/488] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:03.071316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-795c7930-9216-482e-a1ae-af365b959296 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:03.072184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-795c7930-9216-482e-a1ae-af365b959296 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:03.085051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-795c7930-9216-482e-a1ae-af365b959296 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:03.085882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-795c7930-9216-482e-a1ae-af365b959296 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:03.086999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-795c7930-9216-482e-a1ae-af365b959296 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:03.087997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-795c7930-9216-482e-a1ae-af365b959296 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:03.088638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-795c7930-9216-482e-a1ae-af365b959296 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:03.089310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-795c7930-9216-482e-a1ae-af365b959296 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:03.118405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fb0dd8a1-0acb-4466-b09d-1dd7791e504f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:03.137495 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fb0dd8a1-0acb-4466-b09d-1dd7791e504f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1588 microversion: 2.1 time: 0.399418 Sep 10 20:50:03.138146 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 271/489] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:02 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1588 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:03.157908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:03.158664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:03.166292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:03.166839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:03.167447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:03.168268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:03.168728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:03.169152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:03.278464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:03.289685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:03.291622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:03.298576 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f7ba1f02-f6a0-4674-bb0e-ffd650b77054 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.159393 Sep 10 20:50:03.300219 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 272/490] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:03 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:03.311958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a61cca4e-b272-4ed5-adc5-b83511cc3c63 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Action: 'create', calling method: .version_select at 0x7f994510e550>, body: {"pool": null} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:03.480134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-795c7930-9216-482e-a1ae-af365b959296 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:03.495492 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-795c7930-9216-482e-a1ae-af365b959296 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1319 microversion: 2.1 time: 0.430351 Sep 10 20:50:03.497995 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 219/491] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:03 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:03.508962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d9ecf682-8076-4f2f-9c79-887c84201abe tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:03.512710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d9ecf682-8076-4f2f-9c79-887c84201abe tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:03.519839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9ecf682-8076-4f2f-9c79-887c84201abe tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:03.520601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9ecf682-8076-4f2f-9c79-887c84201abe tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:03.522078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9ecf682-8076-4f2f-9c79-887c84201abe tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:03.523162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9ecf682-8076-4f2f-9c79-887c84201abe tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:03.524314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9ecf682-8076-4f2f-9c79-887c84201abe tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:03.524912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9ecf682-8076-4f2f-9c79-887c84201abe tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:03.676177 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d9ecf682-8076-4f2f-9c79-887c84201abe tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176625 Sep 10 20:50:03.676891 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 220/492] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 20:50:03 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:03.682753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dcfc549e-2a22-455b-a5bd-0bf20b86962a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:03.684105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dcfc549e-2a22-455b-a5bd-0bf20b86962a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:03.700886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dcfc549e-2a22-455b-a5bd-0bf20b86962a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:03.702792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dcfc549e-2a22-455b-a5bd-0bf20b86962a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:03.705458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dcfc549e-2a22-455b-a5bd-0bf20b86962a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:03.706582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dcfc549e-2a22-455b-a5bd-0bf20b86962a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:03.707287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dcfc549e-2a22-455b-a5bd-0bf20b86962a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:03.707966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dcfc549e-2a22-455b-a5bd-0bf20b86962a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:04.219075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dcfc549e-2a22-455b-a5bd-0bf20b86962a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:04.237909 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dcfc549e-2a22-455b-a5bd-0bf20b86962a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1313 microversion: 2.1 time: 0.559007 Sep 10 20:50:04.240367 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 221/493] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:03 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:04.256534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:04.257390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:04.274161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:04.278429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:04.279000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:04.280005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:04.281257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:04.281973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:04.792220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:04.803486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:04.806445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:04.807903 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c7a9c26-8fc5-4a5e-be1d-5d91a88718f0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1361 microversion: 2.25 time: 0.565880 Sep 10 20:50:04.808745 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 222/494] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:04 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1361 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:04.814858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:04.816028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:04.823783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:04.824926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:04.825895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:04.826896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:04.827440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:04.827943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:05.237959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:05.275973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:05.282256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:05.295569 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-05dfcb91-33c8-444a-a934-fb8a45d014e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1446 microversion: 2.75 time: 0.485348 Sep 10 20:50:05.314159 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 223/495] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:04 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1446 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:05.322846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:05.323464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:05.351840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:05.352485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:05.352996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:05.361276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:05.362228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:05.362342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:05.694119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:05.704694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:05.706680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:05.716754 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0cd3c69c-338a-4f2c-8677-420ee8025e13 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.399500 Sep 10 20:50:05.717929 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 224/496] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:05 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:05.728097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-221f93ec-ad19-40b0-86c0-0d49b087ae77 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:05.728719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-221f93ec-ad19-40b0-86c0-0d49b087ae77 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:05.737699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-221f93ec-ad19-40b0-86c0-0d49b087ae77 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:05.738577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-221f93ec-ad19-40b0-86c0-0d49b087ae77 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:05.739162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-221f93ec-ad19-40b0-86c0-0d49b087ae77 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:05.740699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-221f93ec-ad19-40b0-86c0-0d49b087ae77 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:05.741170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-221f93ec-ad19-40b0-86c0-0d49b087ae77 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:05.741883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-221f93ec-ad19-40b0-86c0-0d49b087ae77 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:05.821190 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a61cca4e-b272-4ed5-adc5-b83511cc3c63 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.519093 Sep 10 20:50:05.822552 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 273/497] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 20:50:03 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:05.827993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-592ed117-3c78-4546-9890-98ed3f160cda tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:05.829046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-592ed117-3c78-4546-9890-98ed3f160cda tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:05.837926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-592ed117-3c78-4546-9890-98ed3f160cda tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:05.838901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-592ed117-3c78-4546-9890-98ed3f160cda tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:05.839496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-592ed117-3c78-4546-9890-98ed3f160cda tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:05.840468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-592ed117-3c78-4546-9890-98ed3f160cda tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:05.841081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-592ed117-3c78-4546-9890-98ed3f160cda tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:05.841662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-592ed117-3c78-4546-9890-98ed3f160cda tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:06.069382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-592ed117-3c78-4546-9890-98ed3f160cda tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:06.079333 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-592ed117-3c78-4546-9890-98ed3f160cda tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1313 microversion: 2.1 time: 0.255146 Sep 10 20:50:06.094887 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 274/498] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:05 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:06.101537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a7914b9c-ba65-42fb-8df4-c05259ddd4ae req-2bb7739c-3127-478f-9175-da42d65c6def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dd2771-3e57-4798-ab1e-c16e724ad6f4", "name": "network-vif-plugged", "status": "completed", "tag": "5bf39bf7-b621-4388-8dd2-5fd139920258"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:06.114121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a7914b9c-ba65-42fb-8df4-c05259ddd4ae req-2bb7739c-3127-478f-9175-da42d65c6def service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:06.115341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-221f93ec-ad19-40b0-86c0-0d49b087ae77 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:06.116493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a7914b9c-ba65-42fb-8df4-c05259ddd4ae req-2bb7739c-3127-478f-9175-da42d65c6def service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:06.117129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a7914b9c-ba65-42fb-8df4-c05259ddd4ae req-2bb7739c-3127-478f-9175-da42d65c6def service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:06.128346 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-221f93ec-ad19-40b0-86c0-0d49b087ae77 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1468 microversion: 2.1 time: 0.409014 Sep 10 20:50:06.131294 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a7914b9c-ba65-42fb-8df4-c05259ddd4ae req-2bb7739c-3127-478f-9175-da42d65c6def service nova] Creating event network-vif-plugged:5bf39bf7-b621-4388-8dd2-5fd139920258 for instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 on nch2-master-1 Sep 10 20:50:06.131987 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 225/499] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:05 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1468 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:06.136825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:06.142547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:06.144468 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a7914b9c-ba65-42fb-8df4-c05259ddd4ae req-2bb7739c-3127-478f-9175-da42d65c6def service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047324 Sep 10 20:50:06.147295 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 275/500] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:06.155196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b55d8427-df0f-43a3-bf94-e277433603bb tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Calling method '.version_select at 0x7f994510e5e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:06.157373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:06.158579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:06.158851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:06.159666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:06.166632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:06.167208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:06.504546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:06.523973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:06.526355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:06.527808 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-939c63cb-b7a5-44df-b579-1c8faee1b32c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1361 microversion: 2.25 time: 0.394794 Sep 10 20:50:06.529131 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 226/501] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:06 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1361 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:06.540196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b61e80e1-bb73-4c94-956d-9fc206c8b310 tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:06.548242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b61e80e1-bb73-4c94-956d-9fc206c8b310 tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:06.556520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b61e80e1-bb73-4c94-956d-9fc206c8b310 tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:06.557281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b61e80e1-bb73-4c94-956d-9fc206c8b310 tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:06.557941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b61e80e1-bb73-4c94-956d-9fc206c8b310 tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:06.558805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b61e80e1-bb73-4c94-956d-9fc206c8b310 tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:06.559581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b61e80e1-bb73-4c94-956d-9fc206c8b310 tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:06.560157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b61e80e1-bb73-4c94-956d-9fc206c8b310 tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:06.723864 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b61e80e1-bb73-4c94-956d-9fc206c8b310 tempest-DeleteServersAdminTestJSON-850417718 tempest-DeleteServersAdminTestJSON-850417718-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef/action" status: 202 len: 0 microversion: 2.1 time: 0.193217 Sep 10 20:50:06.724817 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 227/502] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:50:06 2022] POST /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:50:06.828580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1544303146", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f3aabbf6-b101-4d74-914c-9c1510387333"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:06.920586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] validate_networks() for [('f3aabbf6-b101-4d74-914c-9c1510387333', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:50:07.474583 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b55d8427-df0f-43a3-bf94-e277433603bb tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/732bf13a-4057-42f7-b39b-9dc9b7d29414" status: 202 len: 0 microversion: 2.1 time: 1.324578 Sep 10 20:50:07.478515 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 276/503] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:50:06 2022] DELETE /compute/v2.1/os-floating-ips/732bf13a-4057-42f7-b39b-9dc9b7d29414 => generated 0 bytes in 1330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:50:07.483557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:07.484376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:07.493317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:07.494036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:07.494728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:07.495619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:07.496236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:07.496997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:07.587007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:07.596344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:07.599771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:07.605937 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aeb55c7d-a6e7-40cb-a96b-e33b97ca2868 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1452 microversion: 2.75 time: 0.126287 Sep 10 20:50:07.622209 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 277/504] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:07 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:07.634789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e2cdfe98-1e84-4b7a-972b-57fd9976c1a9 req-db38bf72-7a8b-436d-9d14-56c8bd3b674c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e", "tag": "185a5cc6-4ac2-4e93-b345-1aad5abefc23"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:07.644692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e2cdfe98-1e84-4b7a-972b-57fd9976c1a9 req-db38bf72-7a8b-436d-9d14-56c8bd3b674c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:07.645454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e2cdfe98-1e84-4b7a-972b-57fd9976c1a9 req-db38bf72-7a8b-436d-9d14-56c8bd3b674c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:07.646678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e2cdfe98-1e84-4b7a-972b-57fd9976c1a9 req-db38bf72-7a8b-436d-9d14-56c8bd3b674c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:07.666510 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e2cdfe98-1e84-4b7a-972b-57fd9976c1a9 req-db38bf72-7a8b-436d-9d14-56c8bd3b674c service nova] Creating event network-changed:185a5cc6-4ac2-4e93-b345-1aad5abefc23 for instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e on nch2-master-1 Sep 10 20:50:07.671875 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e2cdfe98-1e84-4b7a-972b-57fd9976c1a9 req-db38bf72-7a8b-436d-9d14-56c8bd3b674c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048023 Sep 10 20:50:07.672844 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 278/505] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:07.678741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0c2421a9-6aef-44cb-997e-33caa6290e7f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:07.679707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0c2421a9-6aef-44cb-997e-33caa6290e7f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:07.688361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c2421a9-6aef-44cb-997e-33caa6290e7f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:07.689100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c2421a9-6aef-44cb-997e-33caa6290e7f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:07.692464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c2421a9-6aef-44cb-997e-33caa6290e7f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:07.693701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c2421a9-6aef-44cb-997e-33caa6290e7f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:07.694374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c2421a9-6aef-44cb-997e-33caa6290e7f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:07.695177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c2421a9-6aef-44cb-997e-33caa6290e7f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:07.846405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0c2421a9-6aef-44cb-997e-33caa6290e7f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:07.857108 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0c2421a9-6aef-44cb-997e-33caa6290e7f tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1588 microversion: 2.1 time: 0.181574 Sep 10 20:50:07.858239 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 279/506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:07 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1588 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:07.863084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:07.863707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:07.870121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:07.870626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:07.871071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:07.871898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:07.872363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:07.872801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:07.927301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:07.927856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:07.928309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:07.929130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lazy-loading 'fault' on Instance uuid 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:08.065794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.071807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:50:08.072935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:50:08.073432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:50:08.073942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:50:08.074382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:50:08.081384 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d69879d-463e-466e-bf7f-395e3a0bee80 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1451 microversion: 2.1 time: 0.221888 Sep 10 20:50:08.082400 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 280/507] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:07 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1451 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:08.087972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:08.088576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:08.094573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.095065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.095783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.096474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.096928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.097353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.100813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.101613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.102355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.103172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.103710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.104238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.126670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Getting quotas for project 5bd065954b0e4520a3c1deba0916db85. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:50:08.133245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Getting quotas for user f74a2c8cd22c454fa8fdd7c2e1ef9230 and project 5bd065954b0e4520a3c1deba0916db85. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:50:08.152087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:50:08.154382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:50:08.176500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.187243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.188994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.194903 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fb18ff4b-da89-419b-959f-bd5677f021d5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.111235 Sep 10 20:50:08.195992 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 281/508] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:08 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:08.200618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f6333357-8f92-4a3c-9c22-7abed1162e19 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:08.201394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f6333357-8f92-4a3c-9c22-7abed1162e19 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:08.207775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6333357-8f92-4a3c-9c22-7abed1162e19 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.209031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6333357-8f92-4a3c-9c22-7abed1162e19 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.209614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6333357-8f92-4a3c-9c22-7abed1162e19 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.210652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6333357-8f92-4a3c-9c22-7abed1162e19 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.211258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6333357-8f92-4a3c-9c22-7abed1162e19 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.211820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6333357-8f92-4a3c-9c22-7abed1162e19 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.221871 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aa6961ad-42a2-4c83-956b-fa27350714af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495555 Sep 10 20:50:08.222855 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 228/509] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:50:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:50:08.228204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-931ddcd1-23f0-405b-869b-8312fd61fa53 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Calling method '.version_select at 0x7f99450dfee0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:08.290786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-931ddcd1-23f0-405b-869b-8312fd61fa53 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 732bf13a-4057-42f7-b39b-9dc9b7d29414 could not be found", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:50:08.291514 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-931ddcd1-23f0-405b-869b-8312fd61fa53 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] HTTP exception thrown: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414 Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-931ddcd1-23f0-405b-869b-8312fd61fa53 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Request method failure captured: Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-floating-ips/732bf13a-4057-42f7-b39b-9dc9b7d29414 HTTP/1.1 Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhwJTFlHlPtAzyPrpIaw2-m9_oHF8-4SDlZdqAcgEEFektsD2-oQYnJIePX9uOOVoJYlK2Z-1oTvbu4m8NPdJ-g3nPJPJglqTPloiMieqmOyC3gE6IRM78PZIufYqX4vnj2wYNtAiOBmxCL1Ctg-BaZKB8ukcW9OYMLQ5PVr7K8c2M Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 63eb4f57847e4e799b89697d34253337 Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-FloatingIPsTestJSON-1387269723 Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:50:08.304957 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb4f57847e4e799b89697d34253337"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb4f57847e4e799b89697d34253337"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_63eb4f57847e4e799b89697d34253337", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/63eb4f57847e4e799b89697d34253337"}]}] Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-FloatingIPsTestJSON-1387269723 Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 63eb4f57847e4e799b89697d34253337 Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1387269723 Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-FloatingIPsTestJSON-1387269723-project Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 0817d9268715460fbbd6365dff685a23 Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-FloatingIPsTestJSON-1387269723-project Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: exception: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414 Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '732bf13a-4057-42f7-b39b-9dc9b7d29414'} Sep 10 20:50:08.306470 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:50:08.307509 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 732bf13a-4057-42f7-b39b-9dc9b7d29414 could not be found Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5b8ac429-dd06-4337-b108-2a2b54e479ed'] Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414. Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:08.308762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414 Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:08.322614 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:08.324693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414 Sep 10 20:50:08.324693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.324693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-931ddcd1-23f0-405b-869b-8312fd61fa53 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Returning 404 to user: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414 {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:08.324693 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-931ddcd1-23f0-405b-869b-8312fd61fa53 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/732bf13a-4057-42f7-b39b-9dc9b7d29414" status: 404 len: 111 microversion: 2.1 time: 0.083108 Sep 10 20:50:08.324693 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 229/510] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:50:08 2022] GET /compute/v2.1/os-floating-ips/732bf13a-4057-42f7-b39b-9dc9b7d29414 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:08.324693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:08.325176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:08.330109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.330616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.331062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.332031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.334194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.334664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.419773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f6333357-8f92-4a3c-9c22-7abed1162e19 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.428790 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f6333357-8f92-4a3c-9c22-7abed1162e19 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1313 microversion: 2.1 time: 0.231434 Sep 10 20:50:08.430180 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 282/511] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:08 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:08.436200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d3009bf6-85c1-40de-b49e-5b2657420508 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:08.437298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d3009bf6-85c1-40de-b49e-5b2657420508 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:08.443884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3009bf6-85c1-40de-b49e-5b2657420508 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.444896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3009bf6-85c1-40de-b49e-5b2657420508 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.445850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3009bf6-85c1-40de-b49e-5b2657420508 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.446874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3009bf6-85c1-40de-b49e-5b2657420508 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.447803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3009bf6-85c1-40de-b49e-5b2657420508 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.448712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3009bf6-85c1-40de-b49e-5b2657420508 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.484762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d3009bf6-85c1-40de-b49e-5b2657420508 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:50:08.525055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.549256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.550857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.552001 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6640992d-2a29-443d-9bb6-4710805f9a90 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1361 microversion: 2.25 time: 0.236679 Sep 10 20:50:08.553365 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 230/512] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:08 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:08.563499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3d5346fc-4634-41bc-9715-4f12a75b505c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:08.564488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3d5346fc-4634-41bc-9715-4f12a75b505c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:08.581093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:08.607706 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d3009bf6-85c1-40de-b49e-5b2657420508 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 204 len: 0 microversion: 2.1 time: 0.175687 Sep 10 20:50:08.609262 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 283/513] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:50:08 2022] DELETE /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:50:08.616913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-656a6708-ed9c-46dd-87b5-c493db7f44d3 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Calling method '.version_select at 0x7f99451c2a60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:08.691205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3d5346fc-4634-41bc-9715-4f12a75b505c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.702092 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3d5346fc-4634-41bc-9715-4f12a75b505c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1211 microversion: 2.1 time: 0.147334 Sep 10 20:50:08.703554 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 231/514] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:08 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1211 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:08.709739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:08.710602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:08.718783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.719579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.720551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.721503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.722207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.722882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.735513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-656a6708-ed9c-46dd-87b5-c493db7f44d3 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 732bf13a-4057-42f7-b39b-9dc9b7d29414 could not be found", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:50:08.736224 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-656a6708-ed9c-46dd-87b5-c493db7f44d3 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] HTTP exception thrown: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414 Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-656a6708-ed9c-46dd-87b5-c493db7f44d3 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Request method failure captured: Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/os-floating-ips/732bf13a-4057-42f7-b39b-9dc9b7d29414 HTTP/1.1 Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhwJTFlHlPtAzyPrpIaw2-m9_oHF8-4SDlZdqAcgEEFektsD2-oQYnJIePX9uOOVoJYlK2Z-1oTvbu4m8NPdJ-g3nPJPJglqTPloiMieqmOyC3gE6IRM78PZIufYqX4vnj2wYNtAiOBmxCL1Ctg-BaZKB8ukcW9OYMLQ5PVr7K8c2M Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 63eb4f57847e4e799b89697d34253337 Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FloatingIPsTestJSON-1387269723 Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:50:08.746540 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb4f57847e4e799b89697d34253337"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb4f57847e4e799b89697d34253337"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_63eb4f57847e4e799b89697d34253337", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/63eb4f57847e4e799b89697d34253337"}]}] Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FloatingIPsTestJSON-1387269723 Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 63eb4f57847e4e799b89697d34253337 Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1387269723 Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FloatingIPsTestJSON-1387269723-project Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 0817d9268715460fbbd6365dff685a23 Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FloatingIPsTestJSON-1387269723-project Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: exception: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414 Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '732bf13a-4057-42f7-b39b-9dc9b7d29414'} Sep 10 20:50:08.747865 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:50:08.748777 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 732bf13a-4057-42f7-b39b-9dc9b7d29414 could not be found Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78c2445e-5837-4e82-bb9e-bcaffc47e047'] Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414. Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:08.750469 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414 Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:08.753178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:08.754925 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414 Sep 10 20:50:08.754925 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:08.754925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-656a6708-ed9c-46dd-87b5-c493db7f44d3 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] Returning 404 to user: Floating IP not found for ID 732bf13a-4057-42f7-b39b-9dc9b7d29414 {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:08.754925 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-656a6708-ed9c-46dd-87b5-c493db7f44d3 tempest-FloatingIPsTestJSON-1387269723 tempest-FloatingIPsTestJSON-1387269723-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/732bf13a-4057-42f7-b39b-9dc9b7d29414" status: 404 len: 111 microversion: 2.1 time: 0.137008 Sep 10 20:50:08.757340 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 284/515] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:50:08 2022] DELETE /compute/v2.1/os-floating-ips/732bf13a-4057-42f7-b39b-9dc9b7d29414 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:08.763832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:08.764572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:08.771144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.772180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.773045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.773770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lazy-loading 'fault' on Instance uuid 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:08.781236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.781745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.790294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.791794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:08.792505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:08.793030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:08.889280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.893196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:08.903151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.904987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:08.912910 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-90578a86-7238-40cf-830c-5e5a7f4779e7 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1452 microversion: 2.75 time: 0.153232 Sep 10 20:50:08.914558 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 285/516] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:08 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:09.225820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:09.230538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:09.240421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.240945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.241471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:09.242222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.242686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.243782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:09.325337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:09.335006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:09.336795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:09.343116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:09.352470 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ec490a5a-8d5d-4dcc-906e-a79be1631dc2 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1457 microversion: 2.1 time: 0.647549 Sep 10 20:50:09.355558 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-02bed674-d911-4588-b348-1725bf8cb582 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.134872 Sep 10 20:50:09.356418 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 232/517] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:08 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1457 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:09.356654 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 286/518] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:09 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:50:09.452433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9b3b6f78-1524-4b26-8a49-93461955051e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:09.453044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9b3b6f78-1524-4b26-8a49-93461955051e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:09.459421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b3b6f78-1524-4b26-8a49-93461955051e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.459917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b3b6f78-1524-4b26-8a49-93461955051e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.460412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b3b6f78-1524-4b26-8a49-93461955051e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:09.461120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b3b6f78-1524-4b26-8a49-93461955051e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.461624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b3b6f78-1524-4b26-8a49-93461955051e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.462076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b3b6f78-1524-4b26-8a49-93461955051e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:09.500761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:09.579400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:09.580280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:09.591986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.592525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.592970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:09.593708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.598402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.599455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:09.781805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9b3b6f78-1524-4b26-8a49-93461955051e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:09.782272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:09.791496 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9b3b6f78-1524-4b26-8a49-93461955051e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1313 microversion: 2.1 time: 0.342679 Sep 10 20:50:09.793171 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 233/519] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:09 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:09.794534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:09.796571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:09.798206 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7d0c1e83-8c2f-492d-b57f-ff37a7da8de0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1361 microversion: 2.25 time: 0.222690 Sep 10 20:50:09.798367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-43c34b23-68ea-4b5e-a9cd-80c867c8e956 req-dae60f21-c0de-4598-86af-91dd7ba0c449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2412dd3b-5199-44dc-b883-342893c82804", "tag": "45588a70-346a-4df0-a818-fe5ea133697d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:09.805995 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 287/520] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:09 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:09.809675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-43c34b23-68ea-4b5e-a9cd-80c867c8e956 req-dae60f21-c0de-4598-86af-91dd7ba0c449 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.810508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-43c34b23-68ea-4b5e-a9cd-80c867c8e956 req-dae60f21-c0de-4598-86af-91dd7ba0c449 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.811294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-43c34b23-68ea-4b5e-a9cd-80c867c8e956 req-dae60f21-c0de-4598-86af-91dd7ba0c449 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:09.816253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27dc958e-be81-46f2-89db-776733f89825 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:09.822348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-27dc958e-be81-46f2-89db-776733f89825 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:09.832358 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-43c34b23-68ea-4b5e-a9cd-80c867c8e956 req-dae60f21-c0de-4598-86af-91dd7ba0c449 service nova] Creating event network-changed:45588a70-346a-4df0-a818-fe5ea133697d for instance 2412dd3b-5199-44dc-b883-342893c82804 on nch1-master-1 Sep 10 20:50:09.834311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27dc958e-be81-46f2-89db-776733f89825 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.837493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27dc958e-be81-46f2-89db-776733f89825 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.838088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27dc958e-be81-46f2-89db-776733f89825 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:09.839522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27dc958e-be81-46f2-89db-776733f89825 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.839625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27dc958e-be81-46f2-89db-776733f89825 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.841630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27dc958e-be81-46f2-89db-776733f89825 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:09.855151 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-43c34b23-68ea-4b5e-a9cd-80c867c8e956 req-dae60f21-c0de-4598-86af-91dd7ba0c449 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060488 Sep 10 20:50:09.855761 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 234/521] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:09.932874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27dc958e-be81-46f2-89db-776733f89825 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:09.943415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:09.944371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:09.949161 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27dc958e-be81-46f2-89db-776733f89825 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1215 microversion: 2.1 time: 0.141744 Sep 10 20:50:09.950633 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 288/522] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:09 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:09.957563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.958152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.958740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:09.959561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:09.960035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:09.960537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:10.098171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:10.118152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-be98cfec-65a3-446e-bbbe-6de09973c2b7 req-75b1c427-1fbe-4717-b243-34f743491f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdb5cc4-af47-4827-98a3-9e8aa572868b", "name": "network-vif-plugged", "status": "completed", "tag": "586e8c3f-26b3-4849-a7dc-631285af05c5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:10.124806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:10.129723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:10.132784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-be98cfec-65a3-446e-bbbe-6de09973c2b7 req-75b1c427-1fbe-4717-b243-34f743491f42 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:10.133613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-be98cfec-65a3-446e-bbbe-6de09973c2b7 req-75b1c427-1fbe-4717-b243-34f743491f42 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:10.134315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-be98cfec-65a3-446e-bbbe-6de09973c2b7 req-75b1c427-1fbe-4717-b243-34f743491f42 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:10.142326 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ce9b8bc3-abdf-4c4d-903d-c056b3695999 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1452 microversion: 2.75 time: 0.202935 Sep 10 20:50:10.143215 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 235/523] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:09 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:50:10.195080 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-be98cfec-65a3-446e-bbbe-6de09973c2b7 req-75b1c427-1fbe-4717-b243-34f743491f42 service nova] Creating event network-vif-plugged:586e8c3f-26b3-4849-a7dc-631285af05c5 for instance 2fdb5cc4-af47-4827-98a3-9e8aa572868b on nch1-master-1 Sep 10 20:50:10.204438 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-be98cfec-65a3-446e-bbbe-6de09973c2b7 req-75b1c427-1fbe-4717-b243-34f743491f42 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091227 Sep 10 20:50:10.205350 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 289/524] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:50:10.384829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:10.386557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:10.387188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:10.387384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:10.397389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:10.397990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:10.398726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:10.399328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:10.399760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:10.403101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:10.403101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:10.404645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:10.404888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:10.405637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:10.406572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:10.410094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:10.492783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:10.493262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:10.493922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:10.494541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lazy-loading 'fault' on Instance uuid 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:10.538368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:10.549064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:10.550916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:10.558367 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ea2a810e-8fe3-4eaa-9c48-810b04f97870 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.177142 Sep 10 20:50:10.559249 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 290/525] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:10 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:10.825062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-67a3d375-5d2b-4890-841e-5833ae0e0c1d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:10.826537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-67a3d375-5d2b-4890-841e-5833ae0e0c1d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:10.835587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:10.838633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a3d375-5d2b-4890-841e-5833ae0e0c1d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:10.839449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a3d375-5d2b-4890-841e-5833ae0e0c1d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:10.840108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a3d375-5d2b-4890-841e-5833ae0e0c1d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:10.841063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a3d375-5d2b-4890-841e-5833ae0e0c1d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:10.841884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a3d375-5d2b-4890-841e-5833ae0e0c1d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:10.842612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a3d375-5d2b-4890-841e-5833ae0e0c1d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:10.865657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:10.878437 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9088b1bd-0c4f-471a-b26c-2bb650f67fa0 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1457 microversion: 2.1 time: 0.500504 Sep 10 20:50:10.886746 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 236/526] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:10 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1457 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:10.893961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:10.894778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:10.907862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:10.909931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:10.910536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:10.918062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:10.918769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:10.919369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.136115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-67a3d375-5d2b-4890-841e-5833ae0e0c1d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.146612 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-67a3d375-5d2b-4890-841e-5833ae0e0c1d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1313 microversion: 2.1 time: 0.328212 Sep 10 20:50:11.162182 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 291/527] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:10 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:50:11.162182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2e266745-85aa-4e15-935b-7d30bbe8a88f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:11.162182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2e266745-85aa-4e15-935b-7d30bbe8a88f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:11.162914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e266745-85aa-4e15-935b-7d30bbe8a88f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:11.163698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e266745-85aa-4e15-935b-7d30bbe8a88f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:11.164465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e266745-85aa-4e15-935b-7d30bbe8a88f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.165713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e266745-85aa-4e15-935b-7d30bbe8a88f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:11.166763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e266745-85aa-4e15-935b-7d30bbe8a88f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:11.166990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e266745-85aa-4e15-935b-7d30bbe8a88f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.272299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.273182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2e266745-85aa-4e15-935b-7d30bbe8a88f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.285343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.289884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.291318 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2382d62f-cd09-429c-8cf0-49ef189ee7dd tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1361 microversion: 2.25 time: 0.403553 Sep 10 20:50:11.291979 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2e266745-85aa-4e15-935b-7d30bbe8a88f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1207 microversion: 2.1 time: 0.143333 Sep 10 20:50:11.293914 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 292/528] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:11 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1207 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:11.299792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:11.300566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:11.305103 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 237/529] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:10 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:11.329712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:11.333011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:11.334299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.334722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8bcc44fe-619a-4feb-b665-6cc85e3b5059 req-907d7aab-e88f-44a5-a05a-cae11c89e6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef", "name": "network-vif-deleted", "tag": "9c727297-d15f-4723-a7ae-e66860c9a0d8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:11.341187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:11.341778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:11.342311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.353084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8bcc44fe-619a-4feb-b665-6cc85e3b5059 req-907d7aab-e88f-44a5-a05a-cae11c89e6d7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:11.362972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8bcc44fe-619a-4feb-b665-6cc85e3b5059 req-907d7aab-e88f-44a5-a05a-cae11c89e6d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:11.367328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8bcc44fe-619a-4feb-b665-6cc85e3b5059 req-907d7aab-e88f-44a5-a05a-cae11c89e6d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.391656 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8bcc44fe-619a-4feb-b665-6cc85e3b5059 req-907d7aab-e88f-44a5-a05a-cae11c89e6d7 service nova] Creating event network-vif-deleted:9c727297-d15f-4723-a7ae-e66860c9a0d8 for instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef on nch2-master-1 Sep 10 20:50:11.410050 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8bcc44fe-619a-4feb-b665-6cc85e3b5059 req-907d7aab-e88f-44a5-a05a-cae11c89e6d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101901 Sep 10 20:50:11.411133 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 238/530] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:11.526064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.547653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.554875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.568952 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b946980e-ab2c-4eb1-a1b4-d267c30fdc56 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1452 microversion: 2.75 time: 0.273591 Sep 10 20:50:11.572075 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 293/531] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:11 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1452 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:11.599959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:11.601485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:11.632065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:11.633744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:11.636103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.639409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:11.639898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:11.640519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.742686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.750927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.752452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:11.758308 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2579feba-efb4-415d-a7a2-690f9a606042 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1560 microversion: 2.91 time: 0.166584 Sep 10 20:50:11.758884 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 239/532] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:11 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:11.906786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:11.907388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:11.914053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:11.914623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:11.915132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.915914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:11.916603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:11.917160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.955241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:11.955930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:11.956519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:11.957122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lazy-loading 'fault' on Instance uuid 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:12.010323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365336e9f59e4b65ae0a05554776b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc9f18c8fd44fca98cda3832b60b26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.026184 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd7b368a-3775-4559-be6e-58f30ad19f67 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 200 len: 1309 microversion: 2.1 time: 0.123130 Sep 10 20:50:12.028390 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 294/533] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:11 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:12.173223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eaf901ad-c4b5-4545-b40a-9c4f8c73a0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:12.174152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eaf901ad-c4b5-4545-b40a-9c4f8c73a0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:12.177754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:12.190789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaf901ad-c4b5-4545-b40a-9c4f8c73a0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:12.193378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaf901ad-c4b5-4545-b40a-9c4f8c73a0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:12.193908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaf901ad-c4b5-4545-b40a-9c4f8c73a0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:12.197568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaf901ad-c4b5-4545-b40a-9c4f8c73a0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:12.198135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaf901ad-c4b5-4545-b40a-9c4f8c73a0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:12.198568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaf901ad-c4b5-4545-b40a-9c4f8c73a0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:12.320895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e114fd0-fa82-49cd-967e-f0e2753e4cd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:12.321655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e114fd0-fa82-49cd-967e-f0e2753e4cd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:12.327887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e114fd0-fa82-49cd-967e-f0e2753e4cd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:12.328381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e114fd0-fa82-49cd-967e-f0e2753e4cd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:12.328824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e114fd0-fa82-49cd-967e-f0e2753e4cd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:12.329530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e114fd0-fa82-49cd-967e-f0e2753e4cd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:12.330014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e114fd0-fa82-49cd-967e-f0e2753e4cd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:12.330688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e114fd0-fa82-49cd-967e-f0e2753e4cd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:12.463208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e114fd0-fa82-49cd-967e-f0e2753e4cd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.480188 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e114fd0-fa82-49cd-967e-f0e2753e4cd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1207 microversion: 2.1 time: 0.162004 Sep 10 20:50:12.482562 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 295/534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:12 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1207 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:50:12.496616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:12.497808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:12.500741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eaf901ad-c4b5-4545-b40a-9c4f8c73a0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.511118 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eaf901ad-c4b5-4545-b40a-9c4f8c73a0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1313 microversion: 2.1 time: 0.339895 Sep 10 20:50:12.512326 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 240/535] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:12 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:12.518885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:12.520938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:12.521306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:12.525919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:12.526461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:12.528991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:12.605662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:12.606549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:12.613991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:12.615350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:12.616035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:12.616857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:12.617422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:12.618209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:12.745029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.753450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.760424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.762020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.763203 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ddda8e5a-f8ff-4227-abcb-038dc6f662e4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1361 microversion: 2.25 time: 0.279641 Sep 10 20:50:12.764870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.767853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.776835 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-19cfb539-97a1-47ad-b2e4-236a50ac36e0 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1437 microversion: 2.75 time: 0.175123 Sep 10 20:50:12.778394 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 241/536] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:12 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1437 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:50:12.779645 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 296/537] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:12 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:12.798638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:12.799295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:12.812770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:12.812896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:12.813416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:12.814197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:12.814658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:12.815123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:12.936308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.945631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.948238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:12.957335 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-af258632-2ce2-4faf-9d49-b9216aafa74d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.162933 Sep 10 20:50:12.959219 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 242/538] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:12 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:12.994045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:12.997400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:13.004649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.005704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.007100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.008528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.009061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.009421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.061808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:13.062829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:13.072190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.072953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.073584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.075046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.075694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.076333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.111495 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] HTTP exception thrown: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Request method failure captured: Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef HTTP/1.1 Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhHzlOi0BL4O9dIUGz8AnCUPMBn0htSEmSX97ioJkiiYdx0tBpg1yvaIiPH62ENa6HndWeuqlBtEu8kaL2U2DfVOl5yABKACwfqbk444NCFsvsvWvw-CxsaQP2ASCknhkxunY5oStb_3ofport7ekw0w_fPACL0tGDQaiOYXxdvZIE Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:50:13.138360 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cc9f18c8fd44fca98cda3832b60b26d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cc9f18c8fd44fca98cda3832b60b26d"}]}] Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 365336e9f59e4b65ae0a05554776b0ff Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.139761 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef'} Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:13.140525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.141675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.152778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Returning 404 to user: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:13.156360 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b3dee6c1-570b-4e14-8a26-7bd6beaaaf33 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 404 len: 111 microversion: 2.1 time: 0.101104 Sep 10 20:50:13.157208 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 243/539] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:13 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:13.176140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:13.181063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:13.202866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.203879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:50:13.218652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:50:13.220003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:50:13.221565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:50:13.222327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.223578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.226823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:50:13.227932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.234689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.237261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.305785 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] HTTP exception thrown: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Request method failure captured: Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef HTTP/1.1 Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhHzlOi0BL4O9dIUGz8AnCUPMBn0htSEmSX97ioJkiiYdx0tBpg1yvaIiPH62ENa6HndWeuqlBtEu8kaL2U2DfVOl5yABKACwfqbk444NCFsvsvWvw-CxsaQP2ASCknhkxunY5oStb_3ofport7ekw0w_fPACL0tGDQaiOYXxdvZIE Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:50:13.313995 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cc9f18c8fd44fca98cda3832b60b26d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cc9f18c8fd44fca98cda3832b60b26d"}]}] Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 365336e9f59e4b65ae0a05554776b0ff Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.315549 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef'} Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:13.316392 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.318234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.323718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Returning 404 to user: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:13.324726 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-83bb407e-9fe3-4735-93e7-83d89dbc4d1f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 404 len: 111 microversion: 2.1 time: 0.160567 Sep 10 20:50:13.328727 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 244/540] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:50:13 2022] DELETE /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:13.358928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:13.359897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:13.379214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.382444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.383218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.386177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.387925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.388450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.429513 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] HTTP exception thrown: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Request method failure captured: Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef HTTP/1.1 Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhHzlOi0BL4O9dIUGz8AnCUPMBn0htSEmSX97ioJkiiYdx0tBpg1yvaIiPH62ENa6HndWeuqlBtEu8kaL2U2DfVOl5yABKACwfqbk444NCFsvsvWvw-CxsaQP2ASCknhkxunY5oStb_3ofport7ekw0w_fPACL0tGDQaiOYXxdvZIE Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:50:13.431854 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cc9f18c8fd44fca98cda3832b60b26d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cc9f18c8fd44fca98cda3832b60b26d"}]}] Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 365336e9f59e4b65ae0a05554776b0ff Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.433334 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef'} Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:13.434189 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. Sep 10 20:50:13.435481 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.436862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Returning 404 to user: Instance 55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:13.441173 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-12dc1dd3-7d73-4fe3-b7fd-6a4ff21db22f tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef" status: 404 len: 111 microversion: 2.1 time: 0.107282 Sep 10 20:50:13.446482 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 245/541] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:13 2022] GET /compute/v2.1/servers/55f202fe-ad6c-46ae-8871-f7cd9aa1b3ef => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:13.447838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:13.460746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:13.460746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:13.463042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.463843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.464500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.471185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.471922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.472375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.502734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.503328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.513231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.514071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.520025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.520583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.577721 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] HTTP exception thrown: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Request method failure captured: Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea HTTP/1.1 Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhHzlOi0BL4O9dIUGz8AnCUPMBn0htSEmSX97ioJkiiYdx0tBpg1yvaIiPH62ENa6HndWeuqlBtEu8kaL2U2DfVOl5yABKACwfqbk444NCFsvsvWvw-CxsaQP2ASCknhkxunY5oStb_3ofport7ekw0w_fPACL0tGDQaiOYXxdvZIE Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:50:13.579326 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cc9f18c8fd44fca98cda3832b60b26d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cc9f18c8fd44fca98cda3832b60b26d"}]}] Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 365336e9f59e4b65ae0a05554776b0ff Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:50:13.580686 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '9c591752-6514-4202-a477-4d70ffac9dea'} Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:13.581389 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:50:13.582572 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.584365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Returning 404 to user: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:13.584365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dac90a34-c3f3-44f9-b32e-4eadbdaed8d5 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 404 len: 111 microversion: 2.1 time: 0.126096 Sep 10 20:50:13.584365 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 246/542] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:50:13 2022] DELETE /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:13.613526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-48499825-d361-48b9-9f5d-9b61794dcdbb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:13.614276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-48499825-d361-48b9-9f5d-9b61794dcdbb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:13.634580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48499825-d361-48b9-9f5d-9b61794dcdbb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.638518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48499825-d361-48b9-9f5d-9b61794dcdbb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.639013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48499825-d361-48b9-9f5d-9b61794dcdbb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.642634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48499825-d361-48b9-9f5d-9b61794dcdbb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.643370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48499825-d361-48b9-9f5d-9b61794dcdbb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.644971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48499825-d361-48b9-9f5d-9b61794dcdbb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.675200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:13.718862 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5bec9d50-ec5f-41b0-aaee-6ea7a455578b tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a/action" status: 202 len: 1940 microversion: 2.75 time: 0.913069 Sep 10 20:50:13.720066 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 297/543] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:50:12 2022] POST /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a/action => generated 1940 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 20:50:13.741817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7cb2ffec-9ae8-4898-9a51-340fbf5a33c1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:13.742738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7cb2ffec-9ae8-4898-9a51-340fbf5a33c1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:13.752491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb2ffec-9ae8-4898-9a51-340fbf5a33c1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.757474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb2ffec-9ae8-4898-9a51-340fbf5a33c1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.758204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb2ffec-9ae8-4898-9a51-340fbf5a33c1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.759319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb2ffec-9ae8-4898-9a51-340fbf5a33c1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.759993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb2ffec-9ae8-4898-9a51-340fbf5a33c1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.760627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb2ffec-9ae8-4898-9a51-340fbf5a33c1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.861544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-48499825-d361-48b9-9f5d-9b61794dcdbb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:13.871254 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-48499825-d361-48b9-9f5d-9b61794dcdbb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1263 microversion: 2.1 time: 0.288948 Sep 10 20:50:13.883862 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 247/544] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:13 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1263 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:13.905799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:13.906764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] [instance: 9c591752-6514-4202-a477-4d70ffac9dea] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:13.919714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.919714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.924837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.926911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:13.927976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:13.928430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:13.946872 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] HTTP exception thrown: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Request method failure captured: Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea HTTP/1.1 Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhHzlOi0BL4O9dIUGz8AnCUPMBn0htSEmSX97ioJkiiYdx0tBpg1yvaIiPH62ENa6HndWeuqlBtEu8kaL2U2DfVOl5yABKACwfqbk444NCFsvsvWvw-CxsaQP2ASCknhkxunY5oStb_3ofport7ekw0w_fPACL0tGDQaiOYXxdvZIE Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:50:13.948650 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cc9f18c8fd44fca98cda3832b60b26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cc9f18c8fd44fca98cda3832b60b26d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cc9f18c8fd44fca98cda3832b60b26d"}]}] Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5cc9f18c8fd44fca98cda3832b60b26d Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-590320794 Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 365336e9f59e4b65ae0a05554776b0ff Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersAdminTestJSON-590320794-project Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:50:13.950023 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '9c591752-6514-4202-a477-4d70ffac9dea'} Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:13.950767 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. Sep 10 20:50:13.951914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:13.955486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] Returning 404 to user: Instance 9c591752-6514-4202-a477-4d70ffac9dea could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:13.957607 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a090c512-3bab-486a-81b4-2f9528ec9111 tempest-DeleteServersAdminTestJSON-590320794 tempest-DeleteServersAdminTestJSON-590320794-project] 10.222.0.33 "GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea" status: 404 len: 111 microversion: 2.1 time: 0.072388 Sep 10 20:50:13.959043 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 248/545] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:13 2022] GET /compute/v2.1/servers/9c591752-6514-4202-a477-4d70ffac9dea => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:13.982490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d7e41a04-b146-4edb-8fca-6da0090350dd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:13.984493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d7e41a04-b146-4edb-8fca-6da0090350dd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:14.013424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7e41a04-b146-4edb-8fca-6da0090350dd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:14.014214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7e41a04-b146-4edb-8fca-6da0090350dd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:14.014845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7e41a04-b146-4edb-8fca-6da0090350dd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:14.016402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7e41a04-b146-4edb-8fca-6da0090350dd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:14.017087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7e41a04-b146-4edb-8fca-6da0090350dd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:14.018521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7e41a04-b146-4edb-8fca-6da0090350dd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:14.269741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-d7e41a04-b146-4edb-8fca-6da0090350dd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:14.313311 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d7e41a04-b146-4edb-8fca-6da0090350dd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.352638 Sep 10 20:50:14.316979 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 249/546] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:13 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:14.325912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:14.326063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:14.349435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:14.359349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:14.360420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:14.361359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:14.362303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:14.363482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:14.738331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:14.759534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:14.762103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:14.763428 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ae70f82-46c4-44c4-8b1d-701dda095d57 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1361 microversion: 2.25 time: 0.441967 Sep 10 20:50:14.771613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7cb2ffec-9ae8-4898-9a51-340fbf5a33c1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:14.779512 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 250/547] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:14 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1361 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:14.781628 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7cb2ffec-9ae8-4898-9a51-340fbf5a33c1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1463 microversion: 2.1 time: 1.060041 Sep 10 20:50:14.783029 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 298/548] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:13 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1463 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:14.789439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:14.790329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:14.790980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0aee8ee1-d984-4f7d-831c-d0faa382aad6 req-faf8c14b-f911-4367-97b7-5acee4b70102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e", "name": "network-vif-plugged", "status": "completed", "tag": "185a5cc6-4ac2-4e93-b345-1aad5abefc23"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:14.812011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0aee8ee1-d984-4f7d-831c-d0faa382aad6 req-faf8c14b-f911-4367-97b7-5acee4b70102 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:14.812543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0aee8ee1-d984-4f7d-831c-d0faa382aad6 req-faf8c14b-f911-4367-97b7-5acee4b70102 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:14.812662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:14.813030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0aee8ee1-d984-4f7d-831c-d0faa382aad6 req-faf8c14b-f911-4367-97b7-5acee4b70102 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:14.813156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:14.824463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:14.825443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:14.826099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:14.827159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:14.827597 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0aee8ee1-d984-4f7d-831c-d0faa382aad6 req-faf8c14b-f911-4367-97b7-5acee4b70102 service nova] Creating event network-vif-plugged:185a5cc6-4ac2-4e93-b345-1aad5abefc23 for instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e on nch2-master-1 Sep 10 20:50:14.834190 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0aee8ee1-d984-4f7d-831c-d0faa382aad6 req-faf8c14b-f911-4367-97b7-5acee4b70102 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053314 Sep 10 20:50:14.835365 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 251/549] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:14.843472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f16941a2-f58a-40a0-87f0-0a5b9935e0ea tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:14.844580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f16941a2-f58a-40a0-87f0-0a5b9935e0ea tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:14.852752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f16941a2-f58a-40a0-87f0-0a5b9935e0ea tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:14.853581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f16941a2-f58a-40a0-87f0-0a5b9935e0ea tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:14.854339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f16941a2-f58a-40a0-87f0-0a5b9935e0ea tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:14.855664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f16941a2-f58a-40a0-87f0-0a5b9935e0ea tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:14.856500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f16941a2-f58a-40a0-87f0-0a5b9935e0ea tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:14.857185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f16941a2-f58a-40a0-87f0-0a5b9935e0ea tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:14.956293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:14.998351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:15.001244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:15.014342 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f379a372-969c-4c1d-b424-dea4d2e34dc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.229551 Sep 10 20:50:15.014957 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 299/550] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:14 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:15.023219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b79057f-eeb4-4885-9cc6-c00a561ff91d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:15.024339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5b79057f-eeb4-4885-9cc6-c00a561ff91d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:15.033089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b79057f-eeb4-4885-9cc6-c00a561ff91d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:15.033673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b79057f-eeb4-4885-9cc6-c00a561ff91d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:15.034217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b79057f-eeb4-4885-9cc6-c00a561ff91d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:15.035000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b79057f-eeb4-4885-9cc6-c00a561ff91d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:15.035446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b79057f-eeb4-4885-9cc6-c00a561ff91d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:15.035995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b79057f-eeb4-4885-9cc6-c00a561ff91d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:15.043204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:15.220202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5b79057f-eeb4-4885-9cc6-c00a561ff91d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:15.232250 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5b79057f-eeb4-4885-9cc6-c00a561ff91d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1269 microversion: 2.1 time: 0.216174 Sep 10 20:50:15.248396 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 300/551] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:15 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1269 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:15.354506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-08807ec3-b371-457d-9174-0a5370fcdc22 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:15.355160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-08807ec3-b371-457d-9174-0a5370fcdc22 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:15.369231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08807ec3-b371-457d-9174-0a5370fcdc22 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:15.369731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08807ec3-b371-457d-9174-0a5370fcdc22 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:15.370185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08807ec3-b371-457d-9174-0a5370fcdc22 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:15.370893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08807ec3-b371-457d-9174-0a5370fcdc22 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:15.371344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08807ec3-b371-457d-9174-0a5370fcdc22 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:15.371763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08807ec3-b371-457d-9174-0a5370fcdc22 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:15.561169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f16941a2-f58a-40a0-87f0-0a5b9935e0ea tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:15.573466 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f16941a2-f58a-40a0-87f0-0a5b9935e0ea tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1461 microversion: 2.1 time: 0.736617 Sep 10 20:50:15.575928 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 252/552] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:14 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1461 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:15.675412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-08807ec3-b371-457d-9174-0a5370fcdc22 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:15.712026 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-08807ec3-b371-457d-9174-0a5370fcdc22 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.364363 Sep 10 20:50:15.714705 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 301/553] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:15 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:50:15.795443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:15.796113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:15.811791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:15.812483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:15.813958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:15.815017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:15.818503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:15.823326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:15.877013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-659586587", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d3dd2771-3e57-4798-ab1e-c16e724ad6f4"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:15.996592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:50:16.401779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:16.430457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:16.432044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:16.433215 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0394a561-3a1f-482c-bf36-6e611fd26b94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1361 microversion: 2.25 time: 0.641713 Sep 10 20:50:16.450285 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 253/554] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:15 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1361 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:16.456888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:16.460645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:16.487082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:16.489582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:16.491620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:16.492952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:16.495575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:16.497419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:16.616184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:50:16.616755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:50:16.617244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:50:16.617658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:50:16.618096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:50:16.640995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:16.641498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:16.644915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:16.648159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:16.649837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:16.651004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:16.685596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Getting quotas for project 5580128bff364c858eafedcc84dad425. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:50:16.690937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Getting quotas for user cbabc9a296d14628b649da7d81bc8766 and project 5580128bff364c858eafedcc84dad425. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:50:16.707937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:50:16.710797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:50:16.778697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:16.783641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:16.795664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:16.797855 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6b09f834-e4f9-4f99-8ed1-a556eae528cb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924659 Sep 10 20:50:16.799107 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 302/555] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:50:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:50:16.808152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:16.826876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-99fed551-e2ce-4a8c-9155-818c8c8e5edb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:16.831670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99fed551-e2ce-4a8c-9155-818c8c8e5edb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:16.838164 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-42c07430-d6a3-4c89-a74f-7718526c88ba tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.394698 Sep 10 20:50:16.845740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99fed551-e2ce-4a8c-9155-818c8c8e5edb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:16.846503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99fed551-e2ce-4a8c-9155-818c8c8e5edb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:16.847151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99fed551-e2ce-4a8c-9155-818c8c8e5edb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:16.848213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99fed551-e2ce-4a8c-9155-818c8c8e5edb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:16.849693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99fed551-e2ce-4a8c-9155-818c8c8e5edb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:16.850604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99fed551-e2ce-4a8c-9155-818c8c8e5edb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:16.859104 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 254/556] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:16 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:16.892500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-edf9a3f2-fb92-409f-a0d7-dedd964a7e5d tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:16.893427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-edf9a3f2-fb92-409f-a0d7-dedd964a7e5d tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:16.914506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edf9a3f2-fb92-409f-a0d7-dedd964a7e5d tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:16.915484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edf9a3f2-fb92-409f-a0d7-dedd964a7e5d tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:16.916131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edf9a3f2-fb92-409f-a0d7-dedd964a7e5d tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:16.918113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edf9a3f2-fb92-409f-a0d7-dedd964a7e5d tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:16.918740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edf9a3f2-fb92-409f-a0d7-dedd964a7e5d tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:16.919340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edf9a3f2-fb92-409f-a0d7-dedd964a7e5d tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:17.114123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-edf9a3f2-fb92-409f-a0d7-dedd964a7e5d tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:17.148583 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-edf9a3f2-fb92-409f-a0d7-dedd964a7e5d tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.287320 Sep 10 20:50:17.149745 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 255/557] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:16 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:17.155513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e1059dc-3c0d-4549-8bf9-21a2fd2826e0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:17.156347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e1059dc-3c0d-4549-8bf9-21a2fd2826e0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:17.301238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e1059dc-3c0d-4549-8bf9-21a2fd2826e0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:17.319065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99fed551-e2ce-4a8c-9155-818c8c8e5edb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:17.323928 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e1059dc-3c0d-4549-8bf9-21a2fd2826e0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1213 microversion: 2.1 time: 0.170212 Sep 10 20:50:17.326064 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 256/558] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:17 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1213 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:17.344422 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-99fed551-e2ce-4a8c-9155-818c8c8e5edb tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1311 microversion: 2.1 time: 0.544009 Sep 10 20:50:17.357944 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 303/559] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:16 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1311 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:17.478691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:17.479699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:17.494298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:17.495212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:17.496186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:17.497478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:17.506431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:17.509893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:17.879425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:17.899013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:17.920410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:17.926389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:17.928993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:17.930408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:17.932042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:17.932919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.090249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:18.108650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:18.110697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:18.115844 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3d3477a9-d9a4-4221-a40c-4a803b8dfb8c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1557 microversion: 2.25 time: 0.638214 Sep 10 20:50:18.117065 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 257/560] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:17 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1557 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:18.122465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-5a5cdef4-1a83-428a-8f4d-fc9f6f374ed5 req-ff2af524-eaca-4d6e-9cdc-33c9c6e275d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09798018-2269-451d-8486-df991ba45b0c", "tag": "815af22b-692f-4103-b475-aa7f8e8118cd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:18.132791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:18.135241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5a5cdef4-1a83-428a-8f4d-fc9f6f374ed5 req-ff2af524-eaca-4d6e-9cdc-33c9c6e275d7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.135912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5a5cdef4-1a83-428a-8f4d-fc9f6f374ed5 req-ff2af524-eaca-4d6e-9cdc-33c9c6e275d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.136531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5a5cdef4-1a83-428a-8f4d-fc9f6f374ed5 req-ff2af524-eaca-4d6e-9cdc-33c9c6e275d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.151591 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-5a5cdef4-1a83-428a-8f4d-fc9f6f374ed5 req-ff2af524-eaca-4d6e-9cdc-33c9c6e275d7 service nova] Creating event network-changed:815af22b-692f-4103-b475-aa7f8e8118cd for instance 09798018-2269-451d-8486-df991ba45b0c on nch1-master-1 Sep 10 20:50:18.157617 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-5a5cdef4-1a83-428a-8f4d-fc9f6f374ed5 req-ff2af524-eaca-4d6e-9cdc-33c9c6e275d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039197 Sep 10 20:50:18.158953 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 258/561] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:18.166934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a11f362-6be0-4ac8-bd49-f8e4ca63cb28 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:18.167831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a11f362-6be0-4ac8-bd49-f8e4ca63cb28 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:18.174996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a11f362-6be0-4ac8-bd49-f8e4ca63cb28 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.175666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a11f362-6be0-4ac8-bd49-f8e4ca63cb28 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.176627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a11f362-6be0-4ac8-bd49-f8e4ca63cb28 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.177572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a11f362-6be0-4ac8-bd49-f8e4ca63cb28 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.178416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a11f362-6be0-4ac8-bd49-f8e4ca63cb28 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.178854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a11f362-6be0-4ac8-bd49-f8e4ca63cb28 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.228566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:18.245815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:18.251431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:18.272385 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-28e8caad-a1f5-439c-a48f-f250fab13b6b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.395588 Sep 10 20:50:18.274790 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 304/562] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:17 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:18.289180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-285b08a0-4e39-4fbb-b96e-a2fb38518195 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:18.290803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-285b08a0-4e39-4fbb-b96e-a2fb38518195 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:18.308055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-285b08a0-4e39-4fbb-b96e-a2fb38518195 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.308618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-285b08a0-4e39-4fbb-b96e-a2fb38518195 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.309063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-285b08a0-4e39-4fbb-b96e-a2fb38518195 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.314355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-285b08a0-4e39-4fbb-b96e-a2fb38518195 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.314844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-285b08a0-4e39-4fbb-b96e-a2fb38518195 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.316047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-285b08a0-4e39-4fbb-b96e-a2fb38518195 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.443441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-7a11f362-6be0-4ac8-bd49-f8e4ca63cb28 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:18.460843 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a11f362-6be0-4ac8-bd49-f8e4ca63cb28 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 2049 microversion: 2.25 time: 0.300337 Sep 10 20:50:18.462083 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 259/563] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:18 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 2049 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:18.480013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a62e2f54-bb10-4634-a5ad-1a71498312a0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:18.481868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a62e2f54-bb10-4634-a5ad-1a71498312a0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:18.489900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a62e2f54-bb10-4634-a5ad-1a71498312a0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.490600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a62e2f54-bb10-4634-a5ad-1a71498312a0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.491202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a62e2f54-bb10-4634-a5ad-1a71498312a0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.492095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a62e2f54-bb10-4634-a5ad-1a71498312a0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.492713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a62e2f54-bb10-4634-a5ad-1a71498312a0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.493302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a62e2f54-bb10-4634-a5ad-1a71498312a0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.617743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-285b08a0-4e39-4fbb-b96e-a2fb38518195 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:18.662760 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-285b08a0-4e39-4fbb-b96e-a2fb38518195 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.385126 Sep 10 20:50:18.664266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a62e2f54-bb10-4634-a5ad-1a71498312a0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:18.680234 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 305/564] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:18 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:18.693807 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a62e2f54-bb10-4634-a5ad-1a71498312a0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1265 microversion: 2.1 time: 0.229372 Sep 10 20:50:18.706794 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 260/565] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:18 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:18.714233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-165a4645-c51e-4679-aeee-2b86851ec563 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:18.715764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-165a4645-c51e-4679-aeee-2b86851ec563 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:18.718393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3480fb13-5dcd-4d30-b06f-20f0252666fa tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:18.719216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3480fb13-5dcd-4d30-b06f-20f0252666fa tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:18.726732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3480fb13-5dcd-4d30-b06f-20f0252666fa tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.727565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3480fb13-5dcd-4d30-b06f-20f0252666fa tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.728221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3480fb13-5dcd-4d30-b06f-20f0252666fa tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.729163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3480fb13-5dcd-4d30-b06f-20f0252666fa tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.729960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3480fb13-5dcd-4d30-b06f-20f0252666fa tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.730603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3480fb13-5dcd-4d30-b06f-20f0252666fa tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.751065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165a4645-c51e-4679-aeee-2b86851ec563 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.752523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165a4645-c51e-4679-aeee-2b86851ec563 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.756454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165a4645-c51e-4679-aeee-2b86851ec563 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:18.759732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165a4645-c51e-4679-aeee-2b86851ec563 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:18.771935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165a4645-c51e-4679-aeee-2b86851ec563 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:18.774840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165a4645-c51e-4679-aeee-2b86851ec563 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:19.178743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-165a4645-c51e-4679-aeee-2b86851ec563 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:19.195593 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-165a4645-c51e-4679-aeee-2b86851ec563 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1311 microversion: 2.1 time: 0.513952 Sep 10 20:50:19.211975 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 306/566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:18 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1311 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:19.294210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-3480fb13-5dcd-4d30-b06f-20f0252666fa tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:19.319099 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3480fb13-5dcd-4d30-b06f-20f0252666fa tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 2049 microversion: 2.25 time: 0.610920 Sep 10 20:50:19.319687 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 261/567] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:18 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 2049 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:19.343110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:19.354812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:19.370794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:19.371271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:19.371722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:19.372465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:19.372915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:19.377849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:19.535488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:19.548193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:19.552409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:19.562601 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be54ced4-8e5f-4ef7-b65a-c82d686b4b58 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.241856 Sep 10 20:50:19.564278 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 262/568] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:19 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:19.573998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-779ecfeb-b3ca-496b-8e57-d23deb0d9244 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:19.578391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-779ecfeb-b3ca-496b-8e57-d23deb0d9244 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:19.579091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-779ecfeb-b3ca-496b-8e57-d23deb0d9244 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:19.579733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-779ecfeb-b3ca-496b-8e57-d23deb0d9244 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:19.580687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-779ecfeb-b3ca-496b-8e57-d23deb0d9244 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:19.581396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-779ecfeb-b3ca-496b-8e57-d23deb0d9244 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:19.582096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-779ecfeb-b3ca-496b-8e57-d23deb0d9244 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:19.613533 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-779ecfeb-b3ca-496b-8e57-d23deb0d9244 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042949 Sep 10 20:50:19.615075 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 263/569] 10.222.0.33 () {60 vars in 1217 bytes} [Sat Sep 10 20:50:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:50:19.635513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-00627401-992f-44a4-b5f3-d94c9e2461da tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:19.637042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-00627401-992f-44a4-b5f3-d94c9e2461da tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:19.653343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00627401-992f-44a4-b5f3-d94c9e2461da tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:19.655305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00627401-992f-44a4-b5f3-d94c9e2461da tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:19.658036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00627401-992f-44a4-b5f3-d94c9e2461da tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:19.659039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00627401-992f-44a4-b5f3-d94c9e2461da tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:19.660661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00627401-992f-44a4-b5f3-d94c9e2461da tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:19.662363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00627401-992f-44a4-b5f3-d94c9e2461da tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:19.769936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a274fbe0-22f3-41c5-92c8-2652a3ea4840 tempest-ListImageFiltersNegativeTestJSON-1125379513 tempest-ListImageFiltersNegativeTestJSON-1125379513-project] Calling method '.version_select at 0x7f9945052dc0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:19.814976 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-00627401-992f-44a4-b5f3-d94c9e2461da tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e/action" status: 202 len: 0 microversion: 2.25 time: 0.188705 Sep 10 20:50:19.824318 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 264/570] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:50:19 2022] POST /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:50:19.825190 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-a274fbe0-22f3-41c5-92c8-2652a3ea4840 tempest-ListImageFiltersNegativeTestJSON-1125379513 tempest-ListImageFiltersNegativeTestJSON-1125379513-project] HTTP exception thrown: Image not found. Sep 10 20:50:19.831089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8ce02a32-c94f-43af-a01b-bc5196f3da08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:19.831957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8ce02a32-c94f-43af-a01b-bc5196f3da08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a274fbe0-22f3-41c5-92c8-2652a3ea4840 tempest-ListImageFiltersNegativeTestJSON-1125379513 tempest-ListImageFiltersNegativeTestJSON-1125379513-project] Request method failure captured: Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/images/56b04a3d-3a18-49e8-b8f5-54ed63f08d1d HTTP/1.1 Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPiLzRx7TFLY6oDfYrfnQ8Sm7dAzVFk6EFyY4l8hWSC5-FAkw6qP-YnlHFP8ZXLRd3WruX3jphF7fssCQy9YDAhedSLb2vS3GZMy35gy4A3QzXcEhnaWIhKwH4JpGZLgj5d9DdnXZI_m27k7T-Isq4VX-zmnE2bzLStxoqkgmK3YT2c Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: fbd06bf7cc9343e39cd68fff20f494a0 Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1125379513 Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:50:19.837144 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbd06bf7cc9343e39cd68fff20f494a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbd06bf7cc9343e39cd68fff20f494a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbd06bf7cc9343e39cd68fff20f494a0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbd06bf7cc9343e39cd68fff20f494a0"}]}] Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1125379513 Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: fbd06bf7cc9343e39cd68fff20f494a0 Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1125379513 Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ListImageFiltersNegativeTestJSON-1125379513-project Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 58e806c703214b11a5bb61cc7a7f95e6 Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1125379513-project Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '56b04a3d-3a18-49e8-b8f5-54ed63f08d1d'} Sep 10 20:50:19.838784 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:50:19.839730 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 56b04a3d-3a18-49e8-b8f5-54ed63f08d1d Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:50:19.841031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 56b04a3d-3a18-49e8-b8f5-54ed63f08d1d could not be found. Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:50:19.843182 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:19.845893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a274fbe0-22f3-41c5-92c8-2652a3ea4840 tempest-ListImageFiltersNegativeTestJSON-1125379513 tempest-ListImageFiltersNegativeTestJSON-1125379513-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:19.847996 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a274fbe0-22f3-41c5-92c8-2652a3ea4840 tempest-ListImageFiltersNegativeTestJSON-1125379513 tempest-ListImageFiltersNegativeTestJSON-1125379513-project] 10.222.0.33 "GET /compute/v2.1/images/56b04a3d-3a18-49e8-b8f5-54ed63f08d1d" status: 404 len: 62 microversion: 2.1 time: 0.582691 Sep 10 20:50:19.847996 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 307/571] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:50:19 2022] GET /compute/v2.1/images/56b04a3d-3a18-49e8-b8f5-54ed63f08d1d => generated 62 bytes in 593 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:50:19.852066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ce02a32-c94f-43af-a01b-bc5196f3da08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:19.852827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ce02a32-c94f-43af-a01b-bc5196f3da08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:19.853448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ce02a32-c94f-43af-a01b-bc5196f3da08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:19.854403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ce02a32-c94f-43af-a01b-bc5196f3da08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:19.855043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ce02a32-c94f-43af-a01b-bc5196f3da08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:19.855201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6dd2cb49-70af-4573-9a46-aacafaed5b42 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:19.855803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6dd2cb49-70af-4573-9a46-aacafaed5b42 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:19.856080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ce02a32-c94f-43af-a01b-bc5196f3da08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:19.912652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dd2cb49-70af-4573-9a46-aacafaed5b42 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:19.913172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dd2cb49-70af-4573-9a46-aacafaed5b42 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:19.913624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dd2cb49-70af-4573-9a46-aacafaed5b42 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:19.918287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dd2cb49-70af-4573-9a46-aacafaed5b42 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:19.918973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dd2cb49-70af-4573-9a46-aacafaed5b42 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:19.919576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dd2cb49-70af-4573-9a46-aacafaed5b42 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:20.035666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6dd2cb49-70af-4573-9a46-aacafaed5b42 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:20.046451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-8ce02a32-c94f-43af-a01b-bc5196f3da08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:20.053021 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6dd2cb49-70af-4573-9a46-aacafaed5b42 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1271 microversion: 2.1 time: 0.198379 Sep 10 20:50:20.055854 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 308/572] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:19 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:20.067853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91b04183-a775-4045-b113-29e03a46376b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:20.069352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-91b04183-a775-4045-b113-29e03a46376b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:20.080395 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8ce02a32-c94f-43af-a01b-bc5196f3da08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.254156 Sep 10 20:50:20.081333 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 265/573] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:19 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:20.095267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91b04183-a775-4045-b113-29e03a46376b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:20.096475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91b04183-a775-4045-b113-29e03a46376b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:20.097615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91b04183-a775-4045-b113-29e03a46376b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:20.099352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91b04183-a775-4045-b113-29e03a46376b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:20.100385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91b04183-a775-4045-b113-29e03a46376b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:20.101040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91b04183-a775-4045-b113-29e03a46376b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:20.438730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-91b04183-a775-4045-b113-29e03a46376b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:20.499825 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91b04183-a775-4045-b113-29e03a46376b tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 2054 microversion: 2.25 time: 0.438597 Sep 10 20:50:20.500462 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 309/574] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:20 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 2054 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:20.506279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4ef9f79b-9f28-4b3a-a962-9e4d2715265c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:20.507117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4ef9f79b-9f28-4b3a-a962-9e4d2715265c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:20.514369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef9f79b-9f28-4b3a-a962-9e4d2715265c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:20.518489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef9f79b-9f28-4b3a-a962-9e4d2715265c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:20.519167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef9f79b-9f28-4b3a-a962-9e4d2715265c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:20.520069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef9f79b-9f28-4b3a-a962-9e4d2715265c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:20.520775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef9f79b-9f28-4b3a-a962-9e4d2715265c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:20.521397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef9f79b-9f28-4b3a-a962-9e4d2715265c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:20.710213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-962996e2-ce00-48b9-aaee-0dee383e3625 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1486915017", "ram": 512, "vcpus": 1, "disk": 10, "id": 371571363, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:20.742606 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-962996e2-ce00-48b9-aaee-0dee383e3625 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.616793 Sep 10 20:50:20.743820 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 266/575] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:50:20 2022] POST /compute/v2.1/flavors => generated 413 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:20.757233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:20.757871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:20.773706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:20.774230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:20.774775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:20.775498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:20.775950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:20.779374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:20.834096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4ef9f79b-9f28-4b3a-a962-9e4d2715265c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:20.843894 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4ef9f79b-9f28-4b3a-a962-9e4d2715265c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1311 microversion: 2.1 time: 0.341760 Sep 10 20:50:20.844483 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 310/576] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:20 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1311 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:20.952346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:20.974755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:20.976860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:20.986293 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b2bfa298-2cca-4d56-89bf-531950c142c5 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.241305 Sep 10 20:50:20.988253 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 267/577] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:20 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:21.081265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a9d2a7c3-a5c9-466b-9008-0dbec680a813 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:21.081911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9d2a7c3-a5c9-466b-9008-0dbec680a813 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:21.089284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d2a7c3-a5c9-466b-9008-0dbec680a813 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:21.090157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d2a7c3-a5c9-466b-9008-0dbec680a813 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:21.090710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d2a7c3-a5c9-466b-9008-0dbec680a813 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:21.091523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d2a7c3-a5c9-466b-9008-0dbec680a813 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:21.092084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d2a7c3-a5c9-466b-9008-0dbec680a813 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:21.092807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d2a7c3-a5c9-466b-9008-0dbec680a813 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:21.142824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f8a97fb-c459-4af9-91d2-431ce36dfc42 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:21.158845 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-3f8a97fb-c459-4af9-91d2-431ce36dfc42 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] HTTP exception thrown: Flavor 371571363 has no extra specs with key hw:cpu_thread_policy. Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f8a97fb-c459-4af9-91d2-431ce36dfc42 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Request method failure captured: Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/flavors/371571363/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPiKQfqKpenNHyjd_dfzOvOTwZtVbPe_iIy5xDoKsXkxsRCn-pg3UjcIvENrlwbJzqCOyl1UB6UU3O_4zUrjAmxtv26XqtPXsG8NDF2NCD4j01sqQwkhNIBayD8RoXc1mLU0y6ccaxRFGG0zEQ6CZpAVDTlcWek1aP-ART0-GeYi-Wg Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 046393a40a784a2caaa40331e861ab78 Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:50:21.160931 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/046393a40a784a2caaa40331e861ab78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/046393a40a784a2caaa40331e861ab78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_046393a40a784a2caaa40331e861ab78", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/046393a40a784a2caaa40331e861ab78"}]}] Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 046393a40a784a2caaa40331e861ab78 Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: aa9e19a592e34a9ab3f4ab6f4d0b6ea8 Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:50:21.163062 ncdv-master-1 devstack@n-api.service[145771]: exception: Flavor 371571363 has no extra specs with key hw:cpu_thread_policy. Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'flavor_id': '371571363', 'id': 'hw:cpu_thread_policy'} Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 371571363 has no extra specs with key hw:cpu_thread_policy. Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:21.163769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.165171 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.165171 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.165171 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.165171 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:21.165171 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:21.165171 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 371571363 has no extra specs with key hw:cpu_thread_policy. Sep 10 20:50:21.165171 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.166873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f8a97fb-c459-4af9-91d2-431ce36dfc42 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Returning 404 to user: Flavor 371571363 has no extra specs with key hw:cpu_thread_policy. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:21.167945 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f8a97fb-c459-4af9-91d2-431ce36dfc42 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] 10.222.0.33 "GET /compute/v2.1/flavors/371571363/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.308880 Sep 10 20:50:21.169015 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 311/578] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:50:20 2022] GET /compute/v2.1/flavors/371571363/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 310 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:21.173884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-553baa5f-bb58-4ab0-85cb-c167d02e6466 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:21.174746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-553baa5f-bb58-4ab0-85cb-c167d02e6466 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:21.183963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-553baa5f-bb58-4ab0-85cb-c167d02e6466 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:21.184691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-553baa5f-bb58-4ab0-85cb-c167d02e6466 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:21.185330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-553baa5f-bb58-4ab0-85cb-c167d02e6466 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:21.186246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-553baa5f-bb58-4ab0-85cb-c167d02e6466 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:21.186884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-553baa5f-bb58-4ab0-85cb-c167d02e6466 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:21.187514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-553baa5f-bb58-4ab0-85cb-c167d02e6466 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:21.282292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-553baa5f-bb58-4ab0-85cb-c167d02e6466 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:21.327537 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-553baa5f-bb58-4ab0-85cb-c167d02e6466 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.157144 Sep 10 20:50:21.328131 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 312/579] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:21 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:21.335363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a42ebcad-5407-42b4-865e-9e6260e978ab tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:21.339896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a42ebcad-5407-42b4-865e-9e6260e978ab tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'aa9e19a592e34a9ab3f4ab6f4d0b6ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046393a40a784a2caaa40331e861ab78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a42ebcad-5407-42b4-865e-9e6260e978ab tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Request method failure captured: Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/flavors/371571363/os-extra_specs HTTP/1.1 Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 66 Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPiKQfqKpenNHyjd_dfzOvOTwZtVbPe_iIy5xDoKsXkxsRCn-pg3UjcIvENrlwbJzqCOyl1UB6UU3O_4zUrjAmxtv26XqtPXsG8NDF2NCD4j01sqQwkhNIBayD8RoXc1mLU0y6ccaxRFGG0zEQ6CZpAVDTlcWek1aP-ART0-GeYi-Wg Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 046393a40a784a2caaa40331e861ab78 Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:50:21.342013 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/046393a40a784a2caaa40331e861ab78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/046393a40a784a2caaa40331e861ab78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_046393a40a784a2caaa40331e861ab78", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/046393a40a784a2caaa40331e861ab78"}]}] Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 046393a40a784a2caaa40331e861ab78 Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: aa9e19a592e34a9ab3f4ab6f4d0b6ea8 Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 10 20:50:21.343344 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'flavor_id': '371571363', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:50:21.344075 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 10 20:50:21.346042 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.347230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a42ebcad-5407-42b4-865e-9e6260e978ab tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:21.347230 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a42ebcad-5407-42b4-865e-9e6260e978ab tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] 10.222.0.33 "POST /compute/v2.1/flavors/371571363/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.014313 Sep 10 20:50:21.348493 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 313/580] 10.222.0.33 () {60 vars in 1221 bytes} [Sat Sep 10 20:50:21 2022] POST /compute/v2.1/flavors/371571363/os-extra_specs => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:21.356501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f24b77f5-ec6d-4980-a6de-66fd7600a7dc tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:21.386142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:21.404699 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f24b77f5-ec6d-4980-a6de-66fd7600a7dc tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/371571363/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054691 Sep 10 20:50:21.414304 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 314/581] 10.222.0.33 () {60 vars in 1221 bytes} [Sat Sep 10 20:50:21 2022] POST /compute/v2.1/flavors/371571363/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:50:21.421024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2c8dfa36-e139-4314-9b97-b372d28c5ef2 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:21.422693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2c8dfa36-e139-4314-9b97-b372d28c5ef2 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'aa9e19a592e34a9ab3f4ab6f4d0b6ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046393a40a784a2caaa40331e861ab78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2c8dfa36-e139-4314-9b97-b372d28c5ef2 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Request method failure captured: Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPiKQfqKpenNHyjd_dfzOvOTwZtVbPe_iIy5xDoKsXkxsRCn-pg3UjcIvENrlwbJzqCOyl1UB6UU3O_4zUrjAmxtv26XqtPXsG8NDF2NCD4j01sqQwkhNIBayD8RoXc1mLU0y6ccaxRFGG0zEQ6CZpAVDTlcWek1aP-ART0-GeYi-Wg Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 046393a40a784a2caaa40331e861ab78 Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:50:21.424268 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/046393a40a784a2caaa40331e861ab78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/046393a40a784a2caaa40331e861ab78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_046393a40a784a2caaa40331e861ab78", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/046393a40a784a2caaa40331e861ab78"}]}] Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 046393a40a784a2caaa40331e861ab78 Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: aa9e19a592e34a9ab3f4ab6f4d0b6ea8 Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:50:21.425529 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'flavor_id': '371571363', 'id': 'hw:numa_nodes'} Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:50:21.426270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.428424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2c8dfa36-e139-4314-9b97-b372d28c5ef2 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:21.429505 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2c8dfa36-e139-4314-9b97-b372d28c5ef2 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] 10.222.0.33 "DELETE /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010496 Sep 10 20:50:21.430748 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 315/582] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 20:50:21 2022] DELETE /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:21.437774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6dcfbf8-9964-406e-a8a1-dfc8da566e72 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:21.469871 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6dcfbf8-9964-406e-a8a1-dfc8da566e72 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/371571363/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037952 Sep 10 20:50:21.471517 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 316/583] 10.222.0.33 () {60 vars in 1221 bytes} [Sat Sep 10 20:50:21 2022] POST /compute/v2.1/flavors/371571363/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:50:21.482422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d5afdcef-2951-4379-bf65-14ce72bd7e0d tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:21.485758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d5afdcef-2951-4379-bf65-14ce72bd7e0d tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'aa9e19a592e34a9ab3f4ab6f4d0b6ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046393a40a784a2caaa40331e861ab78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d5afdcef-2951-4379-bf65-14ce72bd7e0d tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Request method failure captured: Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 22 Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPiKQfqKpenNHyjd_dfzOvOTwZtVbPe_iIy5xDoKsXkxsRCn-pg3UjcIvENrlwbJzqCOyl1UB6UU3O_4zUrjAmxtv26XqtPXsG8NDF2NCD4j01sqQwkhNIBayD8RoXc1mLU0y6ccaxRFGG0zEQ6CZpAVDTlcWek1aP-ART0-GeYi-Wg Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 046393a40a784a2caaa40331e861ab78 Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:50:21.487781 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/046393a40a784a2caaa40331e861ab78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/046393a40a784a2caaa40331e861ab78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_046393a40a784a2caaa40331e861ab78", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/046393a40a784a2caaa40331e861ab78"}]}] Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 046393a40a784a2caaa40331e861ab78 Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: aa9e19a592e34a9ab3f4ab6f4d0b6ea8 Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: {"hw:numa_nodes": "1"} Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:50:21.489016 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'flavor_id': '371571363', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:50:21.490431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 10 20:50:21.491513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.494667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d5afdcef-2951-4379-bf65-14ce72bd7e0d tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:21.494667 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d5afdcef-2951-4379-bf65-14ce72bd7e0d tempest-FlavorsExtraSpecsNegativeTestJSON-80298192 tempest-FlavorsExtraSpecsNegativeTestJSON-80298192-project] 10.222.0.33 "PUT /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010882 Sep 10 20:50:21.498055 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 317/584] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:50:21 2022] PUT /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:21.502517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2d703db5-14af-4ebd-aad9-aafaea3feba6 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:21.511003 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-2d703db5-14af-4ebd-aad9-aafaea3feba6 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] HTTP exception thrown: Flavor 371571363 has no extra specs with key hw:cpu_thread_policy. Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2d703db5-14af-4ebd-aad9-aafaea3feba6 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Request method failure captured: Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/flavors/371571363/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPiL51trsgDWzCbJD3a-VMmcGl4g-25k2s8W0xCSJHm-JMV54uc91hR0sF16U2C3C-nYLz1jPe0SzEImR2Krub1RA50n_oky5p0gO7YxOJNsLkM8jvgGjqUDwevqItOPfT75dghbqYT2xtkl2Ru2m_ZLx_zNNrY3b1KlsDbvEQw3NtU Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 5d289bfa2059463892f4bf326f23e304 Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:50:21.513698 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d289bfa2059463892f4bf326f23e304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d289bfa2059463892f4bf326f23e304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d289bfa2059463892f4bf326f23e304", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d289bfa2059463892f4bf326f23e304"}]}] Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 5d289bfa2059463892f4bf326f23e304 Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 8e351d08daeb4a25a7f96d8870b8daee Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:50:21.515051 ncdv-master-1 devstack@n-api.service[145771]: exception: Flavor 371571363 has no extra specs with key hw:cpu_thread_policy. Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'flavor_id': '371571363', 'id': 'hw:cpu_thread_policy'} Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 371571363 has no extra specs with key hw:cpu_thread_policy. Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:21.515817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.517854 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.517854 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.517854 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.517854 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:21.517854 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:21.517854 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 371571363 has no extra specs with key hw:cpu_thread_policy. Sep 10 20:50:21.517854 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.517854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2d703db5-14af-4ebd-aad9-aafaea3feba6 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Returning 404 to user: Flavor 371571363 has no extra specs with key hw:cpu_thread_policy. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:21.517854 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2d703db5-14af-4ebd-aad9-aafaea3feba6 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/371571363/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.016362 Sep 10 20:50:21.520152 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 318/585] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 20:50:21 2022] DELETE /compute/v2.1/flavors/371571363/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:50:21.525382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-102cb005-7f9c-4fc5-b1fb-46931a385133 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:21.528838 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-102cb005-7f9c-4fc5-b1fb-46931a385133 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-102cb005-7f9c-4fc5-b1fb-46931a385133 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Request method failure captured: Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 27 Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPiL51trsgDWzCbJD3a-VMmcGl4g-25k2s8W0xCSJHm-JMV54uc91hR0sF16U2C3C-nYLz1jPe0SzEImR2Krub1RA50n_oky5p0gO7YxOJNsLkM8jvgGjqUDwevqItOPfT75dghbqYT2xtkl2Ru2m_ZLx_zNNrY3b1KlsDbvEQw3NtU Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 5d289bfa2059463892f4bf326f23e304 Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:50:21.530607 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d289bfa2059463892f4bf326f23e304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d289bfa2059463892f4bf326f23e304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d289bfa2059463892f4bf326f23e304", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d289bfa2059463892f4bf326f23e304"}]}] Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 5d289bfa2059463892f4bf326f23e304 Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 8e351d08daeb4a25a7f96d8870b8daee Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: {"hw:cpu_policy": "shared"} Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:50:21.532357 ncdv-master-1 devstack@n-api.service[145771]: exception: Request body and URI mismatch Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'flavor_id': '371571363', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.533116 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.534443 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:21.534443 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:21.534443 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 10 20:50:21.534443 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.534443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-102cb005-7f9c-4fc5-b1fb-46931a385133 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:21.536655 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-102cb005-7f9c-4fc5-b1fb-46931a385133 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.013534 Sep 10 20:50:21.541136 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 319/586] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:50:21 2022] PUT /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes => generated 73 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:50:21.546199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0514876f-b853-4831-bde4-ce17a8db1037 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:21.546847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0514876f-b853-4831-bde4-ce17a8db1037 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:21.557580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0514876f-b853-4831-bde4-ce17a8db1037 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:21.558102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0514876f-b853-4831-bde4-ce17a8db1037 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:21.558543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0514876f-b853-4831-bde4-ce17a8db1037 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:21.559248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0514876f-b853-4831-bde4-ce17a8db1037 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:21.559715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0514876f-b853-4831-bde4-ce17a8db1037 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:21.560121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0514876f-b853-4831-bde4-ce17a8db1037 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:21.587380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a9d2a7c3-a5c9-466b-9008-0dbec680a813 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:21.595875 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a9d2a7c3-a5c9-466b-9008-0dbec680a813 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1313 microversion: 2.1 time: 0.518318 Sep 10 20:50:21.596648 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 268/587] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:21 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:21.631643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b11b368e-0910-48c9-b287-4fd41539cc6b tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b11b368e-0910-48c9-b287-4fd41539cc6b tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Request method failure captured: Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: request: PUT /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 49 Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPiL51trsgDWzCbJD3a-VMmcGl4g-25k2s8W0xCSJHm-JMV54uc91hR0sF16U2C3C-nYLz1jPe0SzEImR2Krub1RA50n_oky5p0gO7YxOJNsLkM8jvgGjqUDwevqItOPfT75dghbqYT2xtkl2Ru2m_ZLx_zNNrY3b1KlsDbvEQw3NtU Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5d289bfa2059463892f4bf326f23e304 Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:50:21.650285 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d289bfa2059463892f4bf326f23e304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d289bfa2059463892f4bf326f23e304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d289bfa2059463892f4bf326f23e304", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d289bfa2059463892f4bf326f23e304"}]}] Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5d289bfa2059463892f4bf326f23e304 Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 8e351d08daeb4a25a7f96d8870b8daee Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 10 20:50:21.653180 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'flavor_id': '371571363', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance: Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 10 20:50:21.655046 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.658178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:21.660795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:21.660795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:21.660795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:50:21.660795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:50:21.660795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 20:50:21.660795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:21.663448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b11b368e-0910-48c9-b287-4fd41539cc6b tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:21.664546 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b11b368e-0910-48c9-b287-4fd41539cc6b tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.048416 Sep 10 20:50:21.665712 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 269/588] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:50:21 2022] PUT /compute/v2.1/flavors/371571363/os-extra_specs/hw:numa_nodes => generated 117 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:50:21.674338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b6a74d3d-a161-4fd5-adb9-4fe223fd2fe6 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:21.713617 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b6a74d3d-a161-4fd5-adb9-4fe223fd2fe6 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/371571363" status: 202 len: 0 microversion: 2.1 time: 0.042708 Sep 10 20:50:21.715606 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 270/589] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:50:21 2022] DELETE /compute/v2.1/flavors/371571363 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:50:21.736275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-286a4746-db69-4f42-8fa7-e4d30d8295fc tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:21.773393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-0514876f-b853-4831-bde4-ce17a8db1037 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:21.782419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-286a4746-db69-4f42-8fa7-e4d30d8295fc tempest-FlavorsExtraSpecsNegativeTestJSON-751063082 tempest-FlavorsExtraSpecsNegativeTestJSON-751063082-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.058582 Sep 10 20:50:21.783700 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 271/590] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:50:21 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:21.796034 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0514876f-b853-4831-bde4-ce17a8db1037 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 2034 microversion: 2.25 time: 0.253731 Sep 10 20:50:21.797446 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 320/591] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:21 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 2034 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:21.826427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:21.829720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:21.867842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:21.869893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:21.872894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:21.873947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4b5af7f8-4f2c-49f0-acb8-73363de3948e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:21.874573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4b5af7f8-4f2c-49f0-acb8-73363de3948e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:21.875841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:21.876326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:21.876782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:21.896116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b5af7f8-4f2c-49f0-acb8-73363de3948e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:21.898176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b5af7f8-4f2c-49f0-acb8-73363de3948e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:21.898644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b5af7f8-4f2c-49f0-acb8-73363de3948e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:21.899406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b5af7f8-4f2c-49f0-acb8-73363de3948e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:21.899875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b5af7f8-4f2c-49f0-acb8-73363de3948e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:21.900313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b5af7f8-4f2c-49f0-acb8-73363de3948e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:22.013783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'flavor' on Instance uuid f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:22.060616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Going to try to live migrate instance to nch1-master-1 {{(pid=145772) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 20:50:22.167130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b5af7f8-4f2c-49f0-acb8-73363de3948e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:22.180478 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4b5af7f8-4f2c-49f0-acb8-73363de3948e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1311 microversion: 2.1 time: 0.311433 Sep 10 20:50:22.182861 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 321/592] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:21 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1311 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:22.196073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-460b6676-d7d5-48ff-bbdb-6952ce1b22d5 req-ee7f56aa-089e-4323-9c15-5c2f43e08a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd4a71c8-110a-41cd-a0e2-324f07ba946a", "tag": "6f0dbb98-6c0b-464f-abd0-fecdef02f76a"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:22.232476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-460b6676-d7d5-48ff-bbdb-6952ce1b22d5 req-ee7f56aa-089e-4323-9c15-5c2f43e08a6d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:22.236563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-460b6676-d7d5-48ff-bbdb-6952ce1b22d5 req-ee7f56aa-089e-4323-9c15-5c2f43e08a6d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:22.240303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-460b6676-d7d5-48ff-bbdb-6952ce1b22d5 req-ee7f56aa-089e-4323-9c15-5c2f43e08a6d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:22.266078 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-460b6676-d7d5-48ff-bbdb-6952ce1b22d5 req-ee7f56aa-089e-4323-9c15-5c2f43e08a6d service nova] Creating event network-changed:6f0dbb98-6c0b-464f-abd0-fecdef02f76a for instance bd4a71c8-110a-41cd-a0e2-324f07ba946a on nch2-master-1 Sep 10 20:50:22.281329 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-460b6676-d7d5-48ff-bbdb-6952ce1b22d5 req-ee7f56aa-089e-4323-9c15-5c2f43e08a6d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095292 Sep 10 20:50:22.285639 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 322/593] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:22.291887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:22.302998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:22.312918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:22.313748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:22.316455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:22.317443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:22.318134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:22.319984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:22.623714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:22.635699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:22.644793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:22.673504 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7602bc45-c6b2-42e5-9d1b-240a505ea815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.385653 Sep 10 20:50:22.674276 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 323/594] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:22 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:22.679944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9a07809d-8dc1-489a-804c-574eff79f377 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:22.686813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9a07809d-8dc1-489a-804c-574eff79f377 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:22.702697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a07809d-8dc1-489a-804c-574eff79f377 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:22.714408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a07809d-8dc1-489a-804c-574eff79f377 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:22.715827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a07809d-8dc1-489a-804c-574eff79f377 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:22.716874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a07809d-8dc1-489a-804c-574eff79f377 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:22.717481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a07809d-8dc1-489a-804c-574eff79f377 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:22.718302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a07809d-8dc1-489a-804c-574eff79f377 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:22.924273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-9a07809d-8dc1-489a-804c-574eff79f377 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:22.988665 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9a07809d-8dc1-489a-804c-574eff79f377 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.313223 Sep 10 20:50:22.991953 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 324/595] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:22 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:23.006802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6ebb83f4-1905-4c86-ac47-03726f75b5af tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:23.014170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6ebb83f4-1905-4c86-ac47-03726f75b5af tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:23.032413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ebb83f4-1905-4c86-ac47-03726f75b5af tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:23.034084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ebb83f4-1905-4c86-ac47-03726f75b5af tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:23.035855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ebb83f4-1905-4c86-ac47-03726f75b5af tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:23.036895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ebb83f4-1905-4c86-ac47-03726f75b5af tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:23.039068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ebb83f4-1905-4c86-ac47-03726f75b5af tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:23.040386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ebb83f4-1905-4c86-ac47-03726f75b5af tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:23.057299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:23.316363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6ebb83f4-1905-4c86-ac47-03726f75b5af tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:23.328672 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6ebb83f4-1905-4c86-ac47-03726f75b5af tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1313 microversion: 2.1 time: 0.333617 Sep 10 20:50:23.329260 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 325/596] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:22 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:23.341502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3af6f8d6-878c-4741-8c19-96f6510decce tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:23.342487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3af6f8d6-878c-4741-8c19-96f6510decce tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:23.355925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af6f8d6-878c-4741-8c19-96f6510decce tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:23.358045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af6f8d6-878c-4741-8c19-96f6510decce tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:23.358493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af6f8d6-878c-4741-8c19-96f6510decce tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:23.359229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af6f8d6-878c-4741-8c19-96f6510decce tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:23.359700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af6f8d6-878c-4741-8c19-96f6510decce tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:23.360131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af6f8d6-878c-4741-8c19-96f6510decce tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:23.522198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3af6f8d6-878c-4741-8c19-96f6510decce tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:23.532766 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3af6f8d6-878c-4741-8c19-96f6510decce tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1311 microversion: 2.1 time: 0.201911 Sep 10 20:50:23.533925 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 326/597] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:23 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1311 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:23.812938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e2a53e81-fdbf-460a-9735-8dde1619eb61 tempest-ListImagesTestJSON-1340912479 tempest-ListImagesTestJSON-1340912479-project] Calling method '.version_select at 0x7f9944e86c10>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:23.869486 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e2a53e81-fdbf-460a-9735-8dde1619eb61 tempest-ListImagesTestJSON-1340912479 tempest-ListImagesTestJSON-1340912479-project] 10.222.0.33 "GET /compute/v2.1/images/b43a7a8a-2616-430e-9e50-ef93c087ed12" status: 200 len: 784 microversion: 2.1 time: 0.334362 Sep 10 20:50:23.870118 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 327/598] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:50:23 2022] GET /compute/v2.1/images/b43a7a8a-2616-430e-9e50-ef93c087ed12 => generated 784 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:23.875199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:23.875981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:23.885207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:23.885711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:23.886320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:23.887239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:23.887798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:23.888240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:24.280473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:24.304962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:24.307854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:24.320176 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4e0d2376-6409-4eeb-8b4e-b7dd0f708093 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.448801 Sep 10 20:50:24.333850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 328/599] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:23 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:24.333850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-743b06a5-9a08-458d-8a6e-a3e26bcaa8c6 tempest-ListImagesTestJSON-1340912479 tempest-ListImagesTestJSON-1340912479-project] Calling method '.version_select at 0x7f994510eee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:24.511544 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-743b06a5-9a08-458d-8a6e-a3e26bcaa8c6 tempest-ListImagesTestJSON-1340912479 tempest-ListImagesTestJSON-1340912479-project] 10.222.0.33 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.189704 Sep 10 20:50:24.512731 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 329/600] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Sep 10 20:50:24 2022] GET /compute/v2.1/images => generated 445 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:24.522905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ee50b45-d7e1-463f-98f4-185a0a55cc0e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:24.523536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ee50b45-d7e1-463f-98f4-185a0a55cc0e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:24.545717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ee50b45-d7e1-463f-98f4-185a0a55cc0e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:24.547310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ee50b45-d7e1-463f-98f4-185a0a55cc0e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:24.547813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ee50b45-d7e1-463f-98f4-185a0a55cc0e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:24.552812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ee50b45-d7e1-463f-98f4-185a0a55cc0e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:24.554474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ee50b45-d7e1-463f-98f4-185a0a55cc0e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:24.556081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ee50b45-d7e1-463f-98f4-185a0a55cc0e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:24.725918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-1ee50b45-d7e1-463f-98f4-185a0a55cc0e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:24.748638 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ee50b45-d7e1-463f-98f4-185a0a55cc0e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.234678 Sep 10 20:50:24.749554 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 330/601] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:24 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:24.758462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6f27135b-a5d2-4404-9272-0720d6f8a693 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:24.760198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6f27135b-a5d2-4404-9272-0720d6f8a693 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:24.778695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f27135b-a5d2-4404-9272-0720d6f8a693 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:24.780883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f27135b-a5d2-4404-9272-0720d6f8a693 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:24.781952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f27135b-a5d2-4404-9272-0720d6f8a693 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:24.783771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f27135b-a5d2-4404-9272-0720d6f8a693 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:24.787394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f27135b-a5d2-4404-9272-0720d6f8a693 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:24.788030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f27135b-a5d2-4404-9272-0720d6f8a693 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:25.064188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6f27135b-a5d2-4404-9272-0720d6f8a693 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:25.078826 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6f27135b-a5d2-4404-9272-0720d6f8a693 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1313 microversion: 2.1 time: 0.327603 Sep 10 20:50:25.081372 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 331/602] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:24 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:25.088779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab869d75-6022-4ba1-96a6-7d327e80d487 tempest-ListImagesTestJSON-1340912479 tempest-ListImagesTestJSON-1340912479-project] Calling method '.version_select at 0x7f99454d3ca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:25.153451 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab869d75-6022-4ba1-96a6-7d327e80d487 tempest-ListImagesTestJSON-1340912479 tempest-ListImagesTestJSON-1340912479-project] 10.222.0.33 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.069517 Sep 10 20:50:25.154629 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 332/603] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:50:25 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:25.174009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aabf2f50-a147-4f1f-9786-623fed1a798d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:25.174632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aabf2f50-a147-4f1f-9786-623fed1a798d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:25.182858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aabf2f50-a147-4f1f-9786-623fed1a798d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:25.183604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aabf2f50-a147-4f1f-9786-623fed1a798d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:25.184203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aabf2f50-a147-4f1f-9786-623fed1a798d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:25.185081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aabf2f50-a147-4f1f-9786-623fed1a798d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:25.185539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aabf2f50-a147-4f1f-9786-623fed1a798d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:25.185988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aabf2f50-a147-4f1f-9786-623fed1a798d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:25.421282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aabf2f50-a147-4f1f-9786-623fed1a798d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:25.433232 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aabf2f50-a147-4f1f-9786-623fed1a798d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1311 microversion: 2.1 time: 0.276991 Sep 10 20:50:25.434597 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 333/604] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:25 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1311 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:25.439698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:25.440553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:25.449756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:25.451282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:25.451903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:25.452813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:25.453568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:25.454255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:25.531652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:25.541798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:25.543471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:25.549840 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-112ab5e3-ae05-4c31-8ef0-5f5a5c807cc0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.113925 Sep 10 20:50:25.561850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 334/605] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:25 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:25.586464 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7709ba25-dec3-4c0d-b43e-5ebea57a6686 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e/action" status: 202 len: 0 microversion: 2.25 time: 3.764791 Sep 10 20:50:25.587677 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 272/606] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:50:21 2022] POST /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e/action => generated 0 bytes in 3767 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:50:25.595672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:25.596561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:25.610942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:25.611627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:25.612238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:25.614870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:25.616531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:25.618321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:25.780159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-48bb31cb-c997-43ff-a39f-48c059341af5 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:25.781063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-48bb31cb-c997-43ff-a39f-48c059341af5 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:25.802544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48bb31cb-c997-43ff-a39f-48c059341af5 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:25.817216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48bb31cb-c997-43ff-a39f-48c059341af5 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:25.818220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48bb31cb-c997-43ff-a39f-48c059341af5 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:25.819222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48bb31cb-c997-43ff-a39f-48c059341af5 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:25.819863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48bb31cb-c997-43ff-a39f-48c059341af5 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:25.820451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48bb31cb-c997-43ff-a39f-48c059341af5 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:25.901291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:26.000822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-48bb31cb-c997-43ff-a39f-48c059341af5 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:26.037663 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-48bb31cb-c997-43ff-a39f-48c059341af5 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.261583 Sep 10 20:50:26.041811 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 273/607] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:25 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:50:26.108423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ce670b8d-c9ec-41a2-b9a1-42c808803b6c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:26.109259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ce670b8d-c9ec-41a2-b9a1-42c808803b6c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:26.121494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce670b8d-c9ec-41a2-b9a1-42c808803b6c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:26.123612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce670b8d-c9ec-41a2-b9a1-42c808803b6c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:26.125150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce670b8d-c9ec-41a2-b9a1-42c808803b6c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:26.127260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce670b8d-c9ec-41a2-b9a1-42c808803b6c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:26.127874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce670b8d-c9ec-41a2-b9a1-42c808803b6c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:26.130868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce670b8d-c9ec-41a2-b9a1-42c808803b6c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:26.519479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ce670b8d-c9ec-41a2-b9a1-42c808803b6c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:26.534946 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ce670b8d-c9ec-41a2-b9a1-42c808803b6c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1313 microversion: 2.1 time: 0.431258 Sep 10 20:50:26.539068 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 274/608] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:26 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:50:26.545753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f136ac0c-1f7d-480c-9a95-926abadd9848 req-805fcd7a-0293-48e9-ada1-ac73b84b0bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09798018-2269-451d-8486-df991ba45b0c", "name": "network-vif-plugged", "status": "completed", "tag": "815af22b-692f-4103-b475-aa7f8e8118cd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:26.555878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:26.558973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f136ac0c-1f7d-480c-9a95-926abadd9848 req-805fcd7a-0293-48e9-ada1-ac73b84b0bbf service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:26.559754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f136ac0c-1f7d-480c-9a95-926abadd9848 req-805fcd7a-0293-48e9-ada1-ac73b84b0bbf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:26.560809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f136ac0c-1f7d-480c-9a95-926abadd9848 req-805fcd7a-0293-48e9-ada1-ac73b84b0bbf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:26.563215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:26.573503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:26.580584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:26.582387 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae8bea6d-0201-42dd-ad40-2aa7d4b47536 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.990958 Sep 10 20:50:26.583271 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f136ac0c-1f7d-480c-9a95-926abadd9848 req-805fcd7a-0293-48e9-ada1-ac73b84b0bbf service nova] Creating event network-vif-plugged:815af22b-692f-4103-b475-aa7f8e8118cd for instance 09798018-2269-451d-8486-df991ba45b0c on nch1-master-1 Sep 10 20:50:26.586111 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 335/609] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:25 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:26.589485 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f136ac0c-1f7d-480c-9a95-926abadd9848 req-805fcd7a-0293-48e9-ada1-ac73b84b0bbf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048568 Sep 10 20:50:26.590647 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 275/610] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:26.596658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:26.597493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:26.603320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aa096302-8641-460c-9dd7-7da615a58219 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:26.604420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aa096302-8641-460c-9dd7-7da615a58219 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:26.607838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:26.611313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:26.611574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa096302-8641-460c-9dd7-7da615a58219 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:26.612183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa096302-8641-460c-9dd7-7da615a58219 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:26.612443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:26.612966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa096302-8641-460c-9dd7-7da615a58219 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:26.614787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa096302-8641-460c-9dd7-7da615a58219 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:26.614942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:26.615899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa096302-8641-460c-9dd7-7da615a58219 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:26.616192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:26.616753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:26.617134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa096302-8641-460c-9dd7-7da615a58219 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:26.673463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:26.700141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:26.788985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:26.806968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:26.808563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:26.819342 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b369cc84-9389-4083-bed9-5abdf09e24f8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.227225 Sep 10 20:50:26.823665 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 276/611] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:26 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:27.033669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aa096302-8641-460c-9dd7-7da615a58219 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:27.049959 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aa096302-8641-460c-9dd7-7da615a58219 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1311 microversion: 2.1 time: 0.461999 Sep 10 20:50:27.053933 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 336/612] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:26 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1311 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:27.075340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4d5a0638-bfeb-4c9a-ac68-a76aa4c99e69 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:27.076517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4d5a0638-bfeb-4c9a-ac68-a76aa4c99e69 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:27.088904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d5a0638-bfeb-4c9a-ac68-a76aa4c99e69 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.090758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d5a0638-bfeb-4c9a-ac68-a76aa4c99e69 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.091398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d5a0638-bfeb-4c9a-ac68-a76aa4c99e69 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:27.092612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d5a0638-bfeb-4c9a-ac68-a76aa4c99e69 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.093404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d5a0638-bfeb-4c9a-ac68-a76aa4c99e69 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.093691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d5a0638-bfeb-4c9a-ac68-a76aa4c99e69 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:27.189693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-4d5a0638-bfeb-4c9a-ac68-a76aa4c99e69 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:27.209768 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4d5a0638-bfeb-4c9a-ac68-a76aa4c99e69 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.138756 Sep 10 20:50:27.211089 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 277/613] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:27 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:27.567687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39141ad3-2600-4468-ae9b-0515fc293357 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:27.569761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-39141ad3-2600-4468-ae9b-0515fc293357 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:27.580393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=16 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:27.582177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39141ad3-2600-4468-ae9b-0515fc293357 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.582786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39141ad3-2600-4468-ae9b-0515fc293357 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.583788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39141ad3-2600-4468-ae9b-0515fc293357 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:27.584605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39141ad3-2600-4468-ae9b-0515fc293357 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.585379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39141ad3-2600-4468-ae9b-0515fc293357 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.585909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39141ad3-2600-4468-ae9b-0515fc293357 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:27.821180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-39141ad3-2600-4468-ae9b-0515fc293357 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:27.830557 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-39141ad3-2600-4468-ae9b-0515fc293357 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1313 microversion: 2.1 time: 0.273504 Sep 10 20:50:27.831707 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 278/614] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:27 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:27.837190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:27.838083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:27.845096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.846016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.846482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:27.848653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.849884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.850435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:27.854971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Calling method '.version_select at 0x7f99450e7280>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:27.857524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.858114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.858626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:27.884681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.885304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.886034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:27.897203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.898071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.898734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:27.906327 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e65a9c72-107d-4a4c-b74f-f6d4e26518e5 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.560724 Sep 10 20:50:27.907748 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 337/615] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:50:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:27.913427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:27.914419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:27.922217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.923040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.923712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:27.924665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:27.925348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:27.926137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.027719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:28.049632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:28.051719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:28.062030 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b059ed76-3588-4c51-b244-2ec7eed81a9c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.152682 Sep 10 20:50:28.063285 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 338/616] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:27 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:28.069202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Calling method '.version_select at 0x7f9944fea9d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:28.071305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.072059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.072739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.075172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:28.085093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:28.087301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:28.089156 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-227c1fc7-4d39-4dfb-af41-be8866656535 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.255803 Sep 10 20:50:28.090567 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 279/617] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:27 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:28.091529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.092031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.092607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.096311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc79bfb0-acb7-48d3-9ac2-7750fb6fa0af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:28.096908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fc79bfb0-acb7-48d3-9ac2-7750fb6fa0af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:28.105547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc79bfb0-acb7-48d3-9ac2-7750fb6fa0af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.106686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc79bfb0-acb7-48d3-9ac2-7750fb6fa0af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.107296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc79bfb0-acb7-48d3-9ac2-7750fb6fa0af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.109044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc79bfb0-acb7-48d3-9ac2-7750fb6fa0af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.109503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc79bfb0-acb7-48d3-9ac2-7750fb6fa0af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.109979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc79bfb0-acb7-48d3-9ac2-7750fb6fa0af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.149082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.149945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.150588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.161932 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7542a80d-7b18-47ba-9875-ce40aeb590f7 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 433 microversion: 2.1 time: 0.093303 Sep 10 20:50:28.163188 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 339/618] 10.222.0.33 () {58 vars in 1212 bytes} [Sat Sep 10 20:50:28 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 433 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:28.179084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Calling method '.version_select at 0x7f994590f310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:28.187578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.188079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.188518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.214572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.215081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.215516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.235888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.236755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.237353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.248456 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2573176f-a943-457f-8c92-2eff56fdc3e3 tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.072977 Sep 10 20:50:28.255053 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 340/619] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:50:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:28.260553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dfdcfdf7-f241-4a82-a1b7-386a846de730 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:28.261391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dfdcfdf7-f241-4a82-a1b7-386a846de730 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:28.267916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfdcfdf7-f241-4a82-a1b7-386a846de730 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.268868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfdcfdf7-f241-4a82-a1b7-386a846de730 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.269883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfdcfdf7-f241-4a82-a1b7-386a846de730 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.272083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfdcfdf7-f241-4a82-a1b7-386a846de730 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.272623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfdcfdf7-f241-4a82-a1b7-386a846de730 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.273247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfdcfdf7-f241-4a82-a1b7-386a846de730 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.308586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fc79bfb0-acb7-48d3-9ac2-7750fb6fa0af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:28.321286 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc79bfb0-acb7-48d3-9ac2-7750fb6fa0af tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1311 microversion: 2.1 time: 0.229435 Sep 10 20:50:28.328164 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 280/620] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:28 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1311 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:28.341863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c64e476-5055-463e-afe0-35db55b53c9c tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Calling method '.version_select at 0x7f9945014e50>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:28.343809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c64e476-5055-463e-afe0-35db55b53c9c tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.345235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c64e476-5055-463e-afe0-35db55b53c9c tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.346423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c64e476-5055-463e-afe0-35db55b53c9c tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.396877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c64e476-5055-463e-afe0-35db55b53c9c tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.397647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c64e476-5055-463e-afe0-35db55b53c9c tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.398278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c64e476-5055-463e-afe0-35db55b53c9c tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.406386 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1c64e476-5055-463e-afe0-35db55b53c9c tempest-HypervisorAdminUnderV252Test-305184614 tempest-HypervisorAdminUnderV252Test-305184614-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.077063 Sep 10 20:50:28.414923 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 281/621] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Sep 10 20:50:28 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:28.474258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-dfdcfdf7-f241-4a82-a1b7-386a846de730 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:28.515968 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dfdcfdf7-f241-4a82-a1b7-386a846de730 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.258833 Sep 10 20:50:28.517056 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 341/622] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:28 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:28.622065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-04efb0a8-562e-404f-ab81-7e0f91344a26 req-bfca327f-f293-406f-9fbd-2c92688c0caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd4a71c8-110a-41cd-a0e2-324f07ba946a", "name": "network-vif-plugged", "status": "completed", "tag": "6f0dbb98-6c0b-464f-abd0-fecdef02f76a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:28.651755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-04efb0a8-562e-404f-ab81-7e0f91344a26 req-bfca327f-f293-406f-9fbd-2c92688c0caa service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.656855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-04efb0a8-562e-404f-ab81-7e0f91344a26 req-bfca327f-f293-406f-9fbd-2c92688c0caa service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.658439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-04efb0a8-562e-404f-ab81-7e0f91344a26 req-bfca327f-f293-406f-9fbd-2c92688c0caa service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.676060 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-04efb0a8-562e-404f-ab81-7e0f91344a26 req-bfca327f-f293-406f-9fbd-2c92688c0caa service nova] Creating event network-vif-plugged:6f0dbb98-6c0b-464f-abd0-fecdef02f76a for instance bd4a71c8-110a-41cd-a0e2-324f07ba946a on nch2-master-1 Sep 10 20:50:28.702247 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-04efb0a8-562e-404f-ab81-7e0f91344a26 req-bfca327f-f293-406f-9fbd-2c92688c0caa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084723 Sep 10 20:50:28.703406 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 282/623] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:50:28.856832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ad5f88f5-21ae-4c8e-aa76-4daeda482fad tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:28.858279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ad5f88f5-21ae-4c8e-aa76-4daeda482fad tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:28.875378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad5f88f5-21ae-4c8e-aa76-4daeda482fad tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.876160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad5f88f5-21ae-4c8e-aa76-4daeda482fad tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.876761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad5f88f5-21ae-4c8e-aa76-4daeda482fad tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:28.877657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad5f88f5-21ae-4c8e-aa76-4daeda482fad tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:28.878304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad5f88f5-21ae-4c8e-aa76-4daeda482fad tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:28.878891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad5f88f5-21ae-4c8e-aa76-4daeda482fad tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:29.092476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:29.093334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:29.102593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:29.103136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:29.103581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:29.104324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:29.128513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:29.130262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:29.216141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ad5f88f5-21ae-4c8e-aa76-4daeda482fad tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:29.235107 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ad5f88f5-21ae-4c8e-aa76-4daeda482fad tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1313 microversion: 2.1 time: 0.380426 Sep 10 20:50:29.237987 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 342/624] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:28 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:29.256552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:29.257498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:29.263980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:29.264733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:29.265375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:29.266323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:29.266979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:29.267607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:29.594582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:29.670039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:29.673803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:29.682653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:29.687973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:29.695814 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-29f8df7b-8f7c-4dae-b68e-eaac7e3e8bdc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.449500 Sep 10 20:50:29.696765 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 343/625] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:29 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:29.698994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:29.703749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09b96b97-0e4e-4a7f-8cb3-96f5caf7d325 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:29.704622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-09b96b97-0e4e-4a7f-8cb3-96f5caf7d325 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:29.710332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:29.713184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b96b97-0e4e-4a7f-8cb3-96f5caf7d325 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:29.713962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b96b97-0e4e-4a7f-8cb3-96f5caf7d325 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:29.714304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:29.714880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b96b97-0e4e-4a7f-8cb3-96f5caf7d325 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:29.715822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b96b97-0e4e-4a7f-8cb3-96f5caf7d325 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:29.716511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b96b97-0e4e-4a7f-8cb3-96f5caf7d325 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:29.717155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b96b97-0e4e-4a7f-8cb3-96f5caf7d325 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:29.729387 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1604d24b-91d5-48e4-9f91-aaadef0ff491 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.641007 Sep 10 20:50:29.730499 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 283/626] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:29 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:29.741201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b6a09640-1f35-40cc-b7ed-147ccf353ce3 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:29.743594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b6a09640-1f35-40cc-b7ed-147ccf353ce3 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:29.757072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a09640-1f35-40cc-b7ed-147ccf353ce3 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:29.757819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a09640-1f35-40cc-b7ed-147ccf353ce3 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:29.758459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a09640-1f35-40cc-b7ed-147ccf353ce3 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:29.761387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a09640-1f35-40cc-b7ed-147ccf353ce3 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:29.762820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a09640-1f35-40cc-b7ed-147ccf353ce3 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:29.764066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a09640-1f35-40cc-b7ed-147ccf353ce3 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:29.923889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-b6a09640-1f35-40cc-b7ed-147ccf353ce3 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:30.007011 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b6a09640-1f35-40cc-b7ed-147ccf353ce3 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.269886 Sep 10 20:50:30.008193 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 284/627] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:29 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:30.118968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09b96b97-0e4e-4a7f-8cb3-96f5caf7d325 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:30.142147 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09b96b97-0e4e-4a7f-8cb3-96f5caf7d325 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1494 microversion: 2.1 time: 0.443630 Sep 10 20:50:30.144250 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 344/628] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:29 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1494 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:30.267811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-04e9b2ec-af6b-405c-8aaf-7a8a164fa8d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:30.268433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-04e9b2ec-af6b-405c-8aaf-7a8a164fa8d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:30.281591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e9b2ec-af6b-405c-8aaf-7a8a164fa8d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:30.288002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e9b2ec-af6b-405c-8aaf-7a8a164fa8d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:30.293453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e9b2ec-af6b-405c-8aaf-7a8a164fa8d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:30.296482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e9b2ec-af6b-405c-8aaf-7a8a164fa8d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:30.298122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e9b2ec-af6b-405c-8aaf-7a8a164fa8d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:30.304817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e9b2ec-af6b-405c-8aaf-7a8a164fa8d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:30.778441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9749b57f-cdeb-4d61-a573-75bb02dbc9dc tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:30.780800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9749b57f-cdeb-4d61-a573-75bb02dbc9dc tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:30.793764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9749b57f-cdeb-4d61-a573-75bb02dbc9dc tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:30.795183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9749b57f-cdeb-4d61-a573-75bb02dbc9dc tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:30.795856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9749b57f-cdeb-4d61-a573-75bb02dbc9dc tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:30.797284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9749b57f-cdeb-4d61-a573-75bb02dbc9dc tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:30.798527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9749b57f-cdeb-4d61-a573-75bb02dbc9dc tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:30.799220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9749b57f-cdeb-4d61-a573-75bb02dbc9dc tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:30.804050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-04e9b2ec-af6b-405c-8aaf-7a8a164fa8d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:30.812543 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-04e9b2ec-af6b-405c-8aaf-7a8a164fa8d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1313 microversion: 2.1 time: 0.548629 Sep 10 20:50:30.834957 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 345/629] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:30 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1313 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:30.844439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2eb0853b-998c-44cc-b15f-74cd5e3e3def req-975e5137-0845-4d26-b112-7934a7b46a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e", "name": "network-vif-unplugged", "status": "completed", "tag": "185a5cc6-4ac2-4e93-b345-1aad5abefc23"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:30.864810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2eb0853b-998c-44cc-b15f-74cd5e3e3def req-975e5137-0845-4d26-b112-7934a7b46a98 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:30.871528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2eb0853b-998c-44cc-b15f-74cd5e3e3def req-975e5137-0845-4d26-b112-7934a7b46a98 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:30.876944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2eb0853b-998c-44cc-b15f-74cd5e3e3def req-975e5137-0845-4d26-b112-7934a7b46a98 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:30.902146 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2eb0853b-998c-44cc-b15f-74cd5e3e3def req-975e5137-0845-4d26-b112-7934a7b46a98 service nova] Creating event network-vif-unplugged:185a5cc6-4ac2-4e93-b345-1aad5abefc23 for instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e on nch2-master-1 Sep 10 20:50:30.909839 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2eb0853b-998c-44cc-b15f-74cd5e3e3def req-975e5137-0845-4d26-b112-7934a7b46a98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072573 Sep 10 20:50:30.910557 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 346/630] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:30.916652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:30.917515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:30.927450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:30.928500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:30.929320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:30.930582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:30.931369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:30.931993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.235012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:31.251322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:31.253321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:31.254880 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-20499f80-ff0a-4d31-9b30-8e1f76649449 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.342995 Sep 10 20:50:31.256185 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 347/631] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:30 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:31.262228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:31.263489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:31.274190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:31.275155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:31.282029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.283476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:31.284345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:31.285003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.303647 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9749b57f-cdeb-4d61-a573-75bb02dbc9dc tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1645 microversion: 2.1 time: 1.136340 Sep 10 20:50:31.304240 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 285/632] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:30 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1645 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:31.338013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a3d2af6a-56a5-4bda-95f0-3a29d9d90241 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:31.340297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a3d2af6a-56a5-4bda-95f0-3a29d9d90241 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:31.358047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3d2af6a-56a5-4bda-95f0-3a29d9d90241 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:31.358802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3d2af6a-56a5-4bda-95f0-3a29d9d90241 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:31.359903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3d2af6a-56a5-4bda-95f0-3a29d9d90241 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.361480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3d2af6a-56a5-4bda-95f0-3a29d9d90241 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:31.364678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3d2af6a-56a5-4bda-95f0-3a29d9d90241 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:31.367027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3d2af6a-56a5-4bda-95f0-3a29d9d90241 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.535246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:31.575126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:31.584434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:31.594009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1552bba2-05fe-4526-9f3d-92e08e18afa3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.336175 Sep 10 20:50:31.594695 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 348/633] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:31 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:31.600673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3ed3e300-7f93-4233-a0e9-e0e34b803a6c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:31.601271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3ed3e300-7f93-4233-a0e9-e0e34b803a6c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:31.608634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ed3e300-7f93-4233-a0e9-e0e34b803a6c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:31.609126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ed3e300-7f93-4233-a0e9-e0e34b803a6c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:31.610065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ed3e300-7f93-4233-a0e9-e0e34b803a6c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.610773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ed3e300-7f93-4233-a0e9-e0e34b803a6c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:31.611228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ed3e300-7f93-4233-a0e9-e0e34b803a6c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:31.611703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ed3e300-7f93-4233-a0e9-e0e34b803a6c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.627333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-a3d2af6a-56a5-4bda-95f0-3a29d9d90241 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:31.678507 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a3d2af6a-56a5-4bda-95f0-3a29d9d90241 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.367451 Sep 10 20:50:31.680787 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 286/634] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:31 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:31.847389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8a8a545f-182b-4e99-a99e-bf5f18a9fa28 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:31.848017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8a8a545f-182b-4e99-a99e-bf5f18a9fa28 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:31.862875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8a545f-182b-4e99-a99e-bf5f18a9fa28 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:31.866112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8a545f-182b-4e99-a99e-bf5f18a9fa28 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:31.866571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8a545f-182b-4e99-a99e-bf5f18a9fa28 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.867312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8a545f-182b-4e99-a99e-bf5f18a9fa28 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:31.874101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8a545f-182b-4e99-a99e-bf5f18a9fa28 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:31.874896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8a545f-182b-4e99-a99e-bf5f18a9fa28 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.884327 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3ed3e300-7f93-4233-a0e9-e0e34b803a6c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1645 microversion: 2.1 time: 0.287827 Sep 10 20:50:31.886021 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 349/635] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:31 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1645 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:31.908997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c57c1d33-2532-4d88-a6b4-44e5dafa5748 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:31.913844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c57c1d33-2532-4d88-a6b4-44e5dafa5748 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:31.914581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c57c1d33-2532-4d88-a6b4-44e5dafa5748 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:31.915044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c57c1d33-2532-4d88-a6b4-44e5dafa5748 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.916110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c57c1d33-2532-4d88-a6b4-44e5dafa5748 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:31.916579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c57c1d33-2532-4d88-a6b4-44e5dafa5748 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:31.917013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c57c1d33-2532-4d88-a6b4-44e5dafa5748 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:31.950875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:RELEASE=4,nova_api:SELECT=90 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:31.974333 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c57c1d33-2532-4d88-a6b4-44e5dafa5748 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.068001 Sep 10 20:50:31.983535 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 350/636] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Sep 10 20:50:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:31.991279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:31.994326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:32.012638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:32.013402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:32.014058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:32.014977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:32.015734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:32.016329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:32.047064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lazy-loading 'flavor' on Instance uuid 09798018-2269-451d-8486-df991ba45b0c {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:32.062137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 09798018-2269-451d-8486-df991ba45b0c] Going to try to live migrate instance to nch2-master-1 {{(pid=145771) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 20:50:32.382824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8a8a545f-182b-4e99-a99e-bf5f18a9fa28 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:32.391229 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8a8a545f-182b-4e99-a99e-bf5f18a9fa28 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1463 microversion: 2.1 time: 0.548986 Sep 10 20:50:32.391810 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 287/637] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:31 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1463 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:32.442471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:32.480267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:32.540228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:32.550522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:32.552437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:32.555728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:32.560106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:32.564050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:33.048237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:33.062195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:33.064878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:33.066568 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-16a016cc-e6b6-44fc-8d23-514d2f260ae2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.666097 Sep 10 20:50:33.081873 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 288/638] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:32 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:33.490491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3c07717d-47a5-4a8b-a120-5cba35410447 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:33.516556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3c07717d-47a5-4a8b-a120-5cba35410447 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Searching by: {'deleted': False, 'project_id': '3bc41ed54a5745d8b6f127e3ac482da1'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:50:33.535448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c07717d-47a5-4a8b-a120-5cba35410447 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:33.538009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c07717d-47a5-4a8b-a120-5cba35410447 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:33.539034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c07717d-47a5-4a8b-a120-5cba35410447 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:33.543719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c07717d-47a5-4a8b-a120-5cba35410447 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:33.545731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c07717d-47a5-4a8b-a120-5cba35410447 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:33.546313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c07717d-47a5-4a8b-a120-5cba35410447 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:33.753371 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3c07717d-47a5-4a8b-a120-5cba35410447 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.682802 Sep 10 20:50:33.767509 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 289/639] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:50:33 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:50:33.782331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:33.783208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:33.791680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:33.792600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:33.793560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:33.794795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:33.795417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:33.796009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:33.912298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:33.924351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:33.929123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:33.943535 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a61fe584-59c5-4bc2-b853-ece42cec3689 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.174583 Sep 10 20:50:33.946857 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 290/640] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:33 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:33.964133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dd766223-4287-4df8-83be-60110b9f5d08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:33.967040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dd766223-4287-4df8-83be-60110b9f5d08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:33.980983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd766223-4287-4df8-83be-60110b9f5d08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:33.983564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd766223-4287-4df8-83be-60110b9f5d08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:33.986178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd766223-4287-4df8-83be-60110b9f5d08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:33.987145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd766223-4287-4df8-83be-60110b9f5d08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:33.991518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd766223-4287-4df8-83be-60110b9f5d08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:33.993288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd766223-4287-4df8-83be-60110b9f5d08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:34.008459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:34.178969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-dd766223-4287-4df8-83be-60110b9f5d08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:34.227510 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dd766223-4287-4df8-83be-60110b9f5d08 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.279216 Sep 10 20:50:34.228103 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 291/641] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:33 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:34.243748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6ce4735c-a7ef-4584-a0ce-728ee11b011e req-efe48830-a5b0-451b-bda0-e44818a11c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e", "tag": "185a5cc6-4ac2-4e93-b345-1aad5abefc23"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:34.271924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6ce4735c-a7ef-4584-a0ce-728ee11b011e req-efe48830-a5b0-451b-bda0-e44818a11c34 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:34.272653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6ce4735c-a7ef-4584-a0ce-728ee11b011e req-efe48830-a5b0-451b-bda0-e44818a11c34 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:34.273406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6ce4735c-a7ef-4584-a0ce-728ee11b011e req-efe48830-a5b0-451b-bda0-e44818a11c34 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:34.286450 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6ce4735c-a7ef-4584-a0ce-728ee11b011e req-efe48830-a5b0-451b-bda0-e44818a11c34 service nova] Creating event network-changed:185a5cc6-4ac2-4e93-b345-1aad5abefc23 for instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e on nch2-master-1 Sep 10 20:50:34.309497 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6ce4735c-a7ef-4584-a0ce-728ee11b011e req-efe48830-a5b0-451b-bda0-e44818a11c34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070199 Sep 10 20:50:34.310340 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 292/642] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:34.315447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:34.330891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Searching by: {'deleted': False} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:50:34.349368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:34.355579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:34.357732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:34.363711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:34.367261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:34.367921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:34.668773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:50:34.868655 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5e688805-705b-4995-af56-46fb35769af9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c/action" status: 202 len: 0 microversion: 2.1 time: 2.883555 Sep 10 20:50:34.869286 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 351/643] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:50:31 2022] POST /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c/action => generated 0 bytes in 2885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:50:34.874728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:34.875659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:34.902692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:34.903213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:34.904512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:34.905285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:34.905757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:34.917347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:34.975269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:34.975558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:34.975999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:35.156044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:35.166555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:35.168749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:35.171339 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd1b5802-db6c-45c3-9881-8ef39d5cb430 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.300402 Sep 10 20:50:35.172555 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 352/644] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:34 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:35.178840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-40b4a094-a1a6-4fce-9eac-a2f57d72bad5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:35.179774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-40b4a094-a1a6-4fce-9eac-a2f57d72bad5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:35.190086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40b4a094-a1a6-4fce-9eac-a2f57d72bad5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:35.190900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40b4a094-a1a6-4fce-9eac-a2f57d72bad5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:35.191634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40b4a094-a1a6-4fce-9eac-a2f57d72bad5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:35.193310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40b4a094-a1a6-4fce-9eac-a2f57d72bad5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:35.194080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40b4a094-a1a6-4fce-9eac-a2f57d72bad5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:35.194899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40b4a094-a1a6-4fce-9eac-a2f57d72bad5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:35.482663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-40b4a094-a1a6-4fce-9eac-a2f57d72bad5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:35.494343 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-40b4a094-a1a6-4fce-9eac-a2f57d72bad5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.319153 Sep 10 20:50:35.496607 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 353/645] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:35 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:35.731593 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c19af7cc-7a48-4b2e-bf2d-a232376bfdb3 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14551 microversion: 2.1 time: 1.419846 Sep 10 20:50:35.732920 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 293/646] 10.222.0.33 () {58 vars in 1171 bytes} [Sat Sep 10 20:50:34 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14551 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:50:35.738110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:35.739305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:35.756695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:35.759003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:35.759746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:35.764500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:35.765220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:35.766865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:35.789719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ed0695f2-2ff8-4085-9731-dc0abf5ceca0 tempest-InstanceUsageAuditLogTestJSON-212217238 tempest-InstanceUsageAuditLogTestJSON-212217238-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:35.826350 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ed0695f2-2ff8-4085-9731-dc0abf5ceca0 tempest-InstanceUsageAuditLogTestJSON-212217238 tempest-InstanceUsageAuditLogTestJSON-212217238-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10 20:50:34" status: 200 len: 318 microversion: 2.1 time: 0.327772 Sep 10 20:50:35.841121 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 354/647] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 20:50:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10%2020%3A50%3A34 => generated 318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:35.849282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9deaba9a-9e05-4e5b-959f-45b75c5ce044 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:35.850422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9deaba9a-9e05-4e5b-959f-45b75c5ce044 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:35.857359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9deaba9a-9e05-4e5b-959f-45b75c5ce044 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:35.861372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:35.866178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9deaba9a-9e05-4e5b-959f-45b75c5ce044 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:35.873182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9deaba9a-9e05-4e5b-959f-45b75c5ce044 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:35.878731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9deaba9a-9e05-4e5b-959f-45b75c5ce044 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:35.879958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9deaba9a-9e05-4e5b-959f-45b75c5ce044 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:35.880620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9deaba9a-9e05-4e5b-959f-45b75c5ce044 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:35.882277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:35.884299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:35.896919 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7cecec17-6f63-466d-a0c8-ef699ed3b181 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1537 microversion: 2.91 time: 0.162690 Sep 10 20:50:35.900644 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 294/648] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:35 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:35.912690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d31be929-3fad-47b4-be2a-035591d65276 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:35.928095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d31be929-3fad-47b4-be2a-035591d65276 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Searching by: {'deleted': False, 'project_id': '3bc41ed54a5745d8b6f127e3ac482da1'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:50:35.939733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d31be929-3fad-47b4-be2a-035591d65276 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:35.940801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d31be929-3fad-47b4-be2a-035591d65276 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:35.941292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d31be929-3fad-47b4-be2a-035591d65276 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:35.942341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d31be929-3fad-47b4-be2a-035591d65276 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:35.946647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d31be929-3fad-47b4-be2a-035591d65276 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:35.947241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d31be929-3fad-47b4-be2a-035591d65276 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:35.988197 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d31be929-3fad-47b4-be2a-035591d65276 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?tenant_id=5580128bff364c858eafedcc84dad425" status: 200 len: 15 microversion: 2.1 time: 0.085624 Sep 10 20:50:35.988834 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 295/649] 10.222.0.33 () {58 vars in 1231 bytes} [Sat Sep 10 20:50:35 2022] GET /compute/v2.1/servers/detail?tenant_id=5580128bff364c858eafedcc84dad425 => generated 15 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:50:36.003483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f4496e8f-ad7a-42b1-bfc1-7fda822907e0 tempest-InstanceUsageAuditLogTestJSON-212217238 tempest-InstanceUsageAuditLogTestJSON-212217238-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:36.032131 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f4496e8f-ad7a-42b1-bfc1-7fda822907e0 tempest-InstanceUsageAuditLogTestJSON-212217238 tempest-InstanceUsageAuditLogTestJSON-212217238-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.032420 Sep 10 20:50:36.045605 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 296/650] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Sep 10 20:50:35 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:36.051208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:36.058503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Searching by: {'tenant_id': '5580128bff364c858eafedcc84dad425', 'deleted': False} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:50:36.064047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.064994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.065629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.066608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.067464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.068106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.119918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:50:36.202792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.203322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.203830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.358043 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-42077406-b07c-40d1-9afb-d3eb339e7622 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5580128bff364c858eafedcc84dad425" status: 200 len: 4823 microversion: 2.1 time: 0.309736 Sep 10 20:50:36.359031 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 297/651] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Sep 10 20:50:36 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5580128bff364c858eafedcc84dad425 => generated 4823 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:36.365624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:36.366500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:36.374696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.375684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.376582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.378059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.378680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.379270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.390052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-9deaba9a-9e05-4e5b-959f-45b75c5ce044 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:36.424416 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9deaba9a-9e05-4e5b-959f-45b75c5ce044 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.581874 Sep 10 20:50:36.433137 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 355/652] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:35 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:36.448491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0cf0ed5f-d575-4759-aec0-bfea4f49c2eb tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:36.459264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0cf0ed5f-d575-4759-aec0-bfea4f49c2eb tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Searching by: {'tenant_id': '3bc41ed54a5745d8b6f127e3ac482da1', 'deleted': False} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:50:36.465648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf0ed5f-d575-4759-aec0-bfea4f49c2eb tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.466471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf0ed5f-d575-4759-aec0-bfea4f49c2eb tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.467678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf0ed5f-d575-4759-aec0-bfea4f49c2eb tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.468781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf0ed5f-d575-4759-aec0-bfea4f49c2eb tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.469444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf0ed5f-d575-4759-aec0-bfea4f49c2eb tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.470421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf0ed5f-d575-4759-aec0-bfea4f49c2eb tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.547033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:36.562125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:36.563837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:36.565565 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a07bc2bf-9d20-4b2a-a946-de2de73e0fac tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.205179 Sep 10 20:50:36.566377 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 298/653] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:36 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:36.579331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-23ba56bd-1327-46f5-a3b6-8324a3c061c2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:36.580148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-23ba56bd-1327-46f5-a3b6-8324a3c061c2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:36.596430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ba56bd-1327-46f5-a3b6-8324a3c061c2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.596928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ba56bd-1327-46f5-a3b6-8324a3c061c2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.597359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ba56bd-1327-46f5-a3b6-8324a3c061c2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.598123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ba56bd-1327-46f5-a3b6-8324a3c061c2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.598636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ba56bd-1327-46f5-a3b6-8324a3c061c2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.598994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ba56bd-1327-46f5-a3b6-8324a3c061c2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.633726 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0cf0ed5f-d575-4759-aec0-bfea4f49c2eb tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3bc41ed54a5745d8b6f127e3ac482da1" status: 200 len: 15 microversion: 2.1 time: 0.199330 Sep 10 20:50:36.634637 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 356/654] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Sep 10 20:50:36 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3bc41ed54a5745d8b6f127e3ac482da1 => generated 15 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:50:36.659537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5cc86c2e-9701-4ee8-b870-20325c6ebb5e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:36.665487 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5cc86c2e-9701-4ee8-b870-20325c6ebb5e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009602 Sep 10 20:50:36.666681 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 357/655] 10.222.0.33 () {58 vars in 1189 bytes} [Sat Sep 10 20:50:36 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:50:36.691143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85edb822-f013-4fc8-b5cd-3ca69f32263f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:36.697191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-85edb822-f013-4fc8-b5cd-3ca69f32263f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:36.706936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85edb822-f013-4fc8-b5cd-3ca69f32263f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.708509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85edb822-f013-4fc8-b5cd-3ca69f32263f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.709254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85edb822-f013-4fc8-b5cd-3ca69f32263f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.710557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85edb822-f013-4fc8-b5cd-3ca69f32263f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.711670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85edb822-f013-4fc8-b5cd-3ca69f32263f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.712535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85edb822-f013-4fc8-b5cd-3ca69f32263f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.821107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-23ba56bd-1327-46f5-a3b6-8324a3c061c2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:36.836027 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-23ba56bd-1327-46f5-a3b6-8324a3c061c2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.263822 Sep 10 20:50:36.837248 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 299/656] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:36 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:36.875516 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-85edb822-f013-4fc8-b5cd-3ca69f32263f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action" status: 202 len: 0 microversion: 2.1 time: 0.189135 Sep 10 20:50:36.877007 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 358/657] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:50:36 2022] POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:50:36.885757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:36.891568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:36.892382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '5580128bff364c858eafedcc84dad425'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:50:36.902628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.903119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.905732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.906963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.907485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.907974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.943151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:36.944327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:36.953519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.954574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.955234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:36.956423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:36.957793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:36.959144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.015595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:50:37.091752 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-07d60f1f-3901-46ea-b295-61977a83e012 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.208329 Sep 10 20:50:37.092490 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 300/658] 10.222.0.33 () {58 vars in 1150 bytes} [Sat Sep 10 20:50:36 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:50:37.099132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:37.135343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:37.136809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08893a13-f15a-4824-802b-ffd9bf4e29c6 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:37.137178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:37.143422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-08893a13-f15a-4824-802b-ffd9bf4e29c6 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:37.144734 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-306c451e-41e4-4e58-936a-c6571805f592 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1537 microversion: 2.91 time: 0.207073 Sep 10 20:50:37.146103 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 359/659] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:36 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1537 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:50:37.150546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08893a13-f15a-4824-802b-ffd9bf4e29c6 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.151031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08893a13-f15a-4824-802b-ffd9bf4e29c6 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.151581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08893a13-f15a-4824-802b-ffd9bf4e29c6 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.152282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08893a13-f15a-4824-802b-ffd9bf4e29c6 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.152738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08893a13-f15a-4824-802b-ffd9bf4e29c6 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.153725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08893a13-f15a-4824-802b-ffd9bf4e29c6 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.255208 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-08893a13-f15a-4824-802b-ffd9bf4e29c6 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action" status: 202 len: 0 microversion: 2.1 time: 0.130615 Sep 10 20:50:37.259993 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 301/660] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:50:37 2022] POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:50:37.265756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f0793552-6fe1-4bf3-8af2-36f62e99778a tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:37.266430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f0793552-6fe1-4bf3-8af2-36f62e99778a tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:37.275567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0793552-6fe1-4bf3-8af2-36f62e99778a tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.276075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0793552-6fe1-4bf3-8af2-36f62e99778a tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.276516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0793552-6fe1-4bf3-8af2-36f62e99778a tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.277236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0793552-6fe1-4bf3-8af2-36f62e99778a tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.278371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0793552-6fe1-4bf3-8af2-36f62e99778a tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.278824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0793552-6fe1-4bf3-8af2-36f62e99778a tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.455265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-99fd037d-03d8-42c6-bffd-4b4807f407e1 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:37.456179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-99fd037d-03d8-42c6-bffd-4b4807f407e1 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:37.463173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99fd037d-03d8-42c6-bffd-4b4807f407e1 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.463924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99fd037d-03d8-42c6-bffd-4b4807f407e1 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.464527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99fd037d-03d8-42c6-bffd-4b4807f407e1 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.465554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99fd037d-03d8-42c6-bffd-4b4807f407e1 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.466196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99fd037d-03d8-42c6-bffd-4b4807f407e1 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.466779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99fd037d-03d8-42c6-bffd-4b4807f407e1 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.591396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-99fd037d-03d8-42c6-bffd-4b4807f407e1 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:37.627567 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-99fd037d-03d8-42c6-bffd-4b4807f407e1 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.174666 Sep 10 20:50:37.628826 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 302/661] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:37 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:50:37.634469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:37.635542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:37.642117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.643238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.643876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.645628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.646402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.647183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.647812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:37.662118 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f0793552-6fe1-4bf3-8af2-36f62e99778a tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1612 microversion: 2.1 time: 0.398675 Sep 10 20:50:37.662945 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 360/662] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:37 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1612 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:37.692086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-52fd0fbd-7a07-4f6b-9476-c42fe5e07f4f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:37.692713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-52fd0fbd-7a07-4f6b-9476-c42fe5e07f4f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:37.706156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52fd0fbd-7a07-4f6b-9476-c42fe5e07f4f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.707073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52fd0fbd-7a07-4f6b-9476-c42fe5e07f4f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.708069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52fd0fbd-7a07-4f6b-9476-c42fe5e07f4f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.708878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52fd0fbd-7a07-4f6b-9476-c42fe5e07f4f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.709259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52fd0fbd-7a07-4f6b-9476-c42fe5e07f4f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.709696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52fd0fbd-7a07-4f6b-9476-c42fe5e07f4f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.890801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:37.905532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:37.910380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:37.914483 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a577cf17-b472-4f24-923c-54569baad239 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.281846 Sep 10 20:50:37.916244 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 303/663] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:37 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:37.927391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3464fd72-e7d3-4028-abfd-0eac5ca1d4b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:37.928291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3464fd72-e7d3-4028-abfd-0eac5ca1d4b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:37.943196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3464fd72-e7d3-4028-abfd-0eac5ca1d4b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.947192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3464fd72-e7d3-4028-abfd-0eac5ca1d4b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.948301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3464fd72-e7d3-4028-abfd-0eac5ca1d4b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:37.949534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3464fd72-e7d3-4028-abfd-0eac5ca1d4b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:37.952730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3464fd72-e7d3-4028-abfd-0eac5ca1d4b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:37.953186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3464fd72-e7d3-4028-abfd-0eac5ca1d4b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.187958 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-52fd0fbd-7a07-4f6b-9476-c42fe5e07f4f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1612 microversion: 2.1 time: 0.500504 Sep 10 20:50:38.188549 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 361/664] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:37 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1612 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:38.212543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:38.213788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:38.221633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.222369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.224068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.225199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.226037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.226754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.242458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3464fd72-e7d3-4028-abfd-0eac5ca1d4b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:38.253150 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3464fd72-e7d3-4028-abfd-0eac5ca1d4b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.335346 Sep 10 20:50:38.254177 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 304/665] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:37 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:38.259826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6eb3654a-2aa9-46f4-87cf-00c09216441f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:38.267401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6eb3654a-2aa9-46f4-87cf-00c09216441f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:50:38.276349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6eb3654a-2aa9-46f4-87cf-00c09216441f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.277219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6eb3654a-2aa9-46f4-87cf-00c09216441f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.277929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6eb3654a-2aa9-46f4-87cf-00c09216441f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.278913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6eb3654a-2aa9-46f4-87cf-00c09216441f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.279709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6eb3654a-2aa9-46f4-87cf-00c09216441f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.280545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6eb3654a-2aa9-46f4-87cf-00c09216441f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.416761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:38.427074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:38.432918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:38.436824 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3cb1b227-b047-4798-a5c2-67f8e653b803 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1540 microversion: 2.91 time: 0.232400 Sep 10 20:50:38.441554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-6eb3654a-2aa9-46f4-87cf-00c09216441f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:50:38.461727 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 362/666] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:38 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1540 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:38.471338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e12b1ef2-deec-4367-8256-ed6fba1bec6b tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch2-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:38.474548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e12b1ef2-deec-4367-8256-ed6fba1bec6b tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:38.481491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e12b1ef2-deec-4367-8256-ed6fba1bec6b tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.482030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e12b1ef2-deec-4367-8256-ed6fba1bec6b tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.482479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e12b1ef2-deec-4367-8256-ed6fba1bec6b tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.483194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e12b1ef2-deec-4367-8256-ed6fba1bec6b tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.483653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e12b1ef2-deec-4367-8256-ed6fba1bec6b tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.484086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e12b1ef2-deec-4367-8256-ed6fba1bec6b tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.526995 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6eb3654a-2aa9-46f4-87cf-00c09216441f tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1332 microversion: 2.1 time: 0.271183 Sep 10 20:50:38.534962 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 305/667] 10.222.0.33 () {58 vars in 1190 bytes} [Sat Sep 10 20:50:38 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1332 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:38.546589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1155056e-9589-4585-ab01-37d96df1e37b tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:38.553094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1155056e-9589-4585-ab01-37d96df1e37b tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:50:38.560335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1155056e-9589-4585-ab01-37d96df1e37b tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.560729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1155056e-9589-4585-ab01-37d96df1e37b tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.561164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1155056e-9589-4585-ab01-37d96df1e37b tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.561911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1155056e-9589-4585-ab01-37d96df1e37b tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.562349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1155056e-9589-4585-ab01-37d96df1e37b tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.563676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1155056e-9589-4585-ab01-37d96df1e37b tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.565696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e12b1ef2-deec-4367-8256-ed6fba1bec6b tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch2-master-1". {{(pid=145771) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 20:50:38.584129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:38.591451 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1155056e-9589-4585-ab01-37d96df1e37b tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.048590 Sep 10 20:50:38.592035 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 306/668] 10.222.0.33 () {58 vars in 1196 bytes} [Sat Sep 10 20:50:38 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 20:50:38.605108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-38870d67-0c8f-4355-8d13-fa82f0c6ae77 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:38.607718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-38870d67-0c8f-4355-8d13-fa82f0c6ae77 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:38.616498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38870d67-0c8f-4355-8d13-fa82f0c6ae77 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.617249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38870d67-0c8f-4355-8d13-fa82f0c6ae77 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.617851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38870d67-0c8f-4355-8d13-fa82f0c6ae77 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.618732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38870d67-0c8f-4355-8d13-fa82f0c6ae77 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.619183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38870d67-0c8f-4355-8d13-fa82f0c6ae77 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.619601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38870d67-0c8f-4355-8d13-fa82f0c6ae77 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.655710 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e12b1ef2-deec-4367-8256-ed6fba1bec6b tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0/action" status: 202 len: 0 microversion: 2.91 time: 0.191224 Sep 10 20:50:38.659702 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 363/669] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:50:38 2022] POST /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:50:38.665029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c50c08d-1f9e-459c-ae99-9d3c4ed0d126 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:38.665657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c50c08d-1f9e-459c-ae99-9d3c4ed0d126 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:38.672538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c50c08d-1f9e-459c-ae99-9d3c4ed0d126 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.673171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c50c08d-1f9e-459c-ae99-9d3c4ed0d126 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.673784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c50c08d-1f9e-459c-ae99-9d3c4ed0d126 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.674518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c50c08d-1f9e-459c-ae99-9d3c4ed0d126 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.675057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c50c08d-1f9e-459c-ae99-9d3c4ed0d126 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.675620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c50c08d-1f9e-459c-ae99-9d3c4ed0d126 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.746168 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-38870d67-0c8f-4355-8d13-fa82f0c6ae77 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action" status: 202 len: 0 microversion: 2.1 time: 0.144917 Sep 10 20:50:38.747087 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 307/670] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:50:38 2022] POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:50:38.754045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:38.755301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:38.778250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.779106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.782382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.782382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.782382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.782382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.889343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:38.902072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:38.903779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-6c50c08d-1f9e-459c-ae99-9d3c4ed0d126 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:38.907929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:38.916729 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5a32f80d-4fc2-4549-99e3-10f2d2ae6221 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1548 microversion: 2.91 time: 0.167676 Sep 10 20:50:38.918188 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 308/671] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:38 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:38.923312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:38.929995 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c50c08d-1f9e-459c-ae99-9d3c4ed0d126 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.268928 Sep 10 20:50:38.930826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:38.931159 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 364/672] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:38 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:38.939101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.939705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.940285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.941092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.941729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.942949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:38.943080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.943878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:38.950688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.951537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.952357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:38.953417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:38.954103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:38.954804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:39.076513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:50:39.077180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:50:39.077915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:50:39.078475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:50:39.079031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:50:39.232580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:39.243134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:39.244962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:39.245542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:39.247042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:39.247825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:39.248844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:39.312735 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-090b7c8b-4c99-435a-889a-e380e5d18022 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action" status: 202 len: 1065 microversion: 2.1 time: 0.392920 Sep 10 20:50:39.316713 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 309/673] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:50:38 2022] POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action => generated 1065 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 20:50:39.336081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9b5b0e7a-82ea-4b49-a130-b1f2560ac3d1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:39.337415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9b5b0e7a-82ea-4b49-a130-b1f2560ac3d1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:39.341517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:39.352669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5b0e7a-82ea-4b49-a130-b1f2560ac3d1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:39.365865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5b0e7a-82ea-4b49-a130-b1f2560ac3d1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:39.375154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5b0e7a-82ea-4b49-a130-b1f2560ac3d1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:39.376574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5b0e7a-82ea-4b49-a130-b1f2560ac3d1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:39.379725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5b0e7a-82ea-4b49-a130-b1f2560ac3d1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:39.386342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5b0e7a-82ea-4b49-a130-b1f2560ac3d1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:39.853160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:39.864698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9b5b0e7a-82ea-4b49-a130-b1f2560ac3d1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:39.876539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:39.879120 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9b5b0e7a-82ea-4b49-a130-b1f2560ac3d1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.560415 Sep 10 20:50:39.881750 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 310/674] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:39 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:39.886185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:39.889302 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-99ff5f96-e7ad-4140-959b-4ae33d6dff5e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.952616 Sep 10 20:50:39.890124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a79b96b1-13c3-4a25-9f5b-614592bcf39c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:39.890750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a79b96b1-13c3-4a25-9f5b-614592bcf39c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:39.903030 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 365/675] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:38 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:39.908370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79b96b1-13c3-4a25-9f5b-614592bcf39c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:39.912909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79b96b1-13c3-4a25-9f5b-614592bcf39c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:39.913662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79b96b1-13c3-4a25-9f5b-614592bcf39c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:39.914852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79b96b1-13c3-4a25-9f5b-614592bcf39c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:39.917241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79b96b1-13c3-4a25-9f5b-614592bcf39c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:39.918494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79b96b1-13c3-4a25-9f5b-614592bcf39c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:39.939294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e2aeee2c-e358-4fd1-8feb-d01e173fdc14 req-bb446ceb-1e0a-4c59-b416-ffb05f3ff6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09798018-2269-451d-8486-df991ba45b0c", "name": "network-vif-unplugged", "status": "completed", "tag": "815af22b-692f-4103-b475-aa7f8e8118cd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:39.955646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e2aeee2c-e358-4fd1-8feb-d01e173fdc14 req-bb446ceb-1e0a-4c59-b416-ffb05f3ff6c1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:39.956414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e2aeee2c-e358-4fd1-8feb-d01e173fdc14 req-bb446ceb-1e0a-4c59-b416-ffb05f3ff6c1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:39.957255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e2aeee2c-e358-4fd1-8feb-d01e173fdc14 req-bb446ceb-1e0a-4c59-b416-ffb05f3ff6c1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:39.984709 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e2aeee2c-e358-4fd1-8feb-d01e173fdc14 req-bb446ceb-1e0a-4c59-b416-ffb05f3ff6c1 service nova] Creating event network-vif-unplugged:815af22b-692f-4103-b475-aa7f8e8118cd for instance 09798018-2269-451d-8486-df991ba45b0c on nch1-master-1 Sep 10 20:50:39.997108 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e2aeee2c-e358-4fd1-8feb-d01e173fdc14 req-bb446ceb-1e0a-4c59-b416-ffb05f3ff6c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061063 Sep 10 20:50:40.008813 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 366/676] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:40.015168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:40.016380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:40.024247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:40.025202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:40.026169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:40.027280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:40.028003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:40.028911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:40.226584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:40.242155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:40.246890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:40.280679 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c2a99cc8-3a0e-4e04-9ec0-adbcd558e14a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1490 microversion: 2.91 time: 0.265146 Sep 10 20:50:40.284741 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 367/677] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:40 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1490 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:40.299244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-22c94705-a08d-4e82-9243-d8c862bb12bb tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:40.299868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-22c94705-a08d-4e82-9243-d8c862bb12bb tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:40.331161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22c94705-a08d-4e82-9243-d8c862bb12bb tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:40.335902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22c94705-a08d-4e82-9243-d8c862bb12bb tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:40.339658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22c94705-a08d-4e82-9243-d8c862bb12bb tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:40.343120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22c94705-a08d-4e82-9243-d8c862bb12bb tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:40.344333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22c94705-a08d-4e82-9243-d8c862bb12bb tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:40.347359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22c94705-a08d-4e82-9243-d8c862bb12bb tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:40.449872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a79b96b1-13c3-4a25-9f5b-614592bcf39c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:40.461546 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a79b96b1-13c3-4a25-9f5b-614592bcf39c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1469 microversion: 2.1 time: 0.577124 Sep 10 20:50:40.463021 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 311/678] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:39 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1469 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:40.849409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-22c94705-a08d-4e82-9243-d8c862bb12bb tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:40.893859 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-22c94705-a08d-4e82-9243-d8c862bb12bb tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.607920 Sep 10 20:50:40.896461 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 368/679] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:40 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:40.908694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e034e86-b46a-4b36-bfdd-79be329c36bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:40.909766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e034e86-b46a-4b36-bfdd-79be329c36bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:40.922326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e034e86-b46a-4b36-bfdd-79be329c36bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:40.922803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e034e86-b46a-4b36-bfdd-79be329c36bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:40.923242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e034e86-b46a-4b36-bfdd-79be329c36bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:40.924324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:40.925220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:40.926261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e034e86-b46a-4b36-bfdd-79be329c36bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:40.926744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e034e86-b46a-4b36-bfdd-79be329c36bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:40.930194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e034e86-b46a-4b36-bfdd-79be329c36bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:40.932643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:40.933391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:40.934806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:40.935825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:40.936714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:40.937840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:41.262360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8e034e86-b46a-4b36-bfdd-79be329c36bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:41.271701 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e034e86-b46a-4b36-bfdd-79be329c36bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.367918 Sep 10 20:50:41.274960 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 312/680] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:40 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:41.316058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:41.316898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:41.330785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:41.337870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:41.338454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:41.339069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:41.339546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:41.347636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:41.553569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:41.563833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:41.583575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:41.586059 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3a5b24af-1d3d-4dce-a5fa-cdaa00018ba1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.666632 Sep 10 20:50:41.592918 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 369/681] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:40 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:41.603625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e0418341-8778-4950-872e-ad68c29c45f5 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:41.605506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e0418341-8778-4950-872e-ad68c29c45f5 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:41.626823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0418341-8778-4950-872e-ad68c29c45f5 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:41.627540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0418341-8778-4950-872e-ad68c29c45f5 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:41.627983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0418341-8778-4950-872e-ad68c29c45f5 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:41.629012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0418341-8778-4950-872e-ad68c29c45f5 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:41.629648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0418341-8778-4950-872e-ad68c29c45f5 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:41.630466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0418341-8778-4950-872e-ad68c29c45f5 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:41.764565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:41.781011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:41.782732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:41.803728 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-49ac993b-e09e-441b-96a7-d2b54d53915c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.489829 Sep 10 20:50:41.806802 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 313/682] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:41 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:50:41.927765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ab42de54-d532-42b6-9e1a-1671c8d83622 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:41.928374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ab42de54-d532-42b6-9e1a-1671c8d83622 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:41.943334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab42de54-d532-42b6-9e1a-1671c8d83622 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:41.947217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab42de54-d532-42b6-9e1a-1671c8d83622 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:41.952325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab42de54-d532-42b6-9e1a-1671c8d83622 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:41.953765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab42de54-d532-42b6-9e1a-1671c8d83622 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:41.959467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab42de54-d532-42b6-9e1a-1671c8d83622 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:41.961200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab42de54-d532-42b6-9e1a-1671c8d83622 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:41.997401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e0418341-8778-4950-872e-ad68c29c45f5 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:42.009919 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e0418341-8778-4950-872e-ad68c29c45f5 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1469 microversion: 2.1 time: 0.414486 Sep 10 20:50:42.028594 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 370/683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:41 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1469 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:42.050623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-70943385-6415-46dc-aa8d-5fb6fd069e41 req-f53e8598-91bc-4d87-886b-63d8bbcab253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09798018-2269-451d-8486-df991ba45b0c", "tag": "815af22b-692f-4103-b475-aa7f8e8118cd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:42.084605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-70943385-6415-46dc-aa8d-5fb6fd069e41 req-f53e8598-91bc-4d87-886b-63d8bbcab253 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:42.085123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-70943385-6415-46dc-aa8d-5fb6fd069e41 req-f53e8598-91bc-4d87-886b-63d8bbcab253 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:42.085565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-70943385-6415-46dc-aa8d-5fb6fd069e41 req-f53e8598-91bc-4d87-886b-63d8bbcab253 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:42.117888 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-70943385-6415-46dc-aa8d-5fb6fd069e41 req-f53e8598-91bc-4d87-886b-63d8bbcab253 service nova] Creating event network-changed:815af22b-692f-4103-b475-aa7f8e8118cd for instance 09798018-2269-451d-8486-df991ba45b0c on nch1-master-1 Sep 10 20:50:42.132467 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-70943385-6415-46dc-aa8d-5fb6fd069e41 req-f53e8598-91bc-4d87-886b-63d8bbcab253 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090468 Sep 10 20:50:42.137165 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 371/684] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:42.170606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-ab42de54-d532-42b6-9e1a-1671c8d83622 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:42.236931 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ab42de54-d532-42b6-9e1a-1671c8d83622 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.313195 Sep 10 20:50:42.243106 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 314/685] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:41 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:42.306687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-182ffae8-b798-44e8-8224-2d9c73d4e2c4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:42.307418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-182ffae8-b798-44e8-8224-2d9c73d4e2c4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:42.323552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182ffae8-b798-44e8-8224-2d9c73d4e2c4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:42.325931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182ffae8-b798-44e8-8224-2d9c73d4e2c4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:42.326584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182ffae8-b798-44e8-8224-2d9c73d4e2c4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:42.330608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182ffae8-b798-44e8-8224-2d9c73d4e2c4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:42.331488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182ffae8-b798-44e8-8224-2d9c73d4e2c4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:42.332124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182ffae8-b798-44e8-8224-2d9c73d4e2c4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:42.588402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1321462746", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:42.663137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:50:43.165722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-182ffae8-b798-44e8-8224-2d9c73d4e2c4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:43.180864 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-182ffae8-b798-44e8-8224-2d9c73d4e2c4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.879827 Sep 10 20:50:43.188044 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 372/686] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:42 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:43.208393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:43.209442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:43.228648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:43.233107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:43.233942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:43.235311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:43.238276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:43.239641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:43.941182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:43.953849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:43.967901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:43.971311 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9c5cd760-53e5-49c8-bd5a-f8ff36cbaa76 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1567 microversion: 2.25 time: 0.781361 Sep 10 20:50:43.973955 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 373/687] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:43 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1567 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:43.984249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:43.985647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:43.992471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:43.993237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:44.002544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:44.006804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:44.007718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:44.010245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:44.206310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:44.208443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:50:44.208877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:50:44.209592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:50:44.210222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:50:44.210818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:50:44.215454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:44.220444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:44.244950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:44.245762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:44.246648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:44.248480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:44.250527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:44.250669 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-806eb4d9-8cff-4f82-855d-ebe924eb5f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.262823 Sep 10 20:50:44.260636 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 374/688] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:43 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:44.261476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:44.273272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8bcb9b6-041a-4f86-a8f9-0f4e54665229 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:44.275840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8bcb9b6-041a-4f86-a8f9-0f4e54665229 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:44.291931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8bcb9b6-041a-4f86-a8f9-0f4e54665229 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:44.307582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8bcb9b6-041a-4f86-a8f9-0f4e54665229 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:44.313643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8bcb9b6-041a-4f86-a8f9-0f4e54665229 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:44.314699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8bcb9b6-041a-4f86-a8f9-0f4e54665229 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:44.315354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8bcb9b6-041a-4f86-a8f9-0f4e54665229 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:44.316102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8bcb9b6-041a-4f86-a8f9-0f4e54665229 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:44.319750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for project d969d135196e409584d6647d5186c9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:50:44.332854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for user 870c4c66a15b4546bd981cfb5932b214 and project d969d135196e409584d6647d5186c9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:50:44.380353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:50:44.382872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:50:44.513108 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dc43e119-b7ea-4aad-95bf-865a3bfad4e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.145741 Sep 10 20:50:44.518184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 315/689] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:50:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 20:50:44.530311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5d93b19-9e36-4020-8f1d-2bf54a1ac5ea tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:44.539075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5d93b19-9e36-4020-8f1d-2bf54a1ac5ea tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:44.563832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d93b19-9e36-4020-8f1d-2bf54a1ac5ea tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:44.565739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d93b19-9e36-4020-8f1d-2bf54a1ac5ea tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:44.572316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d93b19-9e36-4020-8f1d-2bf54a1ac5ea tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:44.575912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d93b19-9e36-4020-8f1d-2bf54a1ac5ea tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:44.576632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d93b19-9e36-4020-8f1d-2bf54a1ac5ea tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:44.579100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d93b19-9e36-4020-8f1d-2bf54a1ac5ea tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:44.817639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-a5d93b19-9e36-4020-8f1d-2bf54a1ac5ea tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:44.853459 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5d93b19-9e36-4020-8f1d-2bf54a1ac5ea tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.333249 Sep 10 20:50:44.855376 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 316/690] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:44 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:44.862481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bf26ea77-8b16-42a9-9237-d7d40b6cef94 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:44.863403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bf26ea77-8b16-42a9-9237-d7d40b6cef94 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:44.873394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf26ea77-8b16-42a9-9237-d7d40b6cef94 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:44.875070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf26ea77-8b16-42a9-9237-d7d40b6cef94 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:44.875969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf26ea77-8b16-42a9-9237-d7d40b6cef94 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:44.876960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf26ea77-8b16-42a9-9237-d7d40b6cef94 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:44.877737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf26ea77-8b16-42a9-9237-d7d40b6cef94 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:44.878536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf26ea77-8b16-42a9-9237-d7d40b6cef94 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:44.888683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8bcb9b6-041a-4f86-a8f9-0f4e54665229 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:44.897845 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8bcb9b6-041a-4f86-a8f9-0f4e54665229 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1469 microversion: 2.1 time: 0.645299 Sep 10 20:50:44.905107 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 375/691] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:44 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1469 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:44.910084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-95a2e91e-7d25-42c7-a9c7-3c8fb1a6e6c7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:44.914043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-95a2e91e-7d25-42c7-a9c7-3c8fb1a6e6c7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:45.205175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-95a2e91e-7d25-42c7-a9c7-3c8fb1a6e6c7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:45.217892 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-95a2e91e-7d25-42c7-a9c7-3c8fb1a6e6c7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1213 microversion: 2.1 time: 0.318312 Sep 10 20:50:45.218974 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 376/692] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:44 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1213 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:45.228740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-281415969", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "b0d9b016-bd5d-4209-9287-ac0326e9149d"}, {"uuid": "f0fc7fef-fb46-4037-a810-ac56d99b4cb6"}, {"uuid": "b0d9b016-bd5d-4209-9287-ac0326e9149d"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:45.238011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bf26ea77-8b16-42a9-9237-d7d40b6cef94 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:45.247668 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bf26ea77-8b16-42a9-9237-d7d40b6cef94 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.391025 Sep 10 20:50:45.249947 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 317/693] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:44 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:45.272939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:45.273739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:45.295811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:45.296737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:45.297343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:45.298281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:45.300319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:45.300942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:45.384029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] validate_networks() for [('b0d9b016-bd5d-4209-9287-ac0326e9149d', None, None, None, None, None), ('f0fc7fef-fb46-4037-a810-ac56d99b4cb6', None, None, None, None, None), ('b0d9b016-bd5d-4209-9287-ac0326e9149d', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:50:45.605597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:45.618978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:45.631987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:45.633635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-33386c6a-e973-4c8d-908b-11c2c352bb71 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1542 microversion: 2.25 time: 0.369621 Sep 10 20:50:45.634627 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 318/694] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:45 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1542 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:45.678846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:45.680205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:45.687495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:45.688420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:45.689258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:45.690318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:45.691357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:45.692353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:45.842903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:45.858875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:45.871645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:45.875999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:45.889819 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0b232fb7-088a-47d1-bc76-7178a751f815 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.237031 Sep 10 20:50:45.890882 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 319/695] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:45 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:45.900384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c27a565e-0a85-4e03-bc33-6c19d0e080df tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '.version_select at 0x7f9944c474c0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:45.904467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c27a565e-0a85-4e03-bc33-6c19d0e080df tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:45.905273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c27a565e-0a85-4e03-bc33-6c19d0e080df tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:45.906163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c27a565e-0a85-4e03-bc33-6c19d0e080df tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:45.917200 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c27a565e-0a85-4e03-bc33-6c19d0e080df tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1764 microversion: 2.25 time: 0.024996 Sep 10 20:50:45.929209 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 320/696] 10.222.0.33 () {60 vars in 1184 bytes} [Sat Sep 10 20:50:45 2022] GET /compute/v2.1/os-migrations => generated 1764 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:45.932203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-530c3f85-8d68-4e1e-a1b4-f0f118bf5042 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:45.932851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-530c3f85-8d68-4e1e-a1b4-f0f118bf5042 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:45.940006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-530c3f85-8d68-4e1e-a1b4-f0f118bf5042 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:45.940506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-530c3f85-8d68-4e1e-a1b4-f0f118bf5042 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:45.940957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-530c3f85-8d68-4e1e-a1b4-f0f118bf5042 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:45.941793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-530c3f85-8d68-4e1e-a1b4-f0f118bf5042 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:45.942459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-530c3f85-8d68-4e1e-a1b4-f0f118bf5042 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:45.942949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-530c3f85-8d68-4e1e-a1b4-f0f118bf5042 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:46.105893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-530c3f85-8d68-4e1e-a1b4-f0f118bf5042 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:46.146711 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-530c3f85-8d68-4e1e-a1b4-f0f118bf5042 tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1927 microversion: 2.75 time: 0.218922 Sep 10 20:50:46.147724 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 321/697] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:45 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1927 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:46.157600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb0017bb-f0b0-4751-938b-c34700336d38 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:46.158251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bb0017bb-f0b0-4751-938b-c34700336d38 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:46.174707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb0017bb-f0b0-4751-938b-c34700336d38 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:46.175214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb0017bb-f0b0-4751-938b-c34700336d38 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:46.175657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb0017bb-f0b0-4751-938b-c34700336d38 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:46.176861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb0017bb-f0b0-4751-938b-c34700336d38 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:46.177586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb0017bb-f0b0-4751-938b-c34700336d38 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:46.178306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb0017bb-f0b0-4751-938b-c34700336d38 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:46.526185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bb0017bb-f0b0-4751-938b-c34700336d38 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:46.527633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:46.539264 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bb0017bb-f0b0-4751-938b-c34700336d38 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1469 microversion: 2.1 time: 0.390437 Sep 10 20:50:46.539856 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 322/698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:46 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1469 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:46.562521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cc782a93-80c9-4425-b055-9a019bf322b6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:46.563172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cc782a93-80c9-4425-b055-9a019bf322b6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:46.596837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc782a93-80c9-4425-b055-9a019bf322b6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:46.599364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc782a93-80c9-4425-b055-9a019bf322b6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:46.602411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc782a93-80c9-4425-b055-9a019bf322b6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:46.604508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc782a93-80c9-4425-b055-9a019bf322b6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:46.610037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc782a93-80c9-4425-b055-9a019bf322b6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:46.610887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc782a93-80c9-4425-b055-9a019bf322b6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:47.067533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-cc782a93-80c9-4425-b055-9a019bf322b6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:47.110093 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cc782a93-80c9-4425-b055-9a019bf322b6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 2034 microversion: 2.25 time: 0.557003 Sep 10 20:50:47.110994 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 323/699] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:46 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 2034 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:47.116763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0889b504-e01c-4ae7-8d5e-7514c61f6dec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:47.118516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0889b504-e01c-4ae7-8d5e-7514c61f6dec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:47.125704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0889b504-e01c-4ae7-8d5e-7514c61f6dec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:47.126465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0889b504-e01c-4ae7-8d5e-7514c61f6dec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:47.127078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0889b504-e01c-4ae7-8d5e-7514c61f6dec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:47.128216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0889b504-e01c-4ae7-8d5e-7514c61f6dec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:47.128842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0889b504-e01c-4ae7-8d5e-7514c61f6dec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:47.130702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0889b504-e01c-4ae7-8d5e-7514c61f6dec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:47.368278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0889b504-e01c-4ae7-8d5e-7514c61f6dec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:47.396805 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0889b504-e01c-4ae7-8d5e-7514c61f6dec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1265 microversion: 2.1 time: 0.284506 Sep 10 20:50:47.399070 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 324/700] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:47 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:47.429179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96d4cf40-5e9d-404b-87d5-20ce2e86d30e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:47.450891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96d4cf40-5e9d-404b-87d5-20ce2e86d30e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:47.508669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96d4cf40-5e9d-404b-87d5-20ce2e86d30e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:47.514386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96d4cf40-5e9d-404b-87d5-20ce2e86d30e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:47.515833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96d4cf40-5e9d-404b-87d5-20ce2e86d30e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:47.520635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:50:47.521396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:50:47.521881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:50:47.522519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:50:47.522843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:50:47.527811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96d4cf40-5e9d-404b-87d5-20ce2e86d30e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:47.531375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96d4cf40-5e9d-404b-87d5-20ce2e86d30e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:47.532670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96d4cf40-5e9d-404b-87d5-20ce2e86d30e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:47.543288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:47.544591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:47.545204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:47.546604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:47.547243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:47.548025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:47.572072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Getting quotas for project a7933149ce16427e84de63058fff1142. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:50:47.580786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Getting quotas for user 3f0ba978c04048a29bf4132a1e7379b9 and project a7933149ce16427e84de63058fff1142. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:50:47.603630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:50:47.607610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:50:47.702923 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6dbd3992-45fb-42e1-bc90-43693a54c36c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.477869 Sep 10 20:50:47.711698 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 377/701] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:50:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:50:47.732189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:47.736635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:47.785386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:47.786243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:47.786903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:47.787972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:47.788646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:47.789239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:47.818600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:47.853150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-96d4cf40-5e9d-404b-87d5-20ce2e86d30e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:47.864917 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96d4cf40-5e9d-404b-87d5-20ce2e86d30e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.462974 Sep 10 20:50:47.867315 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 325/702] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:47 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:47.883765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-592255d8-a26e-41ed-940d-a790bbe57928 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Action: 'create', calling method: .version_select at 0x7f9944c04f70>, body: {"keypair": {"name": "tempest-keypair-1885927030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJucXfUycx6Iqt8Cm7uMFHqyRKkRpRztoTG11+xxfEqTOtunvprEv6A2igJ7b5ufWk8XSpiV2iYnm/PIpg0z1lnJjz43YgENsZj9o3u8sTPl1Oj+3dUwP/TRDKbV+rMKZA=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:47.929386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-592255d8-a26e-41ed-940d-a790bbe57928 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Getting quotas for project 89075fefc8ea47c78d4ff7364e12ffde. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:50:47.948634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-592255d8-a26e-41ed-940d-a790bbe57928 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Getting quotas for user dd431fc2d9834bea8df807edb91771ee and project 89075fefc8ea47c78d4ff7364e12ffde. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:50:48.020506 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-592255d8-a26e-41ed-940d-a790bbe57928 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.149613 Sep 10 20:50:48.024249 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 326/703] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Sep 10 20:50:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 20:50:48.050486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-77c50100-5326-4735-bcfe-8ab70ad19afd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:48.051236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-77c50100-5326-4735-bcfe-8ab70ad19afd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:48.061847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:48.077266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77c50100-5326-4735-bcfe-8ab70ad19afd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:48.077794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77c50100-5326-4735-bcfe-8ab70ad19afd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:48.078262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77c50100-5326-4735-bcfe-8ab70ad19afd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:48.078671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:48.084372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77c50100-5326-4735-bcfe-8ab70ad19afd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:48.084893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77c50100-5326-4735-bcfe-8ab70ad19afd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:48.088553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77c50100-5326-4735-bcfe-8ab70ad19afd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:48.095219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:48.123344 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da106a25-7b69-4a52-8840-6537f71348c7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.409680 Sep 10 20:50:48.124539 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 378/704] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:47 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:48.129563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6564628f-095f-4fa6-96c2-f045e07918d1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:48.130716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6564628f-095f-4fa6-96c2-f045e07918d1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:48.138948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6564628f-095f-4fa6-96c2-f045e07918d1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:48.139746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6564628f-095f-4fa6-96c2-f045e07918d1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:48.140417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6564628f-095f-4fa6-96c2-f045e07918d1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:48.141481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6564628f-095f-4fa6-96c2-f045e07918d1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:48.142197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6564628f-095f-4fa6-96c2-f045e07918d1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:48.142854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6564628f-095f-4fa6-96c2-f045e07918d1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:48.395541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-77c50100-5326-4735-bcfe-8ab70ad19afd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:48.402650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6564628f-095f-4fa6-96c2-f045e07918d1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:48.417357 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6564628f-095f-4fa6-96c2-f045e07918d1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1469 microversion: 2.1 time: 0.291253 Sep 10 20:50:48.418509 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 379/705] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:48 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1469 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:48.424093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f518240-e960-4402-9892-e01aa38d576c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:48.425778 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-77c50100-5326-4735-bcfe-8ab70ad19afd tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1933 microversion: 2.75 time: 0.400410 Sep 10 20:50:48.426925 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 327/706] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:48 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1933 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:48.429058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8f518240-e960-4402-9892-e01aa38d576c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:48.438159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-177566f0-097a-4d36-b46a-1f341f5e2652 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:48.439535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-177566f0-097a-4d36-b46a-1f341f5e2652 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:48.450061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-177566f0-097a-4d36-b46a-1f341f5e2652 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:48.451053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-177566f0-097a-4d36-b46a-1f341f5e2652 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:48.451798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-177566f0-097a-4d36-b46a-1f341f5e2652 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:48.452831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-177566f0-097a-4d36-b46a-1f341f5e2652 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:48.453540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-177566f0-097a-4d36-b46a-1f341f5e2652 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:48.454465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-177566f0-097a-4d36-b46a-1f341f5e2652 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:48.524825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8f518240-e960-4402-9892-e01aa38d576c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:48.540996 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8f518240-e960-4402-9892-e01aa38d576c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1212 microversion: 2.1 time: 0.120965 Sep 10 20:50:48.544808 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 380/707] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:48 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1212 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:48.722107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-177566f0-097a-4d36-b46a-1f341f5e2652 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:48.745996 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-177566f0-097a-4d36-b46a-1f341f5e2652 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1265 microversion: 2.1 time: 0.317079 Sep 10 20:50:48.763264 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 328/708] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:48 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:48.892511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f82902e8-f12e-4cb0-b78b-531c7d3f23bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:48.893332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f82902e8-f12e-4cb0-b78b-531c7d3f23bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:48.907876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:48.912289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82902e8-f12e-4cb0-b78b-531c7d3f23bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:48.914497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82902e8-f12e-4cb0-b78b-531c7d3f23bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:48.915517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82902e8-f12e-4cb0-b78b-531c7d3f23bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:48.920285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82902e8-f12e-4cb0-b78b-531c7d3f23bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:48.921170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82902e8-f12e-4cb0-b78b-531c7d3f23bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:48.922176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82902e8-f12e-4cb0-b78b-531c7d3f23bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:49.157719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:49.158620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:49.173890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:49.175597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:49.176834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:49.179705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:49.180401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:49.182915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:49.266127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f82902e8-f12e-4cb0-b78b-531c7d3f23bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:49.289235 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f82902e8-f12e-4cb0-b78b-531c7d3f23bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.400745 Sep 10 20:50:49.291340 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 381/709] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:48 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:49.350806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:49.367640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:49.373232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:49.388281 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d7d7d496-621e-4ac5-b7f5-4b86c639c894 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.233747 Sep 10 20:50:49.403391 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 329/710] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:49 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:49.443212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-865711ee-9b20-4a58-82dc-87215a0413f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:49.444051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-865711ee-9b20-4a58-82dc-87215a0413f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:49.463361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ecd9c775-8600-41c1-87b7-9816cbbc0b4f tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:49.464230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ecd9c775-8600-41c1-87b7-9816cbbc0b4f tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:49.496028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-865711ee-9b20-4a58-82dc-87215a0413f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:49.497124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd9c775-8600-41c1-87b7-9816cbbc0b4f tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:49.497935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-865711ee-9b20-4a58-82dc-87215a0413f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:49.500050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd9c775-8600-41c1-87b7-9816cbbc0b4f tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:49.500880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-865711ee-9b20-4a58-82dc-87215a0413f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:49.501380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd9c775-8600-41c1-87b7-9816cbbc0b4f tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:49.502163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-865711ee-9b20-4a58-82dc-87215a0413f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:49.505268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-865711ee-9b20-4a58-82dc-87215a0413f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:49.505997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-865711ee-9b20-4a58-82dc-87215a0413f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:49.522899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd9c775-8600-41c1-87b7-9816cbbc0b4f tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:49.523575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd9c775-8600-41c1-87b7-9816cbbc0b4f tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:49.525084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd9c775-8600-41c1-87b7-9816cbbc0b4f tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:49.787879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-ecd9c775-8600-41c1-87b7-9816cbbc0b4f tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:49.853668 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ecd9c775-8600-41c1-87b7-9816cbbc0b4f tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1933 microversion: 2.75 time: 0.393800 Sep 10 20:50:49.854864 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 330/711] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:49 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1933 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:50:49.879140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09ef1da5-be97-45bf-9b3c-4b6d4a09fed8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:49.880149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09ef1da5-be97-45bf-9b3c-4b6d4a09fed8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:49.896669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ef1da5-be97-45bf-9b3c-4b6d4a09fed8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:49.897203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ef1da5-be97-45bf-9b3c-4b6d4a09fed8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:49.897648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ef1da5-be97-45bf-9b3c-4b6d4a09fed8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:49.898417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ef1da5-be97-45bf-9b3c-4b6d4a09fed8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:49.898876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ef1da5-be97-45bf-9b3c-4b6d4a09fed8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:49.899311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ef1da5-be97-45bf-9b3c-4b6d4a09fed8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:50.006680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-865711ee-9b20-4a58-82dc-87215a0413f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:50.022189 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-865711ee-9b20-4a58-82dc-87215a0413f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1469 microversion: 2.1 time: 0.582930 Sep 10 20:50:50.025524 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 382/712] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:49 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1469 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:50.046698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a4a81c69-bf35-4fd6-9270-bb045aa81c1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:50.053877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a4a81c69-bf35-4fd6-9270-bb045aa81c1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:50.074883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4a81c69-bf35-4fd6-9270-bb045aa81c1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:50.075228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4a81c69-bf35-4fd6-9270-bb045aa81c1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:50.078816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4a81c69-bf35-4fd6-9270-bb045aa81c1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:50.079775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4a81c69-bf35-4fd6-9270-bb045aa81c1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:50.080449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4a81c69-bf35-4fd6-9270-bb045aa81c1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:50.083388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4a81c69-bf35-4fd6-9270-bb045aa81c1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:50.236593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09ef1da5-be97-45bf-9b3c-4b6d4a09fed8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:50.239034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a4a81c69-bf35-4fd6-9270-bb045aa81c1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:50.249282 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09ef1da5-be97-45bf-9b3c-4b6d4a09fed8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1208 microversion: 2.1 time: 0.393038 Sep 10 20:50:50.252839 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 331/713] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:49 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1208 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:50.254732 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a4a81c69-bf35-4fd6-9270-bb045aa81c1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1265 microversion: 2.1 time: 0.227581 Sep 10 20:50:50.270189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 383/714] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:50 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:50.320269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-685dd2f6-0906-4cb8-b281-dd0d6c691c8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:50.320947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-685dd2f6-0906-4cb8-b281-dd0d6c691c8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:50.336736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685dd2f6-0906-4cb8-b281-dd0d6c691c8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:50.337297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685dd2f6-0906-4cb8-b281-dd0d6c691c8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:50.337753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685dd2f6-0906-4cb8-b281-dd0d6c691c8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:50.338534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685dd2f6-0906-4cb8-b281-dd0d6c691c8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:50.339262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685dd2f6-0906-4cb8-b281-dd0d6c691c8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:50.339701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685dd2f6-0906-4cb8-b281-dd0d6c691c8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:50.431188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:50.432153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:50.443681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:50.446416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:50.448592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:50.450717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:50.452636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:50.454451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:50.710220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-685dd2f6-0906-4cb8-b281-dd0d6c691c8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:50.720503 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-685dd2f6-0906-4cb8-b281-dd0d6c691c8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.406321 Sep 10 20:50:50.731009 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 384/715] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:50 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:50.842631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:50.856785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:50.858355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:50.865488 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35fd712c-4d11-4d64-87f7-8113b13cc161 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.444049 Sep 10 20:50:50.867476 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 332/716] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:50 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:50.888534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c689ce1b-b267-42b8-bd5a-7fd439659c9c tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:50.889446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c689ce1b-b267-42b8-bd5a-7fd439659c9c tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:50.899926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c689ce1b-b267-42b8-bd5a-7fd439659c9c tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:50.909038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c689ce1b-b267-42b8-bd5a-7fd439659c9c tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:50.910244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c689ce1b-b267-42b8-bd5a-7fd439659c9c tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:50.911696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c689ce1b-b267-42b8-bd5a-7fd439659c9c tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:50.912405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c689ce1b-b267-42b8-bd5a-7fd439659c9c tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:50.913070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c689ce1b-b267-42b8-bd5a-7fd439659c9c tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:51.030899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-c689ce1b-b267-42b8-bd5a-7fd439659c9c tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:51.048433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d2b900f-108c-4eb9-8075-5cc22dd3cb34 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:51.049045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d2b900f-108c-4eb9-8075-5cc22dd3cb34 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:51.062160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2b900f-108c-4eb9-8075-5cc22dd3cb34 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:51.062682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2b900f-108c-4eb9-8075-5cc22dd3cb34 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:51.063126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2b900f-108c-4eb9-8075-5cc22dd3cb34 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:51.063843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2b900f-108c-4eb9-8075-5cc22dd3cb34 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:51.064294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2b900f-108c-4eb9-8075-5cc22dd3cb34 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:51.066083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2b900f-108c-4eb9-8075-5cc22dd3cb34 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:51.072013 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c689ce1b-b267-42b8-bd5a-7fd439659c9c tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1933 microversion: 2.75 time: 0.188562 Sep 10 20:50:51.086760 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 385/717] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:50 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1933 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:51.277326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-595e14f2-2f6f-452c-8833-bb4937ba9753 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:51.278220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-595e14f2-2f6f-452c-8833-bb4937ba9753 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:51.289351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-595e14f2-2f6f-452c-8833-bb4937ba9753 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:51.290213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-595e14f2-2f6f-452c-8833-bb4937ba9753 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:51.291951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-595e14f2-2f6f-452c-8833-bb4937ba9753 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:51.292851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-595e14f2-2f6f-452c-8833-bb4937ba9753 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:51.302482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-595e14f2-2f6f-452c-8833-bb4937ba9753 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:51.303311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-595e14f2-2f6f-452c-8833-bb4937ba9753 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:51.446103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-595e14f2-2f6f-452c-8833-bb4937ba9753 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:51.455531 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-595e14f2-2f6f-452c-8833-bb4937ba9753 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1264 microversion: 2.1 time: 0.182177 Sep 10 20:50:51.456187 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 386/718] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:51 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:50:51.476502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2ed0352d-498d-4dfc-a550-f023752968e9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:51.477121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2ed0352d-498d-4dfc-a550-f023752968e9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:51.494017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ed0352d-498d-4dfc-a550-f023752968e9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:51.495822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ed0352d-498d-4dfc-a550-f023752968e9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:51.496282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ed0352d-498d-4dfc-a550-f023752968e9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:51.506035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ed0352d-498d-4dfc-a550-f023752968e9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:51.506542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ed0352d-498d-4dfc-a550-f023752968e9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:51.506992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ed0352d-498d-4dfc-a550-f023752968e9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:51.590454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2ed0352d-498d-4dfc-a550-f023752968e9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:51.608329 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2ed0352d-498d-4dfc-a550-f023752968e9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1271 microversion: 2.1 time: 0.151000 Sep 10 20:50:51.614465 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 387/719] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:51 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:51.760461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1778b0fd-bb95-4257-a8fd-71b285ad9276 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:51.761678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1778b0fd-bb95-4257-a8fd-71b285ad9276 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:51.775906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1778b0fd-bb95-4257-a8fd-71b285ad9276 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:51.778269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1778b0fd-bb95-4257-a8fd-71b285ad9276 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:51.778973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1778b0fd-bb95-4257-a8fd-71b285ad9276 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:51.782100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1778b0fd-bb95-4257-a8fd-71b285ad9276 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:51.782766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1778b0fd-bb95-4257-a8fd-71b285ad9276 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:51.783368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1778b0fd-bb95-4257-a8fd-71b285ad9276 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:52.065431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1778b0fd-bb95-4257-a8fd-71b285ad9276 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:52.081778 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1778b0fd-bb95-4257-a8fd-71b285ad9276 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.326525 Sep 10 20:50:52.083769 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 388/720] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:51 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:52.089561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:52.091090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:52.102117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:52.102839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:52.103426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:52.105016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:52.105488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:52.106779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:52.178820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d2b900f-108c-4eb9-8075-5cc22dd3cb34 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:52.190489 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d2b900f-108c-4eb9-8075-5cc22dd3cb34 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1469 microversion: 2.1 time: 1.145725 Sep 10 20:50:52.191140 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 333/721] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:51 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1469 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:50:52.212824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:52.225122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-48d5ae5a-6033-4375-9b79-540e93ab8f6e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:52.225755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-48d5ae5a-6033-4375-9b79-540e93ab8f6e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:52.238952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d5ae5a-6033-4375-9b79-540e93ab8f6e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:52.239615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d5ae5a-6033-4375-9b79-540e93ab8f6e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:52.240127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d5ae5a-6033-4375-9b79-540e93ab8f6e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:52.240777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d5ae5a-6033-4375-9b79-540e93ab8f6e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:52.246140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d5ae5a-6033-4375-9b79-540e93ab8f6e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:52.246803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d5ae5a-6033-4375-9b79-540e93ab8f6e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:52.249899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:52.257403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:52.279084 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d32d57c6-89f4-42fc-a385-37df1f545e1e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.193016 Sep 10 20:50:52.282396 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 389/722] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:52 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:52.395395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-48d5ae5a-6033-4375-9b79-540e93ab8f6e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] Lazy-loading 'services' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:52.455719 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-48d5ae5a-6033-4375-9b79-540e93ab8f6e tempest-ServersAdmin275Test-2044766906 tempest-ServersAdmin275Test-2044766906-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1918 microversion: 2.75 time: 0.236500 Sep 10 20:50:52.479456 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 334/723] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:52 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1918 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:52.483906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6736c85-1d4c-450c-8e7a-835756f91edf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:52.484740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6736c85-1d4c-450c-8e7a-835756f91edf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:52.512607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bd13dc53-1bc4-4e42-9ce8-0c4c6ca4f5a2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:52.513416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bd13dc53-1bc4-4e42-9ce8-0c4c6ca4f5a2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:52.522646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6736c85-1d4c-450c-8e7a-835756f91edf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:52.523609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd13dc53-1bc4-4e42-9ce8-0c4c6ca4f5a2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:52.524331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd13dc53-1bc4-4e42-9ce8-0c4c6ca4f5a2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:52.525260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6736c85-1d4c-450c-8e7a-835756f91edf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:52.525854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd13dc53-1bc4-4e42-9ce8-0c4c6ca4f5a2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:52.528134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6736c85-1d4c-450c-8e7a-835756f91edf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:52.528267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd13dc53-1bc4-4e42-9ce8-0c4c6ca4f5a2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:52.528488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd13dc53-1bc4-4e42-9ce8-0c4c6ca4f5a2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:52.529088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd13dc53-1bc4-4e42-9ce8-0c4c6ca4f5a2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:52.532111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6736c85-1d4c-450c-8e7a-835756f91edf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:52.534663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6736c85-1d4c-450c-8e7a-835756f91edf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:52.537743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6736c85-1d4c-450c-8e7a-835756f91edf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:52.568255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bd13dc53-1bc4-4e42-9ce8-0c4c6ca4f5a2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:50:52.621797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:52.744737 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bd13dc53-1bc4-4e42-9ce8-0c4c6ca4f5a2 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 204 len: 0 microversion: 2.75 time: 0.239697 Sep 10 20:50:52.751034 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 335/724] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:50:52 2022] DELETE /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:50:52.773922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-630881201", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "d1056f7d-9b49-496a-b2dd-0515a9a2e934"}], "security_groups": [{"name": "tempest-securitygroup--353715797"}], "key_name": "tempest-keypair-1885927030", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:52.826700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:52.833183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c6736c85-1d4c-450c-8e7a-835756f91edf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:52.876938 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6736c85-1d4c-450c-8e7a-835756f91edf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1264 microversion: 2.1 time: 0.395620 Sep 10 20:50:52.898900 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 390/725] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:52 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1264 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:50:52.927816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b274740b-f495-4d55-b34c-401497a37436 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:52.928440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b274740b-f495-4d55-b34c-401497a37436 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:52.949708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b274740b-f495-4d55-b34c-401497a37436 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:52.950237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b274740b-f495-4d55-b34c-401497a37436 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:52.950676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b274740b-f495-4d55-b34c-401497a37436 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:52.951390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b274740b-f495-4d55-b34c-401497a37436 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:52.951846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b274740b-f495-4d55-b34c-401497a37436 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:52.952275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b274740b-f495-4d55-b34c-401497a37436 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:53.244503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] validate_networks() for [('d1056f7d-9b49-496a-b2dd-0515a9a2e934', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:50:53.635096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b274740b-f495-4d55-b34c-401497a37436 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:53.652024 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b274740b-f495-4d55-b34c-401497a37436 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1313 microversion: 2.1 time: 0.750553 Sep 10 20:50:53.655066 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 391/726] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:52 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:53.668599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:53.670685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:53.682051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:53.682906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:53.683484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:53.684346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:53.685397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:53.686127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:53.792312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:53.803828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:53.805316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:53.811708 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-78d6f6e4-8175-4d19-a92f-b627fd2786f1 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1443 microversion: 2.75 time: 0.155197 Sep 10 20:50:53.812312 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 392/727] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:53 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:53.839880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-401c5406-20cf-4bf4-b998-812101246314 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:53.840506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-401c5406-20cf-4bf4-b998-812101246314 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:53.847044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-401c5406-20cf-4bf4-b998-812101246314 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:53.848067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-401c5406-20cf-4bf4-b998-812101246314 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:53.848533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-401c5406-20cf-4bf4-b998-812101246314 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:53.849980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-401c5406-20cf-4bf4-b998-812101246314 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:53.850457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-401c5406-20cf-4bf4-b998-812101246314 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:53.850908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-401c5406-20cf-4bf4-b998-812101246314 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.010145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:50:54.010727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:50:54.011420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:50:54.012366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:50:54.013148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:50:54.022731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.023292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.023469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-401c5406-20cf-4bf4-b998-812101246314 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.023870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.024679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.025211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.025723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.031839 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-401c5406-20cf-4bf4-b998-812101246314 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.202751 Sep 10 20:50:54.032328 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 393/728] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:53 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:54.038112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d758ec66-8fe2-4a52-b2e9-8f2f5e1c749e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:54.038807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d758ec66-8fe2-4a52-b2e9-8f2f5e1c749e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:54.045104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d758ec66-8fe2-4a52-b2e9-8f2f5e1c749e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.045596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d758ec66-8fe2-4a52-b2e9-8f2f5e1c749e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.046096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d758ec66-8fe2-4a52-b2e9-8f2f5e1c749e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.046868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d758ec66-8fe2-4a52-b2e9-8f2f5e1c749e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.047320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d758ec66-8fe2-4a52-b2e9-8f2f5e1c749e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.047747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d758ec66-8fe2-4a52-b2e9-8f2f5e1c749e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.060079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Getting quotas for project 89075fefc8ea47c78d4ff7364e12ffde. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:50:54.064940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Getting quotas for user dd431fc2d9834bea8df807edb91771ee and project 89075fefc8ea47c78d4ff7364e12ffde. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:50:54.078172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:50:54.080606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:50:54.133419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cbccb9e5-2734-4c3e-a54a-6398b0980d8b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.375925 Sep 10 20:50:54.135172 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 336/729] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:50:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 20:50:54.140062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:54.140864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:54.150173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.150173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.150173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.150741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.151204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.151634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.203048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d758ec66-8fe2-4a52-b2e9-8f2f5e1c749e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.212827 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d758ec66-8fe2-4a52-b2e9-8f2f5e1c749e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1469 microversion: 2.1 time: 0.179287 Sep 10 20:50:54.225849 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 394/730] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:54 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:54.225849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98d117d7-77ea-4568-9c58-a1aa68143d24 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:54.225849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-98d117d7-77ea-4568-9c58-a1aa68143d24 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:54.231572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.235825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98d117d7-77ea-4568-9c58-a1aa68143d24 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.236411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98d117d7-77ea-4568-9c58-a1aa68143d24 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.236593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98d117d7-77ea-4568-9c58-a1aa68143d24 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.237209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98d117d7-77ea-4568-9c58-a1aa68143d24 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.237642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98d117d7-77ea-4568-9c58-a1aa68143d24 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.238102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98d117d7-77ea-4568-9c58-a1aa68143d24 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.245165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.247172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.255755 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-529636f0-d217-4496-b5c7-fae573cf8f9d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.119054 Sep 10 20:50:54.256856 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 337/731] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:54 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:54.269650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10d1c2ae-f25a-4bbe-a8b9-70397761397a tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:54.271398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10d1c2ae-f25a-4bbe-a8b9-70397761397a tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:54.317650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-98d117d7-77ea-4568-9c58-a1aa68143d24 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.320534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:54.329028 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-98d117d7-77ea-4568-9c58-a1aa68143d24 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1264 microversion: 2.1 time: 0.113558 Sep 10 20:50:54.329617 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 395/732] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:54 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1264 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:54.340299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10d1c2ae-f25a-4bbe-a8b9-70397761397a tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.350847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10d1c2ae-f25a-4bbe-a8b9-70397761397a tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.353027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10d1c2ae-f25a-4bbe-a8b9-70397761397a tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.354585 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10d1c2ae-f25a-4bbe-a8b9-70397761397a tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1285 microversion: 2.25 time: 0.096481 Sep 10 20:50:54.355318 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 338/733] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:54 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:54.681557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f9a1d433-2d94-4072-82b7-2c952c148978 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:54.682213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f9a1d433-2d94-4072-82b7-2c952c148978 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:54.692329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9a1d433-2d94-4072-82b7-2c952c148978 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.693383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9a1d433-2d94-4072-82b7-2c952c148978 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.694184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9a1d433-2d94-4072-82b7-2c952c148978 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.695248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9a1d433-2d94-4072-82b7-2c952c148978 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.696152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9a1d433-2d94-4072-82b7-2c952c148978 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.696835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9a1d433-2d94-4072-82b7-2c952c148978 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.843794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:54.844782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:54.855688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.856421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.857091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.858954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:54.860409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:54.861079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:54.945387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.955310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.956895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:54.969422 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ed51b4cc-fdc2-454d-9b57-8b549762030c tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1443 microversion: 2.75 time: 0.130094 Sep 10 20:50:54.970311 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 339/734] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:54 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1443 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:55.039967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f9a1d433-2d94-4072-82b7-2c952c148978 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:55.048835 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f9a1d433-2d94-4072-82b7-2c952c148978 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1313 microversion: 2.1 time: 0.373919 Sep 10 20:50:55.049873 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 396/735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:54 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:55.071243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eb80d5af-7959-49b3-a8b7-996fe8b9310a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:55.072068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eb80d5af-7959-49b3-a8b7-996fe8b9310a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:55.078898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb80d5af-7959-49b3-a8b7-996fe8b9310a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.079484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb80d5af-7959-49b3-a8b7-996fe8b9310a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.080000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb80d5af-7959-49b3-a8b7-996fe8b9310a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.080818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb80d5af-7959-49b3-a8b7-996fe8b9310a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.081350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb80d5af-7959-49b3-a8b7-996fe8b9310a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.081936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb80d5af-7959-49b3-a8b7-996fe8b9310a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.237395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd488a79-d4b5-46ce-932c-9d5a5bf2b67e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:55.239137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd488a79-d4b5-46ce-932c-9d5a5bf2b67e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:55.246383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd488a79-d4b5-46ce-932c-9d5a5bf2b67e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.246881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd488a79-d4b5-46ce-932c-9d5a5bf2b67e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.247322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd488a79-d4b5-46ce-932c-9d5a5bf2b67e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.248089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd488a79-d4b5-46ce-932c-9d5a5bf2b67e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.248769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd488a79-d4b5-46ce-932c-9d5a5bf2b67e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.249204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd488a79-d4b5-46ce-932c-9d5a5bf2b67e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.293528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eb80d5af-7959-49b3-a8b7-996fe8b9310a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:55.312879 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eb80d5af-7959-49b3-a8b7-996fe8b9310a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.245844 Sep 10 20:50:55.314552 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 340/736] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:55 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:55.320946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:55.321716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:55.330427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.330938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.331381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.333380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.333896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.334345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.412283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:55.417531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd488a79-d4b5-46ce-932c-9d5a5bf2b67e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:55.420904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:55.422409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:55.428195 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd488a79-d4b5-46ce-932c-9d5a5bf2b67e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1469 microversion: 2.1 time: 0.195433 Sep 10 20:50:55.429351 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cb3c5471-74f4-4439-a7f8-714872ba893d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.113026 Sep 10 20:50:55.430308 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 341/737] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:55 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:55.435817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93127c04-b550-4dd9-a6c7-0263587ce86d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:55.436614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-93127c04-b550-4dd9-a6c7-0263587ce86d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:55.442697 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 397/738] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:55 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:55.446641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93127c04-b550-4dd9-a6c7-0263587ce86d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.447133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93127c04-b550-4dd9-a6c7-0263587ce86d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.447574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93127c04-b550-4dd9-a6c7-0263587ce86d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.448278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93127c04-b550-4dd9-a6c7-0263587ce86d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.448737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93127c04-b550-4dd9-a6c7-0263587ce86d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.449169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93127c04-b550-4dd9-a6c7-0263587ce86d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.450618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:55.451900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:55.460186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.460749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.461296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.462279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.462736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.463331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.541721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:55.551651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:55.553642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:55.554769 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-48796645-501f-44b1-9eae-d042404d284f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1281 microversion: 2.25 time: 0.110827 Sep 10 20:50:55.555329 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 398/739] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:55 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:55.560589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-cce7bc21-dad1-4de2-b1f6-8cd94ef8315d req-f9c34bd1-7596-4046-aff4-f22cfaa638f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7", "tag": "871c6aba-a220-472d-bb9a-015670319816"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:50:55.571377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cce7bc21-dad1-4de2-b1f6-8cd94ef8315d req-f9c34bd1-7596-4046-aff4-f22cfaa638f5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:55.572150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93127c04-b550-4dd9-a6c7-0263587ce86d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:55.572578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cce7bc21-dad1-4de2-b1f6-8cd94ef8315d req-f9c34bd1-7596-4046-aff4-f22cfaa638f5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:55.573210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cce7bc21-dad1-4de2-b1f6-8cd94ef8315d req-f9c34bd1-7596-4046-aff4-f22cfaa638f5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:55.585129 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93127c04-b550-4dd9-a6c7-0263587ce86d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1272 microversion: 2.1 time: 0.153601 Sep 10 20:50:55.585720 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 342/740] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:55 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:55.586984 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cce7bc21-dad1-4de2-b1f6-8cd94ef8315d req-f9c34bd1-7596-4046-aff4-f22cfaa638f5 service nova] Creating event network-changed:871c6aba-a220-472d-bb9a-015670319816 for instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 on nch1-master-1 Sep 10 20:50:55.592831 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-cce7bc21-dad1-4de2-b1f6-8cd94ef8315d req-f9c34bd1-7596-4046-aff4-f22cfaa638f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035257 Sep 10 20:50:55.593613 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 399/741] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:50:56.001357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:56.002040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:56.009330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.009855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.010321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.011201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.011722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.012167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.060681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.061555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.062360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.063071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lazy-loading 'fault' on Instance uuid 09a279e1-69d2-4cc5-89f2-6868705bad3a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:50:56.074442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-97f3e11a-839b-49f3-a3a6-490e2a0a144f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:56.075576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-97f3e11a-839b-49f3-a3a6-490e2a0a144f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:56.084275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97f3e11a-839b-49f3-a3a6-490e2a0a144f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.085183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97f3e11a-839b-49f3-a3a6-490e2a0a144f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.085948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97f3e11a-839b-49f3-a3a6-490e2a0a144f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.086911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97f3e11a-839b-49f3-a3a6-490e2a0a144f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.087387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97f3e11a-839b-49f3-a3a6-490e2a0a144f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.087833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97f3e11a-839b-49f3-a3a6-490e2a0a144f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.144605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.153226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.154799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9232c6fb834f4f68a260f5e10212f891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda0d7766e3e4ddfa7471f9c9196745a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.160186 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3373f955-0a22-49fb-aae0-c24402dd1554 tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 200 len: 1448 microversion: 2.75 time: 0.166504 Sep 10 20:50:56.161164 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 343/742] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:55 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:56.250148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-97f3e11a-839b-49f3-a3a6-490e2a0a144f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.258557 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-97f3e11a-839b-49f3-a3a6-490e2a0a144f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1313 microversion: 2.1 time: 0.188562 Sep 10 20:50:56.259218 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 400/743] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:56 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:56.337089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5edc976-be21-42a7-aa1a-d7f8d8249245 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:56.337710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5edc976-be21-42a7-aa1a-d7f8d8249245 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:56.344413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5edc976-be21-42a7-aa1a-d7f8d8249245 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.344911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5edc976-be21-42a7-aa1a-d7f8d8249245 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.345359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5edc976-be21-42a7-aa1a-d7f8d8249245 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.346369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5edc976-be21-42a7-aa1a-d7f8d8249245 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.346827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5edc976-be21-42a7-aa1a-d7f8d8249245 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.347317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5edc976-be21-42a7-aa1a-d7f8d8249245 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.461247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-866f9a0c-da6d-4be1-b708-ef503a88f0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:56.462855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-866f9a0c-da6d-4be1-b708-ef503a88f0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:56.469211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866f9a0c-da6d-4be1-b708-ef503a88f0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.469708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866f9a0c-da6d-4be1-b708-ef503a88f0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.470181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866f9a0c-da6d-4be1-b708-ef503a88f0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.471164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866f9a0c-da6d-4be1-b708-ef503a88f0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.471624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866f9a0c-da6d-4be1-b708-ef503a88f0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.472052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866f9a0c-da6d-4be1-b708-ef503a88f0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.489143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a5edc976-be21-42a7-aa1a-d7f8d8249245 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.497659 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5edc976-be21-42a7-aa1a-d7f8d8249245 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.164615 Sep 10 20:50:56.498265 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 344/744] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:56 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:50:56.503705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:56.505139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:56.511256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.511911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.512349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.513048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.513504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.514033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.589470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.598736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.600358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.608442 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-31ce601c-cbef-41e1-b8f3-5ad8c4e49ccd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.108847 Sep 10 20:50:56.609228 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 345/745] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:56 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:56.615723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:56.616840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:56.624980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-866f9a0c-da6d-4be1-b708-ef503a88f0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.626966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.627860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.628535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.629786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.630456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.630888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.634180 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-866f9a0c-da6d-4be1-b708-ef503a88f0a3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1469 microversion: 2.1 time: 0.177737 Sep 10 20:50:56.635492 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 401/746] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:56 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:50:56.641207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8c65d7e-cd4a-4d7d-900a-7c37e168c4a8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:56.641900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8c65d7e-cd4a-4d7d-900a-7c37e168c4a8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:56.649280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c65d7e-cd4a-4d7d-900a-7c37e168c4a8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.649775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c65d7e-cd4a-4d7d-900a-7c37e168c4a8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.650384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c65d7e-cd4a-4d7d-900a-7c37e168c4a8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.651125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c65d7e-cd4a-4d7d-900a-7c37e168c4a8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:56.651586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c65d7e-cd4a-4d7d-900a-7c37e168c4a8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:56.652013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c65d7e-cd4a-4d7d-900a-7c37e168c4a8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:56.704701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.714587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8c65d7e-cd4a-4d7d-900a-7c37e168c4a8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.715920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.717875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:56.719055 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1ffc101b-216c-4680-a077-e81ef866d319 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1281 microversion: 2.25 time: 0.108582 Sep 10 20:50:56.719623 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 346/747] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:56 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1281 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:56.723003 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8c65d7e-cd4a-4d7d-900a-7c37e168c4a8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1282 microversion: 2.1 time: 0.086203 Sep 10 20:50:56.723749 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 402/748] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:56 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:57.192429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:57.193458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] [instance: 09a279e1-69d2-4cc5-89f2-6868705bad3a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:57.203606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.204386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.208435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.209332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.209973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.211762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.227682 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] HTTP exception thrown: Instance 09a279e1-69d2-4cc5-89f2-6868705bad3a could not be found. Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Request method failure captured: Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a HTTP/1.1 Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhRcegYJjt2APReVVJjWt6x3DFnCvLn-2AIZRAcP-M7YvRFSRJ5OA0mCcoTR9gq02DKQx36w3wPGcNEUXOI71-ZQh1aS6cw1YIAqTpZ18t-Djdz8_MIBy0KTyY1CFjb7nRvAPnoRhPSXDxHVgyUrG4aALPVBYiCUUjVUqHiNtHH_xg Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.75 Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cda0d7766e3e4ddfa7471f9c9196745a Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdmin275Test-968357817 Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:50:57.229464 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cda0d7766e3e4ddfa7471f9c9196745a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cda0d7766e3e4ddfa7471f9c9196745a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cda0d7766e3e4ddfa7471f9c9196745a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cda0d7766e3e4ddfa7471f9c9196745a"}]}] Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdmin275Test-968357817 Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cda0d7766e3e4ddfa7471f9c9196745a Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdmin275Test-968357817 Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdmin275Test-968357817-project Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9232c6fb834f4f68a260f5e10212f891 Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdmin275Test-968357817-project Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 09a279e1-69d2-4cc5-89f2-6868705bad3a could not be found. Sep 10 20:50:57.231207 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '09a279e1-69d2-4cc5-89f2-6868705bad3a'} Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a279e1-69d2-4cc5-89f2-6868705bad3a could not be found. Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:50:57.232143 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a279e1-69d2-4cc5-89f2-6868705bad3a could not be found. Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a279e1-69d2-4cc5-89f2-6868705bad3a could not be found. Sep 10 20:50:57.233607 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:50:57.236399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] Returning 404 to user: Instance 09a279e1-69d2-4cc5-89f2-6868705bad3a could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:50:57.236399 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e3ce11cf-c7a0-418b-ac18-738cb07af55f tempest-ServersAdmin275Test-968357817 tempest-ServersAdmin275Test-968357817-project] 10.222.0.33 "GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a" status: 404 len: 111 microversion: 2.75 time: 0.044236 Sep 10 20:50:57.236399 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 347/749] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:57 2022] GET /compute/v2.1/servers/09a279e1-69d2-4cc5-89f2-6868705bad3a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:50:57.282126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fde69162-cf17-4254-8afe-6d9e07f68cfd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:57.283553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fde69162-cf17-4254-8afe-6d9e07f68cfd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:57.291699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fde69162-cf17-4254-8afe-6d9e07f68cfd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.295627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fde69162-cf17-4254-8afe-6d9e07f68cfd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.296979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fde69162-cf17-4254-8afe-6d9e07f68cfd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.298866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fde69162-cf17-4254-8afe-6d9e07f68cfd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.300075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fde69162-cf17-4254-8afe-6d9e07f68cfd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.301671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fde69162-cf17-4254-8afe-6d9e07f68cfd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.528517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-54ea4320-8a57-4865-aa34-a235cabeb7f9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:57.529543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-54ea4320-8a57-4865-aa34-a235cabeb7f9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:57.536624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54ea4320-8a57-4865-aa34-a235cabeb7f9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.537357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54ea4320-8a57-4865-aa34-a235cabeb7f9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.537909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54ea4320-8a57-4865-aa34-a235cabeb7f9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.538859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54ea4320-8a57-4865-aa34-a235cabeb7f9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.539680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54ea4320-8a57-4865-aa34-a235cabeb7f9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.540319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54ea4320-8a57-4865-aa34-a235cabeb7f9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.558200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:57.644307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fde69162-cf17-4254-8afe-6d9e07f68cfd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:57.653173 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fde69162-cf17-4254-8afe-6d9e07f68cfd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1313 microversion: 2.1 time: 0.375605 Sep 10 20:50:57.654531 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 403/750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:57 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:57.660236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:57.661048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:57.667557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.668278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.668883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.669765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.670403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.670992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.724494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-54ea4320-8a57-4865-aa34-a235cabeb7f9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:57.735032 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-54ea4320-8a57-4865-aa34-a235cabeb7f9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.211581 Sep 10 20:50:57.736110 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 348/751] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:57 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:57.743789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7efcf40b-a05d-4f98-89f7-3253c4fa8ebf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:57.744760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7efcf40b-a05d-4f98-89f7-3253c4fa8ebf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:57.752599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7efcf40b-a05d-4f98-89f7-3253c4fa8ebf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.753642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7efcf40b-a05d-4f98-89f7-3253c4fa8ebf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.755033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7efcf40b-a05d-4f98-89f7-3253c4fa8ebf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.756120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7efcf40b-a05d-4f98-89f7-3253c4fa8ebf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.757068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7efcf40b-a05d-4f98-89f7-3253c4fa8ebf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.757693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7efcf40b-a05d-4f98-89f7-3253c4fa8ebf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.795931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:57.806586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:57.808519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:57.814026 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b54cabbd-3dad-4c1b-af13-b6bc10868076 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.158318 Sep 10 20:50:57.814883 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 404/752] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:57 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:57.830482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:57.832226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:57.842374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.843169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.844127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.845949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:57.846637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:57.847306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:57.947452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7efcf40b-a05d-4f98-89f7-3253c4fa8ebf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:57.954793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:57.957141 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7efcf40b-a05d-4f98-89f7-3253c4fa8ebf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1475 microversion: 2.1 time: 0.217034 Sep 10 20:50:57.958269 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 349/753] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:57 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1475 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:57.981455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-57e4c130-9c3f-49f5-8f0a-40c6c152e575 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:57.982214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-57e4c130-9c3f-49f5-8f0a-40c6c152e575 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:57.984305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:57.986408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:57.987556 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5c0316b9-dbf4-4a81-8e79-dd843497c6ff tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1281 microversion: 2.25 time: 0.171211 Sep 10 20:50:58.001850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 405/754] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:57 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1281 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:58.002198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4c130-9c3f-49f5-8f0a-40c6c152e575 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:58.002198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4c130-9c3f-49f5-8f0a-40c6c152e575 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:58.002198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4c130-9c3f-49f5-8f0a-40c6c152e575 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:58.002198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4c130-9c3f-49f5-8f0a-40c6c152e575 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:58.002559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4c130-9c3f-49f5-8f0a-40c6c152e575 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:58.002559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4c130-9c3f-49f5-8f0a-40c6c152e575 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:58.091818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-57e4c130-9c3f-49f5-8f0a-40c6c152e575 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:58.101238 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-57e4c130-9c3f-49f5-8f0a-40c6c152e575 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1270 microversion: 2.1 time: 0.128771 Sep 10 20:50:58.102020 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 350/755] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:57 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:58.682137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91048e84-e700-4315-9bf7-73e4ba2168e4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:58.682817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-91048e84-e700-4315-9bf7-73e4ba2168e4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:58.686685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=14 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:58.695084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91048e84-e700-4315-9bf7-73e4ba2168e4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:58.695676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91048e84-e700-4315-9bf7-73e4ba2168e4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:58.696187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91048e84-e700-4315-9bf7-73e4ba2168e4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:58.697347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91048e84-e700-4315-9bf7-73e4ba2168e4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:58.698097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91048e84-e700-4315-9bf7-73e4ba2168e4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:58.699248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91048e84-e700-4315-9bf7-73e4ba2168e4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:58.773233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42f742b0-63d7-48ed-b45f-e7a269b8fe28 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:58.774710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-42f742b0-63d7-48ed-b45f-e7a269b8fe28 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:58.787596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42f742b0-63d7-48ed-b45f-e7a269b8fe28 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:58.789051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42f742b0-63d7-48ed-b45f-e7a269b8fe28 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:58.791001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42f742b0-63d7-48ed-b45f-e7a269b8fe28 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:58.793621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42f742b0-63d7-48ed-b45f-e7a269b8fe28 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:58.794370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42f742b0-63d7-48ed-b45f-e7a269b8fe28 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:58.794963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42f742b0-63d7-48ed-b45f-e7a269b8fe28 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:58.944945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-91048e84-e700-4315-9bf7-73e4ba2168e4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:58.956414 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91048e84-e700-4315-9bf7-73e4ba2168e4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1313 microversion: 2.1 time: 0.278642 Sep 10 20:50:58.958605 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 406/756] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:58 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:58.963825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:58.964720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:58.972123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:58.973381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:58.974075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:58.975227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:58.976024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:58.976721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:59.068837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:59.077585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:59.079172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:59.085970 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-deeb72b4-c8db-4b21-bdf5-f280477a8ad7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.126011 Sep 10 20:50:59.087046 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 407/757] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:58 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:59.091832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-37bebf8f-5dbe-4ffe-8d27-0d44116be4cc tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:59.092512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-37bebf8f-5dbe-4ffe-8d27-0d44116be4cc tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:59.099490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37bebf8f-5dbe-4ffe-8d27-0d44116be4cc tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:59.100052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37bebf8f-5dbe-4ffe-8d27-0d44116be4cc tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:59.100686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37bebf8f-5dbe-4ffe-8d27-0d44116be4cc tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:59.101483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37bebf8f-5dbe-4ffe-8d27-0d44116be4cc tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:59.102054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37bebf8f-5dbe-4ffe-8d27-0d44116be4cc tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:59.102653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37bebf8f-5dbe-4ffe-8d27-0d44116be4cc tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:59.146695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-42f742b0-63d7-48ed-b45f-e7a269b8fe28 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:59.154706 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-42f742b0-63d7-48ed-b45f-e7a269b8fe28 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.387372 Sep 10 20:50:59.155286 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 351/758] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:58 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:59.159919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:59.161099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:59.167258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:59.167955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:59.168557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:59.169409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:59.170061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:59.170647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:59.260799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:59.272203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:59.274928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:59.277115 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b9c1e94c-a14c-43fc-9bde-53ba95dc8500 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1281 microversion: 2.25 time: 0.120729 Sep 10 20:50:59.277683 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 352/759] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:50:59 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1281 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:50:59.284234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c7bb42c8-6480-4244-a41c-7d71ea980aa2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:59.285844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c7bb42c8-6480-4244-a41c-7d71ea980aa2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:59.302307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7bb42c8-6480-4244-a41c-7d71ea980aa2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:59.303316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7bb42c8-6480-4244-a41c-7d71ea980aa2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:59.303841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7bb42c8-6480-4244-a41c-7d71ea980aa2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:59.304720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7bb42c8-6480-4244-a41c-7d71ea980aa2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:59.305329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7bb42c8-6480-4244-a41c-7d71ea980aa2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:59.305988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7bb42c8-6480-4244-a41c-7d71ea980aa2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:59.327660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-37bebf8f-5dbe-4ffe-8d27-0d44116be4cc tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:59.339673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:50:59.344223 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-37bebf8f-5dbe-4ffe-8d27-0d44116be4cc tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1475 microversion: 2.1 time: 0.253028 Sep 10 20:50:59.345363 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 408/760] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:59 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1475 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:59.509078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c7bb42c8-6480-4244-a41c-7d71ea980aa2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:50:59.526562 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c7bb42c8-6480-4244-a41c-7d71ea980aa2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1312 microversion: 2.1 time: 0.246786 Sep 10 20:50:59.527888 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 353/761] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:59 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:50:59.984737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dbcfee99-0958-44bf-aae5-1a551d0baec1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:50:59.985366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dbcfee99-0958-44bf-aae5-1a551d0baec1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:50:59.995586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbcfee99-0958-44bf-aae5-1a551d0baec1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:50:59.996083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbcfee99-0958-44bf-aae5-1a551d0baec1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:50:59.996518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbcfee99-0958-44bf-aae5-1a551d0baec1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:50:59.997260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbcfee99-0958-44bf-aae5-1a551d0baec1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.000413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbcfee99-0958-44bf-aae5-1a551d0baec1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.002762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbcfee99-0958-44bf-aae5-1a551d0baec1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.115797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:00.116652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:00.135176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.135897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.136416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.137585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.137898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.138406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.218158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:00.233074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:00.234984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:00.246237 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3dc56790-a3d1-43d1-8ca5-48c0f15d76cb tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.132105 Sep 10 20:51:00.258514 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 354/762] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:00 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:51:00.275840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1824c665-6c38-47a5-848e-5ab5914f10e0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:00.278066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1824c665-6c38-47a5-848e-5ab5914f10e0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:00.290531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1824c665-6c38-47a5-848e-5ab5914f10e0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.291422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1824c665-6c38-47a5-848e-5ab5914f10e0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.291978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1824c665-6c38-47a5-848e-5ab5914f10e0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.293614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1824c665-6c38-47a5-848e-5ab5914f10e0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.294391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1824c665-6c38-47a5-848e-5ab5914f10e0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.300689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dbcfee99-0958-44bf-aae5-1a551d0baec1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:00.304126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1824c665-6c38-47a5-848e-5ab5914f10e0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.359162 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dbcfee99-0958-44bf-aae5-1a551d0baec1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1313 microversion: 2.1 time: 0.377945 Sep 10 20:51:00.360861 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 409/763] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:50:59 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:00.380346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:00.387556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:00.409154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.409683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.414640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.415426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.419181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.420492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.570154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1824c665-6c38-47a5-848e-5ab5914f10e0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:00.579465 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1824c665-6c38-47a5-848e-5ab5914f10e0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1504 microversion: 2.1 time: 0.319774 Sep 10 20:51:00.591319 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 355/764] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:00 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:00.597805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-735850a1-96fa-45c7-ab65-a2d8cdc6b78b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:00.615466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-735850a1-96fa-45c7-ab65-a2d8cdc6b78b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:00.623217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:00.629044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-735850a1-96fa-45c7-ab65-a2d8cdc6b78b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.634346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-735850a1-96fa-45c7-ab65-a2d8cdc6b78b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.635307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-735850a1-96fa-45c7-ab65-a2d8cdc6b78b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.640034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-735850a1-96fa-45c7-ab65-a2d8cdc6b78b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.640612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-735850a1-96fa-45c7-ab65-a2d8cdc6b78b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.642581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-735850a1-96fa-45c7-ab65-a2d8cdc6b78b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.648437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:00.652582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:00.656524 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3ba50a2d-fb03-4798-b729-105fa0d475d3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1345 microversion: 2.25 time: 0.287660 Sep 10 20:51:00.658552 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 410/765] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:00 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1345 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:00.674735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1a23cc7e-3b56-47e3-9411-0c06fc3383b8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:00.678184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1a23cc7e-3b56-47e3-9411-0c06fc3383b8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:00.698174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a23cc7e-3b56-47e3-9411-0c06fc3383b8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.699073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a23cc7e-3b56-47e3-9411-0c06fc3383b8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.699795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a23cc7e-3b56-47e3-9411-0c06fc3383b8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.701517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a23cc7e-3b56-47e3-9411-0c06fc3383b8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:00.702386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a23cc7e-3b56-47e3-9411-0c06fc3383b8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:00.703530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a23cc7e-3b56-47e3-9411-0c06fc3383b8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:00.939119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-735850a1-96fa-45c7-ab65-a2d8cdc6b78b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:00.951151 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-735850a1-96fa-45c7-ab65-a2d8cdc6b78b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1475 microversion: 2.1 time: 0.358295 Sep 10 20:51:00.966674 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 356/766] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:00 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1475 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:01.222680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1a23cc7e-3b56-47e3-9411-0c06fc3383b8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:01.235709 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1a23cc7e-3b56-47e3-9411-0c06fc3383b8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.573105 Sep 10 20:51:01.236297 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 411/767] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:00 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:01.280676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:01.282874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:01.294574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:01.295654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:01.296393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:01.297199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:01.297929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:01.298594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:01.388720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-007b72dd-4335-4a35-b04f-51b2d32383f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:01.389334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-007b72dd-4335-4a35-b04f-51b2d32383f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:01.400964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-007b72dd-4335-4a35-b04f-51b2d32383f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:01.401709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-007b72dd-4335-4a35-b04f-51b2d32383f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:01.402316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-007b72dd-4335-4a35-b04f-51b2d32383f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:01.403216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-007b72dd-4335-4a35-b04f-51b2d32383f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:01.403822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-007b72dd-4335-4a35-b04f-51b2d32383f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:01.405841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-007b72dd-4335-4a35-b04f-51b2d32383f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:01.418082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:01.436545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:01.442406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:01.453698 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-87467f6e-dd8b-4a15-a7f4-dfe1ddfe3234 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1533 microversion: 2.91 time: 0.177860 Sep 10 20:51:01.473859 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 357/768] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:01 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1533 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:01.488713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5067b71c-29b1-4aef-91e4-a8f2b09a1bdc tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:01.489528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5067b71c-29b1-4aef-91e4-a8f2b09a1bdc tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:01.502807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5067b71c-29b1-4aef-91e4-a8f2b09a1bdc tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:01.503419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5067b71c-29b1-4aef-91e4-a8f2b09a1bdc tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:01.504691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5067b71c-29b1-4aef-91e4-a8f2b09a1bdc tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:01.506705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5067b71c-29b1-4aef-91e4-a8f2b09a1bdc tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:01.507349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5067b71c-29b1-4aef-91e4-a8f2b09a1bdc tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:01.507974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5067b71c-29b1-4aef-91e4-a8f2b09a1bdc tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:01.618799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-5067b71c-29b1-4aef-91e4-a8f2b09a1bdc tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lazy-loading 'services' on Instance uuid 72673474-4355-4d59-a448-2bf591428ba0 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:51:01.643358 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5067b71c-29b1-4aef-91e4-a8f2b09a1bdc tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1938 microversion: 2.91 time: 0.160285 Sep 10 20:51:01.643956 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 358/769] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:01 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1938 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:51:01.667107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bcd4d49e-6c8d-48d4-8777-4a1d8be5139a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:01.668045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bcd4d49e-6c8d-48d4-8777-4a1d8be5139a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:01.685565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd4d49e-6c8d-48d4-8777-4a1d8be5139a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:01.689082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd4d49e-6c8d-48d4-8777-4a1d8be5139a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:01.689716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd4d49e-6c8d-48d4-8777-4a1d8be5139a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:01.693737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd4d49e-6c8d-48d4-8777-4a1d8be5139a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:01.695570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd4d49e-6c8d-48d4-8777-4a1d8be5139a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:01.696045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd4d49e-6c8d-48d4-8777-4a1d8be5139a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:01.848360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-007b72dd-4335-4a35-b04f-51b2d32383f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:01.864909 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-007b72dd-4335-4a35-b04f-51b2d32383f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1313 microversion: 2.1 time: 0.480614 Sep 10 20:51:01.868550 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 412/770] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:01 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:01.876575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-84fe7799-72e6-4ffa-bbd0-fc1da0d842f9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:01.877659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-84fe7799-72e6-4ffa-bbd0-fc1da0d842f9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:01.885709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84fe7799-72e6-4ffa-bbd0-fc1da0d842f9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:01.886481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84fe7799-72e6-4ffa-bbd0-fc1da0d842f9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:01.887125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84fe7799-72e6-4ffa-bbd0-fc1da0d842f9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:01.888342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84fe7799-72e6-4ffa-bbd0-fc1da0d842f9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:01.889124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84fe7799-72e6-4ffa-bbd0-fc1da0d842f9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:01.889706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84fe7799-72e6-4ffa-bbd0-fc1da0d842f9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:01.942112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:01.955569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-84fe7799-72e6-4ffa-bbd0-fc1da0d842f9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lazy-loading 'flavor' on Instance uuid 72673474-4355-4d59-a448-2bf591428ba0 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:51:01.992184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bcd4d49e-6c8d-48d4-8777-4a1d8be5139a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:02.003237 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bcd4d49e-6c8d-48d4-8777-4a1d8be5139a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1494 microversion: 2.1 time: 0.355861 Sep 10 20:51:02.004188 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 359/771] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:01 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1494 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:02.034190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:02.034812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:02.042957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.043522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.044252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.045056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.045626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.046094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.132687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:02.142339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:02.143879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:02.146310 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-84fe38e5-b1e4-4384-8810-62ecacc38b19 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1343 microversion: 2.25 time: 0.123721 Sep 10 20:51:02.158155 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 360/772] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:02 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1343 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:02.158155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a279d1a3-4084-4f49-9b24-297dde295739 req-fc9b1389-1ea6-46df-ba4b-cef6f1bfbff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dd2771-3e57-4798-ab1e-c16e724ad6f4", "name": "network-vif-unplugged", "status": "completed", "tag": "5bf39bf7-b621-4388-8dd2-5fd139920258"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:02.166058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a279d1a3-4084-4f49-9b24-297dde295739 req-fc9b1389-1ea6-46df-ba4b-cef6f1bfbff9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.166058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a279d1a3-4084-4f49-9b24-297dde295739 req-fc9b1389-1ea6-46df-ba4b-cef6f1bfbff9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.166058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a279d1a3-4084-4f49-9b24-297dde295739 req-fc9b1389-1ea6-46df-ba4b-cef6f1bfbff9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.175477 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a279d1a3-4084-4f49-9b24-297dde295739 req-fc9b1389-1ea6-46df-ba4b-cef6f1bfbff9 service nova] Creating event network-vif-unplugged:5bf39bf7-b621-4388-8dd2-5fd139920258 for instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 on nch2-master-1 Sep 10 20:51:02.181442 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a279d1a3-4084-4f49-9b24-297dde295739 req-fc9b1389-1ea6-46df-ba4b-cef6f1bfbff9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033286 Sep 10 20:51:02.182126 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 361/773] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:02.187116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1522e60-bac9-4bf9-8b1d-d138e7ee90c7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:02.187806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e1522e60-bac9-4bf9-8b1d-d138e7ee90c7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:02.195511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1522e60-bac9-4bf9-8b1d-d138e7ee90c7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.196022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1522e60-bac9-4bf9-8b1d-d138e7ee90c7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.196454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1522e60-bac9-4bf9-8b1d-d138e7ee90c7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.197268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1522e60-bac9-4bf9-8b1d-d138e7ee90c7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.198434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1522e60-bac9-4bf9-8b1d-d138e7ee90c7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.198861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1522e60-bac9-4bf9-8b1d-d138e7ee90c7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.289627 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-84fe7799-72e6-4ffa-bbd0-fc1da0d842f9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "POST /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0/action" status: 202 len: 0 microversion: 2.91 time: 0.418812 Sep 10 20:51:02.290445 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 413/774] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:51:01 2022] POST /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:51:02.298218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b4c6092d-b3b9-4413-a3f9-201cb51344bb tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '.version_select at 0x7f99454d3b80>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:02.304259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4c6092d-b3b9-4413-a3f9-201cb51344bb tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.305205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4c6092d-b3b9-4413-a3f9-201cb51344bb tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.306070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4c6092d-b3b9-4413-a3f9-201cb51344bb tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.364387 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b4c6092d-b3b9-4413-a3f9-201cb51344bb tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.071081 Sep 10 20:51:02.375883 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 414/775] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:51:02 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:02.420729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1522e60-bac9-4bf9-8b1d-d138e7ee90c7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:02.433948 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1522e60-bac9-4bf9-8b1d-d138e7ee90c7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1475 microversion: 2.1 time: 0.250607 Sep 10 20:51:02.437508 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 362/776] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:02 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1475 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:02.447478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-626e928a-1d81-4cfb-84f6-8b1ab3b1af44 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:02.453427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-626e928a-1d81-4cfb-84f6-8b1ab3b1af44 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:02.468873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626e928a-1d81-4cfb-84f6-8b1ab3b1af44 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.469380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626e928a-1d81-4cfb-84f6-8b1ab3b1af44 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.469818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626e928a-1d81-4cfb-84f6-8b1ab3b1af44 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.470556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626e928a-1d81-4cfb-84f6-8b1ab3b1af44 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.471273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626e928a-1d81-4cfb-84f6-8b1ab3b1af44 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.471696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626e928a-1d81-4cfb-84f6-8b1ab3b1af44 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.569817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-302388362", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:02.654180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:51:02.705137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-626e928a-1d81-4cfb-84f6-8b1ab3b1af44 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:02.718295 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-626e928a-1d81-4cfb-84f6-8b1ab3b1af44 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.277278 Sep 10 20:51:02.719086 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 363/777] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:02 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:02.724965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:02.725960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:02.732117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.732758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.733334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.734217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.734929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.735575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.810770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:02.820194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:02.821680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:02.828067 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9d54e5d1-e416-4888-80bd-79d589c1dd79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.107717 Sep 10 20:51:02.828788 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 364/778] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:02 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:02.834148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-624d4219-6af3-4ed3-a64c-416d52abaf7f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:02.834974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-624d4219-6af3-4ed3-a64c-416d52abaf7f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:02.855923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-624d4219-6af3-4ed3-a64c-416d52abaf7f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.856665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-624d4219-6af3-4ed3-a64c-416d52abaf7f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.857302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-624d4219-6af3-4ed3-a64c-416d52abaf7f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:02.858599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-624d4219-6af3-4ed3-a64c-416d52abaf7f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:02.859245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-624d4219-6af3-4ed3-a64c-416d52abaf7f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:02.859839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-624d4219-6af3-4ed3-a64c-416d52abaf7f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:03.025247 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-624d4219-6af3-4ed3-a64c-416d52abaf7f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1645 microversion: 2.1 time: 0.195094 Sep 10 20:51:03.026490 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 365/779] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:02 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1645 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:03.031773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e6e13a24-05e8-4f6f-a30e-e151fd74c415 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:03.032692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e6e13a24-05e8-4f6f-a30e-e151fd74c415 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:03.040743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6e13a24-05e8-4f6f-a30e-e151fd74c415 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:03.041252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6e13a24-05e8-4f6f-a30e-e151fd74c415 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:03.041750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6e13a24-05e8-4f6f-a30e-e151fd74c415 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:03.043012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6e13a24-05e8-4f6f-a30e-e151fd74c415 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:03.043012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6e13a24-05e8-4f6f-a30e-e151fd74c415 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:03.043626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6e13a24-05e8-4f6f-a30e-e151fd74c415 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:03.171081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:51:03.171502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:51:03.172235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:51:03.172650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:51:03.173065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:51:03.183288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:03.183876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:03.184319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:03.185044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:03.185493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:03.185939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:03.208528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Getting quotas for project 4f60e45cf4604d9497f253f7bb1e3e71. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:51:03.209964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e6e13a24-05e8-4f6f-a30e-e151fd74c415 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:03.213856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Getting quotas for user ef5c9474c1864436aa4a35057087ea26 and project 4f60e45cf4604d9497f253f7bb1e3e71. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:51:03.220429 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e6e13a24-05e8-4f6f-a30e-e151fd74c415 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1313 microversion: 2.1 time: 0.192461 Sep 10 20:51:03.221900 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 366/780] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:03 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:03.227167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:03.227780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:03.231626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:03.235695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:03.236038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:03.236161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:51:03.236514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:03.237530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:03.238156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:03.238689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:03.239528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:51:03.289961 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f9f2b8cf-ae45-4b8a-aa01-996076a65389 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912789 Sep 10 20:51:03.297809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 415/781] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:51:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:51:03.302285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1242985029", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f3aabbf6-b101-4d74-914c-9c1510387333"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:03.388579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] validate_networks() for [('f3aabbf6-b101-4d74-914c-9c1510387333', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:51:03.432322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:03.442580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:03.444562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:03.445784 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c3f0af27-11cc-4467-8d90-4cd8826364e6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1410 microversion: 2.25 time: 0.223474 Sep 10 20:51:03.446468 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 367/782] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:03 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1410 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:03.468839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da2277cf-3747-417d-8d9d-697a350c2269 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:03.469692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-da2277cf-3747-417d-8d9d-697a350c2269 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:03.539968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-da2277cf-3747-417d-8d9d-697a350c2269 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:03.546554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=27 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:03.548688 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da2277cf-3747-417d-8d9d-697a350c2269 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1213 microversion: 2.1 time: 0.085565 Sep 10 20:51:03.549483 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 368/783] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:03 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:03.555556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c5233d77-89e6-494d-b850-3fbf3796d4ee req-da878707-de0a-440e-8218-0b4574f0be1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5578bf-977b-4757-be61-2c01715e6bc1", "tag": "37119462-c12f-44dd-836b-816fdfd2bce0"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:03.568616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c5233d77-89e6-494d-b850-3fbf3796d4ee req-da878707-de0a-440e-8218-0b4574f0be1a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:03.569208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c5233d77-89e6-494d-b850-3fbf3796d4ee req-da878707-de0a-440e-8218-0b4574f0be1a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:03.569701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c5233d77-89e6-494d-b850-3fbf3796d4ee req-da878707-de0a-440e-8218-0b4574f0be1a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:03.582729 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c5233d77-89e6-494d-b850-3fbf3796d4ee req-da878707-de0a-440e-8218-0b4574f0be1a service nova] Creating event network-changed:37119462-c12f-44dd-836b-816fdfd2bce0 for instance 7e5578bf-977b-4757-be61-2c01715e6bc1 on nch2-master-1 Sep 10 20:51:03.588722 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c5233d77-89e6-494d-b850-3fbf3796d4ee req-da878707-de0a-440e-8218-0b4574f0be1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037278 Sep 10 20:51:03.590065 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 369/784] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:03.598373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-22efae8a-4af2-470b-b16b-c1cbe90ccf6d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:03.599692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-22efae8a-4af2-470b-b16b-c1cbe90ccf6d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:03.607809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22efae8a-4af2-470b-b16b-c1cbe90ccf6d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:03.608846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22efae8a-4af2-470b-b16b-c1cbe90ccf6d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:03.609771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22efae8a-4af2-470b-b16b-c1cbe90ccf6d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:03.610984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22efae8a-4af2-470b-b16b-c1cbe90ccf6d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:03.612107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22efae8a-4af2-470b-b16b-c1cbe90ccf6d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:03.612839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22efae8a-4af2-470b-b16b-c1cbe90ccf6d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:04.047177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=18 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:04.395960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-22efae8a-4af2-470b-b16b-c1cbe90ccf6d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:04.408617 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-22efae8a-4af2-470b-b16b-c1cbe90ccf6d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1475 microversion: 2.1 time: 0.816832 Sep 10 20:51:04.409996 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 370/785] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:03 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1475 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:04.450573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5cdf8911-0858-4025-88c6-d1d929733b4a tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:04.451591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5cdf8911-0858-4025-88c6-d1d929733b4a tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:04.462093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cdf8911-0858-4025-88c6-d1d929733b4a tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:04.462964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cdf8911-0858-4025-88c6-d1d929733b4a tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:04.463521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cdf8911-0858-4025-88c6-d1d929733b4a tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:04.464332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cdf8911-0858-4025-88c6-d1d929733b4a tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:04.464793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cdf8911-0858-4025-88c6-d1d929733b4a tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:04.465411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cdf8911-0858-4025-88c6-d1d929733b4a tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:04.489813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:51:04.490323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:51:04.490748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:51:04.491567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:51:04.492429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:51:04.512151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:04.512689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:04.513144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:04.513922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:04.514389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:04.514818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:04.535034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Getting quotas for project 5bd065954b0e4520a3c1deba0916db85. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:51:04.539986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Getting quotas for user f74a2c8cd22c454fa8fdd7c2e1ef9230 and project 5bd065954b0e4520a3c1deba0916db85. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:51:04.544682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:04.563773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:51:04.567774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:51:04.620754 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-917fe899-a48a-4436-9d45-83105e35d089 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323738 Sep 10 20:51:04.628394 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 416/786] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:51:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:51:04.633552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:04.634260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:04.648092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:04.648973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:04.649355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:04.650138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:04.650618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:04.651080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:04.763707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:04.775359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:04.777220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:04.783135 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8fc84098-880d-475e-b4de-15e1291889a0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.160270 Sep 10 20:51:04.799347 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 417/787] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:04 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:04.814842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-31d1f976-f5d1-4e7b-b980-091f9dd8d7b0 req-7b9f2ee0-c7c2-4931-86d5-424eeda16ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7", "name": "network-vif-plugged", "status": "completed", "tag": "871c6aba-a220-472d-bb9a-015670319816"}, {"server_uuid": "d3dd2771-3e57-4798-ab1e-c16e724ad6f4", "name": "network-vif-plugged", "status": "completed", "tag": "5bf39bf7-b621-4388-8dd2-5fd139920258"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:04.828673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-31d1f976-f5d1-4e7b-b980-091f9dd8d7b0 req-7b9f2ee0-c7c2-4931-86d5-424eeda16ac8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:04.829899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-31d1f976-f5d1-4e7b-b980-091f9dd8d7b0 req-7b9f2ee0-c7c2-4931-86d5-424eeda16ac8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:04.830574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-31d1f976-f5d1-4e7b-b980-091f9dd8d7b0 req-7b9f2ee0-c7c2-4931-86d5-424eeda16ac8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:04.858573 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-31d1f976-f5d1-4e7b-b980-091f9dd8d7b0 req-7b9f2ee0-c7c2-4931-86d5-424eeda16ac8 service nova] Creating event network-vif-plugged:871c6aba-a220-472d-bb9a-015670319816 for instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 on nch1-master-1 Sep 10 20:51:04.862032 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-31d1f976-f5d1-4e7b-b980-091f9dd8d7b0 req-7b9f2ee0-c7c2-4931-86d5-424eeda16ac8 service nova] Creating event network-vif-plugged:5bf39bf7-b621-4388-8dd2-5fd139920258 for instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 on nch2-master-1 Sep 10 20:51:04.883893 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-31d1f976-f5d1-4e7b-b980-091f9dd8d7b0 req-7b9f2ee0-c7c2-4931-86d5-424eeda16ac8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082891 Sep 10 20:51:04.890419 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 418/788] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:04.901990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8c5c004b-88d0-40c6-8ce4-b390b12a7507 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:04.904319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8c5c004b-88d0-40c6-8ce4-b390b12a7507 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:04.920288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c5c004b-88d0-40c6-8ce4-b390b12a7507 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:04.921563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c5c004b-88d0-40c6-8ce4-b390b12a7507 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:04.922162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c5c004b-88d0-40c6-8ce4-b390b12a7507 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:04.923547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c5c004b-88d0-40c6-8ce4-b390b12a7507 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:04.926306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c5c004b-88d0-40c6-8ce4-b390b12a7507 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:04.930049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c5c004b-88d0-40c6-8ce4-b390b12a7507 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:05.035343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5cdf8911-0858-4025-88c6-d1d929733b4a tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:05.048958 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5cdf8911-0858-4025-88c6-d1d929733b4a tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.635498 Sep 10 20:51:05.049571 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 371/789] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:04 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:05.066868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:05.070514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:05.102916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:05.103421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:05.108725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:05.109916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:05.110409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:05.110862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:05.117311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:05.469983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8c5c004b-88d0-40c6-8ce4-b390b12a7507 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:05.480317 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8c5c004b-88d0-40c6-8ce4-b390b12a7507 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1313 microversion: 2.1 time: 0.588235 Sep 10 20:51:05.501177 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 419/790] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:04 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:05.510911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9e60892f-e9bf-42f1-8adc-8f48478f2bd0 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:05.514552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9e60892f-e9bf-42f1-8adc-8f48478f2bd0 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:05.523610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e60892f-e9bf-42f1-8adc-8f48478f2bd0 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:05.524257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e60892f-e9bf-42f1-8adc-8f48478f2bd0 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:05.524855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e60892f-e9bf-42f1-8adc-8f48478f2bd0 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:05.525666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e60892f-e9bf-42f1-8adc-8f48478f2bd0 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:05.526863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e60892f-e9bf-42f1-8adc-8f48478f2bd0 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:05.527518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e60892f-e9bf-42f1-8adc-8f48478f2bd0 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:05.544634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:05.554389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:05.555882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:05.557015 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bea6ea3e-eb62-4059-9615-7f40588e1d5d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1410 microversion: 2.25 time: 0.506488 Sep 10 20:51:05.557588 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 372/791] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:05 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1410 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:05.574659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0f558e6a-4738-46fa-8dc9-7b1d01f9e835 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:05.575269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0f558e6a-4738-46fa-8dc9-7b1d01f9e835 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:05.584199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f558e6a-4738-46fa-8dc9-7b1d01f9e835 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:05.585042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f558e6a-4738-46fa-8dc9-7b1d01f9e835 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:05.585685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f558e6a-4738-46fa-8dc9-7b1d01f9e835 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:05.586695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f558e6a-4738-46fa-8dc9-7b1d01f9e835 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:05.587224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f558e6a-4738-46fa-8dc9-7b1d01f9e835 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:05.587725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f558e6a-4738-46fa-8dc9-7b1d01f9e835 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:05.678760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f558e6a-4738-46fa-8dc9-7b1d01f9e835 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:05.687210 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0f558e6a-4738-46fa-8dc9-7b1d01f9e835 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1207 microversion: 2.1 time: 0.116140 Sep 10 20:51:05.687928 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 373/792] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:05 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1207 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:05.708158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ca14410-acbf-4b1e-b54f-97493192620c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:05.708784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ca14410-acbf-4b1e-b54f-97493192620c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:05.715298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ca14410-acbf-4b1e-b54f-97493192620c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:05.715794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ca14410-acbf-4b1e-b54f-97493192620c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:05.716235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ca14410-acbf-4b1e-b54f-97493192620c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:05.716954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ca14410-acbf-4b1e-b54f-97493192620c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:05.717410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ca14410-acbf-4b1e-b54f-97493192620c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:05.717876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ca14410-acbf-4b1e-b54f-97493192620c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:05.947843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5ca14410-acbf-4b1e-b54f-97493192620c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:05.960442 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ca14410-acbf-4b1e-b54f-97493192620c tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1475 microversion: 2.1 time: 0.256875 Sep 10 20:51:05.961037 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 374/793] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:05 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1475 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:05.962767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e60892f-e9bf-42f1-8adc-8f48478f2bd0 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:05.981318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:05.982876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:05.989613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:05.990012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:05.990484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:05.991176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:05.991638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:05.992059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.001271 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9e60892f-e9bf-42f1-8adc-8f48478f2bd0 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1271 microversion: 2.1 time: 0.494545 Sep 10 20:51:06.002625 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 420/794] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:05 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1271 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:06.010699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5499ba19-a6ed-4263-adb1-a89cf9f7d7a1 req-795892e4-5b58-4164-8389-2371c9330788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd11ff4-6dda-414d-ab81-111f4762df68", "tag": "b0683ab4-3a9c-4ccd-816b-b8815b507ac5"}, {"name": "network-changed", "server_uuid": "7e5578bf-977b-4757-be61-2c01715e6bc1", "tag": "80e2a60f-8b6c-4781-907c-f4c05c172375"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:06.023968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5499ba19-a6ed-4263-adb1-a89cf9f7d7a1 req-795892e4-5b58-4164-8389-2371c9330788 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.024607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5499ba19-a6ed-4263-adb1-a89cf9f7d7a1 req-795892e4-5b58-4164-8389-2371c9330788 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.025146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5499ba19-a6ed-4263-adb1-a89cf9f7d7a1 req-795892e4-5b58-4164-8389-2371c9330788 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.039057 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5499ba19-a6ed-4263-adb1-a89cf9f7d7a1 req-795892e4-5b58-4164-8389-2371c9330788 service nova] Creating event network-changed:b0683ab4-3a9c-4ccd-816b-b8815b507ac5 for instance 3cd11ff4-6dda-414d-ab81-111f4762df68 on nch2-master-1 Sep 10 20:51:06.039567 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5499ba19-a6ed-4263-adb1-a89cf9f7d7a1 req-795892e4-5b58-4164-8389-2371c9330788 service nova] Creating event network-changed:80e2a60f-8b6c-4781-907c-f4c05c172375 for instance 7e5578bf-977b-4757-be61-2c01715e6bc1 on nch2-master-1 Sep 10 20:51:06.045796 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5499ba19-a6ed-4263-adb1-a89cf9f7d7a1 req-795892e4-5b58-4164-8389-2371c9330788 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040147 Sep 10 20:51:06.046425 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 421/795] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:06.078672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2d4f74db-19d7-4a01-84f2-c467afe6bb4c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:06.079580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2d4f74db-19d7-4a01-84f2-c467afe6bb4c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:06.082288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:06.086506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d4f74db-19d7-4a01-84f2-c467afe6bb4c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.087452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d4f74db-19d7-4a01-84f2-c467afe6bb4c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.087773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d4f74db-19d7-4a01-84f2-c467afe6bb4c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.088967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d4f74db-19d7-4a01-84f2-c467afe6bb4c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.089365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d4f74db-19d7-4a01-84f2-c467afe6bb4c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.089890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d4f74db-19d7-4a01-84f2-c467afe6bb4c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.090689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:06.092410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:06.099519 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ae5e23f-ed17-45f5-a627-f180dfe2bb79 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.134975 Sep 10 20:51:06.100113 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 375/796] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:05 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:06.355326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2d4f74db-19d7-4a01-84f2-c467afe6bb4c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:06.364484 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2d4f74db-19d7-4a01-84f2-c467afe6bb4c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.291621 Sep 10 20:51:06.365229 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 422/797] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:06 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:06.506031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8fbc122a-377d-4ef6-95c4-e1eaff2c454f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:06.506984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8fbc122a-377d-4ef6-95c4-e1eaff2c454f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:06.524554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fbc122a-377d-4ef6-95c4-e1eaff2c454f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.525249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fbc122a-377d-4ef6-95c4-e1eaff2c454f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.525669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fbc122a-377d-4ef6-95c4-e1eaff2c454f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.526430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fbc122a-377d-4ef6-95c4-e1eaff2c454f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.526942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fbc122a-377d-4ef6-95c4-e1eaff2c454f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.527381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fbc122a-377d-4ef6-95c4-e1eaff2c454f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.584753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:06.586516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:06.601522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.602069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.602531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.603242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.603703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.604134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.703493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8fbc122a-377d-4ef6-95c4-e1eaff2c454f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:06.715566 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8fbc122a-377d-4ef6-95c4-e1eaff2c454f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1313 microversion: 2.1 time: 0.214414 Sep 10 20:51:06.716470 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 376/798] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:06 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:06.721974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-411441f6-17d2-404d-a70f-558ae4e12adc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:06.723366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-411441f6-17d2-404d-a70f-558ae4e12adc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:06.729788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-411441f6-17d2-404d-a70f-558ae4e12adc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.730883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-411441f6-17d2-404d-a70f-558ae4e12adc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.731489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-411441f6-17d2-404d-a70f-558ae4e12adc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.732357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-411441f6-17d2-404d-a70f-558ae4e12adc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.732971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-411441f6-17d2-404d-a70f-558ae4e12adc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.733553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-411441f6-17d2-404d-a70f-558ae4e12adc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.815888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-411441f6-17d2-404d-a70f-558ae4e12adc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:06.823899 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-411441f6-17d2-404d-a70f-558ae4e12adc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1263 microversion: 2.1 time: 0.106255 Sep 10 20:51:06.826027 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 377/799] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:06 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1263 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:06.891946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:06.901408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:06.902904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:06.904021 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e0806d4f-5efe-4430-8f97-c0ad409eb9fc tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1410 microversion: 2.25 time: 0.325132 Sep 10 20:51:06.904751 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 423/800] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:06 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1410 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:06.984561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-191bc690-c7db-4179-b9b5-2b4fc9e8c4e2 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:06.985204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-191bc690-c7db-4179-b9b5-2b4fc9e8c4e2 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:06.991682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191bc690-c7db-4179-b9b5-2b4fc9e8c4e2 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.992180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191bc690-c7db-4179-b9b5-2b4fc9e8c4e2 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.992624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191bc690-c7db-4179-b9b5-2b4fc9e8c4e2 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:06.993334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191bc690-c7db-4179-b9b5-2b4fc9e8c4e2 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:06.994105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191bc690-c7db-4179-b9b5-2b4fc9e8c4e2 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:06.994597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191bc690-c7db-4179-b9b5-2b4fc9e8c4e2 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.028812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d87afeaf-9a23-454e-bed2-581e1ea5821f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:07.029524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d87afeaf-9a23-454e-bed2-581e1ea5821f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:07.042204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d87afeaf-9a23-454e-bed2-581e1ea5821f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:07.042621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d87afeaf-9a23-454e-bed2-581e1ea5821f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:07.043063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d87afeaf-9a23-454e-bed2-581e1ea5821f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.043989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d87afeaf-9a23-454e-bed2-581e1ea5821f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:07.044452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d87afeaf-9a23-454e-bed2-581e1ea5821f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:07.044955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d87afeaf-9a23-454e-bed2-581e1ea5821f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.196090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d87afeaf-9a23-454e-bed2-581e1ea5821f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:07.205194 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d87afeaf-9a23-454e-bed2-581e1ea5821f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1271 microversion: 2.1 time: 0.180518 Sep 10 20:51:07.205973 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 424/801] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:07 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:07.211714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:07.212798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:07.218978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:07.219725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:07.220510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.221864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:07.223699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:07.224394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.224512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-191bc690-c7db-4179-b9b5-2b4fc9e8c4e2 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:07.232253 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-191bc690-c7db-4179-b9b5-2b4fc9e8c4e2 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1475 microversion: 2.1 time: 0.251603 Sep 10 20:51:07.249090 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 378/802] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:06 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1475 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:07.343364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:07.354964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:07.356948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:07.366076 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6ac95a62-a78e-47a5-a012-452ea18ddd2c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.158145 Sep 10 20:51:07.367299 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 425/803] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:07 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:07.389214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7185aec-d561-4b6c-a7ff-a051c8103c6b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:07.389880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b7185aec-d561-4b6c-a7ff-a051c8103c6b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:07.396911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7185aec-d561-4b6c-a7ff-a051c8103c6b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:07.397556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7185aec-d561-4b6c-a7ff-a051c8103c6b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:07.397924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7185aec-d561-4b6c-a7ff-a051c8103c6b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.398768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7185aec-d561-4b6c-a7ff-a051c8103c6b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:07.400079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7185aec-d561-4b6c-a7ff-a051c8103c6b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:07.400351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7185aec-d561-4b6c-a7ff-a051c8103c6b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.573236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7185aec-d561-4b6c-a7ff-a051c8103c6b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:07.581035 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b7185aec-d561-4b6c-a7ff-a051c8103c6b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.196287 Sep 10 20:51:07.581535 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 379/804] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:07 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:07.740967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-230809b7-bfeb-460d-af0a-9ecf8945be5e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:07.742276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-230809b7-bfeb-460d-af0a-9ecf8945be5e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:07.749021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-230809b7-bfeb-460d-af0a-9ecf8945be5e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:07.749818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-230809b7-bfeb-460d-af0a-9ecf8945be5e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:07.750534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-230809b7-bfeb-460d-af0a-9ecf8945be5e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.751615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-230809b7-bfeb-460d-af0a-9ecf8945be5e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:07.752649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-230809b7-bfeb-460d-af0a-9ecf8945be5e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:07.753364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-230809b7-bfeb-460d-af0a-9ecf8945be5e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.854217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cf87407f-c9ff-4c7c-9265-24a93678a53c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:07.856174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cf87407f-c9ff-4c7c-9265-24a93678a53c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:07.868215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf87407f-c9ff-4c7c-9265-24a93678a53c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:07.868719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf87407f-c9ff-4c7c-9265-24a93678a53c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:07.869156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf87407f-c9ff-4c7c-9265-24a93678a53c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.874336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf87407f-c9ff-4c7c-9265-24a93678a53c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:07.874843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf87407f-c9ff-4c7c-9265-24a93678a53c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:07.875285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf87407f-c9ff-4c7c-9265-24a93678a53c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:07.978966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf87407f-c9ff-4c7c-9265-24a93678a53c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:07.984147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-230809b7-bfeb-460d-af0a-9ecf8945be5e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:07.991205 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cf87407f-c9ff-4c7c-9265-24a93678a53c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1281 microversion: 2.1 time: 0.147228 Sep 10 20:51:07.991828 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 380/805] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:07 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:07.997225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:07.997926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:08.004674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.005756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.006964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.008590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.009191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.009769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.011718 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-230809b7-bfeb-460d-af0a-9ecf8945be5e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1463 microversion: 2.1 time: 0.275371 Sep 10 20:51:08.012771 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 426/806] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:07 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1463 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:08.251772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62c80bfc-4b3f-40ac-b743-2c52900eea90 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:08.252606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62c80bfc-4b3f-40ac-b743-2c52900eea90 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:08.252977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:08.260260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62c80bfc-4b3f-40ac-b743-2c52900eea90 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.260947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62c80bfc-4b3f-40ac-b743-2c52900eea90 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.261395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62c80bfc-4b3f-40ac-b743-2c52900eea90 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.262161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62c80bfc-4b3f-40ac-b743-2c52900eea90 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.262694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62c80bfc-4b3f-40ac-b743-2c52900eea90 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.263131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62c80bfc-4b3f-40ac-b743-2c52900eea90 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.264561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:08.270221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:08.272565 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a7a46f64-bab4-4da8-9010-f82c5a1fbe07 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1410 microversion: 2.25 time: 0.278981 Sep 10 20:51:08.273435 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 381/807] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:07 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1410 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:08.278554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e75814a9-7078-4506-9385-3d0c818a6c7b req-72acc5c7-f2aa-4f0e-9872-d7648dbb0ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5578bf-977b-4757-be61-2c01715e6bc1", "tag": "6db07566-c5ac-4fcb-9d35-209f1d7290d6"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:08.292431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e75814a9-7078-4506-9385-3d0c818a6c7b req-72acc5c7-f2aa-4f0e-9872-d7648dbb0ee0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.292968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e75814a9-7078-4506-9385-3d0c818a6c7b req-72acc5c7-f2aa-4f0e-9872-d7648dbb0ee0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.293410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e75814a9-7078-4506-9385-3d0c818a6c7b req-72acc5c7-f2aa-4f0e-9872-d7648dbb0ee0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.307015 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e75814a9-7078-4506-9385-3d0c818a6c7b req-72acc5c7-f2aa-4f0e-9872-d7648dbb0ee0 service nova] Creating event network-changed:6db07566-c5ac-4fcb-9d35-209f1d7290d6 for instance 7e5578bf-977b-4757-be61-2c01715e6bc1 on nch2-master-1 Sep 10 20:51:08.312290 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e75814a9-7078-4506-9385-3d0c818a6c7b req-72acc5c7-f2aa-4f0e-9872-d7648dbb0ee0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037689 Sep 10 20:51:08.313247 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 382/808] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:08.319313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-adc1a52b-fca8-4f02-a327-00008174b4c5 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:08.320141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-adc1a52b-fca8-4f02-a327-00008174b4c5 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:08.327207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc1a52b-fca8-4f02-a327-00008174b4c5 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.327726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc1a52b-fca8-4f02-a327-00008174b4c5 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.328166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc1a52b-fca8-4f02-a327-00008174b4c5 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.328874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc1a52b-fca8-4f02-a327-00008174b4c5 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.329364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc1a52b-fca8-4f02-a327-00008174b4c5 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.329790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc1a52b-fca8-4f02-a327-00008174b4c5 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.568180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-adc1a52b-fca8-4f02-a327-00008174b4c5 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:08.588727 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-adc1a52b-fca8-4f02-a327-00008174b4c5 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1313 microversion: 2.1 time: 0.272403 Sep 10 20:51:08.589719 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 383/809] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:08 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:08.596632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d72298cc-f116-4534-bdfe-cffc582ab927 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:08.600300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d72298cc-f116-4534-bdfe-cffc582ab927 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:08.615956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d72298cc-f116-4534-bdfe-cffc582ab927 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.616989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d72298cc-f116-4534-bdfe-cffc582ab927 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.617758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d72298cc-f116-4534-bdfe-cffc582ab927 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.618715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d72298cc-f116-4534-bdfe-cffc582ab927 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.619533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d72298cc-f116-4534-bdfe-cffc582ab927 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.621403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d72298cc-f116-4534-bdfe-cffc582ab927 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.809982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d72298cc-f116-4534-bdfe-cffc582ab927 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:08.820171 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d72298cc-f116-4534-bdfe-cffc582ab927 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1461 microversion: 2.1 time: 0.227482 Sep 10 20:51:08.820844 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 384/810] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:08 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1461 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:08.838390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:08.839514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:08.846125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.846721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.847847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.849010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:08.849550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:08.850112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:08.967841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:08.986860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:08.988654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:09.009622 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5972e13f-34e1-4bde-92e0-183eaf1b2ae8 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.187438 Sep 10 20:51:09.010350 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 385/811] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:08 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:09.018262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-04c4f418-8d1b-4f0e-b162-5bfdc548fc72 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:09.027981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-04c4f418-8d1b-4f0e-b162-5bfdc548fc72 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:09.042411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04c4f418-8d1b-4f0e-b162-5bfdc548fc72 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:09.043202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04c4f418-8d1b-4f0e-b162-5bfdc548fc72 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:09.043883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04c4f418-8d1b-4f0e-b162-5bfdc548fc72 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:09.044974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04c4f418-8d1b-4f0e-b162-5bfdc548fc72 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:09.045646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04c4f418-8d1b-4f0e-b162-5bfdc548fc72 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:09.046294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04c4f418-8d1b-4f0e-b162-5bfdc548fc72 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:09.149966 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62c80bfc-4b3f-40ac-b743-2c52900eea90 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1614 microversion: 2.1 time: 1.101169 Sep 10 20:51:09.152525 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 427/812] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:08 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1614 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:09.162817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-531b5ce9-73fb-4851-9fff-923152e250bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:09.167076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-531b5ce9-73fb-4851-9fff-923152e250bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:09.177469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-531b5ce9-73fb-4851-9fff-923152e250bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:09.178435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-531b5ce9-73fb-4851-9fff-923152e250bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:09.178873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-531b5ce9-73fb-4851-9fff-923152e250bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:09.179896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-531b5ce9-73fb-4851-9fff-923152e250bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:09.180582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-531b5ce9-73fb-4851-9fff-923152e250bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:09.181012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-531b5ce9-73fb-4851-9fff-923152e250bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:09.321303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-04c4f418-8d1b-4f0e-b162-5bfdc548fc72 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:09.331483 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-04c4f418-8d1b-4f0e-b162-5bfdc548fc72 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.319659 Sep 10 20:51:09.333624 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 386/813] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:09 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:09.338290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c642d41f-32d2-4ffc-88b0-9a9aced351d7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:09.339073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c642d41f-32d2-4ffc-88b0-9a9aced351d7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:09.346195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c642d41f-32d2-4ffc-88b0-9a9aced351d7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:09.347027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c642d41f-32d2-4ffc-88b0-9a9aced351d7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:09.347951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c642d41f-32d2-4ffc-88b0-9a9aced351d7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:09.349055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c642d41f-32d2-4ffc-88b0-9a9aced351d7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:09.349973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c642d41f-32d2-4ffc-88b0-9a9aced351d7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:09.350403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c642d41f-32d2-4ffc-88b0-9a9aced351d7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:09.814019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-531b5ce9-73fb-4851-9fff-923152e250bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:09.829256 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-531b5ce9-73fb-4851-9fff-923152e250bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1461 microversion: 2.1 time: 0.674146 Sep 10 20:51:09.829782 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 428/814] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:09 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1461 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:09.834917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:09.835918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:09.842214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:09.842999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:09.843677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:09.844602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:09.845291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:09.846233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:09.892524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c642d41f-32d2-4ffc-88b0-9a9aced351d7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:09.902958 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c642d41f-32d2-4ffc-88b0-9a9aced351d7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.567122 Sep 10 20:51:09.905630 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 387/815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:09 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:09.914866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:09.915737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:09.922154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:09.922941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:09.923578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:09.924532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:09.925180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:09.926740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ff6039a197324406a774cd55dc06b9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6a80cfe5e49eda7f76cde966f9799', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:09.927000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:09.927488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] flavor_id is None. Assuming migration. {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 20:51:09.928002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 20:51:10.094032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:10.127826 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e3f6fb3-a0d4-4952-9120-6f3db029ad11 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7/action" status: 202 len: 0 microversion: 2.1 time: 0.296329 Sep 10 20:51:10.129326 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 429/816] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:51:09 2022] POST /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:51:10.135168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3c91ec92-fab3-423b-85ec-381c30e72d79 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:10.136064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3c91ec92-fab3-423b-85ec-381c30e72d79 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:10.142653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91ec92-fab3-423b-85ec-381c30e72d79 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.143890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91ec92-fab3-423b-85ec-381c30e72d79 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.144592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91ec92-fab3-423b-85ec-381c30e72d79 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.145485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91ec92-fab3-423b-85ec-381c30e72d79 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.146143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91ec92-fab3-423b-85ec-381c30e72d79 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.146986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91ec92-fab3-423b-85ec-381c30e72d79 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.224569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:10.244743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:10.248464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:10.250337 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f30c57f4-6ecb-438d-a032-1588db86791c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1410 microversion: 2.25 time: 0.343329 Sep 10 20:51:10.251118 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 388/817] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:09 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1410 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:10.273503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:10.276723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:10.286005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.286924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.287553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.288442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.289063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.289667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.325742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:10.407427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:51:10.407948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:51:10.408428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:51:10.408834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:51:10.409307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:51:10.483308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:10.491455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.492590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.493104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.494537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.495290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.495788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.532322 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5eb20cc4-6c2f-4cdf-8b0d-8b367a1310c0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action" status: 202 len: 1065 microversion: 2.1 time: 0.269290 Sep 10 20:51:10.533010 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 389/818] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:51:10 2022] POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action => generated 1065 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 20:51:10.546927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:10.546927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:10.559640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.560141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.560583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.561284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.561740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.562216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.651493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3c91ec92-fab3-423b-85ec-381c30e72d79 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:10.674334 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3c91ec92-fab3-423b-85ec-381c30e72d79 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1313 microversion: 2.1 time: 0.542766 Sep 10 20:51:10.675881 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 430/819] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:10 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:10.681366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fa52d58e-79ab-4e11-863c-e1ee7d5833ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:10.682107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fa52d58e-79ab-4e11-863c-e1ee7d5833ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:10.692944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa52d58e-79ab-4e11-863c-e1ee7d5833ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.693774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa52d58e-79ab-4e11-863c-e1ee7d5833ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.694447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa52d58e-79ab-4e11-863c-e1ee7d5833ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.695597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa52d58e-79ab-4e11-863c-e1ee7d5833ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.696279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa52d58e-79ab-4e11-863c-e1ee7d5833ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.696987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa52d58e-79ab-4e11-863c-e1ee7d5833ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.707114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:10.721879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:10.724352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:10.730614 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-97edd8a6-bcb7-4377-a7d7-8344417b495e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.196650 Sep 10 20:51:10.740865 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 390/820] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:10 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:10.740865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-717d36cc-07a4-4c17-b3f9-23fcddadf4f8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:10.740865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-717d36cc-07a4-4c17-b3f9-23fcddadf4f8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:10.747065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717d36cc-07a4-4c17-b3f9-23fcddadf4f8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.747065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717d36cc-07a4-4c17-b3f9-23fcddadf4f8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.747458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717d36cc-07a4-4c17-b3f9-23fcddadf4f8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.748249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717d36cc-07a4-4c17-b3f9-23fcddadf4f8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:10.748771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717d36cc-07a4-4c17-b3f9-23fcddadf4f8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:10.749448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717d36cc-07a4-4c17-b3f9-23fcddadf4f8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:10.999962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-717d36cc-07a4-4c17-b3f9-23fcddadf4f8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.009665 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-717d36cc-07a4-4c17-b3f9-23fcddadf4f8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.276314 Sep 10 20:51:11.010280 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 391/821] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:10 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:11.014876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-37ab90e1-31a3-4b10-be5d-5418bbd762a9 req-7489be6f-1a77-4a2d-a31c-a58069a64ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b48c2d1-e818-4a83-aa7b-768175ba35b8", "tag": "f494147e-3b49-449c-9f1e-ac1f6ad6afd7"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:11.025518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-37ab90e1-31a3-4b10-be5d-5418bbd762a9 req-7489be6f-1a77-4a2d-a31c-a58069a64ad7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.025819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-37ab90e1-31a3-4b10-be5d-5418bbd762a9 req-7489be6f-1a77-4a2d-a31c-a58069a64ad7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.026283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-37ab90e1-31a3-4b10-be5d-5418bbd762a9 req-7489be6f-1a77-4a2d-a31c-a58069a64ad7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.036312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fa52d58e-79ab-4e11-863c-e1ee7d5833ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.037287 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-37ab90e1-31a3-4b10-be5d-5418bbd762a9 req-7489be6f-1a77-4a2d-a31c-a58069a64ad7 service nova] Creating event network-changed:f494147e-3b49-449c-9f1e-ac1f6ad6afd7 for instance 3b48c2d1-e818-4a83-aa7b-768175ba35b8 on nch1-master-1 Sep 10 20:51:11.042332 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-37ab90e1-31a3-4b10-be5d-5418bbd762a9 req-7489be6f-1a77-4a2d-a31c-a58069a64ad7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030665 Sep 10 20:51:11.042941 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 392/822] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:11.045770 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fa52d58e-79ab-4e11-863c-e1ee7d5833ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1472 microversion: 2.1 time: 0.368392 Sep 10 20:51:11.046822 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 431/823] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:10 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1472 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:11.048103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-53c3fe18-ebc3-4809-a2a7-5e70adecb149 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:11.049487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-53c3fe18-ebc3-4809-a2a7-5e70adecb149 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:11.053085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-7bad4e84-821a-4e7d-8c42-dd2e33801850 req-60df95b2-d112-467c-8e3f-b8f2eec0131d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6b8ddf-a7d9-4698-9bb8-159ce02769dc", "tag": "6cd39c03-2619-4e42-b3c9-3bc146a98c89"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:11.058438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53c3fe18-ebc3-4809-a2a7-5e70adecb149 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.059131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53c3fe18-ebc3-4809-a2a7-5e70adecb149 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.059725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53c3fe18-ebc3-4809-a2a7-5e70adecb149 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.060605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53c3fe18-ebc3-4809-a2a7-5e70adecb149 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.061226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53c3fe18-ebc3-4809-a2a7-5e70adecb149 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.061813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53c3fe18-ebc3-4809-a2a7-5e70adecb149 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.066613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7bad4e84-821a-4e7d-8c42-dd2e33801850 req-60df95b2-d112-467c-8e3f-b8f2eec0131d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.067236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7bad4e84-821a-4e7d-8c42-dd2e33801850 req-60df95b2-d112-467c-8e3f-b8f2eec0131d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.067825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7bad4e84-821a-4e7d-8c42-dd2e33801850 req-60df95b2-d112-467c-8e3f-b8f2eec0131d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.079547 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7bad4e84-821a-4e7d-8c42-dd2e33801850 req-60df95b2-d112-467c-8e3f-b8f2eec0131d service nova] Creating event network-changed:6cd39c03-2619-4e42-b3c9-3bc146a98c89 for instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc on nch1-master-1 Sep 10 20:51:11.085924 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-7bad4e84-821a-4e7d-8c42-dd2e33801850 req-60df95b2-d112-467c-8e3f-b8f2eec0131d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036285 Sep 10 20:51:11.086723 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 432/824] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:11.095128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d3e26fbe-2cd9-470d-85c3-6241d324a937 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:11.096105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d3e26fbe-2cd9-470d-85c3-6241d324a937 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:11.102916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e26fbe-2cd9-470d-85c3-6241d324a937 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.103445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e26fbe-2cd9-470d-85c3-6241d324a937 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.103892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e26fbe-2cd9-470d-85c3-6241d324a937 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.104759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e26fbe-2cd9-470d-85c3-6241d324a937 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.105230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e26fbe-2cd9-470d-85c3-6241d324a937 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.105669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e26fbe-2cd9-470d-85c3-6241d324a937 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.227720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-53c3fe18-ebc3-4809-a2a7-5e70adecb149 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.235957 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-53c3fe18-ebc3-4809-a2a7-5e70adecb149 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.191685 Sep 10 20:51:11.247735 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 393/825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:11 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:11.260798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d3e26fbe-2cd9-470d-85c3-6241d324a937 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.268811 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d3e26fbe-2cd9-470d-85c3-6241d324a937 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.180125 Sep 10 20:51:11.269439 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 433/826] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:11 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:11.276439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:11.277043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:11.283426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.283915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.284369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.285122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.285579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.286063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.426497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.435129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.436542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.437689 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e64ec739-3f16-4e04-829a-61afec8d3752 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1410 microversion: 2.25 time: 0.166043 Sep 10 20:51:11.438506 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 394/827] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:11 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1410 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:11.697482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9db125fc-dd2c-454e-a485-daa9be65ebac tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:11.698246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9db125fc-dd2c-454e-a485-daa9be65ebac tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:11.704326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9db125fc-dd2c-454e-a485-daa9be65ebac tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.704807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9db125fc-dd2c-454e-a485-daa9be65ebac tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.705238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9db125fc-dd2c-454e-a485-daa9be65ebac tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.705955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9db125fc-dd2c-454e-a485-daa9be65ebac tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.706411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9db125fc-dd2c-454e-a485-daa9be65ebac tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.706961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9db125fc-dd2c-454e-a485-daa9be65ebac tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.775080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:11.775968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:11.782445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.782926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.783384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.784081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.784531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.785524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.849912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9db125fc-dd2c-454e-a485-daa9be65ebac tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.858221 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9db125fc-dd2c-454e-a485-daa9be65ebac tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1313 microversion: 2.1 time: 0.164383 Sep 10 20:51:11.858827 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 434/828] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:11 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:11.863873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-93d32576-2bc3-4497-8410-ae12df0b15cc req-18d78792-55e6-4bbd-b6b1-e56dede7011b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd11ff4-6dda-414d-ab81-111f4762df68", "name": "network-vif-plugged", "status": "completed", "tag": "b0683ab4-3a9c-4ccd-816b-b8815b507ac5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:11.868765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.877236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.878765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:11.883970 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7811b85e-74af-41c9-897c-dbb4d5c1d5a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.112959 Sep 10 20:51:11.884542 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 395/829] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:11 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:11.887574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-93d32576-2bc3-4497-8410-ae12df0b15cc req-18d78792-55e6-4bbd-b6b1-e56dede7011b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:11.888060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-93d32576-2bc3-4497-8410-ae12df0b15cc req-18d78792-55e6-4bbd-b6b1-e56dede7011b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:11.888490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-93d32576-2bc3-4497-8410-ae12df0b15cc req-18d78792-55e6-4bbd-b6b1-e56dede7011b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:11.900233 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-93d32576-2bc3-4497-8410-ae12df0b15cc req-18d78792-55e6-4bbd-b6b1-e56dede7011b service nova] Creating event network-vif-plugged:b0683ab4-3a9c-4ccd-816b-b8815b507ac5 for instance 3cd11ff4-6dda-414d-ab81-111f4762df68 on nch2-master-1 Sep 10 20:51:11.905011 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-93d32576-2bc3-4497-8410-ae12df0b15cc req-18d78792-55e6-4bbd-b6b1-e56dede7011b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045086 Sep 10 20:51:11.905591 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 435/830] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:12.033788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a6007027-017d-4ae2-af84-5dfac9f8f2a1 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:12.034443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a6007027-017d-4ae2-af84-5dfac9f8f2a1 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:12.040638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6007027-017d-4ae2-af84-5dfac9f8f2a1 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.041121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6007027-017d-4ae2-af84-5dfac9f8f2a1 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.041557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6007027-017d-4ae2-af84-5dfac9f8f2a1 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.042280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6007027-017d-4ae2-af84-5dfac9f8f2a1 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.042735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6007027-017d-4ae2-af84-5dfac9f8f2a1 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.043158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6007027-017d-4ae2-af84-5dfac9f8f2a1 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.071926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4db0017e-5ee9-47cb-adc8-d9d29b4322d1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:12.072628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4db0017e-5ee9-47cb-adc8-d9d29b4322d1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:12.078849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4db0017e-5ee9-47cb-adc8-d9d29b4322d1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.079344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4db0017e-5ee9-47cb-adc8-d9d29b4322d1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.079783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4db0017e-5ee9-47cb-adc8-d9d29b4322d1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.080484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4db0017e-5ee9-47cb-adc8-d9d29b4322d1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.080940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4db0017e-5ee9-47cb-adc8-d9d29b4322d1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.081368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4db0017e-5ee9-47cb-adc8-d9d29b4322d1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.188934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a6007027-017d-4ae2-af84-5dfac9f8f2a1 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:12.197535 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a6007027-017d-4ae2-af84-5dfac9f8f2a1 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.167556 Sep 10 20:51:12.198154 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 396/831] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:12 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:12.217519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4db0017e-5ee9-47cb-adc8-d9d29b4322d1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:12.225751 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4db0017e-5ee9-47cb-adc8-d9d29b4322d1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1472 microversion: 2.1 time: 0.157984 Sep 10 20:51:12.226388 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 436/832] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:12 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:12.259836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d8d5610-b862-4db4-8234-9cede738d392 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:12.260378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d8d5610-b862-4db4-8234-9cede738d392 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:12.266666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d8d5610-b862-4db4-8234-9cede738d392 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.267257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d8d5610-b862-4db4-8234-9cede738d392 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.267785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d8d5610-b862-4db4-8234-9cede738d392 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.268488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d8d5610-b862-4db4-8234-9cede738d392 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.268952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d8d5610-b862-4db4-8234-9cede738d392 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.269497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d8d5610-b862-4db4-8234-9cede738d392 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.292555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-074555f5-459b-4565-861f-e6bdf1357b5c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:12.293231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-074555f5-459b-4565-861f-e6bdf1357b5c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:12.299729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-074555f5-459b-4565-861f-e6bdf1357b5c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.300210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-074555f5-459b-4565-861f-e6bdf1357b5c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.301399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-074555f5-459b-4565-861f-e6bdf1357b5c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.302143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-074555f5-459b-4565-861f-e6bdf1357b5c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.302590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-074555f5-459b-4565-861f-e6bdf1357b5c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.303017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-074555f5-459b-4565-861f-e6bdf1357b5c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.413256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d8d5610-b862-4db4-8234-9cede738d392 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:12.421221 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d8d5610-b862-4db4-8234-9cede738d392 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.165213 Sep 10 20:51:12.431292 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 397/833] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:12 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:12.462851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-074555f5-459b-4565-861f-e6bdf1357b5c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:12.464093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:12.464868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:12.473575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.474259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.474801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.475712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.476642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.476896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.477581 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-074555f5-459b-4565-861f-e6bdf1357b5c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.187374 Sep 10 20:51:12.478915 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 437/834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:12 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:12.629537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:12.638555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:12.640034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:12.641475 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a8b0b6bb-c4bf-418c-afd1-a08bfb01dc3f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1410 microversion: 2.25 time: 0.181419 Sep 10 20:51:12.642077 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 398/835] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:12 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1410 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:12.881667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a09290e0-d25c-48b2-9017-c1ee449da068 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:12.882289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a09290e0-d25c-48b2-9017-c1ee449da068 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:12.888337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a09290e0-d25c-48b2-9017-c1ee449da068 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.888813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a09290e0-d25c-48b2-9017-c1ee449da068 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.889247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a09290e0-d25c-48b2-9017-c1ee449da068 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.889960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a09290e0-d25c-48b2-9017-c1ee449da068 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.890420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a09290e0-d25c-48b2-9017-c1ee449da068 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.890844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a09290e0-d25c-48b2-9017-c1ee449da068 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.915146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:12.915858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:12.927499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.928116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.930627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:12.930627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:12.930627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:12.930627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.027127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.036158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.038390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.044028 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-88598264-9d1b-4933-91e4-f70e9791f91a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.135160 Sep 10 20:51:13.044771 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 399/836] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:12 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:13.134541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a09290e0-d25c-48b2-9017-c1ee449da068 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.142325 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a09290e0-d25c-48b2-9017-c1ee449da068 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1313 microversion: 2.1 time: 0.264607 Sep 10 20:51:13.142884 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 438/837] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:12 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:13.221109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-096ae124-eb3c-4f18-a1cf-55e2986d8784 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:13.221875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-096ae124-eb3c-4f18-a1cf-55e2986d8784 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:13.227812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-096ae124-eb3c-4f18-a1cf-55e2986d8784 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:13.228292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-096ae124-eb3c-4f18-a1cf-55e2986d8784 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:13.228722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-096ae124-eb3c-4f18-a1cf-55e2986d8784 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.229408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-096ae124-eb3c-4f18-a1cf-55e2986d8784 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:13.229890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-096ae124-eb3c-4f18-a1cf-55e2986d8784 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:13.230315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-096ae124-eb3c-4f18-a1cf-55e2986d8784 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.250300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dda55bf8-3476-4c61-b4f6-83edc7506adc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:13.250909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dda55bf8-3476-4c61-b4f6-83edc7506adc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:13.257430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dda55bf8-3476-4c61-b4f6-83edc7506adc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:13.258239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dda55bf8-3476-4c61-b4f6-83edc7506adc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:13.258945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dda55bf8-3476-4c61-b4f6-83edc7506adc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.259697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dda55bf8-3476-4c61-b4f6-83edc7506adc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:13.260164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dda55bf8-3476-4c61-b4f6-83edc7506adc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:13.260591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dda55bf8-3476-4c61-b4f6-83edc7506adc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.379583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-096ae124-eb3c-4f18-a1cf-55e2986d8784 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.388566 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-096ae124-eb3c-4f18-a1cf-55e2986d8784 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.171401 Sep 10 20:51:13.396150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dda55bf8-3476-4c61-b4f6-83edc7506adc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.404014 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 400/838] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:13 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:13.404178 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dda55bf8-3476-4c61-b4f6-83edc7506adc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1472 microversion: 2.1 time: 0.157681 Sep 10 20:51:13.415862 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 439/839] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:13 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1472 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:13.454578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8c736a1c-56a8-4c80-bf56-cc954b317abb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:13.455202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8c736a1c-56a8-4c80-bf56-cc954b317abb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:13.461864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c736a1c-56a8-4c80-bf56-cc954b317abb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:13.462269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c736a1c-56a8-4c80-bf56-cc954b317abb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:13.462711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c736a1c-56a8-4c80-bf56-cc954b317abb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.463425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c736a1c-56a8-4c80-bf56-cc954b317abb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:13.463886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c736a1c-56a8-4c80-bf56-cc954b317abb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:13.464320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c736a1c-56a8-4c80-bf56-cc954b317abb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.501430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e7f7050e-7939-4e35-8b0b-823a5706f6ac tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:13.502072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e7f7050e-7939-4e35-8b0b-823a5706f6ac tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:13.508976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7f7050e-7939-4e35-8b0b-823a5706f6ac tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:13.509696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7f7050e-7939-4e35-8b0b-823a5706f6ac tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:13.510159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7f7050e-7939-4e35-8b0b-823a5706f6ac tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.511154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7f7050e-7939-4e35-8b0b-823a5706f6ac tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:13.511681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7f7050e-7939-4e35-8b0b-823a5706f6ac tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:13.512181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7f7050e-7939-4e35-8b0b-823a5706f6ac tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.577931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:13.674716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8c736a1c-56a8-4c80-bf56-cc954b317abb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.693415 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8c736a1c-56a8-4c80-bf56-cc954b317abb tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.241609 Sep 10 20:51:13.695291 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 401/840] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:13 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:13.707351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:13.708883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:13.716617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:13.717489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:13.718434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.719149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:13.720283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:13.720283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:13.835512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e7f7050e-7939-4e35-8b0b-823a5706f6ac tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.843443 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e7f7050e-7939-4e35-8b0b-823a5706f6ac tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.345823 Sep 10 20:51:13.846131 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 440/841] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:13 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:13.895927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.904659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.906168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:13.907289 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fb28dd1b-0015-49f7-9280-5e2d7e7e0748 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1410 microversion: 2.25 time: 0.209533 Sep 10 20:51:13.907890 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 402/842] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:13 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1410 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:14.072798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:14.073499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:14.079608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.080177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.080690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.081546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.082618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.083057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.153385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:14.161329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:14.163489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:14.166067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9870f415-702e-407c-8a11-f457ab4c7e05 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:14.167027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9870f415-702e-407c-8a11-f457ab4c7e05 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:14.170349 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-902a6da9-e628-4cfe-9f68-fadabb3360a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.101504 Sep 10 20:51:14.171244 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 441/843] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:14 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:51:14.180184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9870f415-702e-407c-8a11-f457ab4c7e05 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.180995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9870f415-702e-407c-8a11-f457ab4c7e05 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.181442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9870f415-702e-407c-8a11-f457ab4c7e05 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.182194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9870f415-702e-407c-8a11-f457ab4c7e05 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.182895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9870f415-702e-407c-8a11-f457ab4c7e05 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.183549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9870f415-702e-407c-8a11-f457ab4c7e05 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.375940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9870f415-702e-407c-8a11-f457ab4c7e05 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:14.385112 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9870f415-702e-407c-8a11-f457ab4c7e05 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1313 microversion: 2.1 time: 0.222813 Sep 10 20:51:14.386191 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 403/844] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:14 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:14.414290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5407eee5-8aed-4758-8eaf-3a89a479eeb0 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:14.414825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5407eee5-8aed-4758-8eaf-3a89a479eeb0 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:14.421641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5407eee5-8aed-4758-8eaf-3a89a479eeb0 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.422732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5407eee5-8aed-4758-8eaf-3a89a479eeb0 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.423175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5407eee5-8aed-4758-8eaf-3a89a479eeb0 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.424069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5407eee5-8aed-4758-8eaf-3a89a479eeb0 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.424532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5407eee5-8aed-4758-8eaf-3a89a479eeb0 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.424962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5407eee5-8aed-4758-8eaf-3a89a479eeb0 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.427717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dc5c1b9a-30ab-46fe-9a52-6ca169681762 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:14.428345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dc5c1b9a-30ab-46fe-9a52-6ca169681762 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:14.439147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc5c1b9a-30ab-46fe-9a52-6ca169681762 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.440719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc5c1b9a-30ab-46fe-9a52-6ca169681762 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.442454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc5c1b9a-30ab-46fe-9a52-6ca169681762 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.444445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc5c1b9a-30ab-46fe-9a52-6ca169681762 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.445290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc5c1b9a-30ab-46fe-9a52-6ca169681762 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.445792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc5c1b9a-30ab-46fe-9a52-6ca169681762 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.527899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:14.552755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=12 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:14.610351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dc5c1b9a-30ab-46fe-9a52-6ca169681762 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:14.622204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:14.628450 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dc5c1b9a-30ab-46fe-9a52-6ca169681762 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1472 microversion: 2.1 time: 0.205078 Sep 10 20:51:14.630178 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 404/845] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:14 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1472 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:14.699012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5407eee5-8aed-4758-8eaf-3a89a479eeb0 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:14.708975 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5407eee5-8aed-4758-8eaf-3a89a479eeb0 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.298698 Sep 10 20:51:14.714397 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 442/846] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:14 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:14.725559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-daeb1a0c-3f0d-457b-b9ef-3f5890bc0952 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:14.726646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-daeb1a0c-3f0d-457b-b9ef-3f5890bc0952 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:14.739377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-daeb1a0c-3f0d-457b-b9ef-3f5890bc0952 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.739931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-daeb1a0c-3f0d-457b-b9ef-3f5890bc0952 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.740367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-daeb1a0c-3f0d-457b-b9ef-3f5890bc0952 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.741218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-daeb1a0c-3f0d-457b-b9ef-3f5890bc0952 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.741639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-daeb1a0c-3f0d-457b-b9ef-3f5890bc0952 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.742145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-daeb1a0c-3f0d-457b-b9ef-3f5890bc0952 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.871705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9a31ac9-8355-4412-b103-8d075b44a0b6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:14.872497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9a31ac9-8355-4412-b103-8d075b44a0b6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:14.879835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a31ac9-8355-4412-b103-8d075b44a0b6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.880429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a31ac9-8355-4412-b103-8d075b44a0b6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.881225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a31ac9-8355-4412-b103-8d075b44a0b6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.882027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-daeb1a0c-3f0d-457b-b9ef-3f5890bc0952 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:14.882271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a31ac9-8355-4412-b103-8d075b44a0b6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.882862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a31ac9-8355-4412-b103-8d075b44a0b6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.883405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a31ac9-8355-4412-b103-8d075b44a0b6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.889932 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-daeb1a0c-3f0d-457b-b9ef-3f5890bc0952 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.174159 Sep 10 20:51:14.890541 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 405/847] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:14 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:14.932022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:14.932550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:14.938678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.939167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.939606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:14.940307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:14.940765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:14.941308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.075992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:15.077057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a9a31ac9-8355-4412-b103-8d075b44a0b6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:15.085510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:15.086174 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9a31ac9-8355-4412-b103-8d075b44a0b6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.219545 Sep 10 20:51:15.086753 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 443/848] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:14 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:15.087247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:15.088669 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-756facdb-4e2c-4214-adc8-5dfd65025e14 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1606 microversion: 2.25 time: 0.160596 Sep 10 20:51:15.089543 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 406/849] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:14 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1606 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:51:15.113998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9b54ad2f-2b42-4b81-a8af-8f73acb3fbf8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:15.114507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9b54ad2f-2b42-4b81-a8af-8f73acb3fbf8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:15.120438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b54ad2f-2b42-4b81-a8af-8f73acb3fbf8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.120917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b54ad2f-2b42-4b81-a8af-8f73acb3fbf8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.121349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b54ad2f-2b42-4b81-a8af-8f73acb3fbf8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.122064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b54ad2f-2b42-4b81-a8af-8f73acb3fbf8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.122513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b54ad2f-2b42-4b81-a8af-8f73acb3fbf8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.122931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b54ad2f-2b42-4b81-a8af-8f73acb3fbf8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.202972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:15.203591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:15.205569 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9b54ad2f-2b42-4b81-a8af-8f73acb3fbf8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.096177 Sep 10 20:51:15.207059 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 444/850] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Sep 10 20:51:15 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:51:15.215165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.215165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.215165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.215165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.215583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.215583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.303728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:15.312725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:15.314230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:15.320111 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-522d282d-c3b0-4182-93c2-3c6248c9614a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.121013 Sep 10 20:51:15.334515 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 407/851] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:15 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:51:15.407918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e0806b8-647c-476c-8355-c20b7ac0a339 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:15.408778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5e0806b8-647c-476c-8355-c20b7ac0a339 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:15.415833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e0806b8-647c-476c-8355-c20b7ac0a339 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.416587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e0806b8-647c-476c-8355-c20b7ac0a339 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.416962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e0806b8-647c-476c-8355-c20b7ac0a339 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.417951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e0806b8-647c-476c-8355-c20b7ac0a339 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.418632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e0806b8-647c-476c-8355-c20b7ac0a339 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.419310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e0806b8-647c-476c-8355-c20b7ac0a339 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.556773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5e0806b8-647c-476c-8355-c20b7ac0a339 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:15.565534 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5e0806b8-647c-476c-8355-c20b7ac0a339 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1313 microversion: 2.1 time: 0.161432 Sep 10 20:51:15.567051 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 445/852] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:15 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:15.656108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7154adad-cb8e-4bc5-b550-aa9d20e02f49 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:15.656820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7154adad-cb8e-4bc5-b550-aa9d20e02f49 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:15.662930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:15.664500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7154adad-cb8e-4bc5-b550-aa9d20e02f49 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.665077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7154adad-cb8e-4bc5-b550-aa9d20e02f49 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.665517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7154adad-cb8e-4bc5-b550-aa9d20e02f49 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.666281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7154adad-cb8e-4bc5-b550-aa9d20e02f49 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.666768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7154adad-cb8e-4bc5-b550-aa9d20e02f49 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.667313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7154adad-cb8e-4bc5-b550-aa9d20e02f49 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.734384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5cf0557f-e80c-4c74-8887-fdca5d8dcf8c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:15.735002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5cf0557f-e80c-4c74-8887-fdca5d8dcf8c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:15.743293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf0557f-e80c-4c74-8887-fdca5d8dcf8c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.743781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf0557f-e80c-4c74-8887-fdca5d8dcf8c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.744279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf0557f-e80c-4c74-8887-fdca5d8dcf8c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.745038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf0557f-e80c-4c74-8887-fdca5d8dcf8c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.745438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf0557f-e80c-4c74-8887-fdca5d8dcf8c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.745888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf0557f-e80c-4c74-8887-fdca5d8dcf8c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.889659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7154adad-cb8e-4bc5-b550-aa9d20e02f49 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:15.897164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5cf0557f-e80c-4c74-8887-fdca5d8dcf8c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:15.899199 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7154adad-cb8e-4bc5-b550-aa9d20e02f49 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1472 microversion: 2.1 time: 0.249591 Sep 10 20:51:15.899938 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 408/853] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:15 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:15.906977 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5cf0557f-e80c-4c74-8887-fdca5d8dcf8c tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.176646 Sep 10 20:51:15.907635 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 446/854] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:15 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:15.921250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be57ae4e-95af-42e2-8da2-549417282355 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:15.921900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-be57ae4e-95af-42e2-8da2-549417282355 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:15.928146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be57ae4e-95af-42e2-8da2-549417282355 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.928687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be57ae4e-95af-42e2-8da2-549417282355 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.929158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be57ae4e-95af-42e2-8da2-549417282355 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:15.929890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be57ae4e-95af-42e2-8da2-549417282355 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:15.930384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be57ae4e-95af-42e2-8da2-549417282355 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:15.930820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be57ae4e-95af-42e2-8da2-549417282355 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.109179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3bff6213-52c7-4ac4-8675-5ef41788e1ad tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:16.109944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3bff6213-52c7-4ac4-8675-5ef41788e1ad tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:16.115357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-be57ae4e-95af-42e2-8da2-549417282355 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:16.117452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bff6213-52c7-4ac4-8675-5ef41788e1ad tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.118271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bff6213-52c7-4ac4-8675-5ef41788e1ad tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.118838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bff6213-52c7-4ac4-8675-5ef41788e1ad tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.119735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bff6213-52c7-4ac4-8675-5ef41788e1ad tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.120189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bff6213-52c7-4ac4-8675-5ef41788e1ad tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.120938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bff6213-52c7-4ac4-8675-5ef41788e1ad tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.123877 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be57ae4e-95af-42e2-8da2-549417282355 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.208792 Sep 10 20:51:16.138440 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 409/855] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:15 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:16.353587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:16.355666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:16.366359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.366506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3bff6213-52c7-4ac4-8675-5ef41788e1ad tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:16.366975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.367492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.368283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.368968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.369565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.385601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:16.392471 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3bff6213-52c7-4ac4-8675-5ef41788e1ad tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.286333 Sep 10 20:51:16.394869 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 447/856] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:16 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:16.467236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:16.476663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:16.478190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:16.483340 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8c6c814f-2e34-4ae2-97bf-df30d678a4a1 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.138720 Sep 10 20:51:16.485754 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 410/857] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:16 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:51:16.589256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a5e0ae1-d794-4aac-beb0-e9d4a395def7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:16.589819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2a5e0ae1-d794-4aac-beb0-e9d4a395def7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:16.598280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a5e0ae1-d794-4aac-beb0-e9d4a395def7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.598280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a5e0ae1-d794-4aac-beb0-e9d4a395def7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.598689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a5e0ae1-d794-4aac-beb0-e9d4a395def7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.599406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a5e0ae1-d794-4aac-beb0-e9d4a395def7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.599896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a5e0ae1-d794-4aac-beb0-e9d4a395def7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.600331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a5e0ae1-d794-4aac-beb0-e9d4a395def7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.758747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2a5e0ae1-d794-4aac-beb0-e9d4a395def7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:16.767220 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2a5e0ae1-d794-4aac-beb0-e9d4a395def7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1313 microversion: 2.1 time: 0.182222 Sep 10 20:51:16.767809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 448/858] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:16 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:16.890793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d865228f-232e-4e91-b262-8df097e12654 req-f406c039-44ad-4861-8c9a-d7d299144b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b48c2d1-e818-4a83-aa7b-768175ba35b8", "name": "network-vif-plugged", "status": "completed", "tag": "f494147e-3b49-449c-9f1e-ac1f6ad6afd7"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:16.903519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d865228f-232e-4e91-b262-8df097e12654 req-f406c039-44ad-4861-8c9a-d7d299144b1f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.904051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d865228f-232e-4e91-b262-8df097e12654 req-f406c039-44ad-4861-8c9a-d7d299144b1f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.904484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d865228f-232e-4e91-b262-8df097e12654 req-f406c039-44ad-4861-8c9a-d7d299144b1f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.920117 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d865228f-232e-4e91-b262-8df097e12654 req-f406c039-44ad-4861-8c9a-d7d299144b1f service nova] Creating event network-vif-plugged:f494147e-3b49-449c-9f1e-ac1f6ad6afd7 for instance 3b48c2d1-e818-4a83-aa7b-768175ba35b8 on nch1-master-1 Sep 10 20:51:16.925750 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d865228f-232e-4e91-b262-8df097e12654 req-f406c039-44ad-4861-8c9a-d7d299144b1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038352 Sep 10 20:51:16.927886 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 411/859] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:16.929745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f487ce73-b2da-45f7-97ed-f466593b9757 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:16.930511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f487ce73-b2da-45f7-97ed-f466593b9757 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:16.934133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3607df1c-141d-4441-9ec5-4d9f9a1b9cae tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:16.935042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3607df1c-141d-4441-9ec5-4d9f9a1b9cae tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:16.939606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f487ce73-b2da-45f7-97ed-f466593b9757 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.940480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f487ce73-b2da-45f7-97ed-f466593b9757 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.941988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f487ce73-b2da-45f7-97ed-f466593b9757 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.943379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3607df1c-141d-4441-9ec5-4d9f9a1b9cae tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.943664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f487ce73-b2da-45f7-97ed-f466593b9757 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.944206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3607df1c-141d-4441-9ec5-4d9f9a1b9cae tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.944345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f487ce73-b2da-45f7-97ed-f466593b9757 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.944965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3607df1c-141d-4441-9ec5-4d9f9a1b9cae tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.945858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3607df1c-141d-4441-9ec5-4d9f9a1b9cae tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:16.945977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f487ce73-b2da-45f7-97ed-f466593b9757 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:16.946568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3607df1c-141d-4441-9ec5-4d9f9a1b9cae tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:16.947145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3607df1c-141d-4441-9ec5-4d9f9a1b9cae tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:17.184815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f487ce73-b2da-45f7-97ed-f466593b9757 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:17.193766 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f487ce73-b2da-45f7-97ed-f466593b9757 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1472 microversion: 2.1 time: 0.273542 Sep 10 20:51:17.195116 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 449/860] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:16 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:17.200289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab7651be-ef45-4561-b221-1a542f69d223 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:17.201156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ab7651be-ef45-4561-b221-1a542f69d223 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:17.208729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab7651be-ef45-4561-b221-1a542f69d223 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:17.209582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab7651be-ef45-4561-b221-1a542f69d223 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:17.210473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab7651be-ef45-4561-b221-1a542f69d223 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:17.211412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab7651be-ef45-4561-b221-1a542f69d223 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:17.212219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab7651be-ef45-4561-b221-1a542f69d223 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:17.212901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab7651be-ef45-4561-b221-1a542f69d223 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:17.343395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3607df1c-141d-4441-9ec5-4d9f9a1b9cae tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:17.352956 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3607df1c-141d-4441-9ec5-4d9f9a1b9cae tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.423518 Sep 10 20:51:17.353559 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 412/861] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:16 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:17.358079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e398ac16-8361-43c5-866e-f6115974c793 req-c92220f0-fb30-456b-8d38-caaec30ffdab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd11ff4-6dda-414d-ab81-111f4762df68", "tag": "b0683ab4-3a9c-4ccd-816b-b8815b507ac5"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:17.365312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab7651be-ef45-4561-b221-1a542f69d223 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:17.375023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e398ac16-8361-43c5-866e-f6115974c793 req-c92220f0-fb30-456b-8d38-caaec30ffdab service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:17.375510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e398ac16-8361-43c5-866e-f6115974c793 req-c92220f0-fb30-456b-8d38-caaec30ffdab service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:17.375944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e398ac16-8361-43c5-866e-f6115974c793 req-c92220f0-fb30-456b-8d38-caaec30ffdab service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:17.376674 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab7651be-ef45-4561-b221-1a542f69d223 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.180183 Sep 10 20:51:17.385986 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 450/862] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:17 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:17.388948 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e398ac16-8361-43c5-866e-f6115974c793 req-c92220f0-fb30-456b-8d38-caaec30ffdab service nova] Creating event network-changed:b0683ab4-3a9c-4ccd-816b-b8815b507ac5 for instance 3cd11ff4-6dda-414d-ab81-111f4762df68 on nch2-master-1 Sep 10 20:51:17.393815 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e398ac16-8361-43c5-866e-f6115974c793 req-c92220f0-fb30-456b-8d38-caaec30ffdab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039123 Sep 10 20:51:17.397324 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 413/863] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:17.419542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f0b5ff1e-d13c-476c-aca3-34ebfeaf6e26 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:17.420475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f0b5ff1e-d13c-476c-aca3-34ebfeaf6e26 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:17.427439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0b5ff1e-d13c-476c-aca3-34ebfeaf6e26 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:17.428000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0b5ff1e-d13c-476c-aca3-34ebfeaf6e26 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:17.428759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0b5ff1e-d13c-476c-aca3-34ebfeaf6e26 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:17.429472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0b5ff1e-d13c-476c-aca3-34ebfeaf6e26 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:17.429958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0b5ff1e-d13c-476c-aca3-34ebfeaf6e26 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:17.430390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0b5ff1e-d13c-476c-aca3-34ebfeaf6e26 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:17.514084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:17.515633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:17.523729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:17.524228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:17.524872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:17.526018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:17.526521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:17.526958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:17.617691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:17.637691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:17.639989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:17.650542 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bfbccfb5-4a57-4380-ba54-cfec641cde54 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.141741 Sep 10 20:51:17.652239 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 414/864] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:17 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:51:17.687623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f0b5ff1e-d13c-476c-aca3-34ebfeaf6e26 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:17.700262 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f0b5ff1e-d13c-476c-aca3-34ebfeaf6e26 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.285074 Sep 10 20:51:17.702080 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 451/865] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:17 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:17.791979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-26078938-9009-4200-9ccc-50643e9774a2 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:17.792588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-26078938-9009-4200-9ccc-50643e9774a2 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:17.798913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26078938-9009-4200-9ccc-50643e9774a2 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:17.799398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26078938-9009-4200-9ccc-50643e9774a2 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:17.799836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26078938-9009-4200-9ccc-50643e9774a2 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:17.802150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26078938-9009-4200-9ccc-50643e9774a2 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:17.802609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26078938-9009-4200-9ccc-50643e9774a2 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:17.803037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26078938-9009-4200-9ccc-50643e9774a2 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:17.963965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-26078938-9009-4200-9ccc-50643e9774a2 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:17.973803 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-26078938-9009-4200-9ccc-50643e9774a2 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1313 microversion: 2.1 time: 0.185509 Sep 10 20:51:17.982431 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 415/866] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:17 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:18.223504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d3658142-e081-4d37-8dd6-9bd0f7056271 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:18.224739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d3658142-e081-4d37-8dd6-9bd0f7056271 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:18.231534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3658142-e081-4d37-8dd6-9bd0f7056271 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.232033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3658142-e081-4d37-8dd6-9bd0f7056271 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.232478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3658142-e081-4d37-8dd6-9bd0f7056271 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.233209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3658142-e081-4d37-8dd6-9bd0f7056271 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.233666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3658142-e081-4d37-8dd6-9bd0f7056271 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.234304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3658142-e081-4d37-8dd6-9bd0f7056271 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.388698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d80b4baf-2c2d-40a3-a8e3-df6d32e2a712 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:18.389515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d80b4baf-2c2d-40a3-a8e3-df6d32e2a712 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:18.403728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d80b4baf-2c2d-40a3-a8e3-df6d32e2a712 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.404235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d80b4baf-2c2d-40a3-a8e3-df6d32e2a712 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.407096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d80b4baf-2c2d-40a3-a8e3-df6d32e2a712 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.408606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d80b4baf-2c2d-40a3-a8e3-df6d32e2a712 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.409272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d80b4baf-2c2d-40a3-a8e3-df6d32e2a712 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.410508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d80b4baf-2c2d-40a3-a8e3-df6d32e2a712 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.625121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d80b4baf-2c2d-40a3-a8e3-df6d32e2a712 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:18.637719 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d80b4baf-2c2d-40a3-a8e3-df6d32e2a712 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.252844 Sep 10 20:51:18.638608 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 416/867] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:18 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:18.645159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21526dff-a41c-4be8-8c03-2e3ad874c01a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:18.646210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21526dff-a41c-4be8-8c03-2e3ad874c01a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:18.655785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21526dff-a41c-4be8-8c03-2e3ad874c01a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.656423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21526dff-a41c-4be8-8c03-2e3ad874c01a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.656873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21526dff-a41c-4be8-8c03-2e3ad874c01a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.657595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21526dff-a41c-4be8-8c03-2e3ad874c01a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.658093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21526dff-a41c-4be8-8c03-2e3ad874c01a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.658719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21526dff-a41c-4be8-8c03-2e3ad874c01a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.804263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d3658142-e081-4d37-8dd6-9bd0f7056271 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:18.814856 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d3658142-e081-4d37-8dd6-9bd0f7056271 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1472 microversion: 2.1 time: 0.595573 Sep 10 20:51:18.829110 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 452/868] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:18 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1472 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:18.835646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:18.836357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:18.842551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.843037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.843465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.844170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.844624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.845160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.850209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-21526dff-a41c-4be8-8c03-2e3ad874c01a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:18.859181 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21526dff-a41c-4be8-8c03-2e3ad874c01a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.219133 Sep 10 20:51:18.859948 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 417/869] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:18 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:18.865636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cd9956fa-d078-4857-aee6-010422a71e88 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:18.866491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cd9956fa-d078-4857-aee6-010422a71e88 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:18.874240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd9956fa-d078-4857-aee6-010422a71e88 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.874751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd9956fa-d078-4857-aee6-010422a71e88 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.875198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd9956fa-d078-4857-aee6-010422a71e88 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.875926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd9956fa-d078-4857-aee6-010422a71e88 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.876384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd9956fa-d078-4857-aee6-010422a71e88 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.877001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd9956fa-d078-4857-aee6-010422a71e88 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.935424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:18.945623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:18.947384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:18.954288 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-89b82503-f369-48ec-b4a1-d04b29a7062b tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.123198 Sep 10 20:51:18.957982 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 453/870] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:18 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:18.964730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-95d3f3f1-7dd2-4d12-a1b7-8809ce1fb122 req-b6661eaa-a0c5-448c-9925-43d0bb1d825c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5578bf-977b-4757-be61-2c01715e6bc1", "name": "network-vif-plugged", "status": "completed", "tag": "37119462-c12f-44dd-836b-816fdfd2bce0"}, {"server_uuid": "7e5578bf-977b-4757-be61-2c01715e6bc1", "name": "network-vif-plugged", "status": "completed", "tag": "6db07566-c5ac-4fcb-9d35-209f1d7290d6"}, {"server_uuid": "7e5578bf-977b-4757-be61-2c01715e6bc1", "name": "network-vif-plugged", "status": "completed", "tag": "80e2a60f-8b6c-4781-907c-f4c05c172375"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:18.975819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-95d3f3f1-7dd2-4d12-a1b7-8809ce1fb122 req-b6661eaa-a0c5-448c-9925-43d0bb1d825c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:18.976549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-95d3f3f1-7dd2-4d12-a1b7-8809ce1fb122 req-b6661eaa-a0c5-448c-9925-43d0bb1d825c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:18.977165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-95d3f3f1-7dd2-4d12-a1b7-8809ce1fb122 req-b6661eaa-a0c5-448c-9925-43d0bb1d825c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:18.998342 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-95d3f3f1-7dd2-4d12-a1b7-8809ce1fb122 req-b6661eaa-a0c5-448c-9925-43d0bb1d825c service nova] Creating event network-vif-plugged:37119462-c12f-44dd-836b-816fdfd2bce0 for instance 7e5578bf-977b-4757-be61-2c01715e6bc1 on nch2-master-1 Sep 10 20:51:18.998965 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-95d3f3f1-7dd2-4d12-a1b7-8809ce1fb122 req-b6661eaa-a0c5-448c-9925-43d0bb1d825c service nova] Creating event network-vif-plugged:6db07566-c5ac-4fcb-9d35-209f1d7290d6 for instance 7e5578bf-977b-4757-be61-2c01715e6bc1 on nch2-master-1 Sep 10 20:51:18.999596 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-95d3f3f1-7dd2-4d12-a1b7-8809ce1fb122 req-b6661eaa-a0c5-448c-9925-43d0bb1d825c service nova] Creating event network-vif-plugged:80e2a60f-8b6c-4781-907c-f4c05c172375 for instance 7e5578bf-977b-4757-be61-2c01715e6bc1 on nch2-master-1 Sep 10 20:51:19.006019 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-95d3f3f1-7dd2-4d12-a1b7-8809ce1fb122 req-b6661eaa-a0c5-448c-9925-43d0bb1d825c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.045041 Sep 10 20:51:19.007071 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 454/871] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:51:19.013918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bc588cf8-5b34-48c1-8cc5-b966c91c6411 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:19.014870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bc588cf8-5b34-48c1-8cc5-b966c91c6411 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:19.021317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc588cf8-5b34-48c1-8cc5-b966c91c6411 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.022059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc588cf8-5b34-48c1-8cc5-b966c91c6411 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.022676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc588cf8-5b34-48c1-8cc5-b966c91c6411 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.023565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc588cf8-5b34-48c1-8cc5-b966c91c6411 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.024194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc588cf8-5b34-48c1-8cc5-b966c91c6411 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.024781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc588cf8-5b34-48c1-8cc5-b966c91c6411 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.040672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cd9956fa-d078-4857-aee6-010422a71e88 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:19.062596 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cd9956fa-d078-4857-aee6-010422a71e88 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.201274 Sep 10 20:51:19.063182 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 418/872] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:18 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:19.227447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc588cf8-5b34-48c1-8cc5-b966c91c6411 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:19.235286 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bc588cf8-5b34-48c1-8cc5-b966c91c6411 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1463 microversion: 2.1 time: 0.226872 Sep 10 20:51:19.235911 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 455/873] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:19 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1463 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:19.310083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b368bb3c-0155-4d70-825c-3b429b25c10b tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Calling method '.version_select at 0x7f9944c041f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:19.321486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b368bb3c-0155-4d70-825c-3b429b25c10b tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.321996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b368bb3c-0155-4d70-825c-3b429b25c10b tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.322426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b368bb3c-0155-4d70-825c-3b429b25c10b tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.339852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b368bb3c-0155-4d70-825c-3b429b25c10b tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.340350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b368bb3c-0155-4d70-825c-3b429b25c10b tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.340811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b368bb3c-0155-4d70-825c-3b429b25c10b tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.358614 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b368bb3c-0155-4d70-825c-3b429b25c10b tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/4f60e45cf4604d9497f253f7bb1e3e71?start=2022-09-09T20%3A51%3A19.251463&end=2022-09-11T20%3A51%3A19.251463" status: 200 len: 695 microversion: 2.1 time: 0.103584 Sep 10 20:51:19.359186 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 419/874] 10.222.0.33 () {58 vars in 1412 bytes} [Sat Sep 10 20:51:19 2022] GET /compute/v2.1/os-simple-tenant-usage/4f60e45cf4604d9497f253f7bb1e3e71?start=2022-09-09T20%3A51%3A19.251463&end=2022-09-11T20%3A51%3A19.251463 => generated 695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:19.375439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9382ef56-8ff6-44fa-afa4-3c0ff6b93111 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '.version_select at 0x7f9944e51f70>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:19.386695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9382ef56-8ff6-44fa-afa4-3c0ff6b93111 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.387174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9382ef56-8ff6-44fa-afa4-3c0ff6b93111 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.387629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9382ef56-8ff6-44fa-afa4-3c0ff6b93111 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.404685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9382ef56-8ff6-44fa-afa4-3c0ff6b93111 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.405152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9382ef56-8ff6-44fa-afa4-3c0ff6b93111 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.405580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9382ef56-8ff6-44fa-afa4-3c0ff6b93111 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.422369 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9382ef56-8ff6-44fa-afa4-3c0ff6b93111 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/4f60e45cf4604d9497f253f7bb1e3e71?start=2022-09-09T20%3A51%3A19.251463&end=2022-09-11T20%3A51%3A19.251463" status: 200 len: 694 microversion: 2.1 time: 0.050949 Sep 10 20:51:19.422920 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 456/875] 10.222.0.33 () {58 vars in 1412 bytes} [Sat Sep 10 20:51:19 2022] GET /compute/v2.1/os-simple-tenant-usage/4f60e45cf4604d9497f253f7bb1e3e71?start=2022-09-09T20%3A51%3A19.251463&end=2022-09-11T20%3A51%3A19.251463 => generated 694 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:19.437148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7f82e8f0-df15-4d6d-8f47-95aa6ee132ff tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Calling method '.version_select at 0x7f9944bc0700>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:19.446555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f82e8f0-df15-4d6d-8f47-95aa6ee132ff tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.447028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f82e8f0-df15-4d6d-8f47-95aa6ee132ff tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.447456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f82e8f0-df15-4d6d-8f47-95aa6ee132ff tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.464365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f82e8f0-df15-4d6d-8f47-95aa6ee132ff tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.464839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f82e8f0-df15-4d6d-8f47-95aa6ee132ff tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.465973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f82e8f0-df15-4d6d-8f47-95aa6ee132ff tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.514439 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7f82e8f0-df15-4d6d-8f47-95aa6ee132ff tempest-TenantUsagesTestJSON-168234823 tempest-TenantUsagesTestJSON-168234823-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T20%3A51%3A19.251463&end=2022-09-11T20%3A51%3A19.251463&detailed=1" status: 200 len: 10984 microversion: 2.1 time: 0.080920 Sep 10 20:51:19.515044 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 420/876] 10.222.0.33 () {58 vars in 1335 bytes} [Sat Sep 10 20:51:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T20%3A51%3A19.251463&end=2022-09-11T20%3A51%3A19.251463&detailed=1 => generated 10984 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:51:19.539795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-070f873b-e314-4309-81ef-13f87bfb3414 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:19.540288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-070f873b-e314-4309-81ef-13f87bfb3414 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:19.546150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-070f873b-e314-4309-81ef-13f87bfb3414 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.546632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-070f873b-e314-4309-81ef-13f87bfb3414 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.547065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-070f873b-e314-4309-81ef-13f87bfb3414 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.547754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-070f873b-e314-4309-81ef-13f87bfb3414 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.548204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-070f873b-e314-4309-81ef-13f87bfb3414 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.548624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-070f873b-e314-4309-81ef-13f87bfb3414 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.574086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-070f873b-e314-4309-81ef-13f87bfb3414 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:51:19.635834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:19.655691 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-070f873b-e314-4309-81ef-13f87bfb3414 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 204 len: 0 microversion: 2.1 time: 0.120139 Sep 10 20:51:19.656636 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 457/877] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:51:19 2022] DELETE /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:51:19.662407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-478af395-3a8d-42a7-8e48-42a1ccc72aa3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:19.663026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-478af395-3a8d-42a7-8e48-42a1ccc72aa3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:19.666739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b9f760bd-b297-4c5f-9da9-9a45459ec62f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:19.667431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b9f760bd-b297-4c5f-9da9-9a45459ec62f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:19.669097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-478af395-3a8d-42a7-8e48-42a1ccc72aa3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.669583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-478af395-3a8d-42a7-8e48-42a1ccc72aa3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.670049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-478af395-3a8d-42a7-8e48-42a1ccc72aa3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.670747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-478af395-3a8d-42a7-8e48-42a1ccc72aa3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.671202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-478af395-3a8d-42a7-8e48-42a1ccc72aa3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.671627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-478af395-3a8d-42a7-8e48-42a1ccc72aa3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.673455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9f760bd-b297-4c5f-9da9-9a45459ec62f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.673969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9f760bd-b297-4c5f-9da9-9a45459ec62f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.674398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9f760bd-b297-4c5f-9da9-9a45459ec62f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.675133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9f760bd-b297-4c5f-9da9-9a45459ec62f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.675789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9f760bd-b297-4c5f-9da9-9a45459ec62f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.676397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9f760bd-b297-4c5f-9da9-9a45459ec62f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.812174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b9f760bd-b297-4c5f-9da9-9a45459ec62f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:19.817383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-478af395-3a8d-42a7-8e48-42a1ccc72aa3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:19.821027 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b9f760bd-b297-4c5f-9da9-9a45459ec62f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1469 microversion: 2.1 time: 0.158350 Sep 10 20:51:19.821614 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 458/878] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:19 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:19.825934 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-478af395-3a8d-42a7-8e48-42a1ccc72aa3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1354 microversion: 2.1 time: 0.167906 Sep 10 20:51:19.826337 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 421/879] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:19 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:19.838586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-630c2450-1fba-426b-a01d-3d8e489a4549 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:19.839315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-630c2450-1fba-426b-a01d-3d8e489a4549 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:19.845121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630c2450-1fba-426b-a01d-3d8e489a4549 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.845600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630c2450-1fba-426b-a01d-3d8e489a4549 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.846334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630c2450-1fba-426b-a01d-3d8e489a4549 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.847080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630c2450-1fba-426b-a01d-3d8e489a4549 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.847874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630c2450-1fba-426b-a01d-3d8e489a4549 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.848313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630c2450-1fba-426b-a01d-3d8e489a4549 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.883633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8a452653-7f6e-4714-8221-7daddf8e498d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:19.884447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8a452653-7f6e-4714-8221-7daddf8e498d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:19.890538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a452653-7f6e-4714-8221-7daddf8e498d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.891020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a452653-7f6e-4714-8221-7daddf8e498d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.891456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a452653-7f6e-4714-8221-7daddf8e498d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.892149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a452653-7f6e-4714-8221-7daddf8e498d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:19.892609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a452653-7f6e-4714-8221-7daddf8e498d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:19.893055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a452653-7f6e-4714-8221-7daddf8e498d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:19.984501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-630c2450-1fba-426b-a01d-3d8e489a4549 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:19.992651 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-630c2450-1fba-426b-a01d-3d8e489a4549 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.157902 Sep 10 20:51:19.993245 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 459/880] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:19 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:19.997819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:19.998394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:20.004912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:20.005403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:20.005853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:20.006557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:20.007017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:20.007444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:20.037966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8a452653-7f6e-4714-8221-7daddf8e498d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:20.045729 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8a452653-7f6e-4714-8221-7daddf8e498d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.166039 Sep 10 20:51:20.046399 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 422/881] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:19 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:20.071530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:20.081089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:20.083360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:20.086232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-635f5bde-7281-4cf0-b987-d5f86cb8145c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:20.086863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-635f5bde-7281-4cf0-b987-d5f86cb8145c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:20.088598 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4867f2b1-e06b-45f4-8aac-dfc659243eea tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.094369 Sep 10 20:51:20.089182 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 460/882] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:19 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:20.092784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-635f5bde-7281-4cf0-b987-d5f86cb8145c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:20.093266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-635f5bde-7281-4cf0-b987-d5f86cb8145c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:20.093698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-635f5bde-7281-4cf0-b987-d5f86cb8145c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:20.094419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-635f5bde-7281-4cf0-b987-d5f86cb8145c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:20.094876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-635f5bde-7281-4cf0-b987-d5f86cb8145c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:20.095300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-635f5bde-7281-4cf0-b987-d5f86cb8145c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:20.229003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-635f5bde-7281-4cf0-b987-d5f86cb8145c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:20.236939 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-635f5bde-7281-4cf0-b987-d5f86cb8145c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.155252 Sep 10 20:51:20.238253 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 423/883] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:20 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:20.846437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7c3eba71-9ab1-4de3-a8c7-e35cc1a26165 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:20.847136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7c3eba71-9ab1-4de3-a8c7-e35cc1a26165 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:20.848973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-91876016-6c91-4cbb-bf4d-8040cded99c7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:20.849807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-91876016-6c91-4cbb-bf4d-8040cded99c7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:20.854470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3eba71-9ab1-4de3-a8c7-e35cc1a26165 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:20.854894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3eba71-9ab1-4de3-a8c7-e35cc1a26165 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:20.855572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3eba71-9ab1-4de3-a8c7-e35cc1a26165 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:20.856292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3eba71-9ab1-4de3-a8c7-e35cc1a26165 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:20.856404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91876016-6c91-4cbb-bf4d-8040cded99c7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:20.856755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3eba71-9ab1-4de3-a8c7-e35cc1a26165 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:20.856861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91876016-6c91-4cbb-bf4d-8040cded99c7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:20.857186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91876016-6c91-4cbb-bf4d-8040cded99c7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:20.857313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3eba71-9ab1-4de3-a8c7-e35cc1a26165 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:20.857911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91876016-6c91-4cbb-bf4d-8040cded99c7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:20.858351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91876016-6c91-4cbb-bf4d-8040cded99c7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:20.858773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91876016-6c91-4cbb-bf4d-8040cded99c7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:20.866398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:20.993135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7c3eba71-9ab1-4de3-a8c7-e35cc1a26165 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:21.001617 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7c3eba71-9ab1-4de3-a8c7-e35cc1a26165 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1469 microversion: 2.1 time: 0.159630 Sep 10 20:51:21.002347 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 461/884] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:20 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:21.013174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-91876016-6c91-4cbb-bf4d-8040cded99c7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:21.016089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-519538e9-7ebb-4d63-b0d3-59f103d19bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:21.016531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-519538e9-7ebb-4d63-b0d3-59f103d19bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:21.022875 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-91876016-6c91-4cbb-bf4d-8040cded99c7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1804 microversion: 2.1 time: 0.178338 Sep 10 20:51:21.023460 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 424/885] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:20 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1804 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:21.023609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-519538e9-7ebb-4d63-b0d3-59f103d19bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.023965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-519538e9-7ebb-4d63-b0d3-59f103d19bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.024397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-519538e9-7ebb-4d63-b0d3-59f103d19bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.025084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-519538e9-7ebb-4d63-b0d3-59f103d19bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.025706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-519538e9-7ebb-4d63-b0d3-59f103d19bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.026167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-519538e9-7ebb-4d63-b0d3-59f103d19bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.028517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-77ef335b-9316-4a5f-ba43-b42da00a1dcb req-3c4b00ca-2bba-497a-bef0-9535d891cc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6b8ddf-a7d9-4698-9bb8-159ce02769dc", "name": "network-vif-plugged", "status": "completed", "tag": "6cd39c03-2619-4e42-b3c9-3bc146a98c89"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:21.038823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-77ef335b-9316-4a5f-ba43-b42da00a1dcb req-3c4b00ca-2bba-497a-bef0-9535d891cc8f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.039303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-77ef335b-9316-4a5f-ba43-b42da00a1dcb req-3c4b00ca-2bba-497a-bef0-9535d891cc8f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.039777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-77ef335b-9316-4a5f-ba43-b42da00a1dcb req-3c4b00ca-2bba-497a-bef0-9535d891cc8f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.051074 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-77ef335b-9316-4a5f-ba43-b42da00a1dcb req-3c4b00ca-2bba-497a-bef0-9535d891cc8f service nova] Creating event network-vif-plugged:6cd39c03-2619-4e42-b3c9-3bc146a98c89 for instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc on nch1-master-1 Sep 10 20:51:21.055936 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-77ef335b-9316-4a5f-ba43-b42da00a1dcb req-3c4b00ca-2bba-497a-bef0-9535d891cc8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030921 Sep 10 20:51:21.056527 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 425/886] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:21.061443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-95463e7b-be8b-4bc6-99c3-a54e39538442 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:21.062050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-95463e7b-be8b-4bc6-99c3-a54e39538442 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:21.068464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95463e7b-be8b-4bc6-99c3-a54e39538442 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.068955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95463e7b-be8b-4bc6-99c3-a54e39538442 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.069391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95463e7b-be8b-4bc6-99c3-a54e39538442 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.070120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95463e7b-be8b-4bc6-99c3-a54e39538442 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.070578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95463e7b-be8b-4bc6-99c3-a54e39538442 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.071002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95463e7b-be8b-4bc6-99c3-a54e39538442 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.097588 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-95463e7b-be8b-4bc6-99c3-a54e39538442 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1/ips" status: 200 len: 218 microversion: 2.1 time: 0.039318 Sep 10 20:51:21.098239 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 426/887] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 20:51:21 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1/ips => generated 218 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:21.102599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1d96c3c-9e9f-43f4-bbf0-57515d31b6a7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:21.103209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e1d96c3c-9e9f-43f4-bbf0-57515d31b6a7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:21.109072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d96c3c-9e9f-43f4-bbf0-57515d31b6a7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.109488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d96c3c-9e9f-43f4-bbf0-57515d31b6a7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.109951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d96c3c-9e9f-43f4-bbf0-57515d31b6a7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.110655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d96c3c-9e9f-43f4-bbf0-57515d31b6a7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.111105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d96c3c-9e9f-43f4-bbf0-57515d31b6a7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.111724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1d96c3c-9e9f-43f4-bbf0-57515d31b6a7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.169759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-519538e9-7ebb-4d63-b0d3-59f103d19bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:21.177741 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-519538e9-7ebb-4d63-b0d3-59f103d19bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.165393 Sep 10 20:51:21.178366 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 462/888] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:21 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:21.183453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f76985dc-6fef-411d-a7bc-84bcd736d527 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:21.184162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f76985dc-6fef-411d-a7bc-84bcd736d527 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:21.190766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f76985dc-6fef-411d-a7bc-84bcd736d527 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.191600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f76985dc-6fef-411d-a7bc-84bcd736d527 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.192317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f76985dc-6fef-411d-a7bc-84bcd736d527 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.203294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f76985dc-6fef-411d-a7bc-84bcd736d527 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.203801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f76985dc-6fef-411d-a7bc-84bcd736d527 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.204248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f76985dc-6fef-411d-a7bc-84bcd736d527 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.231495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f76985dc-6fef-411d-a7bc-84bcd736d527 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:51:21.245874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:21.258351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1d96c3c-9e9f-43f4-bbf0-57515d31b6a7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:21.266637 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1d96c3c-9e9f-43f4-bbf0-57515d31b6a7 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.167402 Sep 10 20:51:21.269898 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 427/889] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:21 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:21.274154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:21.275286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:21.281188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.281782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.282422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.283220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.283770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.284302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.312678 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f76985dc-6fef-411d-a7bc-84bcd736d527 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 204 len: 0 microversion: 2.1 time: 0.132691 Sep 10 20:51:21.313446 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 463/890] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:51:21 2022] DELETE /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:51:21.320313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38c228ec-3cb7-4c1b-88ff-8fbf21b1a645 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:21.321163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38c228ec-3cb7-4c1b-88ff-8fbf21b1a645 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:21.327504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c228ec-3cb7-4c1b-88ff-8fbf21b1a645 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.328017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c228ec-3cb7-4c1b-88ff-8fbf21b1a645 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.328449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c228ec-3cb7-4c1b-88ff-8fbf21b1a645 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.329148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c228ec-3cb7-4c1b-88ff-8fbf21b1a645 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.329603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c228ec-3cb7-4c1b-88ff-8fbf21b1a645 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.330101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c228ec-3cb7-4c1b-88ff-8fbf21b1a645 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.355412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:21.364003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:21.365396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:21.370425 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3edad427-a090-4fca-947b-4747c868e148 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.102112 Sep 10 20:51:21.371007 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 428/891] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:21 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:21.375561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-570ebce8-b173-4ded-ae40-5e10e020e853 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:21.376204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-570ebce8-b173-4ded-ae40-5e10e020e853 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:21.382912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-570ebce8-b173-4ded-ae40-5e10e020e853 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.383396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-570ebce8-b173-4ded-ae40-5e10e020e853 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.383841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-570ebce8-b173-4ded-ae40-5e10e020e853 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.384549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-570ebce8-b173-4ded-ae40-5e10e020e853 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:21.385010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-570ebce8-b173-4ded-ae40-5e10e020e853 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:21.385441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-570ebce8-b173-4ded-ae40-5e10e020e853 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:21.475326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38c228ec-3cb7-4c1b-88ff-8fbf21b1a645 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:21.483108 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38c228ec-3cb7-4c1b-88ff-8fbf21b1a645 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.168321 Sep 10 20:51:21.483696 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 464/892] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:21 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:21.650691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-570ebce8-b173-4ded-ae40-5e10e020e853 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:21.658489 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-570ebce8-b173-4ded-ae40-5e10e020e853 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1810 microversion: 2.1 time: 0.286487 Sep 10 20:51:21.659070 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 429/893] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:21 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1810 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:22.026710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dc2fa373-3985-4ea0-91e7-cab55ed62ba7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:22.028107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dc2fa373-3985-4ea0-91e7-cab55ed62ba7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:22.041361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-821386ef-147a-43a0-9986-a6a142f5a2c9 req-c4fd582d-0a2e-4c0b-8076-7708fd056677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b48c2d1-e818-4a83-aa7b-768175ba35b8", "name": "network-vif-deleted", "tag": "f494147e-3b49-449c-9f1e-ac1f6ad6afd7"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:22.043621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc2fa373-3985-4ea0-91e7-cab55ed62ba7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.044129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc2fa373-3985-4ea0-91e7-cab55ed62ba7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.044687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc2fa373-3985-4ea0-91e7-cab55ed62ba7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.045376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc2fa373-3985-4ea0-91e7-cab55ed62ba7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.047098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc2fa373-3985-4ea0-91e7-cab55ed62ba7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.047581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc2fa373-3985-4ea0-91e7-cab55ed62ba7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.056059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-821386ef-147a-43a0-9986-a6a142f5a2c9 req-c4fd582d-0a2e-4c0b-8076-7708fd056677 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.056558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-821386ef-147a-43a0-9986-a6a142f5a2c9 req-c4fd582d-0a2e-4c0b-8076-7708fd056677 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.056956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-821386ef-147a-43a0-9986-a6a142f5a2c9 req-c4fd582d-0a2e-4c0b-8076-7708fd056677 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.069195 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-821386ef-147a-43a0-9986-a6a142f5a2c9 req-c4fd582d-0a2e-4c0b-8076-7708fd056677 service nova] Creating event network-vif-deleted:f494147e-3b49-449c-9f1e-ac1f6ad6afd7 for instance 3b48c2d1-e818-4a83-aa7b-768175ba35b8 on nch1-master-1 Sep 10 20:51:22.074197 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-821386ef-147a-43a0-9986-a6a142f5a2c9 req-c4fd582d-0a2e-4c0b-8076-7708fd056677 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036749 Sep 10 20:51:22.074807 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 430/894] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:22.129210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dc2fa373-3985-4ea0-91e7-cab55ed62ba7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:22.137329 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dc2fa373-3985-4ea0-91e7-cab55ed62ba7 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1427 microversion: 2.1 time: 0.115955 Sep 10 20:51:22.137935 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 465/895] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:22 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:22.202642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c6e3200f-c475-42ea-b8ed-f395613f85c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:22.203264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c6e3200f-c475-42ea-b8ed-f395613f85c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:22.209630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6e3200f-c475-42ea-b8ed-f395613f85c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.210146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6e3200f-c475-42ea-b8ed-f395613f85c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.210578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6e3200f-c475-42ea-b8ed-f395613f85c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.211261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6e3200f-c475-42ea-b8ed-f395613f85c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.211711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6e3200f-c475-42ea-b8ed-f395613f85c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.212163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6e3200f-c475-42ea-b8ed-f395613f85c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.291632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bdf7a71e-5e4f-4d77-82f4-2437235087f4 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:22.292160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bdf7a71e-5e4f-4d77-82f4-2437235087f4 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:22.298248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7a71e-5e4f-4d77-82f4-2437235087f4 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.298715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7a71e-5e4f-4d77-82f4-2437235087f4 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.299149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7a71e-5e4f-4d77-82f4-2437235087f4 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.299843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7a71e-5e4f-4d77-82f4-2437235087f4 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.300914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7a71e-5e4f-4d77-82f4-2437235087f4 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.301344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7a71e-5e4f-4d77-82f4-2437235087f4 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.348080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c6e3200f-c475-42ea-b8ed-f395613f85c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:22.356610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c6e3200f-c475-42ea-b8ed-f395613f85c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.158305 Sep 10 20:51:22.361167 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 431/896] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:22 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:22.400742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:22.401505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:22.407712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.408193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.408627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.409346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.410463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.410891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.434447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bdf7a71e-5e4f-4d77-82f4-2437235087f4 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:22.442631 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bdf7a71e-5e4f-4d77-82f4-2437235087f4 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.154833 Sep 10 20:51:22.443298 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 466/897] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:22 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:22.475621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:22.483709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:22.485149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:22.490267 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-31fc3a93-e244-4de1-aeca-065bb93c657a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.093402 Sep 10 20:51:22.490832 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 432/898] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:22 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:22.506117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5122d6f7-0d62-4f23-8797-f1f3ee232916 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:22.506730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5122d6f7-0d62-4f23-8797-f1f3ee232916 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:22.512910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5122d6f7-0d62-4f23-8797-f1f3ee232916 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.513415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5122d6f7-0d62-4f23-8797-f1f3ee232916 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.513876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5122d6f7-0d62-4f23-8797-f1f3ee232916 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.514711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5122d6f7-0d62-4f23-8797-f1f3ee232916 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.515379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5122d6f7-0d62-4f23-8797-f1f3ee232916 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.515854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5122d6f7-0d62-4f23-8797-f1f3ee232916 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.644628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5122d6f7-0d62-4f23-8797-f1f3ee232916 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:22.652610 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5122d6f7-0d62-4f23-8797-f1f3ee232916 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1311 microversion: 2.1 time: 0.150973 Sep 10 20:51:22.653184 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 467/899] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:22 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1311 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:22.681839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cd3e356b-120e-49f3-805d-69c8461e6503 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:22.682463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cd3e356b-120e-49f3-805d-69c8461e6503 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:22.688400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd3e356b-120e-49f3-805d-69c8461e6503 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.688884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd3e356b-120e-49f3-805d-69c8461e6503 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.689318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd3e356b-120e-49f3-805d-69c8461e6503 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.690669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd3e356b-120e-49f3-805d-69c8461e6503 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:22.691318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd3e356b-120e-49f3-805d-69c8461e6503 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:22.691758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd3e356b-120e-49f3-805d-69c8461e6503 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:22.840606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cd3e356b-120e-49f3-805d-69c8461e6503 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:22.848885 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cd3e356b-120e-49f3-805d-69c8461e6503 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1810 microversion: 2.1 time: 0.170829 Sep 10 20:51:22.849456 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 433/900] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:22 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:23.160556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:23.161354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:23.167938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.168439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.168888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.169581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.170070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.170501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.206137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.206634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.207066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.207709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lazy-loading 'fault' on Instance uuid 3b48c2d1-e818-4a83-aa7b-768175ba35b8 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:51:23.284111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:23.292070 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27a72020-6a11-46a2-af81-7627fa812ba9 tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1303 microversion: 2.1 time: 0.135421 Sep 10 20:51:23.292652 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 468/901] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:23 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:23.381490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-259df42e-79bb-4352-976d-bc9bf3a066e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:23.382621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-259df42e-79bb-4352-976d-bc9bf3a066e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:23.390153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-259df42e-79bb-4352-976d-bc9bf3a066e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.390776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-259df42e-79bb-4352-976d-bc9bf3a066e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.390910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-259df42e-79bb-4352-976d-bc9bf3a066e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.391627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-259df42e-79bb-4352-976d-bc9bf3a066e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.392038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-259df42e-79bb-4352-976d-bc9bf3a066e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.392892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-259df42e-79bb-4352-976d-bc9bf3a066e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.469080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cb1fdbec-604d-4d86-9803-e2c0494715e8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:23.470032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cb1fdbec-604d-4d86-9803-e2c0494715e8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:23.476417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb1fdbec-604d-4d86-9803-e2c0494715e8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.476915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb1fdbec-604d-4d86-9803-e2c0494715e8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.477344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb1fdbec-604d-4d86-9803-e2c0494715e8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.478088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb1fdbec-604d-4d86-9803-e2c0494715e8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.478550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb1fdbec-604d-4d86-9803-e2c0494715e8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.478979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb1fdbec-604d-4d86-9803-e2c0494715e8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.545082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-259df42e-79bb-4352-976d-bc9bf3a066e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:23.556074 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-259df42e-79bb-4352-976d-bc9bf3a066e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.179432 Sep 10 20:51:23.557749 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 434/902] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:23 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:23.564217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-200cbd97-e6b2-4eff-9e7a-fe1f5dab9928 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:23.564893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-200cbd97-e6b2-4eff-9e7a-fe1f5dab9928 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:23.571530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-200cbd97-e6b2-4eff-9e7a-fe1f5dab9928 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.572016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-200cbd97-e6b2-4eff-9e7a-fe1f5dab9928 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.572448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-200cbd97-e6b2-4eff-9e7a-fe1f5dab9928 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.573145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-200cbd97-e6b2-4eff-9e7a-fe1f5dab9928 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.573595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-200cbd97-e6b2-4eff-9e7a-fe1f5dab9928 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.574037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-200cbd97-e6b2-4eff-9e7a-fe1f5dab9928 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.611047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-200cbd97-e6b2-4eff-9e7a-fe1f5dab9928 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:51:23.757844 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-200cbd97-e6b2-4eff-9e7a-fe1f5dab9928 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 204 len: 0 microversion: 2.1 time: 0.196920 Sep 10 20:51:23.758740 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 435/903] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:51:23 2022] DELETE /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:51:23.768264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:23.769364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:23.776855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.777918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.778388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.779256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.779722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.780156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.804207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cb1fdbec-604d-4d86-9803-e2c0494715e8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:23.817807 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cb1fdbec-604d-4d86-9803-e2c0494715e8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.355030 Sep 10 20:51:23.821893 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 469/904] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:23 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:23.826584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8d636c67-9032-4f1a-bf77-39f9a2919b71 req-04f7df83-8274-4c85-9a34-9440d809ae70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5578bf-977b-4757-be61-2c01715e6bc1", "name": "network-vif-deleted", "tag": "37119462-c12f-44dd-836b-816fdfd2bce0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:23.836241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8d636c67-9032-4f1a-bf77-39f9a2919b71 req-04f7df83-8274-4c85-9a34-9440d809ae70 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.836664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8d636c67-9032-4f1a-bf77-39f9a2919b71 req-04f7df83-8274-4c85-9a34-9440d809ae70 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.837099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8d636c67-9032-4f1a-bf77-39f9a2919b71 req-04f7df83-8274-4c85-9a34-9440d809ae70 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.852595 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8d636c67-9032-4f1a-bf77-39f9a2919b71 req-04f7df83-8274-4c85-9a34-9440d809ae70 service nova] Creating event network-vif-deleted:37119462-c12f-44dd-836b-816fdfd2bce0 for instance 7e5578bf-977b-4757-be61-2c01715e6bc1 on nch2-master-1 Sep 10 20:51:23.858045 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8d636c67-9032-4f1a-bf77-39f9a2919b71 req-04f7df83-8274-4c85-9a34-9440d809ae70 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034823 Sep 10 20:51:23.859185 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 470/905] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:23.867398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7dc3e193-e0bf-40c2-a37c-1ddb0632d747 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:23.867398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7dc3e193-e0bf-40c2-a37c-1ddb0632d747 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:23.872954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc3e193-e0bf-40c2-a37c-1ddb0632d747 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.873454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc3e193-e0bf-40c2-a37c-1ddb0632d747 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.873925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc3e193-e0bf-40c2-a37c-1ddb0632d747 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.874638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc3e193-e0bf-40c2-a37c-1ddb0632d747 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.875087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc3e193-e0bf-40c2-a37c-1ddb0632d747 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.875715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc3e193-e0bf-40c2-a37c-1ddb0632d747 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.884733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:23.897374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:23.899428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:23.906077 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4903c571-1973-4cbe-843c-92d34212a455 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.146079 Sep 10 20:51:23.910009 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 436/906] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:23 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:23.912394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d310c44e-3f0e-4c17-9e22-4341e2dfd29e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:23.913195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d310c44e-3f0e-4c17-9e22-4341e2dfd29e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:23.919166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d310c44e-3f0e-4c17-9e22-4341e2dfd29e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.919860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d310c44e-3f0e-4c17-9e22-4341e2dfd29e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.920408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d310c44e-3f0e-4c17-9e22-4341e2dfd29e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:23.921182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d310c44e-3f0e-4c17-9e22-4341e2dfd29e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:23.921718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d310c44e-3f0e-4c17-9e22-4341e2dfd29e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:23.922255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d310c44e-3f0e-4c17-9e22-4341e2dfd29e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.063263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d310c44e-3f0e-4c17-9e22-4341e2dfd29e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:24.071833 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d310c44e-3f0e-4c17-9e22-4341e2dfd29e tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1712 microversion: 2.1 time: 0.163996 Sep 10 20:51:24.072636 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 437/907] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:23 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1712 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:24.072772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7dc3e193-e0bf-40c2-a37c-1ddb0632d747 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:24.080546 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7dc3e193-e0bf-40c2-a37c-1ddb0632d747 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1493 microversion: 2.1 time: 0.220220 Sep 10 20:51:24.081853 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 471/908] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:23 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1493 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:24.092914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cdca052e-808b-4059-9014-243a57b7861b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:24.093526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cdca052e-808b-4059-9014-243a57b7861b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:24.101459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdca052e-808b-4059-9014-243a57b7861b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.101890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdca052e-808b-4059-9014-243a57b7861b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.102338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdca052e-808b-4059-9014-243a57b7861b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.103026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdca052e-808b-4059-9014-243a57b7861b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.103484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdca052e-808b-4059-9014-243a57b7861b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.103926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdca052e-808b-4059-9014-243a57b7861b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.104297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b01a4e55-0958-4d88-8336-df2d21be1ab5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:24.104939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b01a4e55-0958-4d88-8336-df2d21be1ab5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:24.111033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b01a4e55-0958-4d88-8336-df2d21be1ab5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.111518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b01a4e55-0958-4d88-8336-df2d21be1ab5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.112197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b01a4e55-0958-4d88-8336-df2d21be1ab5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.112685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b01a4e55-0958-4d88-8336-df2d21be1ab5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.113368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b01a4e55-0958-4d88-8336-df2d21be1ab5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.113793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b01a4e55-0958-4d88-8336-df2d21be1ab5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.243479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cdca052e-808b-4059-9014-243a57b7861b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:24.251464 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cdca052e-808b-4059-9014-243a57b7861b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1674 microversion: 2.1 time: 0.162224 Sep 10 20:51:24.252051 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 438/909] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:24 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:24.316417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:24.317147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:24.319992 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b01a4e55-0958-4d88-8336-df2d21be1ab5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1644 microversion: 2.1 time: 0.219242 Sep 10 20:51:24.320600 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 472/910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:24 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1644 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:24.325300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.326215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.326730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.327508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.328042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.328560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.343364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0695a73a-bfa8-4253-9236-6fc5cc8b7b7c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:24.344318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0695a73a-bfa8-4253-9236-6fc5cc8b7b7c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:24.369762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0695a73a-bfa8-4253-9236-6fc5cc8b7b7c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.370519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0695a73a-bfa8-4253-9236-6fc5cc8b7b7c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.371069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0695a73a-bfa8-4253-9236-6fc5cc8b7b7c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.371935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0695a73a-bfa8-4253-9236-6fc5cc8b7b7c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.372587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0695a73a-bfa8-4253-9236-6fc5cc8b7b7c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.373186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0695a73a-bfa8-4253-9236-6fc5cc8b7b7c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.393061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.393555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.394152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.394676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lazy-loading 'fault' on Instance uuid 3b48c2d1-e818-4a83-aa7b-768175ba35b8 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:51:24.443949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5c9474c1864436aa4a35057087ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60e45cf4604d9497f253f7bb1e3e71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:24.452119 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4146584e-2aae-458d-ab3a-d665b892cb5f tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 200 len: 1303 microversion: 2.1 time: 0.140289 Sep 10 20:51:24.453056 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 439/911] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:24 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:24.580543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7b7f48d0-da5d-4d7c-b788-5abf66194464 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:24.581072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7b7f48d0-da5d-4d7c-b788-5abf66194464 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:24.588586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b7f48d0-da5d-4d7c-b788-5abf66194464 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.589256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b7f48d0-da5d-4d7c-b788-5abf66194464 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.589676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b7f48d0-da5d-4d7c-b788-5abf66194464 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.590885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b7f48d0-da5d-4d7c-b788-5abf66194464 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.591001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b7f48d0-da5d-4d7c-b788-5abf66194464 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.591617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b7f48d0-da5d-4d7c-b788-5abf66194464 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.595082 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0695a73a-bfa8-4253-9236-6fc5cc8b7b7c tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1644 microversion: 2.1 time: 0.256158 Sep 10 20:51:24.598075 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 473/912] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:24 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1644 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:24.613189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:24.618582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bcea2412-72dd-4637-966a-e4eeb8ef3439 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:24.622485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcea2412-72dd-4637-966a-e4eeb8ef3439 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.622963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcea2412-72dd-4637-966a-e4eeb8ef3439 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.623395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcea2412-72dd-4637-966a-e4eeb8ef3439 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.624121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcea2412-72dd-4637-966a-e4eeb8ef3439 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.624570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcea2412-72dd-4637-966a-e4eeb8ef3439 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.624993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcea2412-72dd-4637-966a-e4eeb8ef3439 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.651437 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bcea2412-72dd-4637-966a-e4eeb8ef3439 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036369 Sep 10 20:51:24.652380 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 474/913] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Sep 10 20:51:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:24.665076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-44314f49-6556-47af-9cee-4c75fcfeed67 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:24.665974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-44314f49-6556-47af-9cee-4c75fcfeed67 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:24.672624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44314f49-6556-47af-9cee-4c75fcfeed67 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.673138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44314f49-6556-47af-9cee-4c75fcfeed67 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.673575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44314f49-6556-47af-9cee-4c75fcfeed67 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.674294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44314f49-6556-47af-9cee-4c75fcfeed67 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.674747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44314f49-6556-47af-9cee-4c75fcfeed67 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.675233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44314f49-6556-47af-9cee-4c75fcfeed67 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.743208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7b7f48d0-da5d-4d7c-b788-5abf66194464 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:24.750412 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-44314f49-6556-47af-9cee-4c75fcfeed67 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc/action" status: 202 len: 0 microversion: 2.1 time: 0.088443 Sep 10 20:51:24.751476 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 475/914] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:51:24 2022] POST /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:51:24.752385 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7b7f48d0-da5d-4d7c-b788-5abf66194464 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.175615 Sep 10 20:51:24.753205 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 440/915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:24 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:24.760485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9cc1e47-3813-4ecc-a59f-64ea553a651f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:24.761518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9cc1e47-3813-4ecc-a59f-64ea553a651f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:24.768126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9cc1e47-3813-4ecc-a59f-64ea553a651f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.768610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9cc1e47-3813-4ecc-a59f-64ea553a651f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.769759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9cc1e47-3813-4ecc-a59f-64ea553a651f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.770507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9cc1e47-3813-4ecc-a59f-64ea553a651f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.770962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9cc1e47-3813-4ecc-a59f-64ea553a651f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.771387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9cc1e47-3813-4ecc-a59f-64ea553a651f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.844823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-02c08d45-5406-4971-a88a-f647f2be75c8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:24.845552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-02c08d45-5406-4971-a88a-f647f2be75c8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:24.852845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c08d45-5406-4971-a88a-f647f2be75c8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.853339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c08d45-5406-4971-a88a-f647f2be75c8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.853777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c08d45-5406-4971-a88a-f647f2be75c8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.854513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c08d45-5406-4971-a88a-f647f2be75c8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:24.854972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c08d45-5406-4971-a88a-f647f2be75c8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:24.855403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c08d45-5406-4971-a88a-f647f2be75c8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:24.993861 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9cc1e47-3813-4ecc-a59f-64ea553a651f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1649 microversion: 2.1 time: 0.236922 Sep 10 20:51:25.004100 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 476/916] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:24 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1649 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:25.004100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:25.004100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:25.010274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.010274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.010274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.010274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.010680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.011647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.025053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-02c08d45-5406-4971-a88a-f647f2be75c8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:25.036454 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-02c08d45-5406-4971-a88a-f647f2be75c8 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.195164 Sep 10 20:51:25.045871 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 441/917] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:24 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:25.098231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-edb90cf7-a8f9-4993-938c-93ee5ff191da tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:25.098863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-edb90cf7-a8f9-4993-938c-93ee5ff191da tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:25.103483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:25.105377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb90cf7-a8f9-4993-938c-93ee5ff191da tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.105897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb90cf7-a8f9-4993-938c-93ee5ff191da tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.106338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb90cf7-a8f9-4993-938c-93ee5ff191da tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.107487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb90cf7-a8f9-4993-938c-93ee5ff191da tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.107487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb90cf7-a8f9-4993-938c-93ee5ff191da tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.107919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb90cf7-a8f9-4993-938c-93ee5ff191da tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.113378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:25.114874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:25.120205 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4d55800f-4229-4123-8b84-4bc3aef9b57a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.125058 Sep 10 20:51:25.124361 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 477/918] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:24 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:25.262749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-edb90cf7-a8f9-4993-938c-93ee5ff191da tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:25.275509 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-edb90cf7-a8f9-4993-938c-93ee5ff191da tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1712 microversion: 2.1 time: 0.183281 Sep 10 20:51:25.275873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:25.276368 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 442/919] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:25 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1712 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:25.276928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:25.296124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.296719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.297256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.298063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.298728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.299225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.334196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.334773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.335249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.335708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lazy-loading 'fault' on Instance uuid 7e5578bf-977b-4757-be61-2c01715e6bc1 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:51:25.384689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:25.387158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:25.395034 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-877a2e74-42b7-44a3-a859-7a781315eac9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 200 len: 1302 microversion: 2.1 time: 0.123160 Sep 10 20:51:25.395607 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 478/920] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:25 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:25.476753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:25.477482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] [instance: 3b48c2d1-e818-4a83-aa7b-768175ba35b8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:25.484579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.485057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.485555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.486280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.486731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.487150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.502314 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] HTTP exception thrown: Instance 3b48c2d1-e818-4a83-aa7b-768175ba35b8 could not be found. Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Request method failure captured: Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 HTTP/1.1 Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPi0z6PDVrmEmRyRZCqM5uZApJFt-KYgoD2XBJcoEKShEzFugWxhwPLQlzRkE_18xn6h0q-AE6-Xs0Qpyfa8KpqrbJtI_zUM4keGOaAulPKFzvxHZn3atPbL1b3-BSHRMaySsZdzPZV3pVx5kShpGzS3ZJI_yTq_Bwp9cver0PeF1d4 Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 4f60e45cf4604d9497f253f7bb1e3e71 Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TenantUsagesTestJSON-1316325408 Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:51:25.504927 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f60e45cf4604d9497f253f7bb1e3e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f60e45cf4604d9497f253f7bb1e3e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4f60e45cf4604d9497f253f7bb1e3e71", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4f60e45cf4604d9497f253f7bb1e3e71"}]}] Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TenantUsagesTestJSON-1316325408 Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 4f60e45cf4604d9497f253f7bb1e3e71 Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1316325408 Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TenantUsagesTestJSON-1316325408-project Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ef5c9474c1864436aa4a35057087ea26 Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TenantUsagesTestJSON-1316325408-project Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 3b48c2d1-e818-4a83-aa7b-768175ba35b8 could not be found. Sep 10 20:51:25.506652 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '3b48c2d1-e818-4a83-aa7b-768175ba35b8'} Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b48c2d1-e818-4a83-aa7b-768175ba35b8 could not be found. Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:51:25.507496 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b48c2d1-e818-4a83-aa7b-768175ba35b8 could not be found. Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b48c2d1-e818-4a83-aa7b-768175ba35b8 could not be found. Sep 10 20:51:25.508790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:25.510252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] Returning 404 to user: Instance 3b48c2d1-e818-4a83-aa7b-768175ba35b8 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:51:25.510252 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c8e32dec-b690-4c45-8296-2a9c5fcd14ba tempest-TenantUsagesTestJSON-1316325408 tempest-TenantUsagesTestJSON-1316325408-project] 10.222.0.33 "GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8" status: 404 len: 111 microversion: 2.1 time: 0.034511 Sep 10 20:51:25.510252 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 443/921] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:25 2022] GET /compute/v2.1/servers/3b48c2d1-e818-4a83-aa7b-768175ba35b8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:51:25.776628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c3237dcb-7353-46df-b2a9-e176a56b70b2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:25.777216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c3237dcb-7353-46df-b2a9-e176a56b70b2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:25.783944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3237dcb-7353-46df-b2a9-e176a56b70b2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.784477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3237dcb-7353-46df-b2a9-e176a56b70b2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.784919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3237dcb-7353-46df-b2a9-e176a56b70b2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.785631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3237dcb-7353-46df-b2a9-e176a56b70b2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.786213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3237dcb-7353-46df-b2a9-e176a56b70b2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.786673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3237dcb-7353-46df-b2a9-e176a56b70b2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.879202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-872469dd-5517-4fff-9ab0-b44123bca866 req-be52dcf1-f5fc-4a05-8937-77538f73f4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5578bf-977b-4757-be61-2c01715e6bc1", "name": "network-vif-deleted", "tag": "6db07566-c5ac-4fcb-9d35-209f1d7290d6"}, {"server_uuid": "7e5578bf-977b-4757-be61-2c01715e6bc1", "name": "network-vif-deleted", "tag": "80e2a60f-8b6c-4781-907c-f4c05c172375"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:25.890059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-872469dd-5517-4fff-9ab0-b44123bca866 req-be52dcf1-f5fc-4a05-8937-77538f73f4ef service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:25.891620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-872469dd-5517-4fff-9ab0-b44123bca866 req-be52dcf1-f5fc-4a05-8937-77538f73f4ef service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:25.892003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-872469dd-5517-4fff-9ab0-b44123bca866 req-be52dcf1-f5fc-4a05-8937-77538f73f4ef service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:25.905398 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-872469dd-5517-4fff-9ab0-b44123bca866 req-be52dcf1-f5fc-4a05-8937-77538f73f4ef service nova] Creating event network-vif-deleted:6db07566-c5ac-4fcb-9d35-209f1d7290d6 for instance 7e5578bf-977b-4757-be61-2c01715e6bc1 on nch2-master-1 Sep 10 20:51:25.905947 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-872469dd-5517-4fff-9ab0-b44123bca866 req-be52dcf1-f5fc-4a05-8937-77538f73f4ef service nova] Creating event network-vif-deleted:80e2a60f-8b6c-4781-907c-f4c05c172375 for instance 7e5578bf-977b-4757-be61-2c01715e6bc1 on nch2-master-1 Sep 10 20:51:25.911211 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-872469dd-5517-4fff-9ab0-b44123bca866 req-be52dcf1-f5fc-4a05-8937-77538f73f4ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036206 Sep 10 20:51:25.911862 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 444/922] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:51:25.947171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c3237dcb-7353-46df-b2a9-e176a56b70b2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:25.954941 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c3237dcb-7353-46df-b2a9-e176a56b70b2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.182817 Sep 10 20:51:25.955513 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 479/923] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:25 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:26.027778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b6a2e947-b5da-4275-9c1c-6399124c1fb5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:26.028476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b6a2e947-b5da-4275-9c1c-6399124c1fb5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:26.035456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2e947-b5da-4275-9c1c-6399124c1fb5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.035952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2e947-b5da-4275-9c1c-6399124c1fb5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.036403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2e947-b5da-4275-9c1c-6399124c1fb5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.037119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2e947-b5da-4275-9c1c-6399124c1fb5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.037696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2e947-b5da-4275-9c1c-6399124c1fb5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.038087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2e947-b5da-4275-9c1c-6399124c1fb5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.062565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-967c087d-37b1-40c3-b573-4e0c4b1149ed tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:26.063348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-967c087d-37b1-40c3-b573-4e0c4b1149ed tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:26.070222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-967c087d-37b1-40c3-b573-4e0c4b1149ed tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.070973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-967c087d-37b1-40c3-b573-4e0c4b1149ed tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.071617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-967c087d-37b1-40c3-b573-4e0c4b1149ed tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.072331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-967c087d-37b1-40c3-b573-4e0c4b1149ed tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.072782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-967c087d-37b1-40c3-b573-4e0c4b1149ed tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.073233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-967c087d-37b1-40c3-b573-4e0c4b1149ed tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.205965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-967c087d-37b1-40c3-b573-4e0c4b1149ed tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:26.213932 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-967c087d-37b1-40c3-b573-4e0c4b1149ed tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.155478 Sep 10 20:51:26.214515 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 480/924] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:26 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:26.234785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:26.235395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:26.241735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.242275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.242712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.243412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.243869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.244297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.313539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:26.323011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:26.324817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:26.330387 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-51e70a95-b25f-4108-a65c-08e094ec068d tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.099239 Sep 10 20:51:26.330975 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 481/925] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:26 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:26.335449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d36f6968-fcb6-48ca-8b36-9bcd2edbd10b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:26.336072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d36f6968-fcb6-48ca-8b36-9bcd2edbd10b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:26.341946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d36f6968-fcb6-48ca-8b36-9bcd2edbd10b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.342655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d36f6968-fcb6-48ca-8b36-9bcd2edbd10b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.343102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d36f6968-fcb6-48ca-8b36-9bcd2edbd10b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.343973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d36f6968-fcb6-48ca-8b36-9bcd2edbd10b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.344572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d36f6968-fcb6-48ca-8b36-9bcd2edbd10b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.345161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d36f6968-fcb6-48ca-8b36-9bcd2edbd10b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.357862 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b6a2e947-b5da-4275-9c1c-6399124c1fb5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1629 microversion: 2.1 time: 0.334105 Sep 10 20:51:26.371731 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 445/926] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:26 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1629 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:26.390376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:26.392911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:26.400266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.400830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.401285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.402085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.402545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.402975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.480878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lazy-loading 'flavor' on Instance uuid 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:51:26.495243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Going to try to live migrate instance to nch2-master-1 {{(pid=145772) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 20:51:26.526743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d36f6968-fcb6-48ca-8b36-9bcd2edbd10b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:26.535319 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d36f6968-fcb6-48ca-8b36-9bcd2edbd10b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1712 microversion: 2.1 time: 0.203224 Sep 10 20:51:26.536165 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 482/927] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:26 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1712 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:26.540707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:26.541246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:26.547183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.547673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.548110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.548810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:26.549488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:26.550384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:26.567241 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] HTTP exception thrown: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Request method failure captured: Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 HTTP/1.1 Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPifoEAILsjLSTYBpSg8vOLy_mjEC59eJYrvMy_6lhbku1dmqwnGWXZfCyyRFMMgBQIGCsCF-TvcT_lfgl7rppW-Jt-eeMi5lDPeMNMS-Qka2OhSY5tszUjXGk1r_zzezKSjuWn8zCaWYSdxwYKv1e3XFfK_aXoZAwk5_KmH17JXSaw Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:51:26.569573 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7933149ce16427e84de63058fff1142", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7933149ce16427e84de63058fff1142"}]}] Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestMultiNic-274842171 Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestMultiNic-274842171-project Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 3f0ba978c04048a29bf4132a1e7379b9 Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestMultiNic-274842171-project Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:51:26.571227 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7e5578bf-977b-4757-be61-2c01715e6bc1'} Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:51:26.572184 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:51:26.573614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:26.575745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Returning 404 to user: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:51:26.575745 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f1e021c-6125-4abb-b0f1-08cdf803423e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 404 len: 111 microversion: 2.1 time: 0.036237 Sep 10 20:51:26.575745 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 483/928] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:26 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:51:26.992566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b6647ff8-848b-4394-9c2a-3eb8c407e747 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:26.993264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b6647ff8-848b-4394-9c2a-3eb8c407e747 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:27.008390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6647ff8-848b-4394-9c2a-3eb8c407e747 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:27.009169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6647ff8-848b-4394-9c2a-3eb8c407e747 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:27.009793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6647ff8-848b-4394-9c2a-3eb8c407e747 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:27.010695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6647ff8-848b-4394-9c2a-3eb8c407e747 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:27.011318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6647ff8-848b-4394-9c2a-3eb8c407e747 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:27.011906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6647ff8-848b-4394-9c2a-3eb8c407e747 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:27.273171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b6647ff8-848b-4394-9c2a-3eb8c407e747 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:27.286216 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b6647ff8-848b-4394-9c2a-3eb8c407e747 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.296709 Sep 10 20:51:27.286883 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 484/929] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:26 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:27.302968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5a9b64fb-95a4-4ae0-b81a-b7704234a9f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:27.304073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5a9b64fb-95a4-4ae0-b81a-b7704234a9f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:27.310445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a9b64fb-95a4-4ae0-b81a-b7704234a9f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:27.311904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a9b64fb-95a4-4ae0-b81a-b7704234a9f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:27.316910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a9b64fb-95a4-4ae0-b81a-b7704234a9f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:27.317883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a9b64fb-95a4-4ae0-b81a-b7704234a9f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:27.318887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a9b64fb-95a4-4ae0-b81a-b7704234a9f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:27.320741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a9b64fb-95a4-4ae0-b81a-b7704234a9f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:27.555573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5a9b64fb-95a4-4ae0-b81a-b7704234a9f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:27.566696 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5a9b64fb-95a4-4ae0-b81a-b7704234a9f9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.278254 Sep 10 20:51:27.567893 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 485/930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:27 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:27.573357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-83f3105f-672a-4425-af9f-cf25b3875189 req-881014b9-a70c-43ac-8ab7-d8f4ba7f3cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2412dd3b-5199-44dc-b883-342893c82804", "name": "network-vif-deleted", "tag": "45588a70-346a-4df0-a818-fe5ea133697d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:27.585031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-83f3105f-672a-4425-af9f-cf25b3875189 req-881014b9-a70c-43ac-8ab7-d8f4ba7f3cd8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:27.585774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-83f3105f-672a-4425-af9f-cf25b3875189 req-881014b9-a70c-43ac-8ab7-d8f4ba7f3cd8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:27.587281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-83f3105f-672a-4425-af9f-cf25b3875189 req-881014b9-a70c-43ac-8ab7-d8f4ba7f3cd8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:27.600673 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-83f3105f-672a-4425-af9f-cf25b3875189 req-881014b9-a70c-43ac-8ab7-d8f4ba7f3cd8 service nova] Creating event network-vif-deleted:45588a70-346a-4df0-a818-fe5ea133697d for instance 2412dd3b-5199-44dc-b883-342893c82804 on nch1-master-1 Sep 10 20:51:27.608207 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-83f3105f-672a-4425-af9f-cf25b3875189 req-881014b9-a70c-43ac-8ab7-d8f4ba7f3cd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037749 Sep 10 20:51:27.609883 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 486/931] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:27.618644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:27.619704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:27.627339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:27.628261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:27.629405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:27.630737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:27.631524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:27.632154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:27.789434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:27.799864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:27.808845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:27.822030 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-49b9e2bb-546e-411f-bcb2-c7cc6c7ced43 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.209615 Sep 10 20:51:27.824475 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 487/932] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:27 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:27.835697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:27.837067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:27.852375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:27.853311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:27.854035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:27.855117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:27.855820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:27.856604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:27.895772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:27.896518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:27.897153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:27.897801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lazy-loading 'fault' on Instance uuid 2412dd3b-5199-44dc-b883-342893c82804 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:51:27.955980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a020e015186b4c32950c2d4edd26374e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44361bde7c94fb6b01d992a8df306bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:27.967951 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-85313c69-6a1e-482c-94d1-0f4b0a00fe63 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 200 len: 1353 microversion: 2.1 time: 0.141325 Sep 10 20:51:27.976252 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 488/933] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:27 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 1353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:28.313971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c67ff116-bd19-4182-8922-a5d43063f31d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:28.314598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c67ff116-bd19-4182-8922-a5d43063f31d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:28.332649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c67ff116-bd19-4182-8922-a5d43063f31d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:28.333527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c67ff116-bd19-4182-8922-a5d43063f31d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:28.334682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c67ff116-bd19-4182-8922-a5d43063f31d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:28.338948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c67ff116-bd19-4182-8922-a5d43063f31d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:28.339474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c67ff116-bd19-4182-8922-a5d43063f31d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:28.339924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c67ff116-bd19-4182-8922-a5d43063f31d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:28.587060 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-000f98d5-6752-4c3b-88bd-04f043514e79 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc/action" status: 202 len: 0 microversion: 2.1 time: 2.200705 Sep 10 20:51:28.589035 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 446/934] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:51:26 2022] POST /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc/action => generated 0 bytes in 2203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:51:28.595578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e2ebe7b-ff11-47f7-9efa-ac80ecd8282f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:28.598644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e2ebe7b-ff11-47f7-9efa-ac80ecd8282f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:28.609872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe7b-ff11-47f7-9efa-ac80ecd8282f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:28.616787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe7b-ff11-47f7-9efa-ac80ecd8282f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:28.617526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe7b-ff11-47f7-9efa-ac80ecd8282f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:28.618571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe7b-ff11-47f7-9efa-ac80ecd8282f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:28.620438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe7b-ff11-47f7-9efa-ac80ecd8282f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:28.621087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe7b-ff11-47f7-9efa-ac80ecd8282f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:28.778947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c67ff116-bd19-4182-8922-a5d43063f31d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:28.791277 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c67ff116-bd19-4182-8922-a5d43063f31d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.481120 Sep 10 20:51:28.792723 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 489/935] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:28 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:28.811692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1e2ebe7b-ff11-47f7-9efa-ac80ecd8282f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:28.815156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23cb2c5d-da89-415c-9f27-1a73e5ed4061 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:28.815785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23cb2c5d-da89-415c-9f27-1a73e5ed4061 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:28.821197 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e2ebe7b-ff11-47f7-9efa-ac80ecd8282f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.230892 Sep 10 20:51:28.822629 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 447/936] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:28 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:28.843768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23cb2c5d-da89-415c-9f27-1a73e5ed4061 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:28.844671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23cb2c5d-da89-415c-9f27-1a73e5ed4061 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:28.845256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23cb2c5d-da89-415c-9f27-1a73e5ed4061 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:28.846590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23cb2c5d-da89-415c-9f27-1a73e5ed4061 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:28.848033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23cb2c5d-da89-415c-9f27-1a73e5ed4061 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:28.848615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23cb2c5d-da89-415c-9f27-1a73e5ed4061 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:28.858267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:28.858883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:28.862119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:28.870834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:28.871540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:28.872808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:28.874407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:28.875193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:28.875866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:28.983718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:28.995589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:28.997048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:29.002329 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7305e761-4319-4d8b-85d0-38cc11041c48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.149622 Sep 10 20:51:29.003167 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 448/937] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:28 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:29.037894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:29.038709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:29.046151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:29.046852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:29.047858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:29.048946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:29.049670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:29.051014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:29.069639 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] HTTP exception thrown: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Request method failure captured: Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 HTTP/1.1 Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgLDRd4oZm9eu-SXzF3aU60kgc4SkXU-W6LtldsRiCWctqw80TNqTqmwoSTpb9oGBZ98KwOsGSkiFZ4yP7eaaeRTpXdgik8V1DVqzUXFbOiYHhR97SUbEmP1jHLAxXHHCVU6I43pyMEZfM8YS6G3EvdKek5W-ADx3Rj0__oaW7165E Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:51:29.071930 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d44361bde7c94fb6b01d992a8df306bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d44361bde7c94fb6b01d992a8df306bb"}]}] Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a020e015186b4c32950c2d4edd26374e Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:29.073479 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2412dd3b-5199-44dc-b883-342893c82804'} Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:51:29.074472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:29.075847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.078635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Returning 404 to user: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:51:29.079700 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-786e510b-b00d-4d89-b453-9f5ca54c331b tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 404 len: 111 microversion: 2.1 time: 0.047882 Sep 10 20:51:29.080273 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 449/938] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:29 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:51:29.089344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:29.091276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:29.098693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:29.099174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:29.099796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:29.100690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:29.101295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:29.101973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:29.121787 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] HTTP exception thrown: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Request method failure captured: Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 HTTP/1.1 Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgLDRd4oZm9eu-SXzF3aU60kgc4SkXU-W6LtldsRiCWctqw80TNqTqmwoSTpb9oGBZ98KwOsGSkiFZ4yP7eaaeRTpXdgik8V1DVqzUXFbOiYHhR97SUbEmP1jHLAxXHHCVU6I43pyMEZfM8YS6G3EvdKek5W-ADx3Rj0__oaW7165E Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:51:29.123504 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d44361bde7c94fb6b01d992a8df306bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d44361bde7c94fb6b01d992a8df306bb"}]}] Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a020e015186b4c32950c2d4edd26374e Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:29.125192 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '023ec8d2-8599-46cf-9dd4-3242411b0762'} Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:51:29.126065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:29.127276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.132139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Returning 404 to user: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:51:29.132139 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c3e28ce6-a46c-4727-8b4e-75ccb6d6ed20 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "DELETE /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 404 len: 111 microversion: 2.1 time: 0.039794 Sep 10 20:51:29.132139 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 450/939] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:51:29 2022] DELETE /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:51:29.137274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:29.138494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:29.147308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:29.148127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:29.148793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:29.149811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:29.150514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:29.151206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:29.168960 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] HTTP exception thrown: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Request method failure captured: Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 HTTP/1.1 Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgLDRd4oZm9eu-SXzF3aU60kgc4SkXU-W6LtldsRiCWctqw80TNqTqmwoSTpb9oGBZ98KwOsGSkiFZ4yP7eaaeRTpXdgik8V1DVqzUXFbOiYHhR97SUbEmP1jHLAxXHHCVU6I43pyMEZfM8YS6G3EvdKek5W-ADx3Rj0__oaW7165E Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:51:29.171038 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d44361bde7c94fb6b01d992a8df306bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d44361bde7c94fb6b01d992a8df306bb"}]}] Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a020e015186b4c32950c2d4edd26374e Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:29.172345 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '023ec8d2-8599-46cf-9dd4-3242411b0762'} Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:51:29.173159 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:29.174419 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:29.178255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Returning 404 to user: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:51:29.179289 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8d6fb4dc-45c7-4b8f-b184-a7dfeeb6e086 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 404 len: 111 microversion: 2.1 time: 0.048790 Sep 10 20:51:29.180000 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 451/940] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:29 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:51:29.189784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e152c7f9-7a45-459d-8f10-6186e2acd345 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '.version_select at 0x7f9944aecf70>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:29.215772 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e152c7f9-7a45-459d-8f10-6186e2acd345 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-272195699" status: 202 len: 0 microversion: 2.1 time: 0.030663 Sep 10 20:51:29.219329 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 452/941] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 20:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-272195699 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:51:29.239615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-23cb2c5d-da89-415c-9f27-1a73e5ed4061 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:29.249101 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23cb2c5d-da89-415c-9f27-1a73e5ed4061 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1503 microversion: 2.1 time: 0.445746 Sep 10 20:51:29.249929 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 490/942] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:28 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1503 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:29.817174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92d3ec98-4e39-4b91-b3a9-94747bf42ba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:29.818511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-92d3ec98-4e39-4b91-b3a9-94747bf42ba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:29.825225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:29.828021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92d3ec98-4e39-4b91-b3a9-94747bf42ba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:29.828720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92d3ec98-4e39-4b91-b3a9-94747bf42ba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:29.829332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92d3ec98-4e39-4b91-b3a9-94747bf42ba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:29.830848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92d3ec98-4e39-4b91-b3a9-94747bf42ba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:29.831748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92d3ec98-4e39-4b91-b3a9-94747bf42ba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:29.832555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92d3ec98-4e39-4b91-b3a9-94747bf42ba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:29.854258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd2a706c-ad62-4997-acad-b8cfea698269 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:29.855114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd2a706c-ad62-4997-acad-b8cfea698269 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:29.872801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd2a706c-ad62-4997-acad-b8cfea698269 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:29.873814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd2a706c-ad62-4997-acad-b8cfea698269 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:29.874580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd2a706c-ad62-4997-acad-b8cfea698269 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:29.875587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd2a706c-ad62-4997-acad-b8cfea698269 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:29.876550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd2a706c-ad62-4997-acad-b8cfea698269 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:29.877485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd2a706c-ad62-4997-acad-b8cfea698269 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.368430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-92d3ec98-4e39-4b91-b3a9-94747bf42ba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:30.389187 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-92d3ec98-4e39-4b91-b3a9-94747bf42ba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.576073 Sep 10 20:51:30.390368 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 453/943] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:29 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:30.405315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:30.406236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:30.416268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.416759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.417513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.418538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.419195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.419793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.536760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:30.547927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:30.550242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:30.556599 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7753fc42-73d6-4b99-90b1-76036778539c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.164902 Sep 10 20:51:30.569851 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 454/944] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:30 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:30.569851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4d846e77-dac5-4f24-82cc-99e2d117285c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:30.569851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4d846e77-dac5-4f24-82cc-99e2d117285c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:30.571327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d846e77-dac5-4f24-82cc-99e2d117285c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.572181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d846e77-dac5-4f24-82cc-99e2d117285c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.572892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d846e77-dac5-4f24-82cc-99e2d117285c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.574517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d846e77-dac5-4f24-82cc-99e2d117285c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.575126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d846e77-dac5-4f24-82cc-99e2d117285c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.575688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d846e77-dac5-4f24-82cc-99e2d117285c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.642801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd2a706c-ad62-4997-acad-b8cfea698269 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:30.653105 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd2a706c-ad62-4997-acad-b8cfea698269 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.806174 Sep 10 20:51:30.654256 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 491/945] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:29 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:30.658770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ec07f52c-c50f-4fb1-a8e7-8ae9636e29a7 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:30.670941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:30.681711 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ec07f52c-c50f-4fb1-a8e7-8ae9636e29a7 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1216379191" status: 202 len: 0 microversion: 2.1 time: 0.026524 Sep 10 20:51:30.682513 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 492/946] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 20:51:30 2022] DELETE /compute/v2.1/flavors/1216379191 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:51:30.693357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b4120b79-0719-49d0-af7c-4520e873501c tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:30.718410 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b4120b79-0719-49d0-af7c-4520e873501c tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.031553 Sep 10 20:51:30.732886 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 493/947] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:51:30 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:30.739971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4d846e77-dac5-4f24-82cc-99e2d117285c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:30.742525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89db3a0e-8cec-4ad4-91cf-20bf91eeab33 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:30.751736 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4d846e77-dac5-4f24-82cc-99e2d117285c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1503 microversion: 2.1 time: 0.192154 Sep 10 20:51:30.752737 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 455/948] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:30 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:30.763342 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-89db3a0e-8cec-4ad4-91cf-20bf91eeab33 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1345878817" status: 202 len: 0 microversion: 2.1 time: 0.024604 Sep 10 20:51:30.763342 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 494/949] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 20:51:30 2022] DELETE /compute/v2.1/flavors/1345878817 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:51:30.772670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-310bc21d-d73c-4483-8dc9-988a3e5b4f55 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:30.794133 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-310bc21d-d73c-4483-8dc9-988a3e5b4f55 tempest-ServersWithSpecificFlavorTestJSON-1672046589 tempest-ServersWithSpecificFlavorTestJSON-1672046589-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026859 Sep 10 20:51:30.795030 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 495/950] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:51:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:30.826115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:30.826639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:30.834487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.834971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.835402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.836101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.836554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.836985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.852012 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] HTTP exception thrown: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Request method failure captured: Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 HTTP/1.1 Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgLDRd4oZm9eu-SXzF3aU60kgc4SkXU-W6LtldsRiCWctqw80TNqTqmwoSTpb9oGBZ98KwOsGSkiFZ4yP7eaaeRTpXdgik8V1DVqzUXFbOiYHhR97SUbEmP1jHLAxXHHCVU6I43pyMEZfM8YS6G3EvdKek5W-ADx3Rj0__oaW7165E Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:51:30.853568 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d44361bde7c94fb6b01d992a8df306bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d44361bde7c94fb6b01d992a8df306bb"}]}] Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a020e015186b4c32950c2d4edd26374e Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:30.854973 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2412dd3b-5199-44dc-b883-342893c82804'} Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:51:30.855732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:30.857115 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.859429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Returning 404 to user: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:51:30.859429 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1c2b0c6-4427-4fc7-9e55-a81160d210c2 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 404 len: 111 microversion: 2.1 time: 0.033481 Sep 10 20:51:30.859429 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 456/951] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:51:30 2022] DELETE /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:51:30.867767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:30.868378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 2412dd3b-5199-44dc-b883-342893c82804] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:30.874937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.875424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.876039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.876754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.877204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.877795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.891295 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] HTTP exception thrown: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Request method failure captured: Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 HTTP/1.1 Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgLDRd4oZm9eu-SXzF3aU60kgc4SkXU-W6LtldsRiCWctqw80TNqTqmwoSTpb9oGBZ98KwOsGSkiFZ4yP7eaaeRTpXdgik8V1DVqzUXFbOiYHhR97SUbEmP1jHLAxXHHCVU6I43pyMEZfM8YS6G3EvdKek5W-ADx3Rj0__oaW7165E Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:51:30.892918 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d44361bde7c94fb6b01d992a8df306bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d44361bde7c94fb6b01d992a8df306bb"}]}] Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a020e015186b4c32950c2d4edd26374e Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:30.895048 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2412dd3b-5199-44dc-b883-342893c82804'} Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:51:30.898260 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. Sep 10 20:51:30.899512 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.900659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Returning 404 to user: Instance 2412dd3b-5199-44dc-b883-342893c82804 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:51:30.900659 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e792e3d1-f550-41bb-9ba4-d0024823cd96 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804" status: 404 len: 111 microversion: 2.1 time: 0.031155 Sep 10 20:51:30.900659 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 496/952] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:30 2022] GET /compute/v2.1/servers/2412dd3b-5199-44dc-b883-342893c82804 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:51:30.904034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:30.904543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:30.911475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.911975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.912416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.913325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.913973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.914679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.931828 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] HTTP exception thrown: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Request method failure captured: Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 HTTP/1.1 Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgLDRd4oZm9eu-SXzF3aU60kgc4SkXU-W6LtldsRiCWctqw80TNqTqmwoSTpb9oGBZ98KwOsGSkiFZ4yP7eaaeRTpXdgik8V1DVqzUXFbOiYHhR97SUbEmP1jHLAxXHHCVU6I43pyMEZfM8YS6G3EvdKek5W-ADx3Rj0__oaW7165E Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:51:30.933408 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d44361bde7c94fb6b01d992a8df306bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d44361bde7c94fb6b01d992a8df306bb"}]}] Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a020e015186b4c32950c2d4edd26374e Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:30.934790 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '023ec8d2-8599-46cf-9dd4-3242411b0762'} Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:51:30.935514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:30.936691 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.938680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Returning 404 to user: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:51:30.938680 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c816f143-a855-449c-84b6-f014f4fd2069 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "DELETE /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 404 len: 111 microversion: 2.1 time: 0.035125 Sep 10 20:51:30.943446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:30.944069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] [instance: 023ec8d2-8599-46cf-9dd4-3242411b0762] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:30.947362 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 457/953] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:51:30 2022] DELETE /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:51:30.951201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.951923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.952617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.953501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:30.954322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:30.955034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:30.970706 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] HTTP exception thrown: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Request method failure captured: Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 HTTP/1.1 Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgLDRd4oZm9eu-SXzF3aU60kgc4SkXU-W6LtldsRiCWctqw80TNqTqmwoSTpb9oGBZ98KwOsGSkiFZ4yP7eaaeRTpXdgik8V1DVqzUXFbOiYHhR97SUbEmP1jHLAxXHHCVU6I43pyMEZfM8YS6G3EvdKek5W-ADx3Rj0__oaW7165E Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:51:30.973742 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d44361bde7c94fb6b01d992a8df306bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d44361bde7c94fb6b01d992a8df306bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d44361bde7c94fb6b01d992a8df306bb"}]}] Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d44361bde7c94fb6b01d992a8df306bb Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685 Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a020e015186b4c32950c2d4edd26374e Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-38519685-project Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:30.975178 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '023ec8d2-8599-46cf-9dd4-3242411b0762'} Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:51:30.975895 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. Sep 10 20:51:30.977059 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:51:30.979793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] Returning 404 to user: Instance 023ec8d2-8599-46cf-9dd4-3242411b0762 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:51:30.981354 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-399f1534-b080-44ca-8bf5-604e5bb5a1a7 tempest-ServersWithSpecificFlavorTestJSON-38519685 tempest-ServersWithSpecificFlavorTestJSON-38519685-project] 10.222.0.33 "GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762" status: 404 len: 111 microversion: 2.1 time: 0.041280 Sep 10 20:51:30.985692 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 497/954] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:30 2022] GET /compute/v2.1/servers/023ec8d2-8599-46cf-9dd4-3242411b0762 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:51:31.414051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08d97d08-2db3-4562-bcf3-3c9fbcad79bc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:31.414672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-08d97d08-2db3-4562-bcf3-3c9fbcad79bc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:31.421984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08d97d08-2db3-4562-bcf3-3c9fbcad79bc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:31.422656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08d97d08-2db3-4562-bcf3-3c9fbcad79bc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:31.423261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08d97d08-2db3-4562-bcf3-3c9fbcad79bc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:31.424162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08d97d08-2db3-4562-bcf3-3c9fbcad79bc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:31.426062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08d97d08-2db3-4562-bcf3-3c9fbcad79bc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:31.426715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08d97d08-2db3-4562-bcf3-3c9fbcad79bc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:31.598199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:31.598860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:31.609702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:31.610236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:31.610684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:31.617513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:31.618165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:31.618627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:31.760314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:31.772392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:31.775985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:31.794022 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-21963667-039f-4581-a962-2f9fcb950abc tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.202639 Sep 10 20:51:31.795289 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 498/955] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:31 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:31.807671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-13658afd-7d31-4c85-9fb1-47197ae64b7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:31.808572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-13658afd-7d31-4c85-9fb1-47197ae64b7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:31.821903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13658afd-7d31-4c85-9fb1-47197ae64b7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:31.822410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13658afd-7d31-4c85-9fb1-47197ae64b7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:31.822852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13658afd-7d31-4c85-9fb1-47197ae64b7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:31.823565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13658afd-7d31-4c85-9fb1-47197ae64b7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:31.824017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13658afd-7d31-4c85-9fb1-47197ae64b7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:31.824458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13658afd-7d31-4c85-9fb1-47197ae64b7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:31.948727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-08d97d08-2db3-4562-bcf3-3c9fbcad79bc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:31.961289 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-08d97d08-2db3-4562-bcf3-3c9fbcad79bc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.551014 Sep 10 20:51:31.974438 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 458/956] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:31 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:31.985287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-2254d5b6-7100-42df-a161-31e82ca77ff1 req-97489a3a-3997-48a9-9c23-c86b01afbfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6b8ddf-a7d9-4698-9bb8-159ce02769dc", "name": "network-vif-unplugged", "status": "completed", "tag": "6cd39c03-2619-4e42-b3c9-3bc146a98c89"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:31.997149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2254d5b6-7100-42df-a161-31e82ca77ff1 req-97489a3a-3997-48a9-9c23-c86b01afbfb7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:31.997941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2254d5b6-7100-42df-a161-31e82ca77ff1 req-97489a3a-3997-48a9-9c23-c86b01afbfb7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:31.998534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2254d5b6-7100-42df-a161-31e82ca77ff1 req-97489a3a-3997-48a9-9c23-c86b01afbfb7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:32.011462 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-2254d5b6-7100-42df-a161-31e82ca77ff1 req-97489a3a-3997-48a9-9c23-c86b01afbfb7 service nova] Creating event network-vif-unplugged:6cd39c03-2619-4e42-b3c9-3bc146a98c89 for instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc on nch1-master-1 Sep 10 20:51:32.017800 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-2254d5b6-7100-42df-a161-31e82ca77ff1 req-97489a3a-3997-48a9-9c23-c86b01afbfb7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041810 Sep 10 20:51:32.019426 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 459/957] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:32.024699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56631916-7245-4ddf-aeec-068bda30c5b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:32.025422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-56631916-7245-4ddf-aeec-068bda30c5b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:32.032457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56631916-7245-4ddf-aeec-068bda30c5b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:32.033471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56631916-7245-4ddf-aeec-068bda30c5b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:32.034517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56631916-7245-4ddf-aeec-068bda30c5b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:32.036360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56631916-7245-4ddf-aeec-068bda30c5b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:32.037071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56631916-7245-4ddf-aeec-068bda30c5b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:32.038313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56631916-7245-4ddf-aeec-068bda30c5b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:32.088598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-13658afd-7d31-4c85-9fb1-47197ae64b7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:32.103810 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-13658afd-7d31-4c85-9fb1-47197ae64b7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.307242 Sep 10 20:51:32.104754 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 499/958] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:31 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:32.559945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-56631916-7245-4ddf-aeec-068bda30c5b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:32.570904 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-56631916-7245-4ddf-aeec-068bda30c5b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1503 microversion: 2.1 time: 0.550220 Sep 10 20:51:32.571491 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 460/959] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:32 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1503 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:32.826979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:32.827592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:32.835899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:32.836406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:32.836846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:32.837562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:32.838111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:32.838548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:32.922335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:32.931829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:32.933638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:32.939201 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8e12a932-31e4-4fa6-90cf-710221020d48 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.116068 Sep 10 20:51:32.954557 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 500/960] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:32 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:32.991747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc61a4f3-0bba-40a4-8a0c-2f480bea9598 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:32.992540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fc61a4f3-0bba-40a4-8a0c-2f480bea9598 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:33.004710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc61a4f3-0bba-40a4-8a0c-2f480bea9598 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:33.005318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc61a4f3-0bba-40a4-8a0c-2f480bea9598 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:33.006015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc61a4f3-0bba-40a4-8a0c-2f480bea9598 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:33.006985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc61a4f3-0bba-40a4-8a0c-2f480bea9598 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:33.007540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc61a4f3-0bba-40a4-8a0c-2f480bea9598 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:33.008088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc61a4f3-0bba-40a4-8a0c-2f480bea9598 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:33.028684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:33.133815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2be8e21d-b8dd-4ddd-a149-feb96c47148f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:33.135364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2be8e21d-b8dd-4ddd-a149-feb96c47148f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:33.145691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2be8e21d-b8dd-4ddd-a149-feb96c47148f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:33.146221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2be8e21d-b8dd-4ddd-a149-feb96c47148f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:33.146732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2be8e21d-b8dd-4ddd-a149-feb96c47148f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:33.147450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2be8e21d-b8dd-4ddd-a149-feb96c47148f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:33.147908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2be8e21d-b8dd-4ddd-a149-feb96c47148f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:33.148674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2be8e21d-b8dd-4ddd-a149-feb96c47148f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:33.343560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fc61a4f3-0bba-40a4-8a0c-2f480bea9598 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:33.376451 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc61a4f3-0bba-40a4-8a0c-2f480bea9598 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.388931 Sep 10 20:51:33.378381 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 461/961] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:32 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:33.426638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2be8e21d-b8dd-4ddd-a149-feb96c47148f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:33.430417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:33.448114 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2be8e21d-b8dd-4ddd-a149-feb96c47148f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.320311 Sep 10 20:51:33.449564 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 501/962] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:33 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:33.595277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8d186de-f0ea-47c4-bd04-54874cf226a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:33.595940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c8d186de-f0ea-47c4-bd04-54874cf226a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:33.626139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8d186de-f0ea-47c4-bd04-54874cf226a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:33.628077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8d186de-f0ea-47c4-bd04-54874cf226a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:33.628540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8d186de-f0ea-47c4-bd04-54874cf226a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:33.629386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8d186de-f0ea-47c4-bd04-54874cf226a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:33.629879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8d186de-f0ea-47c4-bd04-54874cf226a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:33.630301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8d186de-f0ea-47c4-bd04-54874cf226a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:33.968676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:33.969530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:33.982406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:33.982903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:33.983341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:33.984042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:33.986392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:33.987011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:34.144844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:34.174436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:34.183408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:34.192377 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dbfcebd2-7faf-4364-baf9-570a928568e3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1560 microversion: 2.91 time: 0.227444 Sep 10 20:51:34.207190 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 502/963] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:33 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1560 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:51:34.226194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2894c89f-215d-4456-92ab-116f9d70dc04 req-9f378b36-efcb-4c21-89e8-5e79577de304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6b8ddf-a7d9-4698-9bb8-159ce02769dc", "tag": "6cd39c03-2619-4e42-b3c9-3bc146a98c89"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:34.236548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2894c89f-215d-4456-92ab-116f9d70dc04 req-9f378b36-efcb-4c21-89e8-5e79577de304 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:34.237018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2894c89f-215d-4456-92ab-116f9d70dc04 req-9f378b36-efcb-4c21-89e8-5e79577de304 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:34.238966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2894c89f-215d-4456-92ab-116f9d70dc04 req-9f378b36-efcb-4c21-89e8-5e79577de304 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:34.254634 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2894c89f-215d-4456-92ab-116f9d70dc04 req-9f378b36-efcb-4c21-89e8-5e79577de304 service nova] Creating event network-changed:6cd39c03-2619-4e42-b3c9-3bc146a98c89 for instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc on nch1-master-1 Sep 10 20:51:34.260614 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2894c89f-215d-4456-92ab-116f9d70dc04 req-9f378b36-efcb-4c21-89e8-5e79577de304 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056165 Sep 10 20:51:34.261290 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 503/964] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:34.404450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-86d3bab5-c36f-455f-aab2-0dfee673b234 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:34.405251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-86d3bab5-c36f-455f-aab2-0dfee673b234 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:34.412634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86d3bab5-c36f-455f-aab2-0dfee673b234 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:34.413422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86d3bab5-c36f-455f-aab2-0dfee673b234 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:34.414110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86d3bab5-c36f-455f-aab2-0dfee673b234 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:34.415327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86d3bab5-c36f-455f-aab2-0dfee673b234 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:34.416133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86d3bab5-c36f-455f-aab2-0dfee673b234 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:34.416772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86d3bab5-c36f-455f-aab2-0dfee673b234 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:34.561741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c8d186de-f0ea-47c4-bd04-54874cf226a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:34.587596 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c8d186de-f0ea-47c4-bd04-54874cf226a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1503 microversion: 2.1 time: 0.996186 Sep 10 20:51:34.589677 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 462/965] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:33 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1503 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:34.595716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1072286659", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "5db22d65-fe38-495c-87ce-75973f2f8aff"}, {"uuid": "b7a53456-2404-459a-875f-e28d74ac5cfa"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:34.619978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-86d3bab5-c36f-455f-aab2-0dfee673b234 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:34.632135 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-86d3bab5-c36f-455f-aab2-0dfee673b234 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.231802 Sep 10 20:51:34.633126 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 504/966] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:34 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:34.642136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:34.660634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8bb0a822-a648-4d34-998c-c6aea67a440e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:34.661432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8bb0a822-a648-4d34-998c-c6aea67a440e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:34.672736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bb0a822-a648-4d34-998c-c6aea67a440e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:34.675391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bb0a822-a648-4d34-998c-c6aea67a440e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:34.675916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bb0a822-a648-4d34-998c-c6aea67a440e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:34.677156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bb0a822-a648-4d34-998c-c6aea67a440e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:34.677688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bb0a822-a648-4d34-998c-c6aea67a440e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:34.678247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bb0a822-a648-4d34-998c-c6aea67a440e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:34.697418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] validate_networks() for [('5db22d65-fe38-495c-87ce-75973f2f8aff', None, None, None, None, None), ('b7a53456-2404-459a-875f-e28d74ac5cfa', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:51:34.902709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8bb0a822-a648-4d34-998c-c6aea67a440e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:34.912231 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8bb0a822-a648-4d34-998c-c6aea67a440e tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.277992 Sep 10 20:51:34.912944 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 505/967] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:34 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:35.225831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:35.226478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:35.241505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:35.241966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:35.242408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:35.243131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:35.243594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:35.244027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:35.323922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:35.334081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:35.337454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:35.350244 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-63a19e87-91aa-4a21-a63c-3c9604c654fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.129551 Sep 10 20:51:35.368458 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 506/968] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:35 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:51:35.614529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b0f5ff5e-86f2-4a4a-a02e-584ba0ccd35e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:35.617631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b0f5ff5e-86f2-4a4a-a02e-584ba0ccd35e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:35.626168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0f5ff5e-86f2-4a4a-a02e-584ba0ccd35e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:35.626890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0f5ff5e-86f2-4a4a-a02e-584ba0ccd35e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:35.627493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0f5ff5e-86f2-4a4a-a02e-584ba0ccd35e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:35.628442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0f5ff5e-86f2-4a4a-a02e-584ba0ccd35e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:35.629064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0f5ff5e-86f2-4a4a-a02e-584ba0ccd35e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:35.629655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0f5ff5e-86f2-4a4a-a02e-584ba0ccd35e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:35.901330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b0f5ff5e-86f2-4a4a-a02e-584ba0ccd35e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:35.911258 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b0f5ff5e-86f2-4a4a-a02e-584ba0ccd35e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1503 microversion: 2.1 time: 0.301656 Sep 10 20:51:35.912048 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 507/969] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:35 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:35.922673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-598bdd37-4239-4f50-9296-2c93250f09ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:35.923493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-598bdd37-4239-4f50-9296-2c93250f09ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:35.936608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598bdd37-4239-4f50-9296-2c93250f09ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:35.940093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598bdd37-4239-4f50-9296-2c93250f09ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:35.940846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598bdd37-4239-4f50-9296-2c93250f09ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:35.941770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598bdd37-4239-4f50-9296-2c93250f09ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:35.942424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598bdd37-4239-4f50-9296-2c93250f09ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:35.943008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598bdd37-4239-4f50-9296-2c93250f09ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:36.209614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-598bdd37-4239-4f50-9296-2c93250f09ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:36.218760 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-598bdd37-4239-4f50-9296-2c93250f09ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.299845 Sep 10 20:51:36.221390 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 508/970] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:35 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:36.231641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d480a68b-27d2-4816-baa5-59aca73c551d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:36.233251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d480a68b-27d2-4816-baa5-59aca73c551d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:36.241000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d480a68b-27d2-4816-baa5-59aca73c551d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:36.242003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d480a68b-27d2-4816-baa5-59aca73c551d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:36.242728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d480a68b-27d2-4816-baa5-59aca73c551d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:36.243951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d480a68b-27d2-4816-baa5-59aca73c551d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:36.247113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d480a68b-27d2-4816-baa5-59aca73c551d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:36.247777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d480a68b-27d2-4816-baa5-59aca73c551d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:36.577168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d480a68b-27d2-4816-baa5-59aca73c551d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:36.604262 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d480a68b-27d2-4816-baa5-59aca73c551d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.381069 Sep 10 20:51:36.617207 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 509/971] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:36 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:36.628817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:36.639895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:36.657717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:36.658487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:36.659171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:36.660496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:36.661185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:36.661991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:36.783328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:36.792564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:36.797303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:36.808665 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-45f47041-c953-4fee-9a4b-6d539fe214da tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.187411 Sep 10 20:51:36.810025 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 510/972] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:36 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:36.939906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d1909b83-be40-43f1-bd53-1f0dfd453bab tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:36.940799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d1909b83-be40-43f1-bd53-1f0dfd453bab tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:36.954686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1909b83-be40-43f1-bd53-1f0dfd453bab tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:36.955199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1909b83-be40-43f1-bd53-1f0dfd453bab tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:36.955647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1909b83-be40-43f1-bd53-1f0dfd453bab tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:36.956916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1909b83-be40-43f1-bd53-1f0dfd453bab tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:36.957386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1909b83-be40-43f1-bd53-1f0dfd453bab tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:36.957819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1909b83-be40-43f1-bd53-1f0dfd453bab tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:37.324215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d1909b83-be40-43f1-bd53-1f0dfd453bab tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:37.339704 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d1909b83-be40-43f1-bd53-1f0dfd453bab tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1503 microversion: 2.1 time: 0.405639 Sep 10 20:51:37.347404 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 511/973] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:36 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1503 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:37.358025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-372846bf-50bb-4807-a77e-cd76c8c71053 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:37.358811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-372846bf-50bb-4807-a77e-cd76c8c71053 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:37.386125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-372846bf-50bb-4807-a77e-cd76c8c71053 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:37.386892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-372846bf-50bb-4807-a77e-cd76c8c71053 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:37.387491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-372846bf-50bb-4807-a77e-cd76c8c71053 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:37.394760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-372846bf-50bb-4807-a77e-cd76c8c71053 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:37.395798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-372846bf-50bb-4807-a77e-cd76c8c71053 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:37.396423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-372846bf-50bb-4807-a77e-cd76c8c71053 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:37.718199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-372846bf-50bb-4807-a77e-cd76c8c71053 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:37.728508 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-372846bf-50bb-4807-a77e-cd76c8c71053 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.379364 Sep 10 20:51:37.729113 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 512/974] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:37 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:37.750857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b363473f-72c5-48cf-8852-85800d8403d0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:37.751484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b363473f-72c5-48cf-8852-85800d8403d0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:37.759041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b363473f-72c5-48cf-8852-85800d8403d0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:37.759416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b363473f-72c5-48cf-8852-85800d8403d0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:37.759858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b363473f-72c5-48cf-8852-85800d8403d0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:37.760578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b363473f-72c5-48cf-8852-85800d8403d0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:37.761040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b363473f-72c5-48cf-8852-85800d8403d0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:37.761471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b363473f-72c5-48cf-8852-85800d8403d0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:38.040433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:51:38.041484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:51:38.042726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:51:38.043315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:51:38.043899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:51:38.057637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:38.062822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:38.064446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:38.071251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:38.072202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:38.073408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b363473f-72c5-48cf-8852-85800d8403d0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:38.074080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:38.086289 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b363473f-72c5-48cf-8852-85800d8403d0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.342875 Sep 10 20:51:38.091298 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 513/975] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:37 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:38.105895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:38.114382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:38.126482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Getting quotas for project a7933149ce16427e84de63058fff1142. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:51:38.134882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:38.139013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Getting quotas for user 3f0ba978c04048a29bf4132a1e7379b9 and project a7933149ce16427e84de63058fff1142. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:51:38.139836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:38.140420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:38.141449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:38.142050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:38.142589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:38.184551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:51:38.194129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:51:38.256408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:38.265669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:38.269687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:38.277158 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ed0b4f7d-67f3-4e30-ad5c-93bfd6ae1c51 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.184792 Sep 10 20:51:38.286968 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 514/976] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:38 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:38.342770 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2662b9dd-692c-4746-8220-9ef1b5ddfda7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.751488 Sep 10 20:51:38.346588 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 463/977] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:51:38.357598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-05269185-8087-4c2f-883a-8628665cdc4e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:38.360454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-05269185-8087-4c2f-883a-8628665cdc4e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:38.368985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-873d63d5-5ba1-4c7e-b2eb-b64352363306 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:38.370365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-873d63d5-5ba1-4c7e-b2eb-b64352363306 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:38.410602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-873d63d5-5ba1-4c7e-b2eb-b64352363306 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:38.418310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-873d63d5-5ba1-4c7e-b2eb-b64352363306 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:38.419915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-873d63d5-5ba1-4c7e-b2eb-b64352363306 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:38.420874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-873d63d5-5ba1-4c7e-b2eb-b64352363306 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:38.421492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-873d63d5-5ba1-4c7e-b2eb-b64352363306 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:38.427424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-873d63d5-5ba1-4c7e-b2eb-b64352363306 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:38.521857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-05269185-8087-4c2f-883a-8628665cdc4e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:38.532079 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-05269185-8087-4c2f-883a-8628665cdc4e tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1213 microversion: 2.1 time: 0.178141 Sep 10 20:51:38.554804 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 515/978] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:38 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1213 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:38.756327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-69dc4da9-1f10-40d7-82fc-347deb3f12d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:38.756988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-69dc4da9-1f10-40d7-82fc-347deb3f12d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:38.766358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69dc4da9-1f10-40d7-82fc-347deb3f12d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:38.766918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69dc4da9-1f10-40d7-82fc-347deb3f12d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:38.767353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69dc4da9-1f10-40d7-82fc-347deb3f12d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:38.769935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69dc4da9-1f10-40d7-82fc-347deb3f12d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:38.770439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69dc4da9-1f10-40d7-82fc-347deb3f12d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:38.770881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69dc4da9-1f10-40d7-82fc-347deb3f12d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:39.013197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-873d63d5-5ba1-4c7e-b2eb-b64352363306 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:39.036116 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-873d63d5-5ba1-4c7e-b2eb-b64352363306 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1503 microversion: 2.1 time: 0.670728 Sep 10 20:51:39.039810 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 464/979] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:38 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1503 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:39.119174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bf0e225a-59e5-4674-974a-aff346a69f06 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:39.120740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bf0e225a-59e5-4674-974a-aff346a69f06 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:39.131389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf0e225a-59e5-4674-974a-aff346a69f06 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:39.133681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf0e225a-59e5-4674-974a-aff346a69f06 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:39.135041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf0e225a-59e5-4674-974a-aff346a69f06 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:39.137615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf0e225a-59e5-4674-974a-aff346a69f06 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:39.138388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf0e225a-59e5-4674-974a-aff346a69f06 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:39.139530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf0e225a-59e5-4674-974a-aff346a69f06 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:39.524571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bf0e225a-59e5-4674-974a-aff346a69f06 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:39.539093 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bf0e225a-59e5-4674-974a-aff346a69f06 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.423809 Sep 10 20:51:39.540968 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 465/980] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:39 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:39.558483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:39.559386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:39.569803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:39.573098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:39.573772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:39.577513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:39.578886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:39.579513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:39.733023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:39.746148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:39.751722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:39.766951 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f72c22f2-d714-4d27-aa62-41d94e7cb162 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.224058 Sep 10 20:51:39.771671 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 466/981] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:39 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:39.779417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b62c0dc3-5338-42aa-a3fe-bb98e023f720 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:39.780224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b62c0dc3-5338-42aa-a3fe-bb98e023f720 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:39.799410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b62c0dc3-5338-42aa-a3fe-bb98e023f720 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:39.801888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b62c0dc3-5338-42aa-a3fe-bb98e023f720 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:39.802563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b62c0dc3-5338-42aa-a3fe-bb98e023f720 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:39.803770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b62c0dc3-5338-42aa-a3fe-bb98e023f720 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:39.804451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b62c0dc3-5338-42aa-a3fe-bb98e023f720 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:39.806416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b62c0dc3-5338-42aa-a3fe-bb98e023f720 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:39.903960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b62c0dc3-5338-42aa-a3fe-bb98e023f720 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:39.915579 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b62c0dc3-5338-42aa-a3fe-bb98e023f720 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1209 microversion: 2.1 time: 0.141661 Sep 10 20:51:39.916726 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 467/982] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:39 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1209 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:40.073519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d79e965d-5d70-4142-bfaa-8b559063b170 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:40.074602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d79e965d-5d70-4142-bfaa-8b559063b170 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:40.090560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d79e965d-5d70-4142-bfaa-8b559063b170 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:40.093518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d79e965d-5d70-4142-bfaa-8b559063b170 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:40.095038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d79e965d-5d70-4142-bfaa-8b559063b170 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:40.096019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d79e965d-5d70-4142-bfaa-8b559063b170 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:40.098990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d79e965d-5d70-4142-bfaa-8b559063b170 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:40.100134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d79e965d-5d70-4142-bfaa-8b559063b170 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:40.350901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-69dc4da9-1f10-40d7-82fc-347deb3f12d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:40.363848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d79e965d-5d70-4142-bfaa-8b559063b170 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:40.373365 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-69dc4da9-1f10-40d7-82fc-347deb3f12d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 1.618166 Sep 10 20:51:40.374036 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 516/983] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:38 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:40.375882 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d79e965d-5d70-4142-bfaa-8b559063b170 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1503 microversion: 2.1 time: 0.316997 Sep 10 20:51:40.381450 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 468/984] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:40 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1503 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:40.562775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d979a43-796b-4198-ad9e-0b7f99d4796f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:40.563393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d979a43-796b-4198-ad9e-0b7f99d4796f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:40.582924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d979a43-796b-4198-ad9e-0b7f99d4796f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:40.585264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d979a43-796b-4198-ad9e-0b7f99d4796f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:40.588797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d979a43-796b-4198-ad9e-0b7f99d4796f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:40.595818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d979a43-796b-4198-ad9e-0b7f99d4796f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:40.598464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d979a43-796b-4198-ad9e-0b7f99d4796f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:40.601990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d979a43-796b-4198-ad9e-0b7f99d4796f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:40.802649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:40.803134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:40.815860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:40.816461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:40.821900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:40.827063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:40.828324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:40.828790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:41.330509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:41.344767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:41.349573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:41.366051 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-617391b7-241c-451d-bd60-81fd4bc54369 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.567910 Sep 10 20:51:41.381853 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 469/985] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:40 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:41.390345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5e885ad4-bffb-4595-9ae0-a235a0d58ff8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:41.390939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5e885ad4-bffb-4595-9ae0-a235a0d58ff8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:41.416669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e885ad4-bffb-4595-9ae0-a235a0d58ff8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:41.417173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e885ad4-bffb-4595-9ae0-a235a0d58ff8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:41.417618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e885ad4-bffb-4595-9ae0-a235a0d58ff8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:41.432176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e885ad4-bffb-4595-9ae0-a235a0d58ff8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:41.436512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e885ad4-bffb-4595-9ae0-a235a0d58ff8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:41.437213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e885ad4-bffb-4595-9ae0-a235a0d58ff8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:41.514196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9d979a43-796b-4198-ad9e-0b7f99d4796f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:41.527470 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d979a43-796b-4198-ad9e-0b7f99d4796f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1470 microversion: 2.1 time: 0.968224 Sep 10 20:51:41.543527 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 517/986] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:40 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1470 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:41.554897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca079e97-ace1-4414-986d-2d01d2384a18 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:41.556292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ca079e97-ace1-4414-986d-2d01d2384a18 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:41.562810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca079e97-ace1-4414-986d-2d01d2384a18 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:41.564225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca079e97-ace1-4414-986d-2d01d2384a18 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:41.565485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca079e97-ace1-4414-986d-2d01d2384a18 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:41.566470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca079e97-ace1-4414-986d-2d01d2384a18 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:41.567104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca079e97-ace1-4414-986d-2d01d2384a18 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:41.567749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca079e97-ace1-4414-986d-2d01d2384a18 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:41.742735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5e885ad4-bffb-4595-9ae0-a235a0d58ff8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:41.761684 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5e885ad4-bffb-4595-9ae0-a235a0d58ff8 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1265 microversion: 2.1 time: 0.384500 Sep 10 20:51:41.765001 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 470/987] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:41 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1265 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:41.778581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c476ecd1-9e5e-48ba-8219-5d99691e5e57 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:41.782728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c476ecd1-9e5e-48ba-8219-5d99691e5e57 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:41.796079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c476ecd1-9e5e-48ba-8219-5d99691e5e57 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:41.796647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c476ecd1-9e5e-48ba-8219-5d99691e5e57 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:41.808782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c476ecd1-9e5e-48ba-8219-5d99691e5e57 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:41.810744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c476ecd1-9e5e-48ba-8219-5d99691e5e57 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:41.814244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c476ecd1-9e5e-48ba-8219-5d99691e5e57 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:41.815015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c476ecd1-9e5e-48ba-8219-5d99691e5e57 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:42.046278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ca079e97-ace1-4414-986d-2d01d2384a18 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:42.060444 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ca079e97-ace1-4414-986d-2d01d2384a18 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1477 microversion: 2.1 time: 0.514619 Sep 10 20:51:42.064426 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 518/988] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:41 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1477 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:42.401923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:42.402483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:42.431615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:42.441993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:42.443015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:42.443881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:42.445477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:42.446032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:42.577514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c476ecd1-9e5e-48ba-8219-5d99691e5e57 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:42.602476 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c476ecd1-9e5e-48ba-8219-5d99691e5e57 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1503 microversion: 2.1 time: 0.835334 Sep 10 20:51:42.604048 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 471/989] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:41 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1503 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:42.631400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e99459e-0071-4ff1-b070-17a95a19def0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:42.648595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:42.661151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:42.665871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e99459e-0071-4ff1-b070-17a95a19def0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:42.668508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:42.682054 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3a01fd0e-3d89-45ec-8605-8a8cb80545b2 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.286572 Sep 10 20:51:42.704130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e99459e-0071-4ff1-b070-17a95a19def0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:42.706674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e99459e-0071-4ff1-b070-17a95a19def0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:42.707625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e99459e-0071-4ff1-b070-17a95a19def0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:42.710202 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 519/990] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:42 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:42.713078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e99459e-0071-4ff1-b070-17a95a19def0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:42.716239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e99459e-0071-4ff1-b070-17a95a19def0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:42.720992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e99459e-0071-4ff1-b070-17a95a19def0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:42.786079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d2686196-ed5f-4c7b-9369-76d7759a3d09 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:42.786933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d2686196-ed5f-4c7b-9369-76d7759a3d09 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:42.798422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2686196-ed5f-4c7b-9369-76d7759a3d09 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:42.803151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2686196-ed5f-4c7b-9369-76d7759a3d09 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:42.803757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2686196-ed5f-4c7b-9369-76d7759a3d09 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:42.804618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2686196-ed5f-4c7b-9369-76d7759a3d09 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:42.807205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2686196-ed5f-4c7b-9369-76d7759a3d09 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:42.808563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2686196-ed5f-4c7b-9369-76d7759a3d09 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:42.825980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:43.112509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d2686196-ed5f-4c7b-9369-76d7759a3d09 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:43.124647 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d2686196-ed5f-4c7b-9369-76d7759a3d09 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1271 microversion: 2.1 time: 0.343675 Sep 10 20:51:43.139176 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 520/991] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:42 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1271 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:43.172150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bc76e9e4-b12d-4de3-8577-c6eb3393d60d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:43.173058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bc76e9e4-b12d-4de3-8577-c6eb3393d60d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:43.200371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc76e9e4-b12d-4de3-8577-c6eb3393d60d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:43.206161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc76e9e4-b12d-4de3-8577-c6eb3393d60d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:43.207101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc76e9e4-b12d-4de3-8577-c6eb3393d60d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:43.208032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc76e9e4-b12d-4de3-8577-c6eb3393d60d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:43.216592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc76e9e4-b12d-4de3-8577-c6eb3393d60d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:43.224167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc76e9e4-b12d-4de3-8577-c6eb3393d60d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:43.539818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6e99459e-0071-4ff1-b070-17a95a19def0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:43.551819 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e99459e-0071-4ff1-b070-17a95a19def0 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1488 microversion: 2.1 time: 0.943559 Sep 10 20:51:43.566679 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 472/992] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:42 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1488 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:43.634597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-72b40240-a415-495f-925d-a175d96a2c1f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:43.640724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-72b40240-a415-495f-925d-a175d96a2c1f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:43.653665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72b40240-a415-495f-925d-a175d96a2c1f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:43.654742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72b40240-a415-495f-925d-a175d96a2c1f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:43.668047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72b40240-a415-495f-925d-a175d96a2c1f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:43.668926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72b40240-a415-495f-925d-a175d96a2c1f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:43.670523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72b40240-a415-495f-925d-a175d96a2c1f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:43.671920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72b40240-a415-495f-925d-a175d96a2c1f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:43.703944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc76e9e4-b12d-4de3-8577-c6eb3393d60d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:43.717589 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bc76e9e4-b12d-4de3-8577-c6eb3393d60d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1476 microversion: 2.1 time: 0.572929 Sep 10 20:51:43.729875 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 521/993] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:43 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1476 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:43.729875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:43.729875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:43.743115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:43.744171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:43.744871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:43.745731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:43.746355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:43.747141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:44.016802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:44.037317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:44.038806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:44.055270 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4291d7fd-6a45-4cb3-8322-f293bbf79b6e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.335308 Sep 10 20:51:44.056183 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 522/994] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:43 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:44.128862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-72b40240-a415-495f-925d-a175d96a2c1f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:44.140221 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-72b40240-a415-495f-925d-a175d96a2c1f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1503 microversion: 2.1 time: 0.509739 Sep 10 20:51:44.155161 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 473/995] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:43 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1503 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:44.160148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-418360c3-ea5f-4f5b-ab1d-1a0ed6769cd6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:44.160769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-418360c3-ea5f-4f5b-ab1d-1a0ed6769cd6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:44.171350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-418360c3-ea5f-4f5b-ab1d-1a0ed6769cd6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:44.171863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-418360c3-ea5f-4f5b-ab1d-1a0ed6769cd6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:44.172311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-418360c3-ea5f-4f5b-ab1d-1a0ed6769cd6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:44.173031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-418360c3-ea5f-4f5b-ab1d-1a0ed6769cd6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:44.178985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-418360c3-ea5f-4f5b-ab1d-1a0ed6769cd6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:44.180029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-418360c3-ea5f-4f5b-ab1d-1a0ed6769cd6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:44.592711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81e0d9f0-2f42-41d2-83e0-41f2be497bd1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:44.593330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81e0d9f0-2f42-41d2-83e0-41f2be497bd1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:44.606159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e0d9f0-2f42-41d2-83e0-41f2be497bd1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:44.607775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e0d9f0-2f42-41d2-83e0-41f2be497bd1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:44.610041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e0d9f0-2f42-41d2-83e0-41f2be497bd1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:44.611002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e0d9f0-2f42-41d2-83e0-41f2be497bd1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:44.612016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e0d9f0-2f42-41d2-83e0-41f2be497bd1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:44.615506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e0d9f0-2f42-41d2-83e0-41f2be497bd1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:45.074873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-81e0d9f0-2f42-41d2-83e0-41f2be497bd1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:45.088874 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81e0d9f0-2f42-41d2-83e0-41f2be497bd1 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1476 microversion: 2.1 time: 0.500070 Sep 10 20:51:45.090206 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 474/996] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:44 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1476 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:45.096114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8bff3091-0049-4303-9aad-0884bf38f175 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:45.098467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8bff3091-0049-4303-9aad-0884bf38f175 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:45.112837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bff3091-0049-4303-9aad-0884bf38f175 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:45.114883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bff3091-0049-4303-9aad-0884bf38f175 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:45.115535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bff3091-0049-4303-9aad-0884bf38f175 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:45.116706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bff3091-0049-4303-9aad-0884bf38f175 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:45.117327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bff3091-0049-4303-9aad-0884bf38f175 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:45.119117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bff3091-0049-4303-9aad-0884bf38f175 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:45.133638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-418360c3-ea5f-4f5b-ab1d-1a0ed6769cd6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:45.143537 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-418360c3-ea5f-4f5b-ab1d-1a0ed6769cd6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1313 microversion: 2.1 time: 0.987689 Sep 10 20:51:45.148112 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 523/997] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:44 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1313 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:45.158124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3f59ea81-3058-45c8-931f-dc6cf6651799 req-0bb7100c-fb1b-496e-af40-3868b7175a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7", "name": "network-vif-unplugged", "status": "completed", "tag": "871c6aba-a220-472d-bb9a-015670319816"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:45.180822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3f59ea81-3058-45c8-931f-dc6cf6651799 req-0bb7100c-fb1b-496e-af40-3868b7175a58 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:45.181315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3f59ea81-3058-45c8-931f-dc6cf6651799 req-0bb7100c-fb1b-496e-af40-3868b7175a58 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:45.181752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3f59ea81-3058-45c8-931f-dc6cf6651799 req-0bb7100c-fb1b-496e-af40-3868b7175a58 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:45.211548 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3f59ea81-3058-45c8-931f-dc6cf6651799 req-0bb7100c-fb1b-496e-af40-3868b7175a58 service nova] Creating event network-vif-unplugged:871c6aba-a220-472d-bb9a-015670319816 for instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 on nch2-master-1 Sep 10 20:51:45.225049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-3f59ea81-3058-45c8-931f-dc6cf6651799 req-0bb7100c-fb1b-496e-af40-3868b7175a58 service nova] Instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:51:45.255873 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3f59ea81-3058-45c8-931f-dc6cf6651799 req-0bb7100c-fb1b-496e-af40-3868b7175a58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106239 Sep 10 20:51:45.256785 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 524/998] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:45.264075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:45.265302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:45.274074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:45.275337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:45.277081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:45.278361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:45.280528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:45.281442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:45.515783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:45.536733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:45.541445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:45.548539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8bff3091-0049-4303-9aad-0884bf38f175 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:45.557947 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-97b20f3f-1fa6-46cf-ab0d-09d5a300cb0f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.297179 Sep 10 20:51:45.558145 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8bff3091-0049-4303-9aad-0884bf38f175 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1476 microversion: 2.1 time: 0.466466 Sep 10 20:51:45.558611 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 525/999] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:45 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:45.574439 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 475/1000] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:45 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1476 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:45.587744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-abbb576b-3e6a-4cf3-8bb0-2bdda3c84211 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:45.588482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-abbb576b-3e6a-4cf3-8bb0-2bdda3c84211 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:45.598144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abbb576b-3e6a-4cf3-8bb0-2bdda3c84211 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:45.598753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abbb576b-3e6a-4cf3-8bb0-2bdda3c84211 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:45.599209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abbb576b-3e6a-4cf3-8bb0-2bdda3c84211 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:45.599937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abbb576b-3e6a-4cf3-8bb0-2bdda3c84211 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:45.600402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abbb576b-3e6a-4cf3-8bb0-2bdda3c84211 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:45.600889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abbb576b-3e6a-4cf3-8bb0-2bdda3c84211 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:46.053170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-abbb576b-3e6a-4cf3-8bb0-2bdda3c84211 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:46.067785 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-abbb576b-3e6a-4cf3-8bb0-2bdda3c84211 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1478 microversion: 2.1 time: 0.491390 Sep 10 20:51:46.073125 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 526/1001] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:45 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1478 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:46.101661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9d4cf70e-55d9-4031-95e7-7f9adcb37da9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '.version_select at 0x7f9944b71280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:46.113522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bb80175e-de49-4683-8044-990dd6fd2313 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:46.115223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bb80175e-de49-4683-8044-990dd6fd2313 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:46.118468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d4cf70e-55d9-4031-95e7-7f9adcb37da9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:46.122271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d4cf70e-55d9-4031-95e7-7f9adcb37da9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:46.123657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d4cf70e-55d9-4031-95e7-7f9adcb37da9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:46.139749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb80175e-de49-4683-8044-990dd6fd2313 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:46.141179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb80175e-de49-4683-8044-990dd6fd2313 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:46.141791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb80175e-de49-4683-8044-990dd6fd2313 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:46.144856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb80175e-de49-4683-8044-990dd6fd2313 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:46.147890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb80175e-de49-4683-8044-990dd6fd2313 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:46.148585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb80175e-de49-4683-8044-990dd6fd2313 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:46.153802 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9d4cf70e-55d9-4031-95e7-7f9adcb37da9 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1948 microversion: 2.1 time: 0.061399 Sep 10 20:51:46.168005 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 476/1002] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:51:46 2022] GET /compute/v2.1/os-migrations => generated 1948 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:46.177386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-62d64478-d7b6-4cbe-8306-b66087dce13f req-039d6e8a-708c-4a25-954d-9cdc70b365f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dd2771-3e57-4798-ab1e-c16e724ad6f4", "name": "network-vif-unplugged", "status": "completed", "tag": "5bf39bf7-b621-4388-8dd2-5fd139920258"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:46.201897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-62d64478-d7b6-4cbe-8306-b66087dce13f req-039d6e8a-708c-4a25-954d-9cdc70b365f2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:46.202674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-62d64478-d7b6-4cbe-8306-b66087dce13f req-039d6e8a-708c-4a25-954d-9cdc70b365f2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:46.203286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-62d64478-d7b6-4cbe-8306-b66087dce13f req-039d6e8a-708c-4a25-954d-9cdc70b365f2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:46.223374 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-62d64478-d7b6-4cbe-8306-b66087dce13f req-039d6e8a-708c-4a25-954d-9cdc70b365f2 service nova] Creating event network-vif-unplugged:5bf39bf7-b621-4388-8dd2-5fd139920258 for instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 on nch2-master-1 Sep 10 20:51:46.229077 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-62d64478-d7b6-4cbe-8306-b66087dce13f req-039d6e8a-708c-4a25-954d-9cdc70b365f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059380 Sep 10 20:51:46.230297 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 477/1003] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:46.235737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87be66cf-7b17-4e4a-8303-6013ec70b8be tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:46.236767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87be66cf-7b17-4e4a-8303-6013ec70b8be tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:46.245579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87be66cf-7b17-4e4a-8303-6013ec70b8be tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:46.246315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87be66cf-7b17-4e4a-8303-6013ec70b8be tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:46.246916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87be66cf-7b17-4e4a-8303-6013ec70b8be tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:46.247821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87be66cf-7b17-4e4a-8303-6013ec70b8be tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:46.248441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87be66cf-7b17-4e4a-8303-6013ec70b8be tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:46.249026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87be66cf-7b17-4e4a-8303-6013ec70b8be tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:46.571195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bb80175e-de49-4683-8044-990dd6fd2313 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:46.587710 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bb80175e-de49-4683-8044-990dd6fd2313 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1476 microversion: 2.1 time: 0.478026 Sep 10 20:51:46.591059 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 527/1004] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:46 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1476 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:51:46.603141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f8e2bca-c8d3-42e7-a692-3381e6077b2b tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:46.604140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f8e2bca-c8d3-42e7-a692-3381e6077b2b tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:46.618294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f8e2bca-c8d3-42e7-a692-3381e6077b2b tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:46.620523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f8e2bca-c8d3-42e7-a692-3381e6077b2b tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:46.622554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f8e2bca-c8d3-42e7-a692-3381e6077b2b tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:46.625321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f8e2bca-c8d3-42e7-a692-3381e6077b2b tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:46.626954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f8e2bca-c8d3-42e7-a692-3381e6077b2b tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:46.628872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f8e2bca-c8d3-42e7-a692-3381e6077b2b tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:46.915747 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f8e2bca-c8d3-42e7-a692-3381e6077b2b tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1629 microversion: 2.1 time: 0.322983 Sep 10 20:51:46.917818 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 528/1005] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:46 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1629 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:46.926369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a99ce716-ce92-4f98-a5b0-835c134448e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:46.927277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a99ce716-ce92-4f98-a5b0-835c134448e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:46.962917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:46.968441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99ce716-ce92-4f98-a5b0-835c134448e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:46.970865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99ce716-ce92-4f98-a5b0-835c134448e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:46.976790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99ce716-ce92-4f98-a5b0-835c134448e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:46.978460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99ce716-ce92-4f98-a5b0-835c134448e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:46.979115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99ce716-ce92-4f98-a5b0-835c134448e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:46.979833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99ce716-ce92-4f98-a5b0-835c134448e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:47.045316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-87be66cf-7b17-4e4a-8303-6013ec70b8be tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:47.058740 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-87be66cf-7b17-4e4a-8303-6013ec70b8be tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1313 microversion: 2.1 time: 0.827009 Sep 10 20:51:47.061342 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 478/1006] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:46 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1313 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:47.072704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:47.074659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:47.089774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:47.094292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:47.095434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:47.100633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:47.101367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:47.102024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:47.319746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:47.331255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:47.332739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:47.358937 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-19981c19-ff0a-49a2-87ad-e97b993fc51f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.296221 Sep 10 20:51:47.359563 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 479/1007] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:47 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:47.494810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a99ce716-ce92-4f98-a5b0-835c134448e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:47.510400 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a99ce716-ce92-4f98-a5b0-835c134448e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1476 microversion: 2.1 time: 0.588781 Sep 10 20:51:47.511015 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 529/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:46 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1476 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:47.529273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-63a64381-3495-422f-8192-b37b80124160 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Action: 'create', calling method: .version_select at 0x7f9944bc1e50>, body: {"keypair": {"name": "tempest-keypair-1298009359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRtEKh/QGOY720kytqhXodOWMG+LdzANYnj9UZuHk0Nmbhyv2cZ17Zbrq1vIpc3ouQJWCd1PnatNJR8SiOB4/olwpmbnrYtJgQdDTUobCO0ul8a9IeoKuqw6/j8Qnj9cg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:47.601950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-63a64381-3495-422f-8192-b37b80124160 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Getting quotas for project 5bd065954b0e4520a3c1deba0916db85. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:51:47.626386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-63a64381-3495-422f-8192-b37b80124160 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Getting quotas for user f74a2c8cd22c454fa8fdd7c2e1ef9230 and project 5bd065954b0e4520a3c1deba0916db85. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:51:47.643976 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [None req-63a64381-3495-422f-8192-b37b80124160 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [a9c96e39-1220-4d2e-ba7b-61e5a6215d33] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 20:51:47.713702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1506473359", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "b0d499aa-ce83-4d35-aad0-497f959cf650"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:47.851929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] validate_networks() for [('b0d499aa-ce83-4d35-aad0-497f959cf650', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:51:48.100850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:48.168312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:48.656649 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [None req-63a64381-3495-422f-8192-b37b80124160 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [a9c96e39-1220-4d2e-ba7b-61e5a6215d33] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 42476. Sep 10 20:51:48.685072 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-63a64381-3495-422f-8192-b37b80124160 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.167804 Sep 10 20:51:48.687037 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 530/1009] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:51:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:48.709954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d35961c0-ce0a-466d-87b1-ceb06b34b7a2 req-42d2d936-2cff-4362-94a5-b950dc2ee753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7", "tag": "871c6aba-a220-472d-bb9a-015670319816"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:48.738337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d35961c0-ce0a-466d-87b1-ceb06b34b7a2 req-42d2d936-2cff-4362-94a5-b950dc2ee753 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:48.739325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d35961c0-ce0a-466d-87b1-ceb06b34b7a2 req-42d2d936-2cff-4362-94a5-b950dc2ee753 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:48.741562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d35961c0-ce0a-466d-87b1-ceb06b34b7a2 req-42d2d936-2cff-4362-94a5-b950dc2ee753 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:48.802526 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d35961c0-ce0a-466d-87b1-ceb06b34b7a2 req-42d2d936-2cff-4362-94a5-b950dc2ee753 service nova] Creating event network-changed:871c6aba-a220-472d-bb9a-015670319816 for instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 on nch2-master-1 Sep 10 20:51:48.815485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-d35961c0-ce0a-466d-87b1-ceb06b34b7a2 req-42d2d936-2cff-4362-94a5-b950dc2ee753 service nova] Instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:51:48.832508 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d35961c0-ce0a-466d-87b1-ceb06b34b7a2 req-42d2d936-2cff-4362-94a5-b950dc2ee753 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142711 Sep 10 20:51:48.833134 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 531/1010] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:48.858316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-65340ecf-5f1c-456f-8f0b-1e23ac001b64 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:48.859335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-65340ecf-5f1c-456f-8f0b-1e23ac001b64 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:48.885050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65340ecf-5f1c-456f-8f0b-1e23ac001b64 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:48.886099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65340ecf-5f1c-456f-8f0b-1e23ac001b64 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:48.886643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65340ecf-5f1c-456f-8f0b-1e23ac001b64 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:48.887452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65340ecf-5f1c-456f-8f0b-1e23ac001b64 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:48.887969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65340ecf-5f1c-456f-8f0b-1e23ac001b64 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:48.889024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65340ecf-5f1c-456f-8f0b-1e23ac001b64 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:49.179281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-65340ecf-5f1c-456f-8f0b-1e23ac001b64 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:49.193233 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-65340ecf-5f1c-456f-8f0b-1e23ac001b64 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1476 microversion: 2.1 time: 0.357778 Sep 10 20:51:49.213359 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 532/1011] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:48 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:49.219265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-085ca8fb-6d2e-4d7c-ba1b-ceda0f97afc7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:49.219880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-085ca8fb-6d2e-4d7c-ba1b-ceda0f97afc7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:49.227680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-085ca8fb-6d2e-4d7c-ba1b-ceda0f97afc7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:49.228536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-085ca8fb-6d2e-4d7c-ba1b-ceda0f97afc7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:49.228987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-085ca8fb-6d2e-4d7c-ba1b-ceda0f97afc7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:49.229763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-085ca8fb-6d2e-4d7c-ba1b-ceda0f97afc7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:49.230301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-085ca8fb-6d2e-4d7c-ba1b-ceda0f97afc7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:49.231228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-085ca8fb-6d2e-4d7c-ba1b-ceda0f97afc7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:49.406818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:51:49.407363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:51:49.407707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:51:49.408268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:51:49.408749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:51:49.424641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:49.425138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:49.425573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:49.429813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:49.431020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:49.431458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:49.464928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:49.465442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-085ca8fb-6d2e-4d7c-ba1b-ceda0f97afc7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:49.477009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-085ca8fb-6d2e-4d7c-ba1b-ceda0f97afc7 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.262399 Sep 10 20:51:49.481252 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 533/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:49 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:49.482139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Getting quotas for project 8693bafb9e424052ab91e56e9e4da6e7. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:51:49.488689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Getting quotas for user 43b9b4d83834456388c99abd3ecae3c7 and project 8693bafb9e424052ab91e56e9e4da6e7. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:51:49.492861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:49.493498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:49.508519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:51:49.511894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:51:49.528029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:49.540409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:49.543279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:49.544151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:49.545958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:49.546752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:49.550109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:49.625911 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-527ba424-89e8-4856-8ffe-711b310ab376 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.238901 Sep 10 20:51:49.629932 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 480/1013] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:51:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:51:49.642992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7ac7b24-a65a-465c-b239-12defa9210f6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:49.644138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b7ac7b24-a65a-465c-b239-12defa9210f6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:49.659262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7ac7b24-a65a-465c-b239-12defa9210f6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:49.661279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7ac7b24-a65a-465c-b239-12defa9210f6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:49.662189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7ac7b24-a65a-465c-b239-12defa9210f6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:49.663874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7ac7b24-a65a-465c-b239-12defa9210f6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:49.664686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7ac7b24-a65a-465c-b239-12defa9210f6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:49.665399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7ac7b24-a65a-465c-b239-12defa9210f6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:49.912098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:49.922811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:49.926020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:49.953491 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-83f9de62-00e9-4eb1-b81f-03d6ca2c2eca tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.470825 Sep 10 20:51:49.975854 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 534/1014] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:49 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:49.988221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10e7bebc-fd31-47e4-9cc8-789e01882def tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:49.999155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10e7bebc-fd31-47e4-9cc8-789e01882def tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:50.186879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10e7bebc-fd31-47e4-9cc8-789e01882def tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:50.195353 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-10e7bebc-fd31-47e4-9cc8-789e01882def tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1216 microversion: 2.1 time: 0.218019 Sep 10 20:51:50.199546 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 535/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:49 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1216 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:50.223592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2d2f567d-82df-480a-8e43-6feb8b26c959 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:50.224747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2d2f567d-82df-480a-8e43-6feb8b26c959 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:50.251467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d2f567d-82df-480a-8e43-6feb8b26c959 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:50.257306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d2f567d-82df-480a-8e43-6feb8b26c959 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:50.258041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d2f567d-82df-480a-8e43-6feb8b26c959 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:50.259056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d2f567d-82df-480a-8e43-6feb8b26c959 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:50.259691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d2f567d-82df-480a-8e43-6feb8b26c959 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:50.260918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d2f567d-82df-480a-8e43-6feb8b26c959 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:51.062522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7ac7b24-a65a-465c-b239-12defa9210f6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:51.082666 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b7ac7b24-a65a-465c-b239-12defa9210f6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1474 microversion: 2.1 time: 1.448191 Sep 10 20:51:51.083685 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 481/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:49 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1474 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:51.098366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b36643b3-1905-43f7-a7fa-49a96f9cce3d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:51.099671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b36643b3-1905-43f7-a7fa-49a96f9cce3d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:51.109435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2d2f567d-82df-480a-8e43-6feb8b26c959 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:51.119159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b36643b3-1905-43f7-a7fa-49a96f9cce3d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:51.121379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b36643b3-1905-43f7-a7fa-49a96f9cce3d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:51.123398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b36643b3-1905-43f7-a7fa-49a96f9cce3d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:51.124575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b36643b3-1905-43f7-a7fa-49a96f9cce3d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:51.125624 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2d2f567d-82df-480a-8e43-6feb8b26c959 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1476 microversion: 2.1 time: 0.905455 Sep 10 20:51:51.129911 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 536/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:50 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1476 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:51.145263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b36643b3-1905-43f7-a7fa-49a96f9cce3d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:51.145792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b36643b3-1905-43f7-a7fa-49a96f9cce3d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:51.147774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-71c7bd89-cc60-414d-a369-f40587cf4a9f req-00a94c48-36e4-4602-bc3d-e98bc5899a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dd2771-3e57-4798-ab1e-c16e724ad6f4", "name": "network-vif-plugged", "status": "completed", "tag": "5bf39bf7-b621-4388-8dd2-5fd139920258"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:51.178527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-71c7bd89-cc60-414d-a369-f40587cf4a9f req-00a94c48-36e4-4602-bc3d-e98bc5899a08 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:51.181214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-71c7bd89-cc60-414d-a369-f40587cf4a9f req-00a94c48-36e4-4602-bc3d-e98bc5899a08 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:51.186267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-71c7bd89-cc60-414d-a369-f40587cf4a9f req-00a94c48-36e4-4602-bc3d-e98bc5899a08 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:51.224574 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-71c7bd89-cc60-414d-a369-f40587cf4a9f req-00a94c48-36e4-4602-bc3d-e98bc5899a08 service nova] Creating event network-vif-plugged:5bf39bf7-b621-4388-8dd2-5fd139920258 for instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 on nch2-master-1 Sep 10 20:51:51.239325 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-71c7bd89-cc60-414d-a369-f40587cf4a9f req-00a94c48-36e4-4602-bc3d-e98bc5899a08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107199 Sep 10 20:51:51.241115 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 537/1018] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:51.260718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:51.261721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:51.270842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:51.271663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:51.272412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:51.273699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:51.274479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:51.275798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:51.908913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b36643b3-1905-43f7-a7fa-49a96f9cce3d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:51.918232 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b36643b3-1905-43f7-a7fa-49a96f9cce3d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.833176 Sep 10 20:51:51.925983 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 482/1019] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:51 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:51.988516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3fc7d548-a1c3-4838-b412-4ab03e9501b3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:52.024191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3fc7d548-a1c3-4838-b412-4ab03e9501b3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:52.046086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc7d548-a1c3-4838-b412-4ab03e9501b3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:52.047434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc7d548-a1c3-4838-b412-4ab03e9501b3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:52.048437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc7d548-a1c3-4838-b412-4ab03e9501b3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:52.050809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc7d548-a1c3-4838-b412-4ab03e9501b3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:52.052028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc7d548-a1c3-4838-b412-4ab03e9501b3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:52.055072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc7d548-a1c3-4838-b412-4ab03e9501b3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:52.274126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:52.288079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:52.291179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:52.303680 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bc17f228-7258-4e57-90a0-f38eb5970821 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 1.059875 Sep 10 20:51:52.309134 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 538/1020] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:51 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:52.324646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f0a7057a-24e8-43b8-8ef5-826a617ac88c req-95ac000c-ff2f-45b5-a1e5-a6dcae7173ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ab18ac-abbb-4b86-a739-eb4573268835", "tag": "c2ee03b7-df23-46e9-96bd-88920f75922c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:52.341886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f0a7057a-24e8-43b8-8ef5-826a617ac88c req-95ac000c-ff2f-45b5-a1e5-a6dcae7173ef service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:52.342615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f0a7057a-24e8-43b8-8ef5-826a617ac88c req-95ac000c-ff2f-45b5-a1e5-a6dcae7173ef service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:52.344873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f0a7057a-24e8-43b8-8ef5-826a617ac88c req-95ac000c-ff2f-45b5-a1e5-a6dcae7173ef service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:52.370778 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f0a7057a-24e8-43b8-8ef5-826a617ac88c req-95ac000c-ff2f-45b5-a1e5-a6dcae7173ef service nova] Creating event network-changed:c2ee03b7-df23-46e9-96bd-88920f75922c for instance f2ab18ac-abbb-4b86-a739-eb4573268835 on nch1-master-1 Sep 10 20:51:52.391482 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f0a7057a-24e8-43b8-8ef5-826a617ac88c req-95ac000c-ff2f-45b5-a1e5-a6dcae7173ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079441 Sep 10 20:51:52.399094 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 539/1021] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:52.422299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-57b7a6d5-fa1c-46b0-8122-49eb4b3406a1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:52.423602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-57b7a6d5-fa1c-46b0-8122-49eb4b3406a1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:52.437667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57b7a6d5-fa1c-46b0-8122-49eb4b3406a1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:52.438772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57b7a6d5-fa1c-46b0-8122-49eb4b3406a1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:52.439464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57b7a6d5-fa1c-46b0-8122-49eb4b3406a1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:52.441072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57b7a6d5-fa1c-46b0-8122-49eb4b3406a1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:52.441867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57b7a6d5-fa1c-46b0-8122-49eb4b3406a1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:52.442522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57b7a6d5-fa1c-46b0-8122-49eb4b3406a1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:52.948248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3fc7d548-a1c3-4838-b412-4ab03e9501b3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:52.962259 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3fc7d548-a1c3-4838-b412-4ab03e9501b3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1268 microversion: 2.1 time: 1.034660 Sep 10 20:51:52.963324 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 483/1022] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:51 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1268 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:52.997521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-803c0f85-5b58-498f-803d-3121b29e8e7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:52.999248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-803c0f85-5b58-498f-803d-3121b29e8e7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:53.015040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803c0f85-5b58-498f-803d-3121b29e8e7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:53.018967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803c0f85-5b58-498f-803d-3121b29e8e7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:53.022479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803c0f85-5b58-498f-803d-3121b29e8e7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:53.023610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803c0f85-5b58-498f-803d-3121b29e8e7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:53.024336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803c0f85-5b58-498f-803d-3121b29e8e7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:53.025270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803c0f85-5b58-498f-803d-3121b29e8e7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:53.583198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-803c0f85-5b58-498f-803d-3121b29e8e7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:53.592717 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-803c0f85-5b58-498f-803d-3121b29e8e7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1476 microversion: 2.1 time: 0.608326 Sep 10 20:51:53.622393 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 484/1023] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:52 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1476 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:53.630757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fcb327f0-d7b5-451c-915c-b4ed8fff81e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:53.631629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fcb327f0-d7b5-451c-915c-b4ed8fff81e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:53.642562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-57b7a6d5-fa1c-46b0-8122-49eb4b3406a1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:53.653149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:53.653632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb327f0-d7b5-451c-915c-b4ed8fff81e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:53.654322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb327f0-d7b5-451c-915c-b4ed8fff81e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:53.654610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb327f0-d7b5-451c-915c-b4ed8fff81e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:53.655363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb327f0-d7b5-451c-915c-b4ed8fff81e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:53.655799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb327f0-d7b5-451c-915c-b4ed8fff81e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:53.656524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb327f0-d7b5-451c-915c-b4ed8fff81e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:53.671293 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-57b7a6d5-fa1c-46b0-8122-49eb4b3406a1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1471 microversion: 2.1 time: 1.270615 Sep 10 20:51:53.682299 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 540/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:52 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1471 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:53.697203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:53.698525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:53.707917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:53.710575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:53.711315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:53.712754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:53.713494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:53.714134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:53.853162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:53.866941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:53.868516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:53.877065 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b3d60b30-2bfc-403a-bfd6-be793e4ff2e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.192599 Sep 10 20:51:53.889849 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 541/1025] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:53 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:53.889849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-205da0d2-b8a8-4da7-883c-b108669b1036 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:53.889849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-205da0d2-b8a8-4da7-883c-b108669b1036 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:53.896790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-205da0d2-b8a8-4da7-883c-b108669b1036 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:53.896790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-205da0d2-b8a8-4da7-883c-b108669b1036 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:53.896790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-205da0d2-b8a8-4da7-883c-b108669b1036 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:53.897366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-205da0d2-b8a8-4da7-883c-b108669b1036 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:53.897988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-205da0d2-b8a8-4da7-883c-b108669b1036 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:53.900588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-205da0d2-b8a8-4da7-883c-b108669b1036 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:53.988317 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-205da0d2-b8a8-4da7-883c-b108669b1036 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7/action" status: 204 len: 0 microversion: 2.1 time: 0.108406 Sep 10 20:51:53.992722 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 542/1026] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:51:53 2022] POST /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7/action => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:51:54.006895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e079ac8-af3c-4d60-aa1d-42386f7daf44 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:54.007634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e079ac8-af3c-4d60-aa1d-42386f7daf44 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:54.037968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e079ac8-af3c-4d60-aa1d-42386f7daf44 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:54.038481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e079ac8-af3c-4d60-aa1d-42386f7daf44 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:54.038929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e079ac8-af3c-4d60-aa1d-42386f7daf44 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:54.039657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e079ac8-af3c-4d60-aa1d-42386f7daf44 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:54.040124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e079ac8-af3c-4d60-aa1d-42386f7daf44 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:54.040559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e079ac8-af3c-4d60-aa1d-42386f7daf44 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:54.259050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e079ac8-af3c-4d60-aa1d-42386f7daf44 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:54.269609 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e079ac8-af3c-4d60-aa1d-42386f7daf44 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1274 microversion: 2.1 time: 0.278963 Sep 10 20:51:54.273623 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 543/1027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:53 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1274 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:54.287457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-08f8ddd5-291d-45ca-8c80-b330b11b9b84 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:54.288363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-08f8ddd5-291d-45ca-8c80-b330b11b9b84 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:54.300280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08f8ddd5-291d-45ca-8c80-b330b11b9b84 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:54.310781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08f8ddd5-291d-45ca-8c80-b330b11b9b84 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:54.311517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08f8ddd5-291d-45ca-8c80-b330b11b9b84 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:54.312467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08f8ddd5-291d-45ca-8c80-b330b11b9b84 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:54.313092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08f8ddd5-291d-45ca-8c80-b330b11b9b84 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:54.313690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08f8ddd5-291d-45ca-8c80-b330b11b9b84 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:54.701426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-08f8ddd5-291d-45ca-8c80-b330b11b9b84 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:54.709342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fcb327f0-d7b5-451c-915c-b4ed8fff81e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:54.711695 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-08f8ddd5-291d-45ca-8c80-b330b11b9b84 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1471 microversion: 2.1 time: 0.435774 Sep 10 20:51:54.730220 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 544/1028] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:54 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1471 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:54.732033 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fcb327f0-d7b5-451c-915c-b4ed8fff81e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 1.107929 Sep 10 20:51:54.735732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-364394156", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f3aabbf6-b101-4d74-914c-9c1510387333"}], "security_groups": [{"name": "tempest-securitygroup--140422292"}], "key_name": "tempest-keypair-1298009359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:54.741442 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 485/1029] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:53 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:54.772926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-84867911-2518-401c-b169-6aeacb589939 req-1977fa12-2fc2-44ab-a48a-87ada888a993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7", "name": "network-vif-plugged", "status": "completed", "tag": "871c6aba-a220-472d-bb9a-015670319816"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:54.796547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-84867911-2518-401c-b169-6aeacb589939 req-1977fa12-2fc2-44ab-a48a-87ada888a993 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:54.797231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-84867911-2518-401c-b169-6aeacb589939 req-1977fa12-2fc2-44ab-a48a-87ada888a993 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:54.798016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-84867911-2518-401c-b169-6aeacb589939 req-1977fa12-2fc2-44ab-a48a-87ada888a993 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:54.821764 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-84867911-2518-401c-b169-6aeacb589939 req-1977fa12-2fc2-44ab-a48a-87ada888a993 service nova] Creating event network-vif-plugged:871c6aba-a220-472d-bb9a-015670319816 for instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 on nch2-master-1 Sep 10 20:51:54.831845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-84867911-2518-401c-b169-6aeacb589939 req-1977fa12-2fc2-44ab-a48a-87ada888a993 service nova] Instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:51:54.847717 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-84867911-2518-401c-b169-6aeacb589939 req-1977fa12-2fc2-44ab-a48a-87ada888a993 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104882 Sep 10 20:51:54.848901 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 486/1030] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:54.863004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2c5c5433-0a5a-49a7-82d2-931e4321660d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:54.867504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2c5c5433-0a5a-49a7-82d2-931e4321660d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:54.884271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c5c5433-0a5a-49a7-82d2-931e4321660d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:54.885188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c5c5433-0a5a-49a7-82d2-931e4321660d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:54.885806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c5c5433-0a5a-49a7-82d2-931e4321660d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:54.886848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c5c5433-0a5a-49a7-82d2-931e4321660d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:54.889029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c5c5433-0a5a-49a7-82d2-931e4321660d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:54.891105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c5c5433-0a5a-49a7-82d2-931e4321660d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:54.938335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] validate_networks() for [('f3aabbf6-b101-4d74-914c-9c1510387333', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:51:55.477390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2c5c5433-0a5a-49a7-82d2-931e4321660d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:55.500527 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2c5c5433-0a5a-49a7-82d2-931e4321660d tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1476 microversion: 2.1 time: 0.639759 Sep 10 20:51:55.503962 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 487/1031] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:54 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1476 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:55.520060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:55.528840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:55.543385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:55.547545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:55.548291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:55.549433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:55.551634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:55.552309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:55.723268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:55.748950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:55.754759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:55.763296 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7f9d9c44-85ed-4af1-8270-9472881a1ac6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.256402 Sep 10 20:51:55.764186 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 488/1032] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:55 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:55.769538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8235a8fe-d906-494d-8e38-eb17f05c05be tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:55.770493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8235a8fe-d906-494d-8e38-eb17f05c05be tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:55.776896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8235a8fe-d906-494d-8e38-eb17f05c05be tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:55.778420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8235a8fe-d906-494d-8e38-eb17f05c05be tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:55.779117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8235a8fe-d906-494d-8e38-eb17f05c05be tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:55.780061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8235a8fe-d906-494d-8e38-eb17f05c05be tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:55.780766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8235a8fe-d906-494d-8e38-eb17f05c05be tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:55.781410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8235a8fe-d906-494d-8e38-eb17f05c05be tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:55.815741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:51:55.817032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:51:55.817783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:51:55.818462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:51:55.818950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:51:55.839224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:55.843297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:55.844100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:55.845119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:55.845799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:55.852418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:55.876160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Getting quotas for project 5bd065954b0e4520a3c1deba0916db85. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:51:55.887553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Getting quotas for user f74a2c8cd22c454fa8fdd7c2e1ef9230 and project 5bd065954b0e4520a3c1deba0916db85. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:51:55.917318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:51:55.921254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:51:56.012442 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3775fbcb-5f89-4e4c-8d92-d9e25ce1c6ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.280138 Sep 10 20:51:56.014391 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 545/1033] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:51:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:51:56.025984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b6df1096-873e-4952-a49a-d61cfa2b0d21 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:56.027076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b6df1096-873e-4952-a49a-d61cfa2b0d21 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:56.036667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6df1096-873e-4952-a49a-d61cfa2b0d21 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:56.040637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6df1096-873e-4952-a49a-d61cfa2b0d21 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:56.041377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6df1096-873e-4952-a49a-d61cfa2b0d21 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:56.042403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6df1096-873e-4952-a49a-d61cfa2b0d21 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:56.043303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6df1096-873e-4952-a49a-d61cfa2b0d21 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:56.044876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6df1096-873e-4952-a49a-d61cfa2b0d21 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:56.463848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b6df1096-873e-4952-a49a-d61cfa2b0d21 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:56.476649 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b6df1096-873e-4952-a49a-d61cfa2b0d21 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1471 microversion: 2.1 time: 0.458936 Sep 10 20:51:56.478072 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 546/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:56 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1471 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:56.489118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4202be60-d876-4896-8fb0-0e9c1e93dbbb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:56.493520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4202be60-d876-4896-8fb0-0e9c1e93dbbb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:56.512496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4202be60-d876-4896-8fb0-0e9c1e93dbbb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:56.513368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4202be60-d876-4896-8fb0-0e9c1e93dbbb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:56.514869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4202be60-d876-4896-8fb0-0e9c1e93dbbb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:56.518315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4202be60-d876-4896-8fb0-0e9c1e93dbbb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:56.519919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4202be60-d876-4896-8fb0-0e9c1e93dbbb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:56.546750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4202be60-d876-4896-8fb0-0e9c1e93dbbb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:56.784885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8235a8fe-d906-494d-8e38-eb17f05c05be tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:56.809347 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8235a8fe-d906-494d-8e38-eb17f05c05be tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 1.042835 Sep 10 20:51:56.811737 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 489/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:55 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:56.829038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-10b24ccf-db34-49d0-a252-d83aa654ee4d req-9642b0c7-e7a6-4e2b-b7e8-15a6cf8d72da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ab18ac-abbb-4b86-a739-eb4573268835", "tag": "3465ced5-070f-4639-a30b-ff9bf4505ea6"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:56.892305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-10b24ccf-db34-49d0-a252-d83aa654ee4d req-9642b0c7-e7a6-4e2b-b7e8-15a6cf8d72da service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:56.897474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-10b24ccf-db34-49d0-a252-d83aa654ee4d req-9642b0c7-e7a6-4e2b-b7e8-15a6cf8d72da service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:56.899408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-10b24ccf-db34-49d0-a252-d83aa654ee4d req-9642b0c7-e7a6-4e2b-b7e8-15a6cf8d72da service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:56.970435 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-10b24ccf-db34-49d0-a252-d83aa654ee4d req-9642b0c7-e7a6-4e2b-b7e8-15a6cf8d72da service nova] Creating event network-changed:3465ced5-070f-4639-a30b-ff9bf4505ea6 for instance f2ab18ac-abbb-4b86-a739-eb4573268835 on nch1-master-1 Sep 10 20:51:56.992772 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-10b24ccf-db34-49d0-a252-d83aa654ee4d req-9642b0c7-e7a6-4e2b-b7e8-15a6cf8d72da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178638 Sep 10 20:51:56.998168 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 490/1036] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:51:57.004023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4b99266c-52e7-4b0f-9f7d-8f0dc1ea9ed1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:57.004800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4b99266c-52e7-4b0f-9f7d-8f0dc1ea9ed1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:57.248431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4202be60-d876-4896-8fb0-0e9c1e93dbbb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:57.267371 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4202be60-d876-4896-8fb0-0e9c1e93dbbb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.786679 Sep 10 20:51:57.271280 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 547/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:56 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:57.285919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fa47c37b-2802-48e2-bb4b-74d97a846f0f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:57.287076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fa47c37b-2802-48e2-bb4b-74d97a846f0f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:57.314264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa47c37b-2802-48e2-bb4b-74d97a846f0f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:57.316140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa47c37b-2802-48e2-bb4b-74d97a846f0f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:57.317020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa47c37b-2802-48e2-bb4b-74d97a846f0f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:57.329853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa47c37b-2802-48e2-bb4b-74d97a846f0f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:57.330867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa47c37b-2802-48e2-bb4b-74d97a846f0f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:57.332249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa47c37b-2802-48e2-bb4b-74d97a846f0f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:57.714354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b99266c-52e7-4b0f-9f7d-8f0dc1ea9ed1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:57.728942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fa47c37b-2802-48e2-bb4b-74d97a846f0f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:57.738976 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fa47c37b-2802-48e2-bb4b-74d97a846f0f tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1461 microversion: 2.1 time: 0.463946 Sep 10 20:51:57.741715 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4b99266c-52e7-4b0f-9f7d-8f0dc1ea9ed1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1234 microversion: 2.1 time: 0.742072 Sep 10 20:51:57.747214 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 548/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:57 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1461 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:57.748378 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 491/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:56 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1234 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:57.773619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:57.777886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7518e53d-f21b-4d7c-b805-f871e412afec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:57.778505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7518e53d-f21b-4d7c-b805-f871e412afec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:57.786709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:57.803923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7518e53d-f21b-4d7c-b805-f871e412afec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:57.805250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:57.806082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:57.807441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7518e53d-f21b-4d7c-b805-f871e412afec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:57.808178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:57.819535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7518e53d-f21b-4d7c-b805-f871e412afec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:57.820198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:57.821557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7518e53d-f21b-4d7c-b805-f871e412afec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:57.821962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:57.822569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:57.823205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7518e53d-f21b-4d7c-b805-f871e412afec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:57.829072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7518e53d-f21b-4d7c-b805-f871e412afec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.050429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:58.068013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:58.075023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:58.089266 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1dcda82e-68c7-4d05-b00a-b5aa49ab2f82 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1555 microversion: 2.91 time: 0.338771 Sep 10 20:51:58.092876 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 549/1040] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:57 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1555 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:58.100041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8325d6d7-1f54-4ce6-82b6-5d69cf3cfb9e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:58.105876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8325d6d7-1f54-4ce6-82b6-5d69cf3cfb9e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:58.118487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8325d6d7-1f54-4ce6-82b6-5d69cf3cfb9e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.119336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8325d6d7-1f54-4ce6-82b6-5d69cf3cfb9e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.120741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8325d6d7-1f54-4ce6-82b6-5d69cf3cfb9e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.121686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8325d6d7-1f54-4ce6-82b6-5d69cf3cfb9e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.125026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8325d6d7-1f54-4ce6-82b6-5d69cf3cfb9e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.134630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8325d6d7-1f54-4ce6-82b6-5d69cf3cfb9e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.244575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7518e53d-f21b-4d7c-b805-f871e412afec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:58.256544 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8325d6d7-1f54-4ce6-82b6-5d69cf3cfb9e tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action" status: 202 len: 0 microversion: 2.1 time: 0.161715 Sep 10 20:51:58.258518 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 550/1041] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:51:58 2022] POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:51:58.260666 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7518e53d-f21b-4d7c-b805-f871e412afec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1463 microversion: 2.1 time: 0.509255 Sep 10 20:51:58.264887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cf42a405-bc91-4090-8617-fb728391aa8c tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:58.266042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cf42a405-bc91-4090-8617-fb728391aa8c tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:58.270933 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 492/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:57 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1463 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:58.273813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf42a405-bc91-4090-8617-fb728391aa8c tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.274637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf42a405-bc91-4090-8617-fb728391aa8c tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.275264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf42a405-bc91-4090-8617-fb728391aa8c tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.276359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf42a405-bc91-4090-8617-fb728391aa8c tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.277005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf42a405-bc91-4090-8617-fb728391aa8c tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.277536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:58.277724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf42a405-bc91-4090-8617-fb728391aa8c tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.282424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:58.294940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.295699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.296304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.297282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.297933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.298528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.338709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.339458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.340063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.340786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lazy-loading 'fault' on Instance uuid d3dd2771-3e57-4798-ab1e-c16e724ad6f4 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:51:58.615609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cf42a405-bc91-4090-8617-fb728391aa8c tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:58.627568 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cf42a405-bc91-4090-8617-fb728391aa8c tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 0.367392 Sep 10 20:51:58.628163 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 551/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:58 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:58.642498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ef1be6f-734b-4b55-b995-7ebdfcae0e14 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:58.644502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0ef1be6f-734b-4b55-b995-7ebdfcae0e14 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:58.660098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ef1be6f-734b-4b55-b995-7ebdfcae0e14 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.661043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ef1be6f-734b-4b55-b995-7ebdfcae0e14 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.661963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ef1be6f-734b-4b55-b995-7ebdfcae0e14 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.663075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ef1be6f-734b-4b55-b995-7ebdfcae0e14 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.663687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ef1be6f-734b-4b55-b995-7ebdfcae0e14 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.664488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ef1be6f-734b-4b55-b995-7ebdfcae0e14 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.859223 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-46563f4d-0d37-45ed-9b87-ac76765f98b5 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1595 microversion: 2.1 time: 0.586221 Sep 10 20:51:58.874837 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 493/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:58 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1595 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:58.883443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0235ae61-a1c4-4cd2-99aa-bedd0ed24b61 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:58.884079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0235ae61-a1c4-4cd2-99aa-bedd0ed24b61 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:58.890338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0235ae61-a1c4-4cd2-99aa-bedd0ed24b61 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.891259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0235ae61-a1c4-4cd2-99aa-bedd0ed24b61 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.891979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0235ae61-a1c4-4cd2-99aa-bedd0ed24b61 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:58.894413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0235ae61-a1c4-4cd2-99aa-bedd0ed24b61 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:58.895252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0235ae61-a1c4-4cd2-99aa-bedd0ed24b61 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:58.895866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0235ae61-a1c4-4cd2-99aa-bedd0ed24b61 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:59.036098 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0ef1be6f-734b-4b55-b995-7ebdfcae0e14 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1614 microversion: 2.1 time: 0.404352 Sep 10 20:51:59.036781 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 552/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:58 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1614 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:59.041487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ce5b280f-547d-4c99-adef-6039f2ed620a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:59.042440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ce5b280f-547d-4c99-adef-6039f2ed620a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:59.049077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce5b280f-547d-4c99-adef-6039f2ed620a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:59.049665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce5b280f-547d-4c99-adef-6039f2ed620a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:59.050878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce5b280f-547d-4c99-adef-6039f2ed620a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:59.051282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce5b280f-547d-4c99-adef-6039f2ed620a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:59.051981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce5b280f-547d-4c99-adef-6039f2ed620a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:59.052487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce5b280f-547d-4c99-adef-6039f2ed620a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:59.174818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ce5b280f-547d-4c99-adef-6039f2ed620a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:59.184041 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ce5b280f-547d-4c99-adef-6039f2ed620a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1292 microversion: 2.1 time: 0.146012 Sep 10 20:51:59.184724 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 553/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:59 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1292 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:59.189361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8baca6dc-a093-4afc-a631-826913a9324c tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:59.192594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8baca6dc-a093-4afc-a631-826913a9324c tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:59.199526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8baca6dc-a093-4afc-a631-826913a9324c tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:59.200029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8baca6dc-a093-4afc-a631-826913a9324c tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:59.200490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8baca6dc-a093-4afc-a631-826913a9324c tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:59.201201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8baca6dc-a093-4afc-a631-826913a9324c tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:59.201652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8baca6dc-a093-4afc-a631-826913a9324c tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:59.202106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8baca6dc-a093-4afc-a631-826913a9324c tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:59.250544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:59.301272 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8baca6dc-a093-4afc-a631-826913a9324c tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action" status: 202 len: 0 microversion: 2.1 time: 0.115054 Sep 10 20:51:59.306013 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 554/1047] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:51:59 2022] POST /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:51:59.311634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-30a9040c-439d-42a0-8395-caf077f2d2ae tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '.version_select at 0x7f9944bddee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:59.313521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0235ae61-a1c4-4cd2-99aa-bedd0ed24b61 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:59.316021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30a9040c-439d-42a0-8395-caf077f2d2ae tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:59.316522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30a9040c-439d-42a0-8395-caf077f2d2ae tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:59.317130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30a9040c-439d-42a0-8395-caf077f2d2ae tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:59.326521 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0235ae61-a1c4-4cd2-99aa-bedd0ed24b61 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.447646 Sep 10 20:51:59.327821 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 494/1048] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:58 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:59.328887 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-30a9040c-439d-42a0-8395-caf077f2d2ae tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.021223 Sep 10 20:51:59.339696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:59.342706 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 555/1049] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:51:59 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:51:59.343299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:59.352818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6e4933ee-a288-47bf-9ef8-73e724cac5e8 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:51:59.353387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6e4933ee-a288-47bf-9ef8-73e724cac5e8 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:51:59.359854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e4933ee-a288-47bf-9ef8-73e724cac5e8 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:59.360369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e4933ee-a288-47bf-9ef8-73e724cac5e8 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:59.360532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:59.360792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e4933ee-a288-47bf-9ef8-73e724cac5e8 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:59.361233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:59.361595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e4933ee-a288-47bf-9ef8-73e724cac5e8 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:59.362129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e4933ee-a288-47bf-9ef8-73e724cac5e8 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:59.363091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e4933ee-a288-47bf-9ef8-73e724cac5e8 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:59.363963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:59.366198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:51:59.366835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:51:59.368200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:51:59.466096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:51:59.575593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:59.586816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:59.588288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:51:59.595610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3e2fb939-971a-4854-81f2-5f9ceb3d8908 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1537 microversion: 2.91 time: 0.264965 Sep 10 20:51:59.597772 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 495/1050] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:51:59 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1537 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:51:59.603238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1336117059", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:51:59.665656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:52:00.008776 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6e4933ee-a288-47bf-9ef8-73e724cac5e8 tempest-ServersAdminTestJSON-744175023 tempest-ServersAdminTestJSON-744175023-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1612 microversion: 2.1 time: 0.664704 Sep 10 20:52:00.010774 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 556/1051] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:51:59 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1612 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:00.027861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f2291330-1b2b-4ce9-8a1e-f282c1458bf5 req-d51e940a-a6f8-4402-a710-693c268211a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac096a76-c7e3-4400-99c4-eac33e23490e", "tag": "fba41ad7-a3e8-4167-81ed-4370f3ecee4f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:00.048416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f2291330-1b2b-4ce9-8a1e-f282c1458bf5 req-d51e940a-a6f8-4402-a710-693c268211a4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.049191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f2291330-1b2b-4ce9-8a1e-f282c1458bf5 req-d51e940a-a6f8-4402-a710-693c268211a4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.049641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f2291330-1b2b-4ce9-8a1e-f282c1458bf5 req-d51e940a-a6f8-4402-a710-693c268211a4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.064056 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f2291330-1b2b-4ce9-8a1e-f282c1458bf5 req-d51e940a-a6f8-4402-a710-693c268211a4 service nova] Creating event network-changed:fba41ad7-a3e8-4167-81ed-4370f3ecee4f for instance ac096a76-c7e3-4400-99c4-eac33e23490e on nch2-master-1 Sep 10 20:52:00.072853 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f2291330-1b2b-4ce9-8a1e-f282c1458bf5 req-d51e940a-a6f8-4402-a710-693c268211a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058329 Sep 10 20:52:00.074690 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 557/1052] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:00.083829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5454867a-8099-47d8-9303-adbbab136edb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:00.084780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5454867a-8099-47d8-9303-adbbab136edb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:00.092727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5454867a-8099-47d8-9303-adbbab136edb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.093952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5454867a-8099-47d8-9303-adbbab136edb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.094600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5454867a-8099-47d8-9303-adbbab136edb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.095327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5454867a-8099-47d8-9303-adbbab136edb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.097226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5454867a-8099-47d8-9303-adbbab136edb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.097816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5454867a-8099-47d8-9303-adbbab136edb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.169665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:52:00.171616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:52:00.171616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:52:00.172031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:52:00.174693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:52:00.187697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.188224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.188671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.190096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.191156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.191977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.210595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for project d969d135196e409584d6647d5186c9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:52:00.215788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for user 870c4c66a15b4546bd981cfb5932b214 and project d969d135196e409584d6647d5186c9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:52:00.229933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:52:00.232289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:52:00.278793 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2a7589ed-58d9-40f4-a15e-1c7d6ddf3430 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679543 Sep 10 20:52:00.285328 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 496/1053] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:51:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:52:00.286375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d4070c27-a075-4d9a-9438-3ce610cb9faf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:00.287329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d4070c27-a075-4d9a-9438-3ce610cb9faf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:00.294029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4070c27-a075-4d9a-9438-3ce610cb9faf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.294516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4070c27-a075-4d9a-9438-3ce610cb9faf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.294950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4070c27-a075-4d9a-9438-3ce610cb9faf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.296097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4070c27-a075-4d9a-9438-3ce610cb9faf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.296782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4070c27-a075-4d9a-9438-3ce610cb9faf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.297131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4070c27-a075-4d9a-9438-3ce610cb9faf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.325074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d4070c27-a075-4d9a-9438-3ce610cb9faf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:52:00.391587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5454867a-8099-47d8-9303-adbbab136edb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:00.402445 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5454867a-8099-47d8-9303-adbbab136edb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 0.325247 Sep 10 20:52:00.403976 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 558/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:00 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:00.410141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-84036ea1-16f2-4114-b3b8-c47fa331bd84 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:00.410819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-84036ea1-16f2-4114-b3b8-c47fa331bd84 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:00.419207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84036ea1-16f2-4114-b3b8-c47fa331bd84 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.419881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84036ea1-16f2-4114-b3b8-c47fa331bd84 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.420339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84036ea1-16f2-4114-b3b8-c47fa331bd84 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.421147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84036ea1-16f2-4114-b3b8-c47fa331bd84 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.421996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84036ea1-16f2-4114-b3b8-c47fa331bd84 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.422562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84036ea1-16f2-4114-b3b8-c47fa331bd84 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.425365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d4070c27-a075-4d9a-9438-3ce610cb9faf tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 204 len: 0 microversion: 2.1 time: 0.144035 Sep 10 20:52:00.427132 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 497/1055] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:52:00 2022] DELETE /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:52:00.433775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-73198b0e-e0d9-4906-beed-4979c8514e8a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:00.434576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-73198b0e-e0d9-4906-beed-4979c8514e8a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:00.517456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-73198b0e-e0d9-4906-beed-4979c8514e8a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:00.526437 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-73198b0e-e0d9-4906-beed-4979c8514e8a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1213 microversion: 2.1 time: 0.097786 Sep 10 20:52:00.537848 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 498/1056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:00 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:00.537848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e12ddca-2970-4e06-9c27-4b29248a6781 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:00.537848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e12ddca-2970-4e06-9c27-4b29248a6781 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:00.544596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e12ddca-2970-4e06-9c27-4b29248a6781 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.545435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e12ddca-2970-4e06-9c27-4b29248a6781 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.545909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e12ddca-2970-4e06-9c27-4b29248a6781 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.546731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e12ddca-2970-4e06-9c27-4b29248a6781 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.547203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e12ddca-2970-4e06-9c27-4b29248a6781 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.547802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e12ddca-2970-4e06-9c27-4b29248a6781 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.555772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:00.732702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-84036ea1-16f2-4114-b3b8-c47fa331bd84 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:00.748141 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-84036ea1-16f2-4114-b3b8-c47fa331bd84 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.341527 Sep 10 20:52:00.750003 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 559/1057] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:00 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:00.775844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b167165-02e0-4e7d-aeb6-cc14b8b34e73 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:00.776474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b167165-02e0-4e7d-aeb6-cc14b8b34e73 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:00.787146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b167165-02e0-4e7d-aeb6-cc14b8b34e73 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.788081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b167165-02e0-4e7d-aeb6-cc14b8b34e73 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.788743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b167165-02e0-4e7d-aeb6-cc14b8b34e73 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.789644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b167165-02e0-4e7d-aeb6-cc14b8b34e73 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.790224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b167165-02e0-4e7d-aeb6-cc14b8b34e73 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.790846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b167165-02e0-4e7d-aeb6-cc14b8b34e73 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.816007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6e12ddca-2970-4e06-9c27-4b29248a6781 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:00.824712 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e12ddca-2970-4e06-9c27-4b29248a6781 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.296145 Sep 10 20:52:00.831257 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 499/1058] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:00 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:00.845436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:00.847047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:00.854932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.855674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.868166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.870720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:00.873088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:00.873808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:00.967812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:00.990330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:00.992365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:00.994520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b167165-02e0-4e7d-aeb6-cc14b8b34e73 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:00.998311 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ff46e7a9-9ecb-4138-9157-1b8b49cc25e9 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1537 microversion: 2.91 time: 0.165537 Sep 10 20:52:00.999233 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 500/1059] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:00 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:01.003781 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6b167165-02e0-4e7d-aeb6-cc14b8b34e73 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1469 microversion: 2.1 time: 0.252189 Sep 10 20:52:01.005256 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 560/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:00 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1469 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:01.007856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1753954d-e13d-4291-a482-55e429198748 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:01.008465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1753954d-e13d-4291-a482-55e429198748 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:01.014573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1753954d-e13d-4291-a482-55e429198748 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.015053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1753954d-e13d-4291-a482-55e429198748 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.015487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1753954d-e13d-4291-a482-55e429198748 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.016179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1753954d-e13d-4291-a482-55e429198748 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.016628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1753954d-e13d-4291-a482-55e429198748 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.017048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1753954d-e13d-4291-a482-55e429198748 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.153077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-1753954d-e13d-4291-a482-55e429198748 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid 3cd11ff4-6dda-414d-ab81-111f4762df68 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:01.166210 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1753954d-e13d-4291-a482-55e429198748 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 2343 microversion: 2.25 time: 0.162582 Sep 10 20:52:01.167102 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 501/1061] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:00 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 2343 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:01.191450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-78e4edcd-4aa3-42c6-83c4-04b8efc98bc6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:01.195124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78e4edcd-4aa3-42c6-83c4-04b8efc98bc6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.195608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78e4edcd-4aa3-42c6-83c4-04b8efc98bc6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.196043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78e4edcd-4aa3-42c6-83c4-04b8efc98bc6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.196781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78e4edcd-4aa3-42c6-83c4-04b8efc98bc6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.197233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78e4edcd-4aa3-42c6-83c4-04b8efc98bc6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.197658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78e4edcd-4aa3-42c6-83c4-04b8efc98bc6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.215186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:01.224477 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-78e4edcd-4aa3-42c6-83c4-04b8efc98bc6 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037428 Sep 10 20:52:01.225094 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 561/1062] 10.222.0.33 () {60 vars in 1217 bytes} [Sat Sep 10 20:52:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:52:01.429585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d297ad23-e838-4a84-b243-a50bcff30f07 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:01.430195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d297ad23-e838-4a84-b243-a50bcff30f07 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:01.436535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d297ad23-e838-4a84-b243-a50bcff30f07 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.437102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d297ad23-e838-4a84-b243-a50bcff30f07 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.437553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d297ad23-e838-4a84-b243-a50bcff30f07 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.438337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d297ad23-e838-4a84-b243-a50bcff30f07 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.438803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d297ad23-e838-4a84-b243-a50bcff30f07 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.439237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d297ad23-e838-4a84-b243-a50bcff30f07 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.550332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38883c7b-7a7b-4655-a4dd-7326d7637990 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:01.551028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38883c7b-7a7b-4655-a4dd-7326d7637990 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:01.564288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38883c7b-7a7b-4655-a4dd-7326d7637990 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.565366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38883c7b-7a7b-4655-a4dd-7326d7637990 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.566164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38883c7b-7a7b-4655-a4dd-7326d7637990 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.568538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38883c7b-7a7b-4655-a4dd-7326d7637990 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.572626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38883c7b-7a7b-4655-a4dd-7326d7637990 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.573104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38883c7b-7a7b-4655-a4dd-7326d7637990 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.657225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38883c7b-7a7b-4655-a4dd-7326d7637990 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:01.668236 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38883c7b-7a7b-4655-a4dd-7326d7637990 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1217 microversion: 2.1 time: 0.122319 Sep 10 20:52:01.669601 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 562/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:01 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:01.703949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d297ad23-e838-4a84-b243-a50bcff30f07 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:01.713150 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d297ad23-e838-4a84-b243-a50bcff30f07 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 0.287550 Sep 10 20:52:01.713732 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 502/1064] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:01 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:01.776959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8bff50b6-a569-40a3-89e8-50cce5595974 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:01.779127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8bff50b6-a569-40a3-89e8-50cce5595974 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:01.789875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bff50b6-a569-40a3-89e8-50cce5595974 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.790991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bff50b6-a569-40a3-89e8-50cce5595974 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.791871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bff50b6-a569-40a3-89e8-50cce5595974 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.792747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bff50b6-a569-40a3-89e8-50cce5595974 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.793369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bff50b6-a569-40a3-89e8-50cce5595974 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.794613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bff50b6-a569-40a3-89e8-50cce5595974 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.859602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d1e28697-3f8a-4199-8f5c-d3d23406da20 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:01.860518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d1e28697-3f8a-4199-8f5c-d3d23406da20 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:01.870660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1e28697-3f8a-4199-8f5c-d3d23406da20 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.871496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1e28697-3f8a-4199-8f5c-d3d23406da20 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.872581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1e28697-3f8a-4199-8f5c-d3d23406da20 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.873491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1e28697-3f8a-4199-8f5c-d3d23406da20 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:01.874266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1e28697-3f8a-4199-8f5c-d3d23406da20 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:01.875118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1e28697-3f8a-4199-8f5c-d3d23406da20 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:01.991574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8bff50b6-a569-40a3-89e8-50cce5595974 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:01.999992 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8bff50b6-a569-40a3-89e8-50cce5595974 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.231852 Sep 10 20:52:02.010222 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 563/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:01 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:02.051160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:02.052113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:02.061083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:02.061942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:02.063656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:02.069417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:02.070660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:02.071305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:02.110648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d1e28697-3f8a-4199-8f5c-d3d23406da20 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:02.120976 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d1e28697-3f8a-4199-8f5c-d3d23406da20 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.267340 Sep 10 20:52:02.121553 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 503/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:01 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:02.130341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0574a28-e1cb-404e-a0bd-29e26fc57993 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:02.135570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0574a28-e1cb-404e-a0bd-29e26fc57993 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:02.141949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0574a28-e1cb-404e-a0bd-29e26fc57993 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:02.143924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0574a28-e1cb-404e-a0bd-29e26fc57993 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:02.144473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0574a28-e1cb-404e-a0bd-29e26fc57993 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:02.145366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0574a28-e1cb-404e-a0bd-29e26fc57993 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:02.145986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0574a28-e1cb-404e-a0bd-29e26fc57993 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:02.146417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0574a28-e1cb-404e-a0bd-29e26fc57993 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:02.180809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:02.190351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:02.192369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:02.197858 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9e66832e-96f0-4e02-b0ab-3670fd62416a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1537 microversion: 2.91 time: 0.151996 Sep 10 20:52:02.198458 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 564/1067] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:02 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1537 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:02.295276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0574a28-e1cb-404e-a0bd-29e26fc57993 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:02.306809 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0574a28-e1cb-404e-a0bd-29e26fc57993 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1469 microversion: 2.1 time: 0.184053 Sep 10 20:52:02.307499 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 504/1068] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:02 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:02.499508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f195640f-c4ab-427e-b538-0dc37bc62782 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-671296142", "id": 1915921924, "os-flavor-access:is_public": "True"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:02.522330 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f195640f-c4ab-427e-b538-0dc37bc62782 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.169824 Sep 10 20:52:02.524423 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 565/1069] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:02 2022] POST /compute/v2.1/flavors => generated 429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:02.537268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0452fa6a-be5b-4d85-a50a-af5750b0d9fb tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:02.569191 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0452fa6a-be5b-4d85-a50a-af5750b0d9fb tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1915921924" status: 202 len: 0 microversion: 2.1 time: 0.036359 Sep 10 20:52:02.570395 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 505/1070] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 20:52:02 2022] DELETE /compute/v2.1/flavors/1915921924 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:02.578624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b6262dd0-4f71-4eab-b550-6814528fcfe4 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:02.601457 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b6262dd0-4f71-4eab-b550-6814528fcfe4 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026995 Sep 10 20:52:02.609581 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 566/1071] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:02.624777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-51cbdddc-6a06-4641-9167-1f6b308e09bf tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-210610169", "id": 146564033, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:02.645749 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-51cbdddc-6a06-4641-9167-1f6b308e09bf tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.025031 Sep 10 20:52:02.646881 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 506/1072] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:02 2022] POST /compute/v2.1/flavors => generated 413 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:02.659535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db0bdb0e-e73f-4bed-9b68-6e70f0e06fae tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:02.682657 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-db0bdb0e-e73f-4bed-9b68-6e70f0e06fae tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.027290 Sep 10 20:52:02.683788 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 567/1073] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:02 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:02.692687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2103ce07-0c6f-42f9-8fb6-d5bff776b4ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:02.693383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2103ce07-0c6f-42f9-8fb6-d5bff776b4ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:02.706560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f584dd44-e7f7-4355-b274-edbc52ba2b85 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:02.707687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2103ce07-0c6f-42f9-8fb6-d5bff776b4ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:02.708441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2103ce07-0c6f-42f9-8fb6-d5bff776b4ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:02.709074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2103ce07-0c6f-42f9-8fb6-d5bff776b4ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:02.710015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2103ce07-0c6f-42f9-8fb6-d5bff776b4ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:02.710667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2103ce07-0c6f-42f9-8fb6-d5bff776b4ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:02.711331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2103ce07-0c6f-42f9-8fb6-d5bff776b4ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:02.740421 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f584dd44-e7f7-4355-b274-edbc52ba2b85 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/146564033" status: 202 len: 0 microversion: 2.1 time: 0.038568 Sep 10 20:52:02.741565 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 568/1074] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:52:02 2022] DELETE /compute/v2.1/flavors/146564033 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:52:02.747660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-312f8916-f6e7-4356-b554-16134d533250 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:02.748276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-312f8916-f6e7-4356-b554-16134d533250 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:02.760132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f8916-f6e7-4356-b554-16134d533250 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:02.760925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f8916-f6e7-4356-b554-16134d533250 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:02.761532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f8916-f6e7-4356-b554-16134d533250 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:02.762431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f8916-f6e7-4356-b554-16134d533250 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:02.763038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f8916-f6e7-4356-b554-16134d533250 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:02.763629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f8916-f6e7-4356-b554-16134d533250 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:02.840496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2103ce07-0c6f-42f9-8fb6-d5bff776b4ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:02.850926 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2103ce07-0c6f-42f9-8fb6-d5bff776b4ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1217 microversion: 2.1 time: 0.162573 Sep 10 20:52:02.851676 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 507/1075] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:02 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:02.856430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e61da01-62a4-4f2b-9d31-cd83865d48eb tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:02.882553 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3e61da01-62a4-4f2b-9d31-cd83865d48eb tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029524 Sep 10 20:52:02.883538 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 508/1076] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:02.904308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4ca75a71-d797-4e77-8ef5-2dc32461dcb7 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2084850318", "id": 143973592, "os-flavor-access:is_public": "True"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:02.918302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:02.924978 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4ca75a71-d797-4e77-8ef5-2dc32461dcb7 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.024215 Sep 10 20:52:02.929805 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 509/1077] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:02 2022] POST /compute/v2.1/flavors => generated 426 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:02.938912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f60da69-f023-41a2-acea-5c122d646ca7 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:02.960009 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f60da69-f023-41a2-acea-5c122d646ca7 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/143973592" status: 202 len: 0 microversion: 2.1 time: 0.025903 Sep 10 20:52:02.962755 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 510/1078] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:52:02 2022] DELETE /compute/v2.1/flavors/143973592 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:52:02.975649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-79b285ff-02ff-4a9b-88d8-8842c2b51616 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.003423 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-79b285ff-02ff-4a9b-88d8-8842c2b51616 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032709 Sep 10 20:52:03.004525 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 511/1079] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:03.024642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-df6ceb39-1788-4a1e-a498-9fa2b3b73e61 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1320422839", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:03.033366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-312f8916-f6e7-4356-b554-16134d533250 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:03.043188 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-312f8916-f6e7-4356-b554-16134d533250 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 0.300309 Sep 10 20:52:03.044221 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 569/1080] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:02 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:03.048323 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-df6ceb39-1788-4a1e-a498-9fa2b3b73e61 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.027908 Sep 10 20:52:03.049418 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 512/1081] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:03 2022] POST /compute/v2.1/flavors => generated 507 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:03.061004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9e094a80-9299-4a2b-9381-4f21983e02d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.061319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-251d2f64-605e-48e0-a002-98c362cce42d tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.061683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9e094a80-9299-4a2b-9381-4f21983e02d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:03.068735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e094a80-9299-4a2b-9381-4f21983e02d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.069288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e094a80-9299-4a2b-9381-4f21983e02d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.069730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e094a80-9299-4a2b-9381-4f21983e02d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.070478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e094a80-9299-4a2b-9381-4f21983e02d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.070940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e094a80-9299-4a2b-9381-4f21983e02d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.071366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e094a80-9299-4a2b-9381-4f21983e02d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.081635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-251d2f64-605e-48e0-a002-98c362cce42d tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1a899254-4cd6-4ddd-99c9-3380cc80e915" status: 202 len: 0 microversion: 2.1 time: 0.023869 Sep 10 20:52:03.082421 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 513/1082] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:52:03 2022] DELETE /compute/v2.1/flavors/1a899254-4cd6-4ddd-99c9-3380cc80e915 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:03.090048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cb15d6e4-c51a-400c-b825-20c939e53342 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.113047 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cb15d6e4-c51a-400c-b825-20c939e53342 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025615 Sep 10 20:52:03.120116 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 514/1083] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:03.132324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c325c749-1116-4f3f-9132-82e32f988798 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-718588054", "id": "43d5d3eb-e6d0-4164-9f34-72d0ad1f3833", "os-flavor-access:is_public": "True"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:03.158129 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c325c749-1116-4f3f-9132-82e32f988798 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.029276 Sep 10 20:52:03.160177 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 515/1084] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:03 2022] POST /compute/v2.1/flavors => generated 506 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:03.165975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0e610933-497c-4540-b31a-0797796de981 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.166738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0e610933-497c-4540-b31a-0797796de981 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:03.175556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e610933-497c-4540-b31a-0797796de981 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.176059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e610933-497c-4540-b31a-0797796de981 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.176485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e610933-497c-4540-b31a-0797796de981 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.177221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e610933-497c-4540-b31a-0797796de981 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.178048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e610933-497c-4540-b31a-0797796de981 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.178465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e610933-497c-4540-b31a-0797796de981 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.320839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0e610933-497c-4540-b31a-0797796de981 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:03.323678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e094a80-9299-4a2b-9381-4f21983e02d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:03.330165 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0e610933-497c-4540-b31a-0797796de981 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.168600 Sep 10 20:52:03.330797 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 516/1085] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:03 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:03.345639 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9e094a80-9299-4a2b-9381-4f21983e02d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.286757 Sep 10 20:52:03.345639 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 570/1086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:03 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:03.346757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34276254-5cea-4a70-8bd2-aafefd4fe15d tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.346901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fe3a535f-aac2-4e50-90e3-183fdbc42645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96406eb1-c093-4aac-ac54-ad8adc9b782e", "device": "/dev/xvdb"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:03.346901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fe3a535f-aac2-4e50-90e3-183fdbc42645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:03.348258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3a535f-aac2-4e50-90e3-183fdbc42645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.349457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3a535f-aac2-4e50-90e3-183fdbc42645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.349936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3a535f-aac2-4e50-90e3-183fdbc42645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.351067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3a535f-aac2-4e50-90e3-183fdbc42645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.351530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3a535f-aac2-4e50-90e3-183fdbc42645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.351956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3a535f-aac2-4e50-90e3-183fdbc42645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.354143 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-34276254-5cea-4a70-8bd2-aafefd4fe15d tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/43d5d3eb-e6d0-4164-9f34-72d0ad1f3833" status: 202 len: 0 microversion: 2.1 time: 0.022135 Sep 10 20:52:03.354734 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 517/1087] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:52:03 2022] DELETE /compute/v2.1/flavors/43d5d3eb-e6d0-4164-9f34-72d0ad1f3833 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:03.359353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.360019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:03.367866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.368396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.368902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.369789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.370343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.370842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.444569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:03.455391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:03.457326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:03.462899 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9582d45b-1b9d-4a1c-b498-251828c5527f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1537 microversion: 2.91 time: 0.107187 Sep 10 20:52:03.463675 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 518/1088] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:03 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1537 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:03.468385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d21528c0-60d5-4da9-b3c0-1e08eca81289 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.469018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d21528c0-60d5-4da9-b3c0-1e08eca81289 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:03.476982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21528c0-60d5-4da9-b3c0-1e08eca81289 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.477478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21528c0-60d5-4da9-b3c0-1e08eca81289 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.477969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21528c0-60d5-4da9-b3c0-1e08eca81289 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.478683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21528c0-60d5-4da9-b3c0-1e08eca81289 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.479144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21528c0-60d5-4da9-b3c0-1e08eca81289 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.479572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21528c0-60d5-4da9-b3c0-1e08eca81289 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.612661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d21528c0-60d5-4da9-b3c0-1e08eca81289 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:03.620428 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d21528c0-60d5-4da9-b3c0-1e08eca81289 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1469 microversion: 2.1 time: 0.155770 Sep 10 20:52:03.621005 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 519/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:03 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:03.632160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8c0d041e-cb7a-4af5-af3f-57d0b904daa9 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.646676 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8c0d041e-cb7a-4af5-af3f-57d0b904daa9 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024627 Sep 10 20:52:03.647266 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 520/1090] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:03.651676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ebc42d0c-35e6-4a4f-a736-40481e3db4a4 req-3fcdc292-df61-4c60-af07-099df9da7de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662c3986-cb45-4c9f-a1cf-55a8230ac15a", "tag": "3a19535d-5974-4093-a3ab-f07270e88e01"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:03.662148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ebc42d0c-35e6-4a4f-a736-40481e3db4a4 req-3fcdc292-df61-4c60-af07-099df9da7de5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.662622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ebc42d0c-35e6-4a4f-a736-40481e3db4a4 req-3fcdc292-df61-4c60-af07-099df9da7de5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.663052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ebc42d0c-35e6-4a4f-a736-40481e3db4a4 req-3fcdc292-df61-4c60-af07-099df9da7de5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.674282 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ebc42d0c-35e6-4a4f-a736-40481e3db4a4 req-3fcdc292-df61-4c60-af07-099df9da7de5 service nova] Creating event network-changed:3a19535d-5974-4093-a3ab-f07270e88e01 for instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a on nch1-master-1 Sep 10 20:52:03.679640 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ebc42d0c-35e6-4a4f-a736-40481e3db4a4 req-3fcdc292-df61-4c60-af07-099df9da7de5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031093 Sep 10 20:52:03.680201 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 521/1091] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:03.684932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dba4c511-6306-431c-8a33-f1666d8a27c7 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-131645366", "id": 72941884, "os-flavor-access:is_public": "True"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:03.708204 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dba4c511-6306-431c-8a33-f1666d8a27c7 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.1 time: 0.026806 Sep 10 20:52:03.709093 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 522/1092] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:03.722805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da5412e6-2063-4500-918a-f82d1cee2e94 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.729567 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da5412e6-2063-4500-918a-f82d1cee2e94 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/72941884" status: 200 len: 407 microversion: 2.1 time: 0.012249 Sep 10 20:52:03.730195 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 523/1093] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:52:03 2022] GET /compute/v2.1/flavors/72941884 => generated 407 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:03.890808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b4445aa1-c226-42f0-a4e0-fe880115444b tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.914721 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b4445aa1-c226-42f0-a4e0-fe880115444b tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5388 microversion: 2.1 time: 0.174896 Sep 10 20:52:03.915313 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 524/1094] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:03 2022] GET /compute/v2.1/flavors/detail => generated 5388 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:03.919895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3599f8ec-a7b8-481b-a75e-c761c7db177b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:03.920680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3599f8ec-a7b8-481b-a75e-c761c7db177b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:03.927423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3599f8ec-a7b8-481b-a75e-c761c7db177b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.927773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3599f8ec-a7b8-481b-a75e-c761c7db177b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.928212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3599f8ec-a7b8-481b-a75e-c761c7db177b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:03.928922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3599f8ec-a7b8-481b-a75e-c761c7db177b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:03.929386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3599f8ec-a7b8-481b-a75e-c761c7db177b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:03.929805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3599f8ec-a7b8-481b-a75e-c761c7db177b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.070322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3599f8ec-a7b8-481b-a75e-c761c7db177b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:04.081963 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3599f8ec-a7b8-481b-a75e-c761c7db177b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1209 microversion: 2.1 time: 0.165236 Sep 10 20:52:04.082573 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 525/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:03 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1209 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:04.091342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b193cbad-4b9c-4426-8f46-f6fc699bc885 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:04.112820 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b193cbad-4b9c-4426-8f46-f6fc699bc885 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/72941884" status: 202 len: 0 microversion: 2.1 time: 0.029149 Sep 10 20:52:04.113416 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 526/1096] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:52:04 2022] DELETE /compute/v2.1/flavors/72941884 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:04.122424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eea371ed-4d5b-4508-a625-a5e22489d238 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:04.123244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eea371ed-4d5b-4508-a625-a5e22489d238 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:04.132748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eea371ed-4d5b-4508-a625-a5e22489d238 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:04.133523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eea371ed-4d5b-4508-a625-a5e22489d238 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:04.135239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eea371ed-4d5b-4508-a625-a5e22489d238 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.135989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eea371ed-4d5b-4508-a625-a5e22489d238 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:04.136535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eea371ed-4d5b-4508-a625-a5e22489d238 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:04.136898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eea371ed-4d5b-4508-a625-a5e22489d238 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.180563 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fe3a535f-aac2-4e50-90e3-183fdbc42645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "POST /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.845117 Sep 10 20:52:04.181991 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 571/1097] 10.222.0.33 () {62 vars in 1364 bytes} [Sat Sep 10 20:52:03 2022] POST /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:52:04.211215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ac9a5910-964f-4362-b71f-869be561dbb3 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:04.256549 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ac9a5910-964f-4362-b71f-869be561dbb3 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072791 Sep 10 20:52:04.266195 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 572/1098] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:04.279835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c821b79-eb79-44f6-849b-dbdabc7dacd2 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-225851963", "id": 972411046, "os-flavor-access:is_public": "False"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:04.301080 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c821b79-eb79-44f6-849b-dbdabc7dacd2 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.025727 Sep 10 20:52:04.301699 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 573/1099] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:04 2022] POST /compute/v2.1/flavors => generated 426 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:04.316565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6c6457d-5aad-4c5f-8353-6b6e125d90ac tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "972411046"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:04.328350 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-c6c6457d-5aad-4c5f-8353-6b6e125d90ac tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] HTTP exception thrown: Flavor 972411046 could not be found. Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6c6457d-5aad-4c5f-8353-6b6e125d90ac tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] Request method failure captured: Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 106 Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPjxQpTZ6esCmBgZIE-msgpkvlwwjCwzimyvgAfQAlYDgytWILg2444Q0hIo3hubIMAEIN4pxj0ilHnld2aYs0DRmCok9JN_Ycz0NjUzuhh2ABSueH_mU9j8P-eduMvdT2SXP3XvC6y6WP8KMORa9Lzw9TyBnizqId4ORJjsmS3UdSo Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 359f9191e22641c9be16709d2fdf0b25 Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FlavorsAdminTestJSON-33070381 Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:04.334746 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/359f9191e22641c9be16709d2fdf0b25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/359f9191e22641c9be16709d2fdf0b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_359f9191e22641c9be16709d2fdf0b25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/359f9191e22641c9be16709d2fdf0b25"}]}] Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FlavorsAdminTestJSON-33070381 Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 359f9191e22641c9be16709d2fdf0b25 Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-33070381 Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FlavorsAdminTestJSON-33070381-project Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 7874508e24964410b3e1f85cf0792be3 Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FlavorsAdminTestJSON-33070381-project Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "test", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "972411046"}} Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:52:04.336307 ncdv-master-1 devstack@n-api.service[145771]: exception: Flavor 972411046 could not be found. Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '972411046'}}} Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 972411046 could not be found. Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:04.337228 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 972411046 could not be found. Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:04.338606 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:04.341614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:04.341614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:04.341614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:04.341614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 972411046 could not be found. Sep 10 20:52:04.341614 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:04.341614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6c6457d-5aad-4c5f-8353-6b6e125d90ac tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] Returning 400 to user: Flavor 972411046 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:04.341614 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6c6457d-5aad-4c5f-8353-6b6e125d90ac tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.026098 Sep 10 20:52:04.341614 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 574/1100] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:04 2022] POST /compute/v2.1/servers => generated 80 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:52:04.345636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-74df4bbe-560d-4f4f-9755-d711305c0270 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:04.369402 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-74df4bbe-560d-4f4f-9755-d711305c0270 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/972411046" status: 202 len: 0 microversion: 2.1 time: 0.027181 Sep 10 20:52:04.373948 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 575/1101] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:52:04 2022] DELETE /compute/v2.1/flavors/972411046 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:04.376975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eea371ed-4d5b-4508-a625-a5e22489d238 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:04.386678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-76954329-e420-46bb-a3f7-973bd04efd4d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:04.387576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-76954329-e420-46bb-a3f7-973bd04efd4d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:04.398991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76954329-e420-46bb-a3f7-973bd04efd4d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:04.399488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76954329-e420-46bb-a3f7-973bd04efd4d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:04.399927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76954329-e420-46bb-a3f7-973bd04efd4d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.400640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76954329-e420-46bb-a3f7-973bd04efd4d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:04.401102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76954329-e420-46bb-a3f7-973bd04efd4d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:04.401525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76954329-e420-46bb-a3f7-973bd04efd4d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.412495 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eea371ed-4d5b-4508-a625-a5e22489d238 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 0.290320 Sep 10 20:52:04.420093 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 527/1102] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:04 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:04.426685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e6f71d7d-e604-44ed-8cb0-a52fb264c95f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:04.430218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e6f71d7d-e604-44ed-8cb0-a52fb264c95f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:04.449037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6f71d7d-e604-44ed-8cb0-a52fb264c95f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:04.449513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6f71d7d-e604-44ed-8cb0-a52fb264c95f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:04.449983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6f71d7d-e604-44ed-8cb0-a52fb264c95f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.450688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6f71d7d-e604-44ed-8cb0-a52fb264c95f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:04.451316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6f71d7d-e604-44ed-8cb0-a52fb264c95f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:04.451902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6f71d7d-e604-44ed-8cb0-a52fb264c95f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.593717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e6f71d7d-e604-44ed-8cb0-a52fb264c95f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:04.608943 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e6f71d7d-e604-44ed-8cb0-a52fb264c95f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.187269 Sep 10 20:52:04.628872 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 528/1103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:04 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:04.634745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28199c6f-bb81-4e12-aac6-41540f8438a5 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:04.665587 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-28199c6f-bb81-4e12-aac6-41540f8438a5 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034119 Sep 10 20:52:04.667211 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 529/1104] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:04.675847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:04.683880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-76954329-e420-46bb-a3f7-973bd04efd4d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:04.689206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:04.698252 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-76954329-e420-46bb-a3f7-973bd04efd4d tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.324046 Sep 10 20:52:04.699021 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 576/1105] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:04 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:04.700462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:04.700994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:04.701435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.702322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:04.703668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:04.704301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.711696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d654f5bc-d608-4ed0-8921-7a8a671ce8bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:04.712624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d654f5bc-d608-4ed0-8921-7a8a671ce8bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:04.720620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d654f5bc-d608-4ed0-8921-7a8a671ce8bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:04.721762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d654f5bc-d608-4ed0-8921-7a8a671ce8bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:04.722340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d654f5bc-d608-4ed0-8921-7a8a671ce8bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.723050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d654f5bc-d608-4ed0-8921-7a8a671ce8bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:04.723681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d654f5bc-d608-4ed0-8921-7a8a671ce8bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:04.724183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d654f5bc-d608-4ed0-8921-7a8a671ce8bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:04.857406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d654f5bc-d608-4ed0-8921-7a8a671ce8bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:04.866464 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d654f5bc-d608-4ed0-8921-7a8a671ce8bd tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1427 microversion: 2.1 time: 0.166230 Sep 10 20:52:04.894363 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 577/1106] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:04 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1427 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:04.899754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-602d5268-1ad9-4ac8-b659-59b95979ae4c tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1014902703", "id": 794892625, "os-flavor-access:is_public": "False"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:04.930208 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-602d5268-1ad9-4ac8-b659-59b95979ae4c tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.034519 Sep 10 20:52:04.935787 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 578/1107] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:04 2022] POST /compute/v2.1/flavors => generated 412 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:04.946319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:04.952426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-643e493c-4560-4674-a11a-7b632127b8d1 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1573729007", "id": 1447622336, "os-flavor-access:is_public": "True"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:04.967567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:04.969087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:04.996066 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cf2da098-51ff-4781-8753-3301f8f839a4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1540 microversion: 2.91 time: 0.327832 Sep 10 20:52:04.996912 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 530/1108] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:04 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1540 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:05.000956 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-643e493c-4560-4674-a11a-7b632127b8d1 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.057079 Sep 10 20:52:05.009881 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 579/1109] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:04 2022] POST /compute/v2.1/flavors => generated 414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:05.013452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40ee4c2d-f6e2-40d2-a31b-057d6e3bbd8a tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.026469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e2b2f3a-668a-4566-9ff2-99a9a6847246 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch1-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:05.028793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e2b2f3a-668a-4566-9ff2-99a9a6847246 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:05.050069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e2b2f3a-668a-4566-9ff2-99a9a6847246 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.051287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e2b2f3a-668a-4566-9ff2-99a9a6847246 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.053144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e2b2f3a-668a-4566-9ff2-99a9a6847246 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.057082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e2b2f3a-668a-4566-9ff2-99a9a6847246 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.058295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e2b2f3a-668a-4566-9ff2-99a9a6847246 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.058993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e2b2f3a-668a-4566-9ff2-99a9a6847246 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.069913 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40ee4c2d-f6e2-40d2-a31b-057d6e3bbd8a tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.055515 Sep 10 20:52:05.073444 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 531/1110] 10.222.0.33 () {58 vars in 1169 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:05.087203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8829556e-ae3e-4154-a4c8-208fbc0d1ef2 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.114284 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8829556e-ae3e-4154-a4c8-208fbc0d1ef2 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.031479 Sep 10 20:52:05.115277 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 532/1111] 10.222.0.33 () {58 vars in 1177 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:05.121774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ffa03b07-f29d-41f0-a4e9-58a2c401ca9f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.130317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ffa03b07-f29d-41f0-a4e9-58a2c401ca9f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:05.137884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffa03b07-f29d-41f0-a4e9-58a2c401ca9f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.139400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffa03b07-f29d-41f0-a4e9-58a2c401ca9f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.140308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffa03b07-f29d-41f0-a4e9-58a2c401ca9f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.141279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffa03b07-f29d-41f0-a4e9-58a2c401ca9f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.142134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffa03b07-f29d-41f0-a4e9-58a2c401ca9f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.143445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffa03b07-f29d-41f0-a4e9-58a2c401ca9f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.156265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e2b2f3a-668a-4566-9ff2-99a9a6847246 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch1-master-1". {{(pid=145771) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 20:52:05.204047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:05.261473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ffa03b07-f29d-41f0-a4e9-58a2c401ca9f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:05.275095 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ffa03b07-f29d-41f0-a4e9-58a2c401ca9f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1265 microversion: 2.1 time: 0.158605 Sep 10 20:52:05.276402 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 533/1112] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:05.293665 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e2b2f3a-668a-4566-9ff2-99a9a6847246 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0/action" status: 202 len: 0 microversion: 2.91 time: 0.271122 Sep 10 20:52:05.294927 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 580/1113] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:52:05 2022] POST /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 20:52:05.304155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.305154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:05.305289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-950f783e-fee0-41fd-ad0c-ca0f826f7ec3 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.316703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.317740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.318433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.319364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.320088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.322166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.341508 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-950f783e-fee0-41fd-ad0c-ca0f826f7ec3 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.063808 Sep 10 20:52:05.346094 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 534/1114] 10.222.0.33 () {58 vars in 1171 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:05.357888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eefe3de3-cb75-42b3-acec-49b7f05ae63c tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.409461 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eefe3de3-cb75-42b3-acec-49b7f05ae63c tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.055894 Sep 10 20:52:05.425578 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 535/1115] 10.222.0.33 () {58 vars in 1169 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:05.453987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0c647242-1eaa-4ba4-924b-b6bd7979b985 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.458754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0c647242-1eaa-4ba4-924b-b6bd7979b985 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:05.467423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c647242-1eaa-4ba4-924b-b6bd7979b985 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.467919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c647242-1eaa-4ba4-924b-b6bd7979b985 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.468579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c647242-1eaa-4ba4-924b-b6bd7979b985 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.469456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c647242-1eaa-4ba4-924b-b6bd7979b985 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.470022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c647242-1eaa-4ba4-924b-b6bd7979b985 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.470540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c647242-1eaa-4ba4-924b-b6bd7979b985 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.490656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:05.500463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:05.502789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:05.508338 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0de84d3d-c783-4eee-b5fa-131e1796b177 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1488 microversion: 2.91 time: 0.209417 Sep 10 20:52:05.508923 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 581/1116] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1488 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:52:05.530078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f2ae06f-37d2-40fb-9852-a4803b0144e1 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.561437 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8f2ae06f-37d2-40fb-9852-a4803b0144e1 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.050705 Sep 10 20:52:05.562312 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 582/1117] 10.222.0.33 () {58 vars in 1169 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:05.586203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d6475d9d-0f99-47ef-93d6-02ea782661ab tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.614583 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d6475d9d-0f99-47ef-93d6-02ea782661ab tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.035576 Sep 10 20:52:05.638005 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 583/1118] 10.222.0.33 () {58 vars in 1175 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:05.645461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66ac313e-095e-477f-b593-a8285d4db34d tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.668667 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-66ac313e-095e-477f-b593-a8285d4db34d tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.028946 Sep 10 20:52:05.680850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 584/1119] 10.222.0.33 () {58 vars in 1173 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:05.688719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ff5dabf-8984-4e97-ac9e-e227508cdd52 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.690469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7ff5dabf-8984-4e97-ac9e-e227508cdd52 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:05.696781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ff5dabf-8984-4e97-ac9e-e227508cdd52 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.697509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ff5dabf-8984-4e97-ac9e-e227508cdd52 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.698134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ff5dabf-8984-4e97-ac9e-e227508cdd52 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.698994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ff5dabf-8984-4e97-ac9e-e227508cdd52 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.699122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0c647242-1eaa-4ba4-924b-b6bd7979b985 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:05.701542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ff5dabf-8984-4e97-ac9e-e227508cdd52 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.702325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ff5dabf-8984-4e97-ac9e-e227508cdd52 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.717954 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0c647242-1eaa-4ba4-924b-b6bd7979b985 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 0.274472 Sep 10 20:52:05.718878 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 536/1120] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:05.724808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cf05dccc-1a46-4b30-9cc9-538e74940c45 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.777644 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cf05dccc-1a46-4b30-9cc9-538e74940c45 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.057661 Sep 10 20:52:05.779125 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 537/1121] 10.222.0.33 () {58 vars in 1169 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:05.784943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-00e13ebd-113d-4712-a972-761f1fefe3df req-eb9c28fb-4e54-4f55-91d0-0a9488a073dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd4a71c8-110a-41cd-a0e2-324f07ba946a", "name": "network-vif-deleted", "tag": "6f0dbb98-6c0b-464f-abd0-fecdef02f76a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:05.797540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-00e13ebd-113d-4712-a972-761f1fefe3df req-eb9c28fb-4e54-4f55-91d0-0a9488a073dd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.798294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-00e13ebd-113d-4712-a972-761f1fefe3df req-eb9c28fb-4e54-4f55-91d0-0a9488a073dd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.799850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-00e13ebd-113d-4712-a972-761f1fefe3df req-eb9c28fb-4e54-4f55-91d0-0a9488a073dd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.805318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:05.819435 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-00e13ebd-113d-4712-a972-761f1fefe3df req-eb9c28fb-4e54-4f55-91d0-0a9488a073dd service nova] Creating event network-vif-deleted:6f0dbb98-6c0b-464f-abd0-fecdef02f76a for instance bd4a71c8-110a-41cd-a0e2-324f07ba946a on nch2-master-1 Sep 10 20:52:05.825711 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-00e13ebd-113d-4712-a972-761f1fefe3df req-eb9c28fb-4e54-4f55-91d0-0a9488a073dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044187 Sep 10 20:52:05.826847 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 538/1122] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:05.837182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-347dc96b-70c9-4084-9bd5-66697d8570b2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:05.838924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-347dc96b-70c9-4084-9bd5-66697d8570b2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:05.848732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-347dc96b-70c9-4084-9bd5-66697d8570b2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.850297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-347dc96b-70c9-4084-9bd5-66697d8570b2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.850950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-347dc96b-70c9-4084-9bd5-66697d8570b2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.851933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-347dc96b-70c9-4084-9bd5-66697d8570b2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:05.852611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-347dc96b-70c9-4084-9bd5-66697d8570b2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:05.853318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-347dc96b-70c9-4084-9bd5-66697d8570b2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:05.912361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=14 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:06.071865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7ff5dabf-8984-4e97-ac9e-e227508cdd52 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:06.085004 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ff5dabf-8984-4e97-ac9e-e227508cdd52 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.402691 Sep 10 20:52:06.087073 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 585/1123] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:06.092166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3263462a-0893-4897-93ae-8e56dc4f9566 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:06.181903 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3263462a-0893-4897-93ae-8e56dc4f9566 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1447622336" status: 202 len: 0 microversion: 2.1 time: 0.093338 Sep 10 20:52:06.183403 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 586/1124] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 20:52:06 2022] DELETE /compute/v2.1/flavors/1447622336 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:06.203357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:06.206552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:06.219649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:06.222566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:06.224994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:06.225979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:06.227616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:06.230040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:06.291733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:06.292531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:06.292982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:06.293442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lazy-loading 'fault' on Instance uuid bd4a71c8-110a-41cd-a0e2-324f07ba946a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:06.350284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:06.360059 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d3f01c97-82c0-46fd-aaf8-1b9fb958148a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 200 len: 1303 microversion: 2.1 time: 0.173421 Sep 10 20:52:06.361925 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 587/1125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:06 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 1303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:06.367421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c49b4d3b-7a4a-495e-b585-ba61d645ab20 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:06.397910 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c49b4d3b-7a4a-495e-b585-ba61d645ab20 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034325 Sep 10 20:52:06.399178 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 588/1126] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:06.405001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4fda97e2-3f48-4839-befb-8ff241ab443e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:06.406392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4fda97e2-3f48-4839-befb-8ff241ab443e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:06.414521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fda97e2-3f48-4839-befb-8ff241ab443e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:06.415316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fda97e2-3f48-4839-befb-8ff241ab443e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:06.416469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fda97e2-3f48-4839-befb-8ff241ab443e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:06.417674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fda97e2-3f48-4839-befb-8ff241ab443e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:06.418418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fda97e2-3f48-4839-befb-8ff241ab443e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:06.419134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4fda97e2-3f48-4839-befb-8ff241ab443e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:06.504560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4fda97e2-3f48-4839-befb-8ff241ab443e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:06.515110 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4fda97e2-3f48-4839-befb-8ff241ab443e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1271 microversion: 2.1 time: 0.114314 Sep 10 20:52:06.515953 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 589/1127] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:06 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:06.522817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-098471b2-d96d-46a2-b31b-cd75ecd98d02 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:06.550801 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-098471b2-d96d-46a2-b31b-cd75ecd98d02 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/794892625" status: 202 len: 0 microversion: 2.1 time: 0.031493 Sep 10 20:52:06.552448 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 590/1128] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:52:06 2022] DELETE /compute/v2.1/flavors/794892625 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:06.566347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:06.567864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:06.571319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:DELETE=12,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:06.578236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:06.579095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:06.580887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:06.582160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:06.582960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:06.583706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:06.691233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:06.706943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:06.708665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:06.723367 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-89770cf4-f856-4b64-858d-9d37127d2b50 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1488 microversion: 2.91 time: 0.167266 Sep 10 20:52:06.724232 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 591/1129] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:06 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1488 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:06.742830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27f2800d-ccc4-4c11-9bb1-4ecc71c7e634 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:06.782190 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27f2800d-ccc4-4c11-9bb1-4ecc71c7e634 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055296 Sep 10 20:52:06.794350 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 592/1130] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:06.812879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-182c389f-d2a6-4c4f-88cf-228656a230bc tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:06.816682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-182c389f-d2a6-4c4f-88cf-228656a230bc tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:06.827067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182c389f-d2a6-4c4f-88cf-228656a230bc tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:06.827564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182c389f-d2a6-4c4f-88cf-228656a230bc tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:06.828004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182c389f-d2a6-4c4f-88cf-228656a230bc tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:06.829056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182c389f-d2a6-4c4f-88cf-228656a230bc tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:06.829696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182c389f-d2a6-4c4f-88cf-228656a230bc tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:06.830341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182c389f-d2a6-4c4f-88cf-228656a230bc tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:06.848707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-347dc96b-70c9-4084-9bd5-66697d8570b2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:06.858914 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-347dc96b-70c9-4084-9bd5-66697d8570b2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 1.030456 Sep 10 20:52:06.868597 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 539/1131] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:05 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:06.888268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f4b860bb-78c5-4b50-bb09-bdf29b60d3ec tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1448092211", "id": 1886397146, "os-flavor-access:is_public": "False"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:06.918899 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f4b860bb-78c5-4b50-bb09-bdf29b60d3ec tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.034942 Sep 10 20:52:06.920959 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 540/1132] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:06 2022] POST /compute/v2.1/flavors => generated 415 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:06.933741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3401a332-b9ea-4772-b73d-ae186f1fc6c0 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:06.957382 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3401a332-b9ea-4772-b73d-ae186f1fc6c0 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027535 Sep 10 20:52:06.958610 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 541/1133] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:06.982445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a65087a0-8f16-47f6-8bc8-8ce7cf3651d7 tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.029688 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a65087a0-8f16-47f6-8bc8-8ce7cf3651d7 tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055782 Sep 10 20:52:07.032016 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 542/1134] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:07.053778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-98419f7d-5bf9-4d28-8e6d-07d1db6f24d1 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.058036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:07.080677 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-98419f7d-5bf9-4d28-8e6d-07d1db6f24d1 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1886397146" status: 202 len: 0 microversion: 2.1 time: 0.033367 Sep 10 20:52:07.082148 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 543/1135] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 20:52:07 2022] DELETE /compute/v2.1/flavors/1886397146 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:07.103296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-182c389f-d2a6-4c4f-88cf-228656a230bc tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:07.105984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d0e2b7a-ccc0-4251-b669-871b25f903fb tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.119520 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-182c389f-d2a6-4c4f-88cf-228656a230bc tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 0.321921 Sep 10 20:52:07.120523 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 593/1136] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:06 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:07.133337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-24400b57-8b18-42e6-95d8-c76d5bc9d183 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.135632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-24400b57-8b18-42e6-95d8-c76d5bc9d183 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:07.155737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24400b57-8b18-42e6-95d8-c76d5bc9d183 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.156285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24400b57-8b18-42e6-95d8-c76d5bc9d183 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.156834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24400b57-8b18-42e6-95d8-c76d5bc9d183 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.157889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24400b57-8b18-42e6-95d8-c76d5bc9d183 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.160503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24400b57-8b18-42e6-95d8-c76d5bc9d183 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.160776 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8d0e2b7a-ccc0-4251-b669-871b25f903fb tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072529 Sep 10 20:52:07.161556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24400b57-8b18-42e6-95d8-c76d5bc9d183 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.162096 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 544/1137] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:07.188456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5b4365f0-0e14-469f-b4e7-7e904250f6c1 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1863480550", "id": 34822189, "os-flavor-access:is_public": "True"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:07.227710 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5b4365f0-0e14-469f-b4e7-7e904250f6c1 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.045006 Sep 10 20:52:07.238358 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 545/1138] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:07.245037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be65f3b9-6103-4e02-bf7f-0438eacaf684 tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.279495 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be65f3b9-6103-4e02-bf7f-0438eacaf684 tempest-FlavorsAdminTestJSON-33070381 tempest-FlavorsAdminTestJSON-33070381-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5389 microversion: 2.1 time: 0.038911 Sep 10 20:52:07.280744 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 546/1139] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:07 2022] GET /compute/v2.1/flavors/detail => generated 5389 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:07.304451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-50439171-33a2-43f3-828a-5478ea1b112b tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.326215 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-50439171-33a2-43f3-828a-5478ea1b112b tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/34822189" status: 202 len: 0 microversion: 2.1 time: 0.026809 Sep 10 20:52:07.327558 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 547/1140] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:52:07 2022] DELETE /compute/v2.1/flavors/34822189 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:07.335781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d20b6072-2f0a-49a3-a339-a9ec5779a7d2 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.362243 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d20b6072-2f0a-49a3-a339-a9ec5779a7d2 tempest-FlavorsAdminTestJSON-1533550327 tempest-FlavorsAdminTestJSON-1533550327-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029413 Sep 10 20:52:07.368811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-24400b57-8b18-42e6-95d8-c76d5bc9d183 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:07.370033 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 548/1141] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:07.378977 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-24400b57-8b18-42e6-95d8-c76d5bc9d183 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.256180 Sep 10 20:52:07.384840 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 594/1142] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:07 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:07.395016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.396267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: bd4a71c8-110a-41cd-a0e2-324f07ba946a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:07.409652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.412917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.413382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.414159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.414633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.415146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.442768 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] HTTP exception thrown: Instance bd4a71c8-110a-41cd-a0e2-324f07ba946a could not be found. Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Request method failure captured: Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a HTTP/1.1 Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhmSXPL_NmN8wfoIO9z9tPDj-2fNFmfNV3J3WPd7C0gfQLiVqLNFPCAq1Y-2Syxr4SrcWMbeXbtDUUA3qGdoRjcr1qnL7MPXfLWW1jHd6Y-qpHsYer0v4B9-h6TB5mtWnHqY-fECujOhXBAg7x1ibOMCtLLPqy2aZrIpIGzURyv7ag Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5580128bff364c858eafedcc84dad425 Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdminTestJSON-704954675 Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:07.444552 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5580128bff364c858eafedcc84dad425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5580128bff364c858eafedcc84dad425"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5580128bff364c858eafedcc84dad425", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5580128bff364c858eafedcc84dad425"}]}] Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdminTestJSON-704954675 Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5580128bff364c858eafedcc84dad425 Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdminTestJSON-704954675 Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdminTestJSON-704954675-project Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: cbabc9a296d14628b649da7d81bc8766 Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdminTestJSON-704954675-project Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance bd4a71c8-110a-41cd-a0e2-324f07ba946a could not be found. Sep 10 20:52:07.446137 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'bd4a71c8-110a-41cd-a0e2-324f07ba946a'} Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd4a71c8-110a-41cd-a0e2-324f07ba946a could not be found. Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:07.447041 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd4a71c8-110a-41cd-a0e2-324f07ba946a could not be found. Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd4a71c8-110a-41cd-a0e2-324f07ba946a could not be found. Sep 10 20:52:07.449303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:07.450555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Returning 404 to user: Instance bd4a71c8-110a-41cd-a0e2-324f07ba946a could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:07.450555 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0349be22-889e-470c-856a-549ddaea4d47 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a" status: 404 len: 111 microversion: 2.1 time: 0.059740 Sep 10 20:52:07.450555 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 549/1143] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:07 2022] GET /compute/v2.1/servers/bd4a71c8-110a-41cd-a0e2-324f07ba946a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:07.457209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2c3220ca-c6a3-4a04-9981-9c1c1b4cae7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.457715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2c3220ca-c6a3-4a04-9981-9c1c1b4cae7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:07.465210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c3220ca-c6a3-4a04-9981-9c1c1b4cae7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.465702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c3220ca-c6a3-4a04-9981-9c1c1b4cae7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.466438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c3220ca-c6a3-4a04-9981-9c1c1b4cae7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.468059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c3220ca-c6a3-4a04-9981-9c1c1b4cae7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.468712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c3220ca-c6a3-4a04-9981-9c1c1b4cae7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.469386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c3220ca-c6a3-4a04-9981-9c1c1b4cae7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.503950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2c3220ca-c6a3-4a04-9981-9c1c1b4cae7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:52:07.552727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b69e7f88-4a84-4261-9dea-a7dda7ff53c0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.553556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b69e7f88-4a84-4261-9dea-a7dda7ff53c0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:07.571953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b69e7f88-4a84-4261-9dea-a7dda7ff53c0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.572658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b69e7f88-4a84-4261-9dea-a7dda7ff53c0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.576328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b69e7f88-4a84-4261-9dea-a7dda7ff53c0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.578298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b69e7f88-4a84-4261-9dea-a7dda7ff53c0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.581977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b69e7f88-4a84-4261-9dea-a7dda7ff53c0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.584078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b69e7f88-4a84-4261-9dea-a7dda7ff53c0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.614851 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2c3220ca-c6a3-4a04-9981-9c1c1b4cae7a tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 204 len: 0 microversion: 2.1 time: 0.161948 Sep 10 20:52:07.620018 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 595/1144] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:52:07 2022] DELETE /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:52:07.627916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09a5fca0-a2ae-4248-ab0c-5851525913d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.628920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-09a5fca0-a2ae-4248-ab0c-5851525913d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:07.653157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09a5fca0-a2ae-4248-ab0c-5851525913d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.655350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09a5fca0-a2ae-4248-ab0c-5851525913d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.656014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09a5fca0-a2ae-4248-ab0c-5851525913d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.657588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09a5fca0-a2ae-4248-ab0c-5851525913d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.659208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09a5fca0-a2ae-4248-ab0c-5851525913d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.660384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09a5fca0-a2ae-4248-ab0c-5851525913d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.699913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b69e7f88-4a84-4261-9dea-a7dda7ff53c0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:07.708985 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b69e7f88-4a84-4261-9dea-a7dda7ff53c0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1271 microversion: 2.1 time: 0.161700 Sep 10 20:52:07.709616 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 550/1145] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:07 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:07.759153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.760308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:07.768417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.769297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.769853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.770652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.771119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.771552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.815643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09a5fca0-a2ae-4248-ab0c-5851525913d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:07.823436 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09a5fca0-a2ae-4248-ab0c-5851525913d3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1469 microversion: 2.1 time: 0.201994 Sep 10 20:52:07.824191 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 596/1146] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:07 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1469 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:07.853867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:07.865344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:07.867194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:07.872224 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9e76b3b6-1daf-4172-9a45-f7791c81d82f tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.117866 Sep 10 20:52:07.872796 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 551/1147] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:07 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:52:07.899338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ed57526a-6086-4c92-a190-a96d27b8d987 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:07.899960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ed57526a-6086-4c92-a190-a96d27b8d987 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:07.906037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed57526a-6086-4c92-a190-a96d27b8d987 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.906753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed57526a-6086-4c92-a190-a96d27b8d987 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.907185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed57526a-6086-4c92-a190-a96d27b8d987 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:07.907892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed57526a-6086-4c92-a190-a96d27b8d987 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:07.908702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed57526a-6086-4c92-a190-a96d27b8d987 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:07.909142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed57526a-6086-4c92-a190-a96d27b8d987 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.084068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed57526a-6086-4c92-a190-a96d27b8d987 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:08.097240 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ed57526a-6086-4c92-a190-a96d27b8d987 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.205193 Sep 10 20:52:08.111762 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 597/1148] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:07 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:08.144791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-67c1562f-8c51-410d-8e95-efffc2d4011d tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:08.145402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-67c1562f-8c51-410d-8e95-efffc2d4011d tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:08.153984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67c1562f-8c51-410d-8e95-efffc2d4011d tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.154653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67c1562f-8c51-410d-8e95-efffc2d4011d tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.155023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67c1562f-8c51-410d-8e95-efffc2d4011d tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.156092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67c1562f-8c51-410d-8e95-efffc2d4011d tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.156365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67c1562f-8c51-410d-8e95-efffc2d4011d tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.156758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67c1562f-8c51-410d-8e95-efffc2d4011d tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.417147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1189a9cf-3244-458d-9d4e-40c81fbcd2f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:08.418511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1189a9cf-3244-458d-9d4e-40c81fbcd2f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:08.427678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1189a9cf-3244-458d-9d4e-40c81fbcd2f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.428430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1189a9cf-3244-458d-9d4e-40c81fbcd2f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.429026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1189a9cf-3244-458d-9d4e-40c81fbcd2f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.430017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1189a9cf-3244-458d-9d4e-40c81fbcd2f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.430643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1189a9cf-3244-458d-9d4e-40c81fbcd2f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.431430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1189a9cf-3244-458d-9d4e-40c81fbcd2f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.507288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-67c1562f-8c51-410d-8e95-efffc2d4011d tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:08.522506 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-67c1562f-8c51-410d-8e95-efffc2d4011d tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 0.377989 Sep 10 20:52:08.525779 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 552/1149] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:08 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:08.555624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b290f7cc-0656-4b54-8691-8b146fc1a163 req-53b057b7-9482-4bc0-914e-086f64c3e754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac096a76-c7e3-4400-99c4-eac33e23490e", "name": "network-vif-plugged", "status": "completed", "tag": "fba41ad7-a3e8-4167-81ed-4370f3ecee4f"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:08.575679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b290f7cc-0656-4b54-8691-8b146fc1a163 req-53b057b7-9482-4bc0-914e-086f64c3e754 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.576259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b290f7cc-0656-4b54-8691-8b146fc1a163 req-53b057b7-9482-4bc0-914e-086f64c3e754 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.577293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b290f7cc-0656-4b54-8691-8b146fc1a163 req-53b057b7-9482-4bc0-914e-086f64c3e754 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.599481 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b290f7cc-0656-4b54-8691-8b146fc1a163 req-53b057b7-9482-4bc0-914e-086f64c3e754 service nova] Creating event network-vif-plugged:fba41ad7-a3e8-4167-81ed-4370f3ecee4f for instance ac096a76-c7e3-4400-99c4-eac33e23490e on nch2-master-1 Sep 10 20:52:08.607345 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b290f7cc-0656-4b54-8691-8b146fc1a163 req-53b057b7-9482-4bc0-914e-086f64c3e754 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079556 Sep 10 20:52:08.608219 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 553/1150] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:08.634242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1189a9cf-3244-458d-9d4e-40c81fbcd2f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:08.642265 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1189a9cf-3244-458d-9d4e-40c81fbcd2f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.236014 Sep 10 20:52:08.643421 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 598/1151] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:08 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:08.733657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-06702407-d549-4828-9730-95bf733315cd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:08.734783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-06702407-d549-4828-9730-95bf733315cd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:08.741295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06702407-d549-4828-9730-95bf733315cd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.741784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06702407-d549-4828-9730-95bf733315cd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.742427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06702407-d549-4828-9730-95bf733315cd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.743131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06702407-d549-4828-9730-95bf733315cd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.743748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06702407-d549-4828-9730-95bf733315cd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.744347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06702407-d549-4828-9730-95bf733315cd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.850866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7b445109-9b35-4074-a05e-70401050725b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:08.851655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7b445109-9b35-4074-a05e-70401050725b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:08.860819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b445109-9b35-4074-a05e-70401050725b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.862009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b445109-9b35-4074-a05e-70401050725b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.863077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b445109-9b35-4074-a05e-70401050725b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.864304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b445109-9b35-4074-a05e-70401050725b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.864775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b445109-9b35-4074-a05e-70401050725b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.865206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b445109-9b35-4074-a05e-70401050725b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.958359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-06702407-d549-4828-9730-95bf733315cd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:08.979887 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-06702407-d549-4828-9730-95bf733315cd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1313 microversion: 2.1 time: 0.250924 Sep 10 20:52:08.981438 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 554/1152] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:08 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:08.989641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:08.990695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:08.996898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.997604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.998234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:08.998951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:08.999466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:08.999895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:09.085811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:09.100301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:09.101787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:09.116156 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-95e6ab61-60cc-41b4-b03a-fd1a6ffce8e4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.132396 Sep 10 20:52:09.119160 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 555/1153] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:08 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:09.141332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b0cbe2ea-4e85-4a60-8854-f48e938788ec tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:09.142003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b0cbe2ea-4e85-4a60-8854-f48e938788ec tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:09.149075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0cbe2ea-4e85-4a60-8854-f48e938788ec tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:09.149673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0cbe2ea-4e85-4a60-8854-f48e938788ec tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:09.150526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0cbe2ea-4e85-4a60-8854-f48e938788ec tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:09.151384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0cbe2ea-4e85-4a60-8854-f48e938788ec tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:09.151936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0cbe2ea-4e85-4a60-8854-f48e938788ec tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:09.152374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0cbe2ea-4e85-4a60-8854-f48e938788ec tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:09.223254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7b445109-9b35-4074-a05e-70401050725b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:09.259232 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7b445109-9b35-4074-a05e-70401050725b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1469 microversion: 2.1 time: 0.411550 Sep 10 20:52:09.261673 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 599/1154] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:08 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1469 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:09.269494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3e48f1a5-80dc-43eb-8ff5-db841be5f0f4 req-4541e6a0-4fe3-4aff-a785-e89b806ef395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435d0526-f990-4ec6-b38f-13aa30486469", "tag": "bfa95032-3491-453d-9ca4-83b61c66730d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:09.297301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3e48f1a5-80dc-43eb-8ff5-db841be5f0f4 req-4541e6a0-4fe3-4aff-a785-e89b806ef395 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:09.297919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3e48f1a5-80dc-43eb-8ff5-db841be5f0f4 req-4541e6a0-4fe3-4aff-a785-e89b806ef395 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:09.298453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3e48f1a5-80dc-43eb-8ff5-db841be5f0f4 req-4541e6a0-4fe3-4aff-a785-e89b806ef395 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:09.311861 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3e48f1a5-80dc-43eb-8ff5-db841be5f0f4 req-4541e6a0-4fe3-4aff-a785-e89b806ef395 service nova] Creating event network-changed:bfa95032-3491-453d-9ca4-83b61c66730d for instance 435d0526-f990-4ec6-b38f-13aa30486469 on nch2-master-1 Sep 10 20:52:09.317522 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3e48f1a5-80dc-43eb-8ff5-db841be5f0f4 req-4541e6a0-4fe3-4aff-a785-e89b806ef395 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053838 Sep 10 20:52:09.318696 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 600/1155] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:09.363280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b0cbe2ea-4e85-4a60-8854-f48e938788ec tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:09.373979 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b0cbe2ea-4e85-4a60-8854-f48e938788ec tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.242126 Sep 10 20:52:09.390878 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 556/1156] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:09 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:09.554208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-944650aa-4d11-4211-8899-c4777d12e005 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:09.554939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-944650aa-4d11-4211-8899-c4777d12e005 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:09.566108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-944650aa-4d11-4211-8899-c4777d12e005 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:09.567094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-944650aa-4d11-4211-8899-c4777d12e005 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:09.568280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-944650aa-4d11-4211-8899-c4777d12e005 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:09.569235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-944650aa-4d11-4211-8899-c4777d12e005 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:09.571097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-944650aa-4d11-4211-8899-c4777d12e005 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:09.572720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-944650aa-4d11-4211-8899-c4777d12e005 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:09.668609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dd67d13b-e251-4cdd-aa2b-1bd30180aac6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:09.669638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dd67d13b-e251-4cdd-aa2b-1bd30180aac6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:09.681685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd67d13b-e251-4cdd-aa2b-1bd30180aac6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:09.682575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd67d13b-e251-4cdd-aa2b-1bd30180aac6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:09.686252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd67d13b-e251-4cdd-aa2b-1bd30180aac6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:09.687474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd67d13b-e251-4cdd-aa2b-1bd30180aac6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:09.691048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd67d13b-e251-4cdd-aa2b-1bd30180aac6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:09.691759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd67d13b-e251-4cdd-aa2b-1bd30180aac6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:09.882449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-944650aa-4d11-4211-8899-c4777d12e005 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:09.895383 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-944650aa-4d11-4211-8899-c4777d12e005 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 0.349944 Sep 10 20:52:09.896143 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 601/1157] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:09 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:10.009067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d93c078-4b7a-4716-80ca-9a8d8c947eec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:10.009685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d93c078-4b7a-4716-80ca-9a8d8c947eec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:10.019667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d93c078-4b7a-4716-80ca-9a8d8c947eec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:10.020161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d93c078-4b7a-4716-80ca-9a8d8c947eec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:10.026037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d93c078-4b7a-4716-80ca-9a8d8c947eec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:10.026817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d93c078-4b7a-4716-80ca-9a8d8c947eec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:10.027300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d93c078-4b7a-4716-80ca-9a8d8c947eec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:10.027736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d93c078-4b7a-4716-80ca-9a8d8c947eec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:10.038166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:10.170663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dd67d13b-e251-4cdd-aa2b-1bd30180aac6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:10.179165 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dd67d13b-e251-4cdd-aa2b-1bd30180aac6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.515142 Sep 10 20:52:10.190933 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 557/1158] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:09 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:10.196086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:10.196606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:10.199691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:10.210784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:10.214933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:10.216082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:10.218942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:10.219594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:10.220218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:10.366887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3d93c078-4b7a-4716-80ca-9a8d8c947eec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:10.383005 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d93c078-4b7a-4716-80ca-9a8d8c947eec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1313 microversion: 2.1 time: 0.378101 Sep 10 20:52:10.398581 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 602/1159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:10 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:10.405674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3bf16218-cf66-4826-98c6-5f662423e505 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:10.406659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3bf16218-cf66-4826-98c6-5f662423e505 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:10.413182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bf16218-cf66-4826-98c6-5f662423e505 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:10.414063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bf16218-cf66-4826-98c6-5f662423e505 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:10.414718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bf16218-cf66-4826-98c6-5f662423e505 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:10.415973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bf16218-cf66-4826-98c6-5f662423e505 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:10.416650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bf16218-cf66-4826-98c6-5f662423e505 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:10.417291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bf16218-cf66-4826-98c6-5f662423e505 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:10.494532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:10.514387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:10.516825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:10.523473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=16 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:10.558191 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ec6b2597-24df-4d11-9c45-335d8c3d56d3 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.342263 Sep 10 20:52:10.561431 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 558/1160] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:10 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:10.577541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-38ce73d4-2597-46a3-80fd-8ac1f32c63ce tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:10.578402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-38ce73d4-2597-46a3-80fd-8ac1f32c63ce tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:10.624943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ce73d4-2597-46a3-80fd-8ac1f32c63ce tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:10.625451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ce73d4-2597-46a3-80fd-8ac1f32c63ce tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:10.625921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ce73d4-2597-46a3-80fd-8ac1f32c63ce tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:10.629595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ce73d4-2597-46a3-80fd-8ac1f32c63ce tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:10.630140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ce73d4-2597-46a3-80fd-8ac1f32c63ce tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:10.630592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ce73d4-2597-46a3-80fd-8ac1f32c63ce tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:10.938069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-38ce73d4-2597-46a3-80fd-8ac1f32c63ce tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:10.948131 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-38ce73d4-2597-46a3-80fd-8ac1f32c63ce tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.384334 Sep 10 20:52:10.952966 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 559/1161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:10 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:10.962415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6454fd02-8859-4117-b281-bbe700ffeaac req-b592bd6b-12ea-41aa-a088-5627cfbe1175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ab18ac-abbb-4b86-a739-eb4573268835", "name": "network-vif-plugged", "status": "completed", "tag": "c2ee03b7-df23-46e9-96bd-88920f75922c"}, {"server_uuid": "f2ab18ac-abbb-4b86-a739-eb4573268835", "name": "network-vif-plugged", "status": "completed", "tag": "3465ced5-070f-4639-a30b-ff9bf4505ea6"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:11.024088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6454fd02-8859-4117-b281-bbe700ffeaac req-b592bd6b-12ea-41aa-a088-5627cfbe1175 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:11.024824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6454fd02-8859-4117-b281-bbe700ffeaac req-b592bd6b-12ea-41aa-a088-5627cfbe1175 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:11.025455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6454fd02-8859-4117-b281-bbe700ffeaac req-b592bd6b-12ea-41aa-a088-5627cfbe1175 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:11.053259 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6454fd02-8859-4117-b281-bbe700ffeaac req-b592bd6b-12ea-41aa-a088-5627cfbe1175 service nova] Creating event network-vif-plugged:c2ee03b7-df23-46e9-96bd-88920f75922c for instance f2ab18ac-abbb-4b86-a739-eb4573268835 on nch1-master-1 Sep 10 20:52:11.055015 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6454fd02-8859-4117-b281-bbe700ffeaac req-b592bd6b-12ea-41aa-a088-5627cfbe1175 service nova] Creating event network-vif-plugged:3465ced5-070f-4639-a30b-ff9bf4505ea6 for instance f2ab18ac-abbb-4b86-a739-eb4573268835 on nch1-master-1 Sep 10 20:52:11.069510 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6454fd02-8859-4117-b281-bbe700ffeaac req-b592bd6b-12ea-41aa-a088-5627cfbe1175 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113480 Sep 10 20:52:11.071800 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 560/1162] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:11.082828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bf439356-b797-43fb-9849-cc8bef406ed3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:11.089380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bf439356-b797-43fb-9849-cc8bef406ed3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:11.103338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf439356-b797-43fb-9849-cc8bef406ed3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:11.104907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf439356-b797-43fb-9849-cc8bef406ed3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:11.105607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf439356-b797-43fb-9849-cc8bef406ed3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:11.106634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf439356-b797-43fb-9849-cc8bef406ed3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:11.107315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf439356-b797-43fb-9849-cc8bef406ed3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:11.107953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf439356-b797-43fb-9849-cc8bef406ed3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:11.184726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3bf16218-cf66-4826-98c6-5f662423e505 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:11.194012 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3bf16218-cf66-4826-98c6-5f662423e505 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1469 microversion: 2.1 time: 0.793938 Sep 10 20:52:11.195001 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 603/1163] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:10 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1469 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:11.207448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5ff566ee-cff4-47ee-9a18-cf3a7eb65823 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:11.208063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5ff566ee-cff4-47ee-9a18-cf3a7eb65823 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:11.210629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:11.218309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ff566ee-cff4-47ee-9a18-cf3a7eb65823 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:11.218809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ff566ee-cff4-47ee-9a18-cf3a7eb65823 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:11.219242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ff566ee-cff4-47ee-9a18-cf3a7eb65823 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:11.220129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ff566ee-cff4-47ee-9a18-cf3a7eb65823 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:11.222506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ff566ee-cff4-47ee-9a18-cf3a7eb65823 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:11.223310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ff566ee-cff4-47ee-9a18-cf3a7eb65823 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:11.565521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-5ff566ee-cff4-47ee-9a18-cf3a7eb65823 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid 3cd11ff4-6dda-414d-ab81-111f4762df68 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:11.578506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bf439356-b797-43fb-9849-cc8bef406ed3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:11.593658 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bf439356-b797-43fb-9849-cc8bef406ed3 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1316 microversion: 2.1 time: 0.520254 Sep 10 20:52:11.610754 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 561/1164] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:11 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:11.619961 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5ff566ee-cff4-47ee-9a18-cf3a7eb65823 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 2421 microversion: 2.25 time: 0.423870 Sep 10 20:52:11.620601 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 604/1165] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:11 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 2421 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:11.626101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d85dc962-fb15-416c-93f7-042d7d554f80 req-49a24ead-60ec-40d2-9fff-fef368f23e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdb5cc4-af47-4827-98a3-9e8aa572868b", "name": "network-vif-deleted", "tag": "586e8c3f-26b3-4849-a7dc-631285af05c5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:11.647392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d85dc962-fb15-416c-93f7-042d7d554f80 req-49a24ead-60ec-40d2-9fff-fef368f23e0e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:11.648357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d85dc962-fb15-416c-93f7-042d7d554f80 req-49a24ead-60ec-40d2-9fff-fef368f23e0e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:11.649109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d85dc962-fb15-416c-93f7-042d7d554f80 req-49a24ead-60ec-40d2-9fff-fef368f23e0e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:11.663736 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d85dc962-fb15-416c-93f7-042d7d554f80 req-49a24ead-60ec-40d2-9fff-fef368f23e0e service nova] Creating event network-vif-deleted:586e8c3f-26b3-4849-a7dc-631285af05c5 for instance 2fdb5cc4-af47-4827-98a3-9e8aa572868b on nch1-master-1 Sep 10 20:52:11.670519 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d85dc962-fb15-416c-93f7-042d7d554f80 req-49a24ead-60ec-40d2-9fff-fef368f23e0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048629 Sep 10 20:52:11.671869 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 605/1166] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:11.681639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d171cc2f-caf8-4fa6-bcdc-06bf84ad08c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:11.682736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d171cc2f-caf8-4fa6-bcdc-06bf84ad08c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:11.690560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bed39d2f-5c4a-4366-a72e-7511b0b056df tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:11.691607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d171cc2f-caf8-4fa6-bcdc-06bf84ad08c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:11.692170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d171cc2f-caf8-4fa6-bcdc-06bf84ad08c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:11.692910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d171cc2f-caf8-4fa6-bcdc-06bf84ad08c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:11.693761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d171cc2f-caf8-4fa6-bcdc-06bf84ad08c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:11.694254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d171cc2f-caf8-4fa6-bcdc-06bf84ad08c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:11.694847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d171cc2f-caf8-4fa6-bcdc-06bf84ad08c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:11.698924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bed39d2f-5c4a-4366-a72e-7511b0b056df tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:11.717646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bed39d2f-5c4a-4366-a72e-7511b0b056df tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:11.717985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bed39d2f-5c4a-4366-a72e-7511b0b056df tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:11.718960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bed39d2f-5c4a-4366-a72e-7511b0b056df tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:11.722934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bed39d2f-5c4a-4366-a72e-7511b0b056df tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:11.726733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bed39d2f-5c4a-4366-a72e-7511b0b056df tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:11.727638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bed39d2f-5c4a-4366-a72e-7511b0b056df tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.032841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d171cc2f-caf8-4fa6-bcdc-06bf84ad08c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:12.044647 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d171cc2f-caf8-4fa6-bcdc-06bf84ad08c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1313 microversion: 2.1 time: 0.370971 Sep 10 20:52:12.046070 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 606/1167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:11 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:12.051703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:12.052545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:12.062347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.063165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.063777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.066328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.066991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.068300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.137871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:12.146870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:12.147954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bed39d2f-5c4a-4366-a72e-7511b0b056df tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:12.148332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:12.153552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3109092d-a4b8-4f8e-a91b-1051818ba197 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.106226 Sep 10 20:52:12.154171 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 607/1168] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:12 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:12.156860 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bed39d2f-5c4a-4366-a72e-7511b0b056df tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.544662 Sep 10 20:52:12.158195 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 562/1169] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:11 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:12.174108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:12.174108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:12.179038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.179594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.180038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.180210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4e6f27cc-8834-42e8-856c-d16b41a97565 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:12.181063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.181203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4e6f27cc-8834-42e8-856c-d16b41a97565 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:12.181363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.181791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.187297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e6f27cc-8834-42e8-856c-d16b41a97565 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.187865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e6f27cc-8834-42e8-856c-d16b41a97565 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.188388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e6f27cc-8834-42e8-856c-d16b41a97565 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.189192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e6f27cc-8834-42e8-856c-d16b41a97565 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.190402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e6f27cc-8834-42e8-856c-d16b41a97565 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.190831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e6f27cc-8834-42e8-856c-d16b41a97565 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.207339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'flavor' on Instance uuid 3cd11ff4-6dda-414d-ab81-111f4762df68 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:12.222237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Going to try to live migrate instance to nch1-master-1 {{(pid=145771) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 20:52:12.410482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4e6f27cc-8834-42e8-856c-d16b41a97565 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:12.419073 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4e6f27cc-8834-42e8-856c-d16b41a97565 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.242630 Sep 10 20:52:12.420362 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 563/1170] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:12 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:12.644345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-03cb89cb-6540-4273-beaf-0f3dd8b1c03b tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-302487259", "id": 296605398, "os-flavor-access:is_public": "False"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:12.684557 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-03cb89cb-6540-4273-beaf-0f3dd8b1c03b tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.251441 Sep 10 20:52:12.685621 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 564/1171] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:12 2022] POST /compute/v2.1/flavors => generated 427 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:12.694034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:12.695031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:12.702643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.703316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.709662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.711016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.712831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.713469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.770337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.771093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.771543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.772003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lazy-loading 'fault' on Instance uuid 2fdb5cc4-af47-4827-98a3-9e8aa572868b {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:12.816368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:12.825251 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e16199c-ad54-4c28-ac79-b76b6d69e14b tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1303 microversion: 2.1 time: 0.138412 Sep 10 20:52:12.826411 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 565/1172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:12 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:12.832732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-88af577c-419d-40b0-abd6-9563c7162c95 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:12.833585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-88af577c-419d-40b0-abd6-9563c7162c95 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:12.842770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88af577c-419d-40b0-abd6-9563c7162c95 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.843184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88af577c-419d-40b0-abd6-9563c7162c95 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.843798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88af577c-419d-40b0-abd6-9563c7162c95 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.844669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88af577c-419d-40b0-abd6-9563c7162c95 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:12.845345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88af577c-419d-40b0-abd6-9563c7162c95 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:12.847133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88af577c-419d-40b0-abd6-9563c7162c95 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:12.992054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-88af577c-419d-40b0-abd6-9563c7162c95 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:12.999959 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-88af577c-419d-40b0-abd6-9563c7162c95 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1504 microversion: 2.1 time: 0.172330 Sep 10 20:52:13.000762 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 566/1173] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:12 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:13.025124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-803712a6-a20d-4a9b-8449-46dea57e866a tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2ef419dcd60a4af7ba7d02cb93631efc"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:13.109705 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-803712a6-a20d-4a9b-8449-46dea57e866a tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/296605398/action" status: 200 len: 96 microversion: 2.1 time: 0.098453 Sep 10 20:52:13.110274 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 567/1174] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Sep 10 20:52:13 2022] POST /compute/v2.1/flavors/296605398/action => generated 96 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:13.115175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-25e6da7b-d8d9-412c-97dc-5683f2c28269 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:13.115681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-25e6da7b-d8d9-412c-97dc-5683f2c28269 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:13.121747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25e6da7b-d8d9-412c-97dc-5683f2c28269 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.122286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25e6da7b-d8d9-412c-97dc-5683f2c28269 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.122732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25e6da7b-d8d9-412c-97dc-5683f2c28269 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:13.123444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25e6da7b-d8d9-412c-97dc-5683f2c28269 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.123907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25e6da7b-d8d9-412c-97dc-5683f2c28269 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.124340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25e6da7b-d8d9-412c-97dc-5683f2c28269 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:13.130942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:13.152519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-25e6da7b-d8d9-412c-97dc-5683f2c28269 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:52:13.231098 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-25e6da7b-d8d9-412c-97dc-5683f2c28269 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 204 len: 0 microversion: 2.1 time: 0.119446 Sep 10 20:52:13.231976 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 568/1175] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:52:13 2022] DELETE /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:52:13.238840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6fb806e2-57a2-42a6-ac3c-70bad5b70610 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:13.239600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6fb806e2-57a2-42a6-ac3c-70bad5b70610 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:13.246404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fb806e2-57a2-42a6-ac3c-70bad5b70610 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.246906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fb806e2-57a2-42a6-ac3c-70bad5b70610 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.247402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fb806e2-57a2-42a6-ac3c-70bad5b70610 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:13.248056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fb806e2-57a2-42a6-ac3c-70bad5b70610 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.248517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fb806e2-57a2-42a6-ac3c-70bad5b70610 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.248944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fb806e2-57a2-42a6-ac3c-70bad5b70610 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:13.392762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6fb806e2-57a2-42a6-ac3c-70bad5b70610 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:13.401689 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6fb806e2-57a2-42a6-ac3c-70bad5b70610 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1313 microversion: 2.1 time: 0.168400 Sep 10 20:52:13.402607 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 569/1176] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:13 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:13.412164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-851a1fc0-4a4b-44b6-833e-e4a611e5d14c req-4473ad35-1057-4686-b637-31e7760a1183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662c3986-cb45-4c9f-a1cf-55a8230ac15a", "name": "network-vif-plugged", "status": "completed", "tag": "3a19535d-5974-4093-a3ab-f07270e88e01"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:13.422372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-851a1fc0-4a4b-44b6-833e-e4a611e5d14c req-4473ad35-1057-4686-b637-31e7760a1183 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.422854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-851a1fc0-4a4b-44b6-833e-e4a611e5d14c req-4473ad35-1057-4686-b637-31e7760a1183 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.423316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-851a1fc0-4a4b-44b6-833e-e4a611e5d14c req-4473ad35-1057-4686-b637-31e7760a1183 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:13.434981 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-851a1fc0-4a4b-44b6-833e-e4a611e5d14c req-4473ad35-1057-4686-b637-31e7760a1183 service nova] Creating event network-vif-plugged:3a19535d-5974-4093-a3ab-f07270e88e01 for instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a on nch1-master-1 Sep 10 20:52:13.440500 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-851a1fc0-4a4b-44b6-833e-e4a611e5d14c req-4473ad35-1057-4686-b637-31e7760a1183 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032454 Sep 10 20:52:13.441272 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 570/1177] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:13.571109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3023eae5-af7e-45a5-b411-437f389a70cb tempest-FlavorsAccessTestJSON-330061492 tempest-FlavorsAccessTestJSON-330061492-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:13.594547 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3023eae5-af7e-45a5-b411-437f389a70cb tempest-FlavorsAccessTestJSON-330061492 tempest-FlavorsAccessTestJSON-330061492-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.152231 Sep 10 20:52:13.595143 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 571/1178] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:13 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:13.600975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-06e1b70f-8791-4f7d-bdd0-202e94f93eca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:13.601683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-06e1b70f-8791-4f7d-bdd0-202e94f93eca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:13.608114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06e1b70f-8791-4f7d-bdd0-202e94f93eca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.608615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06e1b70f-8791-4f7d-bdd0-202e94f93eca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.609043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06e1b70f-8791-4f7d-bdd0-202e94f93eca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:13.610129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06e1b70f-8791-4f7d-bdd0-202e94f93eca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.610622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06e1b70f-8791-4f7d-bdd0-202e94f93eca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.611097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06e1b70f-8791-4f7d-bdd0-202e94f93eca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:13.759533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-06e1b70f-8791-4f7d-bdd0-202e94f93eca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:13.776865 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-06e1b70f-8791-4f7d-bdd0-202e94f93eca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.172626 Sep 10 20:52:13.777543 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 572/1179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:13 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:13.782551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:13.783489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:13.790764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.791344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.791827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:13.794513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.795005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.795455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:13.867020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:13.876151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:13.878673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:13.884434 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-850c50a1-aafc-4a4a-8a10-5d44a857a7b0 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.105483 Sep 10 20:52:13.885061 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 573/1180] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:13 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:13.890628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5be024d-8c33-4bde-9e2c-02eb1dd1c7fb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:13.891246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e5be024d-8c33-4bde-9e2c-02eb1dd1c7fb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:13.899196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5be024d-8c33-4bde-9e2c-02eb1dd1c7fb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.899943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5be024d-8c33-4bde-9e2c-02eb1dd1c7fb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.900554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5be024d-8c33-4bde-9e2c-02eb1dd1c7fb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:13.901273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5be024d-8c33-4bde-9e2c-02eb1dd1c7fb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:13.901737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5be024d-8c33-4bde-9e2c-02eb1dd1c7fb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:13.902212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5be024d-8c33-4bde-9e2c-02eb1dd1c7fb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:14.045110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e5be024d-8c33-4bde-9e2c-02eb1dd1c7fb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:14.054589 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5be024d-8c33-4bde-9e2c-02eb1dd1c7fb tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1510 microversion: 2.1 time: 0.168487 Sep 10 20:52:14.055173 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 574/1181] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:13 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:14.059627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-52ac7ed8-a4e6-4be5-a49e-82218e0bc000 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:14.060374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-52ac7ed8-a4e6-4be5-a49e-82218e0bc000 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:14.067141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52ac7ed8-a4e6-4be5-a49e-82218e0bc000 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:14.067631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52ac7ed8-a4e6-4be5-a49e-82218e0bc000 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:14.068067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52ac7ed8-a4e6-4be5-a49e-82218e0bc000 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:14.068780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52ac7ed8-a4e6-4be5-a49e-82218e0bc000 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:14.069226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52ac7ed8-a4e6-4be5-a49e-82218e0bc000 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:14.069651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52ac7ed8-a4e6-4be5-a49e-82218e0bc000 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:14.219169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-52ac7ed8-a4e6-4be5-a49e-82218e0bc000 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:14.228245 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-52ac7ed8-a4e6-4be5-a49e-82218e0bc000 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.172054 Sep 10 20:52:14.229063 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 575/1182] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:14 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:14.233323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2a4b230c-80e4-4f20-bfe8-78cc1387d583 tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2ef419dcd60a4af7ba7d02cb93631efc"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:14.288873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:14.311325 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2a4b230c-80e4-4f20-bfe8-78cc1387d583 tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/296605398/action" status: 200 len: 21 microversion: 2.1 time: 0.081436 Sep 10 20:52:14.312207 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 576/1183] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Sep 10 20:52:14 2022] POST /compute/v2.1/flavors/296605398/action => generated 21 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:14.317459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:14.318300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:14.324778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:14.325551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:14.326097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:14.326792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:14.327315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:14.327679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:14.376413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:14.377127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:14.377847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:14.378306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lazy-loading 'fault' on Instance uuid 2fdb5cc4-af47-4827-98a3-9e8aa572868b {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:14.423091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:14.431327 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4aa2f900-1751-4593-80e0-4fb483829df9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1303 microversion: 2.1 time: 0.117764 Sep 10 20:52:14.431968 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 577/1184] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:14 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:14.437162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cd5f7817-35dd-4791-8e8b-c60453ebb331 tempest-FlavorsAccessTestJSON-330061492 tempest-FlavorsAccessTestJSON-330061492-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:14.459229 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cd5f7817-35dd-4791-8e8b-c60453ebb331 tempest-FlavorsAccessTestJSON-330061492 tempest-FlavorsAccessTestJSON-330061492-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026087 Sep 10 20:52:14.460012 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 578/1185] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:14.465966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a340b49f-dd75-4ec7-a6f3-f040644ee3ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:14.466570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a340b49f-dd75-4ec7-a6f3-f040644ee3ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:14.473964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a340b49f-dd75-4ec7-a6f3-f040644ee3ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:14.474446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a340b49f-dd75-4ec7-a6f3-f040644ee3ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:14.474877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a340b49f-dd75-4ec7-a6f3-f040644ee3ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:14.475566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a340b49f-dd75-4ec7-a6f3-f040644ee3ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:14.476019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a340b49f-dd75-4ec7-a6f3-f040644ee3ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:14.476440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a340b49f-dd75-4ec7-a6f3-f040644ee3ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:14.624027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a340b49f-dd75-4ec7-a6f3-f040644ee3ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:14.632817 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a340b49f-dd75-4ec7-a6f3-f040644ee3ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1313 microversion: 2.1 time: 0.171062 Sep 10 20:52:14.633407 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 579/1186] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:14 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:14.638440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09eb01f9-7713-4861-864e-13ebdb3e7f3f tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:14.661342 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09eb01f9-7713-4861-864e-13ebdb3e7f3f tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/296605398" status: 202 len: 0 microversion: 2.1 time: 0.026649 Sep 10 20:52:14.662773 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 580/1187] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:52:14 2022] DELETE /compute/v2.1/flavors/296605398 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:14.673765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3895c0f7-6e36-4db9-8cc6-d10c6c11f044 tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:14.695536 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3895c0f7-6e36-4db9-8cc6-d10c6c11f044 tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028434 Sep 10 20:52:14.696131 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 581/1188] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:14.717218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-921b4ffe-e9e6-4108-8b4f-09e406b9e036 tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-212851237", "id": 1191462280, "os-flavor-access:is_public": "False"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:14.736727 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-921b4ffe-e9e6-4108-8b4f-09e406b9e036 tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.024015 Sep 10 20:52:14.737580 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 582/1189] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:14 2022] POST /compute/v2.1/flavors => generated 430 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:14.749767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a5d5c98-4094-4007-993d-e5053be61887 tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:14.764455 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a5d5c98-4094-4007-993d-e5053be61887 tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1191462280/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.018531 Sep 10 20:52:14.765098 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 583/1190] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Sep 10 20:52:14 2022] GET /compute/v2.1/flavors/1191462280/os-flavor-access => generated 21 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:14.775498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f1a50201-e3d7-44b0-b298-bc0a778e4413 tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:14.794116 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f1a50201-e3d7-44b0-b298-bc0a778e4413 tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1191462280" status: 202 len: 0 microversion: 2.1 time: 0.022145 Sep 10 20:52:14.795008 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 584/1191] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 20:52:14 2022] DELETE /compute/v2.1/flavors/1191462280 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:14.802898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-061674f9-1e3a-4a17-a5ac-7639b7e30538 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:14.803649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-061674f9-1e3a-4a17-a5ac-7639b7e30538 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:14.811659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061674f9-1e3a-4a17-a5ac-7639b7e30538 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:14.812233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061674f9-1e3a-4a17-a5ac-7639b7e30538 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:14.812758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061674f9-1e3a-4a17-a5ac-7639b7e30538 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:14.813570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061674f9-1e3a-4a17-a5ac-7639b7e30538 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:14.814704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061674f9-1e3a-4a17-a5ac-7639b7e30538 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:14.815177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061674f9-1e3a-4a17-a5ac-7639b7e30538 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:15.274570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-061674f9-1e3a-4a17-a5ac-7639b7e30538 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:15.282518 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-061674f9-1e3a-4a17-a5ac-7639b7e30538 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.485101 Sep 10 20:52:15.283926 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 585/1192] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:14 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:15.288466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a242bc44-5928-4bc2-9131-c764dbb78c9f tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:15.320942 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a242bc44-5928-4bc2-9131-c764dbb78c9f tempest-FlavorsAccessTestJSON-1861483752 tempest-FlavorsAccessTestJSON-1861483752-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035971 Sep 10 20:52:15.325931 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 586/1193] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:15.330434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:15.331456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:15.339655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:15.339655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:15.339655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:15.340403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:15.340945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:15.341665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:15.426391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:15.438506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:15.440125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:15.447320 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1b5059af-9ddc-403a-8303-eeabba9f60b6 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.124469 Sep 10 20:52:15.452737 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 587/1194] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:15 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:15.468506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f53e2b1-51fd-4b96-b547-b6c94a1d8515 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:15.469199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2f53e2b1-51fd-4b96-b547-b6c94a1d8515 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:15.476998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f53e2b1-51fd-4b96-b547-b6c94a1d8515 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:15.477501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f53e2b1-51fd-4b96-b547-b6c94a1d8515 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:15.477976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f53e2b1-51fd-4b96-b547-b6c94a1d8515 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:15.478698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f53e2b1-51fd-4b96-b547-b6c94a1d8515 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:15.479161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f53e2b1-51fd-4b96-b547-b6c94a1d8515 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:15.479593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f53e2b1-51fd-4b96-b547-b6c94a1d8515 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:15.749626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2f53e2b1-51fd-4b96-b547-b6c94a1d8515 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b9b4d83834456388c99abd3ecae3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8693bafb9e424052ab91e56e9e4da6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:15.766352 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f53e2b1-51fd-4b96-b547-b6c94a1d8515 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 200 len: 1510 microversion: 2.1 time: 0.312345 Sep 10 20:52:15.782844 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 588/1195] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:15 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:15.792378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-281f9c5a-118a-467c-bb76-68cf5542a59f tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:15.798923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-281f9c5a-118a-467c-bb76-68cf5542a59f tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:15.815531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281f9c5a-118a-467c-bb76-68cf5542a59f tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:15.816038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281f9c5a-118a-467c-bb76-68cf5542a59f tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:15.821576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281f9c5a-118a-467c-bb76-68cf5542a59f tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:15.822580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281f9c5a-118a-467c-bb76-68cf5542a59f tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:15.830915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281f9c5a-118a-467c-bb76-68cf5542a59f tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:15.831458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281f9c5a-118a-467c-bb76-68cf5542a59f tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:16.246965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-281f9c5a-118a-467c-bb76-68cf5542a59f tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:16.256929 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-281f9c5a-118a-467c-bb76-68cf5542a59f tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.472354 Sep 10 20:52:16.259168 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 589/1196] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:15 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:16.264173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:16.264944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:16.278933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:16.279445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:16.279900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:16.280632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:16.281105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:16.281544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:16.336407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:16.337150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:16.337812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:16.338501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lazy-loading 'fault' on Instance uuid 2fdb5cc4-af47-4827-98a3-9e8aa572868b {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:16.418446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:16.433102 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8c2e3458-a146-4d80-aaa2-f9de9d7bc202 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 200 len: 1303 microversion: 2.1 time: 0.171854 Sep 10 20:52:16.435627 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 590/1197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:16 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 1303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:16.462681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d1228902-b8a1-40e4-bf26-f69433a8d161 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:16.463605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d1228902-b8a1-40e4-bf26-f69433a8d161 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:16.474835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1228902-b8a1-40e4-bf26-f69433a8d161 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:16.475949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1228902-b8a1-40e4-bf26-f69433a8d161 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:16.477463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1228902-b8a1-40e4-bf26-f69433a8d161 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:16.478451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1228902-b8a1-40e4-bf26-f69433a8d161 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:16.480040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1228902-b8a1-40e4-bf26-f69433a8d161 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:16.480588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1228902-b8a1-40e4-bf26-f69433a8d161 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:16.699576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d1228902-b8a1-40e4-bf26-f69433a8d161 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:16.709176 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d1228902-b8a1-40e4-bf26-f69433a8d161 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1313 microversion: 2.1 time: 0.272369 Sep 10 20:52:16.710193 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 591/1198] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:16 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:16.715040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3f020355-7be8-4e0e-9b6d-b853e213c28c req-bf578ada-c83d-460c-a55f-4a8dccfb76d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac096a76-c7e3-4400-99c4-eac33e23490e", "name": "network-vif-deleted", "tag": "fba41ad7-a3e8-4167-81ed-4370f3ecee4f"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:16.728119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f020355-7be8-4e0e-9b6d-b853e213c28c req-bf578ada-c83d-460c-a55f-4a8dccfb76d4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:16.729452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f020355-7be8-4e0e-9b6d-b853e213c28c req-bf578ada-c83d-460c-a55f-4a8dccfb76d4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:16.730094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f020355-7be8-4e0e-9b6d-b853e213c28c req-bf578ada-c83d-460c-a55f-4a8dccfb76d4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:16.735133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:16.747487 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3f020355-7be8-4e0e-9b6d-b853e213c28c req-bf578ada-c83d-460c-a55f-4a8dccfb76d4 service nova] Creating event network-vif-deleted:fba41ad7-a3e8-4167-81ed-4370f3ecee4f for instance ac096a76-c7e3-4400-99c4-eac33e23490e on nch2-master-1 Sep 10 20:52:16.755394 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3f020355-7be8-4e0e-9b6d-b853e213c28c req-bf578ada-c83d-460c-a55f-4a8dccfb76d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043427 Sep 10 20:52:16.756530 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 592/1199] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:16.763839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7df81e22-09c0-4a17-8996-660131726efd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:16.764717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7df81e22-09c0-4a17-8996-660131726efd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:16.772672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7df81e22-09c0-4a17-8996-660131726efd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:16.773312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7df81e22-09c0-4a17-8996-660131726efd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:16.773594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7df81e22-09c0-4a17-8996-660131726efd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:16.774332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7df81e22-09c0-4a17-8996-660131726efd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:16.774793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7df81e22-09c0-4a17-8996-660131726efd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:16.775230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7df81e22-09c0-4a17-8996-660131726efd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:16.949612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7df81e22-09c0-4a17-8996-660131726efd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:16.966247 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7df81e22-09c0-4a17-8996-660131726efd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.208032 Sep 10 20:52:16.968514 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 593/1200] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:16 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:16.973936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:16.977896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:16.981922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:16.982436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:16.982889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:16.983707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:16.984888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:16.984888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.100608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:17.109175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:17.113695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:17.133077 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a74448fd-0a85-42f7-be86-1cbc1b17a1f4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.164014 Sep 10 20:52:17.134734 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 594/1201] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:16 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:17.160788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:17.161971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:17.171001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.171898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.173416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.175666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.176150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.176764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.204375 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] HTTP exception thrown: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Request method failure captured: Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e HTTP/1.1 Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPjizAh9A84nBOoeZKbAsSzBb3PZvsFmR79fa6J1gjYzBE3oYnmp3OV5RrWAoXCP_l9DaBsdhnmRqqI-2kYd4jT9GCaWnGWIvt89lqfzyr_9DQybt3ank6ChZT2F4k-3ILA_lMQagFI8AGnCCvbz9yFYJHOiE-yyYDmyyH9pwFTO1Dk Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:17.206504 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8693bafb9e424052ab91e56e9e4da6e7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8693bafb9e424052ab91e56e9e4da6e7"}]}] Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 43b9b4d83834456388c99abd3ecae3c7 Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.208602 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'ac096a76-c7e3-4400-99c4-eac33e23490e'} Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:17.209393 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.211439 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.213540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Returning 404 to user: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:17.213540 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-215e97d6-f4a8-443c-931d-4c2202d53323 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 404 len: 111 microversion: 2.1 time: 0.072048 Sep 10 20:52:17.213540 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 595/1202] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:17 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:17.218417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-963331610", "metadata": {"image_type": "test"}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:17.221630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:17.228714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.229270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.229904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.230715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.231176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.231729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.248224 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] HTTP exception thrown: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Request method failure captured: Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e/action HTTP/1.1 Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 111 Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPjizAh9A84nBOoeZKbAsSzBb3PZvsFmR79fa6J1gjYzBE3oYnmp3OV5RrWAoXCP_l9DaBsdhnmRqqI-2kYd4jT9GCaWnGWIvt89lqfzyr_9DQybt3ank6ChZT2F4k-3ILA_lMQagFI8AGnCCvbz9yFYJHOiE-yyYDmyyH9pwFTO1Dk Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:17.249877 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8693bafb9e424052ab91e56e9e4da6e7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8693bafb9e424052ab91e56e9e4da6e7"}]}] Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 43b9b4d83834456388c99abd3ecae3c7 Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-963331610", "metadata": {"image_type": "test"}}} Sep 10 20:52:17.252495 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'ac096a76-c7e3-4400-99c4-eac33e23490e', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-963331610', 'metadata': {'image_type': 'test'}}}} Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.253298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.254816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.256507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.256507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:17.256507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:17.256507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.256507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.256507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Returning 404 to user: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:17.256507 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cdfd110e-0c17-4d76-ae1d-a56f09ab4883 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "POST /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e/action" status: 404 len: 111 microversion: 2.1 time: 0.036927 Sep 10 20:52:17.256507 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 596/1203] 10.222.0.33 () {60 vars in 1279 bytes} [Sat Sep 10 20:52:17 2022] POST /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:17.264626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0ddfc7a8-35cf-4a39-921b-9c6ff3f905ab tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-224056606", "metadata": {"image_type": "test"}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:17.267588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0ddfc7a8-35cf-4a39-921b-9c6ff3f905ab tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Failed to fetch instance by id tempest-invalid-820062963 {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 20:52:17.268419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0ddfc7a8-35cf-4a39-921b-9c6ff3f905ab tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] HTTP exception thrown: Instance tempest-invalid-820062963 could not be found. Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0ddfc7a8-35cf-4a39-921b-9c6ff3f905ab tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Request method failure captured: Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/tempest-invalid-820062963/action HTTP/1.1 Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 111 Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPjizAh9A84nBOoeZKbAsSzBb3PZvsFmR79fa6J1gjYzBE3oYnmp3OV5RrWAoXCP_l9DaBsdhnmRqqI-2kYd4jT9GCaWnGWIvt89lqfzyr_9DQybt3ank6ChZT2F4k-3ILA_lMQagFI8AGnCCvbz9yFYJHOiE-yyYDmyyH9pwFTO1Dk Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:17.269755 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8693bafb9e424052ab91e56e9e4da6e7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8693bafb9e424052ab91e56e9e4da6e7"}]}] Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 43b9b4d83834456388c99abd3ecae3c7 Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-224056606", "metadata": {"image_type": "test"}}} Sep 10 20:52:17.272636 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance tempest-invalid-820062963 could not be found. Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'tempest-invalid-820062963', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-224056606', 'metadata': {'image_type': 'test'}}}} Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-820062963 could not be found. Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:17.274428 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-820062963 could not be found. Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-820062963 could not be found. Sep 10 20:52:17.276817 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.279474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0ddfc7a8-35cf-4a39-921b-9c6ff3f905ab tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Returning 404 to user: Instance tempest-invalid-820062963 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:17.279474 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0ddfc7a8-35cf-4a39-921b-9c6ff3f905ab tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "POST /compute/v2.1/servers/tempest-invalid-820062963/action" status: 404 len: 100 microversion: 2.1 time: 0.010819 Sep 10 20:52:17.279474 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 597/1204] 10.222.0.33 () {60 vars in 1246 bytes} [Sat Sep 10 20:52:17 2022] POST /compute/v2.1/servers/tempest-invalid-820062963/action => generated 100 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:17.282668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-841279fa-8ab1-4148-81f0-fa5a24b238ff tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1065932344"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:17.285305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-841279fa-8ab1-4148-81f0-fa5a24b238ff tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 20:52:17.286128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-841279fa-8ab1-4148-81f0-fa5a24b238ff tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-841279fa-8ab1-4148-81f0-fa5a24b238ff tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Request method failure captured: Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 57 Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPjizAh9A84nBOoeZKbAsSzBb3PZvsFmR79fa6J1gjYzBE3oYnmp3OV5RrWAoXCP_l9DaBsdhnmRqqI-2kYd4jT9GCaWnGWIvt89lqfzyr_9DQybt3ank6ChZT2F4k-3ILA_lMQagFI8AGnCCvbz9yFYJHOiE-yyYDmyyH9pwFTO1Dk Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:17.288910 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8693bafb9e424052ab91e56e9e4da6e7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8693bafb9e424052ab91e56e9e4da6e7"}]}] Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 43b9b4d83834456388c99abd3ecae3c7 Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: {"createImage": {"name": "tempest-test-snap-1065932344"}} Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:17.290790 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1065932344'}}} Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:17.291897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 20:52:17.295166 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.296674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-841279fa-8ab1-4148-81f0-fa5a24b238ff tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:17.296674 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-841279fa-8ab1-4148-81f0-fa5a24b238ff tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011748 Sep 10 20:52:17.296674 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 598/1205] 10.222.0.33 () {60 vars in 1275 bytes} [Sat Sep 10 20:52:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:52:17.312116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9b168179-fc31-419f-b4c8-ca6aef1360cb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:17.312730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9b168179-fc31-419f-b4c8-ca6aef1360cb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:17.320487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b168179-fc31-419f-b4c8-ca6aef1360cb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.320979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b168179-fc31-419f-b4c8-ca6aef1360cb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.321468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b168179-fc31-419f-b4c8-ca6aef1360cb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.322205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b168179-fc31-419f-b4c8-ca6aef1360cb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.322662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b168179-fc31-419f-b4c8-ca6aef1360cb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.323084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b168179-fc31-419f-b4c8-ca6aef1360cb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.512230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9b168179-fc31-419f-b4c8-ca6aef1360cb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:17.521726 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9b168179-fc31-419f-b4c8-ca6aef1360cb tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.213129 Sep 10 20:52:17.522848 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 599/1206] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:17 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:17.528076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e3295dab-124f-4e4c-b292-0800444df00b tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1778439810"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:17.530489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e3295dab-124f-4e4c-b292-0800444df00b tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 20:52:17.531236 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e3295dab-124f-4e4c-b292-0800444df00b tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e3295dab-124f-4e4c-b292-0800444df00b tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Request method failure captured: Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 57 Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPjizAh9A84nBOoeZKbAsSzBb3PZvsFmR79fa6J1gjYzBE3oYnmp3OV5RrWAoXCP_l9DaBsdhnmRqqI-2kYd4jT9GCaWnGWIvt89lqfzyr_9DQybt3ank6ChZT2F4k-3ILA_lMQagFI8AGnCCvbz9yFYJHOiE-yyYDmyyH9pwFTO1Dk Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:17.533803 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8693bafb9e424052ab91e56e9e4da6e7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8693bafb9e424052ab91e56e9e4da6e7"}]}] Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 43b9b4d83834456388c99abd3ecae3c7 Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: {"createImage": {"name": "tempest-test-snap-1778439810"}} Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:17.535526 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1778439810'}}} Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:17.536581 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 20:52:17.538096 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.539584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e3295dab-124f-4e4c-b292-0800444df00b tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:17.539584 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e3295dab-124f-4e4c-b292-0800444df00b tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.013358 Sep 10 20:52:17.539584 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 600/1207] 10.222.0.33 () {60 vars in 1281 bytes} [Sat Sep 10 20:52:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:17.543490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:17.544302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: 2fdb5cc4-af47-4827-98a3-9e8aa572868b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:17.557419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.558104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.558549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.559395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.559875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.560333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.575856 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] HTTP exception thrown: Instance 2fdb5cc4-af47-4827-98a3-9e8aa572868b could not be found. Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Request method failure captured: Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b HTTP/1.1 Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhmSXPL_NmN8wfoIO9z9tPDj-2fNFmfNV3J3WPd7C0gfQLiVqLNFPCAq1Y-2Syxr4SrcWMbeXbtDUUA3qGdoRjcr1qnL7MPXfLWW1jHd6Y-qpHsYer0v4B9-h6TB5mtWnHqY-fECujOhXBAg7x1ibOMCtLLPqy2aZrIpIGzURyv7ag Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5580128bff364c858eafedcc84dad425 Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdminTestJSON-704954675 Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:17.577649 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5580128bff364c858eafedcc84dad425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5580128bff364c858eafedcc84dad425"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5580128bff364c858eafedcc84dad425", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5580128bff364c858eafedcc84dad425"}]}] Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdminTestJSON-704954675 Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5580128bff364c858eafedcc84dad425 Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdminTestJSON-704954675 Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdminTestJSON-704954675-project Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: cbabc9a296d14628b649da7d81bc8766 Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdminTestJSON-704954675-project Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 2fdb5cc4-af47-4827-98a3-9e8aa572868b could not be found. Sep 10 20:52:17.579058 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2fdb5cc4-af47-4827-98a3-9e8aa572868b'} Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fdb5cc4-af47-4827-98a3-9e8aa572868b could not be found. Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:17.581609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fdb5cc4-af47-4827-98a3-9e8aa572868b could not be found. Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fdb5cc4-af47-4827-98a3-9e8aa572868b could not be found. Sep 10 20:52:17.582909 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.588152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Returning 404 to user: Instance 2fdb5cc4-af47-4827-98a3-9e8aa572868b could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:17.588152 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-65208aef-9f45-4629-a00d-6047e4da2690 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b" status: 404 len: 111 microversion: 2.1 time: 0.039544 Sep 10 20:52:17.588152 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 601/1208] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:17 2022] GET /compute/v2.1/servers/2fdb5cc4-af47-4827-98a3-9e8aa572868b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:17.590826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:17.593206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:17.597756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.598296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.598735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.599440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.599931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.600326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.615126 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] HTTP exception thrown: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Request method failure captured: Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e HTTP/1.1 Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPjizAh9A84nBOoeZKbAsSzBb3PZvsFmR79fa6J1gjYzBE3oYnmp3OV5RrWAoXCP_l9DaBsdhnmRqqI-2kYd4jT9GCaWnGWIvt89lqfzyr_9DQybt3ank6ChZT2F4k-3ILA_lMQagFI8AGnCCvbz9yFYJHOiE-yyYDmyyH9pwFTO1Dk Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:17.616702 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8693bafb9e424052ab91e56e9e4da6e7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8693bafb9e424052ab91e56e9e4da6e7"}]}] Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 43b9b4d83834456388c99abd3ecae3c7 Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.621348 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'ac096a76-c7e3-4400-99c4-eac33e23490e'} Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:17.622514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.624024 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.625577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Returning 404 to user: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:17.625577 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-276bcfac-c1de-47c1-baf0-f569f0ac65dd tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 404 len: 111 microversion: 2.1 time: 0.032206 Sep 10 20:52:17.625577 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 602/1209] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:52:17 2022] DELETE /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:17.625577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c548e44-6051-45f0-8597-bb0ed03c8c31 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:17.626213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c548e44-6051-45f0-8597-bb0ed03c8c31 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:17.633265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c548e44-6051-45f0-8597-bb0ed03c8c31 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.633978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c548e44-6051-45f0-8597-bb0ed03c8c31 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.634601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c548e44-6051-45f0-8597-bb0ed03c8c31 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.635469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c548e44-6051-45f0-8597-bb0ed03c8c31 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.636084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c548e44-6051-45f0-8597-bb0ed03c8c31 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.636669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c548e44-6051-45f0-8597-bb0ed03c8c31 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.676032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c548e44-6051-45f0-8597-bb0ed03c8c31 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:52:17.806191 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c548e44-6051-45f0-8597-bb0ed03c8c31 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 204 len: 0 microversion: 2.1 time: 0.185857 Sep 10 20:52:17.810761 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 603/1210] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:52:17 2022] DELETE /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:52:17.823759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:17.824672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] [instance: ac096a76-c7e3-4400-99c4-eac33e23490e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:17.833335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.834065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.834608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.835571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.836103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.836610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.852873 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] HTTP exception thrown: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Request method failure captured: Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e HTTP/1.1 Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPjizAh9A84nBOoeZKbAsSzBb3PZvsFmR79fa6J1gjYzBE3oYnmp3OV5RrWAoXCP_l9DaBsdhnmRqqI-2kYd4jT9GCaWnGWIvt89lqfzyr_9DQybt3ank6ChZT2F4k-3ILA_lMQagFI8AGnCCvbz9yFYJHOiE-yyYDmyyH9pwFTO1Dk Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:17.854982 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8693bafb9e424052ab91e56e9e4da6e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8693bafb9e424052ab91e56e9e4da6e7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8693bafb9e424052ab91e56e9e4da6e7"}]}] Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 8693bafb9e424052ab91e56e9e4da6e7 Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1663153787 Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 43b9b4d83834456388c99abd3ecae3c7 Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesNegativeTestJSON-1663153787-project Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.856323 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'ac096a76-c7e3-4400-99c4-eac33e23490e'} Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:17.857104 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. Sep 10 20:52:17.859151 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:17.860871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] Returning 404 to user: Instance ac096a76-c7e3-4400-99c4-eac33e23490e could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:17.860871 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bff8f385-b9f0-4b8e-82ca-7dc3e25f4e03 tempest-ImagesNegativeTestJSON-1663153787 tempest-ImagesNegativeTestJSON-1663153787-project] 10.222.0.33 "GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e" status: 404 len: 111 microversion: 2.1 time: 0.044162 Sep 10 20:52:17.875494 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 604/1211] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:17 2022] GET /compute/v2.1/servers/ac096a76-c7e3-4400-99c4-eac33e23490e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:17.880734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f15e720f-472c-4549-a6ff-1f6e8414d20e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:17.884857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f15e720f-472c-4549-a6ff-1f6e8414d20e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:17.896170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f15e720f-472c-4549-a6ff-1f6e8414d20e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.900905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f15e720f-472c-4549-a6ff-1f6e8414d20e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.901426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f15e720f-472c-4549-a6ff-1f6e8414d20e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:17.902447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f15e720f-472c-4549-a6ff-1f6e8414d20e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:17.904535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f15e720f-472c-4549-a6ff-1f6e8414d20e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:17.905062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f15e720f-472c-4549-a6ff-1f6e8414d20e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:18.645860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f15e720f-472c-4549-a6ff-1f6e8414d20e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:18.668396 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f15e720f-472c-4549-a6ff-1f6e8414d20e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1313 microversion: 2.1 time: 0.781152 Sep 10 20:52:18.668396 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 605/1212] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:17 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:18.678419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-353fca9e-c32c-4d1f-95da-8ce504a29fb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:18.678419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-353fca9e-c32c-4d1f-95da-8ce504a29fb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:18.696779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-353fca9e-c32c-4d1f-95da-8ce504a29fb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:18.697284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-353fca9e-c32c-4d1f-95da-8ce504a29fb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:18.697728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-353fca9e-c32c-4d1f-95da-8ce504a29fb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:18.698486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-353fca9e-c32c-4d1f-95da-8ce504a29fb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:18.698951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-353fca9e-c32c-4d1f-95da-8ce504a29fb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:18.706025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-353fca9e-c32c-4d1f-95da-8ce504a29fb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:19.053389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-353fca9e-c32c-4d1f-95da-8ce504a29fb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:19.066667 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-353fca9e-c32c-4d1f-95da-8ce504a29fb9 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1467 microversion: 2.1 time: 0.402017 Sep 10 20:52:19.088353 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 606/1213] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:18 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1467 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:19.101225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ba70a962-fede-4470-8c82-181cecc5981b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:19.103207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ba70a962-fede-4470-8c82-181cecc5981b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:19.120823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba70a962-fede-4470-8c82-181cecc5981b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:19.121376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba70a962-fede-4470-8c82-181cecc5981b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:19.123425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba70a962-fede-4470-8c82-181cecc5981b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:19.125214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba70a962-fede-4470-8c82-181cecc5981b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:19.127088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba70a962-fede-4470-8c82-181cecc5981b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:19.127899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba70a962-fede-4470-8c82-181cecc5981b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:19.744712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ba70a962-fede-4470-8c82-181cecc5981b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:19.764050 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ba70a962-fede-4470-8c82-181cecc5981b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.674042 Sep 10 20:52:19.764934 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 607/1214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:19 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:19.769902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:19.771566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:19.785009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:19.785397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:19.785852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:19.786583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:19.787049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:19.787485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:19.910935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:19.920627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:19.927701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:19.945306 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ecc15e42-1a1f-4125-9e29-27b31b8f12ab tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.179149 Sep 10 20:52:19.946323 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 608/1215] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:19 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:19.951211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8cb3a2c5-d06e-4ad8-ab3d-3ce861bfa3e9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:19.952045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8cb3a2c5-d06e-4ad8-ab3d-3ce861bfa3e9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:19.976155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cb3a2c5-d06e-4ad8-ab3d-3ce861bfa3e9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:19.976938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cb3a2c5-d06e-4ad8-ab3d-3ce861bfa3e9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:19.977381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cb3a2c5-d06e-4ad8-ab3d-3ce861bfa3e9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:19.978146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cb3a2c5-d06e-4ad8-ab3d-3ce861bfa3e9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:19.978765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cb3a2c5-d06e-4ad8-ab3d-3ce861bfa3e9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:19.979353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cb3a2c5-d06e-4ad8-ab3d-3ce861bfa3e9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:20.276047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8cb3a2c5-d06e-4ad8-ab3d-3ce861bfa3e9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:20.287927 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8cb3a2c5-d06e-4ad8-ab3d-3ce861bfa3e9 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.340262 Sep 10 20:52:20.289354 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 609/1216] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:19 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:20.305849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-9e8518de-33a3-4922-bf28-27fa53ebdfc5 req-ed3cf400-7b0e-47b3-b6ce-84f18a4b148c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435d0526-f990-4ec6-b38f-13aa30486469", "name": "network-vif-plugged", "status": "completed", "tag": "bfa95032-3491-453d-9ca4-83b61c66730d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:20.329077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9e8518de-33a3-4922-bf28-27fa53ebdfc5 req-ed3cf400-7b0e-47b3-b6ce-84f18a4b148c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:20.330255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9e8518de-33a3-4922-bf28-27fa53ebdfc5 req-ed3cf400-7b0e-47b3-b6ce-84f18a4b148c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:20.330699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9e8518de-33a3-4922-bf28-27fa53ebdfc5 req-ed3cf400-7b0e-47b3-b6ce-84f18a4b148c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:20.351523 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-9e8518de-33a3-4922-bf28-27fa53ebdfc5 req-ed3cf400-7b0e-47b3-b6ce-84f18a4b148c service nova] Creating event network-vif-plugged:bfa95032-3491-453d-9ca4-83b61c66730d for instance 435d0526-f990-4ec6-b38f-13aa30486469 on nch2-master-1 Sep 10 20:52:20.359110 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-9e8518de-33a3-4922-bf28-27fa53ebdfc5 req-ed3cf400-7b0e-47b3-b6ce-84f18a4b148c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068085 Sep 10 20:52:20.360246 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 610/1217] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:20.366597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-20a221c6-8189-41cb-9385-e31635b2ec7b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:20.367788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-20a221c6-8189-41cb-9385-e31635b2ec7b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:20.374668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20a221c6-8189-41cb-9385-e31635b2ec7b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:20.375307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20a221c6-8189-41cb-9385-e31635b2ec7b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:20.375855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20a221c6-8189-41cb-9385-e31635b2ec7b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:20.376630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20a221c6-8189-41cb-9385-e31635b2ec7b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:20.377144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20a221c6-8189-41cb-9385-e31635b2ec7b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:20.377784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20a221c6-8189-41cb-9385-e31635b2ec7b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:20.765028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-20a221c6-8189-41cb-9385-e31635b2ec7b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:20.774940 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-20a221c6-8189-41cb-9385-e31635b2ec7b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1313 microversion: 2.1 time: 0.413409 Sep 10 20:52:20.776118 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 611/1218] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:20 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:21.010746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b9b7f3c8-0075-4381-88be-6bfec8e49174 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2092262886", "ram": 512, "vcpus": 1, "disk": 10, "id": 1293569259, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:21.016854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=7,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:21.034024 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b9b7f3c8-0075-4381-88be-6bfec8e49174 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.255494 Sep 10 20:52:21.035267 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 612/1219] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:52:20 2022] POST /compute/v2.1/flavors => generated 416 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:21.040104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:21.040931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:21.051337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:21.052081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:21.052533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:21.053268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:21.053740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:21.054207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:21.091025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:21.091749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:21.092517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:21.093150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lazy-loading 'fault' on Instance uuid d3dd2771-3e57-4798-ab1e-c16e724ad6f4 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:21.148228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbabc9a296d14628b649da7d81bc8766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5580128bff364c858eafedcc84dad425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:21.157762 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-abb7a6c7-672c-4fc3-835f-4d7bbab4c4ce tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 200 len: 1303 microversion: 2.1 time: 0.121086 Sep 10 20:52:21.158650 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 613/1220] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:21 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:21.163048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-aa21a154-cf10-4366-ac53-86d0345db4eb req-5fcd2c82-074e-4a52-8c15-03129ff12133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dd2771-3e57-4798-ab1e-c16e724ad6f4", "name": "network-vif-deleted", "tag": "5bf39bf7-b621-4388-8dd2-5fd139920258"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:21.172415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa21a154-cf10-4366-ac53-86d0345db4eb req-5fcd2c82-074e-4a52-8c15-03129ff12133 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:21.172898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa21a154-cf10-4366-ac53-86d0345db4eb req-5fcd2c82-074e-4a52-8c15-03129ff12133 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:21.173904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa21a154-cf10-4366-ac53-86d0345db4eb req-5fcd2c82-074e-4a52-8c15-03129ff12133 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:21.185260 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-aa21a154-cf10-4366-ac53-86d0345db4eb req-5fcd2c82-074e-4a52-8c15-03129ff12133 service nova] Creating event network-vif-deleted:5bf39bf7-b621-4388-8dd2-5fd139920258 for instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 on nch2-master-1 Sep 10 20:52:21.191303 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-aa21a154-cf10-4366-ac53-86d0345db4eb req-5fcd2c82-074e-4a52-8c15-03129ff12133 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031683 Sep 10 20:52:21.191888 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 614/1221] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:21.196849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5271baa6-4c2f-408b-a450-2d4adaac098a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:21.197545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5271baa6-4c2f-408b-a450-2d4adaac098a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:21.203496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5271baa6-4c2f-408b-a450-2d4adaac098a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:21.204177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5271baa6-4c2f-408b-a450-2d4adaac098a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:21.204767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5271baa6-4c2f-408b-a450-2d4adaac098a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:21.205814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5271baa6-4c2f-408b-a450-2d4adaac098a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:21.206298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5271baa6-4c2f-408b-a450-2d4adaac098a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:21.206721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5271baa6-4c2f-408b-a450-2d4adaac098a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:21.410003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5271baa6-4c2f-408b-a450-2d4adaac098a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:21.418191 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5271baa6-4c2f-408b-a450-2d4adaac098a tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.225031 Sep 10 20:52:21.434218 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 615/1222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:21 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:21.434218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:21.434218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:21.443182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:21.443849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:21.444307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:21.445119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:21.445595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:21.446062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:21.451334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:21.534486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:21.544921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:21.547601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:21.553876 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35a3e476-8040-4c0b-8955-76720d32a634 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.133953 Sep 10 20:52:21.554808 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 616/1223] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:21 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:21.559265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f92ccfb4-a08c-4168-b0e6-5fa988fd83f9 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:21.592773 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f92ccfb4-a08c-4168-b0e6-5fa988fd83f9 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1293569259/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036654 Sep 10 20:52:21.593913 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 617/1224] 10.222.0.33 () {60 vars in 1224 bytes} [Sat Sep 10 20:52:21 2022] POST /compute/v2.1/flavors/1293569259/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:21.600284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-51ef8b1f-11d2-4f40-a874-734a0aa139e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:21.601170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-51ef8b1f-11d2-4f40-a874-734a0aa139e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:21.607315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef8b1f-11d2-4f40-a874-734a0aa139e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:21.607867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef8b1f-11d2-4f40-a874-734a0aa139e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:21.608362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef8b1f-11d2-4f40-a874-734a0aa139e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:21.609075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef8b1f-11d2-4f40-a874-734a0aa139e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:21.609662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef8b1f-11d2-4f40-a874-734a0aa139e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:21.610194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef8b1f-11d2-4f40-a874-734a0aa139e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:21.850121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-51ef8b1f-11d2-4f40-a874-734a0aa139e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:21.864712 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-51ef8b1f-11d2-4f40-a874-734a0aa139e6 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1334 microversion: 2.1 time: 0.269559 Sep 10 20:52:21.865319 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 618/1225] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:21 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1334 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:22.099097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c6204db5-9c47-48e1-858f-e6d365af3c54 tempest-FlavorsExtraSpecsTestJSON-1251842813 tempest-FlavorsExtraSpecsTestJSON-1251842813-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:22.108364 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c6204db5-9c47-48e1-858f-e6d365af3c54 tempest-FlavorsExtraSpecsTestJSON-1251842813 tempest-FlavorsExtraSpecsTestJSON-1251842813-project] 10.222.0.33 "GET /compute/v2.1/flavors/1293569259/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.242020 Sep 10 20:52:22.109032 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 619/1226] 10.222.0.33 () {58 vars in 1203 bytes} [Sat Sep 10 20:52:21 2022] GET /compute/v2.1/flavors/1293569259/os-extra_specs => generated 66 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:22.121255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-66424c8f-8520-4fc8-92a2-6cac1c0fe115 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:22.122138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-66424c8f-8520-4fc8-92a2-6cac1c0fe115 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:22.129857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66424c8f-8520-4fc8-92a2-6cac1c0fe115 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:22.130426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66424c8f-8520-4fc8-92a2-6cac1c0fe115 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:22.130959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66424c8f-8520-4fc8-92a2-6cac1c0fe115 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:22.131717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66424c8f-8520-4fc8-92a2-6cac1c0fe115 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:22.132237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66424c8f-8520-4fc8-92a2-6cac1c0fe115 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:22.133128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66424c8f-8520-4fc8-92a2-6cac1c0fe115 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:22.232909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:22.305225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:22.353168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-66424c8f-8520-4fc8-92a2-6cac1c0fe115 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:22.361961 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-66424c8f-8520-4fc8-92a2-6cac1c0fe115 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1462 microversion: 2.1 time: 0.251680 Sep 10 20:52:22.362551 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 620/1227] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:22 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1462 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:22.373963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2cdc45f0-4b21-4108-b4fc-386eb2688e14 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:22.390304 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2cdc45f0-4b21-4108-b4fc-386eb2688e14 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1293569259/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026628 Sep 10 20:52:22.390917 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 621/1228] 10.222.0.33 () {60 vars in 1224 bytes} [Sat Sep 10 20:52:22 2022] POST /compute/v2.1/flavors/1293569259/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:22.396855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:22.397487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] [instance: d3dd2771-3e57-4798-ab1e-c16e724ad6f4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:22.404744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:22.405242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:22.405688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:22.406986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:22.406986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:22.407299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:22.421347 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] HTTP exception thrown: Instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 could not be found. Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Request method failure captured: Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 HTTP/1.1 Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhmSXPL_NmN8wfoIO9z9tPDj-2fNFmfNV3J3WPd7C0gfQLiVqLNFPCAq1Y-2Syxr4SrcWMbeXbtDUUA3qGdoRjcr1qnL7MPXfLWW1jHd6Y-qpHsYer0v4B9-h6TB5mtWnHqY-fECujOhXBAg7x1ibOMCtLLPqy2aZrIpIGzURyv7ag Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5580128bff364c858eafedcc84dad425 Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdminTestJSON-704954675 Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:22.423041 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5580128bff364c858eafedcc84dad425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5580128bff364c858eafedcc84dad425"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5580128bff364c858eafedcc84dad425", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5580128bff364c858eafedcc84dad425"}]}] Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdminTestJSON-704954675 Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5580128bff364c858eafedcc84dad425 Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdminTestJSON-704954675 Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdminTestJSON-704954675-project Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: cbabc9a296d14628b649da7d81bc8766 Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdminTestJSON-704954675-project Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 could not be found. Sep 10 20:52:22.424869 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'd3dd2771-3e57-4798-ab1e-c16e724ad6f4'} Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 could not be found. Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:22.425855 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 could not be found. Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 could not be found. Sep 10 20:52:22.427476 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:22.428809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] Returning 404 to user: Instance d3dd2771-3e57-4798-ab1e-c16e724ad6f4 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:22.428809 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a75fa76f-f47a-4f73-840a-449865910cb3 tempest-ServersAdminTestJSON-704954675 tempest-ServersAdminTestJSON-704954675-project] 10.222.0.33 "GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4" status: 404 len: 111 microversion: 2.1 time: 0.032643 Sep 10 20:52:22.428809 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 622/1229] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:22 2022] GET /compute/v2.1/servers/d3dd2771-3e57-4798-ab1e-c16e724ad6f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:22.430417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:22.432214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:22.439053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:22.439541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:22.439995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:22.441186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:22.441655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:22.442407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:22.556701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:22.574105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Old instance type m1.heat2, new instance type m1.heat {{(pid=145772) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 20:52:22.582430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:52:22.582861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:52:22.583360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:52:22.583744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:52:22.584157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:52:22.739750 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-61e1e420-8cd6-4af7-aa6f-0d8047442497 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469/action" status: 202 len: 0 microversion: 2.1 time: 0.313572 Sep 10 20:52:22.740562 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 623/1230] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:52:22 2022] POST /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:22.745477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c153132c-9d5e-4b15-94a9-83d8529b6baa tempest-FlavorsExtraSpecsTestJSON-1251842813 tempest-FlavorsExtraSpecsTestJSON-1251842813-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:22.759026 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c153132c-9d5e-4b15-94a9-83d8529b6baa tempest-FlavorsExtraSpecsTestJSON-1251842813 tempest-FlavorsExtraSpecsTestJSON-1251842813-project] 10.222.0.33 "GET /compute/v2.1/flavors/1293569259/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.017478 Sep 10 20:52:22.765297 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 624/1231] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 20:52:22 2022] GET /compute/v2.1/flavors/1293569259/os-extra_specs/hw:numa_nodes => generated 22 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:22.770671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-203d8389-a3ed-4b16-bca0-afe1fa4028b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:22.771403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-203d8389-a3ed-4b16-bca0-afe1fa4028b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:22.779031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-203d8389-a3ed-4b16-bca0-afe1fa4028b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:22.779631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-203d8389-a3ed-4b16-bca0-afe1fa4028b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:22.780171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-203d8389-a3ed-4b16-bca0-afe1fa4028b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:22.780972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-203d8389-a3ed-4b16-bca0-afe1fa4028b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:22.783095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-203d8389-a3ed-4b16-bca0-afe1fa4028b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:22.784215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-203d8389-a3ed-4b16-bca0-afe1fa4028b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:23.127315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-203d8389-a3ed-4b16-bca0-afe1fa4028b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:23.143160 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-203d8389-a3ed-4b16-bca0-afe1fa4028b1 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.375712 Sep 10 20:52:23.143987 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 625/1232] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:22 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:23.161026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:23.164762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:23.179246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:23.182565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:23.183100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:23.183933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:23.184402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:23.184840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:23.280635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:23.313202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:23.319137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:23.329269 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6d661187-5992-45af-bb3f-b38084567cad tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.178181 Sep 10 20:52:23.330909 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 626/1233] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:23 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:23.342089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-273718c7-86d0-4951-8fa2-17919a055ba0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:23.342906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-273718c7-86d0-4951-8fa2-17919a055ba0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:23.354634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-273718c7-86d0-4951-8fa2-17919a055ba0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:23.355382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-273718c7-86d0-4951-8fa2-17919a055ba0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:23.356373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-273718c7-86d0-4951-8fa2-17919a055ba0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:23.357684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-273718c7-86d0-4951-8fa2-17919a055ba0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:23.358318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-273718c7-86d0-4951-8fa2-17919a055ba0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:23.358900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-273718c7-86d0-4951-8fa2-17919a055ba0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:23.690837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-273718c7-86d0-4951-8fa2-17919a055ba0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:23.702511 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-273718c7-86d0-4951-8fa2-17919a055ba0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1471 microversion: 2.1 time: 0.369658 Sep 10 20:52:23.718967 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 627/1234] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:23 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1471 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:23.727136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-239f5943-469d-4d41-816e-a93933e8a672 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:23.757232 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-239f5943-469d-4d41-816e-a93933e8a672 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1293569259/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036805 Sep 10 20:52:23.758815 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 628/1235] 10.222.0.33 () {60 vars in 1224 bytes} [Sat Sep 10 20:52:23 2022] POST /compute/v2.1/flavors/1293569259/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:23.764359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bf14634a-d2b4-4e5b-baf0-33abd62baab2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:23.765155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bf14634a-d2b4-4e5b-baf0-33abd62baab2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:23.778851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf14634a-d2b4-4e5b-baf0-33abd62baab2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:23.779707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf14634a-d2b4-4e5b-baf0-33abd62baab2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:23.780355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf14634a-d2b4-4e5b-baf0-33abd62baab2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:23.781272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf14634a-d2b4-4e5b-baf0-33abd62baab2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:23.781969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf14634a-d2b4-4e5b-baf0-33abd62baab2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:23.782650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf14634a-d2b4-4e5b-baf0-33abd62baab2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.133274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bf14634a-d2b4-4e5b-baf0-33abd62baab2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:24.142662 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bf14634a-d2b4-4e5b-baf0-33abd62baab2 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1669 microversion: 2.1 time: 0.381994 Sep 10 20:52:24.143392 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 629/1236] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:23 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1669 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:24.149774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8957fd0-c86d-437b-a3d4-15ecc6ca320f tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:24.201374 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8957fd0-c86d-437b-a3d4-15ecc6ca320f tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1293569259/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055046 Sep 10 20:52:24.224796 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 630/1237] 10.222.0.33 () {58 vars in 1203 bytes} [Sat Sep 10 20:52:24 2022] GET /compute/v2.1/flavors/1293569259/os-extra_specs => generated 66 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:24.246086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e7722794-4f9e-4ea0-9d56-2278c0ad10f3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:24.246775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e7722794-4f9e-4ea0-9d56-2278c0ad10f3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:24.255570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7722794-4f9e-4ea0-9d56-2278c0ad10f3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.256369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7722794-4f9e-4ea0-9d56-2278c0ad10f3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.256917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7722794-4f9e-4ea0-9d56-2278c0ad10f3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.257864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7722794-4f9e-4ea0-9d56-2278c0ad10f3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.258428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7722794-4f9e-4ea0-9d56-2278c0ad10f3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.258965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7722794-4f9e-4ea0-9d56-2278c0ad10f3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.305147 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-559a92bb-4612-4d14-a1f3-5b1c45adab33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/action" status: 202 len: 0 microversion: 2.25 time: 12.149810 Sep 10 20:52:24.305953 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 608/1238] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:52:12 2022] POST /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/action => generated 0 bytes in 12151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:52:24.311509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-57dcfebe-2495-4ecc-ab45-f5e0f2e4f0ae tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:24.312079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-57dcfebe-2495-4ecc-ab45-f5e0f2e4f0ae tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:24.325929 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e7722794-4f9e-4ea0-9d56-2278c0ad10f3 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835/ips" status: 200 len: 179 microversion: 2.1 time: 0.094752 Sep 10 20:52:24.334391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57dcfebe-2495-4ecc-ab45-f5e0f2e4f0ae tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.334391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57dcfebe-2495-4ecc-ab45-f5e0f2e4f0ae tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.334391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57dcfebe-2495-4ecc-ab45-f5e0f2e4f0ae tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.334803 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 631/1239] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 20:52:24 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835/ips => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:24.337245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57dcfebe-2495-4ecc-ab45-f5e0f2e4f0ae tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.337798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57dcfebe-2495-4ecc-ab45-f5e0f2e4f0ae tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.338278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57dcfebe-2495-4ecc-ab45-f5e0f2e4f0ae tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.343662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d255ef91-f627-40c8-8ed9-3d71e15de703 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:24.388429 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d255ef91-f627-40c8-8ed9-3d71e15de703 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1293569259/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.055239 Sep 10 20:52:24.395078 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 632/1240] 10.222.0.33 () {60 vars in 1265 bytes} [Sat Sep 10 20:52:24 2022] PUT /compute/v2.1/flavors/1293569259/os-extra_specs/hw:numa_nodes => generated 22 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:24.402149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:24.403070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:24.412182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.412689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.413139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.414394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.415972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.416450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.641967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:24.649551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-57dcfebe-2495-4ecc-ab45-f5e0f2e4f0ae tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:24.652101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:24.654117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:24.655322 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1643c8c-d54d-4aec-96f7-aa3fbe2a1839 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.259212 Sep 10 20:52:24.658039 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 633/1241] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:24 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:24.661769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-00290aba-7e31-4dc1-af1a-258c3a254603 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:24.662509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-00290aba-7e31-4dc1-af1a-258c3a254603 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:24.665208 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-57dcfebe-2495-4ecc-ab45-f5e0f2e4f0ae tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.353327 Sep 10 20:52:24.668532 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 609/1242] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:24 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:24.676249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00290aba-7e31-4dc1-af1a-258c3a254603 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.684574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:24.685189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:24.686043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00290aba-7e31-4dc1-af1a-258c3a254603 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.686658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00290aba-7e31-4dc1-af1a-258c3a254603 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.687437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00290aba-7e31-4dc1-af1a-258c3a254603 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.690337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00290aba-7e31-4dc1-af1a-258c3a254603 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.690967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00290aba-7e31-4dc1-af1a-258c3a254603 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.702143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.703694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.705268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.706382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.709435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.710610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.724650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-00290aba-7e31-4dc1-af1a-258c3a254603 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:52:24.840847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:24.853533 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-00290aba-7e31-4dc1-af1a-258c3a254603 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 204 len: 0 microversion: 2.1 time: 0.196141 Sep 10 20:52:24.857291 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 634/1243] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:52:24 2022] DELETE /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:52:24.864109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e06c5330-5181-4bf6-9175-afa5772e821a tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:24.865780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:24.867776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:24.871686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=79,nova_api:SAVEPOINT=8,nova_api:RELEASE=8,nova_api:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:24.878742 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e06c5330-5181-4bf6-9175-afa5772e821a tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1293569259/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022002 Sep 10 20:52:24.881959 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 635/1244] 10.222.0.33 () {58 vars in 1203 bytes} [Sat Sep 10 20:52:24 2022] GET /compute/v2.1/flavors/1293569259/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:24.882440 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-49d96cba-8464-4169-a070-cf7d3d287d07 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.211166 Sep 10 20:52:24.883016 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 610/1245] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:24 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:24.888921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8471785-9a61-434d-af65-acfc7b05ff93 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:24.890193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ee6ba310-c26c-4577-aa31-568bf7bd91d7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:24.890311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8471785-9a61-434d-af65-acfc7b05ff93 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:24.891206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ee6ba310-c26c-4577-aa31-568bf7bd91d7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:24.900481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8471785-9a61-434d-af65-acfc7b05ff93 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.901273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8471785-9a61-434d-af65-acfc7b05ff93 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.901925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8471785-9a61-434d-af65-acfc7b05ff93 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.903594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee6ba310-c26c-4577-aa31-568bf7bd91d7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.903780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8471785-9a61-434d-af65-acfc7b05ff93 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.904105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee6ba310-c26c-4577-aa31-568bf7bd91d7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.904571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8471785-9a61-434d-af65-acfc7b05ff93 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.904695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee6ba310-c26c-4577-aa31-568bf7bd91d7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.905261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8471785-9a61-434d-af65-acfc7b05ff93 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:24.905468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee6ba310-c26c-4577-aa31-568bf7bd91d7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:24.906669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee6ba310-c26c-4577-aa31-568bf7bd91d7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:24.907124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee6ba310-c26c-4577-aa31-568bf7bd91d7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:25.060358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ee6ba310-c26c-4577-aa31-568bf7bd91d7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:25.071062 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ee6ba310-c26c-4577-aa31-568bf7bd91d7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1471 microversion: 2.1 time: 0.187679 Sep 10 20:52:25.071650 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 636/1246] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:24 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:25.078622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fcfd3fb8-6cb9-4d39-9cb6-e5f0dce05f40 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:25.110591 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fcfd3fb8-6cb9-4d39-9cb6-e5f0dce05f40 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1293569259/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.037851 Sep 10 20:52:25.112151 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 637/1247] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 20:52:25 2022] DELETE /compute/v2.1/flavors/1293569259/os-extra_specs/hw:numa_nodes => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 20:52:25.120426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6df3c082-8fa7-4632-a848-316d9bd4088d tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:25.152847 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6df3c082-8fa7-4632-a848-316d9bd4088d tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1293569259/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.036211 Sep 10 20:52:25.154276 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 638/1248] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 20:52:25 2022] DELETE /compute/v2.1/flavors/1293569259/os-extra_specs/hw:cpu_policy => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 20:52:25.162953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8471785-9a61-434d-af65-acfc7b05ff93 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:25.163239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-69e0795e-af65-478f-97bb-c365bc2ccff8 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:25.172993 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-69e0795e-af65-478f-97bb-c365bc2ccff8 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1293569259/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013376 Sep 10 20:52:25.174763 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 639/1249] 10.222.0.33 () {58 vars in 1203 bytes} [Sat Sep 10 20:52:25 2022] GET /compute/v2.1/flavors/1293569259/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 20:52:25.184388 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8471785-9a61-434d-af65-acfc7b05ff93 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1675 microversion: 2.1 time: 0.296312 Sep 10 20:52:25.185270 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 611/1250] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:24 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1675 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:25.186208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-11c38597-c883-4cf9-b2c9-08e40415c7b4 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:25.214072 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-11c38597-c883-4cf9-b2c9-08e40415c7b4 tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1293569259" status: 202 len: 0 microversion: 2.1 time: 0.030928 Sep 10 20:52:25.214683 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 640/1251] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 20:52:25 2022] DELETE /compute/v2.1/flavors/1293569259 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:25.224848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-45ef042b-a4d6-4be6-98eb-02cff23d02cb tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:25.258101 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-45ef042b-a4d6-4be6-98eb-02cff23d02cb tempest-FlavorsExtraSpecsTestJSON-585350219 tempest-FlavorsExtraSpecsTestJSON-585350219-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038543 Sep 10 20:52:25.259286 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 612/1252] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:25.685727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:25.686626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:25.694470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c4b5d79b-2bbb-4c4f-bf90-5fed9f0e0243 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:25.695722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c4b5d79b-2bbb-4c4f-bf90-5fed9f0e0243 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:25.703351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4b5d79b-2bbb-4c4f-bf90-5fed9f0e0243 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:25.706563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4b5d79b-2bbb-4c4f-bf90-5fed9f0e0243 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:25.709286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:25.710313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4b5d79b-2bbb-4c4f-bf90-5fed9f0e0243 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:25.711120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4b5d79b-2bbb-4c4f-bf90-5fed9f0e0243 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:25.711578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4b5d79b-2bbb-4c4f-bf90-5fed9f0e0243 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:25.712280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4b5d79b-2bbb-4c4f-bf90-5fed9f0e0243 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:25.713750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:25.714381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:25.716185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:25.716649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:25.717081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:25.928239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:25.938183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:25.940789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:25.942498 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e374d0a5-2725-4196-9269-0338eaca5205 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.260758 Sep 10 20:52:25.958330 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 641/1253] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:25 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:25.969075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:25.969685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:25.984441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:25.984933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:25.985374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:25.988211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:25.988681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:25.989458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:26.009685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c4b5d79b-2bbb-4c4f-bf90-5fed9f0e0243 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:26.022937 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c4b5d79b-2bbb-4c4f-bf90-5fed9f0e0243 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.332068 Sep 10 20:52:26.023828 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 613/1254] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:25 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:26.078105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:26.083488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:26.090939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:26.093083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:26.096898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3cb47a39-4afb-4437-9f3a-7f7ddfcd9782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:26.097992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3cb47a39-4afb-4437-9f3a-7f7ddfcd9782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:26.100799 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3516880c-7174-4c36-a110-3f45ed228fc7 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.140049 Sep 10 20:52:26.101920 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 642/1255] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:25 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:26.106348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb47a39-4afb-4437-9f3a-7f7ddfcd9782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:26.106808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb47a39-4afb-4437-9f3a-7f7ddfcd9782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:26.107267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb47a39-4afb-4437-9f3a-7f7ddfcd9782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:26.107975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb47a39-4afb-4437-9f3a-7f7ddfcd9782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:26.108429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb47a39-4afb-4437-9f3a-7f7ddfcd9782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:26.108860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb47a39-4afb-4437-9f3a-7f7ddfcd9782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:26.210346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-061a8800-2b1b-46fb-9d66-cc1af4fd1125 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:26.211405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-061a8800-2b1b-46fb-9d66-cc1af4fd1125 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:26.223652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061a8800-2b1b-46fb-9d66-cc1af4fd1125 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:26.224527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061a8800-2b1b-46fb-9d66-cc1af4fd1125 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:26.225922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061a8800-2b1b-46fb-9d66-cc1af4fd1125 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:26.226904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061a8800-2b1b-46fb-9d66-cc1af4fd1125 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:26.228750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061a8800-2b1b-46fb-9d66-cc1af4fd1125 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:26.230742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-061a8800-2b1b-46fb-9d66-cc1af4fd1125 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:26.329564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3cb47a39-4afb-4437-9f3a-7f7ddfcd9782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:26.337489 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3cb47a39-4afb-4437-9f3a-7f7ddfcd9782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1471 microversion: 2.1 time: 0.245717 Sep 10 20:52:26.341567 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 614/1256] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:26 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1471 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:26.477276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-061a8800-2b1b-46fb-9d66-cc1af4fd1125 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:26.512020 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-061a8800-2b1b-46fb-9d66-cc1af4fd1125 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1675 microversion: 2.1 time: 0.302956 Sep 10 20:52:26.513681 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 643/1257] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:26 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1675 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:26.744352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-373558d4-44b4-4755-9395-95bb43333c2d tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Action: 'create', calling method: .version_select at 0x7f9949616670>, body: {"keypair": {"name": "tempest-keypair-1545430893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB1peqFUldLExbdD5fFGa2DAy4/rQcAEIeXfiqtc1h4m02lvudsVcnyejx0+i/WW0uaAeRg1Wt3c9WLrZGAg47Szb072Bk87/AzG8OFzW9HPsVje821AqE0tGNmzIyprQ=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:26.767003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-373558d4-44b4-4755-9395-95bb43333c2d tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:52:26.772273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-373558d4-44b4-4755-9395-95bb43333c2d tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for user 45a9194f6cd7487db29d3d928633fb79 and project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:52:26.800078 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-373558d4-44b4-4755-9395-95bb43333c2d tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193299 Sep 10 20:52:26.801179 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 615/1258] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:52:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:26.813295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea40c8a1-3237-4469-a256-23553dd5ee8b tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Calling method '.version_select at 0x7f9944adb5e0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:26.823028 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea40c8a1-3237-4469-a256-23553dd5ee8b tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1545430893" status: 200 len: 497 microversion: 2.1 time: 0.015102 Sep 10 20:52:26.831100 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 644/1259] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 20:52:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1545430893 => generated 497 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:26.835691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6910af65-d9aa-47d8-bd18-717356dca39d tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Calling method '.version_select at 0x7f9949684dc0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:26.859872 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6910af65-d9aa-47d8-bd18-717356dca39d tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545430893" status: 202 len: 0 microversion: 2.1 time: 0.028092 Sep 10 20:52:26.861556 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 616/1260] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 20:52:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545430893 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:52:26.874302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-835fafeb-b2fd-4157-bc17-dcedc28aa21a tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Action: 'create', calling method: .version_select at 0x7f9944fb3280>, body: {"keypair": {"name": "tempest-keypair-614732311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc4eHGnrNEfJK3oGfywoKoivnpP6B5Hml9E72Xv8HkTEMkox0jiiHgG3r1MPPpbiuPzwBm63QcFup1M36uamPQY6DlnQosnFpzeHc7obGS5rOzMM/s9h64PAclvzRF5rQ=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:26.890326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-835fafeb-b2fd-4157-bc17-dcedc28aa21a tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:52:26.897643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-835fafeb-b2fd-4157-bc17-dcedc28aa21a tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for user 45a9194f6cd7487db29d3d928633fb79 and project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:52:26.926213 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-835fafeb-b2fd-4157-bc17-dcedc28aa21a tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055881 Sep 10 20:52:26.927258 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 645/1261] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:52:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:26.937289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b0a1aaab-8624-4d52-a784-b826a01845ee tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Calling method '.version_select at 0x7f9949689b80>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:26.958648 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b0a1aaab-8624-4d52-a784-b826a01845ee tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-614732311" status: 202 len: 0 microversion: 2.1 time: 0.025109 Sep 10 20:52:26.959381 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 617/1262] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 20:52:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-614732311 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:26.972442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-37882e5d-0b30-4a2c-8a44-077a4fe0ac79 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Action: 'create', calling method: .version_select at 0x7f9944d0e8b0>, body: {"keypair": {"name": "tempest-keypair-1842061668", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:26.980821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:26.981455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:26.993900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-37882e5d-0b30-4a2c-8a44-077a4fe0ac79 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:52:26.997575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:26.998090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:27.000745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-37882e5d-0b30-4a2c-8a44-077a4fe0ac79 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for user 45a9194f6cd7487db29d3d928633fb79 and project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:52:27.001698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:27.002683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:27.003142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:27.003566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:27.038087 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-37882e5d-0b30-4a2c-8a44-077a4fe0ac79 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.071164 Sep 10 20:52:27.042557 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 646/1263] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:52:26 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:27.052566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5fb5f9d0-d1e3-446a-835a-3393224a8fbd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:27.055314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5fb5f9d0-d1e3-446a-835a-3393224a8fbd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:27.064201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fb5f9d0-d1e3-446a-835a-3393224a8fbd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:27.065157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fb5f9d0-d1e3-446a-835a-3393224a8fbd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:27.066020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fb5f9d0-d1e3-446a-835a-3393224a8fbd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:27.067654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fb5f9d0-d1e3-446a-835a-3393224a8fbd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:27.068374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fb5f9d0-d1e3-446a-835a-3393224a8fbd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:27.069259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fb5f9d0-d1e3-446a-835a-3393224a8fbd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:27.196978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:27.209275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:27.211675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:27.213249 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd697743-f056-4ec2-b743-7c650d7cd588 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.241472 Sep 10 20:52:27.213916 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 618/1264] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:26 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:27.219207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-13ddaf05-5fe3-49a7-a5e1-b1fb7bc3c383 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Calling method '.version_select at 0x7f99496aa790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:27.255275 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-13ddaf05-5fe3-49a7-a5e1-b1fb7bc3c383 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842061668" status: 202 len: 0 microversion: 2.1 time: 0.039268 Sep 10 20:52:27.256296 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 619/1265] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 20:52:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842061668 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:27.268269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:27.269515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:27.276466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:27.276999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:27.277437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:27.278314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:27.278939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:27.279793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:27.285495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5fb5f9d0-d1e3-446a-835a-3393224a8fbd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:27.299266 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5fb5f9d0-d1e3-446a-835a-3393224a8fbd tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.250739 Sep 10 20:52:27.301177 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 647/1266] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:27 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:27.312792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a83ec99c-b24e-42a4-b1e1-429d26bd69b0 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Action: 'create', calling method: .version_select at 0x7f9944ba18b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-538527903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTdWeHRKFnR+Cd/lOF21isOxiT8i9tsvTpyUeCUD8ebrGjblMxP1oLD0saxzbIt+Fa7ydTTI8dCqEXMXVglr2oLjyjS7ZDz91J7t5JqBiC9LkQePowF3SJzvGOI2IuxnA=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:27.332796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-a83ec99c-b24e-42a4-b1e1-429d26bd69b0 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:52:27.349282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-a83ec99c-b24e-42a4-b1e1-429d26bd69b0 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for user 45a9194f6cd7487db29d3d928633fb79 and project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:52:27.374516 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a83ec99c-b24e-42a4-b1e1-429d26bd69b0 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.071924 Sep 10 20:52:27.384250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:27.384596 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 648/1267] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:52:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:27.385454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c202e156-0aaf-40bf-b909-2922a2ebd2e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:27.389416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c202e156-0aaf-40bf-b909-2922a2ebd2e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:27.397659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c202e156-0aaf-40bf-b909-2922a2ebd2e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:27.397933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c202e156-0aaf-40bf-b909-2922a2ebd2e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:27.398379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c202e156-0aaf-40bf-b909-2922a2ebd2e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:27.399098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c202e156-0aaf-40bf-b909-2922a2ebd2e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:27.399706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c202e156-0aaf-40bf-b909-2922a2ebd2e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:27.400148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c202e156-0aaf-40bf-b909-2922a2ebd2e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:27.400496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:27.405263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:27.413644 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a8194be2-8b5d-4dd8-b990-56c24d050562 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.156066 Sep 10 20:52:27.415838 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 620/1268] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:27 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:27.440588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-255cd8e0-d1be-43c3-95a2-f548f808029d tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Action: 'create', calling method: .version_select at 0x7f99495b3820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2109290073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaiE08cIvzvu8kdo3Hz/WN2FceJzg/V6M0DUk+QgIYNMS5fjUT8GLcSC/+dNWRXlUuH6MXPRK9Q/AhXbn75wLU42sXateVqt1sPm64y93o8sV0ZWRaFZTzFoRkgcKQZQQ=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:27.457182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-255cd8e0-d1be-43c3-95a2-f548f808029d tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:52:27.461880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-255cd8e0-d1be-43c3-95a2-f548f808029d tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for user 45a9194f6cd7487db29d3d928633fb79 and project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:52:27.490327 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-255cd8e0-d1be-43c3-95a2-f548f808029d tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.073438 Sep 10 20:52:27.491272 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 621/1269] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:52:27 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:27.505070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-03d3f75d-d1cd-4033-8a60-c5a312803e4e tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Action: 'create', calling method: .version_select at 0x7f99495c2ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1012572544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIutWzEu/a2Rzcu8jamjCA0D4vDHzWAyLoGQR0FtOKqztQHOf8yLid23sB5N1vvgXrMcGUT7MWgzeHzVkptj45fUOdYdASFdc4CGg44Wj8v4uyLdCLpv2iMijxLFSRIOQ=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:27.524228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-03d3f75d-d1cd-4033-8a60-c5a312803e4e tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:52:27.534839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-03d3f75d-d1cd-4033-8a60-c5a312803e4e tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Getting quotas for user 45a9194f6cd7487db29d3d928633fb79 and project b0e594afa9b14d5180bfc2b46afada1b. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:52:27.563268 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-03d3f75d-d1cd-4033-8a60-c5a312803e4e tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.063485 Sep 10 20:52:27.564442 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 622/1270] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:52:27 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:27.581194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c202e156-0aaf-40bf-b909-2922a2ebd2e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:27.588251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8cddf7bd-51c2-437b-b88b-ab9f2f872449 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:27.588880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8cddf7bd-51c2-437b-b88b-ab9f2f872449 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:27.592120 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c202e156-0aaf-40bf-b909-2922a2ebd2e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.212281 Sep 10 20:52:27.593425 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 649/1271] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:27 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:27.617277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cddf7bd-51c2-437b-b88b-ab9f2f872449 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:27.617787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cddf7bd-51c2-437b-b88b-ab9f2f872449 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:27.618442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cddf7bd-51c2-437b-b88b-ab9f2f872449 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:27.620315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cddf7bd-51c2-437b-b88b-ab9f2f872449 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:27.620954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cddf7bd-51c2-437b-b88b-ab9f2f872449 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:27.621392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cddf7bd-51c2-437b-b88b-ab9f2f872449 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:27.756768 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8d5c090b-11df-4f6f-ad9c-a9372bd012a9 tempest-TenantUsagesNegativeTestJSON-932631005 tempest-TenantUsagesNegativeTestJSON-932631005-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-09T20%3A52%3A27.552685&end=2022-09-11T20%3A52%3A27.552685" status: 404 len: 112 microversion: - time: 0.160872 Sep 10 20:52:27.757356 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 650/1272] 10.222.0.33 () {58 vars in 1316 bytes} [Sat Sep 10 20:52:27 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-09T20%3A52%3A27.552685&end=2022-09-11T20%3A52%3A27.552685 => generated 112 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 20:52:27.766806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10c6f00c-1c73-4471-b5db-921065b8cb05 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Calling method '.version_select at 0x7f994525bc10>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:27.771553 ncdv-master-1 devstack@n-api.service[145772]: WARNING oslo_db.sqlalchemy.utils [None req-10c6f00c-1c73-4471-b5db-921065b8cb05 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 20:52:27.778949 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10c6f00c-1c73-4471-b5db-921065b8cb05 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.020395 Sep 10 20:52:27.779790 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 651/1273] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:52:27 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:27.784609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ba920a4-f311-44e2-ab26-134315c25623 tempest-TenantUsagesNegativeTestJSON-932631005 tempest-TenantUsagesNegativeTestJSON-932631005-project-admin] Calling method '.version_select at 0x7f9944b224c0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:27.788625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8cddf7bd-51c2-437b-b88b-ab9f2f872449 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:27.789810 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-2ba920a4-f311-44e2-ab26-134315c25623 tempest-TenantUsagesNegativeTestJSON-932631005 tempest-TenantUsagesNegativeTestJSON-932631005-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ba920a4-f311-44e2-ab26-134315c25623 tempest-TenantUsagesNegativeTestJSON-932631005 tempest-TenantUsagesNegativeTestJSON-932631005-project-admin] Request method failure captured: Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-simple-tenant-usage/0b0053a439224236892d617e65718f09?start=2022-09-11T20%3A52%3A27.552685&end=2022-09-09T20%3A52%3A27.552685 HTTP/1.1 Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPkLzfYR63ztRdjIvC7IrWIRY4TBfRfc37LxdIeyrO0LV_9y3vo1enfvxNMIYJi0rPlWe4_KvEImLNrsQLS4eB5qEJPYaNyuaDWYN91--RhWxl18Pb2KpKdRA2sYV8d2B_Ue54M6ahK5jUGKuZ9d3qpblIv7Qsx8-OibGnDb7AUVExA Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 0a8671221cb54eb3a2a4247f6318d2f2 Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-932631005 Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:52:27.791607 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a8671221cb54eb3a2a4247f6318d2f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a8671221cb54eb3a2a4247f6318d2f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a8671221cb54eb3a2a4247f6318d2f2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a8671221cb54eb3a2a4247f6318d2f2"}]}] Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-932631005 Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 0a8671221cb54eb3a2a4247f6318d2f2 Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-932631005 Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TenantUsagesNegativeTestJSON-932631005-project-admin Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d39dd5a23b89458c966ba9c93a3869a3 Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-932631005-project-admin Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid start time. The start time cannot occur after the end time. Sep 10 20:52:27.793284 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '0b0053a439224236892d617e65718f09'} Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 20:52:27.795060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ba920a4-f311-44e2-ab26-134315c25623 tempest-TenantUsagesNegativeTestJSON-932631005 tempest-TenantUsagesNegativeTestJSON-932631005-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:27.796239 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ba920a4-f311-44e2-ab26-134315c25623 tempest-TenantUsagesNegativeTestJSON-932631005 tempest-TenantUsagesNegativeTestJSON-932631005-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/0b0053a439224236892d617e65718f09?start=2022-09-11T20%3A52%3A27.552685&end=2022-09-09T20%3A52%3A27.552685" status: 400 len: 111 microversion: 2.1 time: 0.012375 Sep 10 20:52:27.796987 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 652/1274] 10.222.0.33 () {58 vars in 1412 bytes} [Sat Sep 10 20:52:27 2022] GET /compute/v2.1/os-simple-tenant-usage/0b0053a439224236892d617e65718f09?start=2022-09-11T20%3A52%3A27.552685&end=2022-09-09T20%3A52%3A27.552685 => generated 111 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:52:27.802061 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8cddf7bd-51c2-437b-b88b-ab9f2f872449 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1675 microversion: 2.1 time: 0.225882 Sep 10 20:52:27.802840 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 623/1275] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:27 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:27.802982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-71a839ee-48b2-4acb-82ad-8dbb38fd3e23 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Calling method '.version_select at 0x7f9944ba1160>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:27.827294 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-71a839ee-48b2-4acb-82ad-8dbb38fd3e23 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1012572544" status: 202 len: 0 microversion: 2.1 time: 0.031262 Sep 10 20:52:27.828444 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 653/1276] 10.222.0.33 () {58 vars in 1278 bytes} [Sat Sep 10 20:52:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1012572544 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:27.837051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e3790d13-4968-4bb4-aba7-a71ebbb9d384 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Calling method '.version_select at 0x7f9944b99550>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:27.858756 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e3790d13-4968-4bb4-aba7-a71ebbb9d384 tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2109290073" status: 202 len: 0 microversion: 2.1 time: 0.025731 Sep 10 20:52:27.859431 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 654/1277] 10.222.0.33 () {58 vars in 1278 bytes} [Sat Sep 10 20:52:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2109290073 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:27.869177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e277f7b-78b5-482b-b953-1171f457e7ce tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] Calling method '.version_select at 0x7f9944ac81f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:27.894705 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e277f7b-78b5-482b-b953-1171f457e7ce tempest-KeyPairsV2TestJSON-1685055695 tempest-KeyPairsV2TestJSON-1685055695-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-538527903" status: 202 len: 0 microversion: 2.1 time: 0.030301 Sep 10 20:52:27.895220 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 655/1278] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 20:52:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-538527903 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:52:28.021538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16f2304c-d03f-4f97-abf9-f2d66150487a tempest-TenantUsagesNegativeTestJSON-733800023 tempest-TenantUsagesNegativeTestJSON-733800023-project] Calling method '.version_select at 0x7f99495b3a60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:28.025010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-16f2304c-d03f-4f97-abf9-f2d66150487a tempest-TenantUsagesNegativeTestJSON-733800023 tempest-TenantUsagesNegativeTestJSON-733800023-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '2c92dafad95d466fbbc6f38608fa0c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0053a439224236892d617e65718f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16f2304c-d03f-4f97-abf9-f2d66150487a tempest-TenantUsagesNegativeTestJSON-733800023 tempest-TenantUsagesNegativeTestJSON-733800023-project] Request method failure captured: Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T20%3A52%3A27.552685&end=2022-09-11T20%3A52%3A27.552685&detailed=1 HTTP/1.1 Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkK3F1lKo-AdDQoctFQMrvV9esQAF5HBagbSuwhKhjxysJf8-fef7emGO65WF0hEJHEvn2cgnK8K7DlJzL4TemlSNdJDCTI-9J8qKK9hwQXI9Wvwpvp_LG1FM5_lhc5mZ9NJsfDPkzm_OI1PYFQ-2MMp1pGjX-ERy5Gf_YDQYdtPnw Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 0b0053a439224236892d617e65718f09 Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-733800023 Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:28.027391 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b0053a439224236892d617e65718f09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b0053a439224236892d617e65718f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b0053a439224236892d617e65718f09", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b0053a439224236892d617e65718f09"}]}] Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-733800023 Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 0b0053a439224236892d617e65718f09 Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-733800023 Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TenantUsagesNegativeTestJSON-733800023-project Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2c92dafad95d466fbbc6f38608fa0c1d Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-733800023-project Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: action_args: {} Sep 10 20:52:28.028969 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:52:28.035017 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:52:28.036671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:52:28.038093 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 10 20:52:28.038093 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:28.038093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16f2304c-d03f-4f97-abf9-f2d66150487a tempest-TenantUsagesNegativeTestJSON-733800023 tempest-TenantUsagesNegativeTestJSON-733800023-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:28.038093 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-16f2304c-d03f-4f97-abf9-f2d66150487a tempest-TenantUsagesNegativeTestJSON-733800023 tempest-TenantUsagesNegativeTestJSON-733800023-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T20%3A52%3A27.552685&end=2022-09-11T20%3A52%3A27.552685&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.225259 Sep 10 20:52:28.038093 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 624/1279] 10.222.0.33 () {58 vars in 1335 bytes} [Sat Sep 10 20:52:27 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T20%3A52%3A27.552685&end=2022-09-11T20%3A52%3A27.552685&detailed=1 => generated 123 bytes in 226 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:28.244292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:28.245209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:28.251655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:28.252136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:28.252692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:28.253565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:28.254051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:28.254996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:28.329583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e723f4f2-57f9-46e3-8b30-5d3448d36d7c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:28.331396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e723f4f2-57f9-46e3-8b30-5d3448d36d7c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:28.340839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e723f4f2-57f9-46e3-8b30-5d3448d36d7c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:28.341586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e723f4f2-57f9-46e3-8b30-5d3448d36d7c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:28.342164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e723f4f2-57f9-46e3-8b30-5d3448d36d7c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:28.343061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e723f4f2-57f9-46e3-8b30-5d3448d36d7c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:28.343781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e723f4f2-57f9-46e3-8b30-5d3448d36d7c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:28.343928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e723f4f2-57f9-46e3-8b30-5d3448d36d7c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:28.481313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:28.496427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:28.498275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:28.500225 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4b22cc59-3ff5-400e-a7d8-ce26daa49bb2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.260481 Sep 10 20:52:28.501599 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 656/1280] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:28 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:28.508110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:28.508891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:28.515351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:28.516045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:28.516628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:28.518286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:28.518914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:28.519492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:28.527704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e723f4f2-57f9-46e3-8b30-5d3448d36d7c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:28.537107 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e723f4f2-57f9-46e3-8b30-5d3448d36d7c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1359 microversion: 2.1 time: 0.216463 Sep 10 20:52:28.538072 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 625/1281] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:28 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:28.599172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:28.609058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:28.611037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:28.616748 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0f4b46fd-ee61-4d6f-bf51-83e34484af8c tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.113646 Sep 10 20:52:28.617326 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 657/1282] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:28 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:28.621686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9a2fd46-5497-4ed6-be3b-e131cdeab6be tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:28.622615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9a2fd46-5497-4ed6-be3b-e131cdeab6be tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:28.630773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a2fd46-5497-4ed6-be3b-e131cdeab6be tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:28.631518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a2fd46-5497-4ed6-be3b-e131cdeab6be tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:28.632276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a2fd46-5497-4ed6-be3b-e131cdeab6be tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:28.633308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a2fd46-5497-4ed6-be3b-e131cdeab6be tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:28.633789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a2fd46-5497-4ed6-be3b-e131cdeab6be tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:28.634380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a2fd46-5497-4ed6-be3b-e131cdeab6be tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:28.828202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-52c311d3-ec12-459c-a80f-55f7ce85df77 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:28.831222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-52c311d3-ec12-459c-a80f-55f7ce85df77 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:28.839800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c311d3-ec12-459c-a80f-55f7ce85df77 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:28.840301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c311d3-ec12-459c-a80f-55f7ce85df77 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:28.841552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c311d3-ec12-459c-a80f-55f7ce85df77 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:28.842445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c311d3-ec12-459c-a80f-55f7ce85df77 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:28.842908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c311d3-ec12-459c-a80f-55f7ce85df77 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:28.843341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c311d3-ec12-459c-a80f-55f7ce85df77 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:28.971716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a9a2fd46-5497-4ed6-be3b-e131cdeab6be tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:28.985648 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9a2fd46-5497-4ed6-be3b-e131cdeab6be tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.368318 Sep 10 20:52:28.987961 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 626/1283] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:28 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:29.189245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-52c311d3-ec12-459c-a80f-55f7ce85df77 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:29.198573 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-52c311d3-ec12-459c-a80f-55f7ce85df77 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1675 microversion: 2.1 time: 0.375286 Sep 10 20:52:29.200074 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 658/1284] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:28 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1675 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:29.528396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:29.529323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:29.536781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:29.540473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:29.543439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:29.544621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:29.545324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:29.546024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:29.561554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a1c1ad63-2ea2-4237-a676-9a6cb9839284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:29.562578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a1c1ad63-2ea2-4237-a676-9a6cb9839284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:29.565753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=8,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:29.578763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1c1ad63-2ea2-4237-a676-9a6cb9839284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:29.579304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1c1ad63-2ea2-4237-a676-9a6cb9839284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:29.579757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1c1ad63-2ea2-4237-a676-9a6cb9839284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:29.588964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1c1ad63-2ea2-4237-a676-9a6cb9839284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:29.589690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1c1ad63-2ea2-4237-a676-9a6cb9839284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:29.590165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1c1ad63-2ea2-4237-a676-9a6cb9839284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:29.841599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:29.861175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:29.867907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:29.870601 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-72d6acb0-f3ba-4c2c-881a-64ddb20c6ae3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.347149 Sep 10 20:52:29.871519 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 627/1285] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:29 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:29.886750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:29.887581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:29.900948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:29.904295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:29.905520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:29.906748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:29.909207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:29.909915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:30.001779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a1c1ad63-2ea2-4237-a676-9a6cb9839284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:30.013510 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a1c1ad63-2ea2-4237-a676-9a6cb9839284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1541 microversion: 2.1 time: 0.456505 Sep 10 20:52:30.014722 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 659/1286] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:29 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1541 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:30.035471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-aaedb438-b2a1-4c10-8657-1b00ae36c26e req-92698d2d-8908-446c-9131-46b958125719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ab18ac-abbb-4b86-a739-eb4573268835", "name": "network-vif-deleted", "tag": "3465ced5-070f-4639-a30b-ff9bf4505ea6"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:30.059072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aaedb438-b2a1-4c10-8657-1b00ae36c26e req-92698d2d-8908-446c-9131-46b958125719 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:30.059566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aaedb438-b2a1-4c10-8657-1b00ae36c26e req-92698d2d-8908-446c-9131-46b958125719 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:30.060000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aaedb438-b2a1-4c10-8657-1b00ae36c26e req-92698d2d-8908-446c-9131-46b958125719 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:30.074161 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-aaedb438-b2a1-4c10-8657-1b00ae36c26e req-92698d2d-8908-446c-9131-46b958125719 service nova] Creating event network-vif-deleted:3465ced5-070f-4639-a30b-ff9bf4505ea6 for instance f2ab18ac-abbb-4b86-a739-eb4573268835 on nch1-master-1 Sep 10 20:52:30.080523 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-aaedb438-b2a1-4c10-8657-1b00ae36c26e req-92698d2d-8908-446c-9131-46b958125719 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063825 Sep 10 20:52:30.081902 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 660/1287] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:30.087563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e339ca8a-9ba0-4edf-b9fc-6659597b7c8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:30.088802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e339ca8a-9ba0-4edf-b9fc-6659597b7c8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:30.097289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e339ca8a-9ba0-4edf-b9fc-6659597b7c8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:30.099505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e339ca8a-9ba0-4edf-b9fc-6659597b7c8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:30.100026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e339ca8a-9ba0-4edf-b9fc-6659597b7c8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:30.100290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:30.100748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e339ca8a-9ba0-4edf-b9fc-6659597b7c8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:30.101467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e339ca8a-9ba0-4edf-b9fc-6659597b7c8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:30.101931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e339ca8a-9ba0-4edf-b9fc-6659597b7c8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:30.112920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:30.114309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:30.124329 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4d429b0a-7cca-494e-81d2-50abd1a2313e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1546 microversion: 2.91 time: 0.248528 Sep 10 20:52:30.125597 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 628/1288] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:29 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1546 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:30.138311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3ef02f4b-431b-4f97-81c5-3040adacaefc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:30.143221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3ef02f4b-431b-4f97-81c5-3040adacaefc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:30.157294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ef02f4b-431b-4f97-81c5-3040adacaefc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:30.160330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ef02f4b-431b-4f97-81c5-3040adacaefc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:30.163070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ef02f4b-431b-4f97-81c5-3040adacaefc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:30.163740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ef02f4b-431b-4f97-81c5-3040adacaefc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:30.165534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ef02f4b-431b-4f97-81c5-3040adacaefc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:30.166868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ef02f4b-431b-4f97-81c5-3040adacaefc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:30.421728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e339ca8a-9ba0-4edf-b9fc-6659597b7c8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:30.435531 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e339ca8a-9ba0-4edf-b9fc-6659597b7c8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.352147 Sep 10 20:52:30.437192 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3ef02f4b-431b-4f97-81c5-3040adacaefc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.307847 Sep 10 20:52:30.437790 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 629/1289] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 20:52:30 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a/os-interface => generated 284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:30.444202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-02190cf5-338b-47c5-b50f-dc114e2389a5 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:30.444818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-02190cf5-338b-47c5-b50f-dc114e2389a5 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:30.447053 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 661/1290] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:30 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:30.455314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02190cf5-338b-47c5-b50f-dc114e2389a5 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:30.462333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02190cf5-338b-47c5-b50f-dc114e2389a5 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:30.463163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02190cf5-338b-47c5-b50f-dc114e2389a5 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:30.464073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02190cf5-338b-47c5-b50f-dc114e2389a5 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:30.464696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02190cf5-338b-47c5-b50f-dc114e2389a5 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:30.465340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02190cf5-338b-47c5-b50f-dc114e2389a5 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.060085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1734e39c-3f71-4596-b6da-ababbc58f079 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Calling method '.version_select at 0x7f9944c04280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:31.068197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1734e39c-3f71-4596-b6da-ababbc58f079 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.069022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1734e39c-3f71-4596-b6da-ababbc58f079 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.070157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1734e39c-3f71-4596-b6da-ababbc58f079 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.072396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1734e39c-3f71-4596-b6da-ababbc58f079 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.073953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1734e39c-3f71-4596-b6da-ababbc58f079 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.077792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1734e39c-3f71-4596-b6da-ababbc58f079 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.142008 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1734e39c-3f71-4596-b6da-ababbc58f079 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.530822 Sep 10 20:52:31.143819 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 662/1291] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Sep 10 20:52:30 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:31.150176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:31.152633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:31.162699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.163657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.164522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.165480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.167272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.168030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.265400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-02190cf5-338b-47c5-b50f-dc114e2389a5 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ba978c04048a29bf4132a1e7379b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7933149ce16427e84de63058fff1142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:31.279738 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-02190cf5-338b-47c5-b50f-dc114e2389a5 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 200 len: 1497 microversion: 2.1 time: 0.839918 Sep 10 20:52:31.299477 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 630/1292] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:30 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 1497 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:31.309637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1c04a055-2d88-4df8-ae90-9f06e35f9962 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Calling method '.version_select at 0x7f9949616670>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:31.313614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c04a055-2d88-4df8-ae90-9f06e35f9962 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.314442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c04a055-2d88-4df8-ae90-9f06e35f9962 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.315082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c04a055-2d88-4df8-ae90-9f06e35f9962 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.316208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c04a055-2d88-4df8-ae90-9f06e35f9962 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.316843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c04a055-2d88-4df8-ae90-9f06e35f9962 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.317428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c04a055-2d88-4df8-ae90-9f06e35f9962 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.348847 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1c04a055-2d88-4df8-ae90-9f06e35f9962 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.043275 Sep 10 20:52:31.350128 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 631/1293] 10.222.0.33 () {58 vars in 1139 bytes} [Sat Sep 10 20:52:31 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:31.359458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:31.361015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:31.374740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.398385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.411843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.413964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.420277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.421215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.556281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:31.565457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:31.567412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:31.573506 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-63008acf-b479-4ecf-acaf-8c5effdacd68 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1533 microversion: 2.91 time: 0.222116 Sep 10 20:52:31.574589 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 632/1294] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:31 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1533 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:31.586565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e2fdfdd-4d04-4275-9cb4-5b8bcc70eaaf tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Calling method '.version_select at 0x7f99495b38b0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:31.592187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e2fdfdd-4d04-4275-9cb4-5b8bcc70eaaf tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.592833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e2fdfdd-4d04-4275-9cb4-5b8bcc70eaaf tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.593328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e2fdfdd-4d04-4275-9cb4-5b8bcc70eaaf tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.595032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e2fdfdd-4d04-4275-9cb4-5b8bcc70eaaf tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.596727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e2fdfdd-4d04-4275-9cb4-5b8bcc70eaaf tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.597670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e2fdfdd-4d04-4275-9cb4-5b8bcc70eaaf tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.627348 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5e2fdfdd-4d04-4275-9cb4-5b8bcc70eaaf tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.051512 Sep 10 20:52:31.628103 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 633/1295] 10.222.0.33 () {58 vars in 1145 bytes} [Sat Sep 10 20:52:31 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:52:31.632978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae527d47-db9e-4612-8130-544e72c2d7fe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:31.633760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ae527d47-db9e-4612-8130-544e72c2d7fe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:31.641883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae527d47-db9e-4612-8130-544e72c2d7fe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.642385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae527d47-db9e-4612-8130-544e72c2d7fe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.642824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae527d47-db9e-4612-8130-544e72c2d7fe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.643590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae527d47-db9e-4612-8130-544e72c2d7fe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.644091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae527d47-db9e-4612-8130-544e72c2d7fe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.644572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae527d47-db9e-4612-8130-544e72c2d7fe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.739148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:31.752546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:31.754676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:31.756136 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59984e91-4444-4051-ab43-db00286092e0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.611079 Sep 10 20:52:31.772573 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 663/1296] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:31 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:31.863257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae527d47-db9e-4612-8130-544e72c2d7fe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:31.871897 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae527d47-db9e-4612-8130-544e72c2d7fe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.242534 Sep 10 20:52:31.872753 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 634/1297] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:31 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:31.877788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-48a4b3ca-9c07-4334-ba13-30ac29912c91 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:31.878589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-48a4b3ca-9c07-4334-ba13-30ac29912c91 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:31.882781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:31.887797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48a4b3ca-9c07-4334-ba13-30ac29912c91 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.888469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48a4b3ca-9c07-4334-ba13-30ac29912c91 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.889136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48a4b3ca-9c07-4334-ba13-30ac29912c91 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.890115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48a4b3ca-9c07-4334-ba13-30ac29912c91 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:31.890725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48a4b3ca-9c07-4334-ba13-30ac29912c91 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:31.891150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48a4b3ca-9c07-4334-ba13-30ac29912c91 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:31.896241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:31.994185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-48a4b3ca-9c07-4334-ba13-30ac29912c91 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] Lazy-loading 'services' on Instance uuid 72673474-4355-4d59-a448-2bf591428ba0 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:32.023788 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-48a4b3ca-9c07-4334-ba13-30ac29912c91 tempest-UnshelveToHostMultiNodesTest-1856479703 tempest-UnshelveToHostMultiNodesTest-1856479703-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1938 microversion: 2.91 time: 0.149659 Sep 10 20:52:32.039085 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 635/1298] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:31 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1938 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:32.064535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b6c23d1-dc5a-4197-b530-d54fa657e365 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Calling method '.version_select at 0x7f99496aa8b0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:32.074089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b6c23d1-dc5a-4197-b530-d54fa657e365 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.083715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b6c23d1-dc5a-4197-b530-d54fa657e365 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.084182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b6c23d1-dc5a-4197-b530-d54fa657e365 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.085688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b6c23d1-dc5a-4197-b530-d54fa657e365 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.086380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b6c23d1-dc5a-4197-b530-d54fa657e365 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.089157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b6c23d1-dc5a-4197-b530-d54fa657e365 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.183671 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5b6c23d1-dc5a-4197-b530-d54fa657e365 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.143172 Sep 10 20:52:32.193377 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 636/1299] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Sep 10 20:52:32 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:32.198679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2cbfba38-6b3b-4d7c-9b68-eb2f4a64bf11 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:32.199444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2cbfba38-6b3b-4d7c-9b68-eb2f4a64bf11 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:32.202842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c063a337-c7b9-4f3e-ab87-1312297209fa tempest-AbsoluteLimitsTestJSON-844924495 tempest-AbsoluteLimitsTestJSON-844924495-project] Calling method '.version_select at 0x7f9944ad8280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:32.207813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbfba38-6b3b-4d7c-9b68-eb2f4a64bf11 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.209080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbfba38-6b3b-4d7c-9b68-eb2f4a64bf11 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.209703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbfba38-6b3b-4d7c-9b68-eb2f4a64bf11 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.210616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbfba38-6b3b-4d7c-9b68-eb2f4a64bf11 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.211364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbfba38-6b3b-4d7c-9b68-eb2f4a64bf11 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.212097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbfba38-6b3b-4d7c-9b68-eb2f4a64bf11 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.229959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c063a337-c7b9-4f3e-ab87-1312297209fa tempest-AbsoluteLimitsTestJSON-844924495 tempest-AbsoluteLimitsTestJSON-844924495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.230751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c063a337-c7b9-4f3e-ab87-1312297209fa tempest-AbsoluteLimitsTestJSON-844924495 tempest-AbsoluteLimitsTestJSON-844924495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.231497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c063a337-c7b9-4f3e-ab87-1312297209fa tempest-AbsoluteLimitsTestJSON-844924495 tempest-AbsoluteLimitsTestJSON-844924495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.233411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c063a337-c7b9-4f3e-ab87-1312297209fa tempest-AbsoluteLimitsTestJSON-844924495 tempest-AbsoluteLimitsTestJSON-844924495-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.234133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c063a337-c7b9-4f3e-ab87-1312297209fa tempest-AbsoluteLimitsTestJSON-844924495 tempest-AbsoluteLimitsTestJSON-844924495-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.234798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c063a337-c7b9-4f3e-ab87-1312297209fa tempest-AbsoluteLimitsTestJSON-844924495 tempest-AbsoluteLimitsTestJSON-844924495-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.266163 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c063a337-c7b9-4f3e-ab87-1312297209fa tempest-AbsoluteLimitsTestJSON-844924495 tempest-AbsoluteLimitsTestJSON-844924495-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.492191 Sep 10 20:52:32.266494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2cbfba38-6b3b-4d7c-9b68-eb2f4a64bf11 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:52:32.272505 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 664/1300] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Sep 10 20:52:31 2022] GET /compute/v2.1/limits => generated 511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:32.288250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-01858d11-5638-473e-a451-258e77222855 req-7c13aa7a-ab8f-480c-b19f-9642b0bc0b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ab18ac-abbb-4b86-a739-eb4573268835", "name": "network-vif-deleted", "tag": "c2ee03b7-df23-46e9-96bd-88920f75922c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:32.299371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-01858d11-5638-473e-a451-258e77222855 req-7c13aa7a-ab8f-480c-b19f-9642b0bc0b96 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.299966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-01858d11-5638-473e-a451-258e77222855 req-7c13aa7a-ab8f-480c-b19f-9642b0bc0b96 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.300502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-01858d11-5638-473e-a451-258e77222855 req-7c13aa7a-ab8f-480c-b19f-9642b0bc0b96 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.312795 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-01858d11-5638-473e-a451-258e77222855 req-7c13aa7a-ab8f-480c-b19f-9642b0bc0b96 service nova] Creating event network-vif-deleted:c2ee03b7-df23-46e9-96bd-88920f75922c for instance f2ab18ac-abbb-4b86-a739-eb4573268835 on nch1-master-1 Sep 10 20:52:32.322756 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-01858d11-5638-473e-a451-258e77222855 req-7c13aa7a-ab8f-480c-b19f-9642b0bc0b96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038468 Sep 10 20:52:32.326254 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 665/1301] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:32.333775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4d755f4e-d292-4b7b-8923-355461a233cb tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Calling method '.version_select at 0x7f9944ba1820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:32.339136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d755f4e-d292-4b7b-8923-355461a233cb tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.340086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d755f4e-d292-4b7b-8923-355461a233cb tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.340560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d755f4e-d292-4b7b-8923-355461a233cb tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.341525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d755f4e-d292-4b7b-8923-355461a233cb tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.342228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d755f4e-d292-4b7b-8923-355461a233cb tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.342671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d755f4e-d292-4b7b-8923-355461a233cb tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.393399 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4d755f4e-d292-4b7b-8923-355461a233cb tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.065521 Sep 10 20:52:32.394821 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 666/1302] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 20:52:32 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:32.399855 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2cbfba38-6b3b-4d7c-9b68-eb2f4a64bf11 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 204 len: 0 microversion: 2.91 time: 0.204875 Sep 10 20:52:32.400573 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 637/1303] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:52:32 2022] DELETE /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:52:32.402935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:32.404136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:32.415185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.415975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.417111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.418647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.419479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.420129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.428811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:32.430596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:32.445934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.446309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.446919 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] HTTP exception thrown: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:32.447092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.447858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Request method failure captured: Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 HTTP/1.1 Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPifoEAILsjLSTYBpSg8vOLy_mjEC59eJYrvMy_6lhbku1dmqwnGWXZfCyyRFMMgBQIGCsCF-TvcT_lfgl7rppW-Jt-eeMi5lDPeMNMS-Qka2OhSY5tszUjXGk1r_zzezKSjuWn8zCaWYSdxwYKv1e3XFfK_aXoZAwk5_KmH17JXSaw Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:32.450301 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7933149ce16427e84de63058fff1142", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7933149ce16427e84de63058fff1142"}]}] Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestMultiNic-274842171-project Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 3f0ba978c04048a29bf4132a1e7379b9 Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestMultiNic-274842171-project Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:32.451636 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'f2ab18ac-abbb-4b86-a739-eb4573268835'} Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:32.452728 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:32.454742 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:32.457817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.457817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.461245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Returning 404 to user: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:32.462819 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ad58ae6a-c1e6-47a0-a046-04af13797f49 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 404 len: 111 microversion: 2.1 time: 0.065781 Sep 10 20:52:32.469927 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 667/1304] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:32 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:32.476102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-843d1fa4-508f-4d41-8c07-fd273d8bab2b tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Calling method '.version_select at 0x7f9944ba15e0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:32.480418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-843d1fa4-508f-4d41-8c07-fd273d8bab2b tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.481359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-843d1fa4-508f-4d41-8c07-fd273d8bab2b tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.482299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-843d1fa4-508f-4d41-8c07-fd273d8bab2b tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.483830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-843d1fa4-508f-4d41-8c07-fd273d8bab2b tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.484545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-843d1fa4-508f-4d41-8c07-fd273d8bab2b tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.486672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-843d1fa4-508f-4d41-8c07-fd273d8bab2b tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.523372 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-843d1fa4-508f-4d41-8c07-fd273d8bab2b tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.051938 Sep 10 20:52:32.524110 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 668/1305] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Sep 10 20:52:32 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:32.538785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2bfb5508-af59-4ef3-8346-14ecf74b7004 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Calling method '.version_select at 0x7f9944b26310>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:32.548844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bfb5508-af59-4ef3-8346-14ecf74b7004 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.549433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bfb5508-af59-4ef3-8346-14ecf74b7004 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.550517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bfb5508-af59-4ef3-8346-14ecf74b7004 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.571708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bfb5508-af59-4ef3-8346-14ecf74b7004 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.572565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bfb5508-af59-4ef3-8346-14ecf74b7004 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.572893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bfb5508-af59-4ef3-8346-14ecf74b7004 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.629551 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2bfb5508-af59-4ef3-8346-14ecf74b7004 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 729 microversion: 2.1 time: 0.098145 Sep 10 20:52:32.635194 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 669/1306] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Sep 10 20:52:32 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 729 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:32.639204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-82728c3f-da3b-462c-bd08-987e292f6769 req-1241d53b-a11e-476b-845d-c4a23642ca97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662c3986-cb45-4c9f-a1cf-55a8230ac15a", "tag": "3a19535d-5974-4093-a3ab-f07270e88e01"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:32.654083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-82728c3f-da3b-462c-bd08-987e292f6769 req-1241d53b-a11e-476b-845d-c4a23642ca97 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.654671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-82728c3f-da3b-462c-bd08-987e292f6769 req-1241d53b-a11e-476b-845d-c4a23642ca97 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.655170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-82728c3f-da3b-462c-bd08-987e292f6769 req-1241d53b-a11e-476b-845d-c4a23642ca97 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.674556 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-82728c3f-da3b-462c-bd08-987e292f6769 req-1241d53b-a11e-476b-845d-c4a23642ca97 service nova] Creating event network-changed:3a19535d-5974-4093-a3ab-f07270e88e01 for instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a on nch1-master-1 Sep 10 20:52:32.685021 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-82728c3f-da3b-462c-bd08-987e292f6769 req-1241d53b-a11e-476b-845d-c4a23642ca97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051698 Sep 10 20:52:32.686310 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 670/1307] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:32.697090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1231437-8be2-4bc4-af06-07d1efcab4e5 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Calling method '.version_select at 0x7f9944be0700>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:32.709561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1231437-8be2-4bc4-af06-07d1efcab4e5 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.710151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1231437-8be2-4bc4-af06-07d1efcab4e5 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.710720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1231437-8be2-4bc4-af06-07d1efcab4e5 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.751765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1231437-8be2-4bc4-af06-07d1efcab4e5 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.754939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1231437-8be2-4bc4-af06-07d1efcab4e5 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.757358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1231437-8be2-4bc4-af06-07d1efcab4e5 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.802919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:32.812007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:32.814861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:32.818474 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1231437-8be2-4bc4-af06-07d1efcab4e5 tempest-HostsAdminTestJSON-968286659 tempest-HostsAdminTestJSON-968286659-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 729 microversion: 2.1 time: 0.130791 Sep 10 20:52:32.819303 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 671/1308] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Sep 10 20:52:32 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 729 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:32.822415 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5fd207c0-f124-46d0-a0b7-7c9a9db13ae4 tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.407687 Sep 10 20:52:32.824520 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 638/1309] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:32 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:32.827397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:32.828145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:32.834915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.835413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.835853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:32.838063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:32.838593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:32.839421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:33.099542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-47c59767-02b4-4ad8-a2f9-204ffef58641 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Calling method '.version_select at 0x7f99495b3dc0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:33.125150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c59767-02b4-4ad8-a2f9-204ffef58641 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:33.125794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c59767-02b4-4ad8-a2f9-204ffef58641 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:33.126472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c59767-02b4-4ad8-a2f9-204ffef58641 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:33.127344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c59767-02b4-4ad8-a2f9-204ffef58641 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:33.127923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c59767-02b4-4ad8-a2f9-204ffef58641 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:33.128453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c59767-02b4-4ad8-a2f9-204ffef58641 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:33.152740 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-47c59767-02b4-4ad8-a2f9-204ffef58641 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.284518 Sep 10 20:52:33.154271 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 639/1310] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Sep 10 20:52:32 2022] GET /compute/v2.1/limits => generated 511 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:33.169436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-805be1ed-ecb1-4063-963b-3d8ba165b688 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:33.170846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-805be1ed-ecb1-4063-963b-3d8ba165b688 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:33.187367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:33.188779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-805be1ed-ecb1-4063-963b-3d8ba165b688 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:33.189537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-805be1ed-ecb1-4063-963b-3d8ba165b688 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:33.190262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-805be1ed-ecb1-4063-963b-3d8ba165b688 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:33.191172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-805be1ed-ecb1-4063-963b-3d8ba165b688 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:33.191793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-805be1ed-ecb1-4063-963b-3d8ba165b688 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:33.192452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-805be1ed-ecb1-4063-963b-3d8ba165b688 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:33.198755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:33.200210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:33.201395 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f7292276-b4ba-41eb-8e07-a5ff4603ed6d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.380888 Sep 10 20:52:33.223097 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 672/1311] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:32 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:33.339211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb7d3ee3-4d41-4f5c-b528-0deeae6a83f0 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-154151785", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:33.428021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-805be1ed-ecb1-4063-963b-3d8ba165b688 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:33.453286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-bb7d3ee3-4d41-4f5c-b528-0deeae6a83f0 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:52:33.454443 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-805be1ed-ecb1-4063-963b-3d8ba165b688 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.295753 Sep 10 20:52:33.455855 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 640/1312] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:33 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:33.854510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:33.855310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:33.865914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:33.867390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:33.868047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:33.875092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:33.875709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:33.876214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:33.991540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bb7d3ee3-4d41-4f5c-b528-0deeae6a83f0 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Getting quotas for project 6a7fcfb238474035ba488033b7c5706b. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:52:33.996814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:34.008548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:34.010226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:34.011058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bb7d3ee3-4d41-4f5c-b528-0deeae6a83f0 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Getting quotas for user 69aaa52883684baf98b06a23101c494b and project 6a7fcfb238474035ba488033b7c5706b. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:52:34.018017 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-70f4b0a2-c905-4008-91ba-9cc0308779fe tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1539 microversion: 2.91 time: 0.168164 Sep 10 20:52:34.018848 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 641/1313] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:33 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1539 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:34.029864 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-bb7d3ee3-4d41-4f5c-b528-0deeae6a83f0 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb7d3ee3-4d41-4f5c-b528-0deeae6a83f0 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Request method failure captured: Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 1751 Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPkQ1DBuNobsXAeOYI9F6JcoGSGzdDFHrQ-3o1DNZJn4JsTmPI6NlyGOPU0ECL_WVyshDNtGEpk8E4oDeCc239cqXf6TOLdm9n6TP2bCEjIWI0hmBCaZ-hWfcg4OW29cx04poKyolC9v8XgdOnnqVL5wowVXGklPi6EWspDCcsV06n0 Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 6a7fcfb238474035ba488033b7c5706b Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-194313897 Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6a7fcfb238474035ba488033b7c5706b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6a7fcfb238474035ba488033b7c5706b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6a7fcfb238474035ba488033b7c5706b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6a7fcfb238474035ba488033b7c5706b"}]}] Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-194313897 Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 6a7fcfb238474035ba488033b7c5706b Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-194313897 Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-194313897-project Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 69aaa52883684baf98b06a23101c494b Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-194313897-project Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-154151785", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:34.033317 ncdv-master-1 devstack@n-api.service[145772]: exception: Maximum number of metadata items exceeds 128 Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-154151785', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:34.035892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 10 20:52:34.039983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:34.043163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb7d3ee3-4d41-4f5c-b528-0deeae6a83f0 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:34.043802 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bb7d3ee3-4d41-4f5c-b528-0deeae6a83f0 tempest-AbsoluteLimitsNegativeTestJSON-194313897 tempest-AbsoluteLimitsNegativeTestJSON-194313897-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.708790 Sep 10 20:52:34.046333 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 673/1314] 10.222.0.33 () {60 vars in 1148 bytes} [Sat Sep 10 20:52:33 2022] POST /compute/v2.1/servers => generated 87 bytes in 712 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Sep 10 20:52:34.244201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:34.244851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:34.263127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:34.263499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:34.267264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:34.268483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:34.270941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:34.271686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:34.472529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:34.481195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-af747ade-9ebd-42ab-9084-f8d5d3278b8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:34.481959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-af747ade-9ebd-42ab-9084-f8d5d3278b8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:34.483320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:34.490192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:34.495237 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2eaa18a6-233f-48cd-9e0e-a6785669afde tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.258188 Sep 10 20:52:34.510132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af747ade-9ebd-42ab-9084-f8d5d3278b8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:34.510132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af747ade-9ebd-42ab-9084-f8d5d3278b8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:34.510132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af747ade-9ebd-42ab-9084-f8d5d3278b8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:34.511368 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 642/1315] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:34 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:52:34.516744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af747ade-9ebd-42ab-9084-f8d5d3278b8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:34.516744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af747ade-9ebd-42ab-9084-f8d5d3278b8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:34.516744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af747ade-9ebd-42ab-9084-f8d5d3278b8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:35.051071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:35.052091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:35.067443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:35.084017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:35.090675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-af747ade-9ebd-42ab-9084-f8d5d3278b8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:35.099511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:35.100541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:35.102036 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-af747ade-9ebd-42ab-9084-f8d5d3278b8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.625212 Sep 10 20:52:35.104731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:35.105988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:35.135730 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 674/1316] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:34 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:35.169326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:35.169839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:35.170276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:35.170724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lazy-loading 'fault' on Instance uuid 72673474-4355-4d59-a448-2bf591428ba0 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:35.524790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:35.526085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:35.534009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:35.534509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:35.535238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:35.536208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:35.537086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:35.537752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:35.545459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:35.571579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:35.573751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:35.583412 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09deaff1-953f-42b4-9cbf-b00d9b4e5f1a tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1544 microversion: 2.91 time: 0.538465 Sep 10 20:52:35.584750 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 643/1317] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:35 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1544 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:52:35.949859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:35.953348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:35.962087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:35.964609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:35.966490 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ac598bc2-5a8b-4dc3-be32-085f24c47fd1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.445781 Sep 10 20:52:35.967353 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 675/1318] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:35 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:52:36.142549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10fd0f4f-6003-4fc8-8b75-d0805aaf65df tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:36.143333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10fd0f4f-6003-4fc8-8b75-d0805aaf65df tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:36.151063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10fd0f4f-6003-4fc8-8b75-d0805aaf65df tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:36.151941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10fd0f4f-6003-4fc8-8b75-d0805aaf65df tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:36.152651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10fd0f4f-6003-4fc8-8b75-d0805aaf65df tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:36.153589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10fd0f4f-6003-4fc8-8b75-d0805aaf65df tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:36.154322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10fd0f4f-6003-4fc8-8b75-d0805aaf65df tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:36.154965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10fd0f4f-6003-4fc8-8b75-d0805aaf65df tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:36.322079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10fd0f4f-6003-4fc8-8b75-d0805aaf65df tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:36.333556 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-10fd0f4f-6003-4fc8-8b75-d0805aaf65df tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.198152 Sep 10 20:52:36.334901 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 644/1319] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:36 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:36.620586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:36.621596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:36.655874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:36.656498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:36.657093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:36.664046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:36.665989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:36.666940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:36.718182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:36.719738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:36.720585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:36.721285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lazy-loading 'fault' on Instance uuid 72673474-4355-4d59-a448-2bf591428ba0 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:36.833232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:36.848862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:36.852522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7721fd95d802434d905b50d23eaad9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82fb214ece04574bf521a45ba055bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:36.867276 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ec908ffe-9f92-47e3-a38f-b9ae2b8b8f3e tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 200 len: 1544 microversion: 2.91 time: 0.252275 Sep 10 20:52:36.868610 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 676/1320] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:36 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 1544 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:37.005125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:37.005747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:37.018607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.018908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.021951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.022724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.023213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.023644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.201384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:37.202836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:37.221272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.226030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.226698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.229018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.229899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.231132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.271610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] HTTP exception thrown: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Request method failure captured: Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 HTTP/1.1 Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPifoEAILsjLSTYBpSg8vOLy_mjEC59eJYrvMy_6lhbku1dmqwnGWXZfCyyRFMMgBQIGCsCF-TvcT_lfgl7rppW-Jt-eeMi5lDPeMNMS-Qka2OhSY5tszUjXGk1r_zzezKSjuWn8zCaWYSdxwYKv1e3XFfK_aXoZAwk5_KmH17JXSaw Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7933149ce16427e84de63058fff1142", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7933149ce16427e84de63058fff1142"}]}] Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestMultiNic-274842171-project Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 3f0ba978c04048a29bf4132a1e7379b9 Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestMultiNic-274842171-project Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'f2ab18ac-abbb-4b86-a739-eb4573268835'} Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:37.278161 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:37.282035 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.285276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Returning 404 to user: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:37.287187 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7d6b6c5e-49b4-45d3-b957-16914f0fe6ad tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 404 len: 111 microversion: 2.1 time: 0.092819 Sep 10 20:52:37.292760 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 677/1321] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:52:37 2022] DELETE /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:37.305745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:37.307426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: f2ab18ac-abbb-4b86-a739-eb4573268835] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:37.318520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.324117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.324857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.327120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.327800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.329930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.359242 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] HTTP exception thrown: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:37.364564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Request method failure captured: Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 HTTP/1.1 Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPifoEAILsjLSTYBpSg8vOLy_mjEC59eJYrvMy_6lhbku1dmqwnGWXZfCyyRFMMgBQIGCsCF-TvcT_lfgl7rppW-Jt-eeMi5lDPeMNMS-Qka2OhSY5tszUjXGk1r_zzezKSjuWn8zCaWYSdxwYKv1e3XFfK_aXoZAwk5_KmH17JXSaw Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7933149ce16427e84de63058fff1142", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7933149ce16427e84de63058fff1142"}]}] Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestMultiNic-274842171-project Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 3f0ba978c04048a29bf4132a1e7379b9 Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestMultiNic-274842171-project Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'f2ab18ac-abbb-4b86-a739-eb4573268835'} Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:37.377498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.381534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.381534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:37.381534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:37.381534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:37.381534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:37.381534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. Sep 10 20:52:37.381534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.381534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Returning 404 to user: Instance f2ab18ac-abbb-4b86-a739-eb4573268835 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:37.383800 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9133b3c3-f1f0-4aa9-bd69-11df7795900b tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835" status: 404 len: 111 microversion: 2.1 time: 0.085541 Sep 10 20:52:37.386495 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 678/1322] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:37 2022] GET /compute/v2.1/servers/f2ab18ac-abbb-4b86-a739-eb4573268835 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:52:37.388363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:37.390639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:37.392844 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ef14a05-33d3-4d76-9976-5f8274c275de tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.396501 Sep 10 20:52:37.397224 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 645/1323] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:36 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:37.402255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:37.402972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:37.410574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.411534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.412235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.413213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.413883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.414500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.420550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-afe85490-16e3-4483-a31e-3fbe79e45cbb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:37.424832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-afe85490-16e3-4483-a31e-3fbe79e45cbb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:37.432148 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] HTTP exception thrown: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Request method failure captured: Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 HTTP/1.1 Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPifoEAILsjLSTYBpSg8vOLy_mjEC59eJYrvMy_6lhbku1dmqwnGWXZfCyyRFMMgBQIGCsCF-TvcT_lfgl7rppW-Jt-eeMi5lDPeMNMS-Qka2OhSY5tszUjXGk1r_zzezKSjuWn8zCaWYSdxwYKv1e3XFfK_aXoZAwk5_KmH17JXSaw Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7933149ce16427e84de63058fff1142", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7933149ce16427e84de63058fff1142"}]}] Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestMultiNic-274842171-project Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 3f0ba978c04048a29bf4132a1e7379b9 Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestMultiNic-274842171-project Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7e5578bf-977b-4757-be61-2c01715e6bc1'} Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:37.435632 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:52:37.440817 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.442708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Returning 404 to user: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:37.442842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afe85490-16e3-4483-a31e-3fbe79e45cbb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.443323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afe85490-16e3-4483-a31e-3fbe79e45cbb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.443958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afe85490-16e3-4483-a31e-3fbe79e45cbb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.444488 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-438d9696-212f-4c28-87d2-d667c7bbea38 tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 404 len: 111 microversion: 2.1 time: 0.045783 Sep 10 20:52:37.445291 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 646/1324] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:52:37 2022] DELETE /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:37.446423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afe85490-16e3-4483-a31e-3fbe79e45cbb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.446916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afe85490-16e3-4483-a31e-3fbe79e45cbb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.449945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-afe85490-16e3-4483-a31e-3fbe79e45cbb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.453289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:37.458701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] [instance: 7e5578bf-977b-4757-be61-2c01715e6bc1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:37.469150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.476642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.477377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.478319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.478942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.479531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.510638 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] HTTP exception thrown: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Request method failure captured: Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 HTTP/1.1 Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPifoEAILsjLSTYBpSg8vOLy_mjEC59eJYrvMy_6lhbku1dmqwnGWXZfCyyRFMMgBQIGCsCF-TvcT_lfgl7rppW-Jt-eeMi5lDPeMNMS-Qka2OhSY5tszUjXGk1r_zzezKSjuWn8zCaWYSdxwYKv1e3XFfK_aXoZAwk5_KmH17JXSaw Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7933149ce16427e84de63058fff1142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7933149ce16427e84de63058fff1142", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7933149ce16427e84de63058fff1142"}]}] Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a7933149ce16427e84de63058fff1142 Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestMultiNic-274842171 Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestMultiNic-274842171-project Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 3f0ba978c04048a29bf4132a1e7379b9 Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestMultiNic-274842171-project Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7e5578bf-977b-4757-be61-2c01715e6bc1'} Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:37.512679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.517079 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.517079 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:37.517079 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:37.517079 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:37.517079 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:37.517079 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. Sep 10 20:52:37.517079 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.522207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] Returning 404 to user: Instance 7e5578bf-977b-4757-be61-2c01715e6bc1 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:37.529421 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c2492649-ddf4-4b33-acff-2aa784a671cf tempest-ServersTestMultiNic-274842171 tempest-ServersTestMultiNic-274842171-project] 10.222.0.33 "GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1" status: 404 len: 111 microversion: 2.1 time: 0.079962 Sep 10 20:52:37.530348 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 647/1325] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:37 2022] GET /compute/v2.1/servers/7e5578bf-977b-4757-be61-2c01715e6bc1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:37.897944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:37.901413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] [instance: 72673474-4355-4d59-a448-2bf591428ba0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:37.919498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.921942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.923866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.925896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:37.927754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:37.928702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:37.966103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-afe85490-16e3-4483-a31e-3fbe79e45cbb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:37.971069 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] HTTP exception thrown: Instance 72673474-4355-4d59-a448-2bf591428ba0 could not be found. Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Request method failure captured: Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 HTTP/1.1 Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPhdOGIomQXEr5xS9R2ykXybGr4aSR4DRmvGPGT9WJe5fHZ-zzuc5jEryPTQ1Qzxz0d1j1Ma-lx0VjQL5AyAMlz0rW1UbRWRF7-b8_TZHvoDIQAIyoBfcvVitpCuAv49HcU9X4ZDErVx6DK_VLtaCuTkfrANTO9y1WqDdtiC7Lv8Bj8 Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.91 Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c82fb214ece04574bf521a45ba055bdf Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-574103022 Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c82fb214ece04574bf521a45ba055bdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c82fb214ece04574bf521a45ba055bdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c82fb214ece04574bf521a45ba055bdf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c82fb214ece04574bf521a45ba055bdf"}]}] Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-574103022 Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c82fb214ece04574bf521a45ba055bdf Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-574103022 Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-UnshelveToHostMultiNodesTest-574103022-project Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 7721fd95d802434d905b50d23eaad9b7 Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-574103022-project Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 72673474-4355-4d59-a448-2bf591428ba0 could not be found. Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '72673474-4355-4d59-a448-2bf591428ba0'} Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72673474-4355-4d59-a448-2bf591428ba0 could not be found. Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72673474-4355-4d59-a448-2bf591428ba0 could not be found. Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.975510 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:37.979486 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.979486 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:37.979486 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:37.979486 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:37.979486 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:37.979486 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:37.979486 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72673474-4355-4d59-a448-2bf591428ba0 could not be found. Sep 10 20:52:37.979486 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:37.982114 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-afe85490-16e3-4483-a31e-3fbe79e45cbb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.593309 Sep 10 20:52:37.986566 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 679/1326] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:37 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:37.987364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] Returning 404 to user: Instance 72673474-4355-4d59-a448-2bf591428ba0 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:37.988398 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-528b319a-edf1-4bed-af13-2965cb54e0fd tempest-UnshelveToHostMultiNodesTest-574103022 tempest-UnshelveToHostMultiNodesTest-574103022-project] 10.222.0.33 "GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0" status: 404 len: 111 microversion: 2.91 time: 0.094937 Sep 10 20:52:37.989766 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 648/1327] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:37 2022] GET /compute/v2.1/servers/72673474-4355-4d59-a448-2bf591428ba0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:52:38.425854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:38.427069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:38.459848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:38.461321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:38.462002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:38.462935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:38.463746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:38.464811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:38.871934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Calling method '.version_select at 0x7f9944ce5ee0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:38.873714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:38.874288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:38.874753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:38.890264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:38.892334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:38.892900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:38.908760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:38.916521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:38.917344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:38.917872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:38.920275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:38.922765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:38.924405 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a72fc6e6-6dea-438a-ab97-457499e49184 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.504158 Sep 10 20:52:38.925179 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 649/1328] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:38 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:38.925722 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6a2dd973-59f8-49fa-ab0e-9233ea1e8a9c tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.586840 Sep 10 20:52:38.926841 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 680/1329] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:38.938331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Calling method '.version_select at 0x7f99495ef550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:38.940377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:38.941305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:38.941962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:38.958239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:38.958971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:38.959576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:38.990724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:38.991222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:38.991901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:38.999950 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d14d63bf-cc17-49eb-90fd-073a1d7709af tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.065599 Sep 10 20:52:39.001475 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 650/1330] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Sep 10 20:52:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:39.012102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0b759566-f7b4-4f04-9216-8d55035b5dcf tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:39.013359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0b759566-f7b4-4f04-9216-8d55035b5dcf tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:39.017350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Calling method '.version_select at 0x7f99496841f0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:39.020733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b759566-f7b4-4f04-9216-8d55035b5dcf tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.021457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b759566-f7b4-4f04-9216-8d55035b5dcf tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.022156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b759566-f7b4-4f04-9216-8d55035b5dcf tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.023066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b759566-f7b4-4f04-9216-8d55035b5dcf tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.023717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b759566-f7b4-4f04-9216-8d55035b5dcf tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.024047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.024548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.024782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b759566-f7b4-4f04-9216-8d55035b5dcf tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.025012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.060080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.062769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.063290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.080775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.081802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.082464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.091065 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3d8943e-88b2-46aa-9d65-8383a2239fcc tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.077891 Sep 10 20:52:39.092280 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 651/1331] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:39.104178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a5ef26b9-cdd4-4659-9e41-4c3eaf6ed698 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Calling method '.version_select at 0x7f9949678ca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:39.106691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ef26b9-cdd4-4659-9e41-4c3eaf6ed698 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.107407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ef26b9-cdd4-4659-9e41-4c3eaf6ed698 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.108100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ef26b9-cdd4-4659-9e41-4c3eaf6ed698 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.124997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ef26b9-cdd4-4659-9e41-4c3eaf6ed698 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.125438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ef26b9-cdd4-4659-9e41-4c3eaf6ed698 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.125965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ef26b9-cdd4-4659-9e41-4c3eaf6ed698 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.133652 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a5ef26b9-cdd4-4659-9e41-4c3eaf6ed698 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.033868 Sep 10 20:52:39.134849 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 652/1332] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:52:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:39.150897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-afb7996a-6c5e-4098-a39a-442e089e56e8 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Calling method '.version_select at 0x7f9949684820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:39.154057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afb7996a-6c5e-4098-a39a-442e089e56e8 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.156655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afb7996a-6c5e-4098-a39a-442e089e56e8 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.157719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afb7996a-6c5e-4098-a39a-442e089e56e8 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.193980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:39.205052 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-afb7996a-6c5e-4098-a39a-442e089e56e8 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.056959 Sep 10 20:52:39.210006 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 653/1333] 10.222.0.33 () {58 vars in 1179 bytes} [Sat Sep 10 20:52:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:39.230585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Calling method '.version_select at 0x7f99495ef790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:39.240184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.240663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.241102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.269746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.270722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.272097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.286806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.287553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.288153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.301465 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cdfce4f0-ae09-43d9-93e7-2cca1eef5f9e tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.081307 Sep 10 20:52:39.302605 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 654/1334] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:39.314585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c565a4e6-de78-499a-b251-0f1fc5bc9aa6 req-ddafa633-797e-445c-9cb4-6633b0d93d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd11ff4-6dda-414d-ab81-111f4762df68", "name": "network-vif-unplugged", "status": "completed", "tag": "b0683ab4-3a9c-4ccd-816b-b8815b507ac5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:39.326756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c565a4e6-de78-499a-b251-0f1fc5bc9aa6 req-ddafa633-797e-445c-9cb4-6633b0d93d97 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.327497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c565a4e6-de78-499a-b251-0f1fc5bc9aa6 req-ddafa633-797e-445c-9cb4-6633b0d93d97 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.328882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c565a4e6-de78-499a-b251-0f1fc5bc9aa6 req-ddafa633-797e-445c-9cb4-6633b0d93d97 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.345107 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c565a4e6-de78-499a-b251-0f1fc5bc9aa6 req-ddafa633-797e-445c-9cb4-6633b0d93d97 service nova] Creating event network-vif-unplugged:b0683ab4-3a9c-4ccd-816b-b8815b507ac5 for instance 3cd11ff4-6dda-414d-ab81-111f4762df68 on nch2-master-1 Sep 10 20:52:39.352320 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c565a4e6-de78-499a-b251-0f1fc5bc9aa6 req-ddafa633-797e-445c-9cb4-6633b0d93d97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048125 Sep 10 20:52:39.353514 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 655/1335] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:39.359449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e66b928c-7e12-4f36-a03c-8ca253a20433 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Calling method '.version_select at 0x7f9949616160>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:39.362966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e66b928c-7e12-4f36-a03c-8ca253a20433 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.363674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e66b928c-7e12-4f36-a03c-8ca253a20433 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.364339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e66b928c-7e12-4f36-a03c-8ca253a20433 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.396739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e66b928c-7e12-4f36-a03c-8ca253a20433 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.397278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e66b928c-7e12-4f36-a03c-8ca253a20433 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.397721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e66b928c-7e12-4f36-a03c-8ca253a20433 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.409076 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e66b928c-7e12-4f36-a03c-8ca253a20433 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.053933 Sep 10 20:52:39.410297 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 656/1336] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:52:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:39.426609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ec258ee-892a-472d-8dd8-98b57fa36534 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Calling method '.version_select at 0x7f9949616ee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:39.429645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec258ee-892a-472d-8dd8-98b57fa36534 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.430355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec258ee-892a-472d-8dd8-98b57fa36534 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.430983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec258ee-892a-472d-8dd8-98b57fa36534 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.448086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec258ee-892a-472d-8dd8-98b57fa36534 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.448837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec258ee-892a-472d-8dd8-98b57fa36534 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.449494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec258ee-892a-472d-8dd8-98b57fa36534 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.459948 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0ec258ee-892a-472d-8dd8-98b57fa36534 tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.038199 Sep 10 20:52:39.477552 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 657/1337] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:52:39 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:39.501799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Calling method '.version_select at 0x7f99495e8ee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:39.503660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.504147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.504586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.539201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.540291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.541023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.562085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.563691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.565050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.585668 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bfce61e5-3702-4a49-999f-58225df9cabd tempest-HypervisorAdminTestJSON-1971145744 tempest-HypervisorAdminTestJSON-1971145744-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.090147 Sep 10 20:52:39.595801 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 658/1338] 10.222.0.33 () {58 vars in 1173 bytes} [Sat Sep 10 20:52:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:39.952346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:39.955579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:39.976500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.979125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.985761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:39.987022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:39.987849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:39.988516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:40.002656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0b759566-f7b4-4f04-9216-8d55035b5dcf tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:40.023639 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0b759566-f7b4-4f04-9216-8d55035b5dcf tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 1.016912 Sep 10 20:52:40.039903 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 681/1339] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:39 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:40.809641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:40.833920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:40.835358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:40.847758 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f92e2843-249e-4fe8-a7d4-19d3b33f2ee0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.900904 Sep 10 20:52:40.848429 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 659/1340] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:39 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:52:41.051896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59845476-b24c-4820-a5e1-6060c2dddf8b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:41.052816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59845476-b24c-4820-a5e1-6060c2dddf8b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:41.069611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59845476-b24c-4820-a5e1-6060c2dddf8b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:41.073499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59845476-b24c-4820-a5e1-6060c2dddf8b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:41.074307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59845476-b24c-4820-a5e1-6060c2dddf8b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:41.080385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59845476-b24c-4820-a5e1-6060c2dddf8b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:41.081130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59845476-b24c-4820-a5e1-6060c2dddf8b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:41.082080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59845476-b24c-4820-a5e1-6060c2dddf8b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:41.825913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-29043a00-5881-485e-aa23-0d7f48f61860 req-bca1b0d4-7536-43ac-ae01-b24df59c4126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd11ff4-6dda-414d-ab81-111f4762df68", "tag": "b0683ab4-3a9c-4ccd-816b-b8815b507ac5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:41.853739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-29043a00-5881-485e-aa23-0d7f48f61860 req-bca1b0d4-7536-43ac-ae01-b24df59c4126 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:41.858525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-29043a00-5881-485e-aa23-0d7f48f61860 req-bca1b0d4-7536-43ac-ae01-b24df59c4126 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:41.858974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-29043a00-5881-485e-aa23-0d7f48f61860 req-bca1b0d4-7536-43ac-ae01-b24df59c4126 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:41.893712 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-29043a00-5881-485e-aa23-0d7f48f61860 req-bca1b0d4-7536-43ac-ae01-b24df59c4126 service nova] Creating event network-changed:b0683ab4-3a9c-4ccd-816b-b8815b507ac5 for instance 3cd11ff4-6dda-414d-ab81-111f4762df68 on nch2-master-1 Sep 10 20:52:41.921025 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-29043a00-5881-485e-aa23-0d7f48f61860 req-bca1b0d4-7536-43ac-ae01-b24df59c4126 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097057 Sep 10 20:52:41.923151 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 660/1341] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:52:41.933601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:41.940675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:41.951921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:41.955604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:41.958067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:41.958998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:41.960944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:41.961551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:42.500123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:42.568549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-59845476-b24c-4820-a5e1-6060c2dddf8b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:42.583974 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59845476-b24c-4820-a5e1-6060c2dddf8b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 1.534118 Sep 10 20:52:42.585669 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 682/1342] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:41 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:43.126166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=14 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:43.136461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:43.139452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:43.163544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:43.167056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:43.171936 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ea0d4b9b-b146-4bb7-ab30-2fbb063db1b0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 1.245356 Sep 10 20:52:43.172933 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 661/1343] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:41 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:43.617812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b39f36de-f617-4d25-9193-de41a208a7af tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:43.619207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b39f36de-f617-4d25-9193-de41a208a7af tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:43.638534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b39f36de-f617-4d25-9193-de41a208a7af tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:43.640484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b39f36de-f617-4d25-9193-de41a208a7af tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:43.642277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b39f36de-f617-4d25-9193-de41a208a7af tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:43.644173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b39f36de-f617-4d25-9193-de41a208a7af tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:43.646224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b39f36de-f617-4d25-9193-de41a208a7af tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:43.646945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b39f36de-f617-4d25-9193-de41a208a7af tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:44.020127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=18 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:44.200580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:44.201312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:44.217665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:44.224190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:44.227041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:44.234401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:44.237241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:44.240454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:44.355689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b39f36de-f617-4d25-9193-de41a208a7af tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:44.375693 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b39f36de-f617-4d25-9193-de41a208a7af tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.768314 Sep 10 20:52:44.379726 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 683/1344] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:43 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:44.740175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:44.758916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:44.760747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:44.767394 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-93799fa0-a46f-4b66-ac60-b881844c8c9b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.566243 Sep 10 20:52:44.769517 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 662/1345] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:44 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:52:45.411530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-318af850-fae3-473b-bd95-51518da032d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:45.412553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-318af850-fae3-473b-bd95-51518da032d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:45.423373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-318af850-fae3-473b-bd95-51518da032d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:45.423900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-318af850-fae3-473b-bd95-51518da032d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:45.424387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-318af850-fae3-473b-bd95-51518da032d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:45.438160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-318af850-fae3-473b-bd95-51518da032d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:45.440068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-318af850-fae3-473b-bd95-51518da032d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:45.440956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-318af850-fae3-473b-bd95-51518da032d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:45.805556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e6aaf271-00ec-4302-9c93-57092e3eff09 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f99450b3e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2037617741", "description": "tempest-description-1797918518"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:45.868391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-318af850-fae3-473b-bd95-51518da032d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:45.881927 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-318af850-fae3-473b-bd95-51518da032d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.478496 Sep 10 20:52:45.883908 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 663/1346] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:45 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:45.917214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:45.918002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:45.941908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:45.942618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:45.945318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:45.948086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:45.948926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:45.949365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.284986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:46.295500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:46.296949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:46.304576 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-30fe32df-4719-40ba-9158-c3744af3cb54 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.418021 Sep 10 20:52:46.305197 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 664/1347] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:45 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:46.572794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Action: 'update', calling method: .version_select at 0x7f99495b3a60>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:46.577535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.578054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.584501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.605151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.605652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.606116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.630912 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] HTTP exception thrown: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Request method failure captured: Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/os-services/16987d63-7838-4d12-8197-f684045404b1 HTTP/1.1 Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 56 Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkeKZ2baDC9aisJHJ_Y6YCtMmj2z6gvexMWaSa922R_COm2NrNS20kaWNNCh6hSnIekL-EY0JaEMgBv_jl8ea5hAFtConYpWLsCYF5qDYg4VsCKULL-a-dvZFdFM0h0uE7NxbIcAshQnJoqNDbosg6Obbqvs8xkErhEojTOQwQvQK4 Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d75ae76f6fec4a688e774d7f0af40f2c Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1937487179 Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d75ae76f6fec4a688e774d7f0af40f2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d75ae76f6fec4a688e774d7f0af40f2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d75ae76f6fec4a688e774d7f0af40f2c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d75ae76f6fec4a688e774d7f0af40f2c"}]}] Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1937487179 Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d75ae76f6fec4a688e774d7f0af40f2c Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1937487179 Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e06f0e2458704f908f7302866c3787b1 Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: exception: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '16987d63-7838-4d12-8197-f684045404b1', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:46.633033 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.637176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.644525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Returning 404 to user: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:46.645575 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fc52020d-3f62-461d-8a7e-47c70c02e393 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/16987d63-7838-4d12-8197-f684045404b1" status: 404 len: 110 microversion: 2.53 time: 0.304244 Sep 10 20:52:46.646212 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 665/1348] 10.222.0.33 () {62 vars in 1309 bytes} [Sat Sep 10 20:52:46 2022] PUT /compute/v2.1/os-services/16987d63-7838-4d12-8197-f684045404b1 => generated 110 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:52:46.655728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Action: 'update', calling method: .version_select at 0x7f99495fcb80>, body: {"status": "disabled"} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:46.660644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.661129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.661574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.683758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.684548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.685158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.698187 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] HTTP exception thrown: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Request method failure captured: Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/os-services/16987d63-7838-4d12-8197-f684045404b1 HTTP/1.1 Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 22 Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkeKZ2baDC9aisJHJ_Y6YCtMmj2z6gvexMWaSa922R_COm2NrNS20kaWNNCh6hSnIekL-EY0JaEMgBv_jl8ea5hAFtConYpWLsCYF5qDYg4VsCKULL-a-dvZFdFM0h0uE7NxbIcAshQnJoqNDbosg6Obbqvs8xkErhEojTOQwQvQK4 Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d75ae76f6fec4a688e774d7f0af40f2c Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1937487179 Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d75ae76f6fec4a688e774d7f0af40f2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d75ae76f6fec4a688e774d7f0af40f2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d75ae76f6fec4a688e774d7f0af40f2c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d75ae76f6fec4a688e774d7f0af40f2c"}]}] Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1937487179 Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d75ae76f6fec4a688e774d7f0af40f2c Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1937487179 Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e06f0e2458704f908f7302866c3787b1 Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: {"status": "disabled"} Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: exception: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '16987d63-7838-4d12-8197-f684045404b1', 'body': {'status': 'disabled'}} Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:46.699867 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Returning 404 to user: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c88ffc6f-26c0-4f62-b8eb-d71fbd5f1d64 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/16987d63-7838-4d12-8197-f684045404b1" status: 404 len: 110 microversion: 2.53 time: 0.049396 Sep 10 20:52:46.706008 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 666/1349] 10.222.0.33 () {62 vars in 1309 bytes} [Sat Sep 10 20:52:46 2022] PUT /compute/v2.1/os-services/16987d63-7838-4d12-8197-f684045404b1 => generated 110 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:52:46.714562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Action: 'update', calling method: .version_select at 0x7f99495fc9d0>, body: {"status": "enabled"} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:46.723146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.723689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.724142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.733973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.734957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.736364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.742891 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] HTTP exception thrown: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Request method failure captured: Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/os-services/16987d63-7838-4d12-8197-f684045404b1 HTTP/1.1 Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 21 Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkeKZ2baDC9aisJHJ_Y6YCtMmj2z6gvexMWaSa922R_COm2NrNS20kaWNNCh6hSnIekL-EY0JaEMgBv_jl8ea5hAFtConYpWLsCYF5qDYg4VsCKULL-a-dvZFdFM0h0uE7NxbIcAshQnJoqNDbosg6Obbqvs8xkErhEojTOQwQvQK4 Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d75ae76f6fec4a688e774d7f0af40f2c Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1937487179 Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d75ae76f6fec4a688e774d7f0af40f2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d75ae76f6fec4a688e774d7f0af40f2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d75ae76f6fec4a688e774d7f0af40f2c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d75ae76f6fec4a688e774d7f0af40f2c"}]}] Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1937487179 Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d75ae76f6fec4a688e774d7f0af40f2c Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1937487179 Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e06f0e2458704f908f7302866c3787b1 Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: {"status": "enabled"} Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: exception: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '16987d63-7838-4d12-8197-f684045404b1', 'body': {'status': 'enabled'}} Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:52:46.745109 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. Sep 10 20:52:46.752475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:46.756224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Returning 404 to user: Service 16987d63-7838-4d12-8197-f684045404b1 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:46.758430 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5b95cf83-7887-4783-bc48-ed3abfe61dc9 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/16987d63-7838-4d12-8197-f684045404b1" status: 404 len: 110 microversion: 2.53 time: 0.048053 Sep 10 20:52:46.765760 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 667/1350] 10.222.0.33 () {62 vars in 1309 bytes} [Sat Sep 10 20:52:46 2022] PUT /compute/v2.1/os-services/16987d63-7838-4d12-8197-f684045404b1 => generated 110 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 10 20:52:46.771484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b0447835-f0cd-4a7f-a12a-fe84ce4f0614 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:46.777351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0447835-f0cd-4a7f-a12a-fe84ce4f0614 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.778101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0447835-f0cd-4a7f-a12a-fe84ce4f0614 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.779606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0447835-f0cd-4a7f-a12a-fe84ce4f0614 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.780589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0447835-f0cd-4a7f-a12a-fe84ce4f0614 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.781260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0447835-f0cd-4a7f-a12a-fe84ce4f0614 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.781964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0447835-f0cd-4a7f-a12a-fe84ce4f0614 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.811982 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b0447835-f0cd-4a7f-a12a-fe84ce4f0614 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.043253 Sep 10 20:52:46.812886 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 668/1351] 10.222.0.33 () {60 vars in 1178 bytes} [Sat Sep 10 20:52:46 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:46.833363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ebd40034-aa94-4aa6-81e4-4daaeb189cca tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:46.840846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebd40034-aa94-4aa6-81e4-4daaeb189cca tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.862279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebd40034-aa94-4aa6-81e4-4daaeb189cca tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.862901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebd40034-aa94-4aa6-81e4-4daaeb189cca tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.866670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebd40034-aa94-4aa6-81e4-4daaeb189cca tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.867157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebd40034-aa94-4aa6-81e4-4daaeb189cca tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.867600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebd40034-aa94-4aa6-81e4-4daaeb189cca tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.940765 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ebd40034-aa94-4aa6-81e4-4daaeb189cca tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.117795 Sep 10 20:52:46.953631 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 669/1352] 10.222.0.33 () {60 vars in 1211 bytes} [Sat Sep 10 20:52:46 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:46.958639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-67050829-38e6-46e4-b5bb-633d6e08b0ec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:46.959262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-67050829-38e6-46e4-b5bb-633d6e08b0ec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:46.980361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67050829-38e6-46e4-b5bb-633d6e08b0ec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.981122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67050829-38e6-46e4-b5bb-633d6e08b0ec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.981801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67050829-38e6-46e4-b5bb-633d6e08b0ec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:46.982760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67050829-38e6-46e4-b5bb-633d6e08b0ec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:46.983432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67050829-38e6-46e4-b5bb-633d6e08b0ec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:46.984072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67050829-38e6-46e4-b5bb-633d6e08b0ec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:47.297006 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e6aaf271-00ec-4302-9c93-57092e3eff09 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.052815 Sep 10 20:52:47.297739 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 684/1353] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:52:45 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:47.303546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0523f364-c619-431f-af91-09531fee3d0c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:47.309857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0523f364-c619-431f-af91-09531fee3d0c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:47.310357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0523f364-c619-431f-af91-09531fee3d0c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:47.310858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0523f364-c619-431f-af91-09531fee3d0c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:47.311607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0523f364-c619-431f-af91-09531fee3d0c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:47.312062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0523f364-c619-431f-af91-09531fee3d0c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:47.312625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0523f364-c619-431f-af91-09531fee3d0c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:47.352766 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0523f364-c619-431f-af91-09531fee3d0c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.053224 Sep 10 20:52:47.355389 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 685/1354] 10.222.0.33 () {60 vars in 1178 bytes} [Sat Sep 10 20:52:47 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:47.403214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-67050829-38e6-46e4-b5bb-633d6e08b0ec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:47.414070 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-67050829-38e6-46e4-b5bb-633d6e08b0ec tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.459144 Sep 10 20:52:47.420170 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 670/1355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:46 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:47.429245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-63f11577-ab53-42d9-8458-15deb64eb249 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f9944bc1b80>, body: {"security_group_rule": {"parent_group_id": "b899014a-0ba7-4f6e-970b-efae76d33f74", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:47.567657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Calling method '.version_select at 0x7f9944ce5430>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:47.569776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:47.570412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:47.572443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:47.612021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:47.612548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:47.612995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:47.625148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:47.626467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:47.627122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:47.635549 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-94b137a0-1f3f-490d-86a0-d08006f29274 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.277251 Sep 10 20:52:47.636388 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 686/1356] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:47.643223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:47.644080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:47.651201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:47.651953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:47.652558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:47.653427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:47.654079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:47.654716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:47.821963 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-63f11577-ab53-42d9-8458-15deb64eb249 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.396415 Sep 10 20:52:47.824514 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 671/1357] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:52:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:47.834793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9e290747-adc7-4877-a315-ce6c45478d92 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:47.840131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e290747-adc7-4877-a315-ce6c45478d92 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:47.840918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e290747-adc7-4877-a315-ce6c45478d92 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:47.845141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e290747-adc7-4877-a315-ce6c45478d92 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:47.846302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e290747-adc7-4877-a315-ce6c45478d92 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:47.847656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e290747-adc7-4877-a315-ce6c45478d92 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:47.848828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e290747-adc7-4877-a315-ce6c45478d92 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:47.873032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:47.882604 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9e290747-adc7-4877-a315-ce6c45478d92 tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.056818 Sep 10 20:52:47.883546 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 672/1358] 10.222.0.33 () {60 vars in 1237 bytes} [Sat Sep 10 20:52:47 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:48.077285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9fbbed5c-2370-4c99-9813-9aaa233f23c0 tempest-HypervisorAdminNegativeUnderV252Test-1996738888 tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project] Calling method '.version_select at 0x7f99495b3670>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:48.077757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:48.080282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9fbbed5c-2370-4c99-9813-9aaa233f23c0 tempest-HypervisorAdminNegativeUnderV252Test-1996738888 tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1a4133b199784c499f3a8f1a02e50dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35198fec11a4f43b49e60a5f92623aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9fbbed5c-2370-4c99-9813-9aaa233f23c0 tempest-HypervisorAdminNegativeUnderV252Test-1996738888 tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project] Request method failure captured: Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkd32E-Bayy94vAWbId4Gsm-y7ihHvGYX1cwxFK78jVXSVF4GDmZ-5TjA1ylPqVX68E6YGUSNhm3RFEhSrLs_zk9vCSHAgAHcQKo0a40gHcYkXJ99M1Zzx0Uh5pUiCX9m3TAty0hNu83Y32SuEnh-RQ9lH88fEY7LadhYISEZsOVWk Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c35198fec11a4f43b49e60a5f92623aa Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1996738888 Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c35198fec11a4f43b49e60a5f92623aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c35198fec11a4f43b49e60a5f92623aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c35198fec11a4f43b49e60a5f92623aa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c35198fec11a4f43b49e60a5f92623aa"}]}] Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1996738888 Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c35198fec11a4f43b49e60a5f92623aa Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1996738888 Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1a4133b199784c499f3a8f1a02e50dec Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'nch2-master-1'} Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:48.081927 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.086437 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.086437 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.086437 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.086437 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:52:48.086437 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:52:48.086437 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 10 20:52:48.086437 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.086437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9fbbed5c-2370-4c99-9813-9aaa233f23c0 tempest-HypervisorAdminNegativeUnderV252Test-1996738888 tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:48.086437 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9fbbed5c-2370-4c99-9813-9aaa233f23c0 tempest-HypervisorAdminNegativeUnderV252Test-1996738888 tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.198536 Sep 10 20:52:48.086437 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 673/1359] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Sep 10 20:52:47 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 200 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:48.091276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79e61bcb-989b-4015-919e-dc35eeb1ccdb tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f9944bc1b80>, body: {"security_group_rule": {"parent_group_id": "b899014a-0ba7-4f6e-970b-efae76d33f74", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:48.097910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:48.107009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:48.108474 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0d9a214a-0b05-4ed0-a8cb-2fc15349eb40 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.470398 Sep 10 20:52:48.109253 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 687/1360] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:47 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:48.133693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8479c7b6-ddc2-4d5d-b556-0c46cf59b7ac tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:48.137753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8479c7b6-ddc2-4d5d-b556-0c46cf59b7ac tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.138545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8479c7b6-ddc2-4d5d-b556-0c46cf59b7ac tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.139208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8479c7b6-ddc2-4d5d-b556-0c46cf59b7ac tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.140672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8479c7b6-ddc2-4d5d-b556-0c46cf59b7ac tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.141609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8479c7b6-ddc2-4d5d-b556-0c46cf59b7ac tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.142632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8479c7b6-ddc2-4d5d-b556-0c46cf59b7ac tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.168892 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-79e61bcb-989b-4015-919e-dc35eeb1ccdb tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] HTTP exception thrown: This rule already exists in group b899014a-0ba7-4f6e-970b-efae76d33f74 Sep 10 20:52:48.169790 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8479c7b6-ddc2-4d5d-b556-0c46cf59b7ac tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.041845 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79e61bcb-989b-4015-919e-dc35eeb1ccdb tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Request method failure captured: Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 138 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkd0MWfZ1fpcXvbawkOuWrl5n-mtVZA8uhxGe_vA6VW0jlqzmF4MSv2DtDc60JJ8rR9RsEM5dqZ2JW3F6kndRIpA-b6rF8RsKkQDGlzpdtHM8fKC19vJjTA3tObcT9XxZ2GG_TmtvKrpT9qYUE5_Zx7bJ3f9QBU9cY7ogMhkElTSgo Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afb37d675816472db726662b9f0c5994", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afb37d675816472db726662b9f0c5994"}]}] Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e7392a7b7d474216b89feb16c75e2f63 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: {"security_group_rule": {"parent_group_id": "b899014a-0ba7-4f6e-970b-efae76d33f74", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: exception: This rule already exists in group b899014a-0ba7-4f6e-970b-efae76d33f74 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b899014a-0ba7-4f6e-970b-efae76d33f74', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group b899014a-0ba7-4f6e-970b-efae76d33f74 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group b899014a-0ba7-4f6e-970b-efae76d33f74 Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.175370 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.180576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:48.180576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:48.180576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group b899014a-0ba7-4f6e-970b-efae76d33f74 Sep 10 20:52:48.180576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.181542 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 688/1361] 10.222.0.33 () {60 vars in 1178 bytes} [Sat Sep 10 20:52:48 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:48.182716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79e61bcb-989b-4015-919e-dc35eeb1ccdb tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Returning 400 to user: This rule already exists in group b899014a-0ba7-4f6e-970b-efae76d33f74 {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:48.184593 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-79e61bcb-989b-4015-919e-dc35eeb1ccdb tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.098736 Sep 10 20:52:48.185606 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 674/1362] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:52:48 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:52:48.186446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93b51a06-8b58-495f-88a1-e7ca324da0a7 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Calling method '.version_select at 0x7f9944ba18b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:48.189674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93b51a06-8b58-495f-88a1-e7ca324da0a7 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.190438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93b51a06-8b58-495f-88a1-e7ca324da0a7 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.191130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93b51a06-8b58-495f-88a1-e7ca324da0a7 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.197646 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-93b51a06-8b58-495f-88a1-e7ca324da0a7 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 20:52:48.198368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4ef48379-e1d2-4df1-9dd6-e448c8fd874c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93b51a06-8b58-495f-88a1-e7ca324da0a7 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Request method failure captured: Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPkfzi7X8HRhNcXZwIqMp7kZmjXQTEqPsyruWfZz_PAslvR3G72Fv-2zGEXt4v6zZdZ2tgVK1fYOtIv0N4CeRvewshKwD8LEVMuI75Po1Qp-vD0s5nylqczWZKjZulzL1E5v4yJf32RWQEX3jC9-Qf_ilx3f6cxMDfI1rqJXzsgvzfc Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 452cae40661345769a7c731371d0ba89 Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1294662603 Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/452cae40661345769a7c731371d0ba89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/452cae40661345769a7c731371d0ba89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_452cae40661345769a7c731371d0ba89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/452cae40661345769a7c731371d0ba89"}]}] Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1294662603 Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 452cae40661345769a7c731371d0ba89 Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1294662603 Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: bf675e107ee647789d7efbe898704cc0 Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 20:52:48.199566 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.204446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef48379-e1d2-4df1-9dd6-e448c8fd874c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.204620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef48379-e1d2-4df1-9dd6-e448c8fd874c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.205754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93b51a06-8b58-495f-88a1-e7ca324da0a7 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:48.206029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef48379-e1d2-4df1-9dd6-e448c8fd874c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.206873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef48379-e1d2-4df1-9dd6-e448c8fd874c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.207262 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93b51a06-8b58-495f-88a1-e7ca324da0a7 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.024530 Sep 10 20:52:48.207465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef48379-e1d2-4df1-9dd6-e448c8fd874c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.208055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef48379-e1d2-4df1-9dd6-e448c8fd874c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.208830 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 689/1363] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 20:52:48 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:48.215438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-512e6f31-71f9-4dd4-9f5c-d2b7712a3324 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Calling method '.version_select at 0x7f99450df8b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:48.256486 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4ef48379-e1d2-4df1-9dd6-e448c8fd874c tempest-ServicesAdminNegativeV253TestJSON-1937487179 tempest-ServicesAdminNegativeV253TestJSON-1937487179-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.069461 Sep 10 20:52:48.257096 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 675/1364] 10.222.0.33 () {60 vars in 1239 bytes} [Sat Sep 10 20:52:48 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:48.261923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Calling method '.version_select at 0x7f99496870d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:48.272154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.273024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.273718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.294443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.295177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.295861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.310378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.310972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.311514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.318605 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91e398c4-6161-45b8-9d4f-9ea0fa5e90f5 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.060191 Sep 10 20:52:48.319686 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 676/1365] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:52:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:48.498806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f06ef1ae-13f0-42be-b559-badbd692ba33 tempest-ServicesAdminNegativeV253TestJSON-1936511867 tempest-ServicesAdminNegativeV253TestJSON-1936511867-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:48.507365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f06ef1ae-13f0-42be-b559-badbd692ba33 tempest-ServicesAdminNegativeV253TestJSON-1936511867 tempest-ServicesAdminNegativeV253TestJSON-1936511867-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd7c632adbf784d28ab306c9cb60b2a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de87134dfa234cefabb413dbe523ae4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f06ef1ae-13f0-42be-b559-badbd692ba33 tempest-ServicesAdminNegativeV253TestJSON-1936511867 tempest-ServicesAdminNegativeV253TestJSON-1936511867-project] Request method failure captured: Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkchstTSUE6HaBXSe0CG6Ul5Eh7Pl0Io9fmFCgor2CzEn9ragrbqh8BB9MNV9XNMWN4Bk8wkWjdX4RCKJbZCsY6Guc3z0dT_oiRNZk36qI6VznKjRgx8pUJLU_dzskdMUHKqXM-g8OE6kiJSDtdCj71T84KOQMi2M_YY5Wo9OU1RgU Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: de87134dfa234cefabb413dbe523ae4c Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1936511867 Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/de87134dfa234cefabb413dbe523ae4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/de87134dfa234cefabb413dbe523ae4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_de87134dfa234cefabb413dbe523ae4c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/de87134dfa234cefabb413dbe523ae4c"}]}] Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1936511867 Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: de87134dfa234cefabb413dbe523ae4c Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1936511867 Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1936511867-project Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d7c632adbf784d28ab306c9cb60b2a3f Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1936511867-project Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: action_args: {} Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:52:48.509625 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 20:52:48.514205 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.514205 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:48.514205 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.514205 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.514205 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.514205 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.514205 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:52:48.514205 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:52:48.514205 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 20:52:48.514205 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.515808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f06ef1ae-13f0-42be-b559-badbd692ba33 tempest-ServicesAdminNegativeV253TestJSON-1936511867 tempest-ServicesAdminNegativeV253TestJSON-1936511867-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:48.517243 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f06ef1ae-13f0-42be-b559-badbd692ba33 tempest-ServicesAdminNegativeV253TestJSON-1936511867 tempest-ServicesAdminNegativeV253TestJSON-1936511867-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.196543 Sep 10 20:52:48.518021 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 677/1366] 10.222.0.33 () {60 vars in 1178 bytes} [Sat Sep 10 20:52:48 2022] GET /compute/v2.1/os-services => generated 112 bytes in 198 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:52:48.536484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b76c02c3-a060-47cc-ad15-86741d845048 tempest-HypervisorAdminNegativeUnderV252Test-1996738888 tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project] Calling method '.version_select at 0x7f99495f1700>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:48.545033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b76c02c3-a060-47cc-ad15-86741d845048 tempest-HypervisorAdminNegativeUnderV252Test-1996738888 tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1a4133b199784c499f3a8f1a02e50dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35198fec11a4f43b49e60a5f92623aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b76c02c3-a060-47cc-ad15-86741d845048 tempest-HypervisorAdminNegativeUnderV252Test-1996738888 tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project] Request method failure captured: Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkd32E-Bayy94vAWbId4Gsm-y7ihHvGYX1cwxFK78jVXSVF4GDmZ-5TjA1ylPqVX68E6YGUSNhm3RFEhSrLs_zk9vCSHAgAHcQKo0a40gHcYkXJ99M1Zzx0Uh5pUiCX9m3TAty0hNu83Y32SuEnh-RQ9lH88fEY7LadhYISEZsOVWk Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c35198fec11a4f43b49e60a5f92623aa Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1996738888 Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c35198fec11a4f43b49e60a5f92623aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c35198fec11a4f43b49e60a5f92623aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c35198fec11a4f43b49e60a5f92623aa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c35198fec11a4f43b49e60a5f92623aa"}]}] Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1996738888 Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c35198fec11a4f43b49e60a5f92623aa Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1996738888 Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1a4133b199784c499f3a8f1a02e50dec Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '1'} Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:48.548143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.552503 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.552503 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.552503 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.552503 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:52:48.552503 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:52:48.552503 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 10 20:52:48.552503 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.555488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b76c02c3-a060-47cc-ad15-86741d845048 tempest-HypervisorAdminNegativeUnderV252Test-1996738888 tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:48.557953 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b76c02c3-a060-47cc-ad15-86741d845048 tempest-HypervisorAdminNegativeUnderV252Test-1996738888 tempest-HypervisorAdminNegativeUnderV252Test-1996738888-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.029639 Sep 10 20:52:48.564041 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 678/1367] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Sep 10 20:52:48 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:48.569433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-53953f32-ab5c-4550-9d11-e77399ec8495 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:48.570379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-53953f32-ab5c-4550-9d11-e77399ec8495 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:48.582195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53953f32-ab5c-4550-9d11-e77399ec8495 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.582934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53953f32-ab5c-4550-9d11-e77399ec8495 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.583484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53953f32-ab5c-4550-9d11-e77399ec8495 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.584314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53953f32-ab5c-4550-9d11-e77399ec8495 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.584879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53953f32-ab5c-4550-9d11-e77399ec8495 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.585575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53953f32-ab5c-4550-9d11-e77399ec8495 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.772303 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-512e6f31-71f9-4dd4-9f5c-d2b7712a3324 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/92de5929-7f16-47eb-bbf7-ad80e8465207" status: 202 len: 0 microversion: 2.1 time: 0.562103 Sep 10 20:52:48.773004 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 690/1368] 10.222.0.33 () {58 vars in 1287 bytes} [Sat Sep 10 20:52:48 2022] DELETE /compute/v2.1/os-security-group-rules/92de5929-7f16-47eb-bbf7-ad80e8465207 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:48.778180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-abd10fb3-3ecb-4f00-ade3-d7731cec2a59 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Calling method '.version_select at 0x7f99458c6ee0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:48.783462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abd10fb3-3ecb-4f00-ade3-d7731cec2a59 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:48.785223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abd10fb3-3ecb-4f00-ade3-d7731cec2a59 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:48.786461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abd10fb3-3ecb-4f00-ade3-d7731cec2a59 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:48.811732 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-abd10fb3-3ecb-4f00-ade3-d7731cec2a59 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] HTTP exception thrown: No hypervisor matching '5fbab070-a94b-4074-bd1c-2f10ca617922' could be found. Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-abd10fb3-3ecb-4f00-ade3-d7731cec2a59 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Request method failure captured: Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-hypervisors/5fbab070-a94b-4074-bd1c-2f10ca617922/servers HTTP/1.1 Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPkfzi7X8HRhNcXZwIqMp7kZmjXQTEqPsyruWfZz_PAslvR3G72Fv-2zGEXt4v6zZdZ2tgVK1fYOtIv0N4CeRvewshKwD8LEVMuI75Po1Qp-vD0s5nylqczWZKjZulzL1E5v4yJf32RWQEX3jC9-Qf_ilx3f6cxMDfI1rqJXzsgvzfc Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 452cae40661345769a7c731371d0ba89 Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1294662603 Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/452cae40661345769a7c731371d0ba89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/452cae40661345769a7c731371d0ba89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_452cae40661345769a7c731371d0ba89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/452cae40661345769a7c731371d0ba89"}]}] Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1294662603 Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 452cae40661345769a7c731371d0ba89 Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1294662603 Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: bf675e107ee647789d7efbe898704cc0 Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: exception: No hypervisor matching '5fbab070-a94b-4074-bd1c-2f10ca617922' could be found. Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5fbab070-a94b-4074-bd1c-2f10ca617922'} Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5fbab070-a94b-4074-bd1c-2f10ca617922' could be found. Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5fbab070-a94b-4074-bd1c-2f10ca617922' could be found. Sep 10 20:52:48.815517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:48.823948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-abd10fb3-3ecb-4f00-ade3-d7731cec2a59 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] Returning 404 to user: No hypervisor matching '5fbab070-a94b-4074-bd1c-2f10ca617922' could be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:48.824982 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-abd10fb3-3ecb-4f00-ade3-d7731cec2a59 tempest-HypervisorAdminNegativeUnderV252Test-1294662603 tempest-HypervisorAdminNegativeUnderV252Test-1294662603-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/5fbab070-a94b-4074-bd1c-2f10ca617922/servers" status: 404 len: 123 microversion: 2.1 time: 0.050572 Sep 10 20:52:48.829407 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 691/1369] 10.222.0.33 () {58 vars in 1281 bytes} [Sat Sep 10 20:52:48 2022] GET /compute/v2.1/os-hypervisors/5fbab070-a94b-4074-bd1c-2f10ca617922/servers => generated 123 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:48.839350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-076da175-98db-4c66-addc-b596c6690443 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f99450dfee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-894319815", "description": "tempest-description-1398057104"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:49.023365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-53953f32-ab5c-4550-9d11-e77399ec8495 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:49.038263 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-53953f32-ab5c-4550-9d11-e77399ec8495 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.472612 Sep 10 20:52:49.053163 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 679/1370] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:48 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:49.140021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:49.140997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:49.155742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:49.156255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:49.157363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:49.162575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:49.165048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:49.165634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:49.383346 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-076da175-98db-4c66-addc-b596c6690443 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.551813 Sep 10 20:52:49.384205 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 692/1371] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:52:48 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:49.397574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0aeffb54-c223-4714-95b4-162b04794512 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f9944becaf0>, body: {"security_group_rule": {"parent_group_id": "1b26d1d3-fb31-48a0-8c38-213d35699d53", "ip_protocol": "tcp", "from_port": 2098030982, "to_port": 22}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:49.483447 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0aeffb54-c223-4714-95b4-162b04794512 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] HTTP exception thrown: Invalid port range 2098030982:22. Former value cannot be greater than the later Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0aeffb54-c223-4714-95b4-162b04794512 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Request method failure captured: Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 146 Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPkd0MWfZ1fpcXvbawkOuWrl5n-mtVZA8uhxGe_vA6VW0jlqzmF4MSv2DtDc60JJ8rR9RsEM5dqZ2JW3F6kndRIpA-b6rF8RsKkQDGlzpdtHM8fKC19vJjTA3tObcT9XxZ2GG_TmtvKrpT9qYUE5_Zx7bJ3f9QBU9cY7ogMhkElTSgo Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afb37d675816472db726662b9f0c5994", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afb37d675816472db726662b9f0c5994"}]}] Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: e7392a7b7d474216b89feb16c75e2f63 Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: {"security_group_rule": {"parent_group_id": "1b26d1d3-fb31-48a0-8c38-213d35699d53", "ip_protocol": "tcp", "from_port": 2098030982, "to_port": 22}} Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid port range 2098030982:22. Former value cannot be greater than the later Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1b26d1d3-fb31-48a0-8c38-213d35699d53', 'ip_protocol': 'tcp', 'from_port': 2098030982, 'to_port': 22}}} Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2098030982:22. Former value cannot be greater than the later Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2098030982:22. Former value cannot be greater than the later Sep 10 20:52:49.487896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:49.492819 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:49.492819 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:49.492819 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:49.492819 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:49.492819 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:49.492819 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:49.492819 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:49.492819 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2098030982:22. Former value cannot be greater than the later Sep 10 20:52:49.492819 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:49.492819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0aeffb54-c223-4714-95b4-162b04794512 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Returning 400 to user: Invalid port range 2098030982:22. Former value cannot be greater than the later {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:49.494961 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0aeffb54-c223-4714-95b4-162b04794512 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.101234 Sep 10 20:52:49.498578 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 693/1372] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:52:49 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:52:49.518068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07b9f297-e5f2-4dc5-bbed-5a623a49c657 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f99450df3a0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1147937867", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:49.530180 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-07b9f297-e5f2-4dc5-bbed-5a623a49c657 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] HTTP exception thrown: Security group id should be uuid Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07b9f297-e5f2-4dc5-bbed-5a623a49c657 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Request method failure captured: Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 131 Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPkd0MWfZ1fpcXvbawkOuWrl5n-mtVZA8uhxGe_vA6VW0jlqzmF4MSv2DtDc60JJ8rR9RsEM5dqZ2JW3F6kndRIpA-b6rF8RsKkQDGlzpdtHM8fKC19vJjTA3tObcT9XxZ2GG_TmtvKrpT9qYUE5_Zx7bJ3f9QBU9cY7ogMhkElTSgo Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afb37d675816472db726662b9f0c5994", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afb37d675816472db726662b9f0c5994"}]}] Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: e7392a7b7d474216b89feb16c75e2f63 Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1147937867", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: exception: Security group id should be uuid Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1147937867', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:49.533548 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:49.537812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 10 20:52:49.537812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:49.537812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07b9f297-e5f2-4dc5-bbed-5a623a49c657 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Returning 400 to user: Security group id should be uuid {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:49.538330 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-07b9f297-e5f2-4dc5-bbed-5a623a49c657 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.030280 Sep 10 20:52:49.540369 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 694/1373] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:52:49 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:52:49.553888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-33cc16fc-d3f9-4884-b5d1-f2fd857a4621 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f9944ca5a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-521414932", "description": "tempest-description-2130992370"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:49.746532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:49.763391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:49.766643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:49.771692 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0196f6b8-a7b7-441e-9420-48e9473cdecb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.635996 Sep 10 20:52:49.791946 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 680/1374] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:49 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:52:50.065040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7d25cb1e-f7e8-463a-82ea-d978d76ccbbd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:50.065723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7d25cb1e-f7e8-463a-82ea-d978d76ccbbd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:50.087800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d25cb1e-f7e8-463a-82ea-d978d76ccbbd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:50.088313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d25cb1e-f7e8-463a-82ea-d978d76ccbbd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:50.088757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d25cb1e-f7e8-463a-82ea-d978d76ccbbd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:50.089477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d25cb1e-f7e8-463a-82ea-d978d76ccbbd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:50.089972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d25cb1e-f7e8-463a-82ea-d978d76ccbbd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:50.090977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d25cb1e-f7e8-463a-82ea-d978d76ccbbd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:50.131040 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-33cc16fc-d3f9-4884-b5d1-f2fd857a4621 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.582376 Sep 10 20:52:50.131836 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 695/1375] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:52:49 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:50.145038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e39e7f86-38ac-434b-8f58-7a923a5ba02e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f9944b998b0>, body: {"security_group_rule": {"parent_group_id": "9c7b4e67-c895-4800-8e81-4d8062769338", "ip_protocol": "tempest-999-141018656", "from_port": 22, "to_port": 22}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:50.364136 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e39e7f86-38ac-434b-8f58-7a923a5ba02e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] HTTP exception thrown: Invalid IP protocol tempest-999-141018656. Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e39e7f86-38ac-434b-8f58-7a923a5ba02e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Request method failure captured: Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 156 Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPkd0MWfZ1fpcXvbawkOuWrl5n-mtVZA8uhxGe_vA6VW0jlqzmF4MSv2DtDc60JJ8rR9RsEM5dqZ2JW3F6kndRIpA-b6rF8RsKkQDGlzpdtHM8fKC19vJjTA3tObcT9XxZ2GG_TmtvKrpT9qYUE5_Zx7bJ3f9QBU9cY7ogMhkElTSgo Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afb37d675816472db726662b9f0c5994", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afb37d675816472db726662b9f0c5994"}]}] Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: e7392a7b7d474216b89feb16c75e2f63 Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: {"security_group_rule": {"parent_group_id": "9c7b4e67-c895-4800-8e81-4d8062769338", "ip_protocol": "tempest-999-141018656", "from_port": 22, "to_port": 22}} Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid IP protocol tempest-999-141018656. Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9c7b4e67-c895-4800-8e81-4d8062769338', 'ip_protocol': 'tempest-999-141018656', 'from_port': 22, 'to_port': 22}}} Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-141018656. Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-141018656. Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:50.367061 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:50.372331 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:50.372331 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:50.372331 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:50.372331 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:50.372331 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:50.372331 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:50.372331 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-141018656. Sep 10 20:52:50.372331 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:50.376439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e39e7f86-38ac-434b-8f58-7a923a5ba02e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Returning 400 to user: Invalid IP protocol tempest-999-141018656. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:50.377719 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e39e7f86-38ac-434b-8f58-7a923a5ba02e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.236604 Sep 10 20:52:50.381331 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 696/1376] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:52:50 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 10 20:52:50.394889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1d1d5e76-cd8f-48bc-86da-c7f34b6729dc tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f9944ca5d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1002274480", "description": "tempest-description-1198203517"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:51.264055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7d25cb1e-f7e8-463a-82ea-d978d76ccbbd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:51.317628 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1d1d5e76-cd8f-48bc-86da-c7f34b6729dc tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.928737 Sep 10 20:52:51.318647 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 697/1377] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:52:50 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:51.331898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:51.345159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:51.368585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:51.369089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:51.369227 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7d25cb1e-f7e8-463a-82ea-d978d76ccbbd tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 1.300353 Sep 10 20:52:51.369543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:51.376457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:51.377030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:51.377484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:51.390081 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 681/1378] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:50 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:51.418166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-86666598-16f1-4528-b616-0fdaa5a159e0 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f9946466b80>, body: {"security_group_rule": {"parent_group_id": "8f9eec17-f4c9-4e85-9d94-0cb29a4a9678", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:51.622522 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-86666598-16f1-4528-b616-0fdaa5a159e0 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-86666598-16f1-4528-b616-0fdaa5a159e0 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Request method failure captured: Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 138 Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkd0MWfZ1fpcXvbawkOuWrl5n-mtVZA8uhxGe_vA6VW0jlqzmF4MSv2DtDc60JJ8rR9RsEM5dqZ2JW3F6kndRIpA-b6rF8RsKkQDGlzpdtHM8fKC19vJjTA3tObcT9XxZ2GG_TmtvKrpT9qYUE5_Zx7bJ3f9QBU9cY7ogMhkElTSgo Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afb37d675816472db726662b9f0c5994", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afb37d675816472db726662b9f0c5994"}]}] Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e7392a7b7d474216b89feb16c75e2f63 Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: {"security_group_rule": {"parent_group_id": "8f9eec17-f4c9-4e85-9d94-0cb29a4a9678", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8f9eec17-f4c9-4e85-9d94-0cb29a4a9678', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 20:52:51.624364 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:51.630977 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:51.630977 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:51.630977 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:51.630977 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:51.630977 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:51.630977 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:51.630977 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:51.630977 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 20:52:51.630977 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:51.635536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-86666598-16f1-4528-b616-0fdaa5a159e0 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:51.640147 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-86666598-16f1-4528-b616-0fdaa5a159e0 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.246412 Sep 10 20:52:51.641004 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 682/1379] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:52:51 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 250 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:52:51.666367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d48c2be7-a0b5-4efe-98fe-0bf303981bbb tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f9946466b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-173162726", "description": "tempest-description-242107322"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:51.684663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:51.699894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:51.706439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:51.708116 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-561ea146-2b91-42a9-8b51-638189fbe645 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.387617 Sep 10 20:52:51.731011 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 698/1380] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:51 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:52.397168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cd96e59a-66e6-450e-aba5-9994828a0b0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:52.397991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cd96e59a-66e6-450e-aba5-9994828a0b0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:52.423747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96e59a-66e6-450e-aba5-9994828a0b0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:52.425405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96e59a-66e6-450e-aba5-9994828a0b0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:52.427331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96e59a-66e6-450e-aba5-9994828a0b0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:52.428990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96e59a-66e6-450e-aba5-9994828a0b0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:52.430941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96e59a-66e6-450e-aba5-9994828a0b0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:52.432323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96e59a-66e6-450e-aba5-9994828a0b0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:52.459583 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d48c2be7-a0b5-4efe-98fe-0bf303981bbb tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.812480 Sep 10 20:52:52.460208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 683/1381] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:52:51 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:52.484147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3d0c530-c20a-450d-9c78-7b04423f2865 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f99495fc040>, body: {"security_group_rule": {"parent_group_id": "cd9bee75-70a5-4317-b8a3-90388ee6c0b7", "ip_protocol": "tcp", "from_port": 22, "to_port": 1873774773}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:52.771595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cd96e59a-66e6-450e-aba5-9994828a0b0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:52.784998 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cd96e59a-66e6-450e-aba5-9994828a0b0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1476 microversion: 2.1 time: 0.390555 Sep 10 20:52:52.786695 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 699/1382] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:52 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1476 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:52:52.793991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:52.794782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:52.809384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:52.815898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:52.816473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:52.817243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:52.817713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:52.818187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:52.923089 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-b3d0c530-c20a-450d-9c78-7b04423f2865 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] HTTP exception thrown: Invalid port range 22:1873774773. Valid TCP ports should be between 1-65535 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3d0c530-c20a-450d-9c78-7b04423f2865 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Request method failure captured: Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 146 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkd0MWfZ1fpcXvbawkOuWrl5n-mtVZA8uhxGe_vA6VW0jlqzmF4MSv2DtDc60JJ8rR9RsEM5dqZ2JW3F6kndRIpA-b6rF8RsKkQDGlzpdtHM8fKC19vJjTA3tObcT9XxZ2GG_TmtvKrpT9qYUE5_Zx7bJ3f9QBU9cY7ogMhkElTSgo Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afb37d675816472db726662b9f0c5994", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afb37d675816472db726662b9f0c5994"}]}] Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e7392a7b7d474216b89feb16c75e2f63 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: {"security_group_rule": {"parent_group_id": "cd9bee75-70a5-4317-b8a3-90388ee6c0b7", "ip_protocol": "tcp", "from_port": 22, "to_port": 1873774773}} Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid port range 22:1873774773. Valid TCP ports should be between 1-65535 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cd9bee75-70a5-4317-b8a3-90388ee6c0b7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1873774773}}} Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1873774773. Valid TCP ports should be between 1-65535 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1873774773. Valid TCP ports should be between 1-65535 Sep 10 20:52:52.925499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:52.929752 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:52.929752 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:52.929752 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:52.929752 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:52.929752 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:52.929752 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:52.929752 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:52.929752 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1873774773. Valid TCP ports should be between 1-65535 Sep 10 20:52:52.929752 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:52.934204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3d0c530-c20a-450d-9c78-7b04423f2865 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Returning 400 to user: Invalid port range 22:1873774773. Valid TCP ports should be between 1-65535 {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:52.939059 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b3d0c530-c20a-450d-9c78-7b04423f2865 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.468908 Sep 10 20:52:52.940254 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 684/1383] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:52:52 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 471 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 20:52:52.953633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a4a6b73-f7cb-42eb-a693-830054f10b4e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Action: 'create', calling method: .version_select at 0x7f9944bdd940>, body: {"security_group_rule": {"parent_group_id": "df044fa7-bd39-4ecc-bbd8-2d35f5f94368", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:53.063853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-3a4a6b73-f7cb-42eb-a693-830054f10b4e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group df044fa7-bd39-4ecc-bbd8-2d35f5f94368 does not exist", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:52:53.065006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.security_group_api [None req-3a4a6b73-f7cb-42eb-a693-830054f10b4e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Neutron security group df044fa7-bd39-4ecc-bbd8-2d35f5f94368 not found {{(pid=145771) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 20:52:53.066485 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-3a4a6b73-f7cb-42eb-a693-830054f10b4e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] HTTP exception thrown: Security group df044fa7-bd39-4ecc-bbd8-2d35f5f94368 does not exist Sep 10 20:52:53.066485 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-5d59b5d0-cb48-4707-a25f-334c40146de7'] Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a4a6b73-f7cb-42eb-a693-830054f10b4e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Request method failure captured: Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 138 Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkd0MWfZ1fpcXvbawkOuWrl5n-mtVZA8uhxGe_vA6VW0jlqzmF4MSv2DtDc60JJ8rR9RsEM5dqZ2JW3F6kndRIpA-b6rF8RsKkQDGlzpdtHM8fKC19vJjTA3tObcT9XxZ2GG_TmtvKrpT9qYUE5_Zx7bJ3f9QBU9cY7ogMhkElTSgo Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afb37d675816472db726662b9f0c5994", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afb37d675816472db726662b9f0c5994"}]}] Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e7392a7b7d474216b89feb16c75e2f63 Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: {"security_group_rule": {"parent_group_id": "df044fa7-bd39-4ecc-bbd8-2d35f5f94368", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: exception: Security group df044fa7-bd39-4ecc-bbd8-2d35f5f94368 does not exist Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-5d59b5d0-cb48-4707-a25f-334c40146de7'] Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'df044fa7-bd39-4ecc-bbd8-2d35f5f94368', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:52:53.069494 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group df044fa7-bd39-4ecc-bbd8-2d35f5f94368 does not exist Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d59b5d0-cb48-4707-a25f-334c40146de7'] Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group df044fa7-bd39-4ecc-bbd8-2d35f5f94368 does not exist Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d59b5d0-cb48-4707-a25f-334c40146de7'] Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group df044fa7-bd39-4ecc-bbd8-2d35f5f94368 does not exist Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d59b5d0-cb48-4707-a25f-334c40146de7'] Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group df044fa7-bd39-4ecc-bbd8-2d35f5f94368 does not exist Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d59b5d0-cb48-4707-a25f-334c40146de7'] Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a4a6b73-f7cb-42eb-a693-830054f10b4e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Returning 404 to user: Security group df044fa7-bd39-4ecc-bbd8-2d35f5f94368 does not exist Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-5d59b5d0-cb48-4707-a25f-334c40146de7'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:53.074143 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3a4a6b73-f7cb-42eb-a693-830054f10b4e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.125490 Sep 10 20:52:53.082141 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 685/1384] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:52:52 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:53.085716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e76fbb6-f442-4839-9da1-059219b1bb64 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Calling method '.version_select at 0x7f9944bddca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:53.197452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-0e76fbb6-f442-4839-9da1-059219b1bb64 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a3d932ee-e393-4af8-9210-acf5498dead7 does not exist", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:52:53.198094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.security_group_api [None req-0e76fbb6-f442-4839-9da1-059219b1bb64 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Neutron security group rule a3d932ee-e393-4af8-9210-acf5498dead7 not found {{(pid=145771) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 10 20:52:53.198814 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-0e76fbb6-f442-4839-9da1-059219b1bb64 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] HTTP exception thrown: Security group rule a3d932ee-e393-4af8-9210-acf5498dead7 does not exist Sep 10 20:52:53.198814 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-861af188-b452-45b5-8547-5a3645896750'] Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e76fbb6-f442-4839-9da1-059219b1bb64 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Request method failure captured: Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/os-security-group-rules/a3d932ee-e393-4af8-9210-acf5498dead7 HTTP/1.1 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPkd0MWfZ1fpcXvbawkOuWrl5n-mtVZA8uhxGe_vA6VW0jlqzmF4MSv2DtDc60JJ8rR9RsEM5dqZ2JW3F6kndRIpA-b6rF8RsKkQDGlzpdtHM8fKC19vJjTA3tObcT9XxZ2GG_TmtvKrpT9qYUE5_Zx7bJ3f9QBU9cY7ogMhkElTSgo Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afb37d675816472db726662b9f0c5994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afb37d675816472db726662b9f0c5994", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afb37d675816472db726662b9f0c5994"}]}] Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: afb37d675816472db726662b9f0c5994 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e7392a7b7d474216b89feb16c75e2f63 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: exception: Security group rule a3d932ee-e393-4af8-9210-acf5498dead7 does not exist Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-861af188-b452-45b5-8547-5a3645896750'] Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'a3d932ee-e393-4af8-9210-acf5498dead7'} Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:52:53.201754 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a3d932ee-e393-4af8-9210-acf5498dead7 does not exist Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-861af188-b452-45b5-8547-5a3645896750'] Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a3d932ee-e393-4af8-9210-acf5498dead7 does not exist Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-861af188-b452-45b5-8547-5a3645896750'] Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a3d932ee-e393-4af8-9210-acf5498dead7 does not exist Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-861af188-b452-45b5-8547-5a3645896750'] Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a3d932ee-e393-4af8-9210-acf5498dead7 does not exist Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-861af188-b452-45b5-8547-5a3645896750'] Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e76fbb6-f442-4839-9da1-059219b1bb64 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Returning 404 to user: Security group rule a3d932ee-e393-4af8-9210-acf5498dead7 does not exist Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-861af188-b452-45b5-8547-5a3645896750'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e76fbb6-f442-4839-9da1-059219b1bb64 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/a3d932ee-e393-4af8-9210-acf5498dead7" status: 404 len: 199 microversion: 2.1 time: 0.124296 Sep 10 20:52:53.206848 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 686/1385] 10.222.0.33 () {58 vars in 1287 bytes} [Sat Sep 10 20:52:53 2022] DELETE /compute/v2.1/os-security-group-rules/a3d932ee-e393-4af8-9210-acf5498dead7 => generated 199 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:52:53.222889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc8ba2df-2e6e-4e38-9205-74847959675f tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Calling method '.version_select at 0x7f99495fc1f0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:53.226115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:53.242441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:53.246023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:53.249213 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-36e7d077-c814-40f2-9cdf-0ca7b79fb57f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.457736 Sep 10 20:52:53.251171 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 700/1386] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:52 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:53.811823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a906e21-c2d5-4166-bb13-a981f044ac83 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:53.818484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a906e21-c2d5-4166-bb13-a981f044ac83 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:53.837683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a906e21-c2d5-4166-bb13-a981f044ac83 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:53.852250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a906e21-c2d5-4166-bb13-a981f044ac83 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:53.853284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a906e21-c2d5-4166-bb13-a981f044ac83 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:53.855744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a906e21-c2d5-4166-bb13-a981f044ac83 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:53.857374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a906e21-c2d5-4166-bb13-a981f044ac83 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:53.858186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a906e21-c2d5-4166-bb13-a981f044ac83 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:54.062889 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cc8ba2df-2e6e-4e38-9205-74847959675f tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/cd9bee75-70a5-4317-b8a3-90388ee6c0b7" status: 202 len: 0 microversion: 2.1 time: 0.849600 Sep 10 20:52:54.064081 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 687/1387] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:52:53 2022] DELETE /compute/v2.1/os-security-groups/cd9bee75-70a5-4317-b8a3-90388ee6c0b7 => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:54.071899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-41cc49ba-ab17-43c8-9fa3-6322a8b1260b tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Calling method '.version_select at 0x7f994963a670>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:54.943519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7a906e21-c2d5-4166-bb13-a981f044ac83 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:54.958123 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a906e21-c2d5-4166-bb13-a981f044ac83 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1475 microversion: 2.1 time: 1.150723 Sep 10 20:52:54.961062 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 701/1388] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:53 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1475 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:54.982425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:54.985846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:55.001120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:55.014541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:55.015021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:55.015465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:55.019888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:55.023158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:55.023791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:55.126231 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-41cc49ba-ab17-43c8-9fa3-6322a8b1260b tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/8f9eec17-f4c9-4e85-9d94-0cb29a4a9678" status: 202 len: 0 microversion: 2.1 time: 1.054887 Sep 10 20:52:55.126903 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 688/1389] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:52:54 2022] DELETE /compute/v2.1/os-security-groups/8f9eec17-f4c9-4e85-9d94-0cb29a4a9678 => generated 0 bytes in 1059 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:52:55.134892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80feb34a-a582-4a63-bf1e-0402c0675b7e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Calling method '.version_select at 0x7f994963aa60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:55.317178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:55.348778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:55.355434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:55.359045 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-393e6588-32d1-4d0a-bc07-29e8c3591367 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1813 microversion: 2.25 time: 0.396229 Sep 10 20:52:55.362609 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 702/1390] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:54 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1813 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:55.636905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8a590cc9-26b0-460d-b75a-3dedbe55938c tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Calling method '.version_select at 0x7f9944ca5280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:55.698141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-8a590cc9-26b0-460d-b75a-3dedbe55938c tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6dbaf743-d430-46f4-b409-44744ebe3f87 does not exist", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:52:55.698763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.security_group_api [None req-8a590cc9-26b0-460d-b75a-3dedbe55938c tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Neutron security group 6dbaf743-d430-46f4-b409-44744ebe3f87 not found {{(pid=145772) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 20:52:55.699295 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-8a590cc9-26b0-460d-b75a-3dedbe55938c tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] HTTP exception thrown: Security group 6dbaf743-d430-46f4-b409-44744ebe3f87 does not exist Sep 10 20:52:55.699295 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-0c34dd08-e9a1-4caa-882d-0c8fa559b0c7'] Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8a590cc9-26b0-460d-b75a-3dedbe55938c tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Request method failure captured: Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-security-groups/6dbaf743-d430-46f4-b409-44744ebe3f87 HTTP/1.1 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPknYWIUXJJfexhlkybXkHsQz1gtwWZkQiUSpnR1LfThpcAAu_B1tMC76WfWDMw8pU_d_REJT5oUF7HZGOv0wTHY68EKSDPIFzcgT2cFugsO2VNXkFgGgvu3gmqSp3jT6T7iMq2Jk33N9ap94LN-12d6HrBWGF3_Rm8X2P_GkoKCqm4 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 52dc7565b41b48b7a442810f0f21cc01 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52dc7565b41b48b7a442810f0f21cc01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52dc7565b41b48b7a442810f0f21cc01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_52dc7565b41b48b7a442810f0f21cc01", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/52dc7565b41b48b7a442810f0f21cc01"}]}] Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 52dc7565b41b48b7a442810f0f21cc01 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupsNegativeTestJSON-1211447122-project Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: e01d3916c09a484eb3a687ba732162b1 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122-project Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: exception: Security group 6dbaf743-d430-46f4-b409-44744ebe3f87 does not exist Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-0c34dd08-e9a1-4caa-882d-0c8fa559b0c7'] Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '6dbaf743-d430-46f4-b409-44744ebe3f87'} Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:52:55.701124 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6dbaf743-d430-46f4-b409-44744ebe3f87 does not exist Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c34dd08-e9a1-4caa-882d-0c8fa559b0c7'] Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6dbaf743-d430-46f4-b409-44744ebe3f87 does not exist Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c34dd08-e9a1-4caa-882d-0c8fa559b0c7'] Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6dbaf743-d430-46f4-b409-44744ebe3f87 does not exist Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c34dd08-e9a1-4caa-882d-0c8fa559b0c7'] Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6dbaf743-d430-46f4-b409-44744ebe3f87 does not exist Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c34dd08-e9a1-4caa-882d-0c8fa559b0c7'] Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8a590cc9-26b0-460d-b75a-3dedbe55938c tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Returning 404 to user: Security group 6dbaf743-d430-46f4-b409-44744ebe3f87 does not exist Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-0c34dd08-e9a1-4caa-882d-0c8fa559b0c7'] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8a590cc9-26b0-460d-b75a-3dedbe55938c tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6dbaf743-d430-46f4-b409-44744ebe3f87" status: 404 len: 194 microversion: 2.1 time: 0.339651 Sep 10 20:52:55.706021 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 703/1391] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:52:55 2022] DELETE /compute/v2.1/os-security-groups/6dbaf743-d430-46f4-b409-44744ebe3f87 => generated 194 bytes in 341 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:55.715103 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-043bab3d-9a94-4267-a079-42edea4ac4b4 tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005108 Sep 10 20:52:55.718614 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 704/1392] 10.222.0.33 () {58 vars in 1164 bytes} [Sat Sep 10 20:52:55 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 20:52:55.728093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-65167cf2-64c9-4c29-9326-0562584f5b22 tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Calling method '.version_select at 0x7f9944c42dc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:56.010750 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-80feb34a-a582-4a63-bf1e-0402c0675b7e tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9c7b4e67-c895-4800-8e81-4d8062769338" status: 202 len: 0 microversion: 2.1 time: 0.879675 Sep 10 20:52:56.011379 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 689/1393] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:52:55 2022] DELETE /compute/v2.1/os-security-groups/9c7b4e67-c895-4800-8e81-4d8062769338 => generated 0 bytes in 881 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:56.017402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-abb5affa-8a09-4e12-ab5c-54d70641e21d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:56.018262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-abb5affa-8a09-4e12-ab5c-54d70641e21d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:56.039175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abb5affa-8a09-4e12-ab5c-54d70641e21d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:56.040132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abb5affa-8a09-4e12-ab5c-54d70641e21d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:56.041498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abb5affa-8a09-4e12-ab5c-54d70641e21d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:56.046583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abb5affa-8a09-4e12-ab5c-54d70641e21d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:56.047232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abb5affa-8a09-4e12-ab5c-54d70641e21d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:56.050689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abb5affa-8a09-4e12-ab5c-54d70641e21d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:56.063590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:56.420188 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-65167cf2-64c9-4c29-9326-0562584f5b22 tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.695952 Sep 10 20:52:56.421196 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 705/1394] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 20:52:55 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:56.437242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a19b85f8-0033-4ebb-8169-5f7877774495 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Calling method '.version_select at 0x7f9944fb3ee0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:56.558187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-abb5affa-8a09-4e12-ab5c-54d70641e21d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:56.573897 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-abb5affa-8a09-4e12-ab5c-54d70641e21d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1475 microversion: 2.1 time: 0.559234 Sep 10 20:52:56.575651 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 690/1395] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:56 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1475 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:56.583246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:56.584213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:56.591610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:56.592539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:56.593277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:56.594797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:56.595755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:56.596692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:56.873066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:56.886195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:56.893634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:56.895310 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2e695b5c-6fad-4d11-a82a-1eeffee22ae6 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1803 microversion: 2.25 time: 0.318429 Sep 10 20:52:56.896135 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 691/1396] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:56 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1803 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:56.912569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-94336def-562e-41e6-a413-2779270b00dc tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Calling method '.version_select at 0x7f9944bdd5e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:57.071713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-94336def-562e-41e6-a413-2779270b00dc tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:52:57.072881 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-94336def-562e-41e6-a413-2779270b00dc tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 10 20:52:57.072881 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-7735ed3b-86c5-4fef-987b-54b6a29e22e2'] Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-94336def-562e-41e6-a413-2779270b00dc tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Request method failure captured: Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/os-security-groups/ca827457-7e8f-4816-b4c9-b7711d899530 HTTP/1.1 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPknYWIUXJJfexhlkybXkHsQz1gtwWZkQiUSpnR1LfThpcAAu_B1tMC76WfWDMw8pU_d_REJT5oUF7HZGOv0wTHY68EKSDPIFzcgT2cFugsO2VNXkFgGgvu3gmqSp3jT6T7iMq2Jk33N9ap94LN-12d6HrBWGF3_Rm8X2P_GkoKCqm4 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 52dc7565b41b48b7a442810f0f21cc01 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52dc7565b41b48b7a442810f0f21cc01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52dc7565b41b48b7a442810f0f21cc01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_52dc7565b41b48b7a442810f0f21cc01", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/52dc7565b41b48b7a442810f0f21cc01"}]}] Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 52dc7565b41b48b7a442810f0f21cc01 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupsNegativeTestJSON-1211447122-project Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e01d3916c09a484eb3a687ba732162b1 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122-project Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: exception: Insufficient rights for removing default security group. Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-7735ed3b-86c5-4fef-987b-54b6a29e22e2'] Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'ca827457-7e8f-4816-b4c9-b7711d899530'} Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:52:57.076194 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7735ed3b-86c5-4fef-987b-54b6a29e22e2'] Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7735ed3b-86c5-4fef-987b-54b6a29e22e2'] Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7735ed3b-86c5-4fef-987b-54b6a29e22e2'] Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7735ed3b-86c5-4fef-987b-54b6a29e22e2'] Sep 10 20:52:57.082341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.111131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-94336def-562e-41e6-a413-2779270b00dc tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 10 20:52:57.111131 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-7735ed3b-86c5-4fef-987b-54b6a29e22e2'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:57.117520 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-94336def-562e-41e6-a413-2779270b00dc tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ca827457-7e8f-4816-b4c9-b7711d899530" status: 400 len: 182 microversion: 2.1 time: 0.220082 Sep 10 20:52:57.127758 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 692/1397] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:52:56 2022] DELETE /compute/v2.1/os-security-groups/ca827457-7e8f-4816-b4c9-b7711d899530 => generated 182 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:52:57.300375 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a19b85f8-0033-4ebb-8169-5f7877774495 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/1b26d1d3-fb31-48a0-8c38-213d35699d53" status: 202 len: 0 microversion: 2.1 time: 0.877891 Sep 10 20:52:57.300951 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 706/1398] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:52:56 2022] DELETE /compute/v2.1/os-security-groups/1b26d1d3-fb31-48a0-8c38-213d35699d53 => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:57.304806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-40e4c00b-5c6e-4ae3-a30b-7fc33b1d9090 tempest-NetworksTest-1070404131 tempest-NetworksTest-1070404131-project-admin] Calling method '.version_select at 0x7f9944bdd040>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:57.308964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ad8fe2d4-3f6e-4841-b01e-46675d806418 req-39545202-2152-4fdc-b297-010e3c8d2960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435d0526-f990-4ec6-b38f-13aa30486469", "name": "network-vif-unplugged", "status": "completed", "tag": "bfa95032-3491-453d-9ca4-83b61c66730d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:57.319758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ad8fe2d4-3f6e-4841-b01e-46675d806418 req-39545202-2152-4fdc-b297-010e3c8d2960 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:57.320589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ad8fe2d4-3f6e-4841-b01e-46675d806418 req-39545202-2152-4fdc-b297-010e3c8d2960 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:57.321180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ad8fe2d4-3f6e-4841-b01e-46675d806418 req-39545202-2152-4fdc-b297-010e3c8d2960 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:57.339768 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ad8fe2d4-3f6e-4841-b01e-46675d806418 req-39545202-2152-4fdc-b297-010e3c8d2960 service nova] Creating event network-vif-unplugged:bfa95032-3491-453d-9ca4-83b61c66730d for instance 435d0526-f990-4ec6-b38f-13aa30486469 on nch2-master-1 Sep 10 20:52:57.361282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-ad8fe2d4-3f6e-4841-b01e-46675d806418 req-39545202-2152-4fdc-b297-010e3c8d2960 service nova] Instance 435d0526-f990-4ec6-b38f-13aa30486469 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:52:57.370744 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ad8fe2d4-3f6e-4841-b01e-46675d806418 req-39545202-2152-4fdc-b297-010e3c8d2960 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064949 Sep 10 20:52:57.378578 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 707/1399] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:57.420570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a961744-cca5-4c0a-afc8-f1ed79003a3c tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '.version_select at 0x7f9944b99670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:57.434569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a961744-cca5-4c0a-afc8-f1ed79003a3c tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:57.435675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a961744-cca5-4c0a-afc8-f1ed79003a3c tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:57.436632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a961744-cca5-4c0a-afc8-f1ed79003a3c tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:57.461244 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4a961744-cca5-4c0a-afc8-f1ed79003a3c tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3210 microversion: 2.25 time: 0.055338 Sep 10 20:52:57.473553 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 708/1400] 10.222.0.33 () {60 vars in 1184 bytes} [Sat Sep 10 20:52:57 2022] GET /compute/v2.1/os-migrations => generated 3210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:57.478905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e9574ba4-f9b8-4c8a-878c-d2290f278511 tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Calling method '.version_select at 0x7f9944bec3a0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:57.535584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-e9574ba4-f9b8-4c8a-878c-d2290f278511 tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7100882-74d7-4ec3-9833-74b64791dc44 does not exist", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:52:57.536423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.security_group_api [None req-e9574ba4-f9b8-4c8a-878c-d2290f278511 tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Neutron security group a7100882-74d7-4ec3-9833-74b64791dc44 not found {{(pid=145772) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 20:52:57.540812 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e9574ba4-f9b8-4c8a-878c-d2290f278511 tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] HTTP exception thrown: Security group a7100882-74d7-4ec3-9833-74b64791dc44 does not exist Sep 10 20:52:57.540812 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-2dc1e0eb-1d9f-4a32-aa73-48d7819f9964'] Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e9574ba4-f9b8-4c8a-878c-d2290f278511 tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Request method failure captured: Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-security-groups/a7100882-74d7-4ec3-9833-74b64791dc44 HTTP/1.1 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPknYWIUXJJfexhlkybXkHsQz1gtwWZkQiUSpnR1LfThpcAAu_B1tMC76WfWDMw8pU_d_REJT5oUF7HZGOv0wTHY68EKSDPIFzcgT2cFugsO2VNXkFgGgvu3gmqSp3jT6T7iMq2Jk33N9ap94LN-12d6HrBWGF3_Rm8X2P_GkoKCqm4 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 52dc7565b41b48b7a442810f0f21cc01 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52dc7565b41b48b7a442810f0f21cc01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52dc7565b41b48b7a442810f0f21cc01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_52dc7565b41b48b7a442810f0f21cc01", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/52dc7565b41b48b7a442810f0f21cc01"}]}] Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 52dc7565b41b48b7a442810f0f21cc01 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupsNegativeTestJSON-1211447122-project Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: e01d3916c09a484eb3a687ba732162b1 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122-project Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: exception: Security group a7100882-74d7-4ec3-9833-74b64791dc44 does not exist Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-2dc1e0eb-1d9f-4a32-aa73-48d7819f9964'] Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a7100882-74d7-4ec3-9833-74b64791dc44'} Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:52:57.544048 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7100882-74d7-4ec3-9833-74b64791dc44 does not exist Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2dc1e0eb-1d9f-4a32-aa73-48d7819f9964'] Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7100882-74d7-4ec3-9833-74b64791dc44 does not exist Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2dc1e0eb-1d9f-4a32-aa73-48d7819f9964'] Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7100882-74d7-4ec3-9833-74b64791dc44 does not exist Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2dc1e0eb-1d9f-4a32-aa73-48d7819f9964'] Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7100882-74d7-4ec3-9833-74b64791dc44 does not exist Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2dc1e0eb-1d9f-4a32-aa73-48d7819f9964'] Sep 10 20:52:57.548768 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.552997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e9574ba4-f9b8-4c8a-878c-d2290f278511 tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Returning 404 to user: Security group a7100882-74d7-4ec3-9833-74b64791dc44 does not exist Sep 10 20:52:57.552997 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-2dc1e0eb-1d9f-4a32-aa73-48d7819f9964'] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:57.554152 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e9574ba4-f9b8-4c8a-878c-d2290f278511 tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/a7100882-74d7-4ec3-9833-74b64791dc44" status: 404 len: 194 microversion: 2.1 time: 0.079430 Sep 10 20:52:57.555359 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 709/1401] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 20:52:57 2022] GET /compute/v2.1/os-security-groups/a7100882-74d7-4ec3-9833-74b64791dc44 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:57.564908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49e64ad3-101c-4a5a-afb6-eb03c52baaf3 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] Calling method '.version_select at 0x7f9944ce5280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:57.632924 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-40e4c00b-5c6e-4ae3-a30b-7fc33b1d9090 tempest-NetworksTest-1070404131 tempest-NetworksTest-1070404131-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 7432 microversion: 2.1 time: 0.503575 Sep 10 20:52:57.633638 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 693/1402] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:52:57 2022] GET /compute/v2.1/os-networks => generated 7432 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:57.645642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23fcc45c-11ce-47b9-b913-299b7f2b48e0 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:57.646733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23fcc45c-11ce-47b9-b913-299b7f2b48e0 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:57.653944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcc45c-11ce-47b9-b913-299b7f2b48e0 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:57.655329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcc45c-11ce-47b9-b913-299b7f2b48e0 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:57.655944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcc45c-11ce-47b9-b913-299b7f2b48e0 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:57.657217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcc45c-11ce-47b9-b913-299b7f2b48e0 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:57.658017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcc45c-11ce-47b9-b913-299b7f2b48e0 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:57.658556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcc45c-11ce-47b9-b913-299b7f2b48e0 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:57.868639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-23fcc45c-11ce-47b9-b913-299b7f2b48e0 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid 3cd11ff4-6dda-414d-ab81-111f4762df68 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:57.890037 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23fcc45c-11ce-47b9-b913-299b7f2b48e0 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 2421 microversion: 2.25 time: 0.251215 Sep 10 20:52:57.890926 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 694/1403] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:57 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 2421 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:57.919162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3ebaa30-6a76-4077-aa99-ef5586453dfe tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Action: 'update', calling method: .version_select at 0x7f99495b38b0>, body: {"security_group": {"name": "tempest-sg-1527376683", "description": "tempest-description-721521047"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:52:57.966042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-b3ebaa30-6a76-4077-aa99-ef5586453dfe tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f7e1c5b9-990b-4c3a-9640-25a7513c6baa does not exist", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:52:57.975396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.security_group_api [None req-b3ebaa30-6a76-4077-aa99-ef5586453dfe tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Neutron security group f7e1c5b9-990b-4c3a-9640-25a7513c6baa not found {{(pid=145771) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 20:52:57.976361 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-b3ebaa30-6a76-4077-aa99-ef5586453dfe tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] HTTP exception thrown: Security group f7e1c5b9-990b-4c3a-9640-25a7513c6baa does not exist Sep 10 20:52:57.976361 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-23ba70ad-89cb-4b8e-9e47-c1a26f4ac1ba'] Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3ebaa30-6a76-4077-aa99-ef5586453dfe tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Request method failure captured: Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/os-security-groups/f7e1c5b9-990b-4c3a-9640-25a7513c6baa HTTP/1.1 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 101 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPknYWIUXJJfexhlkybXkHsQz1gtwWZkQiUSpnR1LfThpcAAu_B1tMC76WfWDMw8pU_d_REJT5oUF7HZGOv0wTHY68EKSDPIFzcgT2cFugsO2VNXkFgGgvu3gmqSp3jT6T7iMq2Jk33N9ap94LN-12d6HrBWGF3_Rm8X2P_GkoKCqm4 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 52dc7565b41b48b7a442810f0f21cc01 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52dc7565b41b48b7a442810f0f21cc01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52dc7565b41b48b7a442810f0f21cc01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_52dc7565b41b48b7a442810f0f21cc01", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/52dc7565b41b48b7a442810f0f21cc01"}]}] Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 52dc7565b41b48b7a442810f0f21cc01 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupsNegativeTestJSON-1211447122-project Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: e01d3916c09a484eb3a687ba732162b1 Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1211447122-project Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: {"security_group": {"name": "tempest-sg-1527376683", "description": "tempest-description-721521047"}} Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: exception: Security group f7e1c5b9-990b-4c3a-9640-25a7513c6baa does not exist Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-23ba70ad-89cb-4b8e-9e47-c1a26f4ac1ba'] Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'f7e1c5b9-990b-4c3a-9640-25a7513c6baa', 'body': {'security_group': {'name': 'tempest-sg-1527376683', 'description': 'tempest-description-721521047'}}} Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:52:57.988039 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f7e1c5b9-990b-4c3a-9640-25a7513c6baa does not exist Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23ba70ad-89cb-4b8e-9e47-c1a26f4ac1ba'] Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f7e1c5b9-990b-4c3a-9640-25a7513c6baa does not exist Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23ba70ad-89cb-4b8e-9e47-c1a26f4ac1ba'] Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f7e1c5b9-990b-4c3a-9640-25a7513c6baa does not exist Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23ba70ad-89cb-4b8e-9e47-c1a26f4ac1ba'] Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f7e1c5b9-990b-4c3a-9640-25a7513c6baa does not exist Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23ba70ad-89cb-4b8e-9e47-c1a26f4ac1ba'] Sep 10 20:52:57.993698 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:52:57.999798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3ebaa30-6a76-4077-aa99-ef5586453dfe tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] Returning 404 to user: Security group f7e1c5b9-990b-4c3a-9640-25a7513c6baa does not exist Sep 10 20:52:57.999798 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-23ba70ad-89cb-4b8e-9e47-c1a26f4ac1ba'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:52:58.003788 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b3ebaa30-6a76-4077-aa99-ef5586453dfe tempest-SecurityGroupsNegativeTestJSON-1211447122 tempest-SecurityGroupsNegativeTestJSON-1211447122-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/f7e1c5b9-990b-4c3a-9640-25a7513c6baa" status: 404 len: 194 microversion: 2.1 time: 0.111497 Sep 10 20:52:58.005213 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 695/1404] 10.222.0.33 () {60 vars in 1290 bytes} [Sat Sep 10 20:52:57 2022] PUT /compute/v2.1/os-security-groups/f7e1c5b9-990b-4c3a-9640-25a7513c6baa => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:52:58.045943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4b430290-0df9-4667-88e6-4bda385d3f8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:58.049137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4b430290-0df9-4667-88e6-4bda385d3f8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:58.061689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b430290-0df9-4667-88e6-4bda385d3f8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:58.063176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b430290-0df9-4667-88e6-4bda385d3f8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:58.063909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b430290-0df9-4667-88e6-4bda385d3f8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:58.064977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b430290-0df9-4667-88e6-4bda385d3f8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:58.065628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b430290-0df9-4667-88e6-4bda385d3f8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:58.066285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b430290-0df9-4667-88e6-4bda385d3f8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:58.148840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:58.229209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=14 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:52:58.473098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b430290-0df9-4667-88e6-4bda385d3f8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:58.511631 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4b430290-0df9-4667-88e6-4bda385d3f8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1473 microversion: 2.1 time: 0.501496 Sep 10 20:52:58.513449 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 696/1405] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:58 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1473 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:58.529227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-43041892-3c1c-4024-90cc-4b15c8396c66 tempest-NetworksTest-1070404131 tempest-NetworksTest-1070404131-project-admin] Calling method '.version_select at 0x7f99495b3550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:59.035542 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-43041892-3c1c-4024-90cc-4b15c8396c66 tempest-NetworksTest-1070404131 tempest-NetworksTest-1070404131-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks/8579c075-4b43-4770-8663-784dffc99102" status: 200 len: 652 microversion: 2.1 time: 0.510648 Sep 10 20:52:59.036164 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 697/1406] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 20:52:58 2022] GET /compute/v2.1/os-networks/8579c075-4b43-4770-8663-784dffc99102 => generated 652 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:52:59.046838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bc1e65f5-536c-494f-8654-aa09c8938280 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:59.049551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bc1e65f5-536c-494f-8654-aa09c8938280 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:59.059507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc1e65f5-536c-494f-8654-aa09c8938280 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:59.060061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc1e65f5-536c-494f-8654-aa09c8938280 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:59.060779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc1e65f5-536c-494f-8654-aa09c8938280 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:59.061363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc1e65f5-536c-494f-8654-aa09c8938280 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:59.061890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc1e65f5-536c-494f-8654-aa09c8938280 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:59.062336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc1e65f5-536c-494f-8654-aa09c8938280 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:59.084192 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-49e64ad3-101c-4a5a-afb6-eb03c52baaf3 tempest-SecurityGroupRulesNegativeTestJSON-2017514745 tempest-SecurityGroupRulesNegativeTestJSON-2017514745-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/b899014a-0ba7-4f6e-970b-efae76d33f74" status: 202 len: 0 microversion: 2.1 time: 1.527441 Sep 10 20:52:59.089794 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 710/1407] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:52:57 2022] DELETE /compute/v2.1/os-security-groups/b899014a-0ba7-4f6e-970b-efae76d33f74 => generated 0 bytes in 1534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:52:59.095496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ef657c9-cf4c-465a-a342-074fa0769ed7 tempest-NetworksTest-1070404131 tempest-NetworksTest-1070404131-project-admin] Calling method '.version_select at 0x7f9944c42e50>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:59.517571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-bc1e65f5-536c-494f-8654-aa09c8938280 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid 3cd11ff4-6dda-414d-ab81-111f4762df68 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:52:59.549173 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bc1e65f5-536c-494f-8654-aa09c8938280 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 2421 microversion: 2.25 time: 0.507645 Sep 10 20:52:59.549778 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 698/1408] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:52:59 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 2421 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:52:59.563043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-93c666b4-672b-4ae3-a2ea-67697f25d26f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:59.563948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-93c666b4-672b-4ae3-a2ea-67697f25d26f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:59.597239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93c666b4-672b-4ae3-a2ea-67697f25d26f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:59.597743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93c666b4-672b-4ae3-a2ea-67697f25d26f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:59.598209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93c666b4-672b-4ae3-a2ea-67697f25d26f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:59.598940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93c666b4-672b-4ae3-a2ea-67697f25d26f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:59.599408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93c666b4-672b-4ae3-a2ea-67697f25d26f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:59.599841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93c666b4-672b-4ae3-a2ea-67697f25d26f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:59.936836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-93c666b4-672b-4ae3-a2ea-67697f25d26f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:52:59.945079 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-93c666b4-672b-4ae3-a2ea-67697f25d26f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1470 microversion: 2.1 time: 0.389244 Sep 10 20:52:59.945667 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 699/1409] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:52:59 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:52:59.962128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-93497e0f-67c6-40fa-ab6b-57520aab31c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:52:59.962919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-93497e0f-67c6-40fa-ab6b-57520aab31c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:52:59.973630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93497e0f-67c6-40fa-ab6b-57520aab31c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:59.974243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93497e0f-67c6-40fa-ab6b-57520aab31c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:59.974685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93497e0f-67c6-40fa-ab6b-57520aab31c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:59.975400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93497e0f-67c6-40fa-ab6b-57520aab31c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:52:59.976069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93497e0f-67c6-40fa-ab6b-57520aab31c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:52:59.976504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93497e0f-67c6-40fa-ab6b-57520aab31c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:52:59.994047 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ef657c9-cf4c-465a-a342-074fa0769ed7 tempest-NetworksTest-1070404131 tempest-NetworksTest-1070404131-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 7432 microversion: 2.1 time: 0.902758 Sep 10 20:52:59.994838 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 711/1410] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:52:59 2022] GET /compute/v2.1/os-networks => generated 7432 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:00.001418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cc88efc6-67ab-4d78-9721-be46e833399e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:00.002858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cc88efc6-67ab-4d78-9721-be46e833399e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:00.018229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc88efc6-67ab-4d78-9721-be46e833399e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:00.021946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc88efc6-67ab-4d78-9721-be46e833399e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:00.023971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc88efc6-67ab-4d78-9721-be46e833399e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:00.024908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc88efc6-67ab-4d78-9721-be46e833399e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:00.027853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc88efc6-67ab-4d78-9721-be46e833399e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:00.028507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc88efc6-67ab-4d78-9721-be46e833399e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:00.041917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:00.182915 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cc88efc6-67ab-4d78-9721-be46e833399e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469/action" status: 204 len: 0 microversion: 2.1 time: 0.186758 Sep 10 20:53:00.185139 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 712/1411] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:52:59 2022] POST /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469/action => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:53:00.198852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-25533c82-8dd8-4fa7-b23a-eca1f8e312dc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:00.200296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-25533c82-8dd8-4fa7-b23a-eca1f8e312dc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:00.214399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25533c82-8dd8-4fa7-b23a-eca1f8e312dc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:00.217639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25533c82-8dd8-4fa7-b23a-eca1f8e312dc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:00.218132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25533c82-8dd8-4fa7-b23a-eca1f8e312dc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:00.219644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25533c82-8dd8-4fa7-b23a-eca1f8e312dc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:00.220561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25533c82-8dd8-4fa7-b23a-eca1f8e312dc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:00.221185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25533c82-8dd8-4fa7-b23a-eca1f8e312dc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:00.311968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-93497e0f-67c6-40fa-ab6b-57520aab31c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lazy-loading 'services' on Instance uuid 3cd11ff4-6dda-414d-ab81-111f4762df68 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:53:00.643088 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-93497e0f-67c6-40fa-ab6b-57520aab31c0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-volume_attachments/96406eb1-c093-4aac-ac54-ad8adc9b782e" status: 202 len: 0 microversion: 2.25 time: 0.695965 Sep 10 20:53:00.643895 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 700/1412] 10.222.0.33 () {60 vars in 1457 bytes} [Sat Sep 10 20:52:59 2022] DELETE /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-volume_attachments/96406eb1-c093-4aac-ac54-ad8adc9b782e => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:53:00.654169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da56d725-ddb4-4947-9e73-221f912e6150 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:00.660257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da56d725-ddb4-4947-9e73-221f912e6150 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:00.677053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da56d725-ddb4-4947-9e73-221f912e6150 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:00.677769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da56d725-ddb4-4947-9e73-221f912e6150 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:00.678273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da56d725-ddb4-4947-9e73-221f912e6150 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:00.678991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da56d725-ddb4-4947-9e73-221f912e6150 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:00.679450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da56d725-ddb4-4947-9e73-221f912e6150 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:00.679876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da56d725-ddb4-4947-9e73-221f912e6150 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:00.782638 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da56d725-ddb4-4947-9e73-221f912e6150 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.130908 Sep 10 20:53:00.789269 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 701/1413] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Sep 10 20:53:00 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 20:53:00.984673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-25533c82-8dd8-4fa7-b23a-eca1f8e312dc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:01.004496 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-25533c82-8dd8-4fa7-b23a-eca1f8e312dc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1470 microversion: 2.1 time: 0.813246 Sep 10 20:53:01.005103 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 713/1414] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:00 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1470 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:53:01.799531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-414b72a6-1ab2-4a0e-a37e-5da62b5e1225 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:01.805504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-414b72a6-1ab2-4a0e-a37e-5da62b5e1225 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:01.823948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-414b72a6-1ab2-4a0e-a37e-5da62b5e1225 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:01.824446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-414b72a6-1ab2-4a0e-a37e-5da62b5e1225 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:01.824874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-414b72a6-1ab2-4a0e-a37e-5da62b5e1225 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:01.825950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-414b72a6-1ab2-4a0e-a37e-5da62b5e1225 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:01.826653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-414b72a6-1ab2-4a0e-a37e-5da62b5e1225 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:01.827310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-414b72a6-1ab2-4a0e-a37e-5da62b5e1225 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:01.875436 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-414b72a6-1ab2-4a0e-a37e-5da62b5e1225 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082661 Sep 10 20:53:01.881719 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 702/1415] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Sep 10 20:53:01 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:53:02.030494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c6597874-9a55-4260-b025-5bfbfb92ce6d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:02.031276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c6597874-9a55-4260-b025-5bfbfb92ce6d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:02.047722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6597874-9a55-4260-b025-5bfbfb92ce6d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:02.054935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6597874-9a55-4260-b025-5bfbfb92ce6d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:02.055695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6597874-9a55-4260-b025-5bfbfb92ce6d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:02.059450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6597874-9a55-4260-b025-5bfbfb92ce6d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:02.061541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6597874-9a55-4260-b025-5bfbfb92ce6d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:02.064676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6597874-9a55-4260-b025-5bfbfb92ce6d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:02.781673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c6597874-9a55-4260-b025-5bfbfb92ce6d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:02.792747 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c6597874-9a55-4260-b025-5bfbfb92ce6d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1470 microversion: 2.1 time: 0.766067 Sep 10 20:53:02.796300 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 714/1416] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:02 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1470 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:02.889154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a8f6dc79-3362-4473-a310-1831a2de5c0e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:02.892927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a8f6dc79-3362-4473-a310-1831a2de5c0e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:02.909656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8f6dc79-3362-4473-a310-1831a2de5c0e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:02.911877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8f6dc79-3362-4473-a310-1831a2de5c0e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:02.914550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8f6dc79-3362-4473-a310-1831a2de5c0e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:02.915330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8f6dc79-3362-4473-a310-1831a2de5c0e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:02.915991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8f6dc79-3362-4473-a310-1831a2de5c0e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:02.918749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8f6dc79-3362-4473-a310-1831a2de5c0e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:02.998942 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a8f6dc79-3362-4473-a310-1831a2de5c0e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.114160 Sep 10 20:53:03.000631 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 703/1417] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Sep 10 20:53:02 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:03.603176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4189b8ac-9af8-4926-b17d-7005dcaaad9e req-c05460f5-66fd-4676-b93c-58dc152c503f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435d0526-f990-4ec6-b38f-13aa30486469", "name": "network-vif-plugged", "status": "completed", "tag": "bfa95032-3491-453d-9ca4-83b61c66730d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:03.623321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4189b8ac-9af8-4926-b17d-7005dcaaad9e req-c05460f5-66fd-4676-b93c-58dc152c503f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:03.623809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4189b8ac-9af8-4926-b17d-7005dcaaad9e req-c05460f5-66fd-4676-b93c-58dc152c503f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:03.624235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4189b8ac-9af8-4926-b17d-7005dcaaad9e req-c05460f5-66fd-4676-b93c-58dc152c503f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:03.644838 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4189b8ac-9af8-4926-b17d-7005dcaaad9e req-c05460f5-66fd-4676-b93c-58dc152c503f service nova] Creating event network-vif-plugged:bfa95032-3491-453d-9ca4-83b61c66730d for instance 435d0526-f990-4ec6-b38f-13aa30486469 on nch2-master-1 Sep 10 20:53:03.651106 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4189b8ac-9af8-4926-b17d-7005dcaaad9e req-c05460f5-66fd-4676-b93c-58dc152c503f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051973 Sep 10 20:53:03.652374 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 715/1418] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:03.818700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-540759a4-b095-48aa-9439-e3ad540f44ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:03.820314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-540759a4-b095-48aa-9439-e3ad540f44ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:03.836932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-540759a4-b095-48aa-9439-e3ad540f44ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:03.840108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-540759a4-b095-48aa-9439-e3ad540f44ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:03.841343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-540759a4-b095-48aa-9439-e3ad540f44ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:03.846085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-540759a4-b095-48aa-9439-e3ad540f44ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:03.847881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-540759a4-b095-48aa-9439-e3ad540f44ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:03.852719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-540759a4-b095-48aa-9439-e3ad540f44ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:04.372502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-540759a4-b095-48aa-9439-e3ad540f44ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:04.388257 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-540759a4-b095-48aa-9439-e3ad540f44ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1462 microversion: 2.1 time: 0.573961 Sep 10 20:53:04.395904 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 704/1419] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:03 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1462 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:04.416952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-89d6f5b2-9440-4373-b678-0aae3fd59b76 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:04.418753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-89d6f5b2-9440-4373-b678-0aae3fd59b76 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:04.436209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d6f5b2-9440-4373-b678-0aae3fd59b76 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:04.437159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d6f5b2-9440-4373-b678-0aae3fd59b76 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:04.438453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d6f5b2-9440-4373-b678-0aae3fd59b76 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:04.439368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d6f5b2-9440-4373-b678-0aae3fd59b76 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:04.440173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d6f5b2-9440-4373-b678-0aae3fd59b76 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:04.441064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d6f5b2-9440-4373-b678-0aae3fd59b76 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:05.110598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-89d6f5b2-9440-4373-b678-0aae3fd59b76 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:05.120586 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-89d6f5b2-9440-4373-b678-0aae3fd59b76 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1462 microversion: 2.1 time: 0.708534 Sep 10 20:53:05.122652 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 716/1420] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:04 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1462 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:05.152810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ddcb506b-e4cd-4a31-8d8e-05c8757b6dce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'create', calling method: .version_select at 0x7f994963a310>, body: {"keypair": {"name": "tempest-keypair-409619840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgXLSRx4sBLmWgXr5bO+bpFQrKB/mcxsjx5kDMHESDahiLQcE6RNOAoeLgT/eqTqvoFA11lBhXZcgzEvrzox1OggVi4bnwlpqo6N988/DrkgJudgmvJ2mFX/dgkl6cpJg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:05.202310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-ddcb506b-e4cd-4a31-8d8e-05c8757b6dce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for project d969d135196e409584d6647d5186c9c9. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:05.220872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-ddcb506b-e4cd-4a31-8d8e-05c8757b6dce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for user 870c4c66a15b4546bd981cfb5932b214 and project d969d135196e409584d6647d5186c9c9. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:05.292234 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ddcb506b-e4cd-4a31-8d8e-05c8757b6dce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144479 Sep 10 20:53:05.301625 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 705/1421] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:53:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:08.309585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-02e0bb1c-96a2-4f0d-bb08-b41911537978 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '.version_select at 0x7f9944c42c10>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:08.319215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02e0bb1c-96a2-4f0d-bb08-b41911537978 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:08.341961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02e0bb1c-96a2-4f0d-bb08-b41911537978 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:08.347438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02e0bb1c-96a2-4f0d-bb08-b41911537978 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:08.368975 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-02e0bb1c-96a2-4f0d-bb08-b41911537978 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2722 microversion: 2.1 time: 0.062546 Sep 10 20:53:08.381028 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 717/1422] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:53:08 2022] GET /compute/v2.1/os-migrations => generated 2722 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:08.395082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-874520a4-be13-43c3-a7c0-cddc66933d05 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:08.403182 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-874520a4-be13-43c3-a7c0-cddc66933d05 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015357 Sep 10 20:53:08.414991 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 718/1423] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:53:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:53:08.425485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4fb68bbf-0143-4bbd-a569-1a1dec1ca647 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-613187226", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:08.480101 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4fb68bbf-0143-4bbd-a569-1a1dec1ca647 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.062315 Sep 10 20:53:08.490603 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 719/1424] 10.222.0.33 () {60 vars in 1146 bytes} [Sat Sep 10 20:53:08 2022] POST /compute/v2.1/flavors => generated 498 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:08.497202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d441c85d-a4b2-471c-b672-6fab9ea336f6 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:08.514725 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d441c85d-a4b2-471c-b672-6fab9ea336f6 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022568 Sep 10 20:53:08.515741 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 720/1425] 10.222.0.33 () {58 vars in 1182 bytes} [Sat Sep 10 20:53:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:53:08.587896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54df645b-d856-4635-aef8-cc7c4fc7c331 tempest-QuotaClassesAdminTestJSON-2139397870 tempest-QuotaClassesAdminTestJSON-2139397870-project-admin] Calling method '.version_select at 0x7f9944bde9d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:08.653637 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-54df645b-d856-4635-aef8-cc7c4fc7c331 tempest-QuotaClassesAdminTestJSON-2139397870 tempest-QuotaClassesAdminTestJSON-2139397870-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.327534 Sep 10 20:53:08.656120 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 706/1426] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Sep 10 20:53:08 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:08.670066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3b31d29e-dc35-4866-a39f-0065f2eafbc0 tempest-QuotaClassesAdminTestJSON-2139397870 tempest-QuotaClassesAdminTestJSON-2139397870-project-admin] Action: 'update', calling method: .version_select at 0x7f9944bec430>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:08.778596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1781113397", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "b6427c66-823f-473f-b054-dee292c3092e"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:08.902167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:53:09.242846 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3b31d29e-dc35-4866-a39f-0065f2eafbc0 tempest-QuotaClassesAdminTestJSON-2139397870 tempest-QuotaClassesAdminTestJSON-2139397870-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.577413 Sep 10 20:53:09.244714 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 721/1427] 10.222.0.33 () {60 vars in 1206 bytes} [Sat Sep 10 20:53:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:09.264002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4afa588d-4cc6-42a3-8cce-6f9400215061 tempest-QuotaClassesAdminTestJSON-2139397870 tempest-QuotaClassesAdminTestJSON-2139397870-project-admin] Calling method '.version_select at 0x7f9944b99550>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:09.284918 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4afa588d-4cc6-42a3-8cce-6f9400215061 tempest-QuotaClassesAdminTestJSON-2139397870 tempest-QuotaClassesAdminTestJSON-2139397870-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.030515 Sep 10 20:53:09.285796 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 722/1428] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Sep 10 20:53:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:09.299174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-14c12be9-f16d-4cd7-a439-72f8f89341e4 tempest-QuotaClassesAdminTestJSON-2139397870 tempest-QuotaClassesAdminTestJSON-2139397870-project-admin] Action: 'update', calling method: .version_select at 0x7f9944c42af0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:09.525661 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-14c12be9-f16d-4cd7-a439-72f8f89341e4 tempest-QuotaClassesAdminTestJSON-2139397870 tempest-QuotaClassesAdminTestJSON-2139397870-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.230540 Sep 10 20:53:09.537607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:53:09.538315 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 723/1429] 10.222.0.33 () {60 vars in 1206 bytes} [Sat Sep 10 20:53:09 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:09.541957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:53:09.542516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:53:09.542944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:53:09.543391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:53:09.565227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:09.567597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:09.570591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:09.572547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:09.575406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:09.576529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:09.647381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for project d969d135196e409584d6647d5186c9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:09.660568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for user 870c4c66a15b4546bd981cfb5932b214 and project d969d135196e409584d6647d5186c9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:09.683640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:53:09.686842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:53:09.788235 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cf47d08e-b591-4946-be5b-cf6bedfd05b9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015011 Sep 10 20:53:09.799356 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 707/1430] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:53:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:53:09.808983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c93efb5-25e6-4fd6-b467-feb4af8f74a0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:09.810563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9c93efb5-25e6-4fd6-b467-feb4af8f74a0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:09.838305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=8,nova_api:UPDATE=24 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:11.270197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c93efb5-25e6-4fd6-b467-feb4af8f74a0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:11.279674 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c93efb5-25e6-4fd6-b467-feb4af8f74a0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1279 microversion: 2.1 time: 1.481945 Sep 10 20:53:11.305771 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 724/1431] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:09 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1279 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:12.308768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-307a895e-dd96-40c3-9b8e-a031d88da1ee tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:12.309349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-307a895e-dd96-40c3-9b8e-a031d88da1ee tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:12.326913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-307a895e-dd96-40c3-9b8e-a031d88da1ee tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:12.328250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-307a895e-dd96-40c3-9b8e-a031d88da1ee tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:12.328860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-307a895e-dd96-40c3-9b8e-a031d88da1ee tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:12.329747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-307a895e-dd96-40c3-9b8e-a031d88da1ee tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:12.330387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-307a895e-dd96-40c3-9b8e-a031d88da1ee tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:12.331068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-307a895e-dd96-40c3-9b8e-a031d88da1ee tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:13.035167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-307a895e-dd96-40c3-9b8e-a031d88da1ee tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:13.049809 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-307a895e-dd96-40c3-9b8e-a031d88da1ee tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1331 microversion: 2.1 time: 0.748309 Sep 10 20:53:13.081871 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 708/1432] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:12 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1331 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:14.082463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-37a25aea-f55a-4f01-8898-aa0907a60ba7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:14.083189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-37a25aea-f55a-4f01-8898-aa0907a60ba7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:14.099673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37a25aea-f55a-4f01-8898-aa0907a60ba7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:14.118542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e7031adc-7d2f-4f03-aac6-244aeeff4097 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Action: 'create', calling method: .version_select at 0x7f994510b9d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1263505002", "policies": ["affinity"]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:14.122595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37a25aea-f55a-4f01-8898-aa0907a60ba7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:14.124789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37a25aea-f55a-4f01-8898-aa0907a60ba7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:14.127215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37a25aea-f55a-4f01-8898-aa0907a60ba7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:14.128354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37a25aea-f55a-4f01-8898-aa0907a60ba7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:14.129564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37a25aea-f55a-4f01-8898-aa0907a60ba7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:14.184539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e7031adc-7d2f-4f03-aac6-244aeeff4097 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:14.218545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e7031adc-7d2f-4f03-aac6-244aeeff4097 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:14.329554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-37a25aea-f55a-4f01-8898-aa0907a60ba7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:14.349739 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-37a25aea-f55a-4f01-8898-aa0907a60ba7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1337 microversion: 2.1 time: 0.269800 Sep 10 20:53:14.374038 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 709/1433] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:14 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1337 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:14.417999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e7031adc-7d2f-4f03-aac6-244aeeff4097 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:14.432379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e7031adc-7d2f-4f03-aac6-244aeeff4097 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:14.468713 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e7031adc-7d2f-4f03-aac6-244aeeff4097 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.758773 Sep 10 20:53:14.469571 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 725/1434] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Sep 10 20:53:13 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:14.484368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-83df89ec-bb7c-47b1-b338-41f7c77aa698 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Action: 'create', calling method: .version_select at 0x7f9944c90700>, body: {"server_group": {"name": "tempest-server-group-525691797", "policies": ["affinity"]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:14.539897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-83df89ec-bb7c-47b1-b338-41f7c77aa698 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:14.561804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-83df89ec-bb7c-47b1-b338-41f7c77aa698 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:14.665510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-83df89ec-bb7c-47b1-b338-41f7c77aa698 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:14.672949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-83df89ec-bb7c-47b1-b338-41f7c77aa698 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:14.692104 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-83df89ec-bb7c-47b1-b338-41f7c77aa698 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.214136 Sep 10 20:53:14.694649 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 710/1435] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Sep 10 20:53:14 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:14.709935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62233601-8f5d-42c4-842a-e144060e7478 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Action: 'create', calling method: .version_select at 0x7f994510bc10>, body: {"server_group": {"name": "tempest-server-group-525691797", "policies": ["affinity"]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:14.745545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-62233601-8f5d-42c4-842a-e144060e7478 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:14.753642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-62233601-8f5d-42c4-842a-e144060e7478 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:14.857709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-62233601-8f5d-42c4-842a-e144060e7478 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:14.887064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-62233601-8f5d-42c4-842a-e144060e7478 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:14.936635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-62233601-8f5d-42c4-842a-e144060e7478 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.234457 Sep 10 20:53:14.946227 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 726/1436] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Sep 10 20:53:14 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:14.949353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ef04e7d5-a02c-4fff-b88e-716c1f1c2ac7 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:15.058090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:15.068223 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ef04e7d5-a02c-4fff-b88e-716c1f1c2ac7 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/79e8252a-1ceb-459e-a88c-93aea97d73e7" status: 204 len: 0 microversion: 2.1 time: 0.123662 Sep 10 20:53:15.069876 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 711/1437] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 20:53:14 2022] DELETE /compute/v2.1/os-server-groups/79e8252a-1ceb-459e-a88c-93aea97d73e7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 20:53:15.091284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e29c3beb-87df-4c44-a2ad-f4f3334f4d3a tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:15.143096 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e29c3beb-87df-4c44-a2ad-f4f3334f4d3a tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.069366 Sep 10 20:53:15.145750 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 727/1438] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:53:15 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:15.164052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c8af3b78-fd29-473a-a31c-1ec268c987be tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:15.241359 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c8af3b78-fd29-473a-a31c-1ec268c987be tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/dc0e8282-ef8f-4a13-8890-3c25314de85a" status: 204 len: 0 microversion: 2.1 time: 0.087872 Sep 10 20:53:15.247306 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 712/1439] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 20:53:15 2022] DELETE /compute/v2.1/os-server-groups/dc0e8282-ef8f-4a13-8890-3c25314de85a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:53:15.256511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b45f5ba7-9ae6-43ba-a00c-69d2f5536e20 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:15.289969 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b45f5ba7-9ae6-43ba-a00c-69d2f5536e20 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030571 Sep 10 20:53:15.292510 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 728/1440] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:53:15 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:15.305763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-761f8ced-e97d-42aa-b39c-f7ccc4be4339 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Action: 'create', calling method: .version_select at 0x7f9944bc1dc0>, body: {"server_group": {"name": "tempest-server-group-646259780", "policies": ["affinity"]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:15.361860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-761f8ced-e97d-42aa-b39c-f7ccc4be4339 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:15.378571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-761f8ced-e97d-42aa-b39c-f7ccc4be4339 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:15.387265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0b7ade4e-cac1-441a-a888-a5b4cae80aba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:15.388176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0b7ade4e-cac1-441a-a888-a5b4cae80aba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:15.404785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b7ade4e-cac1-441a-a888-a5b4cae80aba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:15.408487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b7ade4e-cac1-441a-a888-a5b4cae80aba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:15.409169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b7ade4e-cac1-441a-a888-a5b4cae80aba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:15.410768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b7ade4e-cac1-441a-a888-a5b4cae80aba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:15.416281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b7ade4e-cac1-441a-a888-a5b4cae80aba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:15.416735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b7ade4e-cac1-441a-a888-a5b4cae80aba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:15.555127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-761f8ced-e97d-42aa-b39c-f7ccc4be4339 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:15.566571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-761f8ced-e97d-42aa-b39c-f7ccc4be4339 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:15.606394 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-761f8ced-e97d-42aa-b39c-f7ccc4be4339 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.305170 Sep 10 20:53:15.609403 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 713/1441] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Sep 10 20:53:15 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:15.625686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f4dea9b1-b1fa-477d-a5b1-f16990ae244f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:15.683576 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f4dea9b1-b1fa-477d-a5b1-f16990ae244f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/e2c28b6a-5db2-41a5-b9d9-7d5bae70fada" status: 204 len: 0 microversion: 2.1 time: 0.069237 Sep 10 20:53:15.684177 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 714/1442] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 20:53:15 2022] DELETE /compute/v2.1/os-server-groups/e2c28b6a-5db2-41a5-b9d9-7d5bae70fada => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:53:15.693408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d45a82f-c77e-4d26-9e2f-bb014f09387b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:15.715614 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d45a82f-c77e-4d26-9e2f-bb014f09387b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.025844 Sep 10 20:53:15.716940 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 715/1443] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:53:15 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:15.734766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c74705ca-2daa-4175-8f80-15b869369e99 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Action: 'create', calling method: .version_select at 0x7f99495b3af0>, body: {"server_group": {"name": "tempest-server-group-744025293", "policies": ["anti-affinity"]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:15.769592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c74705ca-2daa-4175-8f80-15b869369e99 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:15.777118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c74705ca-2daa-4175-8f80-15b869369e99 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:15.880232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0b7ade4e-cac1-441a-a888-a5b4cae80aba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:15.887093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c74705ca-2daa-4175-8f80-15b869369e99 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:15.892596 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0b7ade4e-cac1-441a-a888-a5b4cae80aba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1379 microversion: 2.1 time: 0.510264 Sep 10 20:53:15.893851 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 729/1444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:15 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1379 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:53:15.907928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c74705ca-2daa-4175-8f80-15b869369e99 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:15.924920 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c74705ca-2daa-4175-8f80-15b869369e99 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.194579 Sep 10 20:53:15.926172 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 716/1445] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Sep 10 20:53:15 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:15.940729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5247ae5c-555d-4924-a8b4-3fb83bf72226 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:16.037137 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5247ae5c-555d-4924-a8b4-3fb83bf72226 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c" status: 204 len: 0 microversion: 2.1 time: 0.104101 Sep 10 20:53:16.038416 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 730/1446] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 20:53:15 2022] DELETE /compute/v2.1/os-server-groups/86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:53:16.051067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8fdf0e8b-1d45-471f-8fbf-1289111a2339 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:16.089766 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8fdf0e8b-1d45-471f-8fbf-1289111a2339 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.044330 Sep 10 20:53:16.091011 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 717/1447] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:53:16 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:53:16.307139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1776749868", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "b7e0c299-04ac-420b-a3b9-251ef9af2a6f"}]}, "os:scheduler_hints": {"group": "b228a6fe-9b25-4557-9d54-f7e24326ab58"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:16.399380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] validate_networks() for [('b7e0c299-04ac-420b-a3b9-251ef9af2a6f', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:53:16.796630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a985a724-cca6-4fd5-9af5-7db217795445 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Action: 'create', calling method: .version_select at 0x7f9944ca5e50>, body: {"pool": null} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:18.195793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:53:18.196324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:53:18.196679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:53:18.197082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:53:18.197849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:53:18.228964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:18.230385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:18.230992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:18.232080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:18.242605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:18.243057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:18.278324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:18.309379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:18.340220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:53:18.345360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:53:18.452952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=145771) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 10 20:53:18.472270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=7 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:18.504713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_group_members'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:18.526179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_group_members'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:18.636324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_group_members'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:18.649614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Getting quotas for user 5053eb274d2c4e8180aa1cbcb680a94f and project a45a58e14da346efbb24a4bfed8b0b69. Resources: {'server_group_members'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:18.722656 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f1068a89-ee1c-4a89-92c0-f260c6873df5 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.427441 Sep 10 20:53:18.728323 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 718/1448] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:53:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 20:53:19.404898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4d4b3794-06a4-4d13-b4a6-e2705b93526b tempest-SecurityGroupsTestAdminJSON-988328549 tempest-SecurityGroupsTestAdminJSON-988328549-project] Action: 'create', calling method: .version_select at 0x7f9944c06a60>, body: {"security_group": {"name": "tempest-securitygroup-1789520396", "description": "tempest-description-1392270791"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:20.441033 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a985a724-cca6-4fd5-9af5-7db217795445 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.287759 Sep 10 20:53:20.446313 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 731/1449] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 20:53:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:20.454254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-446e9f98-6a17-409b-80af-90afb5edab3e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:20.454874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-446e9f98-6a17-409b-80af-90afb5edab3e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:20.492217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-446e9f98-6a17-409b-80af-90afb5edab3e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:20.496305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-446e9f98-6a17-409b-80af-90afb5edab3e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:20.500585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-446e9f98-6a17-409b-80af-90afb5edab3e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:20.505242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-446e9f98-6a17-409b-80af-90afb5edab3e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:20.509186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-446e9f98-6a17-409b-80af-90afb5edab3e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:20.510490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-446e9f98-6a17-409b-80af-90afb5edab3e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:20.831425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-446e9f98-6a17-409b-80af-90afb5edab3e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:20.860877 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-446e9f98-6a17-409b-80af-90afb5edab3e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1379 microversion: 2.1 time: 0.413316 Sep 10 20:53:20.864731 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 732/1450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:20 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1379 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:20.886891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5bfe8051-7d30-4e90-854a-9cc48be36e8b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:20.888713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5bfe8051-7d30-4e90-854a-9cc48be36e8b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:20.914968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bfe8051-7d30-4e90-854a-9cc48be36e8b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:20.915524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bfe8051-7d30-4e90-854a-9cc48be36e8b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:20.915967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bfe8051-7d30-4e90-854a-9cc48be36e8b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:20.917228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bfe8051-7d30-4e90-854a-9cc48be36e8b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:20.918173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bfe8051-7d30-4e90-854a-9cc48be36e8b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:20.920014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bfe8051-7d30-4e90-854a-9cc48be36e8b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:21.110985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5bfe8051-7d30-4e90-854a-9cc48be36e8b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:21.126657 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5bfe8051-7d30-4e90-854a-9cc48be36e8b tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1265 microversion: 2.1 time: 0.260321 Sep 10 20:53:21.129709 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 733/1451] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:20 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:21.184906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-06a06529-14bd-4213-8622-0d69ab62e9db req-77853ac8-4db0-4bc5-ae54-7bb0a7876578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e1970c-5740-4466-911f-5aef17b7336e", "tag": "fd86c8ba-198f-490e-a5da-475f9082b557"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:21.216695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-06a06529-14bd-4213-8622-0d69ab62e9db req-77853ac8-4db0-4bc5-ae54-7bb0a7876578 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:21.217184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-06a06529-14bd-4213-8622-0d69ab62e9db req-77853ac8-4db0-4bc5-ae54-7bb0a7876578 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:21.219032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-06a06529-14bd-4213-8622-0d69ab62e9db req-77853ac8-4db0-4bc5-ae54-7bb0a7876578 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:21.248999 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-06a06529-14bd-4213-8622-0d69ab62e9db req-77853ac8-4db0-4bc5-ae54-7bb0a7876578 service nova] Creating event network-changed:fd86c8ba-198f-490e-a5da-475f9082b557 for instance a4e1970c-5740-4466-911f-5aef17b7336e on nch2-master-1 Sep 10 20:53:21.256934 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-06a06529-14bd-4213-8622-0d69ab62e9db req-77853ac8-4db0-4bc5-ae54-7bb0a7876578 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125359 Sep 10 20:53:21.258256 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 734/1452] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:21.265575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62425d74-21bf-4a46-92b0-2e22940fbff0 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Action: 'create', calling method: .version_select at 0x7f99452494c0>, body: {"pool": null} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:22.130431 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4d4b3794-06a4-4d13-b4a6-e2705b93526b tempest-SecurityGroupsTestAdminJSON-988328549 tempest-SecurityGroupsTestAdminJSON-988328549-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 3.400749 Sep 10 20:53:22.131027 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 719/1453] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:53:18 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 3402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:22.135591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b2994853-3eec-44f8-9306-9de282073c68 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:22.136232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b2994853-3eec-44f8-9306-9de282073c68 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:22.149515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2994853-3eec-44f8-9306-9de282073c68 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:22.150330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2994853-3eec-44f8-9306-9de282073c68 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:22.150939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2994853-3eec-44f8-9306-9de282073c68 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:22.152279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2994853-3eec-44f8-9306-9de282073c68 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:22.153092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2994853-3eec-44f8-9306-9de282073c68 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:22.153786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2994853-3eec-44f8-9306-9de282073c68 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:23.372629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b2994853-3eec-44f8-9306-9de282073c68 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:23.387289 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b2994853-3eec-44f8-9306-9de282073c68 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1379 microversion: 2.1 time: 1.255111 Sep 10 20:53:23.388252 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 720/1454] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:22 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1379 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:23.399519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c600263-9cea-444e-bb9c-8f85dad050ce tempest-SecurityGroupsTestAdminJSON-988328549 tempest-SecurityGroupsTestAdminJSON-988328549-project] Action: 'create', calling method: .version_select at 0x7f99495b3670>, body: {"security_group": {"name": "tempest-securitygroup-66331597", "description": "tempest-description-1092233074"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:23.854325 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c600263-9cea-444e-bb9c-8f85dad050ce tempest-SecurityGroupsTestAdminJSON-988328549 tempest-SecurityGroupsTestAdminJSON-988328549-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.462624 Sep 10 20:53:23.855442 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 721/1455] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:53:23 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:23.869255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ed1c4097-49a7-4847-84b8-af0bc98c5329 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:23.869928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ed1c4097-49a7-4847-84b8-af0bc98c5329 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:23.878830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed1c4097-49a7-4847-84b8-af0bc98c5329 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:23.879617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed1c4097-49a7-4847-84b8-af0bc98c5329 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:23.880307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed1c4097-49a7-4847-84b8-af0bc98c5329 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:23.881275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed1c4097-49a7-4847-84b8-af0bc98c5329 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:23.882012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed1c4097-49a7-4847-84b8-af0bc98c5329 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:23.882673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed1c4097-49a7-4847-84b8-af0bc98c5329 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:24.252530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed1c4097-49a7-4847-84b8-af0bc98c5329 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:24.259488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:24.273808 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ed1c4097-49a7-4847-84b8-af0bc98c5329 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1313 microversion: 2.1 time: 0.416177 Sep 10 20:53:24.276513 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 722/1456] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:23 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:24.676324 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-62425d74-21bf-4a46-92b0-2e22940fbff0 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.416239 Sep 10 20:53:24.678202 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 735/1457] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 20:53:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:24.685454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-78968c1f-e7db-4552-a287-5e5827070359 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:24.705433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-78968c1f-e7db-4552-a287-5e5827070359 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:24.718678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-063e8d9d-ad8e-44f9-b0c0-0f8225ab5160 tempest-SecurityGroupsTestAdminJSON-1239627237 tempest-SecurityGroupsTestAdminJSON-1239627237-project-admin] Action: 'create', calling method: .version_select at 0x7f994963a820>, body: {"security_group": {"name": "tempest-securitygroup-1819666191", "description": "tempest-description-1756901158"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:24.733906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78968c1f-e7db-4552-a287-5e5827070359 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:24.734460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78968c1f-e7db-4552-a287-5e5827070359 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:24.734900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78968c1f-e7db-4552-a287-5e5827070359 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:24.741717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78968c1f-e7db-4552-a287-5e5827070359 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:24.743576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78968c1f-e7db-4552-a287-5e5827070359 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:24.744033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78968c1f-e7db-4552-a287-5e5827070359 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:24.921898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=45,nova_cell0:UPDATE=7 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:25.095379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-78968c1f-e7db-4552-a287-5e5827070359 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:25.113615 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-78968c1f-e7db-4552-a287-5e5827070359 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1379 microversion: 2.1 time: 0.432358 Sep 10 20:53:25.115845 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 736/1458] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:24 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1379 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:25.135845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc01f207-b230-4670-9dc7-d1ce872d2b6c tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Action: 'create', calling method: .version_select at 0x7f99450148b0>, body: {"pool": null} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:26.053131 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-063e8d9d-ad8e-44f9-b0c0-0f8225ab5160 tempest-SecurityGroupsTestAdminJSON-1239627237 tempest-SecurityGroupsTestAdminJSON-1239627237-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.775209 Sep 10 20:53:26.053743 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 723/1459] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:53:24 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:26.066742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-84afa3c3-a6a5-4996-b22e-e850e3d9cf78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:26.067409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-84afa3c3-a6a5-4996-b22e-e850e3d9cf78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:26.090045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84afa3c3-a6a5-4996-b22e-e850e3d9cf78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:26.090555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84afa3c3-a6a5-4996-b22e-e850e3d9cf78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:26.091002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84afa3c3-a6a5-4996-b22e-e850e3d9cf78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:26.091740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84afa3c3-a6a5-4996-b22e-e850e3d9cf78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:26.092208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84afa3c3-a6a5-4996-b22e-e850e3d9cf78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:26.092647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84afa3c3-a6a5-4996-b22e-e850e3d9cf78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:26.396942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-84afa3c3-a6a5-4996-b22e-e850e3d9cf78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:26.410518 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-84afa3c3-a6a5-4996-b22e-e850e3d9cf78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1313 microversion: 2.1 time: 0.346656 Sep 10 20:53:26.432811 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 724/1460] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:26 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:26.569326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f61e738c-6b20-4e01-9e66-21ce70b67370 req-5b5c15be-f802-4931-bb7f-5f4da67217c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d6f03e6-d257-478e-b3bb-1dcde947e5d2", "tag": "81ac6655-8d7d-4510-ad0e-703a1d79c2d5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:26.585646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f61e738c-6b20-4e01-9e66-21ce70b67370 req-5b5c15be-f802-4931-bb7f-5f4da67217c7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:26.592246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f61e738c-6b20-4e01-9e66-21ce70b67370 req-5b5c15be-f802-4931-bb7f-5f4da67217c7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:26.592999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f61e738c-6b20-4e01-9e66-21ce70b67370 req-5b5c15be-f802-4931-bb7f-5f4da67217c7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:26.619687 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f61e738c-6b20-4e01-9e66-21ce70b67370 req-5b5c15be-f802-4931-bb7f-5f4da67217c7 service nova] Creating event network-changed:81ac6655-8d7d-4510-ad0e-703a1d79c2d5 for instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 on nch1-master-1 Sep 10 20:53:26.635435 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f61e738c-6b20-4e01-9e66-21ce70b67370 req-5b5c15be-f802-4931-bb7f-5f4da67217c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197115 Sep 10 20:53:26.636236 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 725/1461] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:26.653036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-44835692-8859-47f4-8009-17381dca5e5b tempest-SecurityGroupsTestAdminJSON-1239627237 tempest-SecurityGroupsTestAdminJSON-1239627237-project-admin] Action: 'create', calling method: .version_select at 0x7f9944c45ee0>, body: {"security_group": {"name": "tempest-securitygroup-980632994", "description": "tempest-description-1919395972"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:27.069107 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-44835692-8859-47f4-8009-17381dca5e5b tempest-SecurityGroupsTestAdminJSON-1239627237 tempest-SecurityGroupsTestAdminJSON-1239627237-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.431311 Sep 10 20:53:27.069738 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 726/1462] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:53:26 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:27.075220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-12cedb0b-f47a-4520-826f-48d8deae7782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:27.075943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-12cedb0b-f47a-4520-826f-48d8deae7782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:27.090160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12cedb0b-f47a-4520-826f-48d8deae7782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:27.090817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12cedb0b-f47a-4520-826f-48d8deae7782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:27.091271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12cedb0b-f47a-4520-826f-48d8deae7782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:27.091998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12cedb0b-f47a-4520-826f-48d8deae7782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:27.092464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12cedb0b-f47a-4520-826f-48d8deae7782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:27.093115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12cedb0b-f47a-4520-826f-48d8deae7782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:27.557775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-12cedb0b-f47a-4520-826f-48d8deae7782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:27.571610 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-12cedb0b-f47a-4520-826f-48d8deae7782 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1379 microversion: 2.1 time: 0.500604 Sep 10 20:53:27.574800 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 727/1463] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:27 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1379 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:27.588780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-14b2930c-171b-4c16-9b7a-5ba37e2c5bb1 tempest-SecurityGroupsTestAdminJSON-1239627237 tempest-SecurityGroupsTestAdminJSON-1239627237-project-admin] Calling method '.version_select at 0x7f9944c45940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:28.253598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:28.666856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=50 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:29.590866 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc01f207-b230-4670-9dc7-d1ce872d2b6c tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.473493 Sep 10 20:53:29.591839 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 737/1464] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 20:53:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:29.601343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1fa27b2a-85ce-49bb-ac6f-c88819c30c25 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:29.602690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1fa27b2a-85ce-49bb-ac6f-c88819c30c25 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:29.623740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fa27b2a-85ce-49bb-ac6f-c88819c30c25 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:29.624670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fa27b2a-85ce-49bb-ac6f-c88819c30c25 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:29.625337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fa27b2a-85ce-49bb-ac6f-c88819c30c25 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:29.626400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fa27b2a-85ce-49bb-ac6f-c88819c30c25 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:29.627100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fa27b2a-85ce-49bb-ac6f-c88819c30c25 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:29.627857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fa27b2a-85ce-49bb-ac6f-c88819c30c25 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:29.982050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1fa27b2a-85ce-49bb-ac6f-c88819c30c25 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:29.992759 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1fa27b2a-85ce-49bb-ac6f-c88819c30c25 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1313 microversion: 2.1 time: 0.399508 Sep 10 20:53:30.006946 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 738/1465] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:29 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:30.019502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a244ba74-b225-45a9-ba3b-629664d7aa50 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:30.025156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a244ba74-b225-45a9-ba3b-629664d7aa50 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:30.036036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a244ba74-b225-45a9-ba3b-629664d7aa50 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:30.037457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a244ba74-b225-45a9-ba3b-629664d7aa50 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:30.038342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a244ba74-b225-45a9-ba3b-629664d7aa50 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:30.039414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a244ba74-b225-45a9-ba3b-629664d7aa50 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:30.040199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a244ba74-b225-45a9-ba3b-629664d7aa50 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:30.040826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a244ba74-b225-45a9-ba3b-629664d7aa50 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:30.928494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a244ba74-b225-45a9-ba3b-629664d7aa50 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:30.931972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:30.945231 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a244ba74-b225-45a9-ba3b-629664d7aa50 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1379 microversion: 2.1 time: 0.936745 Sep 10 20:53:30.950775 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 739/1466] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:30 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1379 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:31.041571 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-14b2930c-171b-4c16-9b7a-5ba37e2c5bb1 tempest-SecurityGroupsTestAdminJSON-1239627237 tempest-SecurityGroupsTestAdminJSON-1239627237-project-admin] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12984 microversion: 2.1 time: 3.465488 Sep 10 20:53:31.043014 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 728/1467] 10.222.0.33 () {58 vars in 1191 bytes} [Sat Sep 10 20:53:27 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12984 bytes in 3468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:53:31.060285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d018a6d5-428b-40a9-b1e4-b592331e309f tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Action: 'create', calling method: .version_select at 0x7f9944c90280>, body: {"pool": null} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:31.090931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1238248602", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:31.226081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] validate_networks() for [('8ff548dc-5c62-4be9-a591-e04f702e4db1', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:53:32.963096 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d018a6d5-428b-40a9-b1e4-b592331e309f tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.906754 Sep 10 20:53:32.963697 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 729/1468] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 20:53:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:32.970527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-4144732f-a2e6-4456-a0d3-af742ce609eb req-e53107de-ba23-4c33-be44-219004148b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e1970c-5740-4466-911f-5aef17b7336e", "name": "network-vif-plugged", "status": "completed", "tag": "fd86c8ba-198f-490e-a5da-475f9082b557"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:33.002778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4144732f-a2e6-4456-a0d3-af742ce609eb req-e53107de-ba23-4c33-be44-219004148b2a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:33.003256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4144732f-a2e6-4456-a0d3-af742ce609eb req-e53107de-ba23-4c33-be44-219004148b2a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:33.007344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4144732f-a2e6-4456-a0d3-af742ce609eb req-e53107de-ba23-4c33-be44-219004148b2a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:33.040620 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-4144732f-a2e6-4456-a0d3-af742ce609eb req-e53107de-ba23-4c33-be44-219004148b2a service nova] Creating event network-vif-plugged:fd86c8ba-198f-490e-a5da-475f9082b557 for instance a4e1970c-5740-4466-911f-5aef17b7336e on nch2-master-1 Sep 10 20:53:33.048312 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-4144732f-a2e6-4456-a0d3-af742ce609eb req-e53107de-ba23-4c33-be44-219004148b2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082449 Sep 10 20:53:33.049408 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 730/1469] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:33.063068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1a1ca58c-4a1f-4406-aa66-2f43f72d3771 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:33.064346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1a1ca58c-4a1f-4406-aa66-2f43f72d3771 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:33.079536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a1ca58c-4a1f-4406-aa66-2f43f72d3771 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:33.081411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a1ca58c-4a1f-4406-aa66-2f43f72d3771 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:33.082403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a1ca58c-4a1f-4406-aa66-2f43f72d3771 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:33.083818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a1ca58c-4a1f-4406-aa66-2f43f72d3771 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:33.085622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a1ca58c-4a1f-4406-aa66-2f43f72d3771 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:33.087689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a1ca58c-4a1f-4406-aa66-2f43f72d3771 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:33.319994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:53:33.320547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:53:33.320896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:53:33.321314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:53:33.321736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:53:33.347740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:33.348242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:33.348690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:33.349446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:33.350148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:33.350362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:33.402019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Getting quotas for project f4b1732129f3414fbc3f26fff6d039ec. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:33.413180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Getting quotas for user d8b0a160808f4adda7be57cd535f0631 and project f4b1732129f3414fbc3f26fff6d039ec. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:33.452823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:53:33.460055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:53:33.501180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1a1ca58c-4a1f-4406-aa66-2f43f72d3771 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:33.511807 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1a1ca58c-4a1f-4406-aa66-2f43f72d3771 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1313 microversion: 2.1 time: 0.460942 Sep 10 20:53:33.528513 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 731/1470] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:33 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:33.542499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c4fa514b-26fe-47b2-b610-65cbe14265cb tempest-SecurityGroupsTestAdminJSON-988328549 tempest-SecurityGroupsTestAdminJSON-988328549-project] Calling method '.version_select at 0x7f9944da6820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:33.556760 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-677e7d53-4832-4ec4-a99b-cda138516c98 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.604833 Sep 10 20:53:33.557625 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 740/1471] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:53:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:53:33.568452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-58f3bbac-431d-4654-9a2e-56e82bd1a019 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:33.568953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-58f3bbac-431d-4654-9a2e-56e82bd1a019 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:33.586015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f3bbac-431d-4654-9a2e-56e82bd1a019 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:33.586792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f3bbac-431d-4654-9a2e-56e82bd1a019 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:33.587401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f3bbac-431d-4654-9a2e-56e82bd1a019 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:33.588233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f3bbac-431d-4654-9a2e-56e82bd1a019 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:33.588835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f3bbac-431d-4654-9a2e-56e82bd1a019 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:33.589426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f3bbac-431d-4654-9a2e-56e82bd1a019 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:33.976718 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c4fa514b-26fe-47b2-b610-65cbe14265cb tempest-SecurityGroupsTestAdminJSON-988328549 tempest-SecurityGroupsTestAdminJSON-988328549-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.447006 Sep 10 20:53:33.978407 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 732/1472] 10.222.0.33 () {58 vars in 1191 bytes} [Sat Sep 10 20:53:33 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:33.985232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-df9dd5c4-de0c-4c95-9357-ab4699bbc718 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Calling method '.version_select at 0x7f99495c20d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:34.184151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58f3bbac-431d-4654-9a2e-56e82bd1a019 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:34.195429 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-58f3bbac-431d-4654-9a2e-56e82bd1a019 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1379 microversion: 2.1 time: 0.636497 Sep 10 20:53:34.203469 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 741/1473] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:33 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1379 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:34.208563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c22fc297-c1e1-4ec3-abcf-88addc70d7d6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:34.211227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c22fc297-c1e1-4ec3-abcf-88addc70d7d6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:34.228662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:34.364754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c22fc297-c1e1-4ec3-abcf-88addc70d7d6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:34.374012 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-df9dd5c4-de0c-4c95-9357-ab4699bbc718 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/250beb3c-9b87-4f17-a962-d003c76cca07" status: 200 len: 142 microversion: 2.1 time: 0.392729 Sep 10 20:53:34.375122 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 733/1474] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:53:33 2022] GET /compute/v2.1/os-floating-ips/250beb3c-9b87-4f17-a962-d003c76cca07 => generated 142 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:34.399027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b5ae3f92-166c-4c26-b49b-b57ea699eeb1 tempest-SecurityGroupsTestAdminJSON-1239627237 tempest-SecurityGroupsTestAdminJSON-1239627237-project-admin] Calling method '.version_select at 0x7f99495c28b0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:34.408004 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c22fc297-c1e1-4ec3-abcf-88addc70d7d6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1222 microversion: 2.1 time: 0.203086 Sep 10 20:53:34.408637 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 742/1475] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:34 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1222 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:34.440044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12a3f96a-1892-4838-b715-1a3f50557e27 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Calling method '.version_select at 0x7f9944fa2820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:34.787291 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b5ae3f92-166c-4c26-b49b-b57ea699eeb1 tempest-SecurityGroupsTestAdminJSON-1239627237 tempest-SecurityGroupsTestAdminJSON-1239627237-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/fd6bbc37-41cb-40f7-af9d-9afe69aa5b86" status: 202 len: 0 microversion: 2.1 time: 0.410842 Sep 10 20:53:34.787949 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 734/1476] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:53:34 2022] DELETE /compute/v2.1/os-security-groups/fd6bbc37-41cb-40f7-af9d-9afe69aa5b86 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:53:34.793678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ef650b43-43d4-4176-bfe8-124d8d31e902 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:34.794582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ef650b43-43d4-4176-bfe8-124d8d31e902 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:34.823053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef650b43-43d4-4176-bfe8-124d8d31e902 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:34.824188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef650b43-43d4-4176-bfe8-124d8d31e902 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:34.825069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef650b43-43d4-4176-bfe8-124d8d31e902 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:34.826003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef650b43-43d4-4176-bfe8-124d8d31e902 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:34.826560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef650b43-43d4-4176-bfe8-124d8d31e902 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:34.826931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef650b43-43d4-4176-bfe8-124d8d31e902 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:35.150091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ef650b43-43d4-4176-bfe8-124d8d31e902 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:35.158653 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ef650b43-43d4-4176-bfe8-124d8d31e902 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1313 microversion: 2.1 time: 0.369371 Sep 10 20:53:35.159165 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 735/1477] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:34 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:35.192590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1514887573", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:35.293718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] validate_networks() for [('8ff548dc-5c62-4be9-a591-e04f702e4db1', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:53:36.336936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:53:36.337510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:53:36.337850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:53:36.338260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:53:36.338676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:53:36.361075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:36.361075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:36.361075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:36.361075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:36.361075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:36.376867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:36.415719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Getting quotas for project f4b1732129f3414fbc3f26fff6d039ec. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:36.437298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Getting quotas for user d8b0a160808f4adda7be57cd535f0631 and project f4b1732129f3414fbc3f26fff6d039ec. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:36.476608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:53:36.480358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:53:36.586078 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d51b89f1-e776-44c1-953d-5622b6fe964f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.397528 Sep 10 20:53:36.587216 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 736/1478] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:53:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:53:36.597024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bde57351-e8e8-4faa-9bb5-05de1ea9e4ba tempest-SecurityGroupsTestAdminJSON-1239627237 tempest-SecurityGroupsTestAdminJSON-1239627237-project-admin] Calling method '.version_select at 0x7f9944c45ee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:36.703091 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-12a3f96a-1892-4838-b715-1a3f50557e27 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/250beb3c-9b87-4f17-a962-d003c76cca07" status: 202 len: 0 microversion: 2.1 time: 2.273571 Sep 10 20:53:36.704894 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 743/1479] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:53:34 2022] DELETE /compute/v2.1/os-floating-ips/250beb3c-9b87-4f17-a962-d003c76cca07 => generated 0 bytes in 2296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:53:36.710371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6cc9866f-a854-4fcb-9f04-a6995d2780e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:36.712806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6cc9866f-a854-4fcb-9f04-a6995d2780e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:36.726541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cc9866f-a854-4fcb-9f04-a6995d2780e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:36.728676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cc9866f-a854-4fcb-9f04-a6995d2780e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:36.729138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cc9866f-a854-4fcb-9f04-a6995d2780e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:36.734465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cc9866f-a854-4fcb-9f04-a6995d2780e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:36.734954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cc9866f-a854-4fcb-9f04-a6995d2780e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:36.738895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cc9866f-a854-4fcb-9f04-a6995d2780e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:37.010610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6cc9866f-a854-4fcb-9f04-a6995d2780e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:37.023795 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6cc9866f-a854-4fcb-9f04-a6995d2780e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1529 microversion: 2.1 time: 0.317533 Sep 10 20:53:37.041025 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 744/1480] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:36 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1529 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:37.062467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e8b2423-e34f-409c-b17e-b8a7f756478f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:37.063124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e8b2423-e34f-409c-b17e-b8a7f756478f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:37.081542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e8b2423-e34f-409c-b17e-b8a7f756478f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:37.082063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e8b2423-e34f-409c-b17e-b8a7f756478f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:37.082788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e8b2423-e34f-409c-b17e-b8a7f756478f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:37.083720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e8b2423-e34f-409c-b17e-b8a7f756478f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:37.084404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e8b2423-e34f-409c-b17e-b8a7f756478f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:37.085043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e8b2423-e34f-409c-b17e-b8a7f756478f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:37.383792 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bde57351-e8e8-4faa-9bb5-05de1ea9e4ba tempest-SecurityGroupsTestAdminJSON-1239627237 tempest-SecurityGroupsTestAdminJSON-1239627237-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/cd60afcb-68a5-40cd-89dd-134aaca9e878" status: 202 len: 0 microversion: 2.1 time: 0.790546 Sep 10 20:53:37.386093 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 737/1481] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:53:36 2022] DELETE /compute/v2.1/os-security-groups/cd60afcb-68a5-40cd-89dd-134aaca9e878 => generated 0 bytes in 798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:53:37.496018 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e8b2423-e34f-409c-b17e-b8a7f756478f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1811 microversion: 2.1 time: 0.453712 Sep 10 20:53:37.501321 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 745/1482] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:37 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1811 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:37.514767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8bfd89b2-23b3-44b7-b638-276c92203422 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:37.516040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8bfd89b2-23b3-44b7-b638-276c92203422 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:37.537862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bfd89b2-23b3-44b7-b638-276c92203422 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:37.539361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bfd89b2-23b3-44b7-b638-276c92203422 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:37.540952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bfd89b2-23b3-44b7-b638-276c92203422 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:37.544696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bfd89b2-23b3-44b7-b638-276c92203422 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:37.548422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bfd89b2-23b3-44b7-b638-276c92203422 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:37.550467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bfd89b2-23b3-44b7-b638-276c92203422 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:37.591703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0337548a-e2ce-4239-af1a-4fd63d326da3 req-2e926bdc-a477-43b2-becb-42e87e8bb9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6f03e6-d257-478e-b3bb-1dcde947e5d2", "name": "network-vif-plugged", "status": "completed", "tag": "81ac6655-8d7d-4510-ad0e-703a1d79c2d5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:37.622989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0337548a-e2ce-4239-af1a-4fd63d326da3 req-2e926bdc-a477-43b2-becb-42e87e8bb9b7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:37.624777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0337548a-e2ce-4239-af1a-4fd63d326da3 req-2e926bdc-a477-43b2-becb-42e87e8bb9b7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:37.627989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0337548a-e2ce-4239-af1a-4fd63d326da3 req-2e926bdc-a477-43b2-becb-42e87e8bb9b7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:37.664610 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0337548a-e2ce-4239-af1a-4fd63d326da3 req-2e926bdc-a477-43b2-becb-42e87e8bb9b7 service nova] Creating event network-vif-plugged:81ac6655-8d7d-4510-ad0e-703a1d79c2d5 for instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 on nch1-master-1 Sep 10 20:53:37.688691 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0337548a-e2ce-4239-af1a-4fd63d326da3 req-2e926bdc-a477-43b2-becb-42e87e8bb9b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298555 Sep 10 20:53:37.692945 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 738/1483] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:37.826158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29a3eb50-ad5b-4223-b37d-926330bd082c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Action: 'create', calling method: .version_select at 0x7f9944d35310>, body: {"keypair": {"name": "tempest-keypair-478697339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW8+hc/nBrJi6MIFdnvxk4lC/u5LaoCOs1+sUufi/Gaw1zsg43RJJz1Ra+IFO+MRrpra2f4zJjzuLWVW6KUZ9YizbT2uIrkczbO1yUZIvNFicEsIampkKGtzscIjlKsHw=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:37.879130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-29a3eb50-ad5b-4223-b37d-926330bd082c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Getting quotas for project bbee44bfe21341d295b8c2290f692085. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:37.899362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-29a3eb50-ad5b-4223-b37d-926330bd082c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Getting quotas for user 5b0c267722f14e7fa87395f796551ab5 and project bbee44bfe21341d295b8c2290f692085. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:37.906529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8bfd89b2-23b3-44b7-b638-276c92203422 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:37.914694 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8bfd89b2-23b3-44b7-b638-276c92203422 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1313 microversion: 2.1 time: 0.409972 Sep 10 20:53:37.915274 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 746/1484] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:37 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:37.926227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eb7da4e4-6589-4c94-bae7-85eda054b60d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:37.928475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eb7da4e4-6589-4c94-bae7-85eda054b60d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:37.954903 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-29a3eb50-ad5b-4223-b37d-926330bd082c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.260293 Sep 10 20:53:37.955939 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 739/1485] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:53:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:37.960633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb7da4e4-6589-4c94-bae7-85eda054b60d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:37.966324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb7da4e4-6589-4c94-bae7-85eda054b60d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:37.966324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb7da4e4-6589-4c94-bae7-85eda054b60d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:37.966324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb7da4e4-6589-4c94-bae7-85eda054b60d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:37.966612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb7da4e4-6589-4c94-bae7-85eda054b60d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:37.966902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb7da4e4-6589-4c94-bae7-85eda054b60d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:37.971837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-267d8e19-40c2-4ac4-b1db-1e37fb0a63cd tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Calling method '.version_select at 0x7f9944bde820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:38.233687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eb7da4e4-6589-4c94-bae7-85eda054b60d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:38.249333 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eb7da4e4-6589-4c94-bae7-85eda054b60d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1218 microversion: 2.1 time: 0.329156 Sep 10 20:53:38.253253 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 747/1486] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:37 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1218 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:38.261037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8a27afc3-80e7-406f-a175-6afc9646d428 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:38.263514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8a27afc3-80e7-406f-a175-6afc9646d428 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:38.275319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a27afc3-80e7-406f-a175-6afc9646d428 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:38.276533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a27afc3-80e7-406f-a175-6afc9646d428 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:38.277176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a27afc3-80e7-406f-a175-6afc9646d428 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:38.278106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a27afc3-80e7-406f-a175-6afc9646d428 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:38.278798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a27afc3-80e7-406f-a175-6afc9646d428 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:38.279388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a27afc3-80e7-406f-a175-6afc9646d428 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:38.536268 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-267d8e19-40c2-4ac4-b1db-1e37fb0a63cd tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.578986 Sep 10 20:53:38.537478 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 740/1487] 10.222.0.33 () {58 vars in 1164 bytes} [Sat Sep 10 20:53:37 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:53:38.544104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4e13a514-3920-43fb-bfc3-eb7e24b9f1d4 tempest-SecurityGroupsTestAdminJSON-988328549 tempest-SecurityGroupsTestAdminJSON-988328549-project] Calling method '.version_select at 0x7f9944c06040>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:38.607202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8a27afc3-80e7-406f-a175-6afc9646d428 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:38.618311 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8a27afc3-80e7-406f-a175-6afc9646d428 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1529 microversion: 2.1 time: 0.362600 Sep 10 20:53:38.619506 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 748/1488] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:38 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1529 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:38.650613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59cd0290-4c6b-49a3-8327-a5c2815b31d5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:38.660077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59cd0290-4c6b-49a3-8327-a5c2815b31d5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:38.660921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59cd0290-4c6b-49a3-8327-a5c2815b31d5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:38.661548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59cd0290-4c6b-49a3-8327-a5c2815b31d5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:38.662524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59cd0290-4c6b-49a3-8327-a5c2815b31d5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:38.663138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59cd0290-4c6b-49a3-8327-a5c2815b31d5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:38.663736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59cd0290-4c6b-49a3-8327-a5c2815b31d5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:38.742354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59cd0290-4c6b-49a3-8327-a5c2815b31d5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.096954 Sep 10 20:53:38.744466 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 749/1489] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Sep 10 20:53:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:38.764500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be16a12c-508a-4d88-9bca-94f7b5d9ff03 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Calling method '.version_select at 0x7f99451b78b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:39.162906 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be16a12c-508a-4d88-9bca-94f7b5d9ff03 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.416775 Sep 10 20:53:39.163834 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 750/1490] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 20:53:38 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:39.168431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-879dcb36-55a8-4371-bb71-e45faf6f76a7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:39.228350 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-879dcb36-55a8-4371-bb71-e45faf6f76a7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/b6427c66-823f-473f-b054-dee292c3092e" status: 202 len: 0 microversion: 2.1 time: 0.063305 Sep 10 20:53:39.229387 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 751/1491] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:53:39 2022] DELETE /compute/v2.1/flavors/b6427c66-823f-473f-b054-dee292c3092e => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:53:39.239615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9bc2df15-caaf-4f5f-8355-a5ca4f40c30f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:39.240702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9bc2df15-caaf-4f5f-8355-a5ca4f40c30f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:39.248714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc2df15-caaf-4f5f-8355-a5ca4f40c30f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:39.249686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc2df15-caaf-4f5f-8355-a5ca4f40c30f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:39.250477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc2df15-caaf-4f5f-8355-a5ca4f40c30f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:39.251494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc2df15-caaf-4f5f-8355-a5ca4f40c30f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:39.252170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc2df15-caaf-4f5f-8355-a5ca4f40c30f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:39.252770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc2df15-caaf-4f5f-8355-a5ca4f40c30f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:39.372737 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4e13a514-3920-43fb-bfc3-eb7e24b9f1d4 tempest-SecurityGroupsTestAdminJSON-988328549 tempest-SecurityGroupsTestAdminJSON-988328549-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/c0b11e1d-4c49-4a7b-b601-518f83abba26" status: 202 len: 0 microversion: 2.1 time: 0.833830 Sep 10 20:53:39.374410 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 741/1492] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:53:38 2022] DELETE /compute/v2.1/os-security-groups/c0b11e1d-4c49-4a7b-b601-518f83abba26 => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:53:39.379657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-923f9a12-d1f3-49ba-8f8a-8b784317c346 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Calling method '.version_select at 0x7f994963a820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:39.679396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9bc2df15-caaf-4f5f-8355-a5ca4f40c30f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:39.691854 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9bc2df15-caaf-4f5f-8355-a5ca4f40c30f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1313 microversion: 2.1 time: 0.460164 Sep 10 20:53:39.698249 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 752/1493] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:39 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:39.716455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0f18c0f8-8d8a-4b1e-aec6-1ab3c48eeadc tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:39.804720 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0f18c0f8-8d8a-4b1e-aec6-1ab3c48eeadc tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.105040 Sep 10 20:53:39.843293 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 753/1494] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:53:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:39.860434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f75be101-7322-40da-a9e4-177d7755e945 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:39.861115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f75be101-7322-40da-a9e4-177d7755e945 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:39.882989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f75be101-7322-40da-a9e4-177d7755e945 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:39.885055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f75be101-7322-40da-a9e4-177d7755e945 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:39.887550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f75be101-7322-40da-a9e4-177d7755e945 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:39.890327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f75be101-7322-40da-a9e4-177d7755e945 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:39.896261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f75be101-7322-40da-a9e4-177d7755e945 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:39.897143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f75be101-7322-40da-a9e4-177d7755e945 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:40.452737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f75be101-7322-40da-a9e4-177d7755e945 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:40.468004 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f75be101-7322-40da-a9e4-177d7755e945 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1282 microversion: 2.1 time: 0.622274 Sep 10 20:53:40.468820 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 754/1495] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:39 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1282 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:40.478517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-868401ff-0cc7-42d5-b16e-88009e6898cc tempest-SecurityGroupsTestAdminJSON-988328549 tempest-SecurityGroupsTestAdminJSON-988328549-project] Calling method '.version_select at 0x7f99451ed790>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:41.084725 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-868401ff-0cc7-42d5-b16e-88009e6898cc tempest-SecurityGroupsTestAdminJSON-988328549 tempest-SecurityGroupsTestAdminJSON-988328549-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/3ee06186-98e7-44af-b967-50a07ab31cc4" status: 202 len: 0 microversion: 2.1 time: 0.614195 Sep 10 20:53:41.090239 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 755/1496] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:53:40 2022] DELETE /compute/v2.1/os-security-groups/3ee06186-98e7-44af-b967-50a07ab31cc4 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:53:41.097116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3fef9e25-0b9d-4ffe-bf26-bbc68a162d06 req-6abc71b8-4a43-49b4-aa2e-2813acb32c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be", "tag": "a7339d4b-d64a-4271-90e0-2f1b782cc9fb"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:41.117897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3fef9e25-0b9d-4ffe-bf26-bbc68a162d06 req-6abc71b8-4a43-49b4-aa2e-2813acb32c12 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:41.118385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3fef9e25-0b9d-4ffe-bf26-bbc68a162d06 req-6abc71b8-4a43-49b4-aa2e-2813acb32c12 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:41.118818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3fef9e25-0b9d-4ffe-bf26-bbc68a162d06 req-6abc71b8-4a43-49b4-aa2e-2813acb32c12 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:41.154050 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3fef9e25-0b9d-4ffe-bf26-bbc68a162d06 req-6abc71b8-4a43-49b4-aa2e-2813acb32c12 service nova] Creating event network-changed:a7339d4b-d64a-4271-90e0-2f1b782cc9fb for instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be on nch2-master-1 Sep 10 20:53:41.167069 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3fef9e25-0b9d-4ffe-bf26-bbc68a162d06 req-6abc71b8-4a43-49b4-aa2e-2813acb32c12 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072883 Sep 10 20:53:41.167605 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 756/1497] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:41.180553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:41.189081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:41.206117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:41.206711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:41.207391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:41.208801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:41.210574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:41.213360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:41.292339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:41.306751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Old instance type tempest-test_resize_flavor_-613187226, new instance type m1.heat {{(pid=145772) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 20:53:41.319842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:53:41.320273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:53:41.320878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:53:41.321432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:53:41.322253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:53:41.413713 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2067e5dc-7408-4362-917e-9d375017b62d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e/action" status: 202 len: 0 microversion: 2.1 time: 0.240289 Sep 10 20:53:41.414391 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 757/1498] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:53:41 2022] POST /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:53:41.421055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4aa3ee27-92b7-4601-b99a-cf38d25e55a5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4243e1cf-ccbd-4021-92f0-449a64e8c494", "device": "/dev/xvdb"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:41.425402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4aa3ee27-92b7-4601-b99a-cf38d25e55a5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:41.432750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa3ee27-92b7-4601-b99a-cf38d25e55a5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:41.433284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa3ee27-92b7-4601-b99a-cf38d25e55a5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:41.433957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa3ee27-92b7-4601-b99a-cf38d25e55a5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:41.436078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa3ee27-92b7-4601-b99a-cf38d25e55a5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:41.437232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa3ee27-92b7-4601-b99a-cf38d25e55a5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:41.438131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aa3ee27-92b7-4601-b99a-cf38d25e55a5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:41.975128 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-923f9a12-d1f3-49ba-8f8a-8b784317c346 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/c1f808c0-5dd9-4621-8951-00dd758b4cf6" status: 202 len: 0 microversion: 2.1 time: 2.599422 Sep 10 20:53:41.975876 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 742/1499] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:53:39 2022] DELETE /compute/v2.1/os-floating-ips/c1f808c0-5dd9-4621-8951-00dd758b4cf6 => generated 0 bytes in 2601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:53:41.981060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-02f13167-c28a-43f8-a9a1-d1312e9f782f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:41.982297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-02f13167-c28a-43f8-a9a1-d1312e9f782f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:41.998079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02f13167-c28a-43f8-a9a1-d1312e9f782f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:42.000224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02f13167-c28a-43f8-a9a1-d1312e9f782f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:42.002348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02f13167-c28a-43f8-a9a1-d1312e9f782f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:42.003724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02f13167-c28a-43f8-a9a1-d1312e9f782f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:42.005938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02f13167-c28a-43f8-a9a1-d1312e9f782f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:42.006515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02f13167-c28a-43f8-a9a1-d1312e9f782f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:42.050422 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4aa3ee27-92b7-4601-b99a-cf38d25e55a5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "POST /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.634339 Sep 10 20:53:42.057937 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 758/1500] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 20:53:41 2022] POST /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a/os-volume_attachments => generated 194 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:42.071106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3425529b-7b4c-4bc4-a537-563187ce6f16 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:42.071971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3425529b-7b4c-4bc4-a537-563187ce6f16 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:42.089804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3425529b-7b4c-4bc4-a537-563187ce6f16 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:42.090563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3425529b-7b4c-4bc4-a537-563187ce6f16 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:42.091178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3425529b-7b4c-4bc4-a537-563187ce6f16 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:42.092840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3425529b-7b4c-4bc4-a537-563187ce6f16 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:42.093690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3425529b-7b4c-4bc4-a537-563187ce6f16 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:42.094689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3425529b-7b4c-4bc4-a537-563187ce6f16 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:42.325620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-02f13167-c28a-43f8-a9a1-d1312e9f782f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:42.338347 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-02f13167-c28a-43f8-a9a1-d1312e9f782f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1498 microversion: 2.1 time: 0.361150 Sep 10 20:53:42.362324 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 743/1501] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:41 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1498 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:42.384779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a4561127-5f08-4458-8ef8-f6bc9f4502f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:42.385486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a4561127-5f08-4458-8ef8-f6bc9f4502f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:42.398872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4561127-5f08-4458-8ef8-f6bc9f4502f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:42.401597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4561127-5f08-4458-8ef8-f6bc9f4502f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:42.402356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4561127-5f08-4458-8ef8-f6bc9f4502f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:42.405228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4561127-5f08-4458-8ef8-f6bc9f4502f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:42.406183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4561127-5f08-4458-8ef8-f6bc9f4502f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:42.406809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4561127-5f08-4458-8ef8-f6bc9f4502f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:42.573343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a4561127-5f08-4458-8ef8-f6bc9f4502f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:42.581540 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a4561127-5f08-4458-8ef8-f6bc9f4502f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1280 microversion: 2.1 time: 0.216106 Sep 10 20:53:42.582160 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 744/1502] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:42 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:42.604200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-927e338c-8ef7-4c25-a20a-dcb43921bfb5 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Calling method '.version_select at 0x7f9944bddaf0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:42.634796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3425529b-7b4c-4bc4-a537-563187ce6f16 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:42.674609 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3425529b-7b4c-4bc4-a537-563187ce6f16 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1538 microversion: 2.1 time: 0.614974 Sep 10 20:53:42.682398 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 759/1503] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:42 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1538 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:42.689799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-caa0bd5e-987e-4358-9b7c-3d0a6afff473 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:42.731996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.compute.server_groups [None req-caa0bd5e-987e-4358-9b7c-3d0a6afff473 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Querying cell 2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) for 1 instances {{(pid=145772) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 20:53:42.734525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caa0bd5e-987e-4358-9b7c-3d0a6afff473 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:42.742831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caa0bd5e-987e-4358-9b7c-3d0a6afff473 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:42.743369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caa0bd5e-987e-4358-9b7c-3d0a6afff473 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:42.847766 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-caa0bd5e-987e-4358-9b7c-3d0a6afff473 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/b228a6fe-9b25-4557-9d54-f7e24326ab58" status: 200 len: 222 microversion: 2.1 time: 0.161222 Sep 10 20:53:42.848461 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 760/1504] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:53:42 2022] GET /compute/v2.1/os-server-groups/b228a6fe-9b25-4557-9d54-f7e24326ab58 => generated 222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:42.865495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59310ccc-728d-4bba-b0a9-3123b6abe706 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:42.867420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59310ccc-728d-4bba-b0a9-3123b6abe706 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:42.883861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59310ccc-728d-4bba-b0a9-3123b6abe706 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:42.886754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59310ccc-728d-4bba-b0a9-3123b6abe706 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:42.889335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59310ccc-728d-4bba-b0a9-3123b6abe706 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:42.890822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59310ccc-728d-4bba-b0a9-3123b6abe706 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:42.893677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59310ccc-728d-4bba-b0a9-3123b6abe706 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:42.894400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59310ccc-728d-4bba-b0a9-3123b6abe706 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:42.958801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59310ccc-728d-4bba-b0a9-3123b6abe706 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:53:43.087505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:43.236462 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59310ccc-728d-4bba-b0a9-3123b6abe706 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 204 len: 0 microversion: 2.1 time: 0.380234 Sep 10 20:53:43.240363 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 761/1505] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:53:42 2022] DELETE /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:53:43.280396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-03b51044-7979-4522-b561-08505ab27f35 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:43.282148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-03b51044-7979-4522-b561-08505ab27f35 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:43.313192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b51044-7979-4522-b561-08505ab27f35 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:43.320087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b51044-7979-4522-b561-08505ab27f35 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:43.320682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b51044-7979-4522-b561-08505ab27f35 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:43.324007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b51044-7979-4522-b561-08505ab27f35 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:43.324647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b51044-7979-4522-b561-08505ab27f35 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:43.325227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b51044-7979-4522-b561-08505ab27f35 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:44.068346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-03b51044-7979-4522-b561-08505ab27f35 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:44.082239 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-03b51044-7979-4522-b561-08505ab27f35 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1504 microversion: 2.1 time: 0.825728 Sep 10 20:53:44.107501 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 762/1506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:43 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1504 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:44.123924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9b74180e-5838-4434-9bf0-67ee9e38c3ed tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:44.126827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9b74180e-5838-4434-9bf0-67ee9e38c3ed tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:44.161336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b74180e-5838-4434-9bf0-67ee9e38c3ed tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:44.162645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b74180e-5838-4434-9bf0-67ee9e38c3ed tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:44.163312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b74180e-5838-4434-9bf0-67ee9e38c3ed tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:44.165182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b74180e-5838-4434-9bf0-67ee9e38c3ed tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:44.166264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b74180e-5838-4434-9bf0-67ee9e38c3ed tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:44.166878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b74180e-5838-4434-9bf0-67ee9e38c3ed tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:44.398458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:44.753623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9b74180e-5838-4434-9bf0-67ee9e38c3ed tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:44.779101 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9b74180e-5838-4434-9bf0-67ee9e38c3ed tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1322 microversion: 2.1 time: 0.669760 Sep 10 20:53:44.783958 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 763/1507] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:44 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:44.792468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ce143a3-896d-40a5-b2a1-63e7776f8003 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:44.793853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2ce143a3-896d-40a5-b2a1-63e7776f8003 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:44.823005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce143a3-896d-40a5-b2a1-63e7776f8003 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:44.824882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce143a3-896d-40a5-b2a1-63e7776f8003 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:44.825749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce143a3-896d-40a5-b2a1-63e7776f8003 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:44.827111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce143a3-896d-40a5-b2a1-63e7776f8003 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:44.828251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce143a3-896d-40a5-b2a1-63e7776f8003 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:44.831449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce143a3-896d-40a5-b2a1-63e7776f8003 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:45.582897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ce143a3-896d-40a5-b2a1-63e7776f8003 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:45.636478 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ce143a3-896d-40a5-b2a1-63e7776f8003 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1538 microversion: 2.1 time: 0.848600 Sep 10 20:53:45.638297 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 764/1508] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:44 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1538 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:45.691569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3f4585cb-5e66-4c4b-bab8-98dc29f95f78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:45.692205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3f4585cb-5e66-4c4b-bab8-98dc29f95f78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:45.740145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f4585cb-5e66-4c4b-bab8-98dc29f95f78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:45.747313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f4585cb-5e66-4c4b-bab8-98dc29f95f78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:45.747784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f4585cb-5e66-4c4b-bab8-98dc29f95f78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:45.756535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f4585cb-5e66-4c4b-bab8-98dc29f95f78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:45.762412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f4585cb-5e66-4c4b-bab8-98dc29f95f78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:45.762882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f4585cb-5e66-4c4b-bab8-98dc29f95f78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:45.773733 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-927e338c-8ef7-4c25-a20a-dcb43921bfb5 tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/c00dd2f5-9420-47fc-9277-7a3ac92b16c2" status: 202 len: 0 microversion: 2.1 time: 3.186766 Sep 10 20:53:45.774689 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 745/1509] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:53:42 2022] DELETE /compute/v2.1/os-floating-ips/c00dd2f5-9420-47fc-9277-7a3ac92b16c2 => generated 0 bytes in 3189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:53:45.785405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8ed4cee6-825a-4c7e-a4ce-6ebc68f0385b tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] Calling method '.version_select at 0x7f9944d35940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:46.402846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:46.582226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3f4585cb-5e66-4c4b-bab8-98dc29f95f78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5053eb274d2c4e8180aa1cbcb680a94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45a58e14da346efbb24a4bfed8b0b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:46.592497 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3f4585cb-5e66-4c4b-bab8-98dc29f95f78 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 200 len: 1504 microversion: 2.1 time: 0.951202 Sep 10 20:53:46.593347 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 765/1510] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:45 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 1504 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:46.628639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2d5b6f72-d4de-4d2b-a6c3-d41492e6e9d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:46.629296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2d5b6f72-d4de-4d2b-a6c3-d41492e6e9d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:46.656795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d5b6f72-d4de-4d2b-a6c3-d41492e6e9d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:46.661187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d5b6f72-d4de-4d2b-a6c3-d41492e6e9d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:46.664504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d5b6f72-d4de-4d2b-a6c3-d41492e6e9d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:46.665608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d5b6f72-d4de-4d2b-a6c3-d41492e6e9d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:46.666137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d5b6f72-d4de-4d2b-a6c3-d41492e6e9d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:46.666583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d5b6f72-d4de-4d2b-a6c3-d41492e6e9d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:47.562668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2d5b6f72-d4de-4d2b-a6c3-d41492e6e9d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:47.580911 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2d5b6f72-d4de-4d2b-a6c3-d41492e6e9d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1322 microversion: 2.1 time: 0.980577 Sep 10 20:53:47.581810 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 766/1511] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:46 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1322 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:47.587511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d68cb4d-cf90-44b7-959d-7426e979b26c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:47.588354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8d68cb4d-cf90-44b7-959d-7426e979b26c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:47.614145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d68cb4d-cf90-44b7-959d-7426e979b26c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:47.617077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d68cb4d-cf90-44b7-959d-7426e979b26c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:47.618381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d68cb4d-cf90-44b7-959d-7426e979b26c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:47.619867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d68cb4d-cf90-44b7-959d-7426e979b26c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:47.620630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d68cb4d-cf90-44b7-959d-7426e979b26c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:47.621705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d68cb4d-cf90-44b7-959d-7426e979b26c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:47.927611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=10 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:48.167792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8d68cb4d-cf90-44b7-959d-7426e979b26c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:48.193031 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8ed4cee6-825a-4c7e-a4ce-6ebc68f0385b tempest-FloatingIPDetailsTestJSON-1284081202 tempest-FloatingIPDetailsTestJSON-1284081202-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/72c6d228-ec55-48ad-8271-8359642690ad" status: 202 len: 0 microversion: 2.1 time: 2.411299 Sep 10 20:53:48.193637 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 746/1512] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:53:45 2022] DELETE /compute/v2.1/os-floating-ips/72c6d228-ec55-48ad-8271-8359642690ad => generated 0 bytes in 2413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:53:48.194869 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8d68cb4d-cf90-44b7-959d-7426e979b26c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1538 microversion: 2.1 time: 0.610553 Sep 10 20:53:48.195839 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 767/1513] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:47 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1538 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:48.209758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1f5a482-acce-4479-9ab2-f6fd5db3db6d tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:48.210966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a1f5a482-acce-4479-9ab2-f6fd5db3db6d tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:48.222727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1f5a482-acce-4479-9ab2-f6fd5db3db6d tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:48.223511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1f5a482-acce-4479-9ab2-f6fd5db3db6d tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:48.224987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1f5a482-acce-4479-9ab2-f6fd5db3db6d tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:48.226021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1f5a482-acce-4479-9ab2-f6fd5db3db6d tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:48.234433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1f5a482-acce-4479-9ab2-f6fd5db3db6d tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:48.235519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1f5a482-acce-4479-9ab2-f6fd5db3db6d tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:48.472054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-48b0fa66-bdc9-4d45-a002-332fcf0c2b4d req-63c49ad5-9382-4df2-a31e-e42743386475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6f03e6-d257-478e-b3bb-1dcde947e5d2", "name": "network-vif-deleted", "tag": "81ac6655-8d7d-4510-ad0e-703a1d79c2d5"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:48.499571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-48b0fa66-bdc9-4d45-a002-332fcf0c2b4d req-63c49ad5-9382-4df2-a31e-e42743386475 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:48.503063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-48b0fa66-bdc9-4d45-a002-332fcf0c2b4d req-63c49ad5-9382-4df2-a31e-e42743386475 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:48.503549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-48b0fa66-bdc9-4d45-a002-332fcf0c2b4d req-63c49ad5-9382-4df2-a31e-e42743386475 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:48.523275 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-48b0fa66-bdc9-4d45-a002-332fcf0c2b4d req-63c49ad5-9382-4df2-a31e-e42743386475 service nova] Creating event network-vif-deleted:81ac6655-8d7d-4510-ad0e-703a1d79c2d5 for instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 on nch1-master-1 Sep 10 20:53:48.531617 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-48b0fa66-bdc9-4d45-a002-332fcf0c2b4d req-63c49ad5-9382-4df2-a31e-e42743386475 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333750 Sep 10 20:53:48.533124 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 768/1514] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:48.539961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-50c0c7fb-80f9-45a1-bafd-ad0e8269dc05 req-cc8a02cb-8541-4adc-b991-27ca088cc7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be", "name": "network-vif-plugged", "status": "completed", "tag": "a7339d4b-d64a-4271-90e0-2f1b782cc9fb"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:48.554658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-50c0c7fb-80f9-45a1-bafd-ad0e8269dc05 req-cc8a02cb-8541-4adc-b991-27ca088cc7c3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:48.555624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-50c0c7fb-80f9-45a1-bafd-ad0e8269dc05 req-cc8a02cb-8541-4adc-b991-27ca088cc7c3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:48.556411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-50c0c7fb-80f9-45a1-bafd-ad0e8269dc05 req-cc8a02cb-8541-4adc-b991-27ca088cc7c3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:48.575349 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-50c0c7fb-80f9-45a1-bafd-ad0e8269dc05 req-cc8a02cb-8541-4adc-b991-27ca088cc7c3 service nova] Creating event network-vif-plugged:a7339d4b-d64a-4271-90e0-2f1b782cc9fb for instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be on nch2-master-1 Sep 10 20:53:48.582956 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-50c0c7fb-80f9-45a1-bafd-ad0e8269dc05 req-cc8a02cb-8541-4adc-b991-27ca088cc7c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048051 Sep 10 20:53:48.584022 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 769/1515] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:48.590990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:48.592319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:48.602474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:48.603673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:48.604458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:48.610286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:48.611107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:48.611899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:48.647614 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] HTTP exception thrown: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Request method failure captured: Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 HTTP/1.1 Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPk5xBRbVAaLMw3e4SkOeBnDeJcccOnCgs6R_CEAFDKM4LGFdomwGLOBnErrZmZF6V0RPUYn84cp5X3yhTpmGZIA6pMx4MjzkHUTeb-EZM7FF_bRB05GPWwrBa2g4tiob9k7TyJBTvxj6u0BXGdYPv3Kp8DhP0NprTlpmvaBJaDL6Sg Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a45a58e14da346efbb24a4bfed8b0b69", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a45a58e14da346efbb24a4bfed8b0b69"}]}] Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5053eb274d2c4e8180aa1cbcb680a94f Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '1d6f03e6-d257-478e-b3bb-1dcde947e5d2'} Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:48.653366 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:48.659944 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:48.659944 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:48.659944 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:48.659944 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:53:48.659944 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:53:48.659944 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:48.659944 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:48.663261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Returning 404 to user: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:53:48.667070 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fa7ed79c-72c1-469d-b80e-cb55eb02a683 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 404 len: 111 microversion: 2.1 time: 0.079383 Sep 10 20:53:48.668902 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 770/1516] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:48 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:53:48.677223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8545eafa-d57d-4603-afba-1d213e933277 req-3b6db9b7-dcde-4bd8-b44b-71667d477c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31e18c6b-6c06-42cf-8651-53cdb6c30ff7", "tag": "59ec7720-9ed7-4a7c-8d8c-cb6a33ecbc8d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:48.690765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:48.693508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8545eafa-d57d-4603-afba-1d213e933277 req-3b6db9b7-dcde-4bd8-b44b-71667d477c72 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:48.694013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8545eafa-d57d-4603-afba-1d213e933277 req-3b6db9b7-dcde-4bd8-b44b-71667d477c72 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:48.694686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8545eafa-d57d-4603-afba-1d213e933277 req-3b6db9b7-dcde-4bd8-b44b-71667d477c72 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:48.710066 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8545eafa-d57d-4603-afba-1d213e933277 req-3b6db9b7-dcde-4bd8-b44b-71667d477c72 service nova] Creating event network-changed:59ec7720-9ed7-4a7c-8d8c-cb6a33ecbc8d for instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 on nch1-master-1 Sep 10 20:53:48.715672 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8545eafa-d57d-4603-afba-1d213e933277 req-3b6db9b7-dcde-4bd8-b44b-71667d477c72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045332 Sep 10 20:53:48.716509 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 771/1517] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:48.723487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-140041c3-c63a-474f-b4fd-4f29a92dda5e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:48.724440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-140041c3-c63a-474f-b4fd-4f29a92dda5e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:48.731819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140041c3-c63a-474f-b4fd-4f29a92dda5e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:48.733512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140041c3-c63a-474f-b4fd-4f29a92dda5e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:48.734523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140041c3-c63a-474f-b4fd-4f29a92dda5e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:48.735509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140041c3-c63a-474f-b4fd-4f29a92dda5e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:48.736181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140041c3-c63a-474f-b4fd-4f29a92dda5e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:48.736824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140041c3-c63a-474f-b4fd-4f29a92dda5e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:49.033703 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a1f5a482-acce-4479-9ab2-f6fd5db3db6d tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1857 microversion: 2.1 time: 0.838661 Sep 10 20:53:49.035252 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 747/1518] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:48 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1857 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:49.039603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2ad66518-820c-4a48-a738-53fab7dc7689 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:49.044884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=5 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:49.070961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.compute.server_groups [None req-2ad66518-820c-4a48-a738-53fab7dc7689 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Querying cell 2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) for 1 instances {{(pid=145771) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 20:53:49.071969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ad66518-820c-4a48-a738-53fab7dc7689 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:49.072468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ad66518-820c-4a48-a738-53fab7dc7689 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:49.073050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ad66518-820c-4a48-a738-53fab7dc7689 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:49.101009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2ad66518-820c-4a48-a738-53fab7dc7689 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.064590 Sep 10 20:53:49.102042 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 748/1519] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 20:53:49 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:49.110150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:49.113888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:49.122233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:49.123124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:49.124654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:49.125874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:49.127425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:49.128475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:49.161634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lazy-loading 'flavor' on Instance uuid 662c3986-cb45-4c9f-a1cf-55a8230ac15a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:53:49.186431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Going to try to live migrate instance to nch2-master-1 {{(pid=145771) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 20:53:49.700077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-140041c3-c63a-474f-b4fd-4f29a92dda5e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:49.721152 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-140041c3-c63a-474f-b4fd-4f29a92dda5e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1322 microversion: 2.1 time: 1.002840 Sep 10 20:53:49.723596 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 772/1520] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:48 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1322 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:49.729846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d5d62c4f-c7d8-4d90-a9cc-46c3c812a19f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:49.754394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.compute.server_groups [None req-d5d62c4f-c7d8-4d90-a9cc-46c3c812a19f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Querying cell 2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) for 1 instances {{(pid=145772) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 20:53:49.755455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5d62c4f-c7d8-4d90-a9cc-46c3c812a19f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:49.758319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5d62c4f-c7d8-4d90-a9cc-46c3c812a19f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:49.760297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5d62c4f-c7d8-4d90-a9cc-46c3c812a19f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:49.787774 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d5d62c4f-c7d8-4d90-a9cc-46c3c812a19f tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/b228a6fe-9b25-4557-9d54-f7e24326ab58" status: 200 len: 184 microversion: 2.1 time: 0.057925 Sep 10 20:53:49.791336 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 773/1521] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:53:49 2022] GET /compute/v2.1/os-server-groups/b228a6fe-9b25-4557-9d54-f7e24326ab58 => generated 184 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:49.808451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7dd16c4c-e382-4813-87f7-429532dc8f47 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:49.814672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7dd16c4c-e382-4813-87f7-429532dc8f47 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:49.839414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd16c4c-e382-4813-87f7-429532dc8f47 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:49.853933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd16c4c-e382-4813-87f7-429532dc8f47 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:49.853933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd16c4c-e382-4813-87f7-429532dc8f47 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:49.853933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd16c4c-e382-4813-87f7-429532dc8f47 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:49.853933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd16c4c-e382-4813-87f7-429532dc8f47 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:49.853933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd16c4c-e382-4813-87f7-429532dc8f47 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:50.192481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7dd16c4c-e382-4813-87f7-429532dc8f47 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:50.203182 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7dd16c4c-e382-4813-87f7-429532dc8f47 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1543 microversion: 2.1 time: 0.403473 Sep 10 20:53:50.206676 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 774/1522] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:49 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1543 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:50.212080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:50.212843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:50.220327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:50.221321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:50.222121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:50.223057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:50.223715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:50.224342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:50.242353 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] HTTP exception thrown: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Request method failure captured: Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 HTTP/1.1 Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPk5xBRbVAaLMw3e4SkOeBnDeJcccOnCgs6R_CEAFDKM4LGFdomwGLOBnErrZmZF6V0RPUYn84cp5X3yhTpmGZIA6pMx4MjzkHUTeb-EZM7FF_bRB05GPWwrBa2g4tiob9k7TyJBTvxj6u0BXGdYPv3Kp8DhP0NprTlpmvaBJaDL6Sg Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a45a58e14da346efbb24a4bfed8b0b69", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a45a58e14da346efbb24a4bfed8b0b69"}]}] Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5053eb274d2c4e8180aa1cbcb680a94f Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '1d6f03e6-d257-478e-b3bb-1dcde947e5d2'} Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:53:50.245220 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:50.252597 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.254408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Returning 404 to user: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:53:50.255593 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-95a3d037-d944-4a0a-a29e-ea7306de6330 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 404 len: 111 microversion: 2.1 time: 0.047503 Sep 10 20:53:50.256686 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 775/1523] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:53:50 2022] DELETE /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:53:50.268837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:50.271409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] [instance: 1d6f03e6-d257-478e-b3bb-1dcde947e5d2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:50.282209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:50.282821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:50.283390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:50.284345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:50.284905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:50.285435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:50.313541 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] HTTP exception thrown: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Request method failure captured: Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 HTTP/1.1 Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPk5xBRbVAaLMw3e4SkOeBnDeJcccOnCgs6R_CEAFDKM4LGFdomwGLOBnErrZmZF6V0RPUYn84cp5X3yhTpmGZIA6pMx4MjzkHUTeb-EZM7FF_bRB05GPWwrBa2g4tiob9k7TyJBTvxj6u0BXGdYPv3Kp8DhP0NprTlpmvaBJaDL6Sg Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a45a58e14da346efbb24a4bfed8b0b69", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a45a58e14da346efbb24a4bfed8b0b69"}]}] Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5053eb274d2c4e8180aa1cbcb680a94f Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '1d6f03e6-d257-478e-b3bb-1dcde947e5d2'} Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.316536 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.321516 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.321516 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.321516 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.321516 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:53:50.321516 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:53:50.321516 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. Sep 10 20:53:50.321516 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.321516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Returning 404 to user: Instance 1d6f03e6-d257-478e-b3bb-1dcde947e5d2 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:53:50.321516 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-47930013-0a83-46b8-b661-d46126b3c4c6 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2" status: 404 len: 111 microversion: 2.1 time: 0.059300 Sep 10 20:53:50.323171 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 776/1524] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:50 2022] GET /compute/v2.1/servers/1d6f03e6-d257-478e-b3bb-1dcde947e5d2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:53:50.331670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6aed56a4-3695-4c3a-a775-4b4b66082487 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:50.338213 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-6aed56a4-3695-4c3a-a775-4b4b66082487 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] HTTP exception thrown: Instance group 86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c could not be found. Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6aed56a4-3695-4c3a-a775-4b4b66082487 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Request method failure captured: Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-server-groups/86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c HTTP/1.1 Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPk5xBRbVAaLMw3e4SkOeBnDeJcccOnCgs6R_CEAFDKM4LGFdomwGLOBnErrZmZF6V0RPUYn84cp5X3yhTpmGZIA6pMx4MjzkHUTeb-EZM7FF_bRB05GPWwrBa2g4tiob9k7TyJBTvxj6u0BXGdYPv3Kp8DhP0NprTlpmvaBJaDL6Sg Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a45a58e14da346efbb24a4bfed8b0b69", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a45a58e14da346efbb24a4bfed8b0b69"}]}] Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5053eb274d2c4e8180aa1cbcb680a94f Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance group 86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c could not be found. Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c'} Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c could not be found. Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c could not be found. Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.340375 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.345529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.345529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.345529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:53:50.345529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:53:50.345529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c could not be found. Sep 10 20:53:50.345529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.345529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6aed56a4-3695-4c3a-a775-4b4b66082487 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Returning 404 to user: Instance group 86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:53:50.345529 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6aed56a4-3695-4c3a-a775-4b4b66082487 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c" status: 404 len: 117 microversion: 2.1 time: 0.015681 Sep 10 20:53:50.348520 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 777/1525] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 20:53:50 2022] DELETE /compute/v2.1/os-server-groups/86e1d1f8-fbe5-4a20-8e02-3c38bf6cab9c => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:53:50.353469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-442e1d4b-6f37-48a1-a008-a6672f06ee12 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:50.361018 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-442e1d4b-6f37-48a1-a008-a6672f06ee12 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] HTTP exception thrown: Instance group e2c28b6a-5db2-41a5-b9d9-7d5bae70fada could not be found. Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-442e1d4b-6f37-48a1-a008-a6672f06ee12 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Request method failure captured: Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-server-groups/e2c28b6a-5db2-41a5-b9d9-7d5bae70fada HTTP/1.1 Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPk5xBRbVAaLMw3e4SkOeBnDeJcccOnCgs6R_CEAFDKM4LGFdomwGLOBnErrZmZF6V0RPUYn84cp5X3yhTpmGZIA6pMx4MjzkHUTeb-EZM7FF_bRB05GPWwrBa2g4tiob9k7TyJBTvxj6u0BXGdYPv3Kp8DhP0NprTlpmvaBJaDL6Sg Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a45a58e14da346efbb24a4bfed8b0b69", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a45a58e14da346efbb24a4bfed8b0b69"}]}] Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5053eb274d2c4e8180aa1cbcb680a94f Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance group e2c28b6a-5db2-41a5-b9d9-7d5bae70fada could not be found. Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e2c28b6a-5db2-41a5-b9d9-7d5bae70fada'} Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e2c28b6a-5db2-41a5-b9d9-7d5bae70fada could not be found. Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e2c28b6a-5db2-41a5-b9d9-7d5bae70fada could not be found. Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.363413 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.368365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.368365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.368365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:53:50.368365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:53:50.368365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e2c28b6a-5db2-41a5-b9d9-7d5bae70fada could not be found. Sep 10 20:53:50.368365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.368365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-442e1d4b-6f37-48a1-a008-a6672f06ee12 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Returning 404 to user: Instance group e2c28b6a-5db2-41a5-b9d9-7d5bae70fada could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:53:50.368365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-442e1d4b-6f37-48a1-a008-a6672f06ee12 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/e2c28b6a-5db2-41a5-b9d9-7d5bae70fada" status: 404 len: 117 microversion: 2.1 time: 0.016835 Sep 10 20:53:50.371849 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 778/1526] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 20:53:50 2022] DELETE /compute/v2.1/os-server-groups/e2c28b6a-5db2-41a5-b9d9-7d5bae70fada => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:53:50.377456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92ff1ad6-12d6-48db-a997-d8cfcbe4889a tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:50.384504 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-92ff1ad6-12d6-48db-a997-d8cfcbe4889a tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] HTTP exception thrown: Instance group dc0e8282-ef8f-4a13-8890-3c25314de85a could not be found. Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92ff1ad6-12d6-48db-a997-d8cfcbe4889a tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Request method failure captured: Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-server-groups/dc0e8282-ef8f-4a13-8890-3c25314de85a HTTP/1.1 Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPk5xBRbVAaLMw3e4SkOeBnDeJcccOnCgs6R_CEAFDKM4LGFdomwGLOBnErrZmZF6V0RPUYn84cp5X3yhTpmGZIA6pMx4MjzkHUTeb-EZM7FF_bRB05GPWwrBa2g4tiob9k7TyJBTvxj6u0BXGdYPv3Kp8DhP0NprTlpmvaBJaDL6Sg Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a45a58e14da346efbb24a4bfed8b0b69", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a45a58e14da346efbb24a4bfed8b0b69"}]}] Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5053eb274d2c4e8180aa1cbcb680a94f Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance group dc0e8282-ef8f-4a13-8890-3c25314de85a could not be found. Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'dc0e8282-ef8f-4a13-8890-3c25314de85a'} Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group dc0e8282-ef8f-4a13-8890-3c25314de85a could not be found. Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group dc0e8282-ef8f-4a13-8890-3c25314de85a could not be found. Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.386355 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.391309 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.391309 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.391309 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:53:50.391309 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:53:50.391309 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group dc0e8282-ef8f-4a13-8890-3c25314de85a could not be found. Sep 10 20:53:50.391309 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.391309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92ff1ad6-12d6-48db-a997-d8cfcbe4889a tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Returning 404 to user: Instance group dc0e8282-ef8f-4a13-8890-3c25314de85a could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:53:50.391309 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-92ff1ad6-12d6-48db-a997-d8cfcbe4889a tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/dc0e8282-ef8f-4a13-8890-3c25314de85a" status: 404 len: 117 microversion: 2.1 time: 0.015617 Sep 10 20:53:50.394198 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 779/1527] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 20:53:50 2022] DELETE /compute/v2.1/os-server-groups/dc0e8282-ef8f-4a13-8890-3c25314de85a => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:53:50.400259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8527fcf-2c9f-438f-9094-2dc57cf49fbc tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:50.413931 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f8527fcf-2c9f-438f-9094-2dc57cf49fbc tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] HTTP exception thrown: Instance group 79e8252a-1ceb-459e-a88c-93aea97d73e7 could not be found. Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8527fcf-2c9f-438f-9094-2dc57cf49fbc tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Request method failure captured: Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-server-groups/79e8252a-1ceb-459e-a88c-93aea97d73e7 HTTP/1.1 Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPk5xBRbVAaLMw3e4SkOeBnDeJcccOnCgs6R_CEAFDKM4LGFdomwGLOBnErrZmZF6V0RPUYn84cp5X3yhTpmGZIA6pMx4MjzkHUTeb-EZM7FF_bRB05GPWwrBa2g4tiob9k7TyJBTvxj6u0BXGdYPv3Kp8DhP0NprTlpmvaBJaDL6Sg Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a45a58e14da346efbb24a4bfed8b0b69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a45a58e14da346efbb24a4bfed8b0b69", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a45a58e14da346efbb24a4bfed8b0b69"}]}] Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a45a58e14da346efbb24a4bfed8b0b69 Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerGroupTestJSON-907705777 Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5053eb274d2c4e8180aa1cbcb680a94f Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerGroupTestJSON-907705777-project Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance group 79e8252a-1ceb-459e-a88c-93aea97d73e7 could not be found. Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '79e8252a-1ceb-459e-a88c-93aea97d73e7'} Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 79e8252a-1ceb-459e-a88c-93aea97d73e7 could not be found. Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 79e8252a-1ceb-459e-a88c-93aea97d73e7 could not be found. Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.416097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:53:50.420816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:53:50.420816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:53:50.420816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:53:50.420816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:53:50.420816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 79e8252a-1ceb-459e-a88c-93aea97d73e7 could not be found. Sep 10 20:53:50.420816 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:53:50.420816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8527fcf-2c9f-438f-9094-2dc57cf49fbc tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Returning 404 to user: Instance group 79e8252a-1ceb-459e-a88c-93aea97d73e7 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:53:50.420816 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8527fcf-2c9f-438f-9094-2dc57cf49fbc tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/79e8252a-1ceb-459e-a88c-93aea97d73e7" status: 404 len: 117 microversion: 2.1 time: 0.021774 Sep 10 20:53:50.420816 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 780/1528] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 20:53:50 2022] DELETE /compute/v2.1/os-server-groups/79e8252a-1ceb-459e-a88c-93aea97d73e7 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:53:50.428411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3ec00c14-be2c-4f0c-a50c-063d38cf02a9 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:50.459808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:50.478820 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3ec00c14-be2c-4f0c-a50c-063d38cf02a9 tempest-ServerGroupTestJSON-907705777 tempest-ServerGroupTestJSON-907705777-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/b228a6fe-9b25-4557-9d54-f7e24326ab58" status: 204 len: 0 microversion: 2.1 time: 0.054214 Sep 10 20:53:50.480184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 781/1529] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 20:53:50 2022] DELETE /compute/v2.1/os-server-groups/b228a6fe-9b25-4557-9d54-f7e24326ab58 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:53:50.753847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a900fc5c-ac53-4a75-a8f6-a3ea0a761c5c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:50.755831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a900fc5c-ac53-4a75-a8f6-a3ea0a761c5c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:50.766018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a900fc5c-ac53-4a75-a8f6-a3ea0a761c5c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:50.767225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a900fc5c-ac53-4a75-a8f6-a3ea0a761c5c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:50.767815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a900fc5c-ac53-4a75-a8f6-a3ea0a761c5c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:50.769487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a900fc5c-ac53-4a75-a8f6-a3ea0a761c5c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:50.770310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a900fc5c-ac53-4a75-a8f6-a3ea0a761c5c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:50.771494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a900fc5c-ac53-4a75-a8f6-a3ea0a761c5c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:51.286296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a900fc5c-ac53-4a75-a8f6-a3ea0a761c5c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:51.298226 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a900fc5c-ac53-4a75-a8f6-a3ea0a761c5c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1322 microversion: 2.1 time: 0.551200 Sep 10 20:53:51.299087 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 782/1530] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:50 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:51.304140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-27875151-c4db-44c3-96de-e127a6cb737f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:51.304753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-27875151-c4db-44c3-96de-e127a6cb737f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:51.324727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27875151-c4db-44c3-96de-e127a6cb737f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:51.325222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27875151-c4db-44c3-96de-e127a6cb737f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:51.325663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27875151-c4db-44c3-96de-e127a6cb737f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:51.327211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27875151-c4db-44c3-96de-e127a6cb737f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:51.327996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27875151-c4db-44c3-96de-e127a6cb737f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:51.328475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27875151-c4db-44c3-96de-e127a6cb737f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:51.654805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-27875151-c4db-44c3-96de-e127a6cb737f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:51.666777 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-27875151-c4db-44c3-96de-e127a6cb737f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1543 microversion: 2.1 time: 0.366454 Sep 10 20:53:51.667362 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 783/1531] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:51 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1543 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:52.037295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-703558143", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d1056f7d-9b49-496a-b2dd-0515a9a2e934"}], "block_device_mapping_v2": [{"uuid": "7e5f2172-4d5c-4a70-9903-8645e73975a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:52.115546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] validate_networks() for [('d1056f7d-9b49-496a-b2dd-0515a9a2e934', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:53:54.399279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:53:54.400535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:53:54.401253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:53:54.401668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:53:54.402103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:53:54.422019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:54.423609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:54.424340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:54.426318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:54.428377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:54.429315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:54.464347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Getting quotas for project 89075fefc8ea47c78d4ff7364e12ffde. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:54.472959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Getting quotas for user dd431fc2d9834bea8df807edb91771ee and project 89075fefc8ea47c78d4ff7364e12ffde. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:54.548721 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1e6f1baa-3e76-44ab-a732-c752d318c4d4 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a/action" status: 202 len: 0 microversion: 2.1 time: 5.445194 Sep 10 20:53:54.550174 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 749/1532] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:53:49 2022] POST /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a/action => generated 0 bytes in 5447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:53:54.560236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:53:54.562863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e5f2172-4d5c-4a70-9903-8645e73975a3',volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:53:54.565116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0801d4be-519f-457f-8d2f-9f6fe759748d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:54.567012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0801d4be-519f-457f-8d2f-9f6fe759748d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:54.578701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0801d4be-519f-457f-8d2f-9f6fe759748d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:54.579315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0801d4be-519f-457f-8d2f-9f6fe759748d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:54.580474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0801d4be-519f-457f-8d2f-9f6fe759748d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:54.580859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0801d4be-519f-457f-8d2f-9f6fe759748d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:54.581433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0801d4be-519f-457f-8d2f-9f6fe759748d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:54.582172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0801d4be-519f-457f-8d2f-9f6fe759748d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:54.614916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:54.839277 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e70f6e7d-9c14-490e-b87f-820d90b71824 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.806647 Sep 10 20:53:54.840500 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 784/1533] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:53:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2808 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 20:53:54.851281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d2490368-0d5d-49a2-807d-8da427197be0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:54.858855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d2490368-0d5d-49a2-807d-8da427197be0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:54.865632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2490368-0d5d-49a2-807d-8da427197be0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:54.868550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2490368-0d5d-49a2-807d-8da427197be0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:54.869341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2490368-0d5d-49a2-807d-8da427197be0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:54.895713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2490368-0d5d-49a2-807d-8da427197be0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:54.896493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2490368-0d5d-49a2-807d-8da427197be0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:54.897137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2490368-0d5d-49a2-807d-8da427197be0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:55.153217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0801d4be-519f-457f-8d2f-9f6fe759748d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:55.163004 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0801d4be-519f-457f-8d2f-9f6fe759748d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1322 microversion: 2.1 time: 0.611511 Sep 10 20:53:55.167805 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 750/1534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:54 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:55.174861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-785444259", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9141a643-7227-45dc-ad54-9504f3ee5adb"}], "security_groups": [{"name": "tempest-securitygroup--1892335281"}], "key_name": "tempest-keypair-478697339", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "c646f933-5c16-4429-b5b8-315fd6386033", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:55.239394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d2490368-0d5d-49a2-807d-8da427197be0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:55.252154 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d2490368-0d5d-49a2-807d-8da427197be0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1543 microversion: 2.1 time: 0.410333 Sep 10 20:53:55.267143 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 785/1535] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:54 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1543 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:55.294173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fbd091dd-9ce8-47c4-a808-0bd49025f480 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:55.295119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fbd091dd-9ce8-47c4-a808-0bd49025f480 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:55.303611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd091dd-9ce8-47c4-a808-0bd49025f480 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:55.304877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd091dd-9ce8-47c4-a808-0bd49025f480 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:55.305559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd091dd-9ce8-47c4-a808-0bd49025f480 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:55.306576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd091dd-9ce8-47c4-a808-0bd49025f480 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:55.307258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd091dd-9ce8-47c4-a808-0bd49025f480 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:55.307907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd091dd-9ce8-47c4-a808-0bd49025f480 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:55.608772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] validate_networks() for [('9141a643-7227-45dc-ad54-9504f3ee5adb', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:53:55.614256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fbd091dd-9ce8-47c4-a808-0bd49025f480 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:55.628290 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fbd091dd-9ce8-47c4-a808-0bd49025f480 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.355183 Sep 10 20:53:55.645484 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 786/1536] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:55 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:55.657462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:55.658468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:55.665393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:55.666194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:55.666821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:55.667708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:55.668327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:55.668919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:55.688409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:53:55.775794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:55.788819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:55.791786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:55.797800 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-41007874-0d4e-4b1e-9ba8-63847f0eaad8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1184 microversion: 2.25 time: 0.150663 Sep 10 20:53:55.804375 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 787/1537] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:53:55 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1184 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:53:55.982451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-aa3319c8-27fe-46ad-8a02-ec4d4be1ff3b req-c46d611e-47a9-4125-b897-392659da04e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e18c6b-6c06-42cf-8651-53cdb6c30ff7", "name": "network-vif-plugged", "status": "completed", "tag": "59ec7720-9ed7-4a7c-8d8c-cb6a33ecbc8d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:56.000029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa3319c8-27fe-46ad-8a02-ec4d4be1ff3b req-c46d611e-47a9-4125-b897-392659da04e5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:56.000622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa3319c8-27fe-46ad-8a02-ec4d4be1ff3b req-c46d611e-47a9-4125-b897-392659da04e5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:56.001203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa3319c8-27fe-46ad-8a02-ec4d4be1ff3b req-c46d611e-47a9-4125-b897-392659da04e5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:56.016770 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-aa3319c8-27fe-46ad-8a02-ec4d4be1ff3b req-c46d611e-47a9-4125-b897-392659da04e5 service nova] Creating event network-vif-plugged:59ec7720-9ed7-4a7c-8d8c-cb6a33ecbc8d for instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 on nch1-master-1 Sep 10 20:53:56.024369 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-aa3319c8-27fe-46ad-8a02-ec4d4be1ff3b req-c46d611e-47a9-4125-b897-392659da04e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045993 Sep 10 20:53:56.025294 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 788/1538] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:53:56.197547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-97789620-a0f1-478c-adc5-f3c4c70b0466 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:56.198669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-97789620-a0f1-478c-adc5-f3c4c70b0466 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:56.207863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97789620-a0f1-478c-adc5-f3c4c70b0466 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:56.208953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97789620-a0f1-478c-adc5-f3c4c70b0466 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:56.209625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97789620-a0f1-478c-adc5-f3c4c70b0466 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:56.210632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97789620-a0f1-478c-adc5-f3c4c70b0466 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:56.212235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97789620-a0f1-478c-adc5-f3c4c70b0466 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:56.212925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97789620-a0f1-478c-adc5-f3c4c70b0466 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:56.441230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-97789620-a0f1-478c-adc5-f3c4c70b0466 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:56.456561 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-97789620-a0f1-478c-adc5-f3c4c70b0466 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1322 microversion: 2.1 time: 0.263793 Sep 10 20:53:56.458241 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 789/1539] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:56 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:53:56.470218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81fe2c19-e24b-43e8-a460-f17224bbce7f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:56.471177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81fe2c19-e24b-43e8-a460-f17224bbce7f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:56.500012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fe2c19-e24b-43e8-a460-f17224bbce7f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:56.513957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fe2c19-e24b-43e8-a460-f17224bbce7f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:56.514796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fe2c19-e24b-43e8-a460-f17224bbce7f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:56.516304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fe2c19-e24b-43e8-a460-f17224bbce7f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:56.517018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fe2c19-e24b-43e8-a460-f17224bbce7f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:56.517518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fe2c19-e24b-43e8-a460-f17224bbce7f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:57.152520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-81fe2c19-e24b-43e8-a460-f17224bbce7f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:57.167855 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81fe2c19-e24b-43e8-a460-f17224bbce7f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1543 microversion: 2.1 time: 0.706249 Sep 10 20:53:57.168818 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 790/1540] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:56 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1543 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:57.188115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6abdb5b8-0ff2-415d-b730-02e209ab0e86 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:57.188988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6abdb5b8-0ff2-415d-b730-02e209ab0e86 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:57.202629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6abdb5b8-0ff2-415d-b730-02e209ab0e86 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:57.203425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6abdb5b8-0ff2-415d-b730-02e209ab0e86 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:57.204034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6abdb5b8-0ff2-415d-b730-02e209ab0e86 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:57.204916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6abdb5b8-0ff2-415d-b730-02e209ab0e86 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:57.205533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6abdb5b8-0ff2-415d-b730-02e209ab0e86 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:57.208996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6abdb5b8-0ff2-415d-b730-02e209ab0e86 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:57.434130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Getting quotas for project bbee44bfe21341d295b8c2290f692085. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:57.461182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Getting quotas for user 5b0c267722f14e7fa87395f796551ab5 and project bbee44bfe21341d295b8c2290f692085. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:57.503000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:53:57.507021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:53:57.508431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:53:57.510136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:53:57.511559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:53:57.536123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:57.539101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:57.540720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:57.541967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:57.546136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:57.546932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:57.591204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Getting quotas for project bbee44bfe21341d295b8c2290f692085. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:53:57.606806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Getting quotas for user 5b0c267722f14e7fa87395f796551ab5 and project bbee44bfe21341d295b8c2290f692085. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:53:57.770092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:53:57.773017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c646f933-5c16-4429-b5b8-315fd6386033',volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:53:57.983513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6abdb5b8-0ff2-415d-b730-02e209ab0e86 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:57.993295 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6abdb5b8-0ff2-415d-b730-02e209ab0e86 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.819510 Sep 10 20:53:57.993919 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 791/1541] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:57 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:58.017869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:58.022482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:58.036093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:58.038553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:58.039429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:58.042394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:58.043077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:58.045759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:58.118063 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8f5cad55-34d7-47b3-aa45-9ca3631991e4 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.948750 Sep 10 20:53:58.122125 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 751/1542] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:53:55 2022] POST /compute/v2.1/servers => generated 407 bytes in 2953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:53:58.132752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-49f9adb4-6751-4f39-9f5b-1d65dba018d8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:58.133751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-49f9adb4-6751-4f39-9f5b-1d65dba018d8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:58.153003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49f9adb4-6751-4f39-9f5b-1d65dba018d8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:58.153978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49f9adb4-6751-4f39-9f5b-1d65dba018d8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:58.155199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49f9adb4-6751-4f39-9f5b-1d65dba018d8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:58.156307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49f9adb4-6751-4f39-9f5b-1d65dba018d8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:58.156972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49f9adb4-6751-4f39-9f5b-1d65dba018d8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:58.158831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49f9adb4-6751-4f39-9f5b-1d65dba018d8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:58.330267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:58.343445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:58.349602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:58.351005 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-13b1b64c-101b-49ef-8bb6-417c830e6d3d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1250 microversion: 2.25 time: 0.347173 Sep 10 20:53:58.354922 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 792/1543] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:53:58 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1250 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:53:58.394132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0b9238ef-25d5-4a95-ad54-de6d74ca3b48 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:58.395723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0b9238ef-25d5-4a95-ad54-de6d74ca3b48 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:58.478457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-49f9adb4-6751-4f39-9f5b-1d65dba018d8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:58.498181 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-49f9adb4-6751-4f39-9f5b-1d65dba018d8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1516 microversion: 2.1 time: 0.373884 Sep 10 20:53:58.509852 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 752/1544] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:58 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1516 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:58.509852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0442897d-94e5-44ae-bc15-5d47262edbea tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:58.509852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0442897d-94e5-44ae-bc15-5d47262edbea tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:58.511623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0442897d-94e5-44ae-bc15-5d47262edbea tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:58.512382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0442897d-94e5-44ae-bc15-5d47262edbea tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:58.513037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0442897d-94e5-44ae-bc15-5d47262edbea tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:58.514509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0442897d-94e5-44ae-bc15-5d47262edbea tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:58.515123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0442897d-94e5-44ae-bc15-5d47262edbea tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:58.515699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0442897d-94e5-44ae-bc15-5d47262edbea tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:58.636191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0b9238ef-25d5-4a95-ad54-de6d74ca3b48 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:58.651706 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0b9238ef-25d5-4a95-ad54-de6d74ca3b48 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1120 microversion: 2.1 time: 0.278682 Sep 10 20:53:58.658834 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 793/1545] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:58 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1120 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:58.673580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f99f1025-5b4b-4d43-8acf-8f96530bbcb3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:53:58.687060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f99f1025-5b4b-4d43-8acf-8f96530bbcb3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:58.697497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f1025-5b4b-4d43-8acf-8f96530bbcb3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:58.698093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f1025-5b4b-4d43-8acf-8f96530bbcb3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:58.698631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f1025-5b4b-4d43-8acf-8f96530bbcb3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:58.699561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f1025-5b4b-4d43-8acf-8f96530bbcb3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:58.706340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f1025-5b4b-4d43-8acf-8f96530bbcb3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:58.707461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f1025-5b4b-4d43-8acf-8f96530bbcb3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:58.838210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-f99f1025-5b4b-4d43-8acf-8f96530bbcb3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lazy-loading 'flavor' on Instance uuid 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:53:58.843795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0442897d-94e5-44ae-bc15-5d47262edbea tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:58.891632 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0442897d-94e5-44ae-bc15-5d47262edbea tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1543 microversion: 2.1 time: 0.377634 Sep 10 20:53:58.893076 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 753/1546] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:58 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1543 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:53:59.021630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f180cce0-f22a-4091-90c8-f805aaa78812 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:59.022622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f180cce0-f22a-4091-90c8-f805aaa78812 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:59.053067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f180cce0-f22a-4091-90c8-f805aaa78812 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:59.053584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f180cce0-f22a-4091-90c8-f805aaa78812 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:59.064071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f180cce0-f22a-4091-90c8-f805aaa78812 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:59.065923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f180cce0-f22a-4091-90c8-f805aaa78812 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:59.067902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f180cce0-f22a-4091-90c8-f805aaa78812 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:59.070768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f180cce0-f22a-4091-90c8-f805aaa78812 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:59.078363 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f99f1025-5b4b-4d43-8acf-8f96530bbcb3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7/action" status: 200 len: 32 microversion: 2.1 time: 0.416436 Sep 10 20:53:59.079522 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 794/1547] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:53:58 2022] POST /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7/action => generated 32 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:53:59.109156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0e77def8-8496-4c05-a6fc-2353d9c1b258 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:59.109776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0e77def8-8496-4c05-a6fc-2353d9c1b258 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:59.145673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e77def8-8496-4c05-a6fc-2353d9c1b258 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:59.146351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e77def8-8496-4c05-a6fc-2353d9c1b258 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:59.146794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e77def8-8496-4c05-a6fc-2353d9c1b258 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:59.147513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e77def8-8496-4c05-a6fc-2353d9c1b258 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:59.147970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e77def8-8496-4c05-a6fc-2353d9c1b258 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:59.148389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e77def8-8496-4c05-a6fc-2353d9c1b258 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:59.816356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f180cce0-f22a-4091-90c8-f805aaa78812 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:53:59.835139 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f180cce0-f22a-4091-90c8-f805aaa78812 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.814900 Sep 10 20:53:59.835810 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 754/1548] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:59 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:53:59.850426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:53:59.850426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:53:59.875301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:59.875799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:59.897577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:53:59.899144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:53:59.899857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:53:59.900568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:00.140858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:00.149564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:00.159293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:00.161311 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-06fe817f-224c-4ce2-9b48-c0beed24cb00 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1250 microversion: 2.25 time: 0.323518 Sep 10 20:54:00.161916 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 755/1549] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:53:59 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1250 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:00.180994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4bfd0855-f8f7-4910-964a-9ae2246aec38 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:00.183415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4bfd0855-f8f7-4910-964a-9ae2246aec38 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:00.208827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bfd0855-f8f7-4910-964a-9ae2246aec38 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:00.209620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bfd0855-f8f7-4910-964a-9ae2246aec38 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:00.212230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bfd0855-f8f7-4910-964a-9ae2246aec38 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:00.213203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bfd0855-f8f7-4910-964a-9ae2246aec38 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:00.215340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bfd0855-f8f7-4910-964a-9ae2246aec38 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:00.215786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bfd0855-f8f7-4910-964a-9ae2246aec38 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:00.255742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0e77def8-8496-4c05-a6fc-2353d9c1b258 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:00.277248 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0e77def8-8496-4c05-a6fc-2353d9c1b258 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 1.187141 Sep 10 20:54:00.296663 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 795/1550] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:53:59 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:00.308997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c200c257-8b86-43de-a068-1decc66c4bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:00.309630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c200c257-8b86-43de-a068-1decc66c4bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:00.319623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c200c257-8b86-43de-a068-1decc66c4bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:00.320122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c200c257-8b86-43de-a068-1decc66c4bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:00.320557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c200c257-8b86-43de-a068-1decc66c4bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:00.321269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c200c257-8b86-43de-a068-1decc66c4bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:00.321721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c200c257-8b86-43de-a068-1decc66c4bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:00.322798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c200c257-8b86-43de-a068-1decc66c4bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:00.446353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4bfd0855-f8f7-4910-964a-9ae2246aec38 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:00.454242 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4bfd0855-f8f7-4910-964a-9ae2246aec38 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1218 microversion: 2.1 time: 0.291236 Sep 10 20:54:00.462868 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 756/1551] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:00 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1218 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:00.869059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3768dd52-6841-48cd-b33f-41565479071e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:00.869715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3768dd52-6841-48cd-b33f-41565479071e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:00.884236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3768dd52-6841-48cd-b33f-41565479071e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:00.885111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3768dd52-6841-48cd-b33f-41565479071e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:00.886717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3768dd52-6841-48cd-b33f-41565479071e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:00.887662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3768dd52-6841-48cd-b33f-41565479071e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:00.889844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3768dd52-6841-48cd-b33f-41565479071e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:00.890554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3768dd52-6841-48cd-b33f-41565479071e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:01.146415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3768dd52-6841-48cd-b33f-41565479071e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:01.157353 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3768dd52-6841-48cd-b33f-41565479071e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.292387 Sep 10 20:54:01.167577 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 757/1552] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:00 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:01.192028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:01.194087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:01.201635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:01.202464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:01.203092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:01.203997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:01.205302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:01.206137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:01.283692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:01.298519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:01.304120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:01.305858 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5c46d3d4-019e-4e47-84c9-752b9b177c94 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1238 microversion: 2.25 time: 0.119714 Sep 10 20:54:01.307021 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 758/1553] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:01 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:54:01.325694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8fcf5524-a862-4e8b-81c6-c104d32926ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:01.327368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8fcf5524-a862-4e8b-81c6-c104d32926ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:01.336857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fcf5524-a862-4e8b-81c6-c104d32926ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:01.340629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fcf5524-a862-4e8b-81c6-c104d32926ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:01.341582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fcf5524-a862-4e8b-81c6-c104d32926ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:01.342542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fcf5524-a862-4e8b-81c6-c104d32926ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:01.343002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fcf5524-a862-4e8b-81c6-c104d32926ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:01.343603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fcf5524-a862-4e8b-81c6-c104d32926ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:01.508960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c200c257-8b86-43de-a068-1decc66c4bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:01.525931 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c200c257-8b86-43de-a068-1decc66c4bcc tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1543 microversion: 2.1 time: 1.228170 Sep 10 20:54:01.526685 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 796/1554] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:00 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1543 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:01.551281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-44bbac6f-9f70-4db6-9cfe-8a8cd650e0e9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:01.552147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-44bbac6f-9f70-4db6-9cfe-8a8cd650e0e9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:01.560502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44bbac6f-9f70-4db6-9cfe-8a8cd650e0e9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:01.563152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44bbac6f-9f70-4db6-9cfe-8a8cd650e0e9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:01.564081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44bbac6f-9f70-4db6-9cfe-8a8cd650e0e9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:01.565004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44bbac6f-9f70-4db6-9cfe-8a8cd650e0e9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:01.565638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44bbac6f-9f70-4db6-9cfe-8a8cd650e0e9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:01.566254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44bbac6f-9f70-4db6-9cfe-8a8cd650e0e9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:01.601678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8fcf5524-a862-4e8b-81c6-c104d32926ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:01.616714 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8fcf5524-a862-4e8b-81c6-c104d32926ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.308629 Sep 10 20:54:01.618620 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 759/1555] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:01 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:01.934393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-44bbac6f-9f70-4db6-9cfe-8a8cd650e0e9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:01.943011 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-44bbac6f-9f70-4db6-9cfe-8a8cd650e0e9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1236 microversion: 2.1 time: 0.396088 Sep 10 20:54:01.943601 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 797/1556] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:01 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1236 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:02.182200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fc01fbfa-e05b-4c88-8ae3-826f6bb4c3a4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:02.182830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fc01fbfa-e05b-4c88-8ae3-826f6bb4c3a4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:02.191892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc01fbfa-e05b-4c88-8ae3-826f6bb4c3a4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:02.214181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc01fbfa-e05b-4c88-8ae3-826f6bb4c3a4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:02.214883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc01fbfa-e05b-4c88-8ae3-826f6bb4c3a4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:02.215904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc01fbfa-e05b-4c88-8ae3-826f6bb4c3a4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:02.216599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc01fbfa-e05b-4c88-8ae3-826f6bb4c3a4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:02.217233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc01fbfa-e05b-4c88-8ae3-826f6bb4c3a4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:02.331796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:02.332406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:02.342973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:02.344198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:02.344811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:02.345702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:02.346345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:02.348024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:02.510145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fc01fbfa-e05b-4c88-8ae3-826f6bb4c3a4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:02.530130 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fc01fbfa-e05b-4c88-8ae3-826f6bb4c3a4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.348531 Sep 10 20:54:02.548167 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 760/1557] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:02 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:02.559766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-90098684-5199-43e5-b87b-5ab67e42121c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:02.560548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-90098684-5199-43e5-b87b-5ab67e42121c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:02.578707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90098684-5199-43e5-b87b-5ab67e42121c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:02.579281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90098684-5199-43e5-b87b-5ab67e42121c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:02.581362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90098684-5199-43e5-b87b-5ab67e42121c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:02.582549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90098684-5199-43e5-b87b-5ab67e42121c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:02.584586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90098684-5199-43e5-b87b-5ab67e42121c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:02.586545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90098684-5199-43e5-b87b-5ab67e42121c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:03.352473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-90098684-5199-43e5-b87b-5ab67e42121c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:03.364346 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-90098684-5199-43e5-b87b-5ab67e42121c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1543 microversion: 2.1 time: 0.810006 Sep 10 20:54:03.382088 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 761/1558] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:02 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1543 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:03.394260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2ff8e594-e2d1-43b2-9cb4-2ac866b16168 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:03.401519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2ff8e594-e2d1-43b2-9cb4-2ac866b16168 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:03.409479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ff8e594-e2d1-43b2-9cb4-2ac866b16168 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:03.410422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ff8e594-e2d1-43b2-9cb4-2ac866b16168 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:03.410658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ff8e594-e2d1-43b2-9cb4-2ac866b16168 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:03.421909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ff8e594-e2d1-43b2-9cb4-2ac866b16168 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:03.422443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ff8e594-e2d1-43b2-9cb4-2ac866b16168 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:03.423037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ff8e594-e2d1-43b2-9cb4-2ac866b16168 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:03.449105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:03.459042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:03.473420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:03.480286 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8fd4502a-09da-4d43-bc1c-a5754976a403 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1280 microversion: 2.25 time: 1.146849 Sep 10 20:54:03.490154 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 798/1559] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:02 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1280 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:54:03.490154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c76c430-4880-4dfc-a2c1-5daadfb6d0b9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:03.496524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9c76c430-4880-4dfc-a2c1-5daadfb6d0b9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:03.507396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c76c430-4880-4dfc-a2c1-5daadfb6d0b9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:03.510740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c76c430-4880-4dfc-a2c1-5daadfb6d0b9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:03.511407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c76c430-4880-4dfc-a2c1-5daadfb6d0b9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:03.512288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c76c430-4880-4dfc-a2c1-5daadfb6d0b9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:03.512766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c76c430-4880-4dfc-a2c1-5daadfb6d0b9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:03.513953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c76c430-4880-4dfc-a2c1-5daadfb6d0b9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:03.661858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c76c430-4880-4dfc-a2c1-5daadfb6d0b9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:03.678836 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c76c430-4880-4dfc-a2c1-5daadfb6d0b9 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1224 microversion: 2.1 time: 0.196084 Sep 10 20:54:03.679839 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 799/1560] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:03 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:03.698647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c9bc873f-5fd3-4fb5-8055-01a430d77b93 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:03.699697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c9bc873f-5fd3-4fb5-8055-01a430d77b93 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:03.707597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9bc873f-5fd3-4fb5-8055-01a430d77b93 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:03.708425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9bc873f-5fd3-4fb5-8055-01a430d77b93 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:03.709117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9bc873f-5fd3-4fb5-8055-01a430d77b93 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:03.710088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9bc873f-5fd3-4fb5-8055-01a430d77b93 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:03.710774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9bc873f-5fd3-4fb5-8055-01a430d77b93 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:03.711910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9bc873f-5fd3-4fb5-8055-01a430d77b93 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:03.910988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2ff8e594-e2d1-43b2-9cb4-2ac866b16168 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:03.930463 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2ff8e594-e2d1-43b2-9cb4-2ac866b16168 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.543400 Sep 10 20:54:03.931522 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 762/1561] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:03 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:03.936946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8420ed9c-7048-40a1-bc0b-ff94386eae7f req-370902be-78ff-4ac0-b8e2-76ef40972b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662c3986-cb45-4c9f-a1cf-55a8230ac15a", "name": "network-vif-unplugged", "status": "completed", "tag": "3a19535d-5974-4093-a3ab-f07270e88e01"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:03.956900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8420ed9c-7048-40a1-bc0b-ff94386eae7f req-370902be-78ff-4ac0-b8e2-76ef40972b5b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:03.958684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8420ed9c-7048-40a1-bc0b-ff94386eae7f req-370902be-78ff-4ac0-b8e2-76ef40972b5b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:03.959386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8420ed9c-7048-40a1-bc0b-ff94386eae7f req-370902be-78ff-4ac0-b8e2-76ef40972b5b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:04.004101 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8420ed9c-7048-40a1-bc0b-ff94386eae7f req-370902be-78ff-4ac0-b8e2-76ef40972b5b service nova] Creating event network-vif-unplugged:3a19535d-5974-4093-a3ab-f07270e88e01 for instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a on nch1-master-1 Sep 10 20:54:04.011366 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8420ed9c-7048-40a1-bc0b-ff94386eae7f req-370902be-78ff-4ac0-b8e2-76ef40972b5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077354 Sep 10 20:54:04.013996 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 763/1562] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:04.263201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c9bc873f-5fd3-4fb5-8055-01a430d77b93 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:04.273553 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c9bc873f-5fd3-4fb5-8055-01a430d77b93 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.592015 Sep 10 20:54:04.278191 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 800/1563] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:03 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:04.393856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-308b1850-446c-4c25-86f2-a4c20087958b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:04.395648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-308b1850-446c-4c25-86f2-a4c20087958b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:04.406054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308b1850-446c-4c25-86f2-a4c20087958b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:04.406690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308b1850-446c-4c25-86f2-a4c20087958b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:04.406984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308b1850-446c-4c25-86f2-a4c20087958b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:04.407689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308b1850-446c-4c25-86f2-a4c20087958b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:04.408144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308b1850-446c-4c25-86f2-a4c20087958b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:04.408573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308b1850-446c-4c25-86f2-a4c20087958b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:04.516243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:04.517618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:04.527409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:04.533430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:04.534041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:04.535643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:04.536389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:04.536918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:04.538052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:04.769976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-308b1850-446c-4c25-86f2-a4c20087958b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:04.779835 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-308b1850-446c-4c25-86f2-a4c20087958b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1543 microversion: 2.1 time: 0.390771 Sep 10 20:54:04.786165 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 764/1564] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:04 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1543 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:04.793598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5ac36bd4-14de-4e58-85b6-8812edd6aab5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:04.796508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5ac36bd4-14de-4e58-85b6-8812edd6aab5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:04.809310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ac36bd4-14de-4e58-85b6-8812edd6aab5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:04.816803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ac36bd4-14de-4e58-85b6-8812edd6aab5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:04.817543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ac36bd4-14de-4e58-85b6-8812edd6aab5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:04.819175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ac36bd4-14de-4e58-85b6-8812edd6aab5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:04.819818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ac36bd4-14de-4e58-85b6-8812edd6aab5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:04.823011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ac36bd4-14de-4e58-85b6-8812edd6aab5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:05.412561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:05.431551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:05.435940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:05.438118 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-08fd6818-8c9b-41b4-b29c-852111dd577e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1280 microversion: 2.25 time: 0.929209 Sep 10 20:54:05.441093 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 801/1565] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:04 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1280 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:54:05.454721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-656ce51c-80b7-45d2-ab91-ea3945a9c9a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:05.458320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-656ce51c-80b7-45d2-ab91-ea3945a9c9a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:05.473878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-656ce51c-80b7-45d2-ab91-ea3945a9c9a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:05.477367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-656ce51c-80b7-45d2-ab91-ea3945a9c9a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:05.478349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-656ce51c-80b7-45d2-ab91-ea3945a9c9a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:05.480225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-656ce51c-80b7-45d2-ab91-ea3945a9c9a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:05.484127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-656ce51c-80b7-45d2-ab91-ea3945a9c9a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:05.486019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-656ce51c-80b7-45d2-ab91-ea3945a9c9a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:05.927064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5ac36bd4-14de-4e58-85b6-8812edd6aab5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:05.944864 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5ac36bd4-14de-4e58-85b6-8812edd6aab5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 1.157371 Sep 10 20:54:05.946171 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 765/1566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:04 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:05.957693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0a8928e5-835e-4df6-b857-0c5159f345d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:05.958788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0a8928e5-835e-4df6-b857-0c5159f345d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:05.981181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a8928e5-835e-4df6-b857-0c5159f345d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:05.981671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a8928e5-835e-4df6-b857-0c5159f345d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:05.985591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a8928e5-835e-4df6-b857-0c5159f345d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:05.986456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a8928e5-835e-4df6-b857-0c5159f345d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:05.986945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a8928e5-835e-4df6-b857-0c5159f345d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:05.989923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a8928e5-835e-4df6-b857-0c5159f345d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:06.445657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0a8928e5-835e-4df6-b857-0c5159f345d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:06.459838 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0a8928e5-835e-4df6-b857-0c5159f345d0 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.509485 Sep 10 20:54:06.470395 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 766/1567] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:05 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:06.478292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1f1a2b58-99f5-401f-b354-8fd57d63a82b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:06.479152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1f1a2b58-99f5-401f-b354-8fd57d63a82b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:06.495882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1a2b58-99f5-401f-b354-8fd57d63a82b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:06.496534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1a2b58-99f5-401f-b354-8fd57d63a82b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:06.497139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1a2b58-99f5-401f-b354-8fd57d63a82b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:06.507936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1a2b58-99f5-401f-b354-8fd57d63a82b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:06.508710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1a2b58-99f5-401f-b354-8fd57d63a82b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:06.509349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f1a2b58-99f5-401f-b354-8fd57d63a82b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:06.846400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-656ce51c-80b7-45d2-ab91-ea3945a9c9a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:06.857526 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-656ce51c-80b7-45d2-ab91-ea3945a9c9a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 1.413214 Sep 10 20:54:06.870440 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 802/1568] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:05 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:06.870440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ec3d01ed-008f-4c29-a412-9fa461ba47d4 req-ed8546ad-8858-4308-a2f1-4b6703dda3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662c3986-cb45-4c9f-a1cf-55a8230ac15a", "tag": "3a19535d-5974-4093-a3ab-f07270e88e01"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:06.883699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ec3d01ed-008f-4c29-a412-9fa461ba47d4 req-ed8546ad-8858-4308-a2f1-4b6703dda3b3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:06.884399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ec3d01ed-008f-4c29-a412-9fa461ba47d4 req-ed8546ad-8858-4308-a2f1-4b6703dda3b3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:06.885227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ec3d01ed-008f-4c29-a412-9fa461ba47d4 req-ed8546ad-8858-4308-a2f1-4b6703dda3b3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:06.905799 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ec3d01ed-008f-4c29-a412-9fa461ba47d4 req-ed8546ad-8858-4308-a2f1-4b6703dda3b3 service nova] Creating event network-changed:3a19535d-5974-4093-a3ab-f07270e88e01 for instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a on nch1-master-1 Sep 10 20:54:06.914369 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ec3d01ed-008f-4c29-a412-9fa461ba47d4 req-ed8546ad-8858-4308-a2f1-4b6703dda3b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052945 Sep 10 20:54:06.915143 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 803/1569] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:06.923560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:06.924623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:06.944916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:06.947617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:06.949459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:06.951992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:06.952727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:06.954666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:07.009309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:07.031881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1f1a2b58-99f5-401f-b354-8fd57d63a82b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:07.048842 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1f1a2b58-99f5-401f-b354-8fd57d63a82b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1542 microversion: 2.1 time: 0.572901 Sep 10 20:54:07.052454 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 767/1570] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:06 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1542 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:07.060963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b0ae662d-ba26-4244-b528-9093ff254d95 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Calling method '.version_select at 0x7f9944c065e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:07.121776 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b0ae662d-ba26-4244-b528-9093ff254d95 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9" status: 200 len: 636 microversion: 2.1 time: 0.067672 Sep 10 20:54:07.123032 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 768/1571] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:54:07 2022] GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9 => generated 636 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:07.128424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2e2641a-6ec2-4ae5-aa68-67d5e9c0aaf3 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:07.129075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c2e2641a-6ec2-4ae5-aa68-67d5e9c0aaf3 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:07.136008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2e2641a-6ec2-4ae5-aa68-67d5e9c0aaf3 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:07.136713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2e2641a-6ec2-4ae5-aa68-67d5e9c0aaf3 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:07.137339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2e2641a-6ec2-4ae5-aa68-67d5e9c0aaf3 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:07.138620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2e2641a-6ec2-4ae5-aa68-67d5e9c0aaf3 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:07.139674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2e2641a-6ec2-4ae5-aa68-67d5e9c0aaf3 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:07.140292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2e2641a-6ec2-4ae5-aa68-67d5e9c0aaf3 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:07.145781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:07.574099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:07.597985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c2e2641a-6ec2-4ae5-aa68-67d5e9c0aaf3 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:07.621786 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c2e2641a-6ec2-4ae5-aa68-67d5e9c0aaf3 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.496444 Sep 10 20:54:07.625263 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 769/1572] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:07 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:07.627309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=10 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:07.634133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f5d27d47-6adb-41f7-b9ad-644d9d59f017 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Action: 'update_all', calling method: .version_select at 0x7f9944c06e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:07.685731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:07.725659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:07.734934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:07.736093 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-484cb0b9-4fa0-4a96-bbb3-371533008209 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1280 microversion: 2.25 time: 0.819589 Sep 10 20:54:07.740988 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 804/1573] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:06 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1280 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:07.787933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f5d27d47-6adb-41f7-b9ad-644d9d59f017 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:07.807175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9e83398e-6270-477e-ae75-544a726d1345 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:07.811856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9e83398e-6270-477e-ae75-544a726d1345 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:07.822671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f5d27d47-6adb-41f7-b9ad-644d9d59f017 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for user 8b615ba669104c3b92734b838a026594 and project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:07.830548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e83398e-6270-477e-ae75-544a726d1345 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:07.831172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e83398e-6270-477e-ae75-544a726d1345 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:07.831612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e83398e-6270-477e-ae75-544a726d1345 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:07.832328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e83398e-6270-477e-ae75-544a726d1345 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:07.832779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e83398e-6270-477e-ae75-544a726d1345 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:07.833203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e83398e-6270-477e-ae75-544a726d1345 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:08.317138 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f5d27d47-6adb-41f7-b9ad-644d9d59f017 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.690350 Sep 10 20:54:08.321987 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 770/1574] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:54:07 2022] PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 61 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:08.323382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a73e5232-b4cc-4aeb-b7fd-399eda75bed4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:08.324046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a73e5232-b4cc-4aeb-b7fd-399eda75bed4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:08.343358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a73e5232-b4cc-4aeb-b7fd-399eda75bed4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:08.344584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a73e5232-b4cc-4aeb-b7fd-399eda75bed4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:08.345182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a73e5232-b4cc-4aeb-b7fd-399eda75bed4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:08.346239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a73e5232-b4cc-4aeb-b7fd-399eda75bed4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:08.349487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a73e5232-b4cc-4aeb-b7fd-399eda75bed4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:08.350165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a73e5232-b4cc-4aeb-b7fd-399eda75bed4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:08.651448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:08.685513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9e83398e-6270-477e-ae75-544a726d1345 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:08.699510 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9e83398e-6270-477e-ae75-544a726d1345 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.933787 Sep 10 20:54:08.703434 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 805/1575] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:07 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:08.711517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42d3814f-715d-4439-b267-940c804b0a41 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:08.717731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-42d3814f-715d-4439-b267-940c804b0a41 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:08.729108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42d3814f-715d-4439-b267-940c804b0a41 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:08.730288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42d3814f-715d-4439-b267-940c804b0a41 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:08.730937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42d3814f-715d-4439-b267-940c804b0a41 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:08.732058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42d3814f-715d-4439-b267-940c804b0a41 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:08.732661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42d3814f-715d-4439-b267-940c804b0a41 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:08.738570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42d3814f-715d-4439-b267-940c804b0a41 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:08.781928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a73e5232-b4cc-4aeb-b7fd-399eda75bed4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:08.792727 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a73e5232-b4cc-4aeb-b7fd-399eda75bed4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.472220 Sep 10 20:54:08.793668 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 771/1576] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:08 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:08.829860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-746d667c-810d-4220-bfce-3c1b2e1e5a55 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Calling method '.version_select at 0x7f9944bdea60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:09.106760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-42d3814f-715d-4439-b267-940c804b0a41 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:09.124043 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-42d3814f-715d-4439-b267-940c804b0a41 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1474 microversion: 2.1 time: 0.413923 Sep 10 20:54:09.126305 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 806/1577] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:08 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1474 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:09.138479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ce552ad-0a17-46b2-9618-79629fd860c6 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:09.141770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2ce552ad-0a17-46b2-9618-79629fd860c6 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:09.157696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce552ad-0a17-46b2-9618-79629fd860c6 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:09.158258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce552ad-0a17-46b2-9618-79629fd860c6 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:09.158713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce552ad-0a17-46b2-9618-79629fd860c6 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:09.159447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce552ad-0a17-46b2-9618-79629fd860c6 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:09.162163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce552ad-0a17-46b2-9618-79629fd860c6 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:09.166569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ce552ad-0a17-46b2-9618-79629fd860c6 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:09.253968 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-746d667c-810d-4220-bfce-3c1b2e1e5a55 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "DELETE /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.457543 Sep 10 20:54:09.256381 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 772/1578] 10.222.0.33 () {58 vars in 1296 bytes} [Sat Sep 10 20:54:08 2022] DELETE /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata/os_version => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:54:09.263968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:09.266006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:09.289078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:09.291652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:09.295050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:09.297478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:09.299361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:09.299730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:09.455456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ce552ad-0a17-46b2-9618-79629fd860c6 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:09.464298 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ce552ad-0a17-46b2-9618-79629fd860c6 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.333437 Sep 10 20:54:09.492046 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 807/1579] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:09 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:09.502163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6f31e404-000d-4355-9f8f-caed0e80384e req-bf768d4a-fe69-4718-bf50-950af5006f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb73142-7fcb-44b4-8ff3-b7624fc5b494", "tag": "9c462d3d-b794-4637-b520-7d89a1ddcec2"}, {"name": "network-changed", "server_uuid": "6b0c2412-dd72-4889-8cce-8ec836eaf5e9", "tag": "420c3ef6-3c60-4b0b-b607-faebafccc318"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:09.515696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6f31e404-000d-4355-9f8f-caed0e80384e req-bf768d4a-fe69-4718-bf50-950af5006f62 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:09.516606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6f31e404-000d-4355-9f8f-caed0e80384e req-bf768d4a-fe69-4718-bf50-950af5006f62 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:09.517269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6f31e404-000d-4355-9f8f-caed0e80384e req-bf768d4a-fe69-4718-bf50-950af5006f62 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:09.537002 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6f31e404-000d-4355-9f8f-caed0e80384e req-bf768d4a-fe69-4718-bf50-950af5006f62 service nova] Creating event network-changed:9c462d3d-b794-4637-b520-7d89a1ddcec2 for instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 on nch1-master-1 Sep 10 20:54:09.537896 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6f31e404-000d-4355-9f8f-caed0e80384e req-bf768d4a-fe69-4718-bf50-950af5006f62 service nova] Creating event network-changed:420c3ef6-3c60-4b0b-b607-faebafccc318 for instance 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 on nch1-master-1 Sep 10 20:54:09.544746 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6f31e404-000d-4355-9f8f-caed0e80384e req-bf768d4a-fe69-4718-bf50-950af5006f62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050622 Sep 10 20:54:09.545983 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 808/1580] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:09.551965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0ac5b0b1-3ffa-47a5-925e-eda71467a51c tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Calling method '.version_select at 0x7f9944935f70>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:09.609241 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0ac5b0b1-3ffa-47a5-925e-eda71467a51c tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 37 microversion: 2.1 time: 0.061770 Sep 10 20:54:09.611622 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 809/1581] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:54:09 2022] GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 37 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:09.617544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f35e5735-715f-4d44-8d0d-924e04a8d445 req-b2c01464-419a-4aa6-ad0d-aad7ae9e03b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e1970c-5740-4466-911f-5aef17b7336e", "name": "network-vif-unplugged", "status": "completed", "tag": "fd86c8ba-198f-490e-a5da-475f9082b557"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:09.630136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f35e5735-715f-4d44-8d0d-924e04a8d445 req-b2c01464-419a-4aa6-ad0d-aad7ae9e03b5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:09.630888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f35e5735-715f-4d44-8d0d-924e04a8d445 req-b2c01464-419a-4aa6-ad0d-aad7ae9e03b5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:09.631509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f35e5735-715f-4d44-8d0d-924e04a8d445 req-b2c01464-419a-4aa6-ad0d-aad7ae9e03b5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:09.644438 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f35e5735-715f-4d44-8d0d-924e04a8d445 req-b2c01464-419a-4aa6-ad0d-aad7ae9e03b5 service nova] Creating event network-vif-unplugged:fd86c8ba-198f-490e-a5da-475f9082b557 for instance a4e1970c-5740-4466-911f-5aef17b7336e on nch2-master-1 Sep 10 20:54:09.650870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-f35e5735-715f-4d44-8d0d-924e04a8d445 req-b2c01464-419a-4aa6-ad0d-aad7ae9e03b5 service nova] Instance a4e1970c-5740-4466-911f-5aef17b7336e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:54:09.655328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:09.666807 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f35e5735-715f-4d44-8d0d-924e04a8d445 req-b2c01464-419a-4aa6-ad0d-aad7ae9e03b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053317 Sep 10 20:54:09.671400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:09.672895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:09.674069 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91a12a9b-5578-420d-8bb1-faf28301b96c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1280 microversion: 2.25 time: 0.416343 Sep 10 20:54:09.674646 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 773/1582] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:09 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1280 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:09.677705 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 810/1583] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:09.680783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dad574b0-f5e6-4bdc-a59c-a2f063bd0746 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Action: 'update_all', calling method: .version_select at 0x7f9944c06e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:09.734822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e92d84af-68c2-444d-b93c-e86b6e42212d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:09.736274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e92d84af-68c2-444d-b93c-e86b6e42212d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:09.742025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-dad574b0-f5e6-4bdc-a59c-a2f063bd0746 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:09.750674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92d84af-68c2-444d-b93c-e86b6e42212d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:09.750985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-dad574b0-f5e6-4bdc-a59c-a2f063bd0746 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for user 8b615ba669104c3b92734b838a026594 and project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:09.751879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92d84af-68c2-444d-b93c-e86b6e42212d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:09.753695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92d84af-68c2-444d-b93c-e86b6e42212d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:09.754831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92d84af-68c2-444d-b93c-e86b6e42212d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:09.756683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92d84af-68c2-444d-b93c-e86b6e42212d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:09.757234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92d84af-68c2-444d-b93c-e86b6e42212d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:10.097112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e92d84af-68c2-444d-b93c-e86b6e42212d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:10.111319 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e92d84af-68c2-444d-b93c-e86b6e42212d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.382173 Sep 10 20:54:10.115579 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 811/1584] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:09 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:10.120714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7dd4d7d2-201d-44be-a089-9ba365b07a63 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:10.126596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7dd4d7d2-201d-44be-a089-9ba365b07a63 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:10.145666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd4d7d2-201d-44be-a089-9ba365b07a63 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:10.146695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd4d7d2-201d-44be-a089-9ba365b07a63 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:10.147150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd4d7d2-201d-44be-a089-9ba365b07a63 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:10.148042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd4d7d2-201d-44be-a089-9ba365b07a63 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:10.148711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd4d7d2-201d-44be-a089-9ba365b07a63 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:10.149152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dd4d7d2-201d-44be-a089-9ba365b07a63 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:10.162805 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dad574b0-f5e6-4bdc-a59c-a2f063bd0746 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.487066 Sep 10 20:54:10.163413 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 774/1585] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:54:09 2022] PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 61 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:10.170445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aafa9939-39e5-485e-9f24-36b7d01961eb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:10.171408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aafa9939-39e5-485e-9f24-36b7d01961eb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:10.188418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aafa9939-39e5-485e-9f24-36b7d01961eb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:10.191122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aafa9939-39e5-485e-9f24-36b7d01961eb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:10.192022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aafa9939-39e5-485e-9f24-36b7d01961eb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:10.194498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aafa9939-39e5-485e-9f24-36b7d01961eb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:10.196688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aafa9939-39e5-485e-9f24-36b7d01961eb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:10.197404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aafa9939-39e5-485e-9f24-36b7d01961eb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:10.517706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7dd4d7d2-201d-44be-a089-9ba365b07a63 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:10.526460 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7dd4d7d2-201d-44be-a089-9ba365b07a63 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.409534 Sep 10 20:54:10.546255 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 812/1586] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:10 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:10.561908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa56bc6b-8818-49bf-a2f6-c198e4bdcf2d tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Calling method '.version_select at 0x7f99449168b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:10.593402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aafa9939-39e5-485e-9f24-36b7d01961eb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:10.629276 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aafa9939-39e5-485e-9f24-36b7d01961eb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1474 microversion: 2.1 time: 0.462286 Sep 10 20:54:10.644948 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 775/1587] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:10 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1474 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:10.659066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db096c83-a2ac-4eb3-8839-1bd31197313a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:10.661209 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fa56bc6b-8818-49bf-a2f6-c198e4bdcf2d tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.109696 Sep 10 20:54:10.669543 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 813/1588] 10.222.0.33 () {58 vars in 1290 bytes} [Sat Sep 10 20:54:10 2022] GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata/os_distro => generated 33 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:10.673012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-db096c83-a2ac-4eb3-8839-1bd31197313a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:10.688249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-687ee7e2-f6b4-4665-a27a-3f19bedc6b50 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Action: 'update_all', calling method: .version_select at 0x7f9944935b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:10.689684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db096c83-a2ac-4eb3-8839-1bd31197313a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:10.691327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db096c83-a2ac-4eb3-8839-1bd31197313a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:10.693377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db096c83-a2ac-4eb3-8839-1bd31197313a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:10.694457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db096c83-a2ac-4eb3-8839-1bd31197313a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:10.700055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db096c83-a2ac-4eb3-8839-1bd31197313a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:10.701406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db096c83-a2ac-4eb3-8839-1bd31197313a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:10.781475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-687ee7e2-f6b4-4665-a27a-3f19bedc6b50 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:10.791589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-687ee7e2-f6b4-4665-a27a-3f19bedc6b50 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for user 8b615ba669104c3b92734b838a026594 and project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:11.020878 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-687ee7e2-f6b4-4665-a27a-3f19bedc6b50 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.346887 Sep 10 20:54:11.022356 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 814/1589] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:54:10 2022] PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 61 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:11.028177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:11.029191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:11.037706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:11.038656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:11.039351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:11.040338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:11.041123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:11.042433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:11.262195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-db096c83-a2ac-4eb3-8839-1bd31197313a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:11.279665 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-db096c83-a2ac-4eb3-8839-1bd31197313a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.632835 Sep 10 20:54:11.281259 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 776/1590] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:10 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:11.289555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4e8b00f2-aa61-481d-80a2-d38a2de176a3 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Calling method '.version_select at 0x7f99451c2d30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:11.346765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:11.358991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:11.360178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:11.373145 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-de0c6f6d-011d-4061-a7f5-9f0c2c80f427 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1280 microversion: 2.25 time: 0.337351 Sep 10 20:54:11.377564 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4e8b00f2-aa61-481d-80a2-d38a2de176a3 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.094652 Sep 10 20:54:11.385349 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 777/1592] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:54:11 2022] GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 61 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:11.392379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-187bc3c4-9250-49d8-9b52-d1df20fa9744 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:11.393150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-187bc3c4-9250-49d8-9b52-d1df20fa9744 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:11.393806 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 815/1592] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:11 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1280 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:11.400842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-668c158e-37db-4417-adfb-a0f9f7d617bc tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Action: 'update_all', calling method: .version_select at 0x7f99449161f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:11.406409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-187bc3c4-9250-49d8-9b52-d1df20fa9744 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:11.407532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-187bc3c4-9250-49d8-9b52-d1df20fa9744 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:11.408297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-187bc3c4-9250-49d8-9b52-d1df20fa9744 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:11.409207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-187bc3c4-9250-49d8-9b52-d1df20fa9744 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:11.410417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-187bc3c4-9250-49d8-9b52-d1df20fa9744 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:11.411048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-187bc3c4-9250-49d8-9b52-d1df20fa9744 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:11.505541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-668c158e-37db-4417-adfb-a0f9f7d617bc tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:11.523757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-668c158e-37db-4417-adfb-a0f9f7d617bc tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for user 8b615ba669104c3b92734b838a026594 and project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:11.720675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-187bc3c4-9250-49d8-9b52-d1df20fa9744 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:11.724581 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-668c158e-37db-4417-adfb-a0f9f7d617bc tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.329580 Sep 10 20:54:11.725776 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 816/1593] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:54:11 2022] PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 61 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:11.731047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-15986523-04f7-4b7d-8911-f99ff0943199 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:11.732716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-15986523-04f7-4b7d-8911-f99ff0943199 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:11.737542 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-187bc3c4-9250-49d8-9b52-d1df20fa9744 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.350765 Sep 10 20:54:11.740334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15986523-04f7-4b7d-8911-f99ff0943199 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:11.741058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15986523-04f7-4b7d-8911-f99ff0943199 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:11.741740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15986523-04f7-4b7d-8911-f99ff0943199 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:11.742885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15986523-04f7-4b7d-8911-f99ff0943199 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:11.743555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15986523-04f7-4b7d-8911-f99ff0943199 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:11.744194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15986523-04f7-4b7d-8911-f99ff0943199 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:11.751259 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 778/1594] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:11 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:11.762910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23feeb8a-67e5-4795-b0ae-0b88c97604c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:11.763948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23feeb8a-67e5-4795-b0ae-0b88c97604c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:11.774320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23feeb8a-67e5-4795-b0ae-0b88c97604c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:11.775128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23feeb8a-67e5-4795-b0ae-0b88c97604c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:11.775817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23feeb8a-67e5-4795-b0ae-0b88c97604c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:11.776895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23feeb8a-67e5-4795-b0ae-0b88c97604c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:11.777602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23feeb8a-67e5-4795-b0ae-0b88c97604c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:11.778359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23feeb8a-67e5-4795-b0ae-0b88c97604c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:11.956546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-15986523-04f7-4b7d-8911-f99ff0943199 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:11.979716 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-15986523-04f7-4b7d-8911-f99ff0943199 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.250952 Sep 10 20:54:11.984736 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 817/1595] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:11 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:11.991263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bfcabb4d-cc04-421f-a82a-ef222e3f14c0 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Action: 'update_all', calling method: .version_select at 0x7f9944897f70>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:12.072700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bfcabb4d-cc04-421f-a82a-ef222e3f14c0 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:12.076171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:12.086093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bfcabb4d-cc04-421f-a82a-ef222e3f14c0 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for user 8b615ba669104c3b92734b838a026594 and project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:12.177808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-23feeb8a-67e5-4795-b0ae-0b88c97604c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:12.193043 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23feeb8a-67e5-4795-b0ae-0b88c97604c3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1471 microversion: 2.1 time: 0.439904 Sep 10 20:54:12.212450 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 779/1596] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:11 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:12.225706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:12.227034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:12.246182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:12.246680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:12.251461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:12.252687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:12.253096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:12.253553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:12.336692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:12.346107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:12.346881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:12.347329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:12.348074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:12.354487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:12.355093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:12.415335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for project d969d135196e409584d6647d5186c9c9. Resources: {'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:12.426359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for user 870c4c66a15b4546bd981cfb5932b214 and project d969d135196e409584d6647d5186c9c9. Resources: {'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:12.714126 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7845121f-af4f-42ac-b151-be0c24ebc18e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e/action" status: 202 len: 0 microversion: 2.1 time: 0.492051 Sep 10 20:54:12.715706 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 780/1597] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:54:12 2022] POST /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:54:12.742141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ec13acf-2255-4df7-8ead-348383a3c22c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:12.748568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0ec13acf-2255-4df7-8ead-348383a3c22c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:12.768144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec13acf-2255-4df7-8ead-348383a3c22c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:12.768940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec13acf-2255-4df7-8ead-348383a3c22c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:12.769315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec13acf-2255-4df7-8ead-348383a3c22c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:12.770269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec13acf-2255-4df7-8ead-348383a3c22c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:12.770785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec13acf-2255-4df7-8ead-348383a3c22c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:12.773301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ec13acf-2255-4df7-8ead-348383a3c22c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:12.931696 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bfcabb4d-cc04-421f-a82a-ef222e3f14c0 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 64 microversion: 2.1 time: 0.945215 Sep 10 20:54:12.933981 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 818/1598] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:54:11 2022] PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 64 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:12.956426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:12.960868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:12.993918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:12.994854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:13.001647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:13.004528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:13.005026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:13.005466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:13.486545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0ec13acf-2255-4df7-8ead-348383a3c22c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:13.495590 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0ec13acf-2255-4df7-8ead-348383a3c22c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.778042 Sep 10 20:54:13.497129 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 781/1599] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:12 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:13.502352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5939f752-46ee-4880-be81-27e811199447 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:13.503128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5939f752-46ee-4880-be81-27e811199447 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:13.509607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5939f752-46ee-4880-be81-27e811199447 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:13.510336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5939f752-46ee-4880-be81-27e811199447 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:13.510959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5939f752-46ee-4880-be81-27e811199447 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:13.511848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5939f752-46ee-4880-be81-27e811199447 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:13.512453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5939f752-46ee-4880-be81-27e811199447 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:13.514036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5939f752-46ee-4880-be81-27e811199447 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:13.806122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:13.822305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:13.826697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:13.828051 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09d92292-5e06-483d-89d1-b65869837fb8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1280 microversion: 2.25 time: 0.892850 Sep 10 20:54:13.854276 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 819/1600] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:12 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1280 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:13.860138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a8a62cf1-2c86-4b8e-92c4-b79fcf32bfdf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:13.861044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a8a62cf1-2c86-4b8e-92c4-b79fcf32bfdf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:13.867741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a62cf1-2c86-4b8e-92c4-b79fcf32bfdf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:13.868552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a62cf1-2c86-4b8e-92c4-b79fcf32bfdf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:13.869163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a62cf1-2c86-4b8e-92c4-b79fcf32bfdf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:13.870092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a62cf1-2c86-4b8e-92c4-b79fcf32bfdf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:13.870729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a62cf1-2c86-4b8e-92c4-b79fcf32bfdf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:13.871321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a62cf1-2c86-4b8e-92c4-b79fcf32bfdf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:14.156101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5939f752-46ee-4880-be81-27e811199447 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:14.175743 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5939f752-46ee-4880-be81-27e811199447 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1470 microversion: 2.1 time: 0.676946 Sep 10 20:54:14.177708 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 782/1601] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:13 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1470 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:14.191675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5c18d513-929f-4500-8ad0-ea07d54dd733 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Calling method '.version_select at 0x7f99495b35e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:14.250575 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5c18d513-929f-4500-8ad0-ea07d54dd733 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 64 microversion: 2.1 time: 0.071355 Sep 10 20:54:14.257198 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 783/1602] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:54:14 2022] GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 64 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:14.267233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-31990737-cafb-4771-a59f-835483d7d536 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:14.268407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-31990737-cafb-4771-a59f-835483d7d536 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:14.275589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31990737-cafb-4771-a59f-835483d7d536 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:14.276328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31990737-cafb-4771-a59f-835483d7d536 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:14.276777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31990737-cafb-4771-a59f-835483d7d536 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:14.277725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31990737-cafb-4771-a59f-835483d7d536 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:14.278226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31990737-cafb-4771-a59f-835483d7d536 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:14.279257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31990737-cafb-4771-a59f-835483d7d536 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:14.303681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a8a62cf1-2c86-4b8e-92c4-b79fcf32bfdf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:14.320692 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a8a62cf1-2c86-4b8e-92c4-b79fcf32bfdf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.462426 Sep 10 20:54:14.321327 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 820/1603] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:13 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:14.365667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3f1f0c2f-cb35-4a60-bfde-1758898e2caf req-b4c2effb-bc2e-41f9-99d0-411ae2e44fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e1970c-5740-4466-911f-5aef17b7336e", "name": "network-vif-plugged", "status": "completed", "tag": "fd86c8ba-198f-490e-a5da-475f9082b557"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:14.392304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f1f0c2f-cb35-4a60-bfde-1758898e2caf req-b4c2effb-bc2e-41f9-99d0-411ae2e44fb7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:14.393252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f1f0c2f-cb35-4a60-bfde-1758898e2caf req-b4c2effb-bc2e-41f9-99d0-411ae2e44fb7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:14.394167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f1f0c2f-cb35-4a60-bfde-1758898e2caf req-b4c2effb-bc2e-41f9-99d0-411ae2e44fb7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:14.420536 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3f1f0c2f-cb35-4a60-bfde-1758898e2caf req-b4c2effb-bc2e-41f9-99d0-411ae2e44fb7 service nova] Creating event network-vif-plugged:fd86c8ba-198f-490e-a5da-475f9082b557 for instance a4e1970c-5740-4466-911f-5aef17b7336e on nch2-master-1 Sep 10 20:54:14.441928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-3f1f0c2f-cb35-4a60-bfde-1758898e2caf req-b4c2effb-bc2e-41f9-99d0-411ae2e44fb7 service nova] Instance a4e1970c-5740-4466-911f-5aef17b7336e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:54:14.456192 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3f1f0c2f-cb35-4a60-bfde-1758898e2caf req-b4c2effb-bc2e-41f9-99d0-411ae2e44fb7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132792 Sep 10 20:54:14.457309 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 821/1604] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:14.462927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0136b460-ed9f-47f1-8f08-eab5dad2ac04 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Action: 'update_all', calling method: .version_select at 0x7f9944896d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:14.562782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-0136b460-ed9f-47f1-8f08-eab5dad2ac04 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:14.578948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-0136b460-ed9f-47f1-8f08-eab5dad2ac04 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for user 8b615ba669104c3b92734b838a026594 and project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:14.872849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-31990737-cafb-4771-a59f-835483d7d536 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:14.881589 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-31990737-cafb-4771-a59f-835483d7d536 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.622843 Sep 10 20:54:14.882443 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 784/1605] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:14 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:14.887111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-14209c57-69c8-43b3-ba1d-9b049ce86d4d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:14.888593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-14209c57-69c8-43b3-ba1d-9b049ce86d4d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:14.901159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14209c57-69c8-43b3-ba1d-9b049ce86d4d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:14.901959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14209c57-69c8-43b3-ba1d-9b049ce86d4d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:14.905140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14209c57-69c8-43b3-ba1d-9b049ce86d4d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:14.906359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14209c57-69c8-43b3-ba1d-9b049ce86d4d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:14.908277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14209c57-69c8-43b3-ba1d-9b049ce86d4d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:14.908923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14209c57-69c8-43b3-ba1d-9b049ce86d4d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:15.140404 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0136b460-ed9f-47f1-8f08-eab5dad2ac04 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.680861 Sep 10 20:54:15.141226 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 822/1606] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:54:14 2022] PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 61 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:15.148362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:15.151821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:15.186210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:15.190794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:15.191352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:15.192173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:15.192939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:15.197801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:15.421434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-14209c57-69c8-43b3-ba1d-9b049ce86d4d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:15.432876 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-14209c57-69c8-43b3-ba1d-9b049ce86d4d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.546471 Sep 10 20:54:15.433781 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 785/1607] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:14 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:15.445126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7f0b76b1-c95f-4248-b86f-d4a7c25fa671 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Action: 'update', calling method: .version_select at 0x7f99495c28b0>, body: {"meta": {"os_version": "alt"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:15.524712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-7f0b76b1-c95f-4248-b86f-d4a7c25fa671 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:15.532631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-7f0b76b1-c95f-4248-b86f-d4a7c25fa671 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for user 8b615ba669104c3b92734b838a026594 and project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:15.900625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:15.937521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:15.945782 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7f0b76b1-c95f-4248-b86f-d4a7c25fa671 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.506846 Sep 10 20:54:15.947110 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 786/1608] 10.222.0.33 () {60 vars in 1313 bytes} [Sat Sep 10 20:54:15 2022] PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata/os_version => generated 31 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:15.960664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:15.961857 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-03d85ffa-cd66-40bc-ab3c-359245ea6ade tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1280 microversion: 2.25 time: 0.819139 Sep 10 20:54:15.975386 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 823/1609] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:15 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1280 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:15.989077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-021410e1-06d2-486a-8a8e-b9eeffb4ac9b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:15.990155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-021410e1-06d2-486a-8a8e-b9eeffb4ac9b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:15.997155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-021410e1-06d2-486a-8a8e-b9eeffb4ac9b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:15.998608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-021410e1-06d2-486a-8a8e-b9eeffb4ac9b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:15.999452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-021410e1-06d2-486a-8a8e-b9eeffb4ac9b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:16.000422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-021410e1-06d2-486a-8a8e-b9eeffb4ac9b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:16.001103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-021410e1-06d2-486a-8a8e-b9eeffb4ac9b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:16.001765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-021410e1-06d2-486a-8a8e-b9eeffb4ac9b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:16.223107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-baf323c1-784e-4d54-a788-5ead00585f01 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Action: 'create', calling method: .version_select at 0x7f9944de74c0>, body: {"keypair": {"name": "tempest-keypair-273144398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJOothzmee4zVgfVqdaVzDSIbo7tqhaP7YvWH/5A0E7qBybrhTT11ReRXCJoAFM0xoDprJhnA1NjoLu6Wmyv+viYU6tZqHCwjimP0jDI110eQxM7YTxdLTqoSRn9YdPWg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:16.244035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-baf323c1-784e-4d54-a788-5ead00585f01 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Getting quotas for project f2836de68f8546259ebb0649f7567c4f. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:16.250549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-baf323c1-784e-4d54-a788-5ead00585f01 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Getting quotas for user eff0636f25bb459cb92e0c733bb51df8 and project f2836de68f8546259ebb0649f7567c4f. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:16.276042 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-baf323c1-784e-4d54-a788-5ead00585f01 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.322330 Sep 10 20:54:16.276923 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 787/1610] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:54:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:16.282603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-93967757-4a62-4e59-8d35-1cc0df0b723f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:16.283482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-93967757-4a62-4e59-8d35-1cc0df0b723f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:16.290089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93967757-4a62-4e59-8d35-1cc0df0b723f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:16.290808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93967757-4a62-4e59-8d35-1cc0df0b723f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:16.291591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93967757-4a62-4e59-8d35-1cc0df0b723f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:16.292569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93967757-4a62-4e59-8d35-1cc0df0b723f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:16.293198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93967757-4a62-4e59-8d35-1cc0df0b723f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:16.293811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93967757-4a62-4e59-8d35-1cc0df0b723f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:16.310433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-021410e1-06d2-486a-8a8e-b9eeffb4ac9b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:16.320846 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-021410e1-06d2-486a-8a8e-b9eeffb4ac9b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1470 microversion: 2.1 time: 0.335997 Sep 10 20:54:16.321434 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 824/1611] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:15 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1470 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:16.326487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87fd37ce-d165-4243-ae3a-44559dcf43f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:16.332316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87fd37ce-d165-4243-ae3a-44559dcf43f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:16.342179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87fd37ce-d165-4243-ae3a-44559dcf43f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:16.342972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87fd37ce-d165-4243-ae3a-44559dcf43f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:16.343613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87fd37ce-d165-4243-ae3a-44559dcf43f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:16.344492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87fd37ce-d165-4243-ae3a-44559dcf43f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:16.345106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87fd37ce-d165-4243-ae3a-44559dcf43f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:16.345693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87fd37ce-d165-4243-ae3a-44559dcf43f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:16.485958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-93967757-4a62-4e59-8d35-1cc0df0b723f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:16.505057 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-93967757-4a62-4e59-8d35-1cc0df0b723f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.226834 Sep 10 20:54:16.505677 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 788/1612] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:16 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:16.517572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-865e0ca4-a411-45f2-bbe0-e2e36608bdcf tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Calling method '.version_select at 0x7f9949687f70>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:16.602349 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-865e0ca4-a411-45f2-bbe0-e2e36608bdcf tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 58 microversion: 2.1 time: 0.089554 Sep 10 20:54:16.610743 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 789/1613] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:54:16 2022] GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 58 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:16.621884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6df6c3b6-eb74-4bb7-9133-05efce331e7b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:16.622739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6df6c3b6-eb74-4bb7-9133-05efce331e7b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:16.640342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6df6c3b6-eb74-4bb7-9133-05efce331e7b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:16.643919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6df6c3b6-eb74-4bb7-9133-05efce331e7b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:16.644444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6df6c3b6-eb74-4bb7-9133-05efce331e7b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:16.645285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6df6c3b6-eb74-4bb7-9133-05efce331e7b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:16.645859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6df6c3b6-eb74-4bb7-9133-05efce331e7b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:16.646270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6df6c3b6-eb74-4bb7-9133-05efce331e7b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:16.952490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-87fd37ce-d165-4243-ae3a-44559dcf43f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:16.963194 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-87fd37ce-d165-4243-ae3a-44559dcf43f4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.640480 Sep 10 20:54:16.975493 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 825/1614] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:16 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:16.988870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f2a29b0c-af63-4034-b3ab-8c5681417796 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Action: 'update_all', calling method: .version_select at 0x7f9944836670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:17.071290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f2a29b0c-af63-4034-b3ab-8c5681417796 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:17.081196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f2a29b0c-af63-4034-b3ab-8c5681417796 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for user 8b615ba669104c3b92734b838a026594 and project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:17.088982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6df6c3b6-eb74-4bb7-9133-05efce331e7b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:17.095619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:17.101508 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6df6c3b6-eb74-4bb7-9133-05efce331e7b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.489107 Sep 10 20:54:17.107906 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 790/1615] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:16 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:17.118350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3dd20ddb-7342-467a-946e-474107ab7371 req-22c05c8e-40ad-45be-aaec-1f450823f312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb73142-7fcb-44b4-8ff3-b7624fc5b494", "name": "network-vif-plugged", "status": "completed", "tag": "9c462d3d-b794-4637-b520-7d89a1ddcec2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:17.141447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3dd20ddb-7342-467a-946e-474107ab7371 req-22c05c8e-40ad-45be-aaec-1f450823f312 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:17.142800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3dd20ddb-7342-467a-946e-474107ab7371 req-22c05c8e-40ad-45be-aaec-1f450823f312 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:17.143781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3dd20ddb-7342-467a-946e-474107ab7371 req-22c05c8e-40ad-45be-aaec-1f450823f312 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:17.170924 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3dd20ddb-7342-467a-946e-474107ab7371 req-22c05c8e-40ad-45be-aaec-1f450823f312 service nova] Creating event network-vif-plugged:9c462d3d-b794-4637-b520-7d89a1ddcec2 for instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 on nch1-master-1 Sep 10 20:54:17.177102 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3dd20ddb-7342-467a-946e-474107ab7371 req-22c05c8e-40ad-45be-aaec-1f450823f312 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066994 Sep 10 20:54:17.178148 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 791/1616] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:17.184312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:17.186116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:17.197637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:17.198427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:17.199033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:17.199961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:17.200861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:17.202000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:17.662188 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f2a29b0c-af63-4034-b3ab-8c5681417796 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.679157 Sep 10 20:54:17.666257 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 826/1617] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:54:16 2022] PUT /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 61 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:17.668335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-138fd22d-74d4-43eb-bd3f-2330363f97c9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:17.668958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-138fd22d-74d4-43eb-bd3f-2330363f97c9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:17.684170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-138fd22d-74d4-43eb-bd3f-2330363f97c9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:17.684417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-138fd22d-74d4-43eb-bd3f-2330363f97c9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:17.684993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-138fd22d-74d4-43eb-bd3f-2330363f97c9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:17.685943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-138fd22d-74d4-43eb-bd3f-2330363f97c9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:17.688780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-138fd22d-74d4-43eb-bd3f-2330363f97c9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:17.689243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-138fd22d-74d4-43eb-bd3f-2330363f97c9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:17.704550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:17.714832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:17.718060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:17.720001 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f01fdc9-35d6-42ce-b09b-3d547ef3300e tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1280 microversion: 2.25 time: 0.539964 Sep 10 20:54:17.720822 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 792/1618] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:17 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1280 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:17.734384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-58489876-2ba1-4b26-9adf-ce818fb62ff4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:17.735594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-58489876-2ba1-4b26-9adf-ce818fb62ff4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:17.741880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58489876-2ba1-4b26-9adf-ce818fb62ff4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:17.742753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58489876-2ba1-4b26-9adf-ce818fb62ff4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:17.743366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58489876-2ba1-4b26-9adf-ce818fb62ff4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:17.744790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58489876-2ba1-4b26-9adf-ce818fb62ff4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:17.745402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58489876-2ba1-4b26-9adf-ce818fb62ff4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:17.746058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58489876-2ba1-4b26-9adf-ce818fb62ff4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:17.917729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-58489876-2ba1-4b26-9adf-ce818fb62ff4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:17.928848 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-58489876-2ba1-4b26-9adf-ce818fb62ff4 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.206266 Sep 10 20:54:17.929557 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 793/1619] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:17 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:17.940657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e06ac42c-a718-4935-9edb-e97556958d00 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Action: 'create', calling method: .version_select at 0x7f9944c45790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:18.010611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-e06ac42c-a718-4935-9edb-e97556958d00 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:18.019836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-e06ac42c-a718-4935-9edb-e97556958d00 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Getting quotas for user 8b615ba669104c3b92734b838a026594 and project 566dd302b2664b6e993ba2d639d86a5d. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:18.288051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-138fd22d-74d4-43eb-bd3f-2330363f97c9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:18.298691 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-138fd22d-74d4-43eb-bd3f-2330363f97c9 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1470 microversion: 2.1 time: 0.634386 Sep 10 20:54:18.300078 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 827/1620] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:17 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1470 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:18.308956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-261da80e-ac6f-4358-a1ba-58995cb313a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:18.310072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-261da80e-ac6f-4358-a1ba-58995cb313a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:18.332014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-261da80e-ac6f-4358-a1ba-58995cb313a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:18.334022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-261da80e-ac6f-4358-a1ba-58995cb313a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:18.343903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-261da80e-ac6f-4358-a1ba-58995cb313a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:18.345277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-261da80e-ac6f-4358-a1ba-58995cb313a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:18.346136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-261da80e-ac6f-4358-a1ba-58995cb313a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:18.347574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-261da80e-ac6f-4358-a1ba-58995cb313a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:18.579489 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e06ac42c-a718-4935-9edb-e97556958d00 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "POST /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 85 microversion: 2.1 time: 0.648638 Sep 10 20:54:18.580412 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 794/1621] 10.222.0.33 () {60 vars in 1281 bytes} [Sat Sep 10 20:54:17 2022] POST /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 85 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:18.593848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-93b7c894-6e08-4212-a6d6-968e88759854 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:18.595251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-93b7c894-6e08-4212-a6d6-968e88759854 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:18.612858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93b7c894-6e08-4212-a6d6-968e88759854 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:18.613120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93b7c894-6e08-4212-a6d6-968e88759854 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:18.613519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93b7c894-6e08-4212-a6d6-968e88759854 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:18.614294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93b7c894-6e08-4212-a6d6-968e88759854 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:18.615335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93b7c894-6e08-4212-a6d6-968e88759854 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:18.615335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93b7c894-6e08-4212-a6d6-968e88759854 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:18.962736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-261da80e-ac6f-4358-a1ba-58995cb313a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:18.995592 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-261da80e-ac6f-4358-a1ba-58995cb313a6 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.694195 Sep 10 20:54:18.996193 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 828/1622] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:18 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:19.014140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-01577ae3-1686-425d-80c6-a70625fb19b4 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] Calling method '.version_select at 0x7f9944836940>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:19.110751 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-01577ae3-1686-425d-80c6-a70625fb19b4 tempest-ImagesMetadataTestJSON-2040658652 tempest-ImagesMetadataTestJSON-2040658652-project] 10.222.0.33 "GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata" status: 200 len: 85 microversion: 2.1 time: 0.111051 Sep 10 20:54:19.111500 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 829/1623] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:54:18 2022] GET /compute/v2.1/images/9abc53d6-e572-462f-8b9e-390e67ea9ee9/metadata => generated 85 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:19.124258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-93b7c894-6e08-4212-a6d6-968e88759854 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:19.125941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:19.130495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:19.148041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:19.148895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:19.149575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:19.150874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:19.151581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:19.156087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:19.157096 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-93b7c894-6e08-4212-a6d6-968e88759854 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.575543 Sep 10 20:54:19.157695 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 795/1624] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:18 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:19.186455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:19.200095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-193886fd-d8de-441a-b17d-43d02523eb32 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:19.204138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-193886fd-d8de-441a-b17d-43d02523eb32 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:19.224303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-193886fd-d8de-441a-b17d-43d02523eb32 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:19.225070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-193886fd-d8de-441a-b17d-43d02523eb32 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:19.227420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-193886fd-d8de-441a-b17d-43d02523eb32 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:19.229940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-193886fd-d8de-441a-b17d-43d02523eb32 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:19.232925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-193886fd-d8de-441a-b17d-43d02523eb32 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:19.235112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-193886fd-d8de-441a-b17d-43d02523eb32 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:19.754093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-193886fd-d8de-441a-b17d-43d02523eb32 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:19.777886 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-193886fd-d8de-441a-b17d-43d02523eb32 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1716 microversion: 2.1 time: 0.597810 Sep 10 20:54:19.779740 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 796/1625] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:19 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1716 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:19.793791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7dad22b0-9435-43a9-b077-7ec0dfeb07d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:19.794827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7dad22b0-9435-43a9-b077-7ec0dfeb07d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:19.814778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dad22b0-9435-43a9-b077-7ec0dfeb07d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:19.816111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dad22b0-9435-43a9-b077-7ec0dfeb07d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:19.817811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dad22b0-9435-43a9-b077-7ec0dfeb07d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:19.835194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dad22b0-9435-43a9-b077-7ec0dfeb07d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:19.837053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dad22b0-9435-43a9-b077-7ec0dfeb07d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:19.840098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dad22b0-9435-43a9-b077-7ec0dfeb07d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:20.017125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:20.032555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:20.035170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:20.037242 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b6f1e40a-fbc1-4cdc-83ec-129c2f5c3923 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1280 microversion: 2.25 time: 0.924278 Sep 10 20:54:20.046517 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 830/1626] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:19 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1280 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:20.052907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-61faf934-854d-4a6c-8e15-3788ff464506 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:20.058499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-61faf934-854d-4a6c-8e15-3788ff464506 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:20.084525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61faf934-854d-4a6c-8e15-3788ff464506 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:20.085305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61faf934-854d-4a6c-8e15-3788ff464506 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:20.086974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61faf934-854d-4a6c-8e15-3788ff464506 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:20.088358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61faf934-854d-4a6c-8e15-3788ff464506 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:20.092559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61faf934-854d-4a6c-8e15-3788ff464506 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:20.094711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61faf934-854d-4a6c-8e15-3788ff464506 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:20.265712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7dad22b0-9435-43a9-b077-7ec0dfeb07d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:20.278374 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7dad22b0-9435-43a9-b077-7ec0dfeb07d4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1536 microversion: 2.1 time: 0.496233 Sep 10 20:54:20.280753 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 797/1627] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:19 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1536 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:20.291586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-02096cf3-f654-498d-9204-a2b4996147b5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:20.292419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-02096cf3-f654-498d-9204-a2b4996147b5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:20.306952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02096cf3-f654-498d-9204-a2b4996147b5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:20.310670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02096cf3-f654-498d-9204-a2b4996147b5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:20.313207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02096cf3-f654-498d-9204-a2b4996147b5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:20.314665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02096cf3-f654-498d-9204-a2b4996147b5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:20.322894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02096cf3-f654-498d-9204-a2b4996147b5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:20.323715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02096cf3-f654-498d-9204-a2b4996147b5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:20.685891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-61faf934-854d-4a6c-8e15-3788ff464506 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:20.693983 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-61faf934-854d-4a6c-8e15-3788ff464506 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.645944 Sep 10 20:54:20.694461 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 831/1628] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:20 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:20.748330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-02096cf3-f654-498d-9204-a2b4996147b5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:20.765842 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-02096cf3-f654-498d-9204-a2b4996147b5 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.482850 Sep 10 20:54:20.784314 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 798/1629] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:20 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:20.816031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eed1c8ac-30db-409a-a987-d3d49001323e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:20.816649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eed1c8ac-30db-409a-a987-d3d49001323e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:20.826074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eed1c8ac-30db-409a-a987-d3d49001323e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:20.827122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eed1c8ac-30db-409a-a987-d3d49001323e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:20.827575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eed1c8ac-30db-409a-a987-d3d49001323e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:20.828311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eed1c8ac-30db-409a-a987-d3d49001323e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:20.828778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eed1c8ac-30db-409a-a987-d3d49001323e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:20.830504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eed1c8ac-30db-409a-a987-d3d49001323e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:21.077319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:21.078768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:21.087070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:21.088400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:21.089017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:21.090348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:21.091113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:21.091726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:21.176728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eed1c8ac-30db-409a-a987-d3d49001323e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:21.187956 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eed1c8ac-30db-409a-a987-d3d49001323e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1706 microversion: 2.1 time: 0.384408 Sep 10 20:54:21.198667 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 832/1630] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:20 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1706 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:21.215223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ba9b3fb9-de01-4198-809b-8909de55cc89 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '.version_select at 0x7f99448c8550>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:21.219997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba9b3fb9-de01-4198-809b-8909de55cc89 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:21.220756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba9b3fb9-de01-4198-809b-8909de55cc89 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:21.221369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba9b3fb9-de01-4198-809b-8909de55cc89 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:21.241796 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ba9b3fb9-de01-4198-809b-8909de55cc89 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3496 microversion: 2.1 time: 0.031497 Sep 10 20:54:21.242980 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 833/1631] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:54:21 2022] GET /compute/v2.1/os-migrations => generated 3496 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:21.258542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-11bafd9d-e098-4f50-9423-e8696b70c969 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:21.259159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-11bafd9d-e098-4f50-9423-e8696b70c969 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:21.269748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11bafd9d-e098-4f50-9423-e8696b70c969 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:21.270586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11bafd9d-e098-4f50-9423-e8696b70c969 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:21.271408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11bafd9d-e098-4f50-9423-e8696b70c969 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:21.281314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11bafd9d-e098-4f50-9423-e8696b70c969 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:21.282171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11bafd9d-e098-4f50-9423-e8696b70c969 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:21.282806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11bafd9d-e098-4f50-9423-e8696b70c969 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:21.576381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:21.590002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:21.604391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:21.606090 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-28f836d7-302c-4d1e-b30f-78c2562a71f7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1475 microversion: 2.25 time: 0.535208 Sep 10 20:54:21.628392 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 799/1632] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:21 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1475 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:54:21.647192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8e6fcc8-8f57-4889-9e09-06337822d8ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:21.647192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8e6fcc8-8f57-4889-9e09-06337822d8ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:21.650910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e6fcc8-8f57-4889-9e09-06337822d8ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:21.651699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e6fcc8-8f57-4889-9e09-06337822d8ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:21.652257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e6fcc8-8f57-4889-9e09-06337822d8ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:21.653187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e6fcc8-8f57-4889-9e09-06337822d8ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:21.654035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e6fcc8-8f57-4889-9e09-06337822d8ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:21.654809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e6fcc8-8f57-4889-9e09-06337822d8ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:21.701865 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-11bafd9d-e098-4f50-9423-e8696b70c969 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1857 microversion: 2.1 time: 0.444428 Sep 10 20:54:21.712026 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 834/1633] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:21 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1857 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:21.717037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-205b8b35-da88-40de-b2f7-842f5cf86c33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:21.718071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-205b8b35-da88-40de-b2f7-842f5cf86c33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:21.733928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-205b8b35-da88-40de-b2f7-842f5cf86c33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:21.735215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-205b8b35-da88-40de-b2f7-842f5cf86c33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:21.735741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-205b8b35-da88-40de-b2f7-842f5cf86c33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:21.736608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-205b8b35-da88-40de-b2f7-842f5cf86c33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:21.737403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-205b8b35-da88-40de-b2f7-842f5cf86c33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:21.738215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-205b8b35-da88-40de-b2f7-842f5cf86c33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:21.976894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8e6fcc8-8f57-4889-9e09-06337822d8ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:21.989591 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8e6fcc8-8f57-4889-9e09-06337822d8ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1536 microversion: 2.1 time: 0.357847 Sep 10 20:54:21.992346 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 800/1634] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:21 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1536 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:22.004205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-990a58c0-eceb-4d24-ada5-54d6628ebb10 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:22.009373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-990a58c0-eceb-4d24-ada5-54d6628ebb10 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:22.016805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-990a58c0-eceb-4d24-ada5-54d6628ebb10 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:22.019328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-990a58c0-eceb-4d24-ada5-54d6628ebb10 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:22.021936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-990a58c0-eceb-4d24-ada5-54d6628ebb10 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:22.024536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-990a58c0-eceb-4d24-ada5-54d6628ebb10 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:22.025710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-990a58c0-eceb-4d24-ada5-54d6628ebb10 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:22.026289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-990a58c0-eceb-4d24-ada5-54d6628ebb10 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:22.141445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-205b8b35-da88-40de-b2f7-842f5cf86c33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid aeb73142-7fcb-44b4-8ff3-b7624fc5b494 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:54:22.158370 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-205b8b35-da88-40de-b2f7-842f5cf86c33 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1967 microversion: 2.25 time: 0.454064 Sep 10 20:54:22.160122 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 835/1635] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:21 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1967 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:22.165558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81a5a189-65cd-48ad-b54f-385ba9209ac5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:22.166247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81a5a189-65cd-48ad-b54f-385ba9209ac5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:22.174037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81a5a189-65cd-48ad-b54f-385ba9209ac5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:22.174841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81a5a189-65cd-48ad-b54f-385ba9209ac5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:22.176122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81a5a189-65cd-48ad-b54f-385ba9209ac5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:22.176872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81a5a189-65cd-48ad-b54f-385ba9209ac5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:22.178660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81a5a189-65cd-48ad-b54f-385ba9209ac5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:22.179191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81a5a189-65cd-48ad-b54f-385ba9209ac5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:22.286426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-990a58c0-eceb-4d24-ada5-54d6628ebb10 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:22.296696 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-990a58c0-eceb-4d24-ada5-54d6628ebb10 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.302732 Sep 10 20:54:22.310129 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 801/1636] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:21 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:22.323146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-119abb3b-432f-4567-85d4-22401f7ae57c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:22.323902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-119abb3b-432f-4567-85d4-22401f7ae57c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:22.332145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-119abb3b-432f-4567-85d4-22401f7ae57c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:22.332904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-119abb3b-432f-4567-85d4-22401f7ae57c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:22.333507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-119abb3b-432f-4567-85d4-22401f7ae57c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:22.334547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-119abb3b-432f-4567-85d4-22401f7ae57c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:22.335017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-119abb3b-432f-4567-85d4-22401f7ae57c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:22.335499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-119abb3b-432f-4567-85d4-22401f7ae57c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:22.392893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:22.438184 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81a5a189-65cd-48ad-b54f-385ba9209ac5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1857 microversion: 2.1 time: 0.276676 Sep 10 20:54:22.439647 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 836/1637] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:22 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1857 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:22.445285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2069759027", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "e56ef167-3e3c-4aa6-b5ed-721994e8e64c"}], "security_groups": [{"name": "tempest-securitygroup--1424433497"}], "key_name": "tempest-keypair-273144398", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:22.555203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-119abb3b-432f-4567-85d4-22401f7ae57c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:22.565628 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-119abb3b-432f-4567-85d4-22401f7ae57c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.251448 Sep 10 20:54:22.573248 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 802/1638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:22 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:22.578824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-21d0f7da-e83e-4ca1-824f-952688cfc01a req-df66599c-506b-4365-bb01-534d9f257620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e1970c-5740-4466-911f-5aef17b7336e", "name": "network-vif-unplugged", "status": "completed", "tag": "fd86c8ba-198f-490e-a5da-475f9082b557"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:22.589487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-21d0f7da-e83e-4ca1-824f-952688cfc01a req-df66599c-506b-4365-bb01-534d9f257620 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:22.590460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-21d0f7da-e83e-4ca1-824f-952688cfc01a req-df66599c-506b-4365-bb01-534d9f257620 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:22.591029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-21d0f7da-e83e-4ca1-824f-952688cfc01a req-df66599c-506b-4365-bb01-534d9f257620 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:22.610215 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-21d0f7da-e83e-4ca1-824f-952688cfc01a req-df66599c-506b-4365-bb01-534d9f257620 service nova] Creating event network-vif-unplugged:fd86c8ba-198f-490e-a5da-475f9082b557 for instance a4e1970c-5740-4466-911f-5aef17b7336e on nch2-master-1 Sep 10 20:54:22.617181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-21d0f7da-e83e-4ca1-824f-952688cfc01a req-df66599c-506b-4365-bb01-534d9f257620 service nova] Instance a4e1970c-5740-4466-911f-5aef17b7336e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:54:22.619759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] validate_networks() for [('e56ef167-3e3c-4aa6-b5ed-721994e8e64c', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:54:22.625032 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-21d0f7da-e83e-4ca1-824f-952688cfc01a req-df66599c-506b-4365-bb01-534d9f257620 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050023 Sep 10 20:54:22.625711 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 803/1639] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:22.631336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f0e97c78-b6cb-4844-a832-9471283a4630 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:22.632284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f0e97c78-b6cb-4844-a832-9471283a4630 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:22.639172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0e97c78-b6cb-4844-a832-9471283a4630 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:22.639983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0e97c78-b6cb-4844-a832-9471283a4630 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:22.640792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0e97c78-b6cb-4844-a832-9471283a4630 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:22.642652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0e97c78-b6cb-4844-a832-9471283a4630 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:22.643425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0e97c78-b6cb-4844-a832-9471283a4630 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:22.644096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0e97c78-b6cb-4844-a832-9471283a4630 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:22.877731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-f0e97c78-b6cb-4844-a832-9471283a4630 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid aeb73142-7fcb-44b4-8ff3-b7624fc5b494 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:54:22.900259 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f0e97c78-b6cb-4844-a832-9471283a4630 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1967 microversion: 2.25 time: 0.273059 Sep 10 20:54:22.901090 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 804/1640] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:22 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1967 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:23.359675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1865957921", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:23.422244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] validate_networks() for [('50963dd0-5660-4a61-b1db-e1050760c4fb', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:54:23.554461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:54:23.554969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:54:23.555331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:54:23.555732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:54:23.556138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:54:23.565496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:23.566015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:23.566446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:23.567167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:23.567684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:23.568104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:23.588174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Getting quotas for project f2836de68f8546259ebb0649f7567c4f. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:23.594015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Getting quotas for user eff0636f25bb459cb92e0c733bb51df8 and project f2836de68f8546259ebb0649f7567c4f. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:23.608230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:54:23.610727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:54:23.661605 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-56b23a5b-0094-4478-8301-b977db13028e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.220704 Sep 10 20:54:23.663383 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 837/1641] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:54:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:54:23.668077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-33fe1c46-bc6d-42e9-b4e3-9c2149806a16 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:23.669565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-33fe1c46-bc6d-42e9-b4e3-9c2149806a16 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:23.677788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33fe1c46-bc6d-42e9-b4e3-9c2149806a16 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:23.678021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33fe1c46-bc6d-42e9-b4e3-9c2149806a16 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:23.678459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33fe1c46-bc6d-42e9-b4e3-9c2149806a16 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:23.679167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33fe1c46-bc6d-42e9-b4e3-9c2149806a16 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:23.679793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33fe1c46-bc6d-42e9-b4e3-9c2149806a16 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:23.680225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33fe1c46-bc6d-42e9-b4e3-9c2149806a16 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:23.873215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-33fe1c46-bc6d-42e9-b4e3-9c2149806a16 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lazy-loading 'services' on Instance uuid 662c3986-cb45-4c9f-a1cf-55a8230ac15a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:54:24.021780 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-33fe1c46-bc6d-42e9-b4e3-9c2149806a16 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "DELETE /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a/os-volume_attachments/4243e1cf-ccbd-4021-92f0-449a64e8c494" status: 202 len: 0 microversion: 2.1 time: 0.357279 Sep 10 20:54:24.023140 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 838/1642] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 20:54:23 2022] DELETE /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a/os-volume_attachments/4243e1cf-ccbd-4021-92f0-449a64e8c494 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:54:24.222463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5efdf14c-a575-4dff-b103-062f8d949aff tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:24.226940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5efdf14c-a575-4dff-b103-062f8d949aff tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.227439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5efdf14c-a575-4dff-b103-062f8d949aff tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.227887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5efdf14c-a575-4dff-b103-062f8d949aff tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.231683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5efdf14c-a575-4dff-b103-062f8d949aff tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.232153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5efdf14c-a575-4dff-b103-062f8d949aff tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.232777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5efdf14c-a575-4dff-b103-062f8d949aff tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.298762 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5efdf14c-a575-4dff-b103-062f8d949aff tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.272018 Sep 10 20:54:24.301225 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 839/1643] 10.222.0.33 () {60 vars in 1217 bytes} [Sat Sep 10 20:54:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:54:24.314602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-47dcfe47-df8f-4e54-80b5-70bc9eb03e0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:24.315362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-47dcfe47-df8f-4e54-80b5-70bc9eb03e0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:24.331968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47dcfe47-df8f-4e54-80b5-70bc9eb03e0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.332510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47dcfe47-df8f-4e54-80b5-70bc9eb03e0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.332964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47dcfe47-df8f-4e54-80b5-70bc9eb03e0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.335155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47dcfe47-df8f-4e54-80b5-70bc9eb03e0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.335631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47dcfe47-df8f-4e54-80b5-70bc9eb03e0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.338094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47dcfe47-df8f-4e54-80b5-70bc9eb03e0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.370901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:54:24.371578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:54:24.372726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:54:24.373218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:54:24.373640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:54:24.393382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.394217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.396628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.400950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.401948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.402598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.450299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Getting quotas for project 471f82eb46074bdabaedf6f837f6b94c. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:24.460503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Getting quotas for user 7ef231141009462d9819a123ea16d8c4 and project 471f82eb46074bdabaedf6f837f6b94c. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:24.484340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:54:24.486865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:54:24.552700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-47dcfe47-df8f-4e54-80b5-70bc9eb03e0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:24.561558 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-47dcfe47-df8f-4e54-80b5-70bc9eb03e0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1529 microversion: 2.1 time: 0.258442 Sep 10 20:54:24.568761 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 840/1644] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:24 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1529 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:24.578026 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da62fec2-3762-4bd7-a5fa-cd9beaf616c3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.668157 Sep 10 20:54:24.578026 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 805/1645] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:54:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:54:24.593907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cdb2e624-19c3-465e-9dcf-931f43cf5d8d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:24.594898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cdb2e624-19c3-465e-9dcf-931f43cf5d8d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:24.597306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8fa046d-b35f-4ffd-b8a2-185c04919e18 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:24.598204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8fa046d-b35f-4ffd-b8a2-185c04919e18 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:24.611089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdb2e624-19c3-465e-9dcf-931f43cf5d8d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.611597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdb2e624-19c3-465e-9dcf-931f43cf5d8d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.612037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdb2e624-19c3-465e-9dcf-931f43cf5d8d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.614972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdb2e624-19c3-465e-9dcf-931f43cf5d8d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.615374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdb2e624-19c3-465e-9dcf-931f43cf5d8d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.616079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fa046d-b35f-4ffd-b8a2-185c04919e18 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.616526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fa046d-b35f-4ffd-b8a2-185c04919e18 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.616965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fa046d-b35f-4ffd-b8a2-185c04919e18 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.617698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fa046d-b35f-4ffd-b8a2-185c04919e18 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.618374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdb2e624-19c3-465e-9dcf-931f43cf5d8d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.620516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fa046d-b35f-4ffd-b8a2-185c04919e18 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.624493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fa046d-b35f-4ffd-b8a2-185c04919e18 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.891976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cdb2e624-19c3-465e-9dcf-931f43cf5d8d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:24.917667 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cdb2e624-19c3-465e-9dcf-931f43cf5d8d tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.335976 Sep 10 20:54:24.926053 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 841/1646] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:24 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:24.951431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1b72c836-bf8d-4259-b50d-7c79b164abb3 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:24.952057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1b72c836-bf8d-4259-b50d-7c79b164abb3 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:24.972798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b72c836-bf8d-4259-b50d-7c79b164abb3 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.973895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b72c836-bf8d-4259-b50d-7c79b164abb3 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.974618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b72c836-bf8d-4259-b50d-7c79b164abb3 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:24.976276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b72c836-bf8d-4259-b50d-7c79b164abb3 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:24.977195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b72c836-bf8d-4259-b50d-7c79b164abb3 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:24.980709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b72c836-bf8d-4259-b50d-7c79b164abb3 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:25.084962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b72c836-bf8d-4259-b50d-7c79b164abb3 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:25.118153 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1b72c836-bf8d-4259-b50d-7c79b164abb3 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1293 microversion: 2.1 time: 0.178696 Sep 10 20:54:25.120306 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 842/1647] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:24 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1293 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:25.131784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c850c5fe-1a24-4a59-8244-0cca7065a7c9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:25.134486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c850c5fe-1a24-4a59-8244-0cca7065a7c9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:25.142698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c850c5fe-1a24-4a59-8244-0cca7065a7c9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:25.143630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c850c5fe-1a24-4a59-8244-0cca7065a7c9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:25.144222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c850c5fe-1a24-4a59-8244-0cca7065a7c9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:25.145643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c850c5fe-1a24-4a59-8244-0cca7065a7c9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:25.146963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c850c5fe-1a24-4a59-8244-0cca7065a7c9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:25.147751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c850c5fe-1a24-4a59-8244-0cca7065a7c9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:25.192445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8fa046d-b35f-4ffd-b8a2-185c04919e18 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:25.197064 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c850c5fe-1a24-4a59-8244-0cca7065a7c9 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068425 Sep 10 20:54:25.205121 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8fa046d-b35f-4ffd-b8a2-185c04919e18 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.630925 Sep 10 20:54:25.206477 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 843/1648] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 20:54:25 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:25.207208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 806/1649] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:24 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:25.218148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:25.221296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:25.229601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66f21c38-c808-4910-b572-d7583910ec1c tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:25.229887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:25.230557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:25.231299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:25.232769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:25.233670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:25.234377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:25.236034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-66f21c38-c808-4910-b572-d7583910ec1c tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:25.252298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:25.288859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'flavor' on Instance uuid aeb73142-7fcb-44b4-8ff3-b7624fc5b494 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:54:25.340359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Going to try to live migrate instance to nch2-master-1 {{(pid=145772) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 20:54:25.441440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-66f21c38-c808-4910-b572-d7583910ec1c tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:25.449659 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-66f21c38-c808-4910-b572-d7583910ec1c tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1224 microversion: 2.1 time: 0.240685 Sep 10 20:54:25.454753 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 807/1650] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:25 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1224 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:25.464743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c8155e2-2eca-4caf-9e83-1bb9fec432ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:25.466981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4c8155e2-2eca-4caf-9e83-1bb9fec432ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:25.478760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c8155e2-2eca-4caf-9e83-1bb9fec432ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:25.479535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c8155e2-2eca-4caf-9e83-1bb9fec432ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:25.480190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c8155e2-2eca-4caf-9e83-1bb9fec432ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:25.481136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c8155e2-2eca-4caf-9e83-1bb9fec432ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:25.482363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c8155e2-2eca-4caf-9e83-1bb9fec432ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:25.483126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c8155e2-2eca-4caf-9e83-1bb9fec432ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:26.012057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4c8155e2-2eca-4caf-9e83-1bb9fec432ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:26.023104 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c8155e2-2eca-4caf-9e83-1bb9fec432ef tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1529 microversion: 2.1 time: 0.566574 Sep 10 20:54:26.061860 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 808/1651] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:25 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1529 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:26.088994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b421007e-ec3c-483f-9dcb-58b1cfa879ec req-492bd0c5-a10a-4bd1-bc30-a138f22788b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0c2412-dd72-4889-8cce-8ec836eaf5e9", "name": "network-vif-plugged", "status": "completed", "tag": "420c3ef6-3c60-4b0b-b607-faebafccc318"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:26.126209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b421007e-ec3c-483f-9dcb-58b1cfa879ec req-492bd0c5-a10a-4bd1-bc30-a138f22788b2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:26.126699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b421007e-ec3c-483f-9dcb-58b1cfa879ec req-492bd0c5-a10a-4bd1-bc30-a138f22788b2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:26.140915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b421007e-ec3c-483f-9dcb-58b1cfa879ec req-492bd0c5-a10a-4bd1-bc30-a138f22788b2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:26.167749 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b421007e-ec3c-483f-9dcb-58b1cfa879ec req-492bd0c5-a10a-4bd1-bc30-a138f22788b2 service nova] Creating event network-vif-plugged:420c3ef6-3c60-4b0b-b607-faebafccc318 for instance 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 on nch1-master-1 Sep 10 20:54:26.186811 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b421007e-ec3c-483f-9dcb-58b1cfa879ec req-492bd0c5-a10a-4bd1-bc30-a138f22788b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126756 Sep 10 20:54:26.187702 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 809/1652] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:26.195585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b9903cf4-787d-4df2-a3e8-89846e82f418 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:26.197226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b9903cf4-787d-4df2-a3e8-89846e82f418 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:26.208021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9903cf4-787d-4df2-a3e8-89846e82f418 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:26.220861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9903cf4-787d-4df2-a3e8-89846e82f418 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:26.223894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9903cf4-787d-4df2-a3e8-89846e82f418 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:26.226744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9903cf4-787d-4df2-a3e8-89846e82f418 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:26.227611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9903cf4-787d-4df2-a3e8-89846e82f418 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:26.228967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9903cf4-787d-4df2-a3e8-89846e82f418 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:26.787733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b9903cf4-787d-4df2-a3e8-89846e82f418 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:26.804199 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b9903cf4-787d-4df2-a3e8-89846e82f418 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.615077 Sep 10 20:54:26.804791 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 810/1653] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:26 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:26.809262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6a95257b-b910-418d-a243-01f3f1edd2ce tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:26.834508 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-6a95257b-b910-418d-a243-01f3f1edd2ce tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] HTTP exception thrown: Flavor b6427c66-823f-473f-b054-dee292c3092e could not be found. Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6a95257b-b910-418d-a243-01f3f1edd2ce tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Request method failure captured: Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/flavors/b6427c66-823f-473f-b054-dee292c3092e HTTP/1.1 Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPihCJIOkgN33u2Dm-8scG15lwEAlLpYMTZ7Cvcre87sZDhilSAubAysCQDmQDt8W5NY_PbN2n09tG79mJgWU7i8kQYJEbMzEX0luCok1FrwrGPzF4KrB777noTJqd2f9SDCHRusnJPvRGcpc4TkSRxrn5kzBI9Do4HS3Grk2VMbTxE Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 13d6a80cfe5e49eda7f76cde966f9799 Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-MigrationsAdminTest-337118017 Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13d6a80cfe5e49eda7f76cde966f9799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13d6a80cfe5e49eda7f76cde966f9799"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_13d6a80cfe5e49eda7f76cde966f9799", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/13d6a80cfe5e49eda7f76cde966f9799"}]}] Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-MigrationsAdminTest-337118017 Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 13d6a80cfe5e49eda7f76cde966f9799 Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-MigrationsAdminTest-337118017 Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-MigrationsAdminTest-337118017-project-admin Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ff6039a197324406a774cd55dc06b9be Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-MigrationsAdminTest-337118017-project-admin Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: exception: Flavor b6427c66-823f-473f-b054-dee292c3092e could not be found. Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b6427c66-823f-473f-b054-dee292c3092e'} Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b6427c66-823f-473f-b054-dee292c3092e could not be found. Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor b6427c66-823f-473f-b054-dee292c3092e could not be found. Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:26.837792 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:26.844865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:26.844865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:26.844865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:26.844865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:26.844865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:54:26.844865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:54:26.844865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b6427c66-823f-473f-b054-dee292c3092e could not be found. Sep 10 20:54:26.844865 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:26.846046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6a95257b-b910-418d-a243-01f3f1edd2ce tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Returning 404 to user: Flavor b6427c66-823f-473f-b054-dee292c3092e could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:26.848597 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6a95257b-b910-418d-a243-01f3f1edd2ce tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/b6427c66-823f-473f-b054-dee292c3092e" status: 404 len: 109 microversion: 2.1 time: 0.042856 Sep 10 20:54:26.849208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 811/1654] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:54:26 2022] DELETE /compute/v2.1/flavors/b6427c66-823f-473f-b054-dee292c3092e => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:54:26.866065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5120aa2e-3933-4b7f-aa96-7d33af751c4f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:26.866065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5120aa2e-3933-4b7f-aa96-7d33af751c4f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:26.896135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120aa2e-3933-4b7f-aa96-7d33af751c4f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:26.899038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120aa2e-3933-4b7f-aa96-7d33af751c4f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:26.899508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120aa2e-3933-4b7f-aa96-7d33af751c4f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:26.900258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120aa2e-3933-4b7f-aa96-7d33af751c4f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:26.900730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120aa2e-3933-4b7f-aa96-7d33af751c4f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:26.901166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120aa2e-3933-4b7f-aa96-7d33af751c4f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:26.948854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:27.182250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5120aa2e-3933-4b7f-aa96-7d33af751c4f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:27.198413 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5120aa2e-3933-4b7f-aa96-7d33af751c4f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1299 microversion: 2.1 time: 0.347172 Sep 10 20:54:27.199288 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 812/1655] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:26 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1299 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:27.211240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-05f8339a-3311-4f95-965d-bea0abe8eb6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:27.219985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-05f8339a-3311-4f95-965d-bea0abe8eb6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:27.232087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05f8339a-3311-4f95-965d-bea0abe8eb6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:27.232785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05f8339a-3311-4f95-965d-bea0abe8eb6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:27.233233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05f8339a-3311-4f95-965d-bea0abe8eb6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:27.234065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05f8339a-3311-4f95-965d-bea0abe8eb6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:27.234534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05f8339a-3311-4f95-965d-bea0abe8eb6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:27.234969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05f8339a-3311-4f95-965d-bea0abe8eb6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:27.811878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-05f8339a-3311-4f95-965d-bea0abe8eb6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:27.838824 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-05f8339a-3311-4f95-965d-bea0abe8eb6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.637725 Sep 10 20:54:27.848730 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 813/1656] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:27 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:27.867933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-521a04a7-cb78-4519-b60c-1a5bcfbe8922 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:27.869197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-521a04a7-cb78-4519-b60c-1a5bcfbe8922 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:27.881763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-521a04a7-cb78-4519-b60c-1a5bcfbe8922 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:27.882664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-521a04a7-cb78-4519-b60c-1a5bcfbe8922 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:27.883375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-521a04a7-cb78-4519-b60c-1a5bcfbe8922 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:27.884601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-521a04a7-cb78-4519-b60c-1a5bcfbe8922 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:27.885312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-521a04a7-cb78-4519-b60c-1a5bcfbe8922 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:27.886079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-521a04a7-cb78-4519-b60c-1a5bcfbe8922 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:28.087745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-521a04a7-cb78-4519-b60c-1a5bcfbe8922 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:28.102411 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-521a04a7-cb78-4519-b60c-1a5bcfbe8922 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1282 microversion: 2.1 time: 0.239060 Sep 10 20:54:28.114453 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 814/1657] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:27 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1282 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:28.129926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-193174693", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:28.224324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:54:29.098895 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8ba63c71-cb64-459b-a762-6ffa57d64bbe tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494/action" status: 202 len: 0 microversion: 2.25 time: 3.890921 Sep 10 20:54:29.099728 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 844/1658] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 20:54:25 2022] POST /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494/action => generated 0 bytes in 3893 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:54:29.111981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c4d79f24-74c9-418c-901c-910c2e7af0f8 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:29.115198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c4d79f24-74c9-418c-901c-910c2e7af0f8 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:29.133441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4d79f24-74c9-418c-901c-910c2e7af0f8 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:29.135232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4d79f24-74c9-418c-901c-910c2e7af0f8 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:29.137648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4d79f24-74c9-418c-901c-910c2e7af0f8 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:29.141215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4d79f24-74c9-418c-901c-910c2e7af0f8 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:29.144582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4d79f24-74c9-418c-901c-910c2e7af0f8 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:29.145350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4d79f24-74c9-418c-901c-910c2e7af0f8 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:29.387413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:54:29.388095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:54:29.388806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:54:29.389248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:54:29.389660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:54:29.401736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:29.402272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:29.402930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:29.404278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:29.404904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:29.405531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:29.439247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for project d969d135196e409584d6647d5186c9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:29.470675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Getting quotas for user 870c4c66a15b4546bd981cfb5932b214 and project d969d135196e409584d6647d5186c9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:29.475907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c4d79f24-74c9-418c-901c-910c2e7af0f8 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:29.492590 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c4d79f24-74c9-418c-901c-910c2e7af0f8 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1292 microversion: 2.1 time: 0.389862 Sep 10 20:54:29.494620 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 845/1659] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:29 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1292 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:29.506679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e630a630-0150-463d-8038-a47ea8c5f3b3 req-ffe222aa-3126-4f8a-88a5-c0512c27a237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e1970c-5740-4466-911f-5aef17b7336e", "name": "network-vif-plugged", "status": "completed", "tag": "fd86c8ba-198f-490e-a5da-475f9082b557"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:29.512774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:54:29.515205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:54:29.536074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e630a630-0150-463d-8038-a47ea8c5f3b3 req-ffe222aa-3126-4f8a-88a5-c0512c27a237 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:29.536790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e630a630-0150-463d-8038-a47ea8c5f3b3 req-ffe222aa-3126-4f8a-88a5-c0512c27a237 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:29.537422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e630a630-0150-463d-8038-a47ea8c5f3b3 req-ffe222aa-3126-4f8a-88a5-c0512c27a237 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:29.545062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:29.564193 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e630a630-0150-463d-8038-a47ea8c5f3b3 req-ffe222aa-3126-4f8a-88a5-c0512c27a237 service nova] Creating event network-vif-plugged:fd86c8ba-198f-490e-a5da-475f9082b557 for instance a4e1970c-5740-4466-911f-5aef17b7336e on nch2-master-1 Sep 10 20:54:29.588482 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e630a630-0150-463d-8038-a47ea8c5f3b3 req-ffe222aa-3126-4f8a-88a5-c0512c27a237 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088639 Sep 10 20:54:29.589868 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 846/1660] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:29.609574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a7958315-6101-4a90-ad2f-26c8a354fd25 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:29.610470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a7958315-6101-4a90-ad2f-26c8a354fd25 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:29.624094 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f68ad790-d076-475b-ac49-8ec22b2426e7 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499663 Sep 10 20:54:29.627001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7958315-6101-4a90-ad2f-26c8a354fd25 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:29.632556 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 815/1661] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:54:29.644910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1281100396", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f3aabbf6-b101-4d74-914c-9c1510387333"}], "block_device_mapping_v2": [{"uuid": "821bbf79-1a20-4148-8bf2-6eb9f12cb17d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:29.655699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7958315-6101-4a90-ad2f-26c8a354fd25 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:29.662611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7958315-6101-4a90-ad2f-26c8a354fd25 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:29.671021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7958315-6101-4a90-ad2f-26c8a354fd25 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:29.675245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7958315-6101-4a90-ad2f-26c8a354fd25 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:29.676126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7958315-6101-4a90-ad2f-26c8a354fd25 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:29.835463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] validate_networks() for [('f3aabbf6-b101-4d74-914c-9c1510387333', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:54:30.181967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a7958315-6101-4a90-ad2f-26c8a354fd25 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:30.200297 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a7958315-6101-4a90-ad2f-26c8a354fd25 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.606010 Sep 10 20:54:30.203924 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 847/1662] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:29 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:30.212392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e5f4d23-3ebd-4420-8d39-239a2ed8a144 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:30.223705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e5f4d23-3ebd-4420-8d39-239a2ed8a144 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:30.237204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e5f4d23-3ebd-4420-8d39-239a2ed8a144 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:30.237746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e5f4d23-3ebd-4420-8d39-239a2ed8a144 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:30.240359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e5f4d23-3ebd-4420-8d39-239a2ed8a144 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:30.241329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e5f4d23-3ebd-4420-8d39-239a2ed8a144 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:30.241798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e5f4d23-3ebd-4420-8d39-239a2ed8a144 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:30.242254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e5f4d23-3ebd-4420-8d39-239a2ed8a144 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:30.491341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8e5f4d23-3ebd-4420-8d39-239a2ed8a144 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:30.513712 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e5f4d23-3ebd-4420-8d39-239a2ed8a144 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1522 microversion: 2.1 time: 0.303161 Sep 10 20:54:30.514711 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 848/1663] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:30 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:30.520373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:30.521104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:30.527621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:30.528892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:30.529840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:30.530790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:30.531473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:30.532284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:30.895406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:30.906602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:30.909736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:30.911944 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0b4fe8f-43c2-49f4-85f0-fdcf9fec5670 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.394938 Sep 10 20:54:30.913933 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 849/1664] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:30 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:30.938790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9902845f-68fa-4217-a412-e526805ce8f5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:30.939391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9902845f-68fa-4217-a412-e526805ce8f5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:30.972164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9902845f-68fa-4217-a412-e526805ce8f5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:30.972670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9902845f-68fa-4217-a412-e526805ce8f5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:30.973101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9902845f-68fa-4217-a412-e526805ce8f5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:30.975130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9902845f-68fa-4217-a412-e526805ce8f5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:30.977575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9902845f-68fa-4217-a412-e526805ce8f5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:30.985274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9902845f-68fa-4217-a412-e526805ce8f5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:31.347704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9902845f-68fa-4217-a412-e526805ce8f5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:31.360125 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9902845f-68fa-4217-a412-e526805ce8f5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1324 microversion: 2.1 time: 0.444910 Sep 10 20:54:31.361121 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 850/1665] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:30 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:31.366288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b2e6fbe2-799e-451b-bb11-d5731bfb69ed tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:31.367157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b2e6fbe2-799e-451b-bb11-d5731bfb69ed tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:31.376053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2e6fbe2-799e-451b-bb11-d5731bfb69ed tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:31.376602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2e6fbe2-799e-451b-bb11-d5731bfb69ed tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:31.377280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2e6fbe2-799e-451b-bb11-d5731bfb69ed tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:31.378085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2e6fbe2-799e-451b-bb11-d5731bfb69ed tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:31.378735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2e6fbe2-799e-451b-bb11-d5731bfb69ed tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:31.379163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2e6fbe2-799e-451b-bb11-d5731bfb69ed tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:31.476838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b2e6fbe2-799e-451b-bb11-d5731bfb69ed tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:31.487956 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b2e6fbe2-799e-451b-bb11-d5731bfb69ed tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1264 microversion: 2.1 time: 0.125559 Sep 10 20:54:31.492534 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 851/1666] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:31 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1264 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:31.501230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-33b0f886-1354-46e0-8dea-3c757cf251c1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:31.502440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-33b0f886-1354-46e0-8dea-3c757cf251c1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:31.505218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:31.510437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33b0f886-1354-46e0-8dea-3c757cf251c1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:31.511743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33b0f886-1354-46e0-8dea-3c757cf251c1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:31.512454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33b0f886-1354-46e0-8dea-3c757cf251c1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:31.513287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33b0f886-1354-46e0-8dea-3c757cf251c1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:31.513892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33b0f886-1354-46e0-8dea-3c757cf251c1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:31.514326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33b0f886-1354-46e0-8dea-3c757cf251c1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:31.662274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-33b0f886-1354-46e0-8dea-3c757cf251c1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:31.671701 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-33b0f886-1354-46e0-8dea-3c757cf251c1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1484 microversion: 2.1 time: 0.178122 Sep 10 20:54:31.672291 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 852/1667] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:31 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1484 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:31.676725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3a3a2c04-5757-40aa-8d7f-fc4d4f264b66 req-f852b7df-d5bc-410f-8c2f-0899c3d3b23f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd3610b-d918-4b60-80cc-17213d521c75", "tag": "856894a7-145f-4343-9608-2c238b5a700d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:31.687565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3a3a2c04-5757-40aa-8d7f-fc4d4f264b66 req-f852b7df-d5bc-410f-8c2f-0899c3d3b23f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:31.688048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3a3a2c04-5757-40aa-8d7f-fc4d4f264b66 req-f852b7df-d5bc-410f-8c2f-0899c3d3b23f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:31.688482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3a3a2c04-5757-40aa-8d7f-fc4d4f264b66 req-f852b7df-d5bc-410f-8c2f-0899c3d3b23f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:31.700800 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3a3a2c04-5757-40aa-8d7f-fc4d4f264b66 req-f852b7df-d5bc-410f-8c2f-0899c3d3b23f service nova] Creating event network-changed:856894a7-145f-4343-9608-2c238b5a700d for instance 7cd3610b-d918-4b60-80cc-17213d521c75 on nch2-master-1 Sep 10 20:54:31.705742 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3a3a2c04-5757-40aa-8d7f-fc4d4f264b66 req-f852b7df-d5bc-410f-8c2f-0899c3d3b23f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032301 Sep 10 20:54:31.707800 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 853/1668] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:31.712856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f230fafa-6290-4852-8241-72cc9b3c72e9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:31.713563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f230fafa-6290-4852-8241-72cc9b3c72e9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:31.720296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f230fafa-6290-4852-8241-72cc9b3c72e9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:31.720798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f230fafa-6290-4852-8241-72cc9b3c72e9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:31.721940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f230fafa-6290-4852-8241-72cc9b3c72e9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:31.722235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f230fafa-6290-4852-8241-72cc9b3c72e9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:31.722852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f230fafa-6290-4852-8241-72cc9b3c72e9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:31.723292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f230fafa-6290-4852-8241-72cc9b3c72e9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:31.792232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:54:31.794599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:54:31.795954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:54:31.796773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:54:31.797358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:54:31.810366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:31.811117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:31.813991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:31.815032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:31.816290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:31.816968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:31.850068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Getting quotas for project 5bd065954b0e4520a3c1deba0916db85. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:31.862204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Getting quotas for user f74a2c8cd22c454fa8fdd7c2e1ef9230 and project 5bd065954b0e4520a3c1deba0916db85. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:31.979429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:54:31.983523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='821bbf79-1a20-4148-8bf2-6eb9f12cb17d',volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:54:31.990966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f230fafa-6290-4852-8241-72cc9b3c72e9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:32.002223 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f230fafa-6290-4852-8241-72cc9b3c72e9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.293017 Sep 10 20:54:32.003184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 854/1669] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:31 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:32.008816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1ad7ebbe-d6be-41be-907a-e8ed55f983fb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:32.010265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1ad7ebbe-d6be-41be-907a-e8ed55f983fb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:32.020277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad7ebbe-d6be-41be-907a-e8ed55f983fb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:32.021176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad7ebbe-d6be-41be-907a-e8ed55f983fb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:32.021899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad7ebbe-d6be-41be-907a-e8ed55f983fb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:32.022990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad7ebbe-d6be-41be-907a-e8ed55f983fb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:32.023784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad7ebbe-d6be-41be-907a-e8ed55f983fb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:32.023994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad7ebbe-d6be-41be-907a-e8ed55f983fb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:32.163827 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d99c8373-4472-4f52-8914-331ddfcc185e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.529785 Sep 10 20:54:32.165067 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 816/1670] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:54:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:54:32.177739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b2d5ca43-7248-46fc-bbe9-82d8247b3807 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:32.178288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b2d5ca43-7248-46fc-bbe9-82d8247b3807 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:32.202690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2d5ca43-7248-46fc-bbe9-82d8247b3807 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:32.203492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2d5ca43-7248-46fc-bbe9-82d8247b3807 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:32.204106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2d5ca43-7248-46fc-bbe9-82d8247b3807 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:32.205134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2d5ca43-7248-46fc-bbe9-82d8247b3807 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:32.205775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2d5ca43-7248-46fc-bbe9-82d8247b3807 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:32.206433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2d5ca43-7248-46fc-bbe9-82d8247b3807 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:32.370011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1ad7ebbe-d6be-41be-907a-e8ed55f983fb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:32.380801 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1ad7ebbe-d6be-41be-907a-e8ed55f983fb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1502 microversion: 2.1 time: 0.376340 Sep 10 20:54:32.381797 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 855/1671] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:32 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:32.409302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:32.412423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:32.429406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:32.430616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:32.433098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:32.437268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:32.438377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:32.438848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:32.596225 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b2d5ca43-7248-46fc-bbe9-82d8247b3807 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.428873 Sep 10 20:54:32.598614 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 817/1672] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 20:54:32 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9/os-interface => generated 285 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:32.611951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-524b3301-3c61-4552-9f9b-8f3e853c17b7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:32.614244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-524b3301-3c61-4552-9f9b-8f3e853c17b7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:32.756817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:32.769361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:32.773711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:32.778978 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0a3da973-7947-4cf5-88c4-5964cd30ebeb tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.394743 Sep 10 20:54:32.786095 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 856/1673] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:32 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:32.796753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5439cfbf-fd3d-4a71-b8c4-404010737764 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:32.797187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5439cfbf-fd3d-4a71-b8c4-404010737764 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:32.812959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5439cfbf-fd3d-4a71-b8c4-404010737764 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:32.813452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5439cfbf-fd3d-4a71-b8c4-404010737764 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:32.813950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5439cfbf-fd3d-4a71-b8c4-404010737764 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:32.818427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5439cfbf-fd3d-4a71-b8c4-404010737764 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:32.819179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5439cfbf-fd3d-4a71-b8c4-404010737764 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:32.819822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5439cfbf-fd3d-4a71-b8c4-404010737764 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:32.881642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-524b3301-3c61-4552-9f9b-8f3e853c17b7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:32.899513 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-524b3301-3c61-4552-9f9b-8f3e853c17b7 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1053 microversion: 2.1 time: 0.299469 Sep 10 20:54:32.900492 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 818/1674] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:32 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1053 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:32.907447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3c455267-5e86-4816-be01-bc4d5ce7196e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:32.908489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3c455267-5e86-4816-be01-bc4d5ce7196e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:32.915922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c455267-5e86-4816-be01-bc4d5ce7196e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:32.916766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c455267-5e86-4816-be01-bc4d5ce7196e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:32.917585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c455267-5e86-4816-be01-bc4d5ce7196e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:32.918694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c455267-5e86-4816-be01-bc4d5ce7196e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:32.919870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c455267-5e86-4816-be01-bc4d5ce7196e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:32.920637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c455267-5e86-4816-be01-bc4d5ce7196e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:33.220971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5439cfbf-fd3d-4a71-b8c4-404010737764 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:33.232038 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5439cfbf-fd3d-4a71-b8c4-404010737764 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1324 microversion: 2.1 time: 0.444681 Sep 10 20:54:33.240969 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 857/1675] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:32 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:33.246508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc8bac45-df9d-4729-b1e1-29e5ba8126e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:33.248204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fc8bac45-df9d-4729-b1e1-29e5ba8126e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:33.282915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc8bac45-df9d-4729-b1e1-29e5ba8126e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:33.286199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc8bac45-df9d-4729-b1e1-29e5ba8126e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:33.286791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc8bac45-df9d-4729-b1e1-29e5ba8126e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:33.293177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc8bac45-df9d-4729-b1e1-29e5ba8126e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:33.293819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc8bac45-df9d-4729-b1e1-29e5ba8126e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:33.294551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc8bac45-df9d-4729-b1e1-29e5ba8126e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:33.500732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3c455267-5e86-4816-be01-bc4d5ce7196e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:33.509727 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3c455267-5e86-4816-be01-bc4d5ce7196e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1516 microversion: 2.1 time: 0.607543 Sep 10 20:54:33.510269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fc8bac45-df9d-4729-b1e1-29e5ba8126e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:33.525402 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc8bac45-df9d-4729-b1e1-29e5ba8126e8 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1270 microversion: 2.1 time: 0.282955 Sep 10 20:54:33.526251 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 858/1676] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:33 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1270 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:33.531289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8a68860-3840-4294-b1c9-968d6f7cfeb5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:33.532584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8a68860-3840-4294-b1c9-968d6f7cfeb5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:33.540593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a68860-3840-4294-b1c9-968d6f7cfeb5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:33.541471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a68860-3840-4294-b1c9-968d6f7cfeb5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:33.542465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a68860-3840-4294-b1c9-968d6f7cfeb5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:33.543150 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 819/1677] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:32 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1516 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:33.543718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a68860-3840-4294-b1c9-968d6f7cfeb5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:33.545300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a68860-3840-4294-b1c9-968d6f7cfeb5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:33.546487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a68860-3840-4294-b1c9-968d6f7cfeb5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:33.571166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8e9fd009-4621-4c08-9b3b-8fd38a898c68 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:33.580881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8e9fd009-4621-4c08-9b3b-8fd38a898c68 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 2792aef5-957b-44d0-938e-3da7f004f617] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:33.601052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=26 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:33.622262 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-8e9fd009-4621-4c08-9b3b-8fd38a898c68 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] HTTP exception thrown: Instance 2792aef5-957b-44d0-938e-3da7f004f617 could not be found. Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8e9fd009-4621-4c08-9b3b-8fd38a898c68 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Request method failure captured: Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/2792aef5-957b-44d0-938e-3da7f004f617/action HTTP/1.1 Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 14 Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPlIfEE6BUsYm6N9cc6J4sKvQx8zkdVi0_eGxve7idCE5St69TEoXloNJQbmDpLOYE4kW76RSsXwzH4ER5m-rWYbak-zkdFvTsFOuE5UWRW73UCQGyOtVDm5s0CSvgZ9e1C_-bLDziBI_eeTxSX1Lq4xDS48kCIhpdBe8v0QA9iMeLw Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4b1732129f3414fbc3f26fff6d039ec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4b1732129f3414fbc3f26fff6d039ec"}]}] Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d8b0a160808f4adda7be57cd535f0631 Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: {"rescue": {}} Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 2792aef5-957b-44d0-938e-3da7f004f617 could not be found. Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2792aef5-957b-44d0-938e-3da7f004f617', 'body': {'rescue': {}}} Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2792aef5-957b-44d0-938e-3da7f004f617 could not be found. Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2792aef5-957b-44d0-938e-3da7f004f617 could not be found. Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:33.625002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:33.630607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:33.630607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:33.630607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:54:33.630607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:54:33.630607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2792aef5-957b-44d0-938e-3da7f004f617 could not be found. Sep 10 20:54:33.630607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:33.631878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8e9fd009-4621-4c08-9b3b-8fd38a898c68 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Returning 404 to user: Instance 2792aef5-957b-44d0-938e-3da7f004f617 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:33.632890 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8e9fd009-4621-4c08-9b3b-8fd38a898c68 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/2792aef5-957b-44d0-938e-3da7f004f617/action" status: 404 len: 111 microversion: 2.1 time: 0.067985 Sep 10 20:54:33.633948 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 820/1678] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:54:33 2022] POST /compute/v2.1/servers/2792aef5-957b-44d0-938e-3da7f004f617/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:54:33.645444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0b4ca545-c9a7-4e0e-a883-357d504f0731 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:33.648674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0b4ca545-c9a7-4e0e-a883-357d504f0731 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:33.669456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b4ca545-c9a7-4e0e-a883-357d504f0731 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:33.670377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b4ca545-c9a7-4e0e-a883-357d504f0731 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:33.671050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b4ca545-c9a7-4e0e-a883-357d504f0731 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:33.673720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b4ca545-c9a7-4e0e-a883-357d504f0731 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:33.674483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b4ca545-c9a7-4e0e-a883-357d504f0731 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:33.675163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b4ca545-c9a7-4e0e-a883-357d504f0731 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:33.825948 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0b4ca545-c9a7-4e0e-a883-357d504f0731 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action" status: 202 len: 0 microversion: 2.1 time: 0.183170 Sep 10 20:54:33.829446 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 821/1679] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:54:33 2022] POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:54:33.846250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:33.847704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:33.859372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8a68860-3840-4294-b1c9-968d6f7cfeb5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:33.868152 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8a68860-3840-4294-b1c9-968d6f7cfeb5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.340484 Sep 10 20:54:33.869008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:33.869519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:33.869993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:33.872343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:33.872815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:33.875705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:33.878595 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 859/1680] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:33 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:33.886101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5e9d428d-821f-4cf1-9b48-592d4dbe1e07 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:33.889122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5e9d428d-821f-4cf1-9b48-592d4dbe1e07 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:33.905565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e9d428d-821f-4cf1-9b48-592d4dbe1e07 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:33.906632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e9d428d-821f-4cf1-9b48-592d4dbe1e07 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:33.908117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e9d428d-821f-4cf1-9b48-592d4dbe1e07 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:33.909873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e9d428d-821f-4cf1-9b48-592d4dbe1e07 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:33.910850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e9d428d-821f-4cf1-9b48-592d4dbe1e07 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:33.911580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e9d428d-821f-4cf1-9b48-592d4dbe1e07 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:34.244738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:34.337594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5e9d428d-821f-4cf1-9b48-592d4dbe1e07 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:34.347521 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5e9d428d-821f-4cf1-9b48-592d4dbe1e07 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1521 microversion: 2.1 time: 0.467579 Sep 10 20:54:34.361985 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 860/1681] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:33 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:34.373066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b059ffbf-7739-4ac9-819b-34fa2b936b10 req-a3a735cb-c92f-4dcb-a8aa-b145f9a127c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb03fb54-1b7b-42ec-b71b-b73d7f96b657", "tag": "c88c7c1f-fddc-4804-9ba5-5dfaae6029f9"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:34.383875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b059ffbf-7739-4ac9-819b-34fa2b936b10 req-a3a735cb-c92f-4dcb-a8aa-b145f9a127c4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:34.384359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b059ffbf-7739-4ac9-819b-34fa2b936b10 req-a3a735cb-c92f-4dcb-a8aa-b145f9a127c4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:34.384787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b059ffbf-7739-4ac9-819b-34fa2b936b10 req-a3a735cb-c92f-4dcb-a8aa-b145f9a127c4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:34.404399 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b059ffbf-7739-4ac9-819b-34fa2b936b10 req-a3a735cb-c92f-4dcb-a8aa-b145f9a127c4 service nova] Creating event network-changed:c88c7c1f-fddc-4804-9ba5-5dfaae6029f9 for instance cb03fb54-1b7b-42ec-b71b-b73d7f96b657 on nch2-master-1 Sep 10 20:54:34.411117 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b059ffbf-7739-4ac9-819b-34fa2b936b10 req-a3a735cb-c92f-4dcb-a8aa-b145f9a127c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047425 Sep 10 20:54:34.412297 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 861/1682] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:34.417752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-611d45d1-2a43-44dc-84b9-f1d67a727125 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:34.420550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-611d45d1-2a43-44dc-84b9-f1d67a727125 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:34.435207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-611d45d1-2a43-44dc-84b9-f1d67a727125 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:34.439429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-611d45d1-2a43-44dc-84b9-f1d67a727125 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:34.442524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-611d45d1-2a43-44dc-84b9-f1d67a727125 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:34.444119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-611d45d1-2a43-44dc-84b9-f1d67a727125 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:34.444835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-611d45d1-2a43-44dc-84b9-f1d67a727125 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:34.445501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-611d45d1-2a43-44dc-84b9-f1d67a727125 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:34.577246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-611d45d1-2a43-44dc-84b9-f1d67a727125 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:34.591434 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-611d45d1-2a43-44dc-84b9-f1d67a727125 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1169 microversion: 2.1 time: 0.177621 Sep 10 20:54:34.596838 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 862/1683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:34 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:34.624424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3c44a357-e72f-48df-98f7-c4fe0223ce29 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:34.625051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3c44a357-e72f-48df-98f7-c4fe0223ce29 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:34.647813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c44a357-e72f-48df-98f7-c4fe0223ce29 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:34.649015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c44a357-e72f-48df-98f7-c4fe0223ce29 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:34.649655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c44a357-e72f-48df-98f7-c4fe0223ce29 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:34.650601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c44a357-e72f-48df-98f7-c4fe0223ce29 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:34.652904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c44a357-e72f-48df-98f7-c4fe0223ce29 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:34.653763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c44a357-e72f-48df-98f7-c4fe0223ce29 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:35.230791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:35.244002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:35.246298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:35.248273 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1137c829-b04b-4906-a6aa-c3b33c2d94d4 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 1.416894 Sep 10 20:54:35.249128 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 822/1684] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:33 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:35.254218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-885d3330-4887-48a8-9acf-dc94db617d9a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:35.255844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-885d3330-4887-48a8-9acf-dc94db617d9a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:35.264175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-885d3330-4887-48a8-9acf-dc94db617d9a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:35.265092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-885d3330-4887-48a8-9acf-dc94db617d9a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:35.265778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-885d3330-4887-48a8-9acf-dc94db617d9a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:35.267452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-885d3330-4887-48a8-9acf-dc94db617d9a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:35.268660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-885d3330-4887-48a8-9acf-dc94db617d9a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:35.269419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-885d3330-4887-48a8-9acf-dc94db617d9a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:35.373886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3c44a357-e72f-48df-98f7-c4fe0223ce29 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:35.383490 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3c44a357-e72f-48df-98f7-c4fe0223ce29 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1324 microversion: 2.1 time: 0.768025 Sep 10 20:54:35.385548 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 863/1685] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:34 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1324 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:35.396563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dacda91d-98cc-4ed0-bf4e-60f1d4daff85 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:35.399438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dacda91d-98cc-4ed0-bf4e-60f1d4daff85 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:35.413856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dacda91d-98cc-4ed0-bf4e-60f1d4daff85 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:35.414801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dacda91d-98cc-4ed0-bf4e-60f1d4daff85 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:35.415448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dacda91d-98cc-4ed0-bf4e-60f1d4daff85 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:35.417704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dacda91d-98cc-4ed0-bf4e-60f1d4daff85 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:35.423768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dacda91d-98cc-4ed0-bf4e-60f1d4daff85 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:35.425769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dacda91d-98cc-4ed0-bf4e-60f1d4daff85 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:36.300915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dacda91d-98cc-4ed0-bf4e-60f1d4daff85 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:36.304169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:36.315278 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dacda91d-98cc-4ed0-bf4e-60f1d4daff85 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.925636 Sep 10 20:54:36.331417 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 864/1686] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:35 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:36.341437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ee85b61-ada9-4c40-9dd6-134e2e5816d3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:36.342405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2ee85b61-ada9-4c40-9dd6-134e2e5816d3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:36.349384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ee85b61-ada9-4c40-9dd6-134e2e5816d3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:36.351565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ee85b61-ada9-4c40-9dd6-134e2e5816d3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:36.352072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ee85b61-ada9-4c40-9dd6-134e2e5816d3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:36.353005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ee85b61-ada9-4c40-9dd6-134e2e5816d3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:36.353627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ee85b61-ada9-4c40-9dd6-134e2e5816d3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:36.354244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ee85b61-ada9-4c40-9dd6-134e2e5816d3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:36.482608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-885d3330-4887-48a8-9acf-dc94db617d9a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:36.503063 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-885d3330-4887-48a8-9acf-dc94db617d9a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1312 microversion: 2.1 time: 1.249633 Sep 10 20:54:36.504179 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 823/1687] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:35 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1312 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:36.542983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cdc53016-586d-4e8a-b23e-e9daf16851ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:36.546218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cdc53016-586d-4e8a-b23e-e9daf16851ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:36.578216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc53016-586d-4e8a-b23e-e9daf16851ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:36.578749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc53016-586d-4e8a-b23e-e9daf16851ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:36.579194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc53016-586d-4e8a-b23e-e9daf16851ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:36.586393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc53016-586d-4e8a-b23e-e9daf16851ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:36.586909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc53016-586d-4e8a-b23e-e9daf16851ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:36.592682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc53016-586d-4e8a-b23e-e9daf16851ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:36.681288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ee85b61-ada9-4c40-9dd6-134e2e5816d3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:36.698586 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ee85b61-ada9-4c40-9dd6-134e2e5816d3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1501 microversion: 2.1 time: 0.365317 Sep 10 20:54:36.699534 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 865/1688] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:36 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1501 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:36.723615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:36.730815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:36.736881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cdc53016-586d-4e8a-b23e-e9daf16851ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:36.744375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:36.745124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:36.745744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:36.746852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:36.747526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:36.748198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:36.749123 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cdc53016-586d-4e8a-b23e-e9daf16851ca tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1157 microversion: 2.1 time: 0.219946 Sep 10 20:54:36.750568 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 824/1689] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:36 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1157 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:36.759113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5ae1b275-f80a-481b-85e3-a4a873420e90 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:36.759724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5ae1b275-f80a-481b-85e3-a4a873420e90 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:36.776081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae1b275-f80a-481b-85e3-a4a873420e90 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:36.776683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae1b275-f80a-481b-85e3-a4a873420e90 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:36.777161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae1b275-f80a-481b-85e3-a4a873420e90 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:36.778836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae1b275-f80a-481b-85e3-a4a873420e90 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:36.779342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae1b275-f80a-481b-85e3-a4a873420e90 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:36.779771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae1b275-f80a-481b-85e3-a4a873420e90 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.093306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:37.102741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:37.104212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:37.105376 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-de319e50-7aff-4da4-b2e7-17bcad54c2e8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.389769 Sep 10 20:54:37.106555 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 866/1690] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:36 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:37.125054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:37.129935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:37.159045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.161524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.162183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.164387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.165038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.167263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.246420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lazy-loading 'flavor' on Instance uuid 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:54:37.279623 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] HTTP exception thrown: Cannot 'rescue' instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be while it is in vm_state paused Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Request method failure captured: Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action HTTP/1.1 Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 14 Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPlIfEE6BUsYm6N9cc6J4sKvQx8zkdVi0_eGxve7idCE5St69TEoXloNJQbmDpLOYE4kW76RSsXwzH4ER5m-rWYbak-zkdFvTsFOuE5UWRW73UCQGyOtVDm5s0CSvgZ9e1C_-bLDziBI_eeTxSX1Lq4xDS48kCIhpdBe8v0QA9iMeLw Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4b1732129f3414fbc3f26fff6d039ec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4b1732129f3414fbc3f26fff6d039ec"}]}] Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d8b0a160808f4adda7be57cd535f0631 Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: {"rescue": {}} Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: exception: Cannot 'rescue' instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be while it is in vm_state paused Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be', 'body': {'rescue': {}}} Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be in vm_state paused. Cannot rescue while the instance is in this state. Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be while it is in vm_state paused Sep 10 20:54:37.282273 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:37.288658 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:37.288658 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:37.288658 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:37.288658 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:37.288658 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:37.288658 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:54:37.288658 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:54:37.288658 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be while it is in vm_state paused Sep 10 20:54:37.288658 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:37.288658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Returning 409 to user: Cannot 'rescue' instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be while it is in vm_state paused {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:37.291601 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f19900dd-6be5-4cce-aa3e-c7c34e974459 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action" status: 409 len: 144 microversion: 2.1 time: 0.168883 Sep 10 20:54:37.291915 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 867/1691] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:54:37 2022] POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action => generated 144 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:54:37.310242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8220b9aa-35bd-4c03-9dff-009faf600caa tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:37.310981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8220b9aa-35bd-4c03-9dff-009faf600caa tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:37.322158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8220b9aa-35bd-4c03-9dff-009faf600caa tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.327153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8220b9aa-35bd-4c03-9dff-009faf600caa tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.327792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8220b9aa-35bd-4c03-9dff-009faf600caa tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.328745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8220b9aa-35bd-4c03-9dff-009faf600caa tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.330416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8220b9aa-35bd-4c03-9dff-009faf600caa tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.334253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8220b9aa-35bd-4c03-9dff-009faf600caa tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.417087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5ae1b275-f80a-481b-85e3-a4a873420e90 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:37.451866 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5ae1b275-f80a-481b-85e3-a4a873420e90 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1324 microversion: 2.1 time: 0.697309 Sep 10 20:54:37.467944 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 825/1692] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:36 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1324 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:37.477432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8d1cbdb4-3e19-4487-9413-cf8fb1cab905 req-a010f1ab-3ac0-4c07-9fb5-f317ddcf7233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0c2412-dd72-4889-8cce-8ec836eaf5e9", "tag": "420c3ef6-3c60-4b0b-b607-faebafccc318"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:37.489312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8d1cbdb4-3e19-4487-9413-cf8fb1cab905 req-a010f1ab-3ac0-4c07-9fb5-f317ddcf7233 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.490547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8d1cbdb4-3e19-4487-9413-cf8fb1cab905 req-a010f1ab-3ac0-4c07-9fb5-f317ddcf7233 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.491161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8d1cbdb4-3e19-4487-9413-cf8fb1cab905 req-a010f1ab-3ac0-4c07-9fb5-f317ddcf7233 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.506715 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8d1cbdb4-3e19-4487-9413-cf8fb1cab905 req-a010f1ab-3ac0-4c07-9fb5-f317ddcf7233 service nova] Creating event network-changed:420c3ef6-3c60-4b0b-b607-faebafccc318 for instance 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 on nch1-master-1 Sep 10 20:54:37.515593 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8d1cbdb4-3e19-4487-9413-cf8fb1cab905 req-a010f1ab-3ac0-4c07-9fb5-f317ddcf7233 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040472 Sep 10 20:54:37.517045 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 826/1693] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:37.524322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-adb6cb01-cdf5-45db-8663-369d56d03632 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:37.525254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-adb6cb01-cdf5-45db-8663-369d56d03632 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:37.540485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb6cb01-cdf5-45db-8663-369d56d03632 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.541713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb6cb01-cdf5-45db-8663-369d56d03632 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.542328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb6cb01-cdf5-45db-8663-369d56d03632 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.544987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb6cb01-cdf5-45db-8663-369d56d03632 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.545656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb6cb01-cdf5-45db-8663-369d56d03632 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.546142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb6cb01-cdf5-45db-8663-369d56d03632 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.666883 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-adb6cb01-cdf5-45db-8663-369d56d03632 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action" status: 202 len: 0 microversion: 2.1 time: 0.145295 Sep 10 20:54:37.669715 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 827/1694] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:54:37 2022] POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:54:37.686476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d6f44720-4268-442c-a1bd-88c9a3721ac5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:37.690227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d6f44720-4268-442c-a1bd-88c9a3721ac5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:37.705377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8220b9aa-35bd-4c03-9dff-009faf600caa tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:37.710474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6f44720-4268-442c-a1bd-88c9a3721ac5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.711213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6f44720-4268-442c-a1bd-88c9a3721ac5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.717338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6f44720-4268-442c-a1bd-88c9a3721ac5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.718141 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8220b9aa-35bd-4c03-9dff-009faf600caa tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1484 microversion: 2.1 time: 0.420487 Sep 10 20:54:37.718987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6f44720-4268-442c-a1bd-88c9a3721ac5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.719552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6f44720-4268-442c-a1bd-88c9a3721ac5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.720140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6f44720-4268-442c-a1bd-88c9a3721ac5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.722196 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 868/1695] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:37 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1484 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:37.729889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f13dbb4e-8356-4b36-9793-c4846c8182ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:37.734633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f13dbb4e-8356-4b36-9793-c4846c8182ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:37.750764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f13dbb4e-8356-4b36-9793-c4846c8182ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.760706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f13dbb4e-8356-4b36-9793-c4846c8182ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.762178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f13dbb4e-8356-4b36-9793-c4846c8182ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:37.766885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f13dbb4e-8356-4b36-9793-c4846c8182ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:37.768823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f13dbb4e-8356-4b36-9793-c4846c8182ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:37.771310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f13dbb4e-8356-4b36-9793-c4846c8182ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:38.108433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d6f44720-4268-442c-a1bd-88c9a3721ac5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:38.110216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f13dbb4e-8356-4b36-9793-c4846c8182ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:38.119728 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d6f44720-4268-442c-a1bd-88c9a3721ac5 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.448305 Sep 10 20:54:38.120414 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f13dbb4e-8356-4b36-9793-c4846c8182ad tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1312 microversion: 2.1 time: 0.396961 Sep 10 20:54:38.121008 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 869/1696] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:37 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:38.137984 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 828/1697] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:37 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:38.146110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d75e0191-5f7b-49d2-a7c9-dea9dfb127f5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:38.146726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d75e0191-5f7b-49d2-a7c9-dea9dfb127f5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:38.166881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d75e0191-5f7b-49d2-a7c9-dea9dfb127f5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:38.167396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d75e0191-5f7b-49d2-a7c9-dea9dfb127f5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:38.168049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d75e0191-5f7b-49d2-a7c9-dea9dfb127f5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:38.169042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d75e0191-5f7b-49d2-a7c9-dea9dfb127f5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:38.172559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-480acf86-12ff-47be-8462-f398eb17c3f2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:38.178557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d75e0191-5f7b-49d2-a7c9-dea9dfb127f5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:38.179023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d75e0191-5f7b-49d2-a7c9-dea9dfb127f5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:38.179160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-480acf86-12ff-47be-8462-f398eb17c3f2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:38.192358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-480acf86-12ff-47be-8462-f398eb17c3f2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:38.195011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-480acf86-12ff-47be-8462-f398eb17c3f2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:38.195706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-480acf86-12ff-47be-8462-f398eb17c3f2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:38.196616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-480acf86-12ff-47be-8462-f398eb17c3f2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:38.198201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-480acf86-12ff-47be-8462-f398eb17c3f2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:38.200738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-480acf86-12ff-47be-8462-f398eb17c3f2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:38.436600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d75e0191-5f7b-49d2-a7c9-dea9dfb127f5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:38.446783 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d75e0191-5f7b-49d2-a7c9-dea9dfb127f5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1508 microversion: 2.1 time: 0.324624 Sep 10 20:54:38.454587 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 870/1698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:38 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1508 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:38.459622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:38.460784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:38.477367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:38.478254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:38.478922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:38.479838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:38.483652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:38.484326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:38.761551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-480acf86-12ff-47be-8462-f398eb17c3f2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:38.777152 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-480acf86-12ff-47be-8462-f398eb17c3f2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1199 microversion: 2.1 time: 0.638175 Sep 10 20:54:38.791635 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 829/1699] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:38 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1199 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:38.907391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-288795044", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "fb7a08eb-859f-4d5a-a729-24ed5c968d62"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:39.025177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] validate_networks() for [('fb7a08eb-859f-4d5a-a729-24ed5c968d62', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:54:39.183367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:39.194679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:39.196720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:39.198209 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b574055-ed63-4756-84ae-90f2790ac77b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.742361 Sep 10 20:54:39.209783 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 871/1700] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:38 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:39.225168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c1283a3-2ab8-4754-82c4-3ad9d977b1a5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:39.226201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c1283a3-2ab8-4754-82c4-3ad9d977b1a5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:39.233927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c1283a3-2ab8-4754-82c4-3ad9d977b1a5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:39.234879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c1283a3-2ab8-4754-82c4-3ad9d977b1a5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:39.235590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c1283a3-2ab8-4754-82c4-3ad9d977b1a5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:39.236600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c1283a3-2ab8-4754-82c4-3ad9d977b1a5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:39.237286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c1283a3-2ab8-4754-82c4-3ad9d977b1a5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:39.238084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c1283a3-2ab8-4754-82c4-3ad9d977b1a5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:39.692985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c1283a3-2ab8-4754-82c4-3ad9d977b1a5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:39.709515 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c1283a3-2ab8-4754-82c4-3ad9d977b1a5 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1324 microversion: 2.1 time: 0.490784 Sep 10 20:54:39.710853 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 872/1701] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:39 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1324 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:39.729452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6a7797ca-74da-4d55-844e-7029fd34beed req-9f3fb5f2-f3f8-4295-8e64-4024cb7050c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd3610b-d918-4b60-80cc-17213d521c75", "name": "network-vif-plugged", "status": "completed", "tag": "856894a7-145f-4343-9608-2c238b5a700d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:39.742992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6a7797ca-74da-4d55-844e-7029fd34beed req-9f3fb5f2-f3f8-4295-8e64-4024cb7050c0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:39.743779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6a7797ca-74da-4d55-844e-7029fd34beed req-9f3fb5f2-f3f8-4295-8e64-4024cb7050c0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:39.744813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6a7797ca-74da-4d55-844e-7029fd34beed req-9f3fb5f2-f3f8-4295-8e64-4024cb7050c0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:39.774022 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6a7797ca-74da-4d55-844e-7029fd34beed req-9f3fb5f2-f3f8-4295-8e64-4024cb7050c0 service nova] Creating event network-vif-plugged:856894a7-145f-4343-9608-2c238b5a700d for instance 7cd3610b-d918-4b60-80cc-17213d521c75 on nch2-master-1 Sep 10 20:54:39.789273 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6a7797ca-74da-4d55-844e-7029fd34beed req-9f3fb5f2-f3f8-4295-8e64-4024cb7050c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075454 Sep 10 20:54:39.793099 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 873/1702] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:39.803853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-41498cf2-3b39-40a0-b9e8-109f93b46127 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:39.804871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-41498cf2-3b39-40a0-b9e8-109f93b46127 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:39.823263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41498cf2-3b39-40a0-b9e8-109f93b46127 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:39.824061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41498cf2-3b39-40a0-b9e8-109f93b46127 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:39.824918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41498cf2-3b39-40a0-b9e8-109f93b46127 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:39.837210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41498cf2-3b39-40a0-b9e8-109f93b46127 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:39.838015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41498cf2-3b39-40a0-b9e8-109f93b46127 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:39.840065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41498cf2-3b39-40a0-b9e8-109f93b46127 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:40.282421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-41498cf2-3b39-40a0-b9e8-109f93b46127 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:40.302215 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-41498cf2-3b39-40a0-b9e8-109f93b46127 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1312 microversion: 2.1 time: 0.506521 Sep 10 20:54:40.304260 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 874/1703] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:39 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1312 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:40.313022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea994c54-1c2c-4cdd-9ae4-40b94b44cf82 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:40.313644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ea994c54-1c2c-4cdd-9ae4-40b94b44cf82 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:40.340121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea994c54-1c2c-4cdd-9ae4-40b94b44cf82 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:40.340985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea994c54-1c2c-4cdd-9ae4-40b94b44cf82 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:40.341436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea994c54-1c2c-4cdd-9ae4-40b94b44cf82 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:40.348052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea994c54-1c2c-4cdd-9ae4-40b94b44cf82 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:40.348940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea994c54-1c2c-4cdd-9ae4-40b94b44cf82 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:40.349602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea994c54-1c2c-4cdd-9ae4-40b94b44cf82 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:40.450501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:54:40.452207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:54:40.454016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:54:40.454660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:54:40.455363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:54:40.466946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=43 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:40.471448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:40.473356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:40.474935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:40.475908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:40.476560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:40.477264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:40.565251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Getting quotas for project e8f7f9f3112545e9b40d88a7cc48e3fe. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:54:40.577335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Getting quotas for user 687eef270165450a97b4d260b2724b3e and project e8f7f9f3112545e9b40d88a7cc48e3fe. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:54:40.611163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:54:40.628033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:54:40.739014 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62116476-0423-4d56-b292-9340e0466f2b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.944321 Sep 10 20:54:40.741512 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 830/1704] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:54:40.773375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ead86cb-c0c3-4b84-9e88-2d3185fc7955 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:40.780660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0ead86cb-c0c3-4b84-9e88-2d3185fc7955 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:40.801017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ea994c54-1c2c-4cdd-9ae4-40b94b44cf82 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:40.818874 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea994c54-1c2c-4cdd-9ae4-40b94b44cf82 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.513003 Sep 10 20:54:40.819764 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 875/1705] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:40 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:40.820566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ead86cb-c0c3-4b84-9e88-2d3185fc7955 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:40.824224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ead86cb-c0c3-4b84-9e88-2d3185fc7955 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:40.825975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ead86cb-c0c3-4b84-9e88-2d3185fc7955 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:40.828144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ead86cb-c0c3-4b84-9e88-2d3185fc7955 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:40.829046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ead86cb-c0c3-4b84-9e88-2d3185fc7955 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:40.830153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ead86cb-c0c3-4b84-9e88-2d3185fc7955 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:40.846195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-55cb6ebc-4606-42f8-b1af-02a0eae76771 req-22b0ede1-3601-452b-b328-93f8a1f9629f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ce24e3-3f43-497b-b523-e13026e634fa", "tag": "52761b52-5f8b-4ae4-9fd8-6bcc0382f796"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:40.881621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-55cb6ebc-4606-42f8-b1af-02a0eae76771 req-22b0ede1-3601-452b-b328-93f8a1f9629f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:40.884450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-55cb6ebc-4606-42f8-b1af-02a0eae76771 req-22b0ede1-3601-452b-b328-93f8a1f9629f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:40.884914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-55cb6ebc-4606-42f8-b1af-02a0eae76771 req-22b0ede1-3601-452b-b328-93f8a1f9629f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:40.926882 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-55cb6ebc-4606-42f8-b1af-02a0eae76771 req-22b0ede1-3601-452b-b328-93f8a1f9629f service nova] Creating event network-changed:52761b52-5f8b-4ae4-9fd8-6bcc0382f796 for instance 58ce24e3-3f43-497b-b523-e13026e634fa on nch1-master-1 Sep 10 20:54:40.944570 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-55cb6ebc-4606-42f8-b1af-02a0eae76771 req-22b0ede1-3601-452b-b328-93f8a1f9629f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122544 Sep 10 20:54:40.949172 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 876/1706] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:40.990372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ad7ac4aa-2521-4d59-8b6c-f7766bd7747f req-a1c1c260-f04e-43d4-9ef9-be0b492b3903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb73142-7fcb-44b4-8ff3-b7624fc5b494", "name": "network-vif-unplugged", "status": "completed", "tag": "9c462d3d-b794-4637-b520-7d89a1ddcec2"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:41.016846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ad7ac4aa-2521-4d59-8b6c-f7766bd7747f req-a1c1c260-f04e-43d4-9ef9-be0b492b3903 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:41.021531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ad7ac4aa-2521-4d59-8b6c-f7766bd7747f req-a1c1c260-f04e-43d4-9ef9-be0b492b3903 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:41.022369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ad7ac4aa-2521-4d59-8b6c-f7766bd7747f req-a1c1c260-f04e-43d4-9ef9-be0b492b3903 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:41.058304 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ad7ac4aa-2521-4d59-8b6c-f7766bd7747f req-a1c1c260-f04e-43d4-9ef9-be0b492b3903 service nova] Creating event network-vif-unplugged:9c462d3d-b794-4637-b520-7d89a1ddcec2 for instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 on nch1-master-1 Sep 10 20:54:41.078291 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ad7ac4aa-2521-4d59-8b6c-f7766bd7747f req-a1c1c260-f04e-43d4-9ef9-be0b492b3903 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119341 Sep 10 20:54:41.079119 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 877/1707] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:41.091507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-479a137a-d076-4e64-9ffe-06587c5e7e8b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:41.092257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-479a137a-d076-4e64-9ffe-06587c5e7e8b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:41.111084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-479a137a-d076-4e64-9ffe-06587c5e7e8b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:41.111603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-479a137a-d076-4e64-9ffe-06587c5e7e8b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:41.112054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-479a137a-d076-4e64-9ffe-06587c5e7e8b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:41.112775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-479a137a-d076-4e64-9ffe-06587c5e7e8b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:41.113238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-479a137a-d076-4e64-9ffe-06587c5e7e8b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:41.113670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-479a137a-d076-4e64-9ffe-06587c5e7e8b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:41.314970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0ead86cb-c0c3-4b84-9e88-2d3185fc7955 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:41.334917 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0ead86cb-c0c3-4b84-9e88-2d3185fc7955 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1516 microversion: 2.1 time: 0.591479 Sep 10 20:54:41.335305 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 831/1708] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:40 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1516 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:41.341487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:41.342153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:41.350169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:41.351097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:41.351872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:41.352775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:41.354732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:41.355369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:41.358834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:41.715870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:41.730292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:41.737380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:41.740700 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a527f7d6-ddbd-463a-8fac-171893741e0f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.404324 Sep 10 20:54:41.742127 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 832/1709] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:41 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:41.759302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d1423627-9a40-44b8-920a-a910d2e29548 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:41.762864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d1423627-9a40-44b8-920a-a910d2e29548 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:41.780770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1423627-9a40-44b8-920a-a910d2e29548 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:41.783598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1423627-9a40-44b8-920a-a910d2e29548 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:41.784781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1423627-9a40-44b8-920a-a910d2e29548 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:41.787169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1423627-9a40-44b8-920a-a910d2e29548 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:41.791643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1423627-9a40-44b8-920a-a910d2e29548 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:41.792482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1423627-9a40-44b8-920a-a910d2e29548 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:42.044627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d1423627-9a40-44b8-920a-a910d2e29548 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:42.057197 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d1423627-9a40-44b8-920a-a910d2e29548 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1324 microversion: 2.1 time: 0.313781 Sep 10 20:54:42.060486 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 833/1710] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:41 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1324 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:42.073194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8bf7fb4a-2565-4103-adf5-787cc02fb057 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:42.074162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8bf7fb4a-2565-4103-adf5-787cc02fb057 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:42.080528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:42.094190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bf7fb4a-2565-4103-adf5-787cc02fb057 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:42.095139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bf7fb4a-2565-4103-adf5-787cc02fb057 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:42.095765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bf7fb4a-2565-4103-adf5-787cc02fb057 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:42.098232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bf7fb4a-2565-4103-adf5-787cc02fb057 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:42.099305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bf7fb4a-2565-4103-adf5-787cc02fb057 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:42.100238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bf7fb4a-2565-4103-adf5-787cc02fb057 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:42.189630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-479a137a-d076-4e64-9ffe-06587c5e7e8b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:42.199199 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-479a137a-d076-4e64-9ffe-06587c5e7e8b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1199 microversion: 2.1 time: 1.112809 Sep 10 20:54:42.199832 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 878/1711] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:41 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1199 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:42.220289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7ad1288a-6010-436e-9e8c-d6d2cf709651 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:42.223651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7ad1288a-6010-436e-9e8c-d6d2cf709651 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:42.236128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8bf7fb4a-2565-4103-adf5-787cc02fb057 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:42.239358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ad1288a-6010-436e-9e8c-d6d2cf709651 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:42.240548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ad1288a-6010-436e-9e8c-d6d2cf709651 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:42.241138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ad1288a-6010-436e-9e8c-d6d2cf709651 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:42.244397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ad1288a-6010-436e-9e8c-d6d2cf709651 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:42.244977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ad1288a-6010-436e-9e8c-d6d2cf709651 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:42.245508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ad1288a-6010-436e-9e8c-d6d2cf709651 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:42.257439 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8bf7fb4a-2565-4103-adf5-787cc02fb057 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1203 microversion: 2.1 time: 0.195064 Sep 10 20:54:42.259536 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 834/1712] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:42 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1203 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:42.268042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c3165793-b7d6-4c26-a814-cf3895f96769 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:42.268589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c3165793-b7d6-4c26-a814-cf3895f96769 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:42.285032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3165793-b7d6-4c26-a814-cf3895f96769 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:42.286679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3165793-b7d6-4c26-a814-cf3895f96769 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:42.287135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3165793-b7d6-4c26-a814-cf3895f96769 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:42.287886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3165793-b7d6-4c26-a814-cf3895f96769 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:42.288353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3165793-b7d6-4c26-a814-cf3895f96769 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:42.288769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c3165793-b7d6-4c26-a814-cf3895f96769 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:42.541857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7ad1288a-6010-436e-9e8c-d6d2cf709651 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:42.556157 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7ad1288a-6010-436e-9e8c-d6d2cf709651 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1312 microversion: 2.1 time: 0.347370 Sep 10 20:54:42.556782 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 879/1713] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:42 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:42.560973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c3165793-b7d6-4c26-a814-cf3895f96769 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:42.582308 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c3165793-b7d6-4c26-a814-cf3895f96769 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.318817 Sep 10 20:54:42.583612 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 835/1714] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:42 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:42.779132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:42.779711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:42.799762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:42.802879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:42.806200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:42.806200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:42.806200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:42.806200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:42.961204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:42.976079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:42.977792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:42.979225 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-359b86b1-ed90-40a3-944b-62dca7a317e9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.216994 Sep 10 20:54:42.983793 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 880/1715] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:42 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:54:43.085745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-719de00b-8a15-4661-9352-cca545c022b6 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:43.086809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-719de00b-8a15-4661-9352-cca545c022b6 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:43.095582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719de00b-8a15-4661-9352-cca545c022b6 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.096480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719de00b-8a15-4661-9352-cca545c022b6 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.097288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719de00b-8a15-4661-9352-cca545c022b6 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.097815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-2c84d046-62fd-450c-9e79-a5cc6b9dc6ea req-3d32aa1f-135b-430b-8703-20bba2c92033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3b5948-c5f9-4841-8444-c81ba0f96631", "tag": "0a697059-7bd3-4f8e-a53a-ab17edf98c1f"}, {"name": "network-changed", "server_uuid": "aeb73142-7fcb-44b4-8ff3-b7624fc5b494", "tag": "9c462d3d-b794-4637-b520-7d89a1ddcec2"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:43.114240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719de00b-8a15-4661-9352-cca545c022b6 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.114982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719de00b-8a15-4661-9352-cca545c022b6 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.117237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2c84d046-62fd-450c-9e79-a5cc6b9dc6ea req-3d32aa1f-135b-430b-8703-20bba2c92033 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.117451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719de00b-8a15-4661-9352-cca545c022b6 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.118391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2c84d046-62fd-450c-9e79-a5cc6b9dc6ea req-3d32aa1f-135b-430b-8703-20bba2c92033 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.118983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2c84d046-62fd-450c-9e79-a5cc6b9dc6ea req-3d32aa1f-135b-430b-8703-20bba2c92033 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.144940 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-2c84d046-62fd-450c-9e79-a5cc6b9dc6ea req-3d32aa1f-135b-430b-8703-20bba2c92033 service nova] Creating event network-changed:0a697059-7bd3-4f8e-a53a-ab17edf98c1f for instance eb3b5948-c5f9-4841-8444-c81ba0f96631 on nch1-master-1 Sep 10 20:54:43.145804 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-2c84d046-62fd-450c-9e79-a5cc6b9dc6ea req-3d32aa1f-135b-430b-8703-20bba2c92033 service nova] Creating event network-changed:9c462d3d-b794-4637-b520-7d89a1ddcec2 for instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 on nch1-master-1 Sep 10 20:54:43.175726 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-2c84d046-62fd-450c-9e79-a5cc6b9dc6ea req-3d32aa1f-135b-430b-8703-20bba2c92033 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082296 Sep 10 20:54:43.185722 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 881/1716] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:43.195540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-146b0749-b6c4-47d3-8e05-12fc140ca00f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:43.200216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-146b0749-b6c4-47d3-8e05-12fc140ca00f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:43.210312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-146b0749-b6c4-47d3-8e05-12fc140ca00f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.211404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-146b0749-b6c4-47d3-8e05-12fc140ca00f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.212313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-146b0749-b6c4-47d3-8e05-12fc140ca00f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.213664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-146b0749-b6c4-47d3-8e05-12fc140ca00f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.214456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-146b0749-b6c4-47d3-8e05-12fc140ca00f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.215931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-146b0749-b6c4-47d3-8e05-12fc140ca00f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.256790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-146b0749-b6c4-47d3-8e05-12fc140ca00f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lazy-loading 'flavor' on Instance uuid 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:54:43.321349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:43.362419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-146b0749-b6c4-47d3-8e05-12fc140ca00f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action" status: 200 len: 32 microversion: 2.1 time: 0.174416 Sep 10 20:54:43.364130 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 882/1717] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:54:43 2022] POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:54:43.375676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ada9045a-cd1f-40b3-89b4-d9e5ac32fc5d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:43.376548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ada9045a-cd1f-40b3-89b4-d9e5ac32fc5d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:43.378361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-719de00b-8a15-4661-9352-cca545c022b6 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:43.383230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ada9045a-cd1f-40b3-89b4-d9e5ac32fc5d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.383987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ada9045a-cd1f-40b3-89b4-d9e5ac32fc5d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.384618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ada9045a-cd1f-40b3-89b4-d9e5ac32fc5d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.385561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ada9045a-cd1f-40b3-89b4-d9e5ac32fc5d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.386394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ada9045a-cd1f-40b3-89b4-d9e5ac32fc5d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.387591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ada9045a-cd1f-40b3-89b4-d9e5ac32fc5d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.392249 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-719de00b-8a15-4661-9352-cca545c022b6 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1520 microversion: 2.1 time: 0.310715 Sep 10 20:54:43.392851 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 836/1718] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:43 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:43.397548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e4d25006-6532-4273-8ccd-92edbc2d497b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:43.398191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e4d25006-6532-4273-8ccd-92edbc2d497b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:43.413037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d25006-6532-4273-8ccd-92edbc2d497b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.413558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d25006-6532-4273-8ccd-92edbc2d497b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.414036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d25006-6532-4273-8ccd-92edbc2d497b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.414798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d25006-6532-4273-8ccd-92edbc2d497b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.415470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d25006-6532-4273-8ccd-92edbc2d497b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.415690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d25006-6532-4273-8ccd-92edbc2d497b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.551871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e4d25006-6532-4273-8ccd-92edbc2d497b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:43.566109 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e4d25006-6532-4273-8ccd-92edbc2d497b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1277 microversion: 2.1 time: 0.171903 Sep 10 20:54:43.567631 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 837/1719] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:43 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:43.576227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b2ed6fb6-99d0-4c2e-8713-9ae467deb29b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:43.578175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b2ed6fb6-99d0-4c2e-8713-9ae467deb29b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:43.589167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2ed6fb6-99d0-4c2e-8713-9ae467deb29b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.589167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2ed6fb6-99d0-4c2e-8713-9ae467deb29b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.589167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2ed6fb6-99d0-4c2e-8713-9ae467deb29b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.591766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2ed6fb6-99d0-4c2e-8713-9ae467deb29b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.592879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2ed6fb6-99d0-4c2e-8713-9ae467deb29b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.593772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2ed6fb6-99d0-4c2e-8713-9ae467deb29b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.707559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ada9045a-cd1f-40b3-89b4-d9e5ac32fc5d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:43.735733 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ada9045a-cd1f-40b3-89b4-d9e5ac32fc5d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1199 microversion: 2.1 time: 0.365357 Sep 10 20:54:43.736450 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 883/1720] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:43 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1199 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:43.762990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ba995d22-ecb7-47c4-b9ad-08eac264863d tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1633658976", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ba995d22-ecb7-47c4-b9ad-08eac264863d tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Request method failure captured: Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 243 Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPl-ORJBn3L3j-IXcBiP7RwKR33GNilsX-V6VWG_LTSt5hRydoNelsxqbUAPCAbuP9N11lDLTX2jMJABzFNVq5Y1-HRaI6MWY7gZPRFx1RIJz_B8Nes7Q1cvMTgpujOcdpYmAjcpdRCoSL1kk5Oh2gsyzEYK08abcq4CVt9HwOS3tXs Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_471f82eb46074bdabaedf6f837f6b94c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/471f82eb46074bdabaedf6f837f6b94c"}]}] Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 7ef231141009462d9819a123ea16d8c4 Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1633658976", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1633658976', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '50963dd0-5660-4a61-b1db-e1050760c4fb'}]}}} Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:43.772505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:43.780304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:43.784798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ba995d22-ecb7-47c4-b9ad-08eac264863d tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:43.787395 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ba995d22-ecb7-47c4-b9ad-08eac264863d tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.035230 Sep 10 20:54:43.788000 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 884/1721] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:54:43 2022] POST /compute/v2.1/servers => generated 175 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:54:43.793217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-98c9f490-2685-47f3-bed0-f0f5f8140a37 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:43.794363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-98c9f490-2685-47f3-bed0-f0f5f8140a37 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:43.805670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c9f490-2685-47f3-bed0-f0f5f8140a37 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.806588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c9f490-2685-47f3-bed0-f0f5f8140a37 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.807365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c9f490-2685-47f3-bed0-f0f5f8140a37 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.808362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c9f490-2685-47f3-bed0-f0f5f8140a37 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.809515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c9f490-2685-47f3-bed0-f0f5f8140a37 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.810256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c9f490-2685-47f3-bed0-f0f5f8140a37 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.848274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b2ed6fb6-99d0-4c2e-8713-9ae467deb29b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:43.858474 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b2ed6fb6-99d0-4c2e-8713-9ae467deb29b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.289385 Sep 10 20:54:43.871951 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 838/1722] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:43 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:43.871951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b42364e6-4fb7-4f26-9f84-3be2075906c0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:43.871951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b42364e6-4fb7-4f26-9f84-3be2075906c0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:43.873075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b42364e6-4fb7-4f26-9f84-3be2075906c0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.873216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b42364e6-4fb7-4f26-9f84-3be2075906c0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.873662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b42364e6-4fb7-4f26-9f84-3be2075906c0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:43.874460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b42364e6-4fb7-4f26-9f84-3be2075906c0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:43.875217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b42364e6-4fb7-4f26-9f84-3be2075906c0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:43.875693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b42364e6-4fb7-4f26-9f84-3be2075906c0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:44.051090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-98c9f490-2685-47f3-bed0-f0f5f8140a37 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:44.064744 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-98c9f490-2685-47f3-bed0-f0f5f8140a37 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1312 microversion: 2.1 time: 0.275524 Sep 10 20:54:44.077690 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 885/1723] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:43 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:44.077690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3f2edd9c-1e81-4c51-95a9-2eb72f4ff716 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:44.077690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3f2edd9c-1e81-4c51-95a9-2eb72f4ff716 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: d223d62d-90e8-4b40-ae5b-c801964205ed] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:44.083588 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-3f2edd9c-1e81-4c51-95a9-2eb72f4ff716 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] HTTP exception thrown: Instance d223d62d-90e8-4b40-ae5b-c801964205ed could not be found. Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3f2edd9c-1e81-4c51-95a9-2eb72f4ff716 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Request method failure captured: Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/d223d62d-90e8-4b40-ae5b-c801964205ed/metadata HTTP/1.1 Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPl-ORJBn3L3j-IXcBiP7RwKR33GNilsX-V6VWG_LTSt5hRydoNelsxqbUAPCAbuP9N11lDLTX2jMJABzFNVq5Y1-HRaI6MWY7gZPRFx1RIJz_B8Nes7Q1cvMTgpujOcdpYmAjcpdRCoSL1kk5Oh2gsyzEYK08abcq4CVt9HwOS3tXs Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_471f82eb46074bdabaedf6f837f6b94c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/471f82eb46074bdabaedf6f837f6b94c"}]}] Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 7ef231141009462d9819a123ea16d8c4 Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance d223d62d-90e8-4b40-ae5b-c801964205ed could not be found. Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'server_id': 'd223d62d-90e8-4b40-ae5b-c801964205ed'} Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d223d62d-90e8-4b40-ae5b-c801964205ed could not be found. Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d223d62d-90e8-4b40-ae5b-c801964205ed could not be found. Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.083843 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.090681 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:54:44.090681 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:54:44.090681 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d223d62d-90e8-4b40-ae5b-c801964205ed could not be found. Sep 10 20:54:44.090681 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.090681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3f2edd9c-1e81-4c51-95a9-2eb72f4ff716 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Returning 404 to user: Instance d223d62d-90e8-4b40-ae5b-c801964205ed could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:44.090681 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3f2edd9c-1e81-4c51-95a9-2eb72f4ff716 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/d223d62d-90e8-4b40-ae5b-c801964205ed/metadata" status: 404 len: 111 microversion: 2.1 time: 0.014320 Sep 10 20:54:44.090681 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 886/1724] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:54:44 2022] GET /compute/v2.1/servers/d223d62d-90e8-4b40-ae5b-c801964205ed/metadata => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:54:44.091538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:44.092054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:44.100882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:44.101786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:44.102797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:44.104478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:44.106168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:44.107265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:44.145973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b42364e6-4fb7-4f26-9f84-3be2075906c0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:44.160290 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b42364e6-4fb7-4f26-9f84-3be2075906c0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.299802 Sep 10 20:54:44.161995 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 839/1725] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:43 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:44.172621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f416219-c8ef-475e-b4ba-5bb0b8eafba3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1724952664", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f416219-c8ef-475e-b4ba-5bb0b8eafba3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Request method failure captured: Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 499 Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPl-ORJBn3L3j-IXcBiP7RwKR33GNilsX-V6VWG_LTSt5hRydoNelsxqbUAPCAbuP9N11lDLTX2jMJABzFNVq5Y1-HRaI6MWY7gZPRFx1RIJz_B8Nes7Q1cvMTgpujOcdpYmAjcpdRCoSL1kk5Oh2gsyzEYK08abcq4CVt9HwOS3tXs Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_471f82eb46074bdabaedf6f837f6b94c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/471f82eb46074bdabaedf6f837f6b94c"}]}] Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 7ef231141009462d9819a123ea16d8c4 Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1724952664", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1724952664', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '50963dd0-5660-4a61-b1db-e1050760c4fb'}]}}} Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 20:54:44.179740 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f416219-c8ef-475e-b4ba-5bb0b8eafba3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8f416219-c8ef-475e-b4ba-5bb0b8eafba3 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.018386 Sep 10 20:54:44.183270 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 840/1726] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:54:44 2022] POST /compute/v2.1/servers => generated 687 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:54:44.244485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f067c84-1912-45bb-bb41-09b34379dd91 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-451407585", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f067c84-1912-45bb-bb41-09b34379dd91 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Request method failure captured: Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 499 Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPl-ORJBn3L3j-IXcBiP7RwKR33GNilsX-V6VWG_LTSt5hRydoNelsxqbUAPCAbuP9N11lDLTX2jMJABzFNVq5Y1-HRaI6MWY7gZPRFx1RIJz_B8Nes7Q1cvMTgpujOcdpYmAjcpdRCoSL1kk5Oh2gsyzEYK08abcq4CVt9HwOS3tXs Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_471f82eb46074bdabaedf6f837f6b94c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/471f82eb46074bdabaedf6f837f6b94c"}]}] Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 7ef231141009462d9819a123ea16d8c4 Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-451407585", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-451407585', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '50963dd0-5660-4a61-b1db-e1050760c4fb'}]}}} Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 20:54:44.250185 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.253673 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.259930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f067c84-1912-45bb-bb41-09b34379dd91 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:44.260803 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f067c84-1912-45bb-bb41-09b34379dd91 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.021236 Sep 10 20:54:44.261395 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 841/1727] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:54:44 2022] POST /compute/v2.1/servers => generated 689 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:54:44.333106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-37439c93-2a69-480d-bb67-997a6394c7c1 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-434499470", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-37439c93-2a69-480d-bb67-997a6394c7c1 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Request method failure captured: Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 753 Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPl-ORJBn3L3j-IXcBiP7RwKR33GNilsX-V6VWG_LTSt5hRydoNelsxqbUAPCAbuP9N11lDLTX2jMJABzFNVq5Y1-HRaI6MWY7gZPRFx1RIJz_B8Nes7Q1cvMTgpujOcdpYmAjcpdRCoSL1kk5Oh2gsyzEYK08abcq4CVt9HwOS3tXs Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_471f82eb46074bdabaedf6f837f6b94c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/471f82eb46074bdabaedf6f837f6b94c"}]}] Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 7ef231141009462d9819a123ea16d8c4 Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-434499470", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-434499470', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '50963dd0-5660-4a61-b1db-e1050760c4fb'}]}}} Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:54:44.339233 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:54:44.346870 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:54:44.350076 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.350076 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.350076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-37439c93-2a69-480d-bb67-997a6394c7c1 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:44.350076 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-37439c93-2a69-480d-bb67-997a6394c7c1 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.016705 Sep 10 20:54:44.350076 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 842/1728] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:54:44 2022] POST /compute/v2.1/servers => generated 1197 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 10 20:54:44.387617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:44.404843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:44.406654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:44.408563 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-726be33c-93f1-4640-8305-9ea93049c011 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.321320 Sep 10 20:54:44.410750 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 887/1729] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:44 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:44.450633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c391c315-ee9c-4536-bbd3-aa94727fbf10 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1058970391", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c391c315-ee9c-4536-bbd3-aa94727fbf10 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Request method failure captured: Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 1266 Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPl-ORJBn3L3j-IXcBiP7RwKR33GNilsX-V6VWG_LTSt5hRydoNelsxqbUAPCAbuP9N11lDLTX2jMJABzFNVq5Y1-HRaI6MWY7gZPRFx1RIJz_B8Nes7Q1cvMTgpujOcdpYmAjcpdRCoSL1kk5Oh2gsyzEYK08abcq4CVt9HwOS3tXs Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_471f82eb46074bdabaedf6f837f6b94c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/471f82eb46074bdabaedf6f837f6b94c"}]}] Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 7ef231141009462d9819a123ea16d8c4 Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1058970391", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50963dd0-5660-4a61-b1db-e1050760c4fb"}]}} Sep 10 20:54:44.456551 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1058970391', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '50963dd0-5660-4a61-b1db-e1050760c4fb'}]}}} Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.459029 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:54:44.461899 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:54:44.465706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:54:44.465706 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.467072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c391c315-ee9c-4536-bbd3-aa94727fbf10 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:44.468200 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c391c315-ee9c-4536-bbd3-aa94727fbf10 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.022874 Sep 10 20:54:44.469504 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 843/1730] 10.222.0.33 () {60 vars in 1148 bytes} [Sat Sep 10 20:54:44 2022] POST /compute/v2.1/servers => generated 2221 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 10 20:54:44.483956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7f58813d-610e-4ce4-a61b-e94c0d3cc7a0 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:44.484624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7f58813d-610e-4ce4-a61b-e94c0d3cc7a0 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: ca4d7bb0-0c96-436c-96d0-adcbb768b590] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:44.493963 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-7f58813d-610e-4ce4-a61b-e94c0d3cc7a0 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] HTTP exception thrown: Instance ca4d7bb0-0c96-436c-96d0-adcbb768b590 could not be found. Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7f58813d-610e-4ce4-a61b-e94c0d3cc7a0 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Request method failure captured: Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/ca4d7bb0-0c96-436c-96d0-adcbb768b590/metadata/test2 HTTP/1.1 Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPl-ORJBn3L3j-IXcBiP7RwKR33GNilsX-V6VWG_LTSt5hRydoNelsxqbUAPCAbuP9N11lDLTX2jMJABzFNVq5Y1-HRaI6MWY7gZPRFx1RIJz_B8Nes7Q1cvMTgpujOcdpYmAjcpdRCoSL1kk5Oh2gsyzEYK08abcq4CVt9HwOS3tXs Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_471f82eb46074bdabaedf6f837f6b94c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/471f82eb46074bdabaedf6f837f6b94c"}]}] Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 7ef231141009462d9819a123ea16d8c4 Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance ca4d7bb0-0c96-436c-96d0-adcbb768b590 could not be found. Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'server_id': 'ca4d7bb0-0c96-436c-96d0-adcbb768b590', 'id': 'test2'} Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4d7bb0-0c96-436c-96d0-adcbb768b590 could not be found. Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4d7bb0-0c96-436c-96d0-adcbb768b590 could not be found. Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:44.495472 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:44.501237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:54:44.501237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:54:44.501237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4d7bb0-0c96-436c-96d0-adcbb768b590 could not be found. Sep 10 20:54:44.501237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:54:44.501237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7f58813d-610e-4ce4-a61b-e94c0d3cc7a0 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Returning 404 to user: Instance ca4d7bb0-0c96-436c-96d0-adcbb768b590 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:44.501237 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7f58813d-610e-4ce4-a61b-e94c0d3cc7a0 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/ca4d7bb0-0c96-436c-96d0-adcbb768b590/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.022454 Sep 10 20:54:44.507476 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 888/1731] 10.222.0.33 () {58 vars in 1281 bytes} [Sat Sep 10 20:54:44 2022] GET /compute/v2.1/servers/ca4d7bb0-0c96-436c-96d0-adcbb768b590/metadata/test2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:54:44.526219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1e1ba72e-d016-49fe-85ec-09f66830d297 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:44.526837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e1ba72e-d016-49fe-85ec-09f66830d297 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:44.545181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1ba72e-d016-49fe-85ec-09f66830d297 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:44.545712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1ba72e-d016-49fe-85ec-09f66830d297 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:44.546645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1ba72e-d016-49fe-85ec-09f66830d297 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:44.547820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1ba72e-d016-49fe-85ec-09f66830d297 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:44.548462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1ba72e-d016-49fe-85ec-09f66830d297 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:44.549733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1ba72e-d016-49fe-85ec-09f66830d297 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:44.586925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e1ba72e-d016-49fe-85ec-09f66830d297 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:54:44.599636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e28310d-54cb-4c23-b38c-c57221a97ee8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:44.600316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e28310d-54cb-4c23-b38c-c57221a97ee8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:44.616735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e28310d-54cb-4c23-b38c-c57221a97ee8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:44.617390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e28310d-54cb-4c23-b38c-c57221a97ee8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:44.618447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e28310d-54cb-4c23-b38c-c57221a97ee8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:44.621570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e28310d-54cb-4c23-b38c-c57221a97ee8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:44.622388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e28310d-54cb-4c23-b38c-c57221a97ee8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:44.624502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e28310d-54cb-4c23-b38c-c57221a97ee8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:44.736345 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1e1ba72e-d016-49fe-85ec-09f66830d297 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 204 len: 0 microversion: 2.1 time: 0.223916 Sep 10 20:54:44.738432 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 844/1732] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:54:44 2022] DELETE /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:54:44.754489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-686e7c7b-c622-44e0-a777-246591e38212 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:44.755559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-686e7c7b-c622-44e0-a777-246591e38212 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:44.762865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-686e7c7b-c622-44e0-a777-246591e38212 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:44.763581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-686e7c7b-c622-44e0-a777-246591e38212 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:44.764115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-686e7c7b-c622-44e0-a777-246591e38212 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:44.765016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-686e7c7b-c622-44e0-a777-246591e38212 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:44.765628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-686e7c7b-c622-44e0-a777-246591e38212 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:44.766227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-686e7c7b-c622-44e0-a777-246591e38212 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:44.886662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e28310d-54cb-4c23-b38c-c57221a97ee8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:44.904451 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e28310d-54cb-4c23-b38c-c57221a97ee8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1307 microversion: 2.1 time: 0.311070 Sep 10 20:54:44.905927 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 889/1733] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:44 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:44.914328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-94fd757c-261b-44ff-84cc-115c41209f79 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:44.915139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-94fd757c-261b-44ff-84cc-115c41209f79 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:44.922392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94fd757c-261b-44ff-84cc-115c41209f79 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:44.923274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94fd757c-261b-44ff-84cc-115c41209f79 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:44.924850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94fd757c-261b-44ff-84cc-115c41209f79 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:44.925787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94fd757c-261b-44ff-84cc-115c41209f79 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:44.926621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94fd757c-261b-44ff-84cc-115c41209f79 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:44.927246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94fd757c-261b-44ff-84cc-115c41209f79 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.085716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-686e7c7b-c622-44e0-a777-246591e38212 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:45.098888 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-686e7c7b-c622-44e0-a777-246591e38212 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1526 microversion: 2.1 time: 0.354831 Sep 10 20:54:45.110757 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 845/1734] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:44 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1526 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:45.124247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-af79d4ed-9e55-4b21-b8cf-7d5eb3fbe12c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:45.125051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-af79d4ed-9e55-4b21-b8cf-7d5eb3fbe12c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:45.131316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af79d4ed-9e55-4b21-b8cf-7d5eb3fbe12c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.132010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af79d4ed-9e55-4b21-b8cf-7d5eb3fbe12c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.132657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af79d4ed-9e55-4b21-b8cf-7d5eb3fbe12c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.133521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af79d4ed-9e55-4b21-b8cf-7d5eb3fbe12c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.134179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af79d4ed-9e55-4b21-b8cf-7d5eb3fbe12c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.134769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af79d4ed-9e55-4b21-b8cf-7d5eb3fbe12c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.163310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-94fd757c-261b-44ff-84cc-115c41209f79 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:45.173573 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-94fd757c-261b-44ff-84cc-115c41209f79 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1199 microversion: 2.1 time: 0.265158 Sep 10 20:54:45.174822 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 890/1735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:44 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1199 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:45.181251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-96329fd1-65fa-47bf-a3af-aab343bc913a req-c53c392c-d715-468a-838c-0de0fbe5bc82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb03fb54-1b7b-42ec-b71b-b73d7f96b657", "name": "network-vif-plugged", "status": "completed", "tag": "c88c7c1f-fddc-4804-9ba5-5dfaae6029f9"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:45.192385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-96329fd1-65fa-47bf-a3af-aab343bc913a req-c53c392c-d715-468a-838c-0de0fbe5bc82 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.192857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-96329fd1-65fa-47bf-a3af-aab343bc913a req-c53c392c-d715-468a-838c-0de0fbe5bc82 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.193283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-96329fd1-65fa-47bf-a3af-aab343bc913a req-c53c392c-d715-468a-838c-0de0fbe5bc82 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.205780 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-96329fd1-65fa-47bf-a3af-aab343bc913a req-c53c392c-d715-468a-838c-0de0fbe5bc82 service nova] Creating event network-vif-plugged:c88c7c1f-fddc-4804-9ba5-5dfaae6029f9 for instance cb03fb54-1b7b-42ec-b71b-b73d7f96b657 on nch2-master-1 Sep 10 20:54:45.211202 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-96329fd1-65fa-47bf-a3af-aab343bc913a req-c53c392c-d715-468a-838c-0de0fbe5bc82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035065 Sep 10 20:54:45.212176 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 891/1736] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:45.220638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-23a167a5-9cbb-4103-b13d-5e646f43fba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:45.221344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-23a167a5-9cbb-4103-b13d-5e646f43fba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:45.228199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23a167a5-9cbb-4103-b13d-5e646f43fba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.228680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23a167a5-9cbb-4103-b13d-5e646f43fba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.229119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23a167a5-9cbb-4103-b13d-5e646f43fba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.229809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23a167a5-9cbb-4103-b13d-5e646f43fba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.230681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23a167a5-9cbb-4103-b13d-5e646f43fba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.231283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23a167a5-9cbb-4103-b13d-5e646f43fba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.453473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-23a167a5-9cbb-4103-b13d-5e646f43fba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:45.461807 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-23a167a5-9cbb-4103-b13d-5e646f43fba5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1312 microversion: 2.1 time: 0.248208 Sep 10 20:54:45.462716 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 892/1737] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:45 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:45.468947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-01d3dfc9-61de-49f1-9c2e-5592ed79cfcd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:45.470068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-01d3dfc9-61de-49f1-9c2e-5592ed79cfcd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:45.481724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01d3dfc9-61de-49f1-9c2e-5592ed79cfcd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.482686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01d3dfc9-61de-49f1-9c2e-5592ed79cfcd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.483228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01d3dfc9-61de-49f1-9c2e-5592ed79cfcd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.484219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01d3dfc9-61de-49f1-9c2e-5592ed79cfcd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.484771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01d3dfc9-61de-49f1-9c2e-5592ed79cfcd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.485449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01d3dfc9-61de-49f1-9c2e-5592ed79cfcd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.681664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-01d3dfc9-61de-49f1-9c2e-5592ed79cfcd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:45.702166 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-01d3dfc9-61de-49f1-9c2e-5592ed79cfcd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.237112 Sep 10 20:54:45.704466 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 893/1738] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:45 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:45.712557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:45.720210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:45.736620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.738411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.739558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.740949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.741656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.743340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.793684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-af79d4ed-9e55-4b21-b8cf-7d5eb3fbe12c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:45.806615 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-af79d4ed-9e55-4b21-b8cf-7d5eb3fbe12c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.687401 Sep 10 20:54:45.808055 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 846/1739] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:45 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:45.917941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:45.926892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:45.928820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:45.928960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8d758cef-09b6-47af-a0ef-574a07901452 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:45.929573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8d758cef-09b6-47af-a0ef-574a07901452 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:45.930195 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6a82986d-0c27-4baf-8fcc-1950ae5ee8f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.224129 Sep 10 20:54:45.930988 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 894/1740] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:45 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:45.936580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d758cef-09b6-47af-a0ef-574a07901452 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.937069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d758cef-09b6-47af-a0ef-574a07901452 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.937509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d758cef-09b6-47af-a0ef-574a07901452 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:45.938631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d758cef-09b6-47af-a0ef-574a07901452 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:45.938763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d758cef-09b6-47af-a0ef-574a07901452 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:45.939112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d758cef-09b6-47af-a0ef-574a07901452 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.016865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-960cd1c9-25f3-42e4-ad1f-9979df023393 req-4154a08c-7032-4797-a868-0304793120e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "372f952b-42c2-45e6-bb5c-5a2c37a2879e", "tag": "1719b8ff-bafb-42bb-8a8f-800f550eab35"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:46.027305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-960cd1c9-25f3-42e4-ad1f-9979df023393 req-4154a08c-7032-4797-a868-0304793120e8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.028193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-960cd1c9-25f3-42e4-ad1f-9979df023393 req-4154a08c-7032-4797-a868-0304793120e8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.028803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-960cd1c9-25f3-42e4-ad1f-9979df023393 req-4154a08c-7032-4797-a868-0304793120e8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.040851 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-960cd1c9-25f3-42e4-ad1f-9979df023393 req-4154a08c-7032-4797-a868-0304793120e8 service nova] Creating event network-changed:1719b8ff-bafb-42bb-8a8f-800f550eab35 for instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e on nch2-master-1 Sep 10 20:54:46.046197 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-960cd1c9-25f3-42e4-ad1f-9979df023393 req-4154a08c-7032-4797-a868-0304793120e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034193 Sep 10 20:54:46.046963 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 895/1741] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:54:46.125922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5c9f04cc-2d43-4119-8d26-b910d7add3db tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:46.126625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5c9f04cc-2d43-4119-8d26-b910d7add3db tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:46.140160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c9f04cc-2d43-4119-8d26-b910d7add3db tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.140653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c9f04cc-2d43-4119-8d26-b910d7add3db tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.141090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c9f04cc-2d43-4119-8d26-b910d7add3db tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.141802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c9f04cc-2d43-4119-8d26-b910d7add3db tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.142291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c9f04cc-2d43-4119-8d26-b910d7add3db tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.142743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c9f04cc-2d43-4119-8d26-b910d7add3db tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.244368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8d758cef-09b6-47af-a0ef-574a07901452 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:46.253301 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8d758cef-09b6-47af-a0ef-574a07901452 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1307 microversion: 2.1 time: 0.328638 Sep 10 20:54:46.254123 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 847/1742] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:45 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1307 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:46.258931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d31cf8ec-ce27-442e-82e9-f6beeb6d7466 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:46.259557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d31cf8ec-ce27-442e-82e9-f6beeb6d7466 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:46.266610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d31cf8ec-ce27-442e-82e9-f6beeb6d7466 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.267342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d31cf8ec-ce27-442e-82e9-f6beeb6d7466 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.267938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d31cf8ec-ce27-442e-82e9-f6beeb6d7466 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.269030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d31cf8ec-ce27-442e-82e9-f6beeb6d7466 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.269644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d31cf8ec-ce27-442e-82e9-f6beeb6d7466 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.270382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d31cf8ec-ce27-442e-82e9-f6beeb6d7466 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.317419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5c9f04cc-2d43-4119-8d26-b910d7add3db tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:46.325938 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5c9f04cc-2d43-4119-8d26-b910d7add3db tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1526 microversion: 2.1 time: 0.204925 Sep 10 20:54:46.326518 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 896/1743] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:46 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1526 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:46.407725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d31cf8ec-ce27-442e-82e9-f6beeb6d7466 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:46.415553 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d31cf8ec-ce27-442e-82e9-f6beeb6d7466 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1199 microversion: 2.1 time: 0.160321 Sep 10 20:54:46.416133 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 848/1744] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:46 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1199 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:46.487880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a1b5c2c8-aaac-48b5-b7cb-e1ee18a149d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:46.488462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a1b5c2c8-aaac-48b5-b7cb-e1ee18a149d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:46.494839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1b5c2c8-aaac-48b5-b7cb-e1ee18a149d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.495313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1b5c2c8-aaac-48b5-b7cb-e1ee18a149d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.495744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1b5c2c8-aaac-48b5-b7cb-e1ee18a149d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.497314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1b5c2c8-aaac-48b5-b7cb-e1ee18a149d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.497937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1b5c2c8-aaac-48b5-b7cb-e1ee18a149d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.498367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1b5c2c8-aaac-48b5-b7cb-e1ee18a149d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.732848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1840e7e2-f025-4abf-bdb1-7db3056cabfa tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:46.733811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1840e7e2-f025-4abf-bdb1-7db3056cabfa tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:46.741317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1840e7e2-f025-4abf-bdb1-7db3056cabfa tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.741990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1840e7e2-f025-4abf-bdb1-7db3056cabfa tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.742539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1840e7e2-f025-4abf-bdb1-7db3056cabfa tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.743365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1840e7e2-f025-4abf-bdb1-7db3056cabfa tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.743979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1840e7e2-f025-4abf-bdb1-7db3056cabfa tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.744515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1840e7e2-f025-4abf-bdb1-7db3056cabfa tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.747386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a1b5c2c8-aaac-48b5-b7cb-e1ee18a149d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:46.760644 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a1b5c2c8-aaac-48b5-b7cb-e1ee18a149d2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1312 microversion: 2.1 time: 0.276430 Sep 10 20:54:46.761684 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 897/1745] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:46 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:46.831463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7f799d1-77a7-48a5-8392-b9ef2312f371 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:46.832535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b7f799d1-77a7-48a5-8392-b9ef2312f371 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:46.840016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7f799d1-77a7-48a5-8392-b9ef2312f371 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.840814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7f799d1-77a7-48a5-8392-b9ef2312f371 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.841463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7f799d1-77a7-48a5-8392-b9ef2312f371 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.842213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7f799d1-77a7-48a5-8392-b9ef2312f371 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.842672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7f799d1-77a7-48a5-8392-b9ef2312f371 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.843291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7f799d1-77a7-48a5-8392-b9ef2312f371 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.933188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1840e7e2-f025-4abf-bdb1-7db3056cabfa tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:46.946353 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1840e7e2-f025-4abf-bdb1-7db3056cabfa tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.216145 Sep 10 20:54:46.947334 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 849/1746] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:46 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:46.957072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:46.958066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:46.966208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.967620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.968285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:46.969584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:46.970296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:46.970896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.127801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7f799d1-77a7-48a5-8392-b9ef2312f371 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:47.142142 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b7f799d1-77a7-48a5-8392-b9ef2312f371 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.314942 Sep 10 20:54:47.143398 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 898/1747] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:46 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:47.250611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:47.273509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:47.275366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:47.277187 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-669f10fd-55e5-4690-bec3-f8a6056d3de8 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.323763 Sep 10 20:54:47.277964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d9af0e31-a277-4438-a84d-84d21c0f2303 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:47.290435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d9af0e31-a277-4438-a84d-84d21c0f2303 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:47.290736 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 850/1748] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:46 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:54:47.308432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9af0e31-a277-4438-a84d-84d21c0f2303 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.310223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9af0e31-a277-4438-a84d-84d21c0f2303 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.314841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9af0e31-a277-4438-a84d-84d21c0f2303 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.319987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9af0e31-a277-4438-a84d-84d21c0f2303 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.319987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9af0e31-a277-4438-a84d-84d21c0f2303 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.319987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9af0e31-a277-4438-a84d-84d21c0f2303 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.358970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-269c3eca-9d0b-44bb-b623-e9a5f66b4f26 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:47.365755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-269c3eca-9d0b-44bb-b623-e9a5f66b4f26 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:47.386696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-269c3eca-9d0b-44bb-b623-e9a5f66b4f26 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.388182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-269c3eca-9d0b-44bb-b623-e9a5f66b4f26 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.389281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-269c3eca-9d0b-44bb-b623-e9a5f66b4f26 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.390392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-269c3eca-9d0b-44bb-b623-e9a5f66b4f26 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.391250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-269c3eca-9d0b-44bb-b623-e9a5f66b4f26 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.391945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-269c3eca-9d0b-44bb-b623-e9a5f66b4f26 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.399373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:47.557768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-269c3eca-9d0b-44bb-b623-e9a5f66b4f26 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:47.567448 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-269c3eca-9d0b-44bb-b623-e9a5f66b4f26 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1484 microversion: 2.1 time: 0.221876 Sep 10 20:54:47.568088 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 851/1749] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:47 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1484 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:47.577246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-365f6558-8339-4028-bc2b-c90ef440cf64 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:47.584104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-365f6558-8339-4028-bc2b-c90ef440cf64 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:47.600810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-365f6558-8339-4028-bc2b-c90ef440cf64 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.601365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-365f6558-8339-4028-bc2b-c90ef440cf64 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.601812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-365f6558-8339-4028-bc2b-c90ef440cf64 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.602603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-365f6558-8339-4028-bc2b-c90ef440cf64 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.603062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-365f6558-8339-4028-bc2b-c90ef440cf64 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.603659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-365f6558-8339-4028-bc2b-c90ef440cf64 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.654874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d9af0e31-a277-4438-a84d-84d21c0f2303 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:47.664986 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d9af0e31-a277-4438-a84d-84d21c0f2303 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1307 microversion: 2.1 time: 0.392057 Sep 10 20:54:47.665682 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 899/1750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:47 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1307 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:47.671587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a0a65d6f-4471-4591-ac08-167ab916d24e req-79e51d9d-dd1c-440c-967d-66ecf89ebd4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd3610b-d918-4b60-80cc-17213d521c75", "name": "network-vif-deleted", "tag": "856894a7-145f-4343-9608-2c238b5a700d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:47.695343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a0a65d6f-4471-4591-ac08-167ab916d24e req-79e51d9d-dd1c-440c-967d-66ecf89ebd4f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.695831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a0a65d6f-4471-4591-ac08-167ab916d24e req-79e51d9d-dd1c-440c-967d-66ecf89ebd4f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.697205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a0a65d6f-4471-4591-ac08-167ab916d24e req-79e51d9d-dd1c-440c-967d-66ecf89ebd4f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.710724 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a0a65d6f-4471-4591-ac08-167ab916d24e req-79e51d9d-dd1c-440c-967d-66ecf89ebd4f service nova] Creating event network-vif-deleted:856894a7-145f-4343-9608-2c238b5a700d for instance 7cd3610b-d918-4b60-80cc-17213d521c75 on nch2-master-1 Sep 10 20:54:47.716102 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a0a65d6f-4471-4591-ac08-167ab916d24e req-79e51d9d-dd1c-440c-967d-66ecf89ebd4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049016 Sep 10 20:54:47.716719 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 900/1751] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:47.722303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f9629ed4-4927-43ee-beda-66ff5ff04fba req-5c7c60a7-7779-4d1f-817b-1f1720e63fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ce24e3-3f43-497b-b523-e13026e634fa", "name": "network-vif-plugged", "status": "completed", "tag": "52761b52-5f8b-4ae4-9fd8-6bcc0382f796"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:47.734942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f9629ed4-4927-43ee-beda-66ff5ff04fba req-5c7c60a7-7779-4d1f-817b-1f1720e63fbf service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.735340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f9629ed4-4927-43ee-beda-66ff5ff04fba req-5c7c60a7-7779-4d1f-817b-1f1720e63fbf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.735774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f9629ed4-4927-43ee-beda-66ff5ff04fba req-5c7c60a7-7779-4d1f-817b-1f1720e63fbf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.747777 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f9629ed4-4927-43ee-beda-66ff5ff04fba req-5c7c60a7-7779-4d1f-817b-1f1720e63fbf service nova] Creating event network-vif-plugged:52761b52-5f8b-4ae4-9fd8-6bcc0382f796 for instance 58ce24e3-3f43-497b-b523-e13026e634fa on nch1-master-1 Sep 10 20:54:47.752744 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f9629ed4-4927-43ee-beda-66ff5ff04fba req-5c7c60a7-7779-4d1f-817b-1f1720e63fbf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Sep 10 20:54:47.753355 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 901/1752] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:47.770179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-365f6558-8339-4028-bc2b-c90ef440cf64 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:47.778926 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-365f6558-8339-4028-bc2b-c90ef440cf64 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1199 microversion: 2.1 time: 0.205113 Sep 10 20:54:47.779591 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 852/1753] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:47 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1199 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:47.788881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ba89177-9b95-41bc-a647-9be39fd6e72e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:47.789913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2ba89177-9b95-41bc-a647-9be39fd6e72e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:47.798495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba89177-9b95-41bc-a647-9be39fd6e72e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.798981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba89177-9b95-41bc-a647-9be39fd6e72e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.799415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba89177-9b95-41bc-a647-9be39fd6e72e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.800107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba89177-9b95-41bc-a647-9be39fd6e72e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.800607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba89177-9b95-41bc-a647-9be39fd6e72e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.801028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba89177-9b95-41bc-a647-9be39fd6e72e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.977426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae16a87c-7224-4c35-97fb-a5fd93cd5e33 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:47.980249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ae16a87c-7224-4c35-97fb-a5fd93cd5e33 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:47.986626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae16a87c-7224-4c35-97fb-a5fd93cd5e33 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.987114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae16a87c-7224-4c35-97fb-a5fd93cd5e33 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.987617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae16a87c-7224-4c35-97fb-a5fd93cd5e33 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:47.989057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae16a87c-7224-4c35-97fb-a5fd93cd5e33 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:47.989057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae16a87c-7224-4c35-97fb-a5fd93cd5e33 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:47.989634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae16a87c-7224-4c35-97fb-a5fd93cd5e33 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.020026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ba89177-9b95-41bc-a647-9be39fd6e72e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:48.028820 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ba89177-9b95-41bc-a647-9be39fd6e72e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1312 microversion: 2.1 time: 0.243863 Sep 10 20:54:48.040343 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 902/1754] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:47 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:48.181134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9180b412-0405-43af-8a46-8fec41da2f3d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:48.182493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9180b412-0405-43af-8a46-8fec41da2f3d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:48.185555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:48.189778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae16a87c-7224-4c35-97fb-a5fd93cd5e33 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:48.194043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9180b412-0405-43af-8a46-8fec41da2f3d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:48.194529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9180b412-0405-43af-8a46-8fec41da2f3d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:48.194962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9180b412-0405-43af-8a46-8fec41da2f3d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.195662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9180b412-0405-43af-8a46-8fec41da2f3d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:48.196108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9180b412-0405-43af-8a46-8fec41da2f3d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:48.196529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9180b412-0405-43af-8a46-8fec41da2f3d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.197540 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae16a87c-7224-4c35-97fb-a5fd93cd5e33 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1367 microversion: 2.1 time: 0.224517 Sep 10 20:54:48.198143 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 853/1755] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:47 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:48.305188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:48.305878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:48.312303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:48.312788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:48.313222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.313943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:48.314398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:48.314821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.330397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9180b412-0405-43af-8a46-8fec41da2f3d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:48.338038 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9180b412-0405-43af-8a46-8fec41da2f3d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.173325 Sep 10 20:54:48.338617 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 903/1756] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:48 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:48.447123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:48.455561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:48.457011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:48.458206 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8df5c86d-7add-4419-abfd-ba227bafa92d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.156855 Sep 10 20:54:48.458768 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 854/1757] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:48 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:54:48.592530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2d70aad4-60c3-4e09-a096-dbec71d64fc2 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:48.593194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2d70aad4-60c3-4e09-a096-dbec71d64fc2 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:48.601129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d70aad4-60c3-4e09-a096-dbec71d64fc2 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:48.601606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d70aad4-60c3-4e09-a096-dbec71d64fc2 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:48.602160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d70aad4-60c3-4e09-a096-dbec71d64fc2 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.602875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d70aad4-60c3-4e09-a096-dbec71d64fc2 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:48.603460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d70aad4-60c3-4e09-a096-dbec71d64fc2 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:48.603865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d70aad4-60c3-4e09-a096-dbec71d64fc2 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.621073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:48.673640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2d70aad4-60c3-4e09-a096-dbec71d64fc2 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:48.681589 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2d70aad4-60c3-4e09-a096-dbec71d64fc2 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1484 microversion: 2.1 time: 0.093829 Sep 10 20:54:48.682186 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 904/1758] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:48 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1484 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:48.690493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b91c5ca0-2e37-4e6b-b792-362267946703 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:48.691412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b91c5ca0-2e37-4e6b-b792-362267946703 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:48.697666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91c5ca0-2e37-4e6b-b792-362267946703 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:48.698423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91c5ca0-2e37-4e6b-b792-362267946703 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:48.698866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91c5ca0-2e37-4e6b-b792-362267946703 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.700160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91c5ca0-2e37-4e6b-b792-362267946703 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:48.700640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91c5ca0-2e37-4e6b-b792-362267946703 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:48.701091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91c5ca0-2e37-4e6b-b792-362267946703 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.815126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-293e549e-458e-4643-a429-f3643c32f126 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:48.815126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-293e549e-458e-4643-a429-f3643c32f126 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:48.838333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-293e549e-458e-4643-a429-f3643c32f126 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:48.839021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-293e549e-458e-4643-a429-f3643c32f126 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:48.839537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-293e549e-458e-4643-a429-f3643c32f126 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.857250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-293e549e-458e-4643-a429-f3643c32f126 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:48.857250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-293e549e-458e-4643-a429-f3643c32f126 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:48.857250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-293e549e-458e-4643-a429-f3643c32f126 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:48.877916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b91c5ca0-2e37-4e6b-b792-362267946703 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:48.885856 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b91c5ca0-2e37-4e6b-b792-362267946703 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1307 microversion: 2.1 time: 0.199257 Sep 10 20:54:48.886633 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 855/1759] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:48 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:48.996022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-293e549e-458e-4643-a429-f3643c32f126 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:49.005952 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-293e549e-458e-4643-a429-f3643c32f126 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1199 microversion: 2.1 time: 0.205383 Sep 10 20:54:49.006666 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 905/1760] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:48 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1199 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:49.055693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-64d98cd6-993a-4472-8530-a7bfa58bbc1a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:49.056294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-64d98cd6-993a-4472-8530-a7bfa58bbc1a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:49.064187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64d98cd6-993a-4472-8530-a7bfa58bbc1a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.064967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64d98cd6-993a-4472-8530-a7bfa58bbc1a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.065585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64d98cd6-993a-4472-8530-a7bfa58bbc1a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.066517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64d98cd6-993a-4472-8530-a7bfa58bbc1a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.067179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64d98cd6-993a-4472-8530-a7bfa58bbc1a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.067813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64d98cd6-993a-4472-8530-a7bfa58bbc1a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.223074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae9442d9-da9b-4164-bf10-1942146655b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:49.224007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ae9442d9-da9b-4164-bf10-1942146655b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:49.235975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9442d9-da9b-4164-bf10-1942146655b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.236942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9442d9-da9b-4164-bf10-1942146655b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.238235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9442d9-da9b-4164-bf10-1942146655b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.239500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9442d9-da9b-4164-bf10-1942146655b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.240274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9442d9-da9b-4164-bf10-1942146655b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.240887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9442d9-da9b-4164-bf10-1942146655b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.305534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-64d98cd6-993a-4472-8530-a7bfa58bbc1a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:49.319558 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-64d98cd6-993a-4472-8530-a7bfa58bbc1a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1312 microversion: 2.1 time: 0.268297 Sep 10 20:54:49.334398 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 856/1761] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:49 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1312 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:49.362867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1e501502-47a5-40a3-b8fd-f36e2057a2ca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:49.365239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e501502-47a5-40a3-b8fd-f36e2057a2ca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:49.381128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e501502-47a5-40a3-b8fd-f36e2057a2ca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.383431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e501502-47a5-40a3-b8fd-f36e2057a2ca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.385623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e501502-47a5-40a3-b8fd-f36e2057a2ca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.389533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e501502-47a5-40a3-b8fd-f36e2057a2ca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.390652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e501502-47a5-40a3-b8fd-f36e2057a2ca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.391584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e501502-47a5-40a3-b8fd-f36e2057a2ca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.527333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ae9442d9-da9b-4164-bf10-1942146655b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:49.537685 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ae9442d9-da9b-4164-bf10-1942146655b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1557 microversion: 2.1 time: 0.320919 Sep 10 20:54:49.550607 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 906/1762] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:49 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1557 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:49.562884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:49.563507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:49.570348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.571053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.571689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.573195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.573910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.575089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.612031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1e501502-47a5-40a3-b8fd-f36e2057a2ca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:49.620871 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1e501502-47a5-40a3-b8fd-f36e2057a2ca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.261887 Sep 10 20:54:49.621648 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 857/1763] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:49 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:49.626732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-af9986f6-343b-417e-96e4-c07cee60196c tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:49.627540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-af9986f6-343b-417e-96e4-c07cee60196c tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:49.642466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af9986f6-343b-417e-96e4-c07cee60196c tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.643057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af9986f6-343b-417e-96e4-c07cee60196c tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.643544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af9986f6-343b-417e-96e4-c07cee60196c tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.644547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af9986f6-343b-417e-96e4-c07cee60196c tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.645061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af9986f6-343b-417e-96e4-c07cee60196c tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.645495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af9986f6-343b-417e-96e4-c07cee60196c tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.755476 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-af9986f6-343b-417e-96e4-c07cee60196c tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132684 Sep 10 20:54:49.756185 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 858/1764] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 20:54:49 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:49.762556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:49.763604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:49.772083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.772700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.773397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.774229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.775713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.776214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.813350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.813881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.814321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.814888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lazy-loading 'fault' on Instance uuid 7cd3610b-d918-4b60-80cc-17213d521c75 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:54:49.882391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef231141009462d9819a123ea16d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471f82eb46074bdabaedf6f837f6b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:49.892942 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0b78ff0b-267d-431c-94c2-19cf41f5e472 tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 200 len: 1314 microversion: 2.1 time: 0.134566 Sep 10 20:54:49.893733 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 859/1765] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:49 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 1314 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:49.896449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:49.914191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aa86f7cc-b2fa-47e7-80c0-d58233ad390e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:49.914804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aa86f7cc-b2fa-47e7-80c0-d58233ad390e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:49.916387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:49.917956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:49.919572 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-60f74cd6-ccad-4ee5-8db7-85a729778e3b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.367587 Sep 10 20:54:49.931930 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 907/1766] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:49 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:49.937121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa86f7cc-b2fa-47e7-80c0-d58233ad390e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.939017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa86f7cc-b2fa-47e7-80c0-d58233ad390e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.939509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa86f7cc-b2fa-47e7-80c0-d58233ad390e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:49.940265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa86f7cc-b2fa-47e7-80c0-d58233ad390e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:49.940720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa86f7cc-b2fa-47e7-80c0-d58233ad390e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:49.941157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa86f7cc-b2fa-47e7-80c0-d58233ad390e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:50.029292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8bcc14a5-73fc-49c6-b224-b1d8ab9c6856 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:50.030323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8bcc14a5-73fc-49c6-b224-b1d8ab9c6856 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:50.039908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bcc14a5-73fc-49c6-b224-b1d8ab9c6856 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:50.040824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bcc14a5-73fc-49c6-b224-b1d8ab9c6856 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:50.041450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bcc14a5-73fc-49c6-b224-b1d8ab9c6856 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:50.042396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bcc14a5-73fc-49c6-b224-b1d8ab9c6856 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:50.043422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bcc14a5-73fc-49c6-b224-b1d8ab9c6856 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:50.044282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8bcc14a5-73fc-49c6-b224-b1d8ab9c6856 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:50.125064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aa86f7cc-b2fa-47e7-80c0-d58233ad390e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:50.143336 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aa86f7cc-b2fa-47e7-80c0-d58233ad390e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1307 microversion: 2.1 time: 0.234892 Sep 10 20:54:50.145494 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 860/1767] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:49 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1307 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:50.345127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b7885fb1-640a-4320-948e-bb792b91d463 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:50.345760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b7885fb1-640a-4320-948e-bb792b91d463 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:50.352815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7885fb1-640a-4320-948e-bb792b91d463 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:50.353277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7885fb1-640a-4320-948e-bb792b91d463 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:50.353712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7885fb1-640a-4320-948e-bb792b91d463 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:50.354656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7885fb1-640a-4320-948e-bb792b91d463 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:50.355105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7885fb1-640a-4320-948e-bb792b91d463 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:50.356081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b7885fb1-640a-4320-948e-bb792b91d463 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:50.538272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:50.543960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b7885fb1-640a-4320-948e-bb792b91d463 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:50.557300 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b7885fb1-640a-4320-948e-bb792b91d463 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1461 microversion: 2.1 time: 0.216831 Sep 10 20:54:50.558315 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 861/1768] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:50 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1461 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:50.589690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0fa34af2-5b25-4280-8c65-2d2106decfb5 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:50.590938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0fa34af2-5b25-4280-8c65-2d2106decfb5 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:50.597816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa34af2-5b25-4280-8c65-2d2106decfb5 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:50.598651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa34af2-5b25-4280-8c65-2d2106decfb5 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:50.599280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa34af2-5b25-4280-8c65-2d2106decfb5 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:50.599999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa34af2-5b25-4280-8c65-2d2106decfb5 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:50.600463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa34af2-5b25-4280-8c65-2d2106decfb5 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:50.600909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa34af2-5b25-4280-8c65-2d2106decfb5 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:50.601355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=5 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:50.791533 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0fa34af2-5b25-4280-8c65-2d2106decfb5 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1612 microversion: 2.1 time: 0.207270 Sep 10 20:54:50.792689 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 862/1769] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:50 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1612 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:50.799070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b1269258-6bab-49cb-ae31-a684bd6e207b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:50.799953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b1269258-6bab-49cb-ae31-a684bd6e207b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:50.805060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8bcc14a5-73fc-49c6-b224-b1d8ab9c6856 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:50.807072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1269258-6bab-49cb-ae31-a684bd6e207b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:50.807752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1269258-6bab-49cb-ae31-a684bd6e207b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:50.808379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1269258-6bab-49cb-ae31-a684bd6e207b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:50.810029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1269258-6bab-49cb-ae31-a684bd6e207b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:50.810700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1269258-6bab-49cb-ae31-a684bd6e207b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:50.811326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1269258-6bab-49cb-ae31-a684bd6e207b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:50.818249 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8bcc14a5-73fc-49c6-b224-b1d8ab9c6856 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1199 microversion: 2.1 time: 0.789181 Sep 10 20:54:50.819506 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 908/1770] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:50 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1199 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:50.847435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:50.850389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:50.865961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:50.866802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:50.867973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:50.869226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:50.870019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:50.870969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:51.014046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ff6039a197324406a774cd55dc06b9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6a80cfe5e49eda7f76cde966f9799', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:51.014716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] flavor_id is None. Assuming migration. {{(pid=145772) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 20:54:51.015056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=145772) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 20:54:51.064345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b1269258-6bab-49cb-ae31-a684bd6e207b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:51.083006 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b1269258-6bab-49cb-ae31-a684bd6e207b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.288997 Sep 10 20:54:51.094606 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 863/1771] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:50 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:51.102617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:51.103017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] [instance: 7cd3610b-d918-4b60-80cc-17213d521c75] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:51.122877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:51.123890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:51.124987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:51.125991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:51.127537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:51.129142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:51.152437 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] HTTP exception thrown: Instance 7cd3610b-d918-4b60-80cc-17213d521c75 could not be found. Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Request method failure captured: Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 HTTP/1.1 Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPl-ORJBn3L3j-IXcBiP7RwKR33GNilsX-V6VWG_LTSt5hRydoNelsxqbUAPCAbuP9N11lDLTX2jMJABzFNVq5Y1-HRaI6MWY7gZPRFx1RIJz_B8Nes7Q1cvMTgpujOcdpYmAjcpdRCoSL1kk5Oh2gsyzEYK08abcq4CVt9HwOS3tXs Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/471f82eb46074bdabaedf6f837f6b94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_471f82eb46074bdabaedf6f837f6b94c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/471f82eb46074bdabaedf6f837f6b94c"}]}] Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 471f82eb46074bdabaedf6f837f6b94c Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357564685 Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 7ef231141009462d9819a123ea16d8c4 Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357564685-project Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 7cd3610b-d918-4b60-80cc-17213d521c75 could not be found. Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7cd3610b-d918-4b60-80cc-17213d521c75'} Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd3610b-d918-4b60-80cc-17213d521c75 could not be found. Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd3610b-d918-4b60-80cc-17213d521c75 could not be found. Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:51.155140 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:54:51.160925 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:51.160925 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:54:51.160925 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:54:51.160925 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:54:51.160925 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:54:51.160925 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:54:51.160925 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd3610b-d918-4b60-80cc-17213d521c75 could not be found. Sep 10 20:54:51.160925 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:54:51.160925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] Returning 404 to user: Instance 7cd3610b-d918-4b60-80cc-17213d521c75 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:54:51.163129 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1cf12bdc-d8fc-42ce-8d23-026e34cec99e tempest-ServerMetadataNegativeTestJSON-1357564685 tempest-ServerMetadataNegativeTestJSON-1357564685-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75" status: 404 len: 111 microversion: 2.1 time: 0.066545 Sep 10 20:54:51.167676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 864/1772] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:51 2022] GET /compute/v2.1/servers/7cd3610b-d918-4b60-80cc-17213d521c75 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:54:51.188665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:51.191396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:51.201549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:51.202534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:51.203986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:51.220934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:51.222314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:51.223319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:51.451475 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6bdeee0b-de73-44a3-894e-09c6d47850ba tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa/action" status: 202 len: 0 microversion: 2.1 time: 0.630448 Sep 10 20:54:51.452644 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 909/1773] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:54:50 2022] POST /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:54:51.468413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e96fc1cc-e669-40ce-8a47-ed051599fa59 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:51.469360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e96fc1cc-e669-40ce-8a47-ed051599fa59 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:51.482784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96fc1cc-e669-40ce-8a47-ed051599fa59 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:51.484464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96fc1cc-e669-40ce-8a47-ed051599fa59 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:51.485449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96fc1cc-e669-40ce-8a47-ed051599fa59 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:51.486573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96fc1cc-e669-40ce-8a47-ed051599fa59 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:51.487390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96fc1cc-e669-40ce-8a47-ed051599fa59 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:51.488760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e96fc1cc-e669-40ce-8a47-ed051599fa59 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:51.544544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:51.563433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:51.566260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:51.568685 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a3e6d8ba-2651-4424-aded-eab58e2bdf4d tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.403038 Sep 10 20:54:51.570307 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 865/1774] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:51 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:51.579271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3fcee5dd-a973-4b67-8a7f-815f7eaaec8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:51.580210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3fcee5dd-a973-4b67-8a7f-815f7eaaec8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:51.591995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fcee5dd-a973-4b67-8a7f-815f7eaaec8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:51.595014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fcee5dd-a973-4b67-8a7f-815f7eaaec8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:51.595920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fcee5dd-a973-4b67-8a7f-815f7eaaec8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:51.597250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fcee5dd-a973-4b67-8a7f-815f7eaaec8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:51.597583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fcee5dd-a973-4b67-8a7f-815f7eaaec8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:51.598065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fcee5dd-a973-4b67-8a7f-815f7eaaec8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:51.944073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3fcee5dd-a973-4b67-8a7f-815f7eaaec8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:51.967960 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3fcee5dd-a973-4b67-8a7f-815f7eaaec8d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1470 microversion: 2.1 time: 0.382136 Sep 10 20:54:51.978632 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 866/1775] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:51 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1470 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:51.986601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-55bfc11a-6283-4655-a955-2a7a474e8bdc req-b60d8ad6-32a8-4a7f-899f-e5511086b22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3b5948-c5f9-4841-8444-c81ba0f96631", "name": "network-vif-plugged", "status": "completed", "tag": "0a697059-7bd3-4f8e-a53a-ab17edf98c1f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:52.006423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e96fc1cc-e669-40ce-8a47-ed051599fa59 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:52.019101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-55bfc11a-6283-4655-a955-2a7a474e8bdc req-b60d8ad6-32a8-4a7f-899f-e5511086b22c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:52.019651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-55bfc11a-6283-4655-a955-2a7a474e8bdc req-b60d8ad6-32a8-4a7f-899f-e5511086b22c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:52.020310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-55bfc11a-6283-4655-a955-2a7a474e8bdc req-b60d8ad6-32a8-4a7f-899f-e5511086b22c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:52.036191 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-55bfc11a-6283-4655-a955-2a7a474e8bdc req-b60d8ad6-32a8-4a7f-899f-e5511086b22c service nova] Creating event network-vif-plugged:0a697059-7bd3-4f8e-a53a-ab17edf98c1f for instance eb3b5948-c5f9-4841-8444-c81ba0f96631 on nch1-master-1 Sep 10 20:54:52.042970 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-55bfc11a-6283-4655-a955-2a7a474e8bdc req-b60d8ad6-32a8-4a7f-899f-e5511086b22c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063990 Sep 10 20:54:52.044293 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 867/1776] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:52.047992 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e96fc1cc-e669-40ce-8a47-ed051599fa59 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1307 microversion: 2.1 time: 0.588255 Sep 10 20:54:52.051926 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 910/1777] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:51 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1307 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:52.052518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae84ccab-3ee6-4ff9-8484-f049e6d611db tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:52.053581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ae84ccab-3ee6-4ff9-8484-f049e6d611db tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:52.066283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae84ccab-3ee6-4ff9-8484-f049e6d611db tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:52.066977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae84ccab-3ee6-4ff9-8484-f049e6d611db tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:52.067691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae84ccab-3ee6-4ff9-8484-f049e6d611db tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:52.068813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae84ccab-3ee6-4ff9-8484-f049e6d611db tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:52.069579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae84ccab-3ee6-4ff9-8484-f049e6d611db tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:52.070200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae84ccab-3ee6-4ff9-8484-f049e6d611db tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:52.114449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5c195b3c-1232-4dd0-ad99-688d44f34f90 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:52.116209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5c195b3c-1232-4dd0-ad99-688d44f34f90 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:52.126137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c195b3c-1232-4dd0-ad99-688d44f34f90 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:52.127179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c195b3c-1232-4dd0-ad99-688d44f34f90 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:52.127798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c195b3c-1232-4dd0-ad99-688d44f34f90 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:52.129042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c195b3c-1232-4dd0-ad99-688d44f34f90 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:52.129669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c195b3c-1232-4dd0-ad99-688d44f34f90 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:52.130335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c195b3c-1232-4dd0-ad99-688d44f34f90 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:52.415097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae84ccab-3ee6-4ff9-8484-f049e6d611db tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:52.430199 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae84ccab-3ee6-4ff9-8484-f049e6d611db tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1199 microversion: 2.1 time: 0.383690 Sep 10 20:54:52.445015 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 868/1778] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:52 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1199 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:52.460375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a57711ea-8ce5-4320-830c-1dbeaa74b628 req-864843f9-de7a-478a-a307-c2dcb2f80324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb03fb54-1b7b-42ec-b71b-b73d7f96b657", "tag": "c88c7c1f-fddc-4804-9ba5-5dfaae6029f9"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:52.474808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a57711ea-8ce5-4320-830c-1dbeaa74b628 req-864843f9-de7a-478a-a307-c2dcb2f80324 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:52.475596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a57711ea-8ce5-4320-830c-1dbeaa74b628 req-864843f9-de7a-478a-a307-c2dcb2f80324 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:52.476229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a57711ea-8ce5-4320-830c-1dbeaa74b628 req-864843f9-de7a-478a-a307-c2dcb2f80324 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:52.482459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:52.499458 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a57711ea-8ce5-4320-830c-1dbeaa74b628 req-864843f9-de7a-478a-a307-c2dcb2f80324 service nova] Creating event network-changed:c88c7c1f-fddc-4804-9ba5-5dfaae6029f9 for instance cb03fb54-1b7b-42ec-b71b-b73d7f96b657 on nch2-master-1 Sep 10 20:54:52.509126 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a57711ea-8ce5-4320-830c-1dbeaa74b628 req-864843f9-de7a-478a-a307-c2dcb2f80324 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055778 Sep 10 20:54:52.511240 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 869/1779] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:52.598807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:52.599963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:52.615801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:52.623195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:52.625019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:52.626389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:52.627326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:52.628493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:52.746929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5c195b3c-1232-4dd0-ad99-688d44f34f90 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:52.763529 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5c195b3c-1232-4dd0-ad99-688d44f34f90 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.653067 Sep 10 20:54:52.770142 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 911/1780] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:52 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:52.994875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-854f4a7c-a188-4b3e-9c5f-0b807ff3f31f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:52.998931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-854f4a7c-a188-4b3e-9c5f-0b807ff3f31f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:53.007170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-854f4a7c-a188-4b3e-9c5f-0b807ff3f31f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:53.008146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-854f4a7c-a188-4b3e-9c5f-0b807ff3f31f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:53.009585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-854f4a7c-a188-4b3e-9c5f-0b807ff3f31f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:53.010537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-854f4a7c-a188-4b3e-9c5f-0b807ff3f31f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:53.011322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-854f4a7c-a188-4b3e-9c5f-0b807ff3f31f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:53.012602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-854f4a7c-a188-4b3e-9c5f-0b807ff3f31f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:53.386860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:53.400822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:53.410610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-854f4a7c-a188-4b3e-9c5f-0b807ff3f31f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:53.421188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:53.423924 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5993f038-b2e4-4736-9d9e-05c85557cbc5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.832149 Sep 10 20:54:53.426099 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-854f4a7c-a188-4b3e-9c5f-0b807ff3f31f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1470 microversion: 2.1 time: 0.436966 Sep 10 20:54:53.429216 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 870/1781] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:52 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:53.435197 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 912/1782] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:52 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1470 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:53.450325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5a9e436-39cd-4904-99bf-b9cbcfb77c9c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:53.458015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e5a9e436-39cd-4904-99bf-b9cbcfb77c9c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:53.458810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3528d3a4-4827-4399-8537-a78b9edae4cf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:53.459415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3528d3a4-4827-4399-8537-a78b9edae4cf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:53.466027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a9e436-39cd-4904-99bf-b9cbcfb77c9c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:53.466837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a9e436-39cd-4904-99bf-b9cbcfb77c9c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:53.467760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a9e436-39cd-4904-99bf-b9cbcfb77c9c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:53.469363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a9e436-39cd-4904-99bf-b9cbcfb77c9c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:53.470133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a9e436-39cd-4904-99bf-b9cbcfb77c9c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:53.471054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a9e436-39cd-4904-99bf-b9cbcfb77c9c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:53.491637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3528d3a4-4827-4399-8537-a78b9edae4cf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:53.493797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3528d3a4-4827-4399-8537-a78b9edae4cf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:53.495767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3528d3a4-4827-4399-8537-a78b9edae4cf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:53.500547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3528d3a4-4827-4399-8537-a78b9edae4cf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:53.501587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3528d3a4-4827-4399-8537-a78b9edae4cf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:53.503069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3528d3a4-4827-4399-8537-a78b9edae4cf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:54.020831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3528d3a4-4827-4399-8537-a78b9edae4cf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:54.047635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3528d3a4-4827-4399-8537-a78b9edae4cf tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1199 microversion: 2.1 time: 0.593028 Sep 10 20:54:54.060602 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 913/1783] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:53 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1199 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:54.069966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-64fe3652-056a-4886-93f2-fd5545e14c40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:54.071898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-64fe3652-056a-4886-93f2-fd5545e14c40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:54.078738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64fe3652-056a-4886-93f2-fd5545e14c40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:54.092596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64fe3652-056a-4886-93f2-fd5545e14c40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:54.093555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64fe3652-056a-4886-93f2-fd5545e14c40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:54.095753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64fe3652-056a-4886-93f2-fd5545e14c40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:54.099368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64fe3652-056a-4886-93f2-fd5545e14c40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:54.100141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64fe3652-056a-4886-93f2-fd5545e14c40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:54.369560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-64fe3652-056a-4886-93f2-fd5545e14c40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:54.389755 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-64fe3652-056a-4886-93f2-fd5545e14c40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.326541 Sep 10 20:54:54.397984 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 914/1784] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:54 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:54.405511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-122e62ca-3e6d-42cc-a8ff-19e421039023 req-5d0abada-6515-476a-b2a2-71706f47fb38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372f952b-42c2-45e6-bb5c-5a2c37a2879e", "name": "network-vif-plugged", "status": "completed", "tag": "1719b8ff-bafb-42bb-8a8f-800f550eab35"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:54.435555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-122e62ca-3e6d-42cc-a8ff-19e421039023 req-5d0abada-6515-476a-b2a2-71706f47fb38 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:54.437036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-122e62ca-3e6d-42cc-a8ff-19e421039023 req-5d0abada-6515-476a-b2a2-71706f47fb38 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:54.437930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-122e62ca-3e6d-42cc-a8ff-19e421039023 req-5d0abada-6515-476a-b2a2-71706f47fb38 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:54.486360 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-122e62ca-3e6d-42cc-a8ff-19e421039023 req-5d0abada-6515-476a-b2a2-71706f47fb38 service nova] Creating event network-vif-plugged:1719b8ff-bafb-42bb-8a8f-800f550eab35 for instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e on nch2-master-1 Sep 10 20:54:54.495418 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-122e62ca-3e6d-42cc-a8ff-19e421039023 req-5d0abada-6515-476a-b2a2-71706f47fb38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095337 Sep 10 20:54:54.498932 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 915/1785] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:54.513242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:54.514138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:54.525054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:54.525575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:54.526037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:54.526969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:54.528742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:54.529199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:54.564652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e5a9e436-39cd-4904-99bf-b9cbcfb77c9c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:54.595246 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5a9e436-39cd-4904-99bf-b9cbcfb77c9c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1307 microversion: 2.1 time: 1.159578 Sep 10 20:54:54.596923 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 871/1786] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:53 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1307 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:54.606792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-065b5455-3460-4f84-ab1c-bef51cb5ab1d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:54.607774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-065b5455-3460-4f84-ab1c-bef51cb5ab1d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:54.615014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-065b5455-3460-4f84-ab1c-bef51cb5ab1d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:54.615850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-065b5455-3460-4f84-ab1c-bef51cb5ab1d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:54.616574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-065b5455-3460-4f84-ab1c-bef51cb5ab1d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:54.617580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-065b5455-3460-4f84-ab1c-bef51cb5ab1d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:54.618260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-065b5455-3460-4f84-ab1c-bef51cb5ab1d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:54.618950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-065b5455-3460-4f84-ab1c-bef51cb5ab1d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:54.731290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:54.743101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:54.746552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:54.748603 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-330d9029-9a66-47cc-bc0f-be45ece88c0c tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1485 microversion: 2.25 time: 0.247770 Sep 10 20:54:54.749659 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 916/1787] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:54 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1485 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:55.089179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c664a623-bd79-4c49-8a7e-36fc063fc560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:55.090719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c664a623-bd79-4c49-8a7e-36fc063fc560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:55.099914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c664a623-bd79-4c49-8a7e-36fc063fc560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:55.100402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c664a623-bd79-4c49-8a7e-36fc063fc560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:55.100836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c664a623-bd79-4c49-8a7e-36fc063fc560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:55.101541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c664a623-bd79-4c49-8a7e-36fc063fc560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:55.102035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c664a623-bd79-4c49-8a7e-36fc063fc560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:55.102644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c664a623-bd79-4c49-8a7e-36fc063fc560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:55.140137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-065b5455-3460-4f84-ab1c-bef51cb5ab1d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:55.151568 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-065b5455-3460-4f84-ab1c-bef51cb5ab1d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1470 microversion: 2.1 time: 0.553267 Sep 10 20:54:55.153926 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 872/1788] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:54 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1470 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:55.396217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c664a623-bd79-4c49-8a7e-36fc063fc560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:55.412683 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c664a623-bd79-4c49-8a7e-36fc063fc560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1382 microversion: 2.1 time: 0.327559 Sep 10 20:54:55.414439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2d96e3ea-d0b5-433e-92b1-7e3915f3fd6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:55.414842 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 917/1789] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:55 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1382 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:55.415201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2d96e3ea-d0b5-433e-92b1-7e3915f3fd6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:55.427249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d96e3ea-d0b5-433e-92b1-7e3915f3fd6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:55.427745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d96e3ea-d0b5-433e-92b1-7e3915f3fd6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:55.428182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d96e3ea-d0b5-433e-92b1-7e3915f3fd6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:55.429136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d96e3ea-d0b5-433e-92b1-7e3915f3fd6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:55.429594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d96e3ea-d0b5-433e-92b1-7e3915f3fd6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:55.430052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d96e3ea-d0b5-433e-92b1-7e3915f3fd6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:55.446003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ecdd5ad4-2e93-41e2-b65d-dbc5c177998f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:55.447148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ecdd5ad4-2e93-41e2-b65d-dbc5c177998f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:55.456598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecdd5ad4-2e93-41e2-b65d-dbc5c177998f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:55.457369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecdd5ad4-2e93-41e2-b65d-dbc5c177998f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:55.458169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecdd5ad4-2e93-41e2-b65d-dbc5c177998f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:55.459193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecdd5ad4-2e93-41e2-b65d-dbc5c177998f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:55.459996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecdd5ad4-2e93-41e2-b65d-dbc5c177998f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:55.460627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecdd5ad4-2e93-41e2-b65d-dbc5c177998f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:55.715535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2d96e3ea-d0b5-433e-92b1-7e3915f3fd6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:55.729112 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2d96e3ea-d0b5-433e-92b1-7e3915f3fd6b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.318426 Sep 10 20:54:55.732171 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 873/1790] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:55 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:54:55.742635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ecdd5ad4-2e93-41e2-b65d-dbc5c177998f tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1533 microversion: 2.1 time: 0.304712 Sep 10 20:54:55.743483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16bba149-b049-40cc-b808-e81edbffa01c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:55.744578 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 918/1791] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:55 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1533 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:55.763504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-16bba149-b049-40cc-b808-e81edbffa01c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:55.772757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9136f43f-e11f-43a7-bde8-1a5239f638d7 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:55.773035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16bba149-b049-40cc-b808-e81edbffa01c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:55.773759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9136f43f-e11f-43a7-bde8-1a5239f638d7 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:55.775800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16bba149-b049-40cc-b808-e81edbffa01c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:55.779079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16bba149-b049-40cc-b808-e81edbffa01c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:55.780037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16bba149-b049-40cc-b808-e81edbffa01c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:55.784749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16bba149-b049-40cc-b808-e81edbffa01c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:55.785130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9136f43f-e11f-43a7-bde8-1a5239f638d7 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:55.785743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16bba149-b049-40cc-b808-e81edbffa01c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:55.787418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9136f43f-e11f-43a7-bde8-1a5239f638d7 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:55.788208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9136f43f-e11f-43a7-bde8-1a5239f638d7 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:55.789617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9136f43f-e11f-43a7-bde8-1a5239f638d7 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:55.790757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9136f43f-e11f-43a7-bde8-1a5239f638d7 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:55.791536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9136f43f-e11f-43a7-bde8-1a5239f638d7 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.005648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-16bba149-b049-40cc-b808-e81edbffa01c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:56.020119 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-16bba149-b049-40cc-b808-e81edbffa01c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1307 microversion: 2.1 time: 0.284329 Sep 10 20:54:56.020730 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 874/1792] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:55 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1307 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:56.028890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:56.029695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:56.037076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.037921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.038571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.039441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.040646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.041451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.150372 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9136f43f-e11f-43a7-bde8-1a5239f638d7 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1533 microversion: 2.1 time: 0.382674 Sep 10 20:54:56.151712 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 919/1793] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:55 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1533 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:56.177556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-02603eee-0711-4eb7-8664-28d5592481b5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:56.185780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02603eee-0711-4eb7-8664-28d5592481b5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.188072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02603eee-0711-4eb7-8664-28d5592481b5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.188866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02603eee-0711-4eb7-8664-28d5592481b5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.189975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02603eee-0711-4eb7-8664-28d5592481b5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.191316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02603eee-0711-4eb7-8664-28d5592481b5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.192007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02603eee-0711-4eb7-8664-28d5592481b5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.214098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:54:56.236911 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-02603eee-0711-4eb7-8664-28d5592481b5 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.063418 Sep 10 20:54:56.238227 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 920/1794] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Sep 10 20:54:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:54:56.254063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b103606b-75de-4478-b2f1-de436f15a308 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:56.256346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b103606b-75de-4478-b2f1-de436f15a308 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:56.265410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b103606b-75de-4478-b2f1-de436f15a308 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.266889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b103606b-75de-4478-b2f1-de436f15a308 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.267725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b103606b-75de-4478-b2f1-de436f15a308 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.268512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b103606b-75de-4478-b2f1-de436f15a308 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.269277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b103606b-75de-4478-b2f1-de436f15a308 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.270196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b103606b-75de-4478-b2f1-de436f15a308 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.275343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:56.288628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:56.291923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:56.295669 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0b582af1-90a2-40dc-b12d-c43ffd57a4a2 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1475 microversion: 2.25 time: 0.272099 Sep 10 20:54:56.303295 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 875/1795] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:56 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1475 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:56.324652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:56.331658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:56.343276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.344063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.344598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.348575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.349198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.349991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.381372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lazy-loading 'flavor' on Instance uuid eb3b5948-c5f9-4841-8444-c81ba0f96631 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:54:56.400214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Going to try to live migrate instance to nch2-master-1 {{(pid=145771) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 20:54:56.537311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b103606b-75de-4478-b2f1-de436f15a308 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:56.548892 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b103606b-75de-4478-b2f1-de436f15a308 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.309119 Sep 10 20:54:56.550169 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 921/1796] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:56 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:56.555703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a8d4637f-0064-44ef-aada-638187f6db5a tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '.version_select at 0x7f994969be50>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:56.562394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8d4637f-0064-44ef-aada-638187f6db5a tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.563381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8d4637f-0064-44ef-aada-638187f6db5a tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.564063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8d4637f-0064-44ef-aada-638187f6db5a tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.585059 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a8d4637f-0064-44ef-aada-638187f6db5a tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 4893 microversion: 2.25 time: 0.033129 Sep 10 20:54:56.587842 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 922/1797] 10.222.0.33 () {60 vars in 1184 bytes} [Sat Sep 10 20:54:56 2022] GET /compute/v2.1/os-migrations => generated 4893 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:56.611379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fb7cd682-2c2d-4a93-97c6-5a5f5be75c20 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:56.612282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fb7cd682-2c2d-4a93-97c6-5a5f5be75c20 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:56.622061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb7cd682-2c2d-4a93-97c6-5a5f5be75c20 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.622752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb7cd682-2c2d-4a93-97c6-5a5f5be75c20 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.623199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb7cd682-2c2d-4a93-97c6-5a5f5be75c20 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:56.624225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb7cd682-2c2d-4a93-97c6-5a5f5be75c20 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:56.624849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb7cd682-2c2d-4a93-97c6-5a5f5be75c20 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:56.625964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb7cd682-2c2d-4a93-97c6-5a5f5be75c20 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:57.227723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-fb7cd682-2c2d-4a93-97c6-5a5f5be75c20 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] Lazy-loading 'services' on Instance uuid aeb73142-7fcb-44b4-8ff3-b7624fc5b494 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:54:57.251548 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fb7cd682-2c2d-4a93-97c6-5a5f5be75c20 tempest-LiveAutoBlockMigrationV225Test-1721871605 tempest-LiveAutoBlockMigrationV225Test-1721871605-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1967 microversion: 2.25 time: 0.644519 Sep 10 20:54:57.258426 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 923/1798] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:56 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1967 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:54:57.267811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f7e73f5-3653-40c0-aec5-79c44dc5fbc0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:57.268697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5f7e73f5-3653-40c0-aec5-79c44dc5fbc0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:57.280797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f7e73f5-3653-40c0-aec5-79c44dc5fbc0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:57.281512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f7e73f5-3653-40c0-aec5-79c44dc5fbc0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:57.282208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f7e73f5-3653-40c0-aec5-79c44dc5fbc0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:57.283478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f7e73f5-3653-40c0-aec5-79c44dc5fbc0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:57.283981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f7e73f5-3653-40c0-aec5-79c44dc5fbc0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:57.284644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f7e73f5-3653-40c0-aec5-79c44dc5fbc0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:57.486631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5f7e73f5-3653-40c0-aec5-79c44dc5fbc0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:57.494821 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f7e73f5-3653-40c0-aec5-79c44dc5fbc0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.235090 Sep 10 20:54:57.495389 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 924/1799] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:57 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:57.500451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-45c4b972-7acf-4a96-8148-da9aa0014c5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:57.501059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-45c4b972-7acf-4a96-8148-da9aa0014c5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:57.507871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c4b972-7acf-4a96-8148-da9aa0014c5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:57.508632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c4b972-7acf-4a96-8148-da9aa0014c5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:57.509074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c4b972-7acf-4a96-8148-da9aa0014c5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:57.509983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c4b972-7acf-4a96-8148-da9aa0014c5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:57.510446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c4b972-7acf-4a96-8148-da9aa0014c5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:57.510901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c4b972-7acf-4a96-8148-da9aa0014c5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:57.671989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-45c4b972-7acf-4a96-8148-da9aa0014c5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:57.680987 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-45c4b972-7acf-4a96-8148-da9aa0014c5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1488 microversion: 2.1 time: 0.183615 Sep 10 20:54:57.698364 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 925/1800] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:57 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1488 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:57.711238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f41491f-35ca-4bda-a965-b103995b6a64 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:57.714855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4f41491f-35ca-4bda-a965-b103995b6a64 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:57.733048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f41491f-35ca-4bda-a965-b103995b6a64 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:57.733726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f41491f-35ca-4bda-a965-b103995b6a64 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:57.735047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f41491f-35ca-4bda-a965-b103995b6a64 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:57.736220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f41491f-35ca-4bda-a965-b103995b6a64 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:57.736998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f41491f-35ca-4bda-a965-b103995b6a64 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:57.738169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f41491f-35ca-4bda-a965-b103995b6a64 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:57.782003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4f41491f-35ca-4bda-a965-b103995b6a64 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:54:57.927291 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f41491f-35ca-4bda-a965-b103995b6a64 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 204 len: 0 microversion: 2.25 time: 0.227012 Sep 10 20:54:57.928243 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 926/1801] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:54:57 2022] DELETE /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:54:57.935985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-494b41b6-af7a-4387-95ad-0b591102ed27 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:57.937057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-494b41b6-af7a-4387-95ad-0b591102ed27 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:57.944151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-494b41b6-af7a-4387-95ad-0b591102ed27 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:57.944649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-494b41b6-af7a-4387-95ad-0b591102ed27 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:57.945089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-494b41b6-af7a-4387-95ad-0b591102ed27 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:57.945907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-494b41b6-af7a-4387-95ad-0b591102ed27 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:57.946377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-494b41b6-af7a-4387-95ad-0b591102ed27 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:57.946856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-494b41b6-af7a-4387-95ad-0b591102ed27 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:58.348672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-494b41b6-af7a-4387-95ad-0b591102ed27 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:58.357607 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-494b41b6-af7a-4387-95ad-0b591102ed27 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.427992 Sep 10 20:54:58.358357 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 927/1802] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:57 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:58.363187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-191566d5-496f-4df2-ad22-1864d1619905 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:58.363730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-191566d5-496f-4df2-ad22-1864d1619905 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:58.369533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191566d5-496f-4df2-ad22-1864d1619905 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:58.370071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191566d5-496f-4df2-ad22-1864d1619905 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:58.370855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191566d5-496f-4df2-ad22-1864d1619905 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:58.371710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191566d5-496f-4df2-ad22-1864d1619905 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:58.372456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191566d5-496f-4df2-ad22-1864d1619905 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:58.373057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-191566d5-496f-4df2-ad22-1864d1619905 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:58.444938 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-191566d5-496f-4df2-ad22-1864d1619905 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e/action" status: 202 len: 0 microversion: 2.1 time: 0.085181 Sep 10 20:54:58.445902 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 928/1803] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:54:58 2022] POST /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:54:58.451657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:58.452351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:58.459328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:58.459830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:58.460152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:58.461710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:58.461710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:58.461974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:58.846167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:58.865945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:58.888137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:58.892189 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-491c94f6-9926-4048-afcd-320a910d06df tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1481 microversion: 2.25 time: 0.444822 Sep 10 20:54:58.902605 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 929/1804] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:58 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1481 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:54:58.907493 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c26bcc05-8149-445e-82b8-99491ce3c401 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631/action" status: 202 len: 0 microversion: 2.1 time: 2.602430 Sep 10 20:54:58.908844 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 876/1805] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:54:56 2022] POST /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631/action => generated 0 bytes in 2605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:54:58.912549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d2f68d4d-9da3-4143-a45c-211463196803 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:58.913422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d2f68d4d-9da3-4143-a45c-211463196803 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:58.915362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ce8a98a1-e232-4c6f-8fa9-83e96827680b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:58.919362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ce8a98a1-e232-4c6f-8fa9-83e96827680b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:58.926821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f68d4d-9da3-4143-a45c-211463196803 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:58.927698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f68d4d-9da3-4143-a45c-211463196803 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:58.928388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f68d4d-9da3-4143-a45c-211463196803 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:58.929521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f68d4d-9da3-4143-a45c-211463196803 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:58.930564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f68d4d-9da3-4143-a45c-211463196803 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:58.931249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f68d4d-9da3-4143-a45c-211463196803 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:58.937924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce8a98a1-e232-4c6f-8fa9-83e96827680b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:58.938664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce8a98a1-e232-4c6f-8fa9-83e96827680b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:58.939307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce8a98a1-e232-4c6f-8fa9-83e96827680b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:58.940054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce8a98a1-e232-4c6f-8fa9-83e96827680b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:58.940749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce8a98a1-e232-4c6f-8fa9-83e96827680b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:58.941871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce8a98a1-e232-4c6f-8fa9-83e96827680b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:59.173269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d2f68d4d-9da3-4143-a45c-211463196803 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:59.190799 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d2f68d4d-9da3-4143-a45c-211463196803 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 200 len: 1473 microversion: 2.1 time: 0.290794 Sep 10 20:54:59.192655 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 930/1806] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:58 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 1473 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:59.206118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a1946fec-e2e6-4fce-a2e7-aa6a9c1bc70c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:59.206490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a1946fec-e2e6-4fce-a2e7-aa6a9c1bc70c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:59.216980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1946fec-e2e6-4fce-a2e7-aa6a9c1bc70c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:59.217707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1946fec-e2e6-4fce-a2e7-aa6a9c1bc70c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:59.218388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1946fec-e2e6-4fce-a2e7-aa6a9c1bc70c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:59.219170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1946fec-e2e6-4fce-a2e7-aa6a9c1bc70c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:59.219599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1946fec-e2e6-4fce-a2e7-aa6a9c1bc70c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:59.220165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a1946fec-e2e6-4fce-a2e7-aa6a9c1bc70c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:59.356614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ce8a98a1-e232-4c6f-8fa9-83e96827680b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:59.365672 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ce8a98a1-e232-4c6f-8fa9-83e96827680b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.455531 Sep 10 20:54:59.377809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a1946fec-e2e6-4fce-a2e7-aa6a9c1bc70c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:59.382851 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 877/1807] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:58 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:59.388848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f97c30b-3221-404f-98d6-2e9871aebcff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1459049457"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:59.390959 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a1946fec-e2e6-4fce-a2e7-aa6a9c1bc70c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 0.197415 Sep 10 20:54:59.391813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2f97c30b-3221-404f-98d6-2e9871aebcff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:59.392113 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 931/1808] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:59 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:59.398172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-73611778-9099-4c94-865c-beedfdf3563d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:59.398825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-73611778-9099-4c94-865c-beedfdf3563d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:59.400130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f97c30b-3221-404f-98d6-2e9871aebcff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:59.400684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f97c30b-3221-404f-98d6-2e9871aebcff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:59.401131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f97c30b-3221-404f-98d6-2e9871aebcff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:59.402812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f97c30b-3221-404f-98d6-2e9871aebcff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:59.403809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f97c30b-3221-404f-98d6-2e9871aebcff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:59.404251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f97c30b-3221-404f-98d6-2e9871aebcff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:59.406795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73611778-9099-4c94-865c-beedfdf3563d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:59.407726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73611778-9099-4c94-865c-beedfdf3563d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:59.408464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73611778-9099-4c94-865c-beedfdf3563d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:59.409215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73611778-9099-4c94-865c-beedfdf3563d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:59.409711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73611778-9099-4c94-865c-beedfdf3563d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:59.410366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73611778-9099-4c94-865c-beedfdf3563d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:59.631412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-73611778-9099-4c94-865c-beedfdf3563d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:54:59.634709 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f97c30b-3221-404f-98d6-2e9871aebcff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e/action" status: 202 len: 0 microversion: 2.1 time: 0.250261 Sep 10 20:54:59.635492 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 878/1809] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:54:59 2022] POST /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 20:54:59.641390 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-73611778-9099-4c94-865c-beedfdf3563d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.248049 Sep 10 20:54:59.642357 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 932/1810] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:54:59 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:59.647861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d7c1039-4aad-4a9d-befe-b0f0ac8e310d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944673040>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:59.703473 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d7c1039-4aad-4a9d-befe-b0f0ac8e310d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.059498 Sep 10 20:54:59.705218 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 879/1811] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:54:59 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:54:59.924070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:54:59.924921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:54:59.933048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:59.933868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:59.934708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:59.935607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:59.936130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:59.936854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:59.958864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-01515436-60ed-40dd-a633-ba92ff7e4fb6 req-3619455d-a1b3-49f6-9adb-a6aff3c0ab8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb73142-7fcb-44b4-8ff3-b7624fc5b494", "name": "network-vif-deleted", "tag": "9c462d3d-b794-4637-b520-7d89a1ddcec2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:54:59.981225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-01515436-60ed-40dd-a633-ba92ff7e4fb6 req-3619455d-a1b3-49f6-9adb-a6aff3c0ab8d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:54:59.982547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-01515436-60ed-40dd-a633-ba92ff7e4fb6 req-3619455d-a1b3-49f6-9adb-a6aff3c0ab8d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:54:59.983080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-01515436-60ed-40dd-a633-ba92ff7e4fb6 req-3619455d-a1b3-49f6-9adb-a6aff3c0ab8d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:54:59.997768 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-01515436-60ed-40dd-a633-ba92ff7e4fb6 req-3619455d-a1b3-49f6-9adb-a6aff3c0ab8d service nova] Creating event network-vif-deleted:9c462d3d-b794-4637-b520-7d89a1ddcec2 for instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 on nch2-master-1 Sep 10 20:55:00.003556 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-01515436-60ed-40dd-a633-ba92ff7e4fb6 req-3619455d-a1b3-49f6-9adb-a6aff3c0ab8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049227 Sep 10 20:55:00.004189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 880/1812] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:55:00.019135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:00.031413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:00.032497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:00.033785 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0c6723c6-afc7-450a-b23d-172c16956931 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1439 microversion: 2.25 time: 0.115147 Sep 10 20:55:00.034518 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 933/1813] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:54:59 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1439 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:00.390841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b9b61118-c05b-4cdf-8265-9863ea568e73 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:00.391661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b9b61118-c05b-4cdf-8265-9863ea568e73 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:00.398836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9b61118-c05b-4cdf-8265-9863ea568e73 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:00.399710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9b61118-c05b-4cdf-8265-9863ea568e73 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:00.400280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9b61118-c05b-4cdf-8265-9863ea568e73 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:00.401000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9b61118-c05b-4cdf-8265-9863ea568e73 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:00.401461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9b61118-c05b-4cdf-8265-9863ea568e73 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:00.401971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b9b61118-c05b-4cdf-8265-9863ea568e73 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:00.420784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-484317e0-9663-4f1c-8abc-da3df823c560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:00.421405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-484317e0-9663-4f1c-8abc-da3df823c560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:00.431091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484317e0-9663-4f1c-8abc-da3df823c560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:00.431091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484317e0-9663-4f1c-8abc-da3df823c560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:00.431091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484317e0-9663-4f1c-8abc-da3df823c560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:00.431091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484317e0-9663-4f1c-8abc-da3df823c560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:00.431517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484317e0-9663-4f1c-8abc-da3df823c560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:00.431821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-484317e0-9663-4f1c-8abc-da3df823c560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:00.576704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b9b61118-c05b-4cdf-8265-9863ea568e73 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:00.586153 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b9b61118-c05b-4cdf-8265-9863ea568e73 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.201170 Sep 10 20:55:00.587724 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 881/1814] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:00 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:00.602061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-484317e0-9663-4f1c-8abc-da3df823c560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:00.610079 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-484317e0-9663-4f1c-8abc-da3df823c560 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 0.194445 Sep 10 20:55:00.610925 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 934/1815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:00 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:00.667366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-de585bf7-4f97-4dcf-af7c-37611a5557a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:00.668606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-de585bf7-4f97-4dcf-af7c-37611a5557a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:00.675602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de585bf7-4f97-4dcf-af7c-37611a5557a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:00.676371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de585bf7-4f97-4dcf-af7c-37611a5557a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:00.676902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de585bf7-4f97-4dcf-af7c-37611a5557a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:00.677814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de585bf7-4f97-4dcf-af7c-37611a5557a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:00.678459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de585bf7-4f97-4dcf-af7c-37611a5557a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:00.679052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de585bf7-4f97-4dcf-af7c-37611a5557a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:00.724048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d5e96e98-ac11-46a6-81f7-8a97aeea1931 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99495d7670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:00.796017 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d5e96e98-ac11-46a6-81f7-8a97aeea1931 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.075881 Sep 10 20:55:00.796932 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 935/1816] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:00 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:00.868756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-de585bf7-4f97-4dcf-af7c-37611a5557a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:00.888700 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-de585bf7-4f97-4dcf-af7c-37611a5557a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.225438 Sep 10 20:55:00.889347 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 882/1817] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:00 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:01.063035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:01.064027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:01.074053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:01.074729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:01.075267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:01.076287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:01.077039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:01.077620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:01.084009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:01.160304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:01.176186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:01.177752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:01.179047 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5fe86ba7-0108-422a-81af-bea2aac57296 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 200 len: 1265 microversion: 2.25 time: 0.122437 Sep 10 20:55:01.186477 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 936/1818] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:01 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 1265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:01.611916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-36212dcf-a3b1-4d3b-94d9-b3a2a41cdd21 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:01.613343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-36212dcf-a3b1-4d3b-94d9-b3a2a41cdd21 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:01.634915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2196defa-27e8-4f07-a689-625e8d816264 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:01.635855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2196defa-27e8-4f07-a689-625e8d816264 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:01.641860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36212dcf-a3b1-4d3b-94d9-b3a2a41cdd21 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:01.642366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36212dcf-a3b1-4d3b-94d9-b3a2a41cdd21 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:01.642815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36212dcf-a3b1-4d3b-94d9-b3a2a41cdd21 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:01.645902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2196defa-27e8-4f07-a689-625e8d816264 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:01.646352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2196defa-27e8-4f07-a689-625e8d816264 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:01.646786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2196defa-27e8-4f07-a689-625e8d816264 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:01.647500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2196defa-27e8-4f07-a689-625e8d816264 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:01.647972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36212dcf-a3b1-4d3b-94d9-b3a2a41cdd21 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:01.648645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36212dcf-a3b1-4d3b-94d9-b3a2a41cdd21 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:01.649459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36212dcf-a3b1-4d3b-94d9-b3a2a41cdd21 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:01.657595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2196defa-27e8-4f07-a689-625e8d816264 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:01.658102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2196defa-27e8-4f07-a689-625e8d816264 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:01.924920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2196defa-27e8-4f07-a689-625e8d816264 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:01.934047 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2196defa-27e8-4f07-a689-625e8d816264 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 0.303188 Sep 10 20:55:01.936338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-36212dcf-a3b1-4d3b-94d9-b3a2a41cdd21 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:01.946281 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 937/1819] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:01 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:01.951504 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-36212dcf-a3b1-4d3b-94d9-b3a2a41cdd21 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.344599 Sep 10 20:55:01.952255 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 883/1820] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:01 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:01.955850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-881ffda7-6949-4f67-9ad4-222a798e07bc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99495d7670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:01.957114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-905b0fbf-7c49-461e-ad68-eb53ab97b12c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:01.957729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-905b0fbf-7c49-461e-ad68-eb53ab97b12c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:01.961380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:01.966962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905b0fbf-7c49-461e-ad68-eb53ab97b12c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:01.967702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905b0fbf-7c49-461e-ad68-eb53ab97b12c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:01.968326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905b0fbf-7c49-461e-ad68-eb53ab97b12c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:01.969261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905b0fbf-7c49-461e-ad68-eb53ab97b12c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:01.970011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905b0fbf-7c49-461e-ad68-eb53ab97b12c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:01.970659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-905b0fbf-7c49-461e-ad68-eb53ab97b12c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:02.017125 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-881ffda7-6949-4f67-9ad4-222a798e07bc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.069708 Sep 10 20:55:02.018086 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 938/1821] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:01 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:02.207333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:02.207978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: aeb73142-7fcb-44b4-8ff3-b7624fc5b494] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:02.222587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:02.223452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:02.223960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:02.225043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:02.231261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:02.233232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:02.260573 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] HTTP exception thrown: Instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 could not be found. Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Request method failure captured: Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 HTTP/1.1 Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgsePhEuWaZfVRlXkJ7w7wIqPxbC13U5IcxgKA6IcXX-web3gE55eKYDVEPfs3b2ZTohIRVE-S3MDLn-VvdMycJDKrc0B1Y6JhFGAPNbWBy14rOX9cSWbDmg0efA86Rq2MuvBcYRRjdwQHk9OGQzd1Zn8x2uukTEk_OlnKTUfRS2-o Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 89075fefc8ea47c78d4ff7364e12ffde Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89075fefc8ea47c78d4ff7364e12ffde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89075fefc8ea47c78d4ff7364e12ffde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89075fefc8ea47c78d4ff7364e12ffde", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89075fefc8ea47c78d4ff7364e12ffde"}]}] Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 89075fefc8ea47c78d4ff7364e12ffde Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-LiveAutoBlockMigrationV225Test-1800857620-project Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: dd431fc2d9834bea8df807edb91771ee Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620-project Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 could not be found. Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'aeb73142-7fcb-44b4-8ff3-b7624fc5b494'} Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 could not be found. Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 could not be found. Sep 10 20:55:02.264637 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:02.269615 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:02.269615 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:02.269615 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:02.269615 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:02.269615 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:02.269615 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:02.269615 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:02.269615 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 could not be found. Sep 10 20:55:02.269615 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:02.271764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Returning 404 to user: Instance aeb73142-7fcb-44b4-8ff3-b7624fc5b494 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:02.272847 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e698730c-a9c4-4c97-91f5-7c623222b76f tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494" status: 404 len: 111 microversion: 2.25 time: 0.069971 Sep 10 20:55:02.281802 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 939/1822] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:02 2022] GET /compute/v2.1/servers/aeb73142-7fcb-44b4-8ff3-b7624fc5b494 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:55:02.488630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-905b0fbf-7c49-461e-ad68-eb53ab97b12c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:02.491212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:02.505156 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-905b0fbf-7c49-461e-ad68-eb53ab97b12c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.548215 Sep 10 20:55:02.508800 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 884/1823] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:01 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:02.960014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35c7ef67-fcc8-4a69-b459-c2a18a24d97f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:02.960607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35c7ef67-fcc8-4a69-b459-c2a18a24d97f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:02.978629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35c7ef67-fcc8-4a69-b459-c2a18a24d97f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:02.979132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35c7ef67-fcc8-4a69-b459-c2a18a24d97f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:02.979786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35c7ef67-fcc8-4a69-b459-c2a18a24d97f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:02.980782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35c7ef67-fcc8-4a69-b459-c2a18a24d97f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:02.981449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35c7ef67-fcc8-4a69-b459-c2a18a24d97f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:02.982673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35c7ef67-fcc8-4a69-b459-c2a18a24d97f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:02.995401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d2ee112-6463-4c84-a3dd-6ed12ac25439 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:02.996319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d2ee112-6463-4c84-a3dd-6ed12ac25439 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:03.021734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2ee112-6463-4c84-a3dd-6ed12ac25439 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:03.023311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2ee112-6463-4c84-a3dd-6ed12ac25439 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:03.023941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2ee112-6463-4c84-a3dd-6ed12ac25439 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:03.024915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2ee112-6463-4c84-a3dd-6ed12ac25439 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:03.026834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2ee112-6463-4c84-a3dd-6ed12ac25439 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:03.029454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2ee112-6463-4c84-a3dd-6ed12ac25439 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:03.383384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9d2ee112-6463-4c84-a3dd-6ed12ac25439 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:03.402121 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d2ee112-6463-4c84-a3dd-6ed12ac25439 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1502 microversion: 2.1 time: 0.422546 Sep 10 20:55:03.404439 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 885/1824] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:02 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1502 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:03.411121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d5b5ea39-aa24-4e85-b4a4-bbac601bb14a tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944d35040>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:03.533595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35c7ef67-fcc8-4a69-b459-c2a18a24d97f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:03.554166 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35c7ef67-fcc8-4a69-b459-c2a18a24d97f tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 0.596493 Sep 10 20:55:03.556893 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 940/1825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:02 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:03.558553 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d5b5ea39-aa24-4e85-b4a4-bbac601bb14a tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.151802 Sep 10 20:55:03.559514 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 886/1826] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:03 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:03.566899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-34d78f31-3abc-4935-ab78-687733ae2d0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:03.567815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-34d78f31-3abc-4935-ab78-687733ae2d0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:03.576317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "812950cf-833e-48e3-a750-de030985afb4"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:03.582509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:03.591991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:03.592746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:03.593651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:03.594746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:03.595443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:03.596412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:03.608394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34d78f31-3abc-4935-ab78-687733ae2d0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:03.608909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34d78f31-3abc-4935-ab78-687733ae2d0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:03.609404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34d78f31-3abc-4935-ab78-687733ae2d0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:03.618494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34d78f31-3abc-4935-ab78-687733ae2d0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:03.619271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34d78f31-3abc-4935-ab78-687733ae2d0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:03.622406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34d78f31-3abc-4935-ab78-687733ae2d0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:03.656432 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] HTTP exception thrown: Cannot 'attach_volume' instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be while it is in vm_state rescued Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Request method failure captured: Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/os-volume_attachments HTTP/1.1 Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 74 Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPlIfEE6BUsYm6N9cc6J4sKvQx8zkdVi0_eGxve7idCE5St69TEoXloNJQbmDpLOYE4kW76RSsXwzH4ER5m-rWYbak-zkdFvTsFOuE5UWRW73UCQGyOtVDm5s0CSvgZ9e1C_-bLDziBI_eeTxSX1Lq4xDS48kCIhpdBe8v0QA9iMeLw Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4b1732129f3414fbc3f26fff6d039ec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4b1732129f3414fbc3f26fff6d039ec"}]}] Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d8b0a160808f4adda7be57cd535f0631 Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: {"volumeAttachment": {"volumeId": "812950cf-833e-48e3-a750-de030985afb4"}} Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: exception: Cannot 'attach_volume' instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be while it is in vm_state rescued Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'server_id': '5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be', 'body': {'volumeAttachment': {'volumeId': '812950cf-833e-48e3-a750-de030985afb4'}}} Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 10 20:55:03.664050 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be while it is in vm_state rescued Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be while it is in vm_state rescued Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Returning 409 to user: Cannot 'attach_volume' instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be while it is in vm_state rescued {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:03.671173 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ae9a2cd1-4899-417d-9aa2-6a42ee6062ee tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.111120 Sep 10 20:55:03.678062 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 941/1827] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 20:55:03 2022] POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/os-volume_attachments => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:55:03.682133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-50b1cd57-e903-498f-875a-e42608d9d0ae tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:03.692976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-50b1cd57-e903-498f-875a-e42608d9d0ae tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:03.722104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b1cd57-e903-498f-875a-e42608d9d0ae tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:03.726474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b1cd57-e903-498f-875a-e42608d9d0ae tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:03.727015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b1cd57-e903-498f-875a-e42608d9d0ae tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:03.728032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b1cd57-e903-498f-875a-e42608d9d0ae tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:03.728586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b1cd57-e903-498f-875a-e42608d9d0ae tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:03.729179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b1cd57-e903-498f-875a-e42608d9d0ae tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:03.780454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-50b1cd57-e903-498f-875a-e42608d9d0ae tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:55:03.928509 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-50b1cd57-e903-498f-875a-e42608d9d0ae tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 204 len: 0 microversion: 2.25 time: 0.253896 Sep 10 20:55:03.929994 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 942/1828] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:55:03 2022] DELETE /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:03.945054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8162e288-973d-4109-8e3f-9ab0a4f0c808 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:03.946382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8162e288-973d-4109-8e3f-9ab0a4f0c808 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:03.955170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-34d78f31-3abc-4935-ab78-687733ae2d0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:03.972913 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-34d78f31-3abc-4935-ab78-687733ae2d0c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.412031 Sep 10 20:55:03.974135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8162e288-973d-4109-8e3f-9ab0a4f0c808 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:03.977126 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 887/1829] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:03 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:03.977926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8162e288-973d-4109-8e3f-9ab0a4f0c808 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:03.978632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8162e288-973d-4109-8e3f-9ab0a4f0c808 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:03.982672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8162e288-973d-4109-8e3f-9ab0a4f0c808 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:03.983840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8162e288-973d-4109-8e3f-9ab0a4f0c808 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:03.984470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8162e288-973d-4109-8e3f-9ab0a4f0c808 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:04.002696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:04.003449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:04.032253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:04.032580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:04.035467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:04.041683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:04.046685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:04.049725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:04.182466 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8162e288-973d-4109-8e3f-9ab0a4f0c808 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action" status: 202 len: 0 microversion: 2.1 time: 0.250421 Sep 10 20:55:04.183919 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 943/1830] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:55:03 2022] POST /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:55:04.197921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3bda9a91-6132-44d8-aaaf-91dfe3d8a1db tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:04.199991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3bda9a91-6132-44d8-aaaf-91dfe3d8a1db tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:04.219449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bda9a91-6132-44d8-aaaf-91dfe3d8a1db tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:04.220565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bda9a91-6132-44d8-aaaf-91dfe3d8a1db tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:04.222702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bda9a91-6132-44d8-aaaf-91dfe3d8a1db tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:04.226310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bda9a91-6132-44d8-aaaf-91dfe3d8a1db tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:04.228134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bda9a91-6132-44d8-aaaf-91dfe3d8a1db tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:04.231060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bda9a91-6132-44d8-aaaf-91dfe3d8a1db tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:04.417266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:04.426589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:04.428338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:04.429535 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9c049bec-46bb-40d7-8805-9fc8f7173f70 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1731 microversion: 2.25 time: 0.449461 Sep 10 20:55:04.430124 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 888/1831] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:03 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1731 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:04.577929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5bc82179-1641-458f-bcac-ba1157f2fc2c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944673310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:04.584072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3bda9a91-6132-44d8-aaaf-91dfe3d8a1db tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:04.603632 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3bda9a91-6132-44d8-aaaf-91dfe3d8a1db tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1510 microversion: 2.1 time: 0.414472 Sep 10 20:55:04.604922 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 944/1832] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:04 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1510 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:04.613781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c228bfcf-8df9-4b3f-afed-5da306a57449 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:04.615026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c228bfcf-8df9-4b3f-afed-5da306a57449 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:04.637252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c228bfcf-8df9-4b3f-afed-5da306a57449 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:04.641441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c228bfcf-8df9-4b3f-afed-5da306a57449 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:04.644442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c228bfcf-8df9-4b3f-afed-5da306a57449 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:04.645447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c228bfcf-8df9-4b3f-afed-5da306a57449 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:04.646125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c228bfcf-8df9-4b3f-afed-5da306a57449 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:04.646573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c228bfcf-8df9-4b3f-afed-5da306a57449 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:04.676421 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5bc82179-1641-458f-bcac-ba1157f2fc2c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.105034 Sep 10 20:55:04.677757 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 889/1833] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:04 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:05.005042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fd3ff630-9ad7-4589-9546-331f2746c160 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:05.006887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fd3ff630-9ad7-4589-9546-331f2746c160 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:05.020462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3ff630-9ad7-4589-9546-331f2746c160 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:05.023178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3ff630-9ad7-4589-9546-331f2746c160 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:05.023824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3ff630-9ad7-4589-9546-331f2746c160 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:05.024764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3ff630-9ad7-4589-9546-331f2746c160 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:05.026479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3ff630-9ad7-4589-9546-331f2746c160 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:05.029039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3ff630-9ad7-4589-9546-331f2746c160 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:05.440055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fd3ff630-9ad7-4589-9546-331f2746c160 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:05.454379 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fd3ff630-9ad7-4589-9546-331f2746c160 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.452658 Sep 10 20:55:05.456235 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 890/1834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:04 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:05.463355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-7d174599-78c3-453f-b1e1-ee0147374926 req-ff9f1544-d255-43a2-8729-6b74c40bc229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372f952b-42c2-45e6-bb5c-5a2c37a2879e", "name": "network-vif-plugged", "status": "completed", "tag": "1719b8ff-bafb-42bb-8a8f-800f550eab35"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:05.477802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7d174599-78c3-453f-b1e1-ee0147374926 req-ff9f1544-d255-43a2-8729-6b74c40bc229 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:05.478905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7d174599-78c3-453f-b1e1-ee0147374926 req-ff9f1544-d255-43a2-8729-6b74c40bc229 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:05.479745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7d174599-78c3-453f-b1e1-ee0147374926 req-ff9f1544-d255-43a2-8729-6b74c40bc229 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:05.511535 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7d174599-78c3-453f-b1e1-ee0147374926 req-ff9f1544-d255-43a2-8729-6b74c40bc229 service nova] Creating event network-vif-plugged:1719b8ff-bafb-42bb-8a8f-800f550eab35 for instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e on nch2-master-1 Sep 10 20:55:05.520919 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-7d174599-78c3-453f-b1e1-ee0147374926 req-ff9f1544-d255-43a2-8729-6b74c40bc229 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062856 Sep 10 20:55:05.522086 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 891/1835] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:05.533260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:05.534611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:05.545788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:05.546810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:05.548528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:05.550260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:05.551168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:05.551887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:05.602042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c228bfcf-8df9-4b3f-afed-5da306a57449 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:05.612881 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c228bfcf-8df9-4b3f-afed-5da306a57449 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 1.006604 Sep 10 20:55:05.617803 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 945/1836] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:04 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:05.636471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a6eb2df6-81ce-4eda-a7c1-270681d79a14 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:05.637281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a6eb2df6-81ce-4eda-a7c1-270681d79a14 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:05.649543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6eb2df6-81ce-4eda-a7c1-270681d79a14 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:05.650297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6eb2df6-81ce-4eda-a7c1-270681d79a14 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:05.652594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6eb2df6-81ce-4eda-a7c1-270681d79a14 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:05.658427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6eb2df6-81ce-4eda-a7c1-270681d79a14 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:05.659006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6eb2df6-81ce-4eda-a7c1-270681d79a14 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:05.659525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6eb2df6-81ce-4eda-a7c1-270681d79a14 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:05.934443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:05.971224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:05.978696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:05.986781 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e22dc2ab-692d-4585-8284-5511d58d5fb5 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1731 microversion: 2.25 time: 0.459062 Sep 10 20:55:05.991555 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 892/1837] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:05 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1731 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:06.017886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f20c3b0d-ae5d-438e-99dc-1e2021736136 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99446730d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:06.065132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a6eb2df6-81ce-4eda-a7c1-270681d79a14 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:06.083251 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a6eb2df6-81ce-4eda-a7c1-270681d79a14 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1510 microversion: 2.1 time: 0.451651 Sep 10 20:55:06.094349 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 946/1838] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:05 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1510 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:06.151565 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f20c3b0d-ae5d-438e-99dc-1e2021736136 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.158259 Sep 10 20:55:06.152323 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 893/1839] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:05 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:06.488306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a223d9ed-469f-426b-8c4c-bc9015aaffe1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:06.489726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a223d9ed-469f-426b-8c4c-bc9015aaffe1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:06.495207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:06.506352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a223d9ed-469f-426b-8c4c-bc9015aaffe1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:06.508123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a223d9ed-469f-426b-8c4c-bc9015aaffe1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:06.509032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a223d9ed-469f-426b-8c4c-bc9015aaffe1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:06.510457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a223d9ed-469f-426b-8c4c-bc9015aaffe1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:06.511836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a223d9ed-469f-426b-8c4c-bc9015aaffe1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:06.513133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a223d9ed-469f-426b-8c4c-bc9015aaffe1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:07.136587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8a5dce88-138f-43e3-bf68-3c4dee937942 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:07.138482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8a5dce88-138f-43e3-bf68-3c4dee937942 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:07.169617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a5dce88-138f-43e3-bf68-3c4dee937942 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:07.170976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a5dce88-138f-43e3-bf68-3c4dee937942 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:07.171443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a5dce88-138f-43e3-bf68-3c4dee937942 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:07.173964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a5dce88-138f-43e3-bf68-3c4dee937942 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:07.176199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a5dce88-138f-43e3-bf68-3c4dee937942 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:07.176726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a5dce88-138f-43e3-bf68-3c4dee937942 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:07.200342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a223d9ed-469f-426b-8c4c-bc9015aaffe1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:07.219528 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a223d9ed-469f-426b-8c4c-bc9015aaffe1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.739951 Sep 10 20:55:07.224291 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 947/1840] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:06 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:07.254319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:07.255372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:07.259544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:07.267754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:07.268873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:07.269572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:07.270664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:07.272683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:07.273363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:07.646431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8a5dce88-138f-43e3-bf68-3c4dee937942 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:07.657014 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8a5dce88-138f-43e3-bf68-3c4dee937942 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 1.005689 Sep 10 20:55:07.660018 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 894/1841] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:06 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:07.672466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2713152a-3c6c-42d4-bbb1-721e59a99a9c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:07.679412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2713152a-3c6c-42d4-bbb1-721e59a99a9c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:07.694205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2713152a-3c6c-42d4-bbb1-721e59a99a9c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:07.696349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2713152a-3c6c-42d4-bbb1-721e59a99a9c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:07.697096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2713152a-3c6c-42d4-bbb1-721e59a99a9c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:07.699147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2713152a-3c6c-42d4-bbb1-721e59a99a9c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:07.700313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2713152a-3c6c-42d4-bbb1-721e59a99a9c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:07.700987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2713152a-3c6c-42d4-bbb1-721e59a99a9c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:07.796562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:07.822032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:07.824470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:07.825707 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-46f433c4-0c46-424d-9c2a-1ce907bd11c9 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1731 microversion: 2.25 time: 0.583827 Sep 10 20:55:07.826517 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 948/1842] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:07 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1731 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:07.848703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9ebc929e-af21-493e-84e8-3440c66d2101 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9949566e50>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:07.965649 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9ebc929e-af21-493e-84e8-3440c66d2101 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.136531 Sep 10 20:55:07.978347 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 949/1843] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:07 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:08.256708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8c73b592-bc3f-4d71-85b8-89233046cccb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:08.257624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8c73b592-bc3f-4d71-85b8-89233046cccb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:08.281166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c73b592-bc3f-4d71-85b8-89233046cccb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:08.283397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c73b592-bc3f-4d71-85b8-89233046cccb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:08.284786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c73b592-bc3f-4d71-85b8-89233046cccb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:08.289623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c73b592-bc3f-4d71-85b8-89233046cccb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:08.290522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c73b592-bc3f-4d71-85b8-89233046cccb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:08.293553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8c73b592-bc3f-4d71-85b8-89233046cccb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:08.895806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8c73b592-bc3f-4d71-85b8-89233046cccb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:08.921438 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8c73b592-bc3f-4d71-85b8-89233046cccb tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.668851 Sep 10 20:55:08.925674 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 950/1844] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:08 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:08.933206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2713152a-3c6c-42d4-bbb1-721e59a99a9c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:08.943679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f42ff27f-d622-4075-a39d-337d72f91fd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:08.953605 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2713152a-3c6c-42d4-bbb1-721e59a99a9c tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1510 microversion: 2.1 time: 1.288335 Sep 10 20:55:08.955699 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 895/1845] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:07 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1510 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:08.959690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f42ff27f-d622-4075-a39d-337d72f91fd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:08.973640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-9a124bb0-1aed-4e39-a7f2-f989ccdbf318 req-fff69766-4396-4096-99b6-12f3c999fe22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd11ff4-6dda-414d-ab81-111f4762df68", "name": "network-vif-deleted", "tag": "b0683ab4-3a9c-4ccd-816b-b8815b507ac5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:08.991301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f42ff27f-d622-4075-a39d-337d72f91fd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:08.994495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f42ff27f-d622-4075-a39d-337d72f91fd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:09.001390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f42ff27f-d622-4075-a39d-337d72f91fd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:09.003279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f42ff27f-d622-4075-a39d-337d72f91fd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:09.003943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f42ff27f-d622-4075-a39d-337d72f91fd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:09.006355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f42ff27f-d622-4075-a39d-337d72f91fd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:09.016003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9a124bb0-1aed-4e39-a7f2-f989ccdbf318 req-fff69766-4396-4096-99b6-12f3c999fe22 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:09.017492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9a124bb0-1aed-4e39-a7f2-f989ccdbf318 req-fff69766-4396-4096-99b6-12f3c999fe22 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:09.020436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9a124bb0-1aed-4e39-a7f2-f989ccdbf318 req-fff69766-4396-4096-99b6-12f3c999fe22 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:09.060131 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-9a124bb0-1aed-4e39-a7f2-f989ccdbf318 req-fff69766-4396-4096-99b6-12f3c999fe22 service nova] Creating event network-vif-deleted:b0683ab4-3a9c-4ccd-816b-b8815b507ac5 for instance 3cd11ff4-6dda-414d-ab81-111f4762df68 on nch1-master-1 Sep 10 20:55:09.073134 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-9a124bb0-1aed-4e39-a7f2-f989ccdbf318 req-fff69766-4396-4096-99b6-12f3c999fe22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114165 Sep 10 20:55:09.077732 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 896/1846] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:09.098792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:09.106591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:09.118387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:09.119400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:09.120039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:09.121692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:09.127125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:09.127995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:09.185602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:09.186486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:09.187187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:09.187820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lazy-loading 'fault' on Instance uuid 3cd11ff4-6dda-414d-ab81-111f4762df68 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:09.306994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f42ff27f-d622-4075-a39d-337d72f91fd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:09.320521 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f42ff27f-d622-4075-a39d-337d72f91fd6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 0.392296 Sep 10 20:55:09.322440 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 951/1847] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:08 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:09.345964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ceacd3f9-a54a-423d-810d-23beb8a4158f req-976a3c35-2093-47e1-9249-590239274b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3b5948-c5f9-4841-8444-c81ba0f96631", "name": "network-vif-unplugged", "status": "completed", "tag": "0a697059-7bd3-4f8e-a53a-ab17edf98c1f"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:09.353076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:09.359633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ceacd3f9-a54a-423d-810d-23beb8a4158f req-976a3c35-2093-47e1-9249-590239274b56 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:09.360554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ceacd3f9-a54a-423d-810d-23beb8a4158f req-976a3c35-2093-47e1-9249-590239274b56 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:09.361355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ceacd3f9-a54a-423d-810d-23beb8a4158f req-976a3c35-2093-47e1-9249-590239274b56 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:09.368000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:09.373992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:09.375277 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f5ad1b49-15b9-4fe3-a2ec-cc971d6a0a34 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1375 microversion: 2.25 time: 0.296088 Sep 10 20:55:09.376612 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 897/1848] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:09 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1375 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:09.425142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e8504657-01f7-4e3d-a51e-d8b1a30905bf tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994462a670>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:09.451044 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ceacd3f9-a54a-423d-810d-23beb8a4158f req-976a3c35-2093-47e1-9249-590239274b56 service nova] Creating event network-vif-unplugged:0a697059-7bd3-4f8e-a53a-ab17edf98c1f for instance eb3b5948-c5f9-4841-8444-c81ba0f96631 on nch1-master-1 Sep 10 20:55:09.456833 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ceacd3f9-a54a-423d-810d-23beb8a4158f req-976a3c35-2093-47e1-9249-590239274b56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115383 Sep 10 20:55:09.459951 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 952/1849] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:09.538072 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e8504657-01f7-4e3d-a51e-d8b1a30905bf tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.121407 Sep 10 20:55:09.538964 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 898/1850] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:09 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:09.955810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e293dff8-5fc0-4249-acc1-4e5bcda12bbe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:09.957444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e293dff8-5fc0-4249-acc1-4e5bcda12bbe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:09.991108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e293dff8-5fc0-4249-acc1-4e5bcda12bbe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:09.991621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e293dff8-5fc0-4249-acc1-4e5bcda12bbe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:09.992094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e293dff8-5fc0-4249-acc1-4e5bcda12bbe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:09.992832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e293dff8-5fc0-4249-acc1-4e5bcda12bbe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:09.993295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e293dff8-5fc0-4249-acc1-4e5bcda12bbe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:09.993767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e293dff8-5fc0-4249-acc1-4e5bcda12bbe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:09.997293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ff4ff827-d935-4618-8cb2-f35c7b51e6d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:09.998562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ff4ff827-d935-4618-8cb2-f35c7b51e6d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:10.013964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff4ff827-d935-4618-8cb2-f35c7b51e6d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:10.015650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff4ff827-d935-4618-8cb2-f35c7b51e6d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:10.016610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff4ff827-d935-4618-8cb2-f35c7b51e6d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:10.017805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff4ff827-d935-4618-8cb2-f35c7b51e6d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:10.018650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff4ff827-d935-4618-8cb2-f35c7b51e6d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:10.019674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff4ff827-d935-4618-8cb2-f35c7b51e6d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:10.330778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e293dff8-5fc0-4249-acc1-4e5bcda12bbe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:10.340450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:10.366737 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e293dff8-5fc0-4249-acc1-4e5bcda12bbe tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.414930 Sep 10 20:55:10.389696 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 953/1851] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:09 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:10.400989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cec2b929-77c5-485b-9227-28d2248b39ea tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:10.405435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cec2b929-77c5-485b-9227-28d2248b39ea tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:10.440360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cec2b929-77c5-485b-9227-28d2248b39ea tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:10.446990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cec2b929-77c5-485b-9227-28d2248b39ea tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:10.447709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cec2b929-77c5-485b-9227-28d2248b39ea tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:10.451997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cec2b929-77c5-485b-9227-28d2248b39ea tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:10.452495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cec2b929-77c5-485b-9227-28d2248b39ea tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:10.452950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cec2b929-77c5-485b-9227-28d2248b39ea tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:10.592152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ff4ff827-d935-4618-8cb2-f35c7b51e6d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:10.609700 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ff4ff827-d935-4618-8cb2-f35c7b51e6d4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1516 microversion: 2.1 time: 0.626073 Sep 10 20:55:10.614167 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 899/1852] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:09 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1516 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:10.628151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:10.629342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:10.666031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:10.671876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:10.672785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:10.675068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:10.675951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:10.677456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:10.806621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:10.813371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:10.814014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:10.814689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lazy-loading 'fault' on Instance uuid 3cd11ff4-6dda-414d-ab81-111f4762df68 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:11.048779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:11.070433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:11.082155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:11.096079 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae004e68-238b-4bf6-8bdc-fe246c934e41 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 200 len: 1375 microversion: 2.25 time: 0.470444 Sep 10 20:55:11.101075 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 900/1853] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:10 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 1375 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:11.126123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-773bdb8d-852e-4d07-b0f0-8162cbc254c6 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994462a820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:11.262713 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-773bdb8d-852e-4d07-b0f0-8162cbc254c6 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.155487 Sep 10 20:55:11.274624 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 901/1854] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:11 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:11.404537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5ae05938-c85a-455b-bdae-70d36208f0b3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:11.406659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5ae05938-c85a-455b-bdae-70d36208f0b3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:11.422298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae05938-c85a-455b-bdae-70d36208f0b3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:11.423256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae05938-c85a-455b-bdae-70d36208f0b3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:11.425007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae05938-c85a-455b-bdae-70d36208f0b3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:11.427529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae05938-c85a-455b-bdae-70d36208f0b3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:11.428666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae05938-c85a-455b-bdae-70d36208f0b3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:11.429974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ae05938-c85a-455b-bdae-70d36208f0b3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:11.573432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cec2b929-77c5-485b-9227-28d2248b39ea tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:11.586164 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cec2b929-77c5-485b-9227-28d2248b39ea tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 1.194782 Sep 10 20:55:11.603338 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 954/1855] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:10 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:11.626056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-260a707f-bd27-4fd8-8c7a-c082f1154893 req-dce60de2-bc52-4767-a046-7235589df0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3b5948-c5f9-4841-8444-c81ba0f96631", "tag": "0a697059-7bd3-4f8e-a53a-ab17edf98c1f"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:11.648488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-260a707f-bd27-4fd8-8c7a-c082f1154893 req-dce60de2-bc52-4767-a046-7235589df0d7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:11.653908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-260a707f-bd27-4fd8-8c7a-c082f1154893 req-dce60de2-bc52-4767-a046-7235589df0d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:11.654541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-260a707f-bd27-4fd8-8c7a-c082f1154893 req-dce60de2-bc52-4767-a046-7235589df0d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:11.684679 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-260a707f-bd27-4fd8-8c7a-c082f1154893 req-dce60de2-bc52-4767-a046-7235589df0d7 service nova] Creating event network-changed:0a697059-7bd3-4f8e-a53a-ab17edf98c1f for instance eb3b5948-c5f9-4841-8444-c81ba0f96631 on nch1-master-1 Sep 10 20:55:11.700519 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-260a707f-bd27-4fd8-8c7a-c082f1154893 req-dce60de2-bc52-4767-a046-7235589df0d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078490 Sep 10 20:55:11.705377 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 955/1856] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:11.868632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5ae05938-c85a-455b-bdae-70d36208f0b3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:11.882487 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5ae05938-c85a-455b-bdae-70d36208f0b3 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.493830 Sep 10 20:55:11.883408 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 902/1857] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:11 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:12.131177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:12.132379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 3cd11ff4-6dda-414d-ab81-111f4762df68] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:12.143264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:12.144049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:12.144767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:12.146467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:12.147704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:12.149504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:12.186008 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] HTTP exception thrown: Instance 3cd11ff4-6dda-414d-ab81-111f4762df68 could not be found. Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Request method failure captured: Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 HTTP/1.1 Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgsePhEuWaZfVRlXkJ7w7wIqPxbC13U5IcxgKA6IcXX-web3gE55eKYDVEPfs3b2ZTohIRVE-S3MDLn-VvdMycJDKrc0B1Y6JhFGAPNbWBy14rOX9cSWbDmg0efA86Rq2MuvBcYRRjdwQHk9OGQzd1Zn8x2uukTEk_OlnKTUfRS2-o Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 89075fefc8ea47c78d4ff7364e12ffde Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89075fefc8ea47c78d4ff7364e12ffde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89075fefc8ea47c78d4ff7364e12ffde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89075fefc8ea47c78d4ff7364e12ffde", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89075fefc8ea47c78d4ff7364e12ffde"}]}] Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 89075fefc8ea47c78d4ff7364e12ffde Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-LiveAutoBlockMigrationV225Test-1800857620-project Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: dd431fc2d9834bea8df807edb91771ee Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620-project Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 3cd11ff4-6dda-414d-ab81-111f4762df68 could not be found. Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '3cd11ff4-6dda-414d-ab81-111f4762df68'} Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd11ff4-6dda-414d-ab81-111f4762df68 could not be found. Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd11ff4-6dda-414d-ab81-111f4762df68 could not be found. Sep 10 20:55:12.188051 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:12.192726 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:12.192726 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:12.192726 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:12.192726 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:12.192726 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:12.192726 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:12.192726 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:12.192726 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd11ff4-6dda-414d-ab81-111f4762df68 could not be found. Sep 10 20:55:12.192726 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:12.199599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Returning 404 to user: Instance 3cd11ff4-6dda-414d-ab81-111f4762df68 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:12.200941 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f6a77ce0-bbef-46e2-aebc-31107f336694 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68" status: 404 len: 111 microversion: 2.25 time: 0.074830 Sep 10 20:55:12.212147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-48d67857-08ba-403c-976f-b3d4826258f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '.version_select at 0x7f9944654700>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:12.213180 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 956/1858] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:12 2022] GET /compute/v2.1/servers/3cd11ff4-6dda-414d-ab81-111f4762df68 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:55:12.244303 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-48d67857-08ba-403c-976f-b3d4826258f1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885927030" status: 204 len: 0 microversion: 2.25 time: 0.037212 Sep 10 20:55:12.248328 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 903/1859] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:55:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885927030 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:12.283169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5fa2036f-2e5c-451a-8737-35ee6adb38af tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9949578820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:12.373650 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5fa2036f-2e5c-451a-8737-35ee6adb38af tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.095903 Sep 10 20:55:12.375288 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 957/1860] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:12 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:12.493729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-82104b1d-6b62-4af9-8e96-18ecd60c308b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'create', calling method: .version_select at 0x7f99445eaf70>, body: {"keypair": {"name": "tempest-keypair-623379754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ5j+hWoLqyGdFVzsSpd3D1z2IXyLuE78rBiNaEpeKzeAG2Q5aEpm/xCW+VypVJskBi4TdW0+laH+b1+gD9ZiBWfVfnet4nFoNjO2ygM4XWY/Wvpwkd1JhVWcYf4pEStw=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:12.516328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-82104b1d-6b62-4af9-8e96-18ecd60c308b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Getting quotas for project f4b1732129f3414fbc3f26fff6d039ec. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:55:12.523204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-82104b1d-6b62-4af9-8e96-18ecd60c308b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Getting quotas for user d8b0a160808f4adda7be57cd535f0631 and project f4b1732129f3414fbc3f26fff6d039ec. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:55:12.564818 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-82104b1d-6b62-4af9-8e96-18ecd60c308b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075150 Sep 10 20:55:12.566296 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 904/1861] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:55:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:12.618184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2918edc4-a153-4a91-914f-2798117bb827 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:12.619697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2918edc4-a153-4a91-914f-2798117bb827 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:12.643477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2918edc4-a153-4a91-914f-2798117bb827 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:12.643908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2918edc4-a153-4a91-914f-2798117bb827 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:12.644764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2918edc4-a153-4a91-914f-2798117bb827 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:12.646262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2918edc4-a153-4a91-914f-2798117bb827 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:12.647556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2918edc4-a153-4a91-914f-2798117bb827 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:12.648234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2918edc4-a153-4a91-914f-2798117bb827 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:12.898363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2918edc4-a153-4a91-914f-2798117bb827 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:12.909651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3ddbb1b4-fc8e-4d0d-af5d-c8344e9d81da tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:12.920573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3ddbb1b4-fc8e-4d0d-af5d-c8344e9d81da tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:12.920573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ddbb1b4-fc8e-4d0d-af5d-c8344e9d81da tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:12.921297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ddbb1b4-fc8e-4d0d-af5d-c8344e9d81da tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:12.922149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ddbb1b4-fc8e-4d0d-af5d-c8344e9d81da tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:12.925762 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2918edc4-a153-4a91-914f-2798117bb827 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 0.312884 Sep 10 20:55:12.926229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ddbb1b4-fc8e-4d0d-af5d-c8344e9d81da tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:12.926744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ddbb1b4-fc8e-4d0d-af5d-c8344e9d81da tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:12.927192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ddbb1b4-fc8e-4d0d-af5d-c8344e9d81da tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:12.937509 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 958/1862] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:12 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:13.204291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-384136547", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "ba85a6cf-7e68-4cc3-a462-83f10cee0137"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:13.356929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] validate_networks() for [('ba85a6cf-7e68-4cc3-a462-83f10cee0137', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:55:13.461709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3ddbb1b4-fc8e-4d0d-af5d-c8344e9d81da tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:13.476516 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3ddbb1b4-fc8e-4d0d-af5d-c8344e9d81da tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.572070 Sep 10 20:55:13.504897 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 905/1863] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:12 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:13.525745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6d8335dd-13d8-46db-8d82-da29f4beeba6 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99445ea310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:13.607460 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6d8335dd-13d8-46db-8d82-da29f4beeba6 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.101277 Sep 10 20:55:13.609373 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 906/1864] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:13 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:13.962610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d95f1c5b-921f-42cc-ba0d-be5f94ffd799 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:13.963618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d95f1c5b-921f-42cc-ba0d-be5f94ffd799 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:13.998689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d95f1c5b-921f-42cc-ba0d-be5f94ffd799 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:13.999202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d95f1c5b-921f-42cc-ba0d-be5f94ffd799 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:14.004709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d95f1c5b-921f-42cc-ba0d-be5f94ffd799 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:14.005627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d95f1c5b-921f-42cc-ba0d-be5f94ffd799 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:14.007914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d95f1c5b-921f-42cc-ba0d-be5f94ffd799 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:14.008399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d95f1c5b-921f-42cc-ba0d-be5f94ffd799 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:14.177565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:55:14.178769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:55:14.179452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:55:14.180099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:55:14.180684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:55:14.193312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:14.194251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:14.194972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:14.195918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:14.196572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:14.197180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:14.223898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Getting quotas for project fcd2501efc564e63834afc0a474d486d. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:55:14.231721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Getting quotas for user a7130068051c4688a7759ccbfbb134a9 and project fcd2501efc564e63834afc0a474d486d. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:55:14.247228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:55:14.250158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:55:14.331254 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4aed16a5-6286-43dc-8ea7-1221782b1a8b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.289319 Sep 10 20:55:14.334030 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 959/1865] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:55:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 20:55:14.346519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-813acdf2-37f6-4253-80f2-a8d8912db3f6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:14.348944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-813acdf2-37f6-4253-80f2-a8d8912db3f6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:14.469896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-813acdf2-37f6-4253-80f2-a8d8912db3f6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:14.483435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-813acdf2-37f6-4253-80f2-a8d8912db3f6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:14.490366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-813acdf2-37f6-4253-80f2-a8d8912db3f6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:14.491994 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-813acdf2-37f6-4253-80f2-a8d8912db3f6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1261 microversion: 2.26 time: 0.149851 Sep 10 20:55:14.492918 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 960/1866] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:14 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:14.503602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ca38bfe9-a9ce-4538-8511-3d9c3fd7fdc4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:14.506599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ca38bfe9-a9ce-4538-8511-3d9c3fd7fdc4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:14.528498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca38bfe9-a9ce-4538-8511-3d9c3fd7fdc4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:14.528757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca38bfe9-a9ce-4538-8511-3d9c3fd7fdc4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:14.529255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca38bfe9-a9ce-4538-8511-3d9c3fd7fdc4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:14.530094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca38bfe9-a9ce-4538-8511-3d9c3fd7fdc4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:14.530559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca38bfe9-a9ce-4538-8511-3d9c3fd7fdc4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:14.531042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca38bfe9-a9ce-4538-8511-3d9c3fd7fdc4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:14.820536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ca38bfe9-a9ce-4538-8511-3d9c3fd7fdc4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:14.840833 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ca38bfe9-a9ce-4538-8511-3d9c3fd7fdc4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.340671 Sep 10 20:55:14.841419 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 961/1867] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:14 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:14.871199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ef559547-41df-4813-98e5-71adc7442d2c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994958f160>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:14.947121 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ef559547-41df-4813-98e5-71adc7442d2c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.081504 Sep 10 20:55:14.961129 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 962/1868] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:14 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:15.107237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-94de54c6-01c7-40f5-936c-e417f61636a0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:15.107237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-94de54c6-01c7-40f5-936c-e417f61636a0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:15.145290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94de54c6-01c7-40f5-936c-e417f61636a0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:15.148778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94de54c6-01c7-40f5-936c-e417f61636a0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:15.151084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94de54c6-01c7-40f5-936c-e417f61636a0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:15.156537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94de54c6-01c7-40f5-936c-e417f61636a0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:15.158507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94de54c6-01c7-40f5-936c-e417f61636a0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:15.159380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94de54c6-01c7-40f5-936c-e417f61636a0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:15.252206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-94de54c6-01c7-40f5-936c-e417f61636a0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:55:15.439674 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-94de54c6-01c7-40f5-936c-e417f61636a0 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 204 len: 0 microversion: 2.25 time: 0.339161 Sep 10 20:55:15.440637 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 963/1869] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:55:15 2022] DELETE /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 20:55:15.461945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d95f1c5b-921f-42cc-ba0d-be5f94ffd799 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:15.472633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:15.481567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:15.488933 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d95f1c5b-921f-42cc-ba0d-be5f94ffd799 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 1.535026 Sep 10 20:55:15.492549 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 907/1870] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:13 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:15.501344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:15.505494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:15.507351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:15.508272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:15.515485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:15.518467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:15.528254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:15.529172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:15.561200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:15.562261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:15.563267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:15.568200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:15.569026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:15.570803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:15.866615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:15.878296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:15.887140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:15.888953 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-95b51043-ce02-4fa0-a3d7-e027f7060480 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1548 microversion: 2.25 time: 0.444067 Sep 10 20:55:15.892712 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 964/1871] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:15 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1548 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:15.898288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-431d2605-1b7c-4770-8cfe-b3f794650c5d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:15.899119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-431d2605-1b7c-4770-8cfe-b3f794650c5d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:15.906901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-431d2605-1b7c-4770-8cfe-b3f794650c5d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:15.907595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-431d2605-1b7c-4770-8cfe-b3f794650c5d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:15.908211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-431d2605-1b7c-4770-8cfe-b3f794650c5d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:15.909183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-431d2605-1b7c-4770-8cfe-b3f794650c5d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:15.910004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-431d2605-1b7c-4770-8cfe-b3f794650c5d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:15.911407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-431d2605-1b7c-4770-8cfe-b3f794650c5d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:16.109168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:16.161067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:16.169630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:16.171013 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-17c12325-1c37-413b-b52c-7c1b47048ca0 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1257 microversion: 2.26 time: 0.649412 Sep 10 20:55:16.178047 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 908/1872] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:15 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1257 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:55:16.210410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-416d836b-a977-4a84-9aea-1d17ca94d084 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99445eab80>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:16.294133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-431d2605-1b7c-4770-8cfe-b3f794650c5d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:16.316230 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-431d2605-1b7c-4770-8cfe-b3f794650c5d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.419219 Sep 10 20:55:16.317210 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 965/1873] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:15 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:16.359801 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-416d836b-a977-4a84-9aea-1d17ca94d084 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.179930 Sep 10 20:55:16.360380 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 909/1874] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:16 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:16.523872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2d1f3676-a2d7-4916-991b-317178a06b0e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:16.525134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2d1f3676-a2d7-4916-991b-317178a06b0e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:16.575824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d1f3676-a2d7-4916-991b-317178a06b0e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:16.579289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d1f3676-a2d7-4916-991b-317178a06b0e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:16.582986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d1f3676-a2d7-4916-991b-317178a06b0e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:16.585513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d1f3676-a2d7-4916-991b-317178a06b0e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:16.587773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d1f3676-a2d7-4916-991b-317178a06b0e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:16.594540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d1f3676-a2d7-4916-991b-317178a06b0e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:16.927160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:16.927807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:16.944445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:16.947081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:16.948318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:16.955699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:16.957073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:16.957764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:17.344501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2d1f3676-a2d7-4916-991b-317178a06b0e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:17.362099 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2d1f3676-a2d7-4916-991b-317178a06b0e tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 0.844555 Sep 10 20:55:17.370950 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 966/1875] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:16 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:17.379476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:17.380104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:17.409488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:17.410056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:17.410487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:17.411415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:17.411651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:17.422237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:17.821686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:17.831783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:17.849423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:17.851238 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0f0f72ce-7050-4adb-b47a-72285f011e50 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1331 microversion: 2.26 time: 0.481118 Sep 10 20:55:17.862528 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 967/1876] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:17 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1331 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:17.875569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-380d3b13-230a-49e2-ba80-a1470b8268db tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:17.876762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-380d3b13-230a-49e2-ba80-a1470b8268db tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:17.893657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-380d3b13-230a-49e2-ba80-a1470b8268db tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:17.894654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-380d3b13-230a-49e2-ba80-a1470b8268db tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:17.896667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-380d3b13-230a-49e2-ba80-a1470b8268db tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:17.898899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-380d3b13-230a-49e2-ba80-a1470b8268db tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:17.900046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-380d3b13-230a-49e2-ba80-a1470b8268db tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:17.901232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-380d3b13-230a-49e2-ba80-a1470b8268db tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:18.123016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:18.139721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:18.141170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:18.145674 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-586fdc4d-98d6-48f5-9bab-60690d9a709b tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 200 len: 1548 microversion: 2.25 time: 1.224957 Sep 10 20:55:18.149855 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 910/1877] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:16 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 1548 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:18.165541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8d5c88cd-3515-4a19-9202-b35fac535b53 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99445eaa60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:18.256775 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8d5c88cd-3515-4a19-9202-b35fac535b53 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.105483 Sep 10 20:55:18.257362 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 911/1878] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:18 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:18.267446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a5b0906d-cb6d-4e0b-828b-ccc18a0b5195 req-0c461248-74a9-4baa-a639-94dfeaa43d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e", "name": "network-vif-deleted", "tag": "185a5cc6-4ac2-4e93-b345-1aad5abefc23"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:18.268324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-380d3b13-230a-49e2-ba80-a1470b8268db tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:18.281008 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-380d3b13-230a-49e2-ba80-a1470b8268db tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.414608 Sep 10 20:55:18.282426 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 968/1879] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:17 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:18.306073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a5b0906d-cb6d-4e0b-828b-ccc18a0b5195 req-0c461248-74a9-4baa-a639-94dfeaa43d7e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:18.306562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a5b0906d-cb6d-4e0b-828b-ccc18a0b5195 req-0c461248-74a9-4baa-a639-94dfeaa43d7e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:18.311959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a5b0906d-cb6d-4e0b-828b-ccc18a0b5195 req-0c461248-74a9-4baa-a639-94dfeaa43d7e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:18.328172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:18.337913 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a5b0906d-cb6d-4e0b-828b-ccc18a0b5195 req-0c461248-74a9-4baa-a639-94dfeaa43d7e service nova] Creating event network-vif-deleted:185a5cc6-4ac2-4e93-b345-1aad5abefc23 for instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e on nch1-master-1 Sep 10 20:55:18.357026 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a5b0906d-cb6d-4e0b-828b-ccc18a0b5195 req-0c461248-74a9-4baa-a639-94dfeaa43d7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097191 Sep 10 20:55:18.358323 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 912/1880] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:18.395413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e532c35-56fd-4bcb-988f-1cb9611727b3 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:18.396045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e532c35-56fd-4bcb-988f-1cb9611727b3 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:18.415710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e532c35-56fd-4bcb-988f-1cb9611727b3 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:18.416598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e532c35-56fd-4bcb-988f-1cb9611727b3 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:18.422739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e532c35-56fd-4bcb-988f-1cb9611727b3 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:18.426932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e532c35-56fd-4bcb-988f-1cb9611727b3 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:18.433335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e532c35-56fd-4bcb-988f-1cb9611727b3 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:18.434744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e532c35-56fd-4bcb-988f-1cb9611727b3 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:18.751836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1e532c35-56fd-4bcb-988f-1cb9611727b3 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:18.762800 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e532c35-56fd-4bcb-988f-1cb9611727b3 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 0.374372 Sep 10 20:55:18.763942 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 969/1881] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:18 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:18.896846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:18.897551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:18.920200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:18.920722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:18.921168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:18.921918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:18.922586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:18.923211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:19.116950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:19.134416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:19.147459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:19.149997 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fb786f71-8568-4546-88ef-9b7e12887401 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1319 microversion: 2.26 time: 0.257570 Sep 10 20:55:19.154130 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 913/1882] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:18 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:19.177397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:19.178164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:19.189139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:19.194277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:19.195764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:19.200595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:19.201714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:19.202670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:19.239586 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] HTTP exception thrown: Instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e could not be found. Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Request method failure captured: Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e HTTP/1.1 Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPgsePhEuWaZfVRlXkJ7w7wIqPxbC13U5IcxgKA6IcXX-web3gE55eKYDVEPfs3b2ZTohIRVE-S3MDLn-VvdMycJDKrc0B1Y6JhFGAPNbWBy14rOX9cSWbDmg0efA86Rq2MuvBcYRRjdwQHk9OGQzd1Zn8x2uukTEk_OlnKTUfRS2-o Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 89075fefc8ea47c78d4ff7364e12ffde Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89075fefc8ea47c78d4ff7364e12ffde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89075fefc8ea47c78d4ff7364e12ffde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89075fefc8ea47c78d4ff7364e12ffde", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89075fefc8ea47c78d4ff7364e12ffde"}]}] Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 89075fefc8ea47c78d4ff7364e12ffde Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-LiveAutoBlockMigrationV225Test-1800857620-project Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: dd431fc2d9834bea8df807edb91771ee Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620-project Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e could not be found. Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e'} Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e could not be found. Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e could not be found. Sep 10 20:55:19.241364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e could not be found. Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Returning 404 to user: Instance f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3b0eeef5-cddd-4327-95a5-9257816c64b3 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e" status: 404 len: 111 microversion: 2.25 time: 0.069872 Sep 10 20:55:19.251438 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 970/1883] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:19 2022] GET /compute/v2.1/servers/f8348f1f-5f8d-4720-8b93-f5eb1f9bcc1e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:55:19.255857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23ec82e3-b7ad-41e5-97af-3c4c3333c675 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:19.256640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23ec82e3-b7ad-41e5-97af-3c4c3333c675 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:19.264751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23ec82e3-b7ad-41e5-97af-3c4c3333c675 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:19.265683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23ec82e3-b7ad-41e5-97af-3c4c3333c675 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:19.266461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23ec82e3-b7ad-41e5-97af-3c4c3333c675 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:19.274152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-260171c3-7c78-4d10-8d74-cca57c41f5f6 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9949565ca0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:19.279242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23ec82e3-b7ad-41e5-97af-3c4c3333c675 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:19.280056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23ec82e3-b7ad-41e5-97af-3c4c3333c675 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:19.280889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23ec82e3-b7ad-41e5-97af-3c4c3333c675 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:19.341074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23ec82e3-b7ad-41e5-97af-3c4c3333c675 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:55:19.383610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-260171c3-7c78-4d10-8d74-cca57c41f5f6 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.114198 Sep 10 20:55:19.384825 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 971/1884] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:19 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:19.401031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-38b3b0f7-5f7a-4e86-adbe-313ac820951e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:19.405892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-38b3b0f7-5f7a-4e86-adbe-313ac820951e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:19.420154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38b3b0f7-5f7a-4e86-adbe-313ac820951e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:19.423938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38b3b0f7-5f7a-4e86-adbe-313ac820951e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:19.424663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38b3b0f7-5f7a-4e86-adbe-313ac820951e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:19.425691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38b3b0f7-5f7a-4e86-adbe-313ac820951e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:19.426533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38b3b0f7-5f7a-4e86-adbe-313ac820951e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:19.427197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38b3b0f7-5f7a-4e86-adbe-313ac820951e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:19.601126 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23ec82e3-b7ad-41e5-97af-3c4c3333c675 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 204 len: 0 microversion: 2.25 time: 0.350304 Sep 10 20:55:19.607635 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 914/1885] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:55:19 2022] DELETE /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:19.622253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:19.623037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:19.649572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:19.653501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:19.655089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:19.659658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:19.666623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:19.670087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:19.677739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-38b3b0f7-5f7a-4e86-adbe-313ac820951e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:19.694262 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-38b3b0f7-5f7a-4e86-adbe-313ac820951e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.308127 Sep 10 20:55:19.717718 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 972/1886] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:19 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:19.787965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9cf9a91-d1cc-4d49-989d-f6e8ef6b8a58 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:19.789068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f9cf9a91-d1cc-4d49-989d-f6e8ef6b8a58 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:19.803447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9cf9a91-d1cc-4d49-989d-f6e8ef6b8a58 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:19.806042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9cf9a91-d1cc-4d49-989d-f6e8ef6b8a58 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:19.806751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9cf9a91-d1cc-4d49-989d-f6e8ef6b8a58 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:19.809429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9cf9a91-d1cc-4d49-989d-f6e8ef6b8a58 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:19.811069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9cf9a91-d1cc-4d49-989d-f6e8ef6b8a58 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:19.812023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9cf9a91-d1cc-4d49-989d-f6e8ef6b8a58 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:20.043216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f9cf9a91-d1cc-4d49-989d-f6e8ef6b8a58 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:20.059649 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f9cf9a91-d1cc-4d49-989d-f6e8ef6b8a58 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1392 microversion: 2.1 time: 0.276056 Sep 10 20:55:20.060556 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 973/1887] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:19 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1392 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:20.070152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1227385617", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ff548dc-5c62-4be9-a591-e04f702e4db1"}], "security_groups": [{"name": "tempest-securitygroup--161867359"}], "key_name": "tempest-keypair-623379754", "user_data": "}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:20.255790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:20.305764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:20.309668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:20.311254 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-92d2ce11-8b7d-49d4-b4d5-c374930c1ea1 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1564 microversion: 2.25 time: 0.701454 Sep 10 20:55:20.312330 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 915/1888] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:19 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1564 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:20.326269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:20.327170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:20.343572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:20.344382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:20.344997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:20.346151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:20.347069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:20.347662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:20.827936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:20.845419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] validate_networks() for [('8ff548dc-5c62-4be9-a591-e04f702e4db1', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:55:20.891155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:20.900776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:20.915681 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d185ae9d-ce46-45fe-8038-93cdc4d75243 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1361 microversion: 2.26 time: 0.601844 Sep 10 20:55:20.933205 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 916/1889] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:20 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1361 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:20.951398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dc3477b2-28d7-4634-b0a4-e7d5419dabf2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99446475e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:21.090239 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dc3477b2-28d7-4634-b0a4-e7d5419dabf2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.154364 Sep 10 20:55:21.093220 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 917/1890] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:20 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:21.102551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-71114b1c-806e-4f0a-af3f-2644e1ea3a5b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:21.103578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-71114b1c-806e-4f0a-af3f-2644e1ea3a5b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:21.114298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71114b1c-806e-4f0a-af3f-2644e1ea3a5b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:21.115315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71114b1c-806e-4f0a-af3f-2644e1ea3a5b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:21.116889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71114b1c-806e-4f0a-af3f-2644e1ea3a5b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:21.117651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71114b1c-806e-4f0a-af3f-2644e1ea3a5b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:21.118183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71114b1c-806e-4f0a-af3f-2644e1ea3a5b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:21.119025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71114b1c-806e-4f0a-af3f-2644e1ea3a5b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:21.501498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-71114b1c-806e-4f0a-af3f-2644e1ea3a5b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:21.526674 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-71114b1c-806e-4f0a-af3f-2644e1ea3a5b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.432030 Sep 10 20:55:21.530575 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 918/1891] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:21 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:21.546601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c7b8af0-a6a2-4711-8772-f57262e76ae5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:21.547503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4c7b8af0-a6a2-4711-8772-f57262e76ae5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:21.559188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c7b8af0-a6a2-4711-8772-f57262e76ae5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:21.560307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c7b8af0-a6a2-4711-8772-f57262e76ae5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:21.560959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c7b8af0-a6a2-4711-8772-f57262e76ae5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:21.562002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c7b8af0-a6a2-4711-8772-f57262e76ae5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:21.562704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c7b8af0-a6a2-4711-8772-f57262e76ae5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:21.563333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c7b8af0-a6a2-4711-8772-f57262e76ae5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:21.665335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:55:21.666073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:55:21.666721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:55:21.667902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:55:21.668512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:55:21.689673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:21.690235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:21.690683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:21.694046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:21.694751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:21.695435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:21.722813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Getting quotas for project f4b1732129f3414fbc3f26fff6d039ec. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:55:21.735621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Getting quotas for user d8b0a160808f4adda7be57cd535f0631 and project f4b1732129f3414fbc3f26fff6d039ec. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:55:21.767027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:55:21.771971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:55:21.886190 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-72fb4e81-4805-4083-8e3b-0f1292a517fa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.822830 Sep 10 20:55:21.895408 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 974/1892] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:55:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:55:21.902642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:21.903984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:21.916017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:21.917546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:21.919608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:21.920742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:21.922399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:21.923879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:22.071590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:22.093987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:22.098784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:22.102858 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fd8020db-45ae-4072-8171-1e331c734f79 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1522 microversion: 2.25 time: 0.205137 Sep 10 20:55:22.106711 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 975/1893] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:21 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:22.117427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-bf3231a8-eaa0-4480-aba8-9e56d07bfc8a req-dcb15559-132d-4b95-a629-705c0ad9207e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e5c032-830c-485e-95db-6ce8a67b1872", "name": "network-vif-deleted", "tag": "77555f73-bd32-4402-a6df-d676567f9a43"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:22.153364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bf3231a8-eaa0-4480-aba8-9e56d07bfc8a req-dcb15559-132d-4b95-a629-705c0ad9207e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:22.154842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bf3231a8-eaa0-4480-aba8-9e56d07bfc8a req-dcb15559-132d-4b95-a629-705c0ad9207e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:22.155778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bf3231a8-eaa0-4480-aba8-9e56d07bfc8a req-dcb15559-132d-4b95-a629-705c0ad9207e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:22.170146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:22.182345 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-bf3231a8-eaa0-4480-aba8-9e56d07bfc8a req-dcb15559-132d-4b95-a629-705c0ad9207e service nova] Creating event network-vif-deleted:77555f73-bd32-4402-a6df-d676567f9a43 for instance 71e5c032-830c-485e-95db-6ce8a67b1872 on nch1-master-1 Sep 10 20:55:22.192326 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-bf3231a8-eaa0-4480-aba8-9e56d07bfc8a req-dcb15559-132d-4b95-a629-705c0ad9207e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081228 Sep 10 20:55:22.202308 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 976/1894] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:22.210559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a497ab80-8e09-45d1-8f58-b05afce62cc8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:22.212153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a497ab80-8e09-45d1-8f58-b05afce62cc8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:22.331244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a497ab80-8e09-45d1-8f58-b05afce62cc8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:22.342777 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a497ab80-8e09-45d1-8f58-b05afce62cc8 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1245 microversion: 2.1 time: 0.137773 Sep 10 20:55:22.343798 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 977/1895] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:22 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1245 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:22.349724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:22.350385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:22.358412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:22.359016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:22.360508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:22.361514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:22.362357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:22.363067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:22.533719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:22.692207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:22.724183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:22.727452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:22.732182 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6f689a10-0c20-4bbb-8298-67f75d32f745 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1361 microversion: 2.26 time: 0.383679 Sep 10 20:55:22.734782 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 978/1896] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:22 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1361 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:22.774814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eead24d6-affa-4de4-acf1-3476ec7a95be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99495d7af0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:22.825127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4c7b8af0-a6a2-4711-8772-f57262e76ae5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:22.838108 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c7b8af0-a6a2-4711-8772-f57262e76ae5 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1382 microversion: 2.1 time: 1.305498 Sep 10 20:55:22.855665 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eead24d6-affa-4de4-acf1-3476ec7a95be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.091715 Sep 10 20:55:22.864545 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 979/1897] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:22 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:22.864781 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 919/1898] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:21 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1382 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:22.864898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b1eb8a58-319c-40be-97aa-1fe65f7f8916 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:22.864898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b1eb8a58-319c-40be-97aa-1fe65f7f8916 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:22.872818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1eb8a58-319c-40be-97aa-1fe65f7f8916 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:22.873959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1eb8a58-319c-40be-97aa-1fe65f7f8916 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:22.874701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1eb8a58-319c-40be-97aa-1fe65f7f8916 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:22.875689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d539627f-bf35-48ef-a2c7-b84759b0dc19 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '.version_select at 0x7f9944de73a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:22.876910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1eb8a58-319c-40be-97aa-1fe65f7f8916 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:22.879847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1eb8a58-319c-40be-97aa-1fe65f7f8916 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:22.881132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1eb8a58-319c-40be-97aa-1fe65f7f8916 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:22.884629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d539627f-bf35-48ef-a2c7-b84759b0dc19 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:22.888214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d539627f-bf35-48ef-a2c7-b84759b0dc19 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:22.889357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d539627f-bf35-48ef-a2c7-b84759b0dc19 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:22.932290 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d539627f-bf35-48ef-a2c7-b84759b0dc19 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3507 microversion: 2.1 time: 0.065361 Sep 10 20:55:22.948988 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 920/1899] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 20:55:22 2022] GET /compute/v2.1/os-migrations => generated 3507 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:22.968611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-275a3360-011a-4a67-a4b0-b7133dc3e549 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:22.971342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-275a3360-011a-4a67-a4b0-b7133dc3e549 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:22.986799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275a3360-011a-4a67-a4b0-b7133dc3e549 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:22.987592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275a3360-011a-4a67-a4b0-b7133dc3e549 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.001774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275a3360-011a-4a67-a4b0-b7133dc3e549 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.006974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275a3360-011a-4a67-a4b0-b7133dc3e549 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.009301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275a3360-011a-4a67-a4b0-b7133dc3e549 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.012913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275a3360-011a-4a67-a4b0-b7133dc3e549 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.249370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1eb8a58-319c-40be-97aa-1fe65f7f8916 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:23.276895 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b1eb8a58-319c-40be-97aa-1fe65f7f8916 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.416722 Sep 10 20:55:23.280145 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 980/1900] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:22 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:23.287320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:23.289045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:23.302704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.304705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.306528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.310066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.311353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.312059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.387499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.389760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.390263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.391007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lazy-loading 'fault' on Instance uuid 71e5c032-830c-485e-95db-6ce8a67b1872 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:23.470749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:23.488532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:23.490270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd431fc2d9834bea8df807edb91771ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89075fefc8ea47c78d4ff7364e12ffde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:23.491729 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cf86e717-0adf-4168-9471-8a533f26ca27 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 200 len: 1352 microversion: 2.25 time: 0.209996 Sep 10 20:55:23.522080 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 981/1901] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:23 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 1352 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:23.529983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-32264e52-23f0-4ebf-8d05-14f0ecb28dff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:23.530765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-32264e52-23f0-4ebf-8d05-14f0ecb28dff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:23.535742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:23.544167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32264e52-23f0-4ebf-8d05-14f0ecb28dff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.544829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32264e52-23f0-4ebf-8d05-14f0ecb28dff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.545338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32264e52-23f0-4ebf-8d05-14f0ecb28dff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.546437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32264e52-23f0-4ebf-8d05-14f0ecb28dff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.547198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32264e52-23f0-4ebf-8d05-14f0ecb28dff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.549081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32264e52-23f0-4ebf-8d05-14f0ecb28dff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.586852 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-275a3360-011a-4a67-a4b0-b7133dc3e549 tempest-LiveMigrationTest-932954205 tempest-LiveMigrationTest-932954205-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1533 microversion: 2.1 time: 0.632173 Sep 10 20:55:23.589404 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 921/1902] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:22 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1533 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:23.602756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-7713a320-9eca-4da6-bcd6-9435f627b88f req-6cb5d0bf-b9af-45d8-bf9b-6a5195a159de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c7829e-d133-4ea4-a691-b3d4bdb83615", "tag": "08d65ec1-73e8-46bc-9046-eda5210e393e"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:23.640038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7713a320-9eca-4da6-bcd6-9435f627b88f req-6cb5d0bf-b9af-45d8-bf9b-6a5195a159de service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.640719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7713a320-9eca-4da6-bcd6-9435f627b88f req-6cb5d0bf-b9af-45d8-bf9b-6a5195a159de service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.641636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7713a320-9eca-4da6-bcd6-9435f627b88f req-6cb5d0bf-b9af-45d8-bf9b-6a5195a159de service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.679815 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7713a320-9eca-4da6-bcd6-9435f627b88f req-6cb5d0bf-b9af-45d8-bf9b-6a5195a159de service nova] Creating event network-changed:08d65ec1-73e8-46bc-9046-eda5210e393e for instance d7c7829e-d133-4ea4-a691-b3d4bdb83615 on nch1-master-1 Sep 10 20:55:23.690565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-32264e52-23f0-4ebf-8d05-14f0ecb28dff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:23.693488 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-7713a320-9eca-4da6-bcd6-9435f627b88f req-6cb5d0bf-b9af-45d8-bf9b-6a5195a159de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101111 Sep 10 20:55:23.695800 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 922/1903] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:23.703367 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-32264e52-23f0-4ebf-8d05-14f0ecb28dff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1241 microversion: 2.1 time: 0.179498 Sep 10 20:55:23.704005 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 982/1904] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:23 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:23.708551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6a4f1b1-7502-4b3c-af4f-920ea02af284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:23.710923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6a4f1b1-7502-4b3c-af4f-920ea02af284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:23.719199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6a4f1b1-7502-4b3c-af4f-920ea02af284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.719991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6a4f1b1-7502-4b3c-af4f-920ea02af284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.720694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6a4f1b1-7502-4b3c-af4f-920ea02af284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.721439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6a4f1b1-7502-4b3c-af4f-920ea02af284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.722394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6a4f1b1-7502-4b3c-af4f-920ea02af284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.722986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6a4f1b1-7502-4b3c-af4f-920ea02af284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.763970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6a4f1b1-7502-4b3c-af4f-920ea02af284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:55:23.775820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:23.777501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:23.795734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.796464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.797591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.798248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:23.799723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:23.800787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:23.904195 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6a4f1b1-7502-4b3c-af4f-920ea02af284 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 204 len: 0 microversion: 2.1 time: 0.206598 Sep 10 20:55:23.910560 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 923/1905] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:55:23 2022] DELETE /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:55:23.919365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c22d514d-4c83-4efc-8a2d-60b1c2df907f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944579a60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:23.993306 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c22d514d-4c83-4efc-8a2d-60b1c2df907f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.080774 Sep 10 20:55:23.994033 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 924/1906] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:23 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:24.001179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-99a1817f-e52b-4a3a-8556-bed0f3e752f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:24.002381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99a1817f-e52b-4a3a-8556-bed0f3e752f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:24.011931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99a1817f-e52b-4a3a-8556-bed0f3e752f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:24.012429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99a1817f-e52b-4a3a-8556-bed0f3e752f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:24.012858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99a1817f-e52b-4a3a-8556-bed0f3e752f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:24.013665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99a1817f-e52b-4a3a-8556-bed0f3e752f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:24.014154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99a1817f-e52b-4a3a-8556-bed0f3e752f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:24.014573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99a1817f-e52b-4a3a-8556-bed0f3e752f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:24.064387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:24.076151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:24.078770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:24.081024 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d64a92fe-e94f-423a-a0b2-97121d7ac54e tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1361 microversion: 2.26 time: 0.309506 Sep 10 20:55:24.082444 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 983/1907] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:23 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:24.308701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c9efcf5-9af6-4bf7-97aa-ffca6615065c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:24.311012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9c9efcf5-9af6-4bf7-97aa-ffca6615065c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:24.328831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c9efcf5-9af6-4bf7-97aa-ffca6615065c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:24.331919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c9efcf5-9af6-4bf7-97aa-ffca6615065c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:24.333600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c9efcf5-9af6-4bf7-97aa-ffca6615065c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:24.334585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c9efcf5-9af6-4bf7-97aa-ffca6615065c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:24.335449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c9efcf5-9af6-4bf7-97aa-ffca6615065c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:24.336156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c9efcf5-9af6-4bf7-97aa-ffca6615065c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:24.386341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99a1817f-e52b-4a3a-8556-bed0f3e752f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:24.397502 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-99a1817f-e52b-4a3a-8556-bed0f3e752f6 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1388 microversion: 2.1 time: 0.397560 Sep 10 20:55:24.399003 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 925/1908] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:23 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1388 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:24.529532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:24.530938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] [instance: 71e5c032-830c-485e-95db-6ce8a67b1872] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:24.550337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:24.553968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:24.557052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:24.560188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:24.562797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:24.563267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:24.601121 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] HTTP exception thrown: Instance 71e5c032-830c-485e-95db-6ce8a67b1872 could not be found. Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Request method failure captured: Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 HTTP/1.1 Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPgsePhEuWaZfVRlXkJ7w7wIqPxbC13U5IcxgKA6IcXX-web3gE55eKYDVEPfs3b2ZTohIRVE-S3MDLn-VvdMycJDKrc0B1Y6JhFGAPNbWBy14rOX9cSWbDmg0efA86Rq2MuvBcYRRjdwQHk9OGQzd1Zn8x2uukTEk_OlnKTUfRS2-o Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 89075fefc8ea47c78d4ff7364e12ffde Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89075fefc8ea47c78d4ff7364e12ffde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89075fefc8ea47c78d4ff7364e12ffde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89075fefc8ea47c78d4ff7364e12ffde", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89075fefc8ea47c78d4ff7364e12ffde"}]}] Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 89075fefc8ea47c78d4ff7364e12ffde Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620 Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-LiveAutoBlockMigrationV225Test-1800857620-project Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: dd431fc2d9834bea8df807edb91771ee Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1800857620-project Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 71e5c032-830c-485e-95db-6ce8a67b1872 could not be found. Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '71e5c032-830c-485e-95db-6ce8a67b1872'} Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e5c032-830c-485e-95db-6ce8a67b1872 could not be found. Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e5c032-830c-485e-95db-6ce8a67b1872 could not be found. Sep 10 20:55:24.605607 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:24.614568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:24.614568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:24.614568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:24.614568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:24.614568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:24.614568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:24.614568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:24.614568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e5c032-830c-485e-95db-6ce8a67b1872 could not be found. Sep 10 20:55:24.614568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:24.616958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] Returning 404 to user: Instance 71e5c032-830c-485e-95db-6ce8a67b1872 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:24.618320 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cc9d940c-3107-4963-9f1d-f0750c62aba7 tempest-LiveAutoBlockMigrationV225Test-1800857620 tempest-LiveAutoBlockMigrationV225Test-1800857620-project] 10.222.0.33 "GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872" status: 404 len: 111 microversion: 2.25 time: 0.093468 Sep 10 20:55:24.620536 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 926/1909] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:24 2022] GET /compute/v2.1/servers/71e5c032-830c-485e-95db-6ce8a67b1872 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:55:24.620969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c9efcf5-9af6-4bf7-97aa-ffca6615065c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:24.633760 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c9efcf5-9af6-4bf7-97aa-ffca6615065c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.329556 Sep 10 20:55:24.637184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 984/1910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:24 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:24.731358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-984a83bf-e98d-4fbe-9fca-4c811ff7c7aa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:24.732142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-984a83bf-e98d-4fbe-9fca-4c811ff7c7aa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:24.759319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-984a83bf-e98d-4fbe-9fca-4c811ff7c7aa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:24.762163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-984a83bf-e98d-4fbe-9fca-4c811ff7c7aa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:24.764629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-984a83bf-e98d-4fbe-9fca-4c811ff7c7aa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:24.765529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-984a83bf-e98d-4fbe-9fca-4c811ff7c7aa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:24.766138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-984a83bf-e98d-4fbe-9fca-4c811ff7c7aa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:24.766619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-984a83bf-e98d-4fbe-9fca-4c811ff7c7aa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:24.929090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-984a83bf-e98d-4fbe-9fca-4c811ff7c7aa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:24.947016 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-984a83bf-e98d-4fbe-9fca-4c811ff7c7aa tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1297 microversion: 2.1 time: 0.222549 Sep 10 20:55:24.948595 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 927/1911] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:24 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1297 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:25.010938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56fd7d36-ce88-459c-8387-cb496b0d7532 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9949642a60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:25.112792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:25.113682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:25.117155 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-56fd7d36-ce88-459c-8387-cb496b0d7532 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.110098 Sep 10 20:55:25.121877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:25.123522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:25.124509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:25.125927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:25.126650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:25.127868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:25.130269 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 985/1912] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:25 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:25.423555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85b1eeb0-7915-47e7-8a4f-3690db644026 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:25.424249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-85b1eeb0-7915-47e7-8a4f-3690db644026 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:25.431340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b1eeb0-7915-47e7-8a4f-3690db644026 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:25.432156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b1eeb0-7915-47e7-8a4f-3690db644026 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:25.432974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b1eeb0-7915-47e7-8a4f-3690db644026 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:25.434165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b1eeb0-7915-47e7-8a4f-3690db644026 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:25.434800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b1eeb0-7915-47e7-8a4f-3690db644026 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:25.435401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b1eeb0-7915-47e7-8a4f-3690db644026 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:25.529043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:25.545598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:25.548023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:25.550654 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b0328877-f70f-40ba-a0b1-e61602b30709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1361 microversion: 2.26 time: 0.441317 Sep 10 20:55:25.552614 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 928/1913] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:25 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1361 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:25.639183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-85b1eeb0-7915-47e7-8a4f-3690db644026 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:25.651737 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-85b1eeb0-7915-47e7-8a4f-3690db644026 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1388 microversion: 2.1 time: 0.231430 Sep 10 20:55:25.653323 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 986/1914] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:25 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1388 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:25.661847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e9a961e1-7259-48de-9a25-bd51e85c8a6f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:25.662568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e9a961e1-7259-48de-9a25-bd51e85c8a6f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:25.673713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a961e1-7259-48de-9a25-bd51e85c8a6f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:25.674569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a961e1-7259-48de-9a25-bd51e85c8a6f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:25.676242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a961e1-7259-48de-9a25-bd51e85c8a6f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:25.678893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a961e1-7259-48de-9a25-bd51e85c8a6f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:25.679601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a961e1-7259-48de-9a25-bd51e85c8a6f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:25.680330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a961e1-7259-48de-9a25-bd51e85c8a6f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:25.972848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e38f151-1fb7-437b-bf22-4aaa7df1bc2b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:25.973466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e38f151-1fb7-437b-bf22-4aaa7df1bc2b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:25.982025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e38f151-1fb7-437b-bf22-4aaa7df1bc2b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:25.993952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e38f151-1fb7-437b-bf22-4aaa7df1bc2b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:25.997381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e38f151-1fb7-437b-bf22-4aaa7df1bc2b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:25.997903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e38f151-1fb7-437b-bf22-4aaa7df1bc2b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:25.999011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e38f151-1fb7-437b-bf22-4aaa7df1bc2b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:25.999686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e38f151-1fb7-437b-bf22-4aaa7df1bc2b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:26.111993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6e38f151-1fb7-437b-bf22-4aaa7df1bc2b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:26.124044 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e38f151-1fb7-437b-bf22-4aaa7df1bc2b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1305 microversion: 2.1 time: 0.155267 Sep 10 20:55:26.125257 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 987/1915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:25 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1305 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:26.147304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a95b9c45-a7c3-470e-a502-fe03fe94f505 req-6bb6b15a-a1e5-4b5d-98ac-914722491d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3b5948-c5f9-4841-8444-c81ba0f96631", "name": "network-vif-deleted", "tag": "0a697059-7bd3-4f8e-a53a-ab17edf98c1f"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:26.154817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e9a961e1-7259-48de-9a25-bd51e85c8a6f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:26.164595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a95b9c45-a7c3-470e-a502-fe03fe94f505 req-6bb6b15a-a1e5-4b5d-98ac-914722491d7c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:26.165339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a95b9c45-a7c3-470e-a502-fe03fe94f505 req-6bb6b15a-a1e5-4b5d-98ac-914722491d7c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:26.165998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a95b9c45-a7c3-470e-a502-fe03fe94f505 req-6bb6b15a-a1e5-4b5d-98ac-914722491d7c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:26.166552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e9a961e1-7259-48de-9a25-bd51e85c8a6f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.506787 Sep 10 20:55:26.170487 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 929/1916] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:25 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:26.189182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1af3a6d3-d009-4051-822b-89b0c920fada tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944d35820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:26.216466 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a95b9c45-a7c3-470e-a502-fe03fe94f505 req-6bb6b15a-a1e5-4b5d-98ac-914722491d7c service nova] Creating event network-vif-deleted:0a697059-7bd3-4f8e-a53a-ab17edf98c1f for instance eb3b5948-c5f9-4841-8444-c81ba0f96631 on nch2-master-1 Sep 10 20:55:26.235262 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a95b9c45-a7c3-470e-a502-fe03fe94f505 req-6bb6b15a-a1e5-4b5d-98ac-914722491d7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090906 Sep 10 20:55:26.236338 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 988/1917] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:26.269504 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1af3a6d3-d009-4051-822b-89b0c920fada tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1414 microversion: 2.1 time: 0.097528 Sep 10 20:55:26.270229 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 930/1918] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:26 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:26.582854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:26.584395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:26.609251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:26.609946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:26.611071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:26.611744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:26.612365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:26.613025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:26.688488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:26.689156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:26.725305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:26.725305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:26.725758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:26.728679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:26.731187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:26.731840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:26.738792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:26.786069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:26.804521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:26.808555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:26.809317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:26.810020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lazy-loading 'fault' on Instance uuid eb3b5948-c5f9-4841-8444-c81ba0f96631 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:26.856389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:26.874287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:26.884154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:26.886936 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2cd0179e-ecce-43b7-a90a-fe3defe37065 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1361 microversion: 2.26 time: 0.310532 Sep 10 20:55:26.899352 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 989/1919] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:26 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1361 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:26.918653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:26.929009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-699a2157-b887-45bb-b31a-c4bf8c387e61 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 200 len: 1143 microversion: 2.1 time: 0.244615 Sep 10 20:55:26.938890 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 931/1920] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:26 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 1143 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:27.158465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-13415897-c6f0-4051-afae-ac40419ace8b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:27.159523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-13415897-c6f0-4051-afae-ac40419ace8b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:27.172836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13415897-c6f0-4051-afae-ac40419ace8b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:27.173918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13415897-c6f0-4051-afae-ac40419ace8b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:27.174648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13415897-c6f0-4051-afae-ac40419ace8b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:27.181292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13415897-c6f0-4051-afae-ac40419ace8b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:27.182118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13415897-c6f0-4051-afae-ac40419ace8b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:27.183407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13415897-c6f0-4051-afae-ac40419ace8b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:27.204225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f2463975-23fc-484f-8023-cfdd5a1aed14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:27.206456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f2463975-23fc-484f-8023-cfdd5a1aed14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:27.236698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2463975-23fc-484f-8023-cfdd5a1aed14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:27.241003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2463975-23fc-484f-8023-cfdd5a1aed14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:27.241724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2463975-23fc-484f-8023-cfdd5a1aed14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:27.244184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2463975-23fc-484f-8023-cfdd5a1aed14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:27.245239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2463975-23fc-484f-8023-cfdd5a1aed14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:27.246704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2463975-23fc-484f-8023-cfdd5a1aed14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:27.314450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13415897-c6f0-4051-afae-ac40419ace8b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:27.323493 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-13415897-c6f0-4051-afae-ac40419ace8b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1305 microversion: 2.1 time: 0.171388 Sep 10 20:55:27.324806 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 990/1921] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:27 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1305 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:27.330375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e81fb2a-8668-4ec3-8ac5-1ba299bc00d1 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994971aaf0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:27.398531 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e81fb2a-8668-4ec3-8ac5-1ba299bc00d1 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1423 microversion: 2.1 time: 0.072143 Sep 10 20:55:27.410415 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 991/1922] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:27 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:27.416204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8ad64a07-5c63-4839-bfad-5762d970e1e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99496e65e0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:27.490384 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8ad64a07-5c63-4839-bfad-5762d970e1e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 200 len: 1423 microversion: 2.1 time: 0.078125 Sep 10 20:55:27.502341 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 992/1923] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:55:27 2022] GET /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:27.514267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-20b19657-cf99-4b43-9eea-678c3d998e61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9949681ca0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:27.841479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f2463975-23fc-484f-8023-cfdd5a1aed14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:27.866974 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f2463975-23fc-484f-8023-cfdd5a1aed14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.668491 Sep 10 20:55:27.870682 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 932/1924] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:27 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:27.919336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:27.919970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:27.930963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:27.931475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:27.931920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:27.933493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:27.934002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:27.934439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:28.196600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:28.212857 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-20b19657-cf99-4b43-9eea-678c3d998e61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 204 len: 0 microversion: 2.1 time: 0.705651 Sep 10 20:55:28.214212 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 993/1925] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:27 2022] DELETE /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:55:28.222145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:28.223178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: eb3b5948-c5f9-4841-8444-c81ba0f96631] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:28.232075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:28.232919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:28.233572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:28.234631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:28.235480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:28.236069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:28.252886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:28.255397 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] HTTP exception thrown: Instance eb3b5948-c5f9-4841-8444-c81ba0f96631 could not be found. Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Request method failure captured: Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 HTTP/1.1 Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhvlcO4qle-WKUx9tRkOJFC0RqEhNmKoEL9cIlOPfkx2A87LtTAL4EC1h4nWqZefGKX9BSSoYkvFVsNaSBrkwTp5kqQTlGVXHRPWemD4Wzm-LsDm7ektMICHYp6pc5tKlbfRLhCtVgBYVasQ11jWTr1Tvrk1sDiiVnMSoF4JaK5rys Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5bd065954b0e4520a3c1deba0916db85 Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd065954b0e4520a3c1deba0916db85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd065954b0e4520a3c1deba0916db85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5bd065954b0e4520a3c1deba0916db85", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5bd065954b0e4520a3c1deba0916db85"}]}] Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5bd065954b0e4520a3c1deba0916db85 Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-LiveMigrationTest-1321581955-project Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f74a2c8cd22c454fa8fdd7c2e1ef9230 Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-LiveMigrationTest-1321581955-project Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance eb3b5948-c5f9-4841-8444-c81ba0f96631 could not be found. Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'eb3b5948-c5f9-4841-8444-c81ba0f96631'} Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3b5948-c5f9-4841-8444-c81ba0f96631 could not be found. Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3b5948-c5f9-4841-8444-c81ba0f96631 could not be found. Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:28.257985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:28.264510 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:28.264510 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:28.264510 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:28.264510 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:28.264510 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:28.264510 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3b5948-c5f9-4841-8444-c81ba0f96631 could not be found. Sep 10 20:55:28.264510 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:28.265135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:28.266132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Returning 404 to user: Instance eb3b5948-c5f9-4841-8444-c81ba0f96631 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:28.266673 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a3cf3b40-f266-4bd5-baeb-9a8c1d6b467c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1361 microversion: 2.26 time: 0.350841 Sep 10 20:55:28.267428 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 933/1926] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:27 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:28.267826 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ae705942-1ad8-473f-bc7d-b2e9bb288d3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631" status: 404 len: 111 microversion: 2.1 time: 0.051618 Sep 10 20:55:28.269065 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 994/1927] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:28 2022] GET /compute/v2.1/servers/eb3b5948-c5f9-4841-8444-c81ba0f96631 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:55:28.285362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f25c4f28-d2b7-40e4-bbcd-a6e83fa41e23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:28.286079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f25c4f28-d2b7-40e4-bbcd-a6e83fa41e23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:28.299446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f25c4f28-d2b7-40e4-bbcd-a6e83fa41e23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:28.300085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f25c4f28-d2b7-40e4-bbcd-a6e83fa41e23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:28.300619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f25c4f28-d2b7-40e4-bbcd-a6e83fa41e23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:28.301590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f25c4f28-d2b7-40e4-bbcd-a6e83fa41e23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:28.302302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f25c4f28-d2b7-40e4-bbcd-a6e83fa41e23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:28.308063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f25c4f28-d2b7-40e4-bbcd-a6e83fa41e23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:28.340953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f25c4f28-d2b7-40e4-bbcd-a6e83fa41e23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:55:28.353167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7bbf1e29-67b8-4d64-a098-ce518bc670e4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:28.353885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7bbf1e29-67b8-4d64-a098-ce518bc670e4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:28.384301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bbf1e29-67b8-4d64-a098-ce518bc670e4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:28.384817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bbf1e29-67b8-4d64-a098-ce518bc670e4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:28.387689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bbf1e29-67b8-4d64-a098-ce518bc670e4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:28.392514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bbf1e29-67b8-4d64-a098-ce518bc670e4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:28.396350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bbf1e29-67b8-4d64-a098-ce518bc670e4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:28.396844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bbf1e29-67b8-4d64-a098-ce518bc670e4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:28.515696 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f25c4f28-d2b7-40e4-bbcd-a6e83fa41e23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 204 len: 0 microversion: 2.1 time: 0.246227 Sep 10 20:55:28.517091 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 934/1928] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:55:28 2022] DELETE /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:55:28.556001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7bbf1e29-67b8-4d64-a098-ce518bc670e4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:28.567500 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7bbf1e29-67b8-4d64-a098-ce518bc670e4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1303 microversion: 2.1 time: 0.219106 Sep 10 20:55:28.581187 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 995/1929] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:28 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:28.699280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1009150089", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "fb7a08eb-859f-4d5a-a729-24ed5c968d62"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:28.775914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] validate_networks() for [('fb7a08eb-859f-4d5a-a729-24ed5c968d62', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:55:28.898875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da7518ab-c084-4a6a-9d50-c5545b9ac2a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:28.901910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-da7518ab-c084-4a6a-9d50-c5545b9ac2a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:28.913121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da7518ab-c084-4a6a-9d50-c5545b9ac2a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:28.918706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da7518ab-c084-4a6a-9d50-c5545b9ac2a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:28.919421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da7518ab-c084-4a6a-9d50-c5545b9ac2a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:28.920341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da7518ab-c084-4a6a-9d50-c5545b9ac2a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:28.923830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da7518ab-c084-4a6a-9d50-c5545b9ac2a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:28.924601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da7518ab-c084-4a6a-9d50-c5545b9ac2a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:29.226170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-da7518ab-c084-4a6a-9d50-c5545b9ac2a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:29.237523 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da7518ab-c084-4a6a-9d50-c5545b9ac2a5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1475 microversion: 2.1 time: 0.343494 Sep 10 20:55:29.254475 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 996/1930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:28 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1475 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:29.299328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:29.300118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:29.306216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:29.306817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:29.323450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:29.327495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:29.328063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:29.329415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:29.855813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:29.866453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:29.868708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:29.869986 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93f377d3-520a-4d28-8179-c2afa7695709 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1361 microversion: 2.26 time: 0.578683 Sep 10 20:55:29.877925 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 997/1931] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:29 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1361 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:29.882875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-722727cf-5037-4d21-8d7f-b3d8e6e42a3d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:29.883376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-722727cf-5037-4d21-8d7f-b3d8e6e42a3d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:29.894849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-722727cf-5037-4d21-8d7f-b3d8e6e42a3d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:29.895441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-722727cf-5037-4d21-8d7f-b3d8e6e42a3d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:29.895948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-722727cf-5037-4d21-8d7f-b3d8e6e42a3d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:29.896736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-722727cf-5037-4d21-8d7f-b3d8e6e42a3d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:29.897705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-722727cf-5037-4d21-8d7f-b3d8e6e42a3d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:29.898610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-722727cf-5037-4d21-8d7f-b3d8e6e42a3d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:29.928891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-722727cf-5037-4d21-8d7f-b3d8e6e42a3d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:55:29.980316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:55:29.980836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:55:29.981204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:55:29.981619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:55:29.982059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:55:29.994801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:29.995312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:29.995827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:29.996570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:29.997027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:29.997455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:30.003488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:30.019867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Getting quotas for project e8f7f9f3112545e9b40d88a7cc48e3fe. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:55:30.026821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Getting quotas for user 687eef270165450a97b4d260b2724b3e and project e8f7f9f3112545e9b40d88a7cc48e3fe. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:55:30.045430 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-722727cf-5037-4d21-8d7f-b3d8e6e42a3d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "DELETE /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 204 len: 0 microversion: 2.1 time: 0.165982 Sep 10 20:55:30.049026 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 998/1932] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:55:29 2022] DELETE /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:55:30.051592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:55:30.052230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3be4e1ed-a4c8-4317-8a43-d4e4561a308a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:30.053004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3be4e1ed-a4c8-4317-8a43-d4e4561a308a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:30.054465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:55:30.060678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3be4e1ed-a4c8-4317-8a43-d4e4561a308a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:30.061257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3be4e1ed-a4c8-4317-8a43-d4e4561a308a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:30.061767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3be4e1ed-a4c8-4317-8a43-d4e4561a308a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:30.062602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3be4e1ed-a4c8-4317-8a43-d4e4561a308a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:30.063128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3be4e1ed-a4c8-4317-8a43-d4e4561a308a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:30.063650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3be4e1ed-a4c8-4317-8a43-d4e4561a308a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:30.135861 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-981e51b7-2e68-412f-a1bc-340dc7db3c05 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.441926 Sep 10 20:55:30.137089 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 935/1933] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:55:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:55:30.146752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a5f12cb2-5a50-4e15-a766-5710c8bcc9a3 req-e7cbdca6-b41d-45c6-b403-a6f1beed85d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c7829e-d133-4ea4-a691-b3d4bdb83615", "name": "network-vif-plugged", "status": "completed", "tag": "08d65ec1-73e8-46bc-9046-eda5210e393e"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:30.153410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3be4e1ed-a4c8-4317-8a43-d4e4561a308a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:30.158533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a5f12cb2-5a50-4e15-a766-5710c8bcc9a3 req-e7cbdca6-b41d-45c6-b403-a6f1beed85d4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:30.159011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a5f12cb2-5a50-4e15-a766-5710c8bcc9a3 req-e7cbdca6-b41d-45c6-b403-a6f1beed85d4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:30.159655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a5f12cb2-5a50-4e15-a766-5710c8bcc9a3 req-e7cbdca6-b41d-45c6-b403-a6f1beed85d4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:30.165099 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3be4e1ed-a4c8-4317-8a43-d4e4561a308a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1303 microversion: 2.1 time: 0.117316 Sep 10 20:55:30.167303 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 999/1934] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:30 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:30.174780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-093e5b68-bd13-40af-be4d-cfd41180f2e8 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:30.175577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-093e5b68-bd13-40af-be4d-cfd41180f2e8 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:30.187645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-093e5b68-bd13-40af-be4d-cfd41180f2e8 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:30.188724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-093e5b68-bd13-40af-be4d-cfd41180f2e8 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:30.189421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-093e5b68-bd13-40af-be4d-cfd41180f2e8 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:30.190155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-093e5b68-bd13-40af-be4d-cfd41180f2e8 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:30.190784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-093e5b68-bd13-40af-be4d-cfd41180f2e8 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:30.191409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-093e5b68-bd13-40af-be4d-cfd41180f2e8 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:30.193872 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a5f12cb2-5a50-4e15-a766-5710c8bcc9a3 req-e7cbdca6-b41d-45c6-b403-a6f1beed85d4 service nova] Creating event network-vif-plugged:08d65ec1-73e8-46bc-9046-eda5210e393e for instance d7c7829e-d133-4ea4-a691-b3d4bdb83615 on nch1-master-1 Sep 10 20:55:30.204220 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a5f12cb2-5a50-4e15-a766-5710c8bcc9a3 req-e7cbdca6-b41d-45c6-b403-a6f1beed85d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065600 Sep 10 20:55:30.205859 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 936/1935] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:30.214459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-46356ce2-eb08-446e-b587-d6028db3aba3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:30.215233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-46356ce2-eb08-446e-b587-d6028db3aba3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:30.408693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-46356ce2-eb08-446e-b587-d6028db3aba3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:30.422218 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-46356ce2-eb08-446e-b587-d6028db3aba3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1208 microversion: 2.1 time: 0.214621 Sep 10 20:55:30.423343 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 937/1936] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:30 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1208 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:30.442575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b5ce7d80-b2b6-4cee-bc8a-cbb82e29e5e1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:30.446519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b5ce7d80-b2b6-4cee-bc8a-cbb82e29e5e1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:30.460100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ce7d80-b2b6-4cee-bc8a-cbb82e29e5e1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:30.460786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ce7d80-b2b6-4cee-bc8a-cbb82e29e5e1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:30.461807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ce7d80-b2b6-4cee-bc8a-cbb82e29e5e1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:30.463086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ce7d80-b2b6-4cee-bc8a-cbb82e29e5e1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:30.465376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ce7d80-b2b6-4cee-bc8a-cbb82e29e5e1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:30.466376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ce7d80-b2b6-4cee-bc8a-cbb82e29e5e1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:30.527650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-093e5b68-bd13-40af-be4d-cfd41180f2e8 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:30.539230 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-093e5b68-bd13-40af-be4d-cfd41180f2e8 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1666 microversion: 2.1 time: 0.370393 Sep 10 20:55:30.554196 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1000/1937] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:30 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1666 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:30.900561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:30.901805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:30.912212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:30.912760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:30.913946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:30.914666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:30.915121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:30.916411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:31.106769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:31.122822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:31.124698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:31.125903 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-855d7374-22a7-4d9c-a3c9-21c204e54cec tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1361 microversion: 2.26 time: 0.231743 Sep 10 20:55:31.127276 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1001/1938] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:30 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:31.194027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ca2c444-1d21-44ef-8db7-c8f63ac725af tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:31.195772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6ca2c444-1d21-44ef-8db7-c8f63ac725af tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:31.205011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b5ce7d80-b2b6-4cee-bc8a-cbb82e29e5e1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:31.208292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ca2c444-1d21-44ef-8db7-c8f63ac725af tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:31.208999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ca2c444-1d21-44ef-8db7-c8f63ac725af tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:31.209550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ca2c444-1d21-44ef-8db7-c8f63ac725af tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:31.210691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ca2c444-1d21-44ef-8db7-c8f63ac725af tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:31.211394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ca2c444-1d21-44ef-8db7-c8f63ac725af tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:31.212009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ca2c444-1d21-44ef-8db7-c8f63ac725af tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:31.219406 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b5ce7d80-b2b6-4cee-bc8a-cbb82e29e5e1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1474 microversion: 2.1 time: 0.794519 Sep 10 20:55:31.219984 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 938/1939] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:30 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1474 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:31.364335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ca2c444-1d21-44ef-8db7-c8f63ac725af tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:31.373485 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ca2c444-1d21-44ef-8db7-c8f63ac725af tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1370 microversion: 2.1 time: 0.185622 Sep 10 20:55:31.374344 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1002/1940] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:31 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:31.452352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e9291be3-7649-4ec9-bc71-5b024c556f07 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:31.453142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e9291be3-7649-4ec9-bc71-5b024c556f07 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:31.460686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9291be3-7649-4ec9-bc71-5b024c556f07 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:31.461186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9291be3-7649-4ec9-bc71-5b024c556f07 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:31.461622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9291be3-7649-4ec9-bc71-5b024c556f07 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:31.462362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9291be3-7649-4ec9-bc71-5b024c556f07 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:31.463004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9291be3-7649-4ec9-bc71-5b024c556f07 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:31.464093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9291be3-7649-4ec9-bc71-5b024c556f07 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:31.564048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e523241-0dd1-41aa-aa0c-09cade6c6b8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:31.564681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e523241-0dd1-41aa-aa0c-09cade6c6b8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:31.570908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e523241-0dd1-41aa-aa0c-09cade6c6b8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:31.571685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e523241-0dd1-41aa-aa0c-09cade6c6b8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:31.572133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e523241-0dd1-41aa-aa0c-09cade6c6b8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:31.573559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e523241-0dd1-41aa-aa0c-09cade6c6b8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:31.574280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e523241-0dd1-41aa-aa0c-09cade6c6b8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:31.574878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e523241-0dd1-41aa-aa0c-09cade6c6b8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:31.705709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:31.733364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8e523241-0dd1-41aa-aa0c-09cade6c6b8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:31.747003 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e523241-0dd1-41aa-aa0c-09cade6c6b8d tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1666 microversion: 2.1 time: 0.187106 Sep 10 20:55:31.747605 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1003/1941] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:31 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1666 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:31.925245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e9291be3-7649-4ec9-bc71-5b024c556f07 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:31.939444 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e9291be3-7649-4ec9-bc71-5b024c556f07 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1204 microversion: 2.1 time: 0.492139 Sep 10 20:55:31.940476 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 939/1942] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:31 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1204 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:32.152588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:32.153205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:32.160535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:32.161230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:32.162639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:32.166418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:32.167645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:32.169022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:32.246153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ed8afac9-9db1-4575-825e-ca1aab8c6eb0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:32.246690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ed8afac9-9db1-4575-825e-ca1aab8c6eb0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:32.262220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed8afac9-9db1-4575-825e-ca1aab8c6eb0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:32.264457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed8afac9-9db1-4575-825e-ca1aab8c6eb0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:32.265363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed8afac9-9db1-4575-825e-ca1aab8c6eb0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:32.266489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed8afac9-9db1-4575-825e-ca1aab8c6eb0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:32.267123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed8afac9-9db1-4575-825e-ca1aab8c6eb0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:32.267755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed8afac9-9db1-4575-825e-ca1aab8c6eb0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:32.336358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=16 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:32.419607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:32.437344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:32.439415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:32.441762 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3a22578f-091d-443d-a5a9-ae6dbd4856a4 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1544 microversion: 2.26 time: 0.292981 Sep 10 20:55:32.442972 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1004/1943] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:32 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1544 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:32.456065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-37389f4b-900c-4021-bd06-07c11a81e05a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:32.456941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-37389f4b-900c-4021-bd06-07c11a81e05a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:32.471073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37389f4b-900c-4021-bd06-07c11a81e05a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:32.472161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37389f4b-900c-4021-bd06-07c11a81e05a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:32.472603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37389f4b-900c-4021-bd06-07c11a81e05a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:32.473653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37389f4b-900c-4021-bd06-07c11a81e05a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:32.474274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37389f4b-900c-4021-bd06-07c11a81e05a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:32.474711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37389f4b-900c-4021-bd06-07c11a81e05a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:32.896447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed8afac9-9db1-4575-825e-ca1aab8c6eb0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:32.928513 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ed8afac9-9db1-4575-825e-ca1aab8c6eb0 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1474 microversion: 2.1 time: 0.687904 Sep 10 20:55:32.931575 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 940/1944] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:32 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1474 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:32.954253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f9944579f70>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:32.993737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-37389f4b-900c-4021-bd06-07c11a81e05a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:32.996452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:32.997055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:32.997714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:32.998429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:33.007342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.008096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.008841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.011246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.012401 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-37389f4b-900c-4021-bd06-07c11a81e05a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1370 microversion: 2.1 time: 0.567184 Sep 10 20:55:33.013460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.014270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.022344 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1005/1945] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:32 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1370 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:33.073324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa206cd3-4d8d-4555-a36c-c721b9c9c9fc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:33.078394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aa206cd3-4d8d-4555-a36c-c721b9c9c9fc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:33.086344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa206cd3-4d8d-4555-a36c-c721b9c9c9fc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.087821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa206cd3-4d8d-4555-a36c-c721b9c9c9fc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.089026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa206cd3-4d8d-4555-a36c-c721b9c9c9fc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.090086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa206cd3-4d8d-4555-a36c-c721b9c9c9fc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.090904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa206cd3-4d8d-4555-a36c-c721b9c9c9fc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.091535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa206cd3-4d8d-4555-a36c-c721b9c9c9fc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.092073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.092569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.093062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.139629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.140376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.140978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.181193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:33.207211 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2aaf2eb9-6353-45d3-b90d-15068779569b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-324026421" status: 201 len: 0 microversion: 2.26 time: 0.267283 Sep 10 20:55:33.208158 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 941/1946] 10.222.0.33 () {62 vars in 1377 bytes} [Sat Sep 10 20:55:32 2022] PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-324026421 => generated 0 bytes in 271 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 10 20:55:33.218978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a4498673-72e1-4e5f-9949-95f9d52286fe req-4240fafc-25bf-4e2f-802a-5227a2495c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ce24e3-3f43-497b-b523-e13026e634fa", "name": "network-vif-unplugged", "status": "completed", "tag": "52761b52-5f8b-4ae4-9fd8-6bcc0382f796"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:33.229274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a4498673-72e1-4e5f-9949-95f9d52286fe req-4240fafc-25bf-4e2f-802a-5227a2495c8a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.230071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a4498673-72e1-4e5f-9949-95f9d52286fe req-4240fafc-25bf-4e2f-802a-5227a2495c8a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.230681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a4498673-72e1-4e5f-9949-95f9d52286fe req-4240fafc-25bf-4e2f-802a-5227a2495c8a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.246524 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a4498673-72e1-4e5f-9949-95f9d52286fe req-4240fafc-25bf-4e2f-802a-5227a2495c8a service nova] Creating event network-vif-unplugged:52761b52-5f8b-4ae4-9fd8-6bcc0382f796 for instance 58ce24e3-3f43-497b-b523-e13026e634fa on nch2-master-1 Sep 10 20:55:33.256792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-a4498673-72e1-4e5f-9949-95f9d52286fe req-4240fafc-25bf-4e2f-802a-5227a2495c8a service nova] Instance 58ce24e3-3f43-497b-b523-e13026e634fa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:55:33.271513 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a4498673-72e1-4e5f-9949-95f9d52286fe req-4240fafc-25bf-4e2f-802a-5227a2495c8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055767 Sep 10 20:55:33.277344 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 942/1947] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:33.283431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38f32a37-cbdb-4c82-b459-5cadb9bfbd6b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:33.284463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38f32a37-cbdb-4c82-b459-5cadb9bfbd6b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:33.291871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f32a37-cbdb-4c82-b459-5cadb9bfbd6b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.292874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f32a37-cbdb-4c82-b459-5cadb9bfbd6b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.293567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f32a37-cbdb-4c82-b459-5cadb9bfbd6b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.294581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f32a37-cbdb-4c82-b459-5cadb9bfbd6b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.295221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f32a37-cbdb-4c82-b459-5cadb9bfbd6b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.295929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f32a37-cbdb-4c82-b459-5cadb9bfbd6b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.518982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38f32a37-cbdb-4c82-b459-5cadb9bfbd6b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:33.529886 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38f32a37-cbdb-4c82-b459-5cadb9bfbd6b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1266 microversion: 2.1 time: 0.250493 Sep 10 20:55:33.530435 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 943/1948] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:33 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:33.542308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0138c411-9f5a-4ca8-983a-797d81af1f07 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f9944579700>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:33.552838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0138c411-9f5a-4ca8-983a-797d81af1f07 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.552838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0138c411-9f5a-4ca8-983a-797d81af1f07 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.553303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0138c411-9f5a-4ca8-983a-797d81af1f07 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.564235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aa206cd3-4d8d-4555-a36c-c721b9c9c9fc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:33.576085 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aa206cd3-4d8d-4555-a36c-c721b9c9c9fc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1666 microversion: 2.1 time: 0.551452 Sep 10 20:55:33.577233 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1006/1949] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:33 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1666 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:33.583275 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0138c411-9f5a-4ca8-983a-797d81af1f07 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-324026421" status: 204 len: 0 microversion: 2.26 time: 0.051510 Sep 10 20:55:33.588081 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 944/1950] 10.222.0.33 () {60 vars in 1358 bytes} [Sat Sep 10 20:55:33 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-324026421 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:33.604835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f99495b5940>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:33.613592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.614487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.615823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.616516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:33.625258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.626157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.627006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.628570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.629213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.629818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.660342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.661055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.661800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.692311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:33.720071 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5e5a187-b760-4220-b67d-e2398ca0d467 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 204 len: 0 microversion: 2.26 time: 0.121610 Sep 10 20:55:33.722307 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1007/1951] 10.222.0.33 () {60 vars in 1295 bytes} [Sat Sep 10 20:55:33 2022] DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:33.734247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1c3db79d-cc94-44e2-a3d0-4e30e6442694 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f9944647c10>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:33.747684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c3db79d-cc94-44e2-a3d0-4e30e6442694 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.749462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c3db79d-cc94-44e2-a3d0-4e30e6442694 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.751420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c3db79d-cc94-44e2-a3d0-4e30e6442694 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.777230 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1c3db79d-cc94-44e2-a3d0-4e30e6442694 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 200 len: 12 microversion: 2.26 time: 0.048571 Sep 10 20:55:33.784816 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 945/1952] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Sep 10 20:55:33 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 12 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:33.792115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f99496e64c0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:33.826879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.827379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.827829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.828351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:33.842787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.843308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.845495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.846957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.847498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.848005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.903828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.904333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.906999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.919288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.919785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.920230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.960094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:33.980715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-935ff52d-edb7-41a5-a4b2-a781710dcff6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:33.981336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-935ff52d-edb7-41a5-a4b2-a781710dcff6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:33.984542 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4ef2978d-389d-4812-b205-bcd1f15d2487 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-548167644" status: 201 len: 0 microversion: 2.26 time: 0.197708 Sep 10 20:55:33.989806 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1008/1953] 10.222.0.33 () {62 vars in 1377 bytes} [Sat Sep 10 20:55:33 2022] PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-548167644 => generated 0 bytes in 200 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 10 20:55:33.995610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-935ff52d-edb7-41a5-a4b2-a781710dcff6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.996410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-935ff52d-edb7-41a5-a4b2-a781710dcff6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:33.997044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-935ff52d-edb7-41a5-a4b2-a781710dcff6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:33.998685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-935ff52d-edb7-41a5-a4b2-a781710dcff6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:33.999318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dc2c16af-1ab9-4868-b494-5f8b7f9b6c56 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f994969bb80>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:33.999842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-935ff52d-edb7-41a5-a4b2-a781710dcff6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.000631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-935ff52d-edb7-41a5-a4b2-a781710dcff6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.012775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc2c16af-1ab9-4868-b494-5f8b7f9b6c56 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:34.013311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc2c16af-1ab9-4868-b494-5f8b7f9b6c56 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.014253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc2c16af-1ab9-4868-b494-5f8b7f9b6c56 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.030607 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dc2c16af-1ab9-4868-b494-5f8b7f9b6c56 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 200 len: 35 microversion: 2.26 time: 0.038596 Sep 10 20:55:34.037122 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1009/1954] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Sep 10 20:55:33 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 35 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:34.049283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f99496e60d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:34.060689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:34.061193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.061648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.062960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:34.071385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:34.071887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.072574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.073521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:34.074062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.074995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.119119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:34.119576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.120060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.192122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:34.237399 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-12cbf9e4-0c4e-4154-acb8-e0cd8a712e2f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-548167644" status: 204 len: 0 microversion: 2.26 time: 0.197555 Sep 10 20:55:34.238214 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1010/1955] 10.222.0.33 () {60 vars in 1361 bytes} [Sat Sep 10 20:55:34 2022] DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-548167644 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:34.247132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f6d6b9d-f4a3-46fd-9962-ef0442cd1cca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:34.248013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4f6d6b9d-f4a3-46fd-9962-ef0442cd1cca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:34.256645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6d6b9d-f4a3-46fd-9962-ef0442cd1cca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:34.257627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6d6b9d-f4a3-46fd-9962-ef0442cd1cca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.258454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6d6b9d-f4a3-46fd-9962-ef0442cd1cca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.259928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6d6b9d-f4a3-46fd-9962-ef0442cd1cca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:34.260625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6d6b9d-f4a3-46fd-9962-ef0442cd1cca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.261502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6d6b9d-f4a3-46fd-9962-ef0442cd1cca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.692116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4f6d6b9d-f4a3-46fd-9962-ef0442cd1cca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:34.702644 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f6d6b9d-f4a3-46fd-9962-ef0442cd1cca tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1370 microversion: 2.1 time: 0.461740 Sep 10 20:55:34.710426 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1011/1956] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:34 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1370 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:34.716896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8067cd18-1689-4de2-99d9-894457251769 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f99495b1d30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:34.755653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8067cd18-1689-4de2-99d9-894457251769 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:34.756632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8067cd18-1689-4de2-99d9-894457251769 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.757168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8067cd18-1689-4de2-99d9-894457251769 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.787763 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8067cd18-1689-4de2-99d9-894457251769 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 200 len: 12 microversion: 2.26 time: 0.075512 Sep 10 20:55:34.798356 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1012/1957] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Sep 10 20:55:34 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 12 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:34.800125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c2ce3768-8dde-419c-845f-d40d4ce1f48f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:34.800805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c2ce3768-8dde-419c-845f-d40d4ce1f48f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:34.807870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2ce3768-8dde-419c-845f-d40d4ce1f48f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:34.808446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2ce3768-8dde-419c-845f-d40d4ce1f48f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.808877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2ce3768-8dde-419c-845f-d40d4ce1f48f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.809587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2ce3768-8dde-419c-845f-d40d4ce1f48f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:34.810130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2ce3768-8dde-419c-845f-d40d4ce1f48f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:34.810562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2ce3768-8dde-419c-845f-d40d4ce1f48f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:34.813486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:35.089904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-935ff52d-edb7-41a5-a4b2-a781710dcff6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:35.106879 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-935ff52d-edb7-41a5-a4b2-a781710dcff6 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1474 microversion: 2.1 time: 1.145983 Sep 10 20:55:35.108136 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 946/1958] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:33 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1474 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:35.115154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9abad4cb-1c3a-440e-a4bb-325d87e97572 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:35.118320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9abad4cb-1c3a-440e-a4bb-325d87e97572 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:35.134621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9abad4cb-1c3a-440e-a4bb-325d87e97572 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.136339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9abad4cb-1c3a-440e-a4bb-325d87e97572 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.137040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9abad4cb-1c3a-440e-a4bb-325d87e97572 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.138214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9abad4cb-1c3a-440e-a4bb-325d87e97572 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.138836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9abad4cb-1c3a-440e-a4bb-325d87e97572 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.139593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9abad4cb-1c3a-440e-a4bb-325d87e97572 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.167579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:35.197164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c2ce3768-8dde-419c-845f-d40d4ce1f48f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:35.215992 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c2ce3768-8dde-419c-845f-d40d4ce1f48f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 0.419780 Sep 10 20:55:35.216590 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1013/1959] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:34 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:35.222204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f9944836670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:35.239102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.239600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.240047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.240519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:35.262138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.262138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.262138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.262442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.266119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.266119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.325659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.326174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.326617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.350857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:35.389225 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8365ac09-cebe-4c5b-b74e-7514e5a539b6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 204 len: 0 microversion: 2.26 time: 0.157220 Sep 10 20:55:35.389970 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1014/1960] 10.222.0.33 () {60 vars in 1295 bytes} [Sat Sep 10 20:55:35 2022] DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:35.399390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f9944893160>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:35.432356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.433035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.433483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.435418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:35.441629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.442150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.442810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.444746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.445393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.446535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.494293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9abad4cb-1c3a-440e-a4bb-325d87e97572 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:35.505013 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9abad4cb-1c3a-440e-a4bb-325d87e97572 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 200 len: 1599 microversion: 2.1 time: 0.395597 Sep 10 20:55:35.505599 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 947/1961] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:35 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 1599 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:35.508768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.509284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.510944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.517530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-cbd480b0-23c0-47be-9f10-86d6d62eca9a req-10aa10c6-cc6d-49ff-92b9-3aedf02eec14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372f952b-42c2-45e6-bb5c-5a2c37a2879e", "name": "network-vif-deleted", "tag": "1719b8ff-bafb-42bb-8a8f-800f550eab35"}, {"name": "network-changed", "server_uuid": "58ce24e3-3f43-497b-b523-e13026e634fa", "tag": "52761b52-5f8b-4ae4-9fd8-6bcc0382f796"}, {"name": "network-changed", "server_uuid": "37fb692b-5186-4333-ad32-a567de472d62", "tag": "4e3266c3-685c-4364-9c48-5e262bf043c6"}, {"server_uuid": "662c3986-cb45-4c9f-a1cf-55a8230ac15a", "name": "network-vif-deleted", "tag": "3a19535d-5974-4093-a3ab-f07270e88e01"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:35.534761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.535916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.536357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.545541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cbd480b0-23c0-47be-9f10-86d6d62eca9a req-10aa10c6-cc6d-49ff-92b9-3aedf02eec14 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.547139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cbd480b0-23c0-47be-9f10-86d6d62eca9a req-10aa10c6-cc6d-49ff-92b9-3aedf02eec14 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.547594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cbd480b0-23c0-47be-9f10-86d6d62eca9a req-10aa10c6-cc6d-49ff-92b9-3aedf02eec14 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.574619 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cbd480b0-23c0-47be-9f10-86d6d62eca9a req-10aa10c6-cc6d-49ff-92b9-3aedf02eec14 service nova] Creating event network-vif-deleted:1719b8ff-bafb-42bb-8a8f-800f550eab35 for instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e on nch2-master-1 Sep 10 20:55:35.575508 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cbd480b0-23c0-47be-9f10-86d6d62eca9a req-10aa10c6-cc6d-49ff-92b9-3aedf02eec14 service nova] Creating event network-changed:52761b52-5f8b-4ae4-9fd8-6bcc0382f796 for instance 58ce24e3-3f43-497b-b523-e13026e634fa on nch2-master-1 Sep 10 20:55:35.576294 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cbd480b0-23c0-47be-9f10-86d6d62eca9a req-10aa10c6-cc6d-49ff-92b9-3aedf02eec14 service nova] Creating event network-changed:4e3266c3-685c-4364-9c48-5e262bf043c6 for instance 37fb692b-5186-4333-ad32-a567de472d62 on nch1-master-1 Sep 10 20:55:35.577023 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cbd480b0-23c0-47be-9f10-86d6d62eca9a req-10aa10c6-cc6d-49ff-92b9-3aedf02eec14 service nova] Creating event network-vif-deleted:3a19535d-5974-4093-a3ab-f07270e88e01 for instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a on nch2-master-1 Sep 10 20:55:35.584358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-cbd480b0-23c0-47be-9f10-86d6d62eca9a req-10aa10c6-cc6d-49ff-92b9-3aedf02eec14 service nova] Instance 58ce24e3-3f43-497b-b523-e13026e634fa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:55:35.590811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:35.606570 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-cbd480b0-23c0-47be-9f10-86d6d62eca9a req-10aa10c6-cc6d-49ff-92b9-3aedf02eec14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.097080 Sep 10 20:55:35.607485 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 948/1962] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:35.632069 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ab7f6c2-864b-4fa2-83d2-77febc294347 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-368586290" status: 201 len: 0 microversion: 2.26 time: 0.236444 Sep 10 20:55:35.636005 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1015/1963] 10.222.0.33 () {62 vars in 1377 bytes} [Sat Sep 10 20:55:35 2022] PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-368586290 => generated 0 bytes in 241 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 10 20:55:35.648935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f99445ea1f0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:35.664941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.665467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.666124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.666888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:35.674916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.675558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.676008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.676726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.677380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.677768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.718068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.718768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.719212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.733958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.734716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.735692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.735967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-72a89ad7-b260-4892-bd39-eb389488b7cc tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:35.736646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-72a89ad7-b260-4892-bd39-eb389488b7cc tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:35.749251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72a89ad7-b260-4892-bd39-eb389488b7cc tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.750636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72a89ad7-b260-4892-bd39-eb389488b7cc tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.752453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72a89ad7-b260-4892-bd39-eb389488b7cc tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.755083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72a89ad7-b260-4892-bd39-eb389488b7cc tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.757205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72a89ad7-b260-4892-bd39-eb389488b7cc tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.758873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72a89ad7-b260-4892-bd39-eb389488b7cc tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.778011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:35.812822 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a0b2b0d1-c963-4929-94b5-0fe94dfba109 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-1481703228" status: 201 len: 0 microversion: 2.26 time: 0.169770 Sep 10 20:55:35.818939 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 949/1964] 10.222.0.33 () {62 vars in 1380 bytes} [Sat Sep 10 20:55:35 2022] PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-1481703228 => generated 0 bytes in 177 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 10 20:55:35.827427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f994459be50>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:35.841494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.842431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.843426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.844449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:35.854780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.855818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.856521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.857252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.857746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.858209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.901559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.902129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.902669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:35.930909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:35.947983 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5bd0b9d1-bf77-4cd1-b224-9dbb70fb9af7 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 204 len: 0 microversion: 2.26 time: 0.126948 Sep 10 20:55:35.948775 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 950/1965] 10.222.0.33 () {60 vars in 1295 bytes} [Sat Sep 10 20:55:35 2022] DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:35.958712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-224f38e3-685c-42ef-9675-d250d7202f75 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f99445c5280>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:35.988445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-224f38e3-685c-42ef-9675-d250d7202f75 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:35.988951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-224f38e3-685c-42ef-9675-d250d7202f75 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:35.989399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-224f38e3-685c-42ef-9675-d250d7202f75 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.002402 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-224f38e3-685c-42ef-9675-d250d7202f75 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 200 len: 12 microversion: 2.26 time: 0.047941 Sep 10 20:55:36.004462 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 951/1966] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Sep 10 20:55:35 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:36.013848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f994452b670>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:36.022290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.022776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.023220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.023692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:36.030310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.030801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.031235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.031930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.032731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.032906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.059853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.060285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.060730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.072398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:36.098983 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c14c7da4-6ea8-4dd1-a181-f913b84427fc tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 204 len: 0 microversion: 2.26 time: 0.089601 Sep 10 20:55:36.107285 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 952/1967] 10.222.0.33 () {60 vars in 1295 bytes} [Sat Sep 10 20:55:36 2022] DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:36.114959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f9944d35040>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:36.134204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.134692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.135419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.136056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:36.147209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.147711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.148159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.148861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.149345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.149730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.251018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.251695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.252301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.264237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.266416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.280315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.333676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:36.387325 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-122afb30-1d4d-40b2-9d85-1483ef16fdb3 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-1614779494" status: 201 len: 0 microversion: 2.26 time: 0.270189 Sep 10 20:55:36.389442 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 953/1968] 10.222.0.33 () {62 vars in 1380 bytes} [Sat Sep 10 20:55:36 2022] PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-1614779494 => generated 0 bytes in 282 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 10 20:55:36.397507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e638713c-56c0-4396-bb3d-65adcbb7cd0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:36.398903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e638713c-56c0-4396-bb3d-65adcbb7cd0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:36.412228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e638713c-56c0-4396-bb3d-65adcbb7cd0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.413236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e638713c-56c0-4396-bb3d-65adcbb7cd0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.414354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e638713c-56c0-4396-bb3d-65adcbb7cd0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.415392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e638713c-56c0-4396-bb3d-65adcbb7cd0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.416089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e638713c-56c0-4396-bb3d-65adcbb7cd0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.417301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e638713c-56c0-4396-bb3d-65adcbb7cd0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.545506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-72a89ad7-b260-4892-bd39-eb389488b7cc tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:36.556624 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-72a89ad7-b260-4892-bd39-eb389488b7cc tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1370 microversion: 2.1 time: 0.825002 Sep 10 20:55:36.558754 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1016/1969] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:35 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1370 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:36.564300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1fd9d7a5-28f2-441c-be14-40cc4cc57e48 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:36.565018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1fd9d7a5-28f2-441c-be14-40cc4cc57e48 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:36.575035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fd9d7a5-28f2-441c-be14-40cc4cc57e48 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.575549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fd9d7a5-28f2-441c-be14-40cc4cc57e48 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.575991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fd9d7a5-28f2-441c-be14-40cc4cc57e48 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.578169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fd9d7a5-28f2-441c-be14-40cc4cc57e48 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.578889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fd9d7a5-28f2-441c-be14-40cc4cc57e48 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.579517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fd9d7a5-28f2-441c-be14-40cc4cc57e48 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.928120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e638713c-56c0-4396-bb3d-65adcbb7cd0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:36.945625 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e638713c-56c0-4396-bb3d-65adcbb7cd0d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1474 microversion: 2.1 time: 0.553786 Sep 10 20:55:36.946636 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 954/1970] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:36 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1474 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:36.970813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f5e3f714-bde9-4397-8dd7-1da03085acbd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abc672b3-ff69-41aa-999c-f3efe68b8e69"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:36.973883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f5e3f714-bde9-4397-8dd7-1da03085acbd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:36.982557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5e3f714-bde9-4397-8dd7-1da03085acbd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.983056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5e3f714-bde9-4397-8dd7-1da03085acbd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.983492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5e3f714-bde9-4397-8dd7-1da03085acbd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:36.984213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5e3f714-bde9-4397-8dd7-1da03085acbd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:36.984664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5e3f714-bde9-4397-8dd7-1da03085acbd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:36.985083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5e3f714-bde9-4397-8dd7-1da03085acbd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.268612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1fd9d7a5-28f2-441c-be14-40cc4cc57e48 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:37.278129 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1fd9d7a5-28f2-441c-be14-40cc4cc57e48 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 0.717685 Sep 10 20:55:37.279044 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1017/1971] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:36 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:37.284895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f9949681310>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:37.301225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.301892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.302684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.303324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:37.309674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.310226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.310668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.311365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.311821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.312249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.340237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.340719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.341160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.351162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.351642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.352079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.378125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:37.394939 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0fa0da5b-d1ae-4d87-86f1-e7f6f9884232 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-890237605" status: 201 len: 0 microversion: 2.26 time: 0.114794 Sep 10 20:55:37.395509 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1018/1972] 10.222.0.33 () {62 vars in 1377 bytes} [Sat Sep 10 20:55:37 2022] PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags/tempest-tag-890237605 => generated 0 bytes in 116 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 10 20:55:37.400864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:37.402086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 662c3986-cb45-4c9f-a1cf-55a8230ac15a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:37.409879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.410442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.411087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.412423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.412779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.413207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.431652 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] HTTP exception thrown: Instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a could not be found. Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Request method failure captured: Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a HTTP/1.1 Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhvlcO4qle-WKUx9tRkOJFC0RqEhNmKoEL9cIlOPfkx2A87LtTAL4EC1h4nWqZefGKX9BSSoYkvFVsNaSBrkwTp5kqQTlGVXHRPWemD4Wzm-LsDm7ektMICHYp6pc5tKlbfRLhCtVgBYVasQ11jWTr1Tvrk1sDiiVnMSoF4JaK5rys Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5bd065954b0e4520a3c1deba0916db85 Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd065954b0e4520a3c1deba0916db85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd065954b0e4520a3c1deba0916db85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5bd065954b0e4520a3c1deba0916db85", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5bd065954b0e4520a3c1deba0916db85"}]}] Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5bd065954b0e4520a3c1deba0916db85 Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-LiveMigrationTest-1321581955-project Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f74a2c8cd22c454fa8fdd7c2e1ef9230 Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-LiveMigrationTest-1321581955-project Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a could not be found. Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '662c3986-cb45-4c9f-a1cf-55a8230ac15a'} Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a could not be found. Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a could not be found. Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:37.434469 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:37.440518 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:37.440518 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:37.440518 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:37.440518 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:37.440518 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:37.440518 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a could not be found. Sep 10 20:55:37.440518 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:37.440518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Returning 404 to user: Instance 662c3986-cb45-4c9f-a1cf-55a8230ac15a could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:37.440518 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3793fe5-8e51-4024-b292-52096b1d3667 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a" status: 404 len: 111 microversion: 2.1 time: 0.039569 Sep 10 20:55:37.440518 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1019/1973] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:37 2022] GET /compute/v2.1/servers/662c3986-cb45-4c9f-a1cf-55a8230ac15a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:55:37.442488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Action: 'update_all', calling method: .version_select at 0x7f9944896670>, body: {"tags": ["tempest-tag-2003339299", "tempest-tag-1500225100"]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:37.453712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.454243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.454717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.455373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:37.461987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.462769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.463314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.464540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.465026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.465494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.492529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.493012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.493444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.515384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:37.532712 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ebde6d0e-fe12-42e2-8d9d-c1f5886e892b tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 200 len: 62 microversion: 2.26 time: 0.094805 Sep 10 20:55:37.533389 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1020/1974] 10.222.0.33 () {62 vars in 1312 bytes} [Sat Sep 10 20:55:37 2022] PUT /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 62 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:37.543388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b5b5dd94-6ea0-48ce-93db-5b3879af1296 req-454c1ebf-93f4-412b-8f2f-1172953290b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e7f8366-d0bc-4854-b822-a6775d0dc931", "tag": "a59227ae-40ff-48e2-ad01-586a234173ca"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:37.553850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b5b5dd94-6ea0-48ce-93db-5b3879af1296 req-454c1ebf-93f4-412b-8f2f-1172953290b5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.554462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b5b5dd94-6ea0-48ce-93db-5b3879af1296 req-454c1ebf-93f4-412b-8f2f-1172953290b5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.554729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b5b5dd94-6ea0-48ce-93db-5b3879af1296 req-454c1ebf-93f4-412b-8f2f-1172953290b5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.566718 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b5b5dd94-6ea0-48ce-93db-5b3879af1296 req-454c1ebf-93f4-412b-8f2f-1172953290b5 service nova] Creating event network-changed:a59227ae-40ff-48e2-ad01-586a234173ca for instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 on nch1-master-1 Sep 10 20:55:37.571106 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b5b5dd94-6ea0-48ce-93db-5b3879af1296 req-454c1ebf-93f4-412b-8f2f-1172953290b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036510 Sep 10 20:55:37.571705 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1021/1975] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:37.577149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0d8ef694-4b43-4812-baa8-4a74ed6e74a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '.version_select at 0x7f9944896040>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:37.601693 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0d8ef694-4b43-4812-baa8-4a74ed6e74a2 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298009359" status: 202 len: 0 microversion: 2.1 time: 0.028788 Sep 10 20:55:37.602524 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1022/1976] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 20:55:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298009359 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:55:37.616761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5c787593-2d6c-49be-aff8-9d153108b98c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f9949681310>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:37.641154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c787593-2d6c-49be-aff8-9d153108b98c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.641773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c787593-2d6c-49be-aff8-9d153108b98c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.642337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c787593-2d6c-49be-aff8-9d153108b98c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.657565 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5c787593-2d6c-49be-aff8-9d153108b98c tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 200 len: 62 microversion: 2.26 time: 0.054108 Sep 10 20:55:37.658645 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1023/1977] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Sep 10 20:55:37 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 62 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:37.665776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f39d7012-fdf8-4ea6-9af5-c10fd059f0a7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:37.667840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f39d7012-fdf8-4ea6-9af5-c10fd059f0a7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:37.675122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f39d7012-fdf8-4ea6-9af5-c10fd059f0a7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.675575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f39d7012-fdf8-4ea6-9af5-c10fd059f0a7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.676454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f39d7012-fdf8-4ea6-9af5-c10fd059f0a7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.677291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f39d7012-fdf8-4ea6-9af5-c10fd059f0a7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.677814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f39d7012-fdf8-4ea6-9af5-c10fd059f0a7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.678384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f39d7012-fdf8-4ea6-9af5-c10fd059f0a7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.927599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f39d7012-fdf8-4ea6-9af5-c10fd059f0a7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:37.945041 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f39d7012-fdf8-4ea6-9af5-c10fd059f0a7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1370 microversion: 2.1 time: 0.281308 Sep 10 20:55:37.946143 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1024/1978] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:37 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1370 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:37.951805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '.version_select at 0x7f994958f280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:37.957922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:37.966560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.968206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.970492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.971122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:37.984428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.986456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.986919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:37.987873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:37.988557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:37.988935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.023181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.023810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.024255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.049162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'flavor' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:38.078394 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8cddd721-888e-4066-82b8-285b57560fb8 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags" status: 204 len: 0 microversion: 2.26 time: 0.130224 Sep 10 20:55:38.079307 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1025/1979] 10.222.0.33 () {60 vars in 1295 bytes} [Sat Sep 10 20:55:37 2022] DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615/tags => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:38.095032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-383d24fc-3871-4387-9fba-8e7c81f2229d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:38.095704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-383d24fc-3871-4387-9fba-8e7c81f2229d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:38.106864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-383d24fc-3871-4387-9fba-8e7c81f2229d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.108012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-383d24fc-3871-4387-9fba-8e7c81f2229d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.109701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-383d24fc-3871-4387-9fba-8e7c81f2229d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.110062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-383d24fc-3871-4387-9fba-8e7c81f2229d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.110561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-383d24fc-3871-4387-9fba-8e7c81f2229d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.111135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-383d24fc-3871-4387-9fba-8e7c81f2229d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.426058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-383d24fc-3871-4387-9fba-8e7c81f2229d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:38.429619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:38.436495 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-383d24fc-3871-4387-9fba-8e7c81f2229d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1472 microversion: 2.1 time: 0.353513 Sep 10 20:55:38.437655 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1026/1980] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:38 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1472 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:38.452650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4444e7ae-ef70-4fc5-bf7d-eb709eaaf111 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:38.453161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4444e7ae-ef70-4fc5-bf7d-eb709eaaf111 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:38.460882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4444e7ae-ef70-4fc5-bf7d-eb709eaaf111 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.461599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4444e7ae-ef70-4fc5-bf7d-eb709eaaf111 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.462301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4444e7ae-ef70-4fc5-bf7d-eb709eaaf111 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.463138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4444e7ae-ef70-4fc5-bf7d-eb709eaaf111 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.464350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4444e7ae-ef70-4fc5-bf7d-eb709eaaf111 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.464781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4444e7ae-ef70-4fc5-bf7d-eb709eaaf111 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.495143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4444e7ae-ef70-4fc5-bf7d-eb709eaaf111 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:55:38.581484 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4444e7ae-ef70-4fc5-bf7d-eb709eaaf111 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 204 len: 0 microversion: 2.26 time: 0.141873 Sep 10 20:55:38.582223 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1027/1981] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:55:38 2022] DELETE /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:55:38.589090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d43870a-3ece-4225-b0a3-e5adfb670f85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:38.590007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7d43870a-3ece-4225-b0a3-e5adfb670f85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:38.595934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43870a-3ece-4225-b0a3-e5adfb670f85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.596491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43870a-3ece-4225-b0a3-e5adfb670f85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.597191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43870a-3ece-4225-b0a3-e5adfb670f85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.597954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43870a-3ece-4225-b0a3-e5adfb670f85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.598414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43870a-3ece-4225-b0a3-e5adfb670f85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.598836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43870a-3ece-4225-b0a3-e5adfb670f85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.816283 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f5e3f714-bde9-4397-8dd7-1da03085acbd tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "POST /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.856170 Sep 10 20:55:38.816943 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 955/1982] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 20:55:36 2022] POST /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments => generated 194 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:38.822842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-48fd1b5f-4bbb-48b6-b01d-a9fe98e4c99c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:38.823981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-48fd1b5f-4bbb-48b6-b01d-a9fe98e4c99c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:38.831388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48fd1b5f-4bbb-48b6-b01d-a9fe98e4c99c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.832412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48fd1b5f-4bbb-48b6-b01d-a9fe98e4c99c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.833149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48fd1b5f-4bbb-48b6-b01d-a9fe98e4c99c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.834058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48fd1b5f-4bbb-48b6-b01d-a9fe98e4c99c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.835013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48fd1b5f-4bbb-48b6-b01d-a9fe98e4c99c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.835701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48fd1b5f-4bbb-48b6-b01d-a9fe98e4c99c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.882230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-48fd1b5f-4bbb-48b6-b01d-a9fe98e4c99c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:55:38.922855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7d43870a-3ece-4225-b0a3-e5adfb670f85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:38.950126 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7d43870a-3ece-4225-b0a3-e5adfb670f85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 0.366129 Sep 10 20:55:38.951009 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1028/1983] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:38 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:38.957483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:38.958174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:38.967204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.967908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.968294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:38.969021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:38.970556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:38.970556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:39.064383 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-48fd1b5f-4bbb-48b6-b01d-a9fe98e4c99c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 204 len: 0 microversion: 2.1 time: 0.242572 Sep 10 20:55:39.066738 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 956/1984] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:55:38 2022] DELETE /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:55:39.079460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-86058ba7-39a6-4810-92a7-74634ab512c3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:39.080588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-86058ba7-39a6-4810-92a7-74634ab512c3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:39.093903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86058ba7-39a6-4810-92a7-74634ab512c3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:39.094849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86058ba7-39a6-4810-92a7-74634ab512c3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:39.095862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86058ba7-39a6-4810-92a7-74634ab512c3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:39.097673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86058ba7-39a6-4810-92a7-74634ab512c3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:39.098379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86058ba7-39a6-4810-92a7-74634ab512c3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:39.099148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86058ba7-39a6-4810-92a7-74634ab512c3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:39.128016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:39.302360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:39.313084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:39.314940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:39.316445 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5833696f-3d63-4966-a722-d226c0031a49 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1550 microversion: 2.26 time: 0.364493 Sep 10 20:55:39.317220 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1029/1985] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:38 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1550 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:39.326910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-468206a9-8df5-46e8-b691-55a5a1dd562b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:39.327830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-468206a9-8df5-46e8-b691-55a5a1dd562b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:39.334903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-468206a9-8df5-46e8-b691-55a5a1dd562b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:39.335642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-468206a9-8df5-46e8-b691-55a5a1dd562b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:39.336260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-468206a9-8df5-46e8-b691-55a5a1dd562b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:39.337130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-468206a9-8df5-46e8-b691-55a5a1dd562b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:39.337741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-468206a9-8df5-46e8-b691-55a5a1dd562b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:39.338787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-468206a9-8df5-46e8-b691-55a5a1dd562b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:39.538255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-86058ba7-39a6-4810-92a7-74634ab512c3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:39.549442 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-86058ba7-39a6-4810-92a7-74634ab512c3 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1370 microversion: 2.1 time: 0.480600 Sep 10 20:55:39.550546 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 957/1986] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:39 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1370 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:39.556665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5a738981-054f-4ea8-bbcd-99126546a2c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:39.558624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5a738981-054f-4ea8-bbcd-99126546a2c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:39.568452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a738981-054f-4ea8-bbcd-99126546a2c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:39.570323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a738981-054f-4ea8-bbcd-99126546a2c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:39.571082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a738981-054f-4ea8-bbcd-99126546a2c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:39.573859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a738981-054f-4ea8-bbcd-99126546a2c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:39.575028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a738981-054f-4ea8-bbcd-99126546a2c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:39.575690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a738981-054f-4ea8-bbcd-99126546a2c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:39.612247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-468206a9-8df5-46e8-b691-55a5a1dd562b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:39.625072 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-468206a9-8df5-46e8-b691-55a5a1dd562b tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1484 microversion: 2.1 time: 0.300088 Sep 10 20:55:39.627519 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1030/1987] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:39 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1484 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:39.947091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5a738981-054f-4ea8-bbcd-99126546a2c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:39.961588 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5a738981-054f-4ea8-bbcd-99126546a2c2 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1469 microversion: 2.1 time: 0.409879 Sep 10 20:55:39.967664 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 958/1988] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:39 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1469 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:39.995851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c69c3cff-346d-48a0-a4e5-e7efaf15ccbe tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:39.997289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c69c3cff-346d-48a0-a4e5-e7efaf15ccbe tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:39.998224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0bea7354-ff32-460b-a7aa-913366ad7b1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:39.998954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0bea7354-ff32-460b-a7aa-913366ad7b1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:40.007743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bea7354-ff32-460b-a7aa-913366ad7b1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:40.008677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bea7354-ff32-460b-a7aa-913366ad7b1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:40.009452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bea7354-ff32-460b-a7aa-913366ad7b1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:40.009938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69c3cff-346d-48a0-a4e5-e7efaf15ccbe tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:40.011444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bea7354-ff32-460b-a7aa-913366ad7b1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:40.012229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bea7354-ff32-460b-a7aa-913366ad7b1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:40.012944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bea7354-ff32-460b-a7aa-913366ad7b1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:40.013093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69c3cff-346d-48a0-a4e5-e7efaf15ccbe tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:40.013513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69c3cff-346d-48a0-a4e5-e7efaf15ccbe tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:40.014343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:40.014491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69c3cff-346d-48a0-a4e5-e7efaf15ccbe tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:40.014842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69c3cff-346d-48a0-a4e5-e7efaf15ccbe tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:40.015265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69c3cff-346d-48a0-a4e5-e7efaf15ccbe tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:40.233709 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0bea7354-ff32-460b-a7aa-913366ad7b1b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "POST /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa/action" status: 202 len: 0 microversion: 2.1 time: 0.241073 Sep 10 20:55:40.237879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 959/1989] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:55:39 2022] POST /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:55:40.251888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-001b450c-db57-44b3-9471-7764bd3dd81a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:40.253472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-001b450c-db57-44b3-9471-7764bd3dd81a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:40.266478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:40.280550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c69c3cff-346d-48a0-a4e5-e7efaf15ccbe tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:40.282540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-001b450c-db57-44b3-9471-7764bd3dd81a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:40.283263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-001b450c-db57-44b3-9471-7764bd3dd81a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:40.284784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-001b450c-db57-44b3-9471-7764bd3dd81a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:40.288123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-001b450c-db57-44b3-9471-7764bd3dd81a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:40.288893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-001b450c-db57-44b3-9471-7764bd3dd81a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:40.289694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-001b450c-db57-44b3-9471-7764bd3dd81a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:40.293250 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c69c3cff-346d-48a0-a4e5-e7efaf15ccbe tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 0.319327 Sep 10 20:55:40.295391 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1031/1990] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:39 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:40.351277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:40.352101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:40.377326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:40.378085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:40.378827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:40.379548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:40.380176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:40.380851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:40.413559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:40.875168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:40.896412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:40.899369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:40.902835 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-013af62d-a799-4f82-82ee-ec8609d3b9fa tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1550 microversion: 2.26 time: 0.559502 Sep 10 20:55:40.905019 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1032/1991] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:40 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1550 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:55:40.912346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a43485ec-0eb3-4240-b838-0b4747c65c89 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:40.913399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a43485ec-0eb3-4240-b838-0b4747c65c89 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:40.923284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a43485ec-0eb3-4240-b838-0b4747c65c89 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:40.940354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a43485ec-0eb3-4240-b838-0b4747c65c89 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:40.940673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a43485ec-0eb3-4240-b838-0b4747c65c89 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:40.941724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a43485ec-0eb3-4240-b838-0b4747c65c89 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:40.942506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a43485ec-0eb3-4240-b838-0b4747c65c89 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:40.943762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a43485ec-0eb3-4240-b838-0b4747c65c89 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:41.265283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-001b450c-db57-44b3-9471-7764bd3dd81a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:41.277415 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-001b450c-db57-44b3-9471-7764bd3dd81a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 1.037861 Sep 10 20:55:41.284194 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 960/1992] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:40 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:41.289848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fad94b60-6be2-422b-a23f-8f77abd25b85 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:41.290489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fad94b60-6be2-422b-a23f-8f77abd25b85 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:41.312730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad94b60-6be2-422b-a23f-8f77abd25b85 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:41.313246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad94b60-6be2-422b-a23f-8f77abd25b85 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:41.314008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad94b60-6be2-422b-a23f-8f77abd25b85 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:41.315393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad94b60-6be2-422b-a23f-8f77abd25b85 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:41.321095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad94b60-6be2-422b-a23f-8f77abd25b85 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:41.321992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fad94b60-6be2-422b-a23f-8f77abd25b85 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:41.416527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a43485ec-0eb3-4240-b838-0b4747c65c89 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:41.427634 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a43485ec-0eb3-4240-b838-0b4747c65c89 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1370 microversion: 2.1 time: 0.520750 Sep 10 20:55:41.428241 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1033/1993] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:40 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1370 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:41.451494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c96799aa-907b-40c2-9fd2-977ef1b5f08d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:41.452449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c96799aa-907b-40c2-9fd2-977ef1b5f08d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:41.460692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c96799aa-907b-40c2-9fd2-977ef1b5f08d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:41.461384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c96799aa-907b-40c2-9fd2-977ef1b5f08d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:41.462068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c96799aa-907b-40c2-9fd2-977ef1b5f08d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:41.463096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c96799aa-907b-40c2-9fd2-977ef1b5f08d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:41.464300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c96799aa-907b-40c2-9fd2-977ef1b5f08d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:41.465026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c96799aa-907b-40c2-9fd2-977ef1b5f08d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:41.727962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c96799aa-907b-40c2-9fd2-977ef1b5f08d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:41.740329 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c96799aa-907b-40c2-9fd2-977ef1b5f08d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 0.293850 Sep 10 20:55:41.758090 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1034/1994] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:41 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:41.935906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:41.937706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:41.952099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:41.952879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:41.953574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:41.955193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:41.958447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:41.959082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:41.991604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fad94b60-6be2-422b-a23f-8f77abd25b85 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:42.012786 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fad94b60-6be2-422b-a23f-8f77abd25b85 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1484 microversion: 2.1 time: 0.727374 Sep 10 20:55:42.013720 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 961/1995] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:41 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1484 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:42.018433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c8552290-5b4b-46c7-86d9-b6b9819f65ed req-be14f930-6d08-40fc-839d-08299512227c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6b8ddf-a7d9-4698-9bb8-159ce02769dc", "name": "network-vif-deleted", "tag": "6cd39c03-2619-4e42-b3c9-3bc146a98c89"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:42.038722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c8552290-5b4b-46c7-86d9-b6b9819f65ed req-be14f930-6d08-40fc-839d-08299512227c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:42.039753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c8552290-5b4b-46c7-86d9-b6b9819f65ed req-be14f930-6d08-40fc-839d-08299512227c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:42.042146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c8552290-5b4b-46c7-86d9-b6b9819f65ed req-be14f930-6d08-40fc-839d-08299512227c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:42.074895 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c8552290-5b4b-46c7-86d9-b6b9819f65ed req-be14f930-6d08-40fc-839d-08299512227c service nova] Creating event network-vif-deleted:6cd39c03-2619-4e42-b3c9-3bc146a98c89 for instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc on nch2-master-1 Sep 10 20:55:42.081412 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c8552290-5b4b-46c7-86d9-b6b9819f65ed req-be14f930-6d08-40fc-839d-08299512227c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066219 Sep 10 20:55:42.083370 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 962/1996] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:42.154490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-9683993f-1d3b-4cfe-89ab-7d67b33ca972 req-09ad9296-db24-407c-b11c-b4505a62fb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fb692b-5186-4333-ad32-a567de472d62", "name": "network-vif-plugged", "status": "completed", "tag": "4e3266c3-685c-4364-9c48-5e262bf043c6"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:42.180630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9683993f-1d3b-4cfe-89ab-7d67b33ca972 req-09ad9296-db24-407c-b11c-b4505a62fb8b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:42.182358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9683993f-1d3b-4cfe-89ab-7d67b33ca972 req-09ad9296-db24-407c-b11c-b4505a62fb8b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:42.183010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9683993f-1d3b-4cfe-89ab-7d67b33ca972 req-09ad9296-db24-407c-b11c-b4505a62fb8b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:42.202622 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-9683993f-1d3b-4cfe-89ab-7d67b33ca972 req-09ad9296-db24-407c-b11c-b4505a62fb8b service nova] Creating event network-vif-plugged:4e3266c3-685c-4364-9c48-5e262bf043c6 for instance 37fb692b-5186-4333-ad32-a567de472d62 on nch1-master-1 Sep 10 20:55:42.211523 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-9683993f-1d3b-4cfe-89ab-7d67b33ca972 req-09ad9296-db24-407c-b11c-b4505a62fb8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060784 Sep 10 20:55:42.212658 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 963/1997] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:55:42.271907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:42.285971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:42.288484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:42.291214 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f53be7b-e800-4f5b-9470-539f25885bf6 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1550 microversion: 2.26 time: 0.360024 Sep 10 20:55:42.305714 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1035/1998] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:41 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1550 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:55:42.315675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2b18950-2d0f-461c-9af0-c4fb6447e01c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:42.317246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c2b18950-2d0f-461c-9af0-c4fb6447e01c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:42.365138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2b18950-2d0f-461c-9af0-c4fb6447e01c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:42.368443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2b18950-2d0f-461c-9af0-c4fb6447e01c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:42.368927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2b18950-2d0f-461c-9af0-c4fb6447e01c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:42.375443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2b18950-2d0f-461c-9af0-c4fb6447e01c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:42.378760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2b18950-2d0f-461c-9af0-c4fb6447e01c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:42.381385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2b18950-2d0f-461c-9af0-c4fb6447e01c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:42.461878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d280d5e7-02d9-4bf1-a564-1e4e17d07b3e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:42.462556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d280d5e7-02d9-4bf1-a564-1e4e17d07b3e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:42.476566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d280d5e7-02d9-4bf1-a564-1e4e17d07b3e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:42.478338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d280d5e7-02d9-4bf1-a564-1e4e17d07b3e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:42.479558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d280d5e7-02d9-4bf1-a564-1e4e17d07b3e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:42.482523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d280d5e7-02d9-4bf1-a564-1e4e17d07b3e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:42.484040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d280d5e7-02d9-4bf1-a564-1e4e17d07b3e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:42.484781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d280d5e7-02d9-4bf1-a564-1e4e17d07b3e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:42.707281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d280d5e7-02d9-4bf1-a564-1e4e17d07b3e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:42.716957 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d280d5e7-02d9-4bf1-a564-1e4e17d07b3e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1370 microversion: 2.1 time: 0.260524 Sep 10 20:55:42.717319 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1036/1999] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:42 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:42.773581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cdc07042-799a-4dab-adce-5c276cbea2be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:42.774235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cdc07042-799a-4dab-adce-5c276cbea2be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:42.781015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdc07042-799a-4dab-adce-5c276cbea2be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:42.781489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdc07042-799a-4dab-adce-5c276cbea2be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:42.782002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdc07042-799a-4dab-adce-5c276cbea2be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:42.782783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdc07042-799a-4dab-adce-5c276cbea2be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:42.783321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdc07042-799a-4dab-adce-5c276cbea2be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:42.783759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdc07042-799a-4dab-adce-5c276cbea2be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:42.983419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cdc07042-799a-4dab-adce-5c276cbea2be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:42.999745 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cdc07042-799a-4dab-adce-5c276cbea2be tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 0.230045 Sep 10 20:55:43.000837 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1037/2000] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:42 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:43.042362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:43.044874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:43.056036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:43.056617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:43.058892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:43.059880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:43.076246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:43.076963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:43.173625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:43.174613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:43.175989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:43.176726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lazy-loading 'fault' on Instance uuid 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:43.265349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:43.301413 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d3070624-7654-4a67-bd62-14d82977738c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 200 len: 1301 microversion: 2.1 time: 0.259067 Sep 10 20:55:43.302640 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1038/2001] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:43 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 1301 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:43.335123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:43.336063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:43.344628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:43.346415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:43.347090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:43.347926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:43.348600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:43.349328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:43.484527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:43.498888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:43.505818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:43.509454 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-84405e03-53a8-4256-88ad-f374fc3ac7e1 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1508 microversion: 2.26 time: 0.185290 Sep 10 20:55:43.514752 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1039/2002] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:43 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:43.533960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c2b18950-2d0f-461c-9af0-c4fb6447e01c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:43.548963 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c2b18950-2d0f-461c-9af0-c4fb6447e01c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 1.244099 Sep 10 20:55:43.550787 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 964/2003] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:42 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:43.596089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:43.625244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:43.628827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Searching by: {'deleted': False, 'project_id': 'bbee44bfe21341d295b8c2290f692085'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:55:43.667895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:43.671225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:43.671687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:43.672940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:43.673043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:43.673421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:43.773100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:55:43.843813 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a4c1554c-a6a0-4f9c-830c-7c1748970165 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.268226 Sep 10 20:55:43.844957 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1040/2004] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 20:55:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:43.861114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3aa7236f-0da1-4e27-bcb0-e6941b16dc40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:43.862006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3aa7236f-0da1-4e27-bcb0-e6941b16dc40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:43.873860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa7236f-0da1-4e27-bcb0-e6941b16dc40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:43.874671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa7236f-0da1-4e27-bcb0-e6941b16dc40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:43.875953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa7236f-0da1-4e27-bcb0-e6941b16dc40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:43.876825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa7236f-0da1-4e27-bcb0-e6941b16dc40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:43.877982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa7236f-0da1-4e27-bcb0-e6941b16dc40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:43.878435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa7236f-0da1-4e27-bcb0-e6941b16dc40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:43.883964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:44.096159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3aa7236f-0da1-4e27-bcb0-e6941b16dc40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:44.113235 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3aa7236f-0da1-4e27-bcb0-e6941b16dc40 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1370 microversion: 2.1 time: 0.266090 Sep 10 20:55:44.120010 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1041/2005] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:43 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:44.134199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:44.143534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:44.143741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9918f04d-f4d6-4970-898b-7de385f0535f"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:44.144331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Searching by: {'deleted': False, 'project_id': 'bbee44bfe21341d295b8c2290f692085'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:55:44.146152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:44.153702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.154524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.154926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.155080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.155870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.156630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.156787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.157192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.157469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.157740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.158424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.159156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.204031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:55:44.257958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:44.274234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.274741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.275201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.306294 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] HTTP exception thrown: Volume 9918f04d-f4d6-4970-898b-7de385f0535f could not be found. Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Request method failure captured: Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments/abc672b3-ff69-41aa-999c-f3efe68b8e69 HTTP/1.1 Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 74 Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPl3jZJoruk7E5vZLhJIiVrQoo2XwDiF7KOskL3TtXAkmheEj5-wJUj3BMVrUY9M6LJgfb5sDdEnU-2xHGfJsKdzh5g4QNjmQESJqiOI6zodpjn67ba-5pxyWnCLh37sC3nNqWBm9sB7js8z2rBpzYIipjaMiU66H8KCUoFSolT1Dtc Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 8d8536a456e94f5b842c0f9be5caf0ff Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-VolumesAdminNegativeTest-1848135853 Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d8536a456e94f5b842c0f9be5caf0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d8536a456e94f5b842c0f9be5caf0ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d8536a456e94f5b842c0f9be5caf0ff", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d8536a456e94f5b842c0f9be5caf0ff"}]}] Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-VolumesAdminNegativeTest-1848135853 Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 8d8536a456e94f5b842c0f9be5caf0ff Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1848135853 Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-VolumesAdminNegativeTest-1848135853-project-admin Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5fa4298166524e10a0cf869cdec9df34 Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-VolumesAdminNegativeTest-1848135853-project-admin Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: {"volumeAttachment": {"volumeId": "9918f04d-f4d6-4970-898b-7de385f0535f"}} Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: exception: Volume 9918f04d-f4d6-4970-898b-7de385f0535f could not be found. Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'server_id': 'cb03fb54-1b7b-42ec-b71b-b73d7f96b657', 'id': 'abc672b3-ff69-41aa-999c-f3efe68b8e69', 'body': {'volumeAttachment': {'volumeId': '9918f04d-f4d6-4970-898b-7de385f0535f'}}} Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9918f04d-f4d6-4970-898b-7de385f0535f could not be found. (HTTP 404) (Request-ID: req-a51283ae-676b-427a-bdda-8cae9e4ab2e1) Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 20:55:44.331113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9918f04d-f4d6-4970-898b-7de385f0535f could not be found. Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 9918f04d-f4d6-4970-898b-7de385f0535f could not be found. Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9918f04d-f4d6-4970-898b-7de385f0535f could not be found. Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Returning 400 to user: Volume 9918f04d-f4d6-4970-898b-7de385f0535f could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f35fbfbc-a985-4fa4-80ce-6eb9667742a6 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments/abc672b3-ff69-41aa-999c-f3efe68b8e69" status: 400 len: 107 microversion: 2.1 time: 0.679206 Sep 10 20:55:44.342054 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 965/2006] 10.222.0.33 () {60 vars in 1433 bytes} [Sat Sep 10 20:55:43 2022] PUT /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments/abc672b3-ff69-41aa-999c-f3efe68b8e69 => generated 107 bytes in 681 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 20:55:44.347843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e57bcc4-cbd9-44a7-bf53-e0405166c244 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:44.347843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e57bcc4-cbd9-44a7-bf53-e0405166c244 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:44.350555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e57bcc4-cbd9-44a7-bf53-e0405166c244 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.351367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e57bcc4-cbd9-44a7-bf53-e0405166c244 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.351505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e57bcc4-cbd9-44a7-bf53-e0405166c244 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.352185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e57bcc4-cbd9-44a7-bf53-e0405166c244 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.352908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e57bcc4-cbd9-44a7-bf53-e0405166c244 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.353391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e57bcc4-cbd9-44a7-bf53-e0405166c244 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.449151 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-430d35f4-89b9-46ea-a101-70459496c3af tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.326214 Sep 10 20:55:44.449757 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1042/2007] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:55:44 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:44.454897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-329d5661-8a7d-476d-889c-d668db51f87f req-4bf7c3b0-3550-4fc7-8fac-05b20d6a32eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c7829e-d133-4ea4-a691-b3d4bdb83615", "name": "network-vif-deleted", "tag": "08d65ec1-73e8-46bc-9046-eda5210e393e"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:44.475355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-329d5661-8a7d-476d-889c-d668db51f87f req-4bf7c3b0-3550-4fc7-8fac-05b20d6a32eb service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.475832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-329d5661-8a7d-476d-889c-d668db51f87f req-4bf7c3b0-3550-4fc7-8fac-05b20d6a32eb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.476267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-329d5661-8a7d-476d-889c-d668db51f87f req-4bf7c3b0-3550-4fc7-8fac-05b20d6a32eb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.489095 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-329d5661-8a7d-476d-889c-d668db51f87f req-4bf7c3b0-3550-4fc7-8fac-05b20d6a32eb service nova] Creating event network-vif-deleted:08d65ec1-73e8-46bc-9046-eda5210e393e for instance d7c7829e-d133-4ea4-a691-b3d4bdb83615 on nch1-master-1 Sep 10 20:55:44.495482 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-329d5661-8a7d-476d-889c-d668db51f87f req-4bf7c3b0-3550-4fc7-8fac-05b20d6a32eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043162 Sep 10 20:55:44.496503 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1043/2008] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:44.502448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-9f8d19d8-8b5d-497b-9e40-d560ab44a40a req-53e8f0b3-dcda-4e6b-a516-b7f940697332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ce24e3-3f43-497b-b523-e13026e634fa", "name": "network-vif-plugged", "status": "completed", "tag": "52761b52-5f8b-4ae4-9fd8-6bcc0382f796"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:44.514311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9f8d19d8-8b5d-497b-9e40-d560ab44a40a req-53e8f0b3-dcda-4e6b-a516-b7f940697332 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.514858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9f8d19d8-8b5d-497b-9e40-d560ab44a40a req-53e8f0b3-dcda-4e6b-a516-b7f940697332 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.515244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9f8d19d8-8b5d-497b-9e40-d560ab44a40a req-53e8f0b3-dcda-4e6b-a516-b7f940697332 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.537874 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-9f8d19d8-8b5d-497b-9e40-d560ab44a40a req-53e8f0b3-dcda-4e6b-a516-b7f940697332 service nova] Creating event network-vif-plugged:52761b52-5f8b-4ae4-9fd8-6bcc0382f796 for instance 58ce24e3-3f43-497b-b523-e13026e634fa on nch2-master-1 Sep 10 20:55:44.545477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-9f8d19d8-8b5d-497b-9e40-d560ab44a40a req-53e8f0b3-dcda-4e6b-a516-b7f940697332 service nova] Instance 58ce24e3-3f43-497b-b523-e13026e634fa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:55:44.556036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e57bcc4-cbd9-44a7-bf53-e0405166c244 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:44.557716 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-9f8d19d8-8b5d-497b-9e40-d560ab44a40a req-53e8f0b3-dcda-4e6b-a516-b7f940697332 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059499 Sep 10 20:55:44.558360 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1044/2009] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:44.566608 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e57bcc4-cbd9-44a7-bf53-e0405166c244 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 0.230663 Sep 10 20:55:44.567195 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 966/2010] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:44 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:44.570415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:44.571126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:44.577374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.577889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.578506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.579396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.580048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.580648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.583984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ee9e670-7687-43b5-b811-65e3ea1e9ccf tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:44.586382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0ee9e670-7687-43b5-b811-65e3ea1e9ccf tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:44.592716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee9e670-7687-43b5-b811-65e3ea1e9ccf tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.593249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee9e670-7687-43b5-b811-65e3ea1e9ccf tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.593948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee9e670-7687-43b5-b811-65e3ea1e9ccf tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.594708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee9e670-7687-43b5-b811-65e3ea1e9ccf tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.595210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee9e670-7687-43b5-b811-65e3ea1e9ccf tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.597185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee9e670-7687-43b5-b811-65e3ea1e9ccf tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.598572 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] HTTP exception thrown: Instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc could not be found. Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Request method failure captured: Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc HTTP/1.1 Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhvlcO4qle-WKUx9tRkOJFC0RqEhNmKoEL9cIlOPfkx2A87LtTAL4EC1h4nWqZefGKX9BSSoYkvFVsNaSBrkwTp5kqQTlGVXHRPWemD4Wzm-LsDm7ektMICHYp6pc5tKlbfRLhCtVgBYVasQ11jWTr1Tvrk1sDiiVnMSoF4JaK5rys Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5bd065954b0e4520a3c1deba0916db85 Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd065954b0e4520a3c1deba0916db85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd065954b0e4520a3c1deba0916db85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5bd065954b0e4520a3c1deba0916db85", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5bd065954b0e4520a3c1deba0916db85"}]}] Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5bd065954b0e4520a3c1deba0916db85 Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-LiveMigrationTest-1321581955-project Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f74a2c8cd22c454fa8fdd7c2e1ef9230 Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-LiveMigrationTest-1321581955-project Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc could not be found. Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5e6b8ddf-a7d9-4698-9bb8-159ce02769dc'} Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc could not be found. Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc could not be found. Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:44.600841 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.609017 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:44.609017 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:44.609017 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:44.609017 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:44.609017 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:44.609017 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc could not be found. Sep 10 20:55:44.609017 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:44.609017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Returning 404 to user: Instance 5e6b8ddf-a7d9-4698-9bb8-159ce02769dc could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:44.609017 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b16de03a-96ca-411b-9dd2-b8e432150753 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc" status: 404 len: 111 microversion: 2.1 time: 0.042398 Sep 10 20:55:44.609017 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1045/2011] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:44 2022] GET /compute/v2.1/servers/5e6b8ddf-a7d9-4698-9bb8-159ce02769dc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:55:44.612377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-514c3eb8-f3f1-4007-8856-72f8b3ca0584 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:44.621417 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-514c3eb8-f3f1-4007-8856-72f8b3ca0584 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017501 Sep 10 20:55:44.621961 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1046/2012] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:55:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:44.635436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:44.636216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:44.645546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.646758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.647319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.648375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.649227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.650098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.700381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.700901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.701428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.701990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'fault' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:44.716981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-0ee9e670-7687-43b5-b811-65e3ea1e9ccf tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lazy-loading 'services' on Instance uuid cb03fb54-1b7b-42ec-b71b-b73d7f96b657 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:44.767702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:44.779808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:44.781890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:44.783523 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e9da7ed-09c5-4c4c-ba85-f963df9ea7cd tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1351 microversion: 2.26 time: 0.152692 Sep 10 20:55:44.784374 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1047/2013] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:44 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:44.789965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0cf9bd57-ebb6-42ae-858d-2bb473fe167f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:44.790875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0cf9bd57-ebb6-42ae-858d-2bb473fe167f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:44.801534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cf9bd57-ebb6-42ae-858d-2bb473fe167f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.802186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cf9bd57-ebb6-42ae-858d-2bb473fe167f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.803155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cf9bd57-ebb6-42ae-858d-2bb473fe167f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.804566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cf9bd57-ebb6-42ae-858d-2bb473fe167f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.805167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cf9bd57-ebb6-42ae-858d-2bb473fe167f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.806499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cf9bd57-ebb6-42ae-858d-2bb473fe167f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.824905 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0ee9e670-7687-43b5-b811-65e3ea1e9ccf tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments/abc672b3-ff69-41aa-999c-f3efe68b8e69" status: 202 len: 0 microversion: 2.1 time: 0.255712 Sep 10 20:55:44.828753 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 967/2014] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 20:55:44 2022] DELETE /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments/abc672b3-ff69-41aa-999c-f3efe68b8e69 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:55:44.831244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-68b224dd-7144-412a-b2cf-0667f4228486 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:44.831826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-68b224dd-7144-412a-b2cf-0667f4228486 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:44.839668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68b224dd-7144-412a-b2cf-0667f4228486 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.840111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68b224dd-7144-412a-b2cf-0667f4228486 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.840555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68b224dd-7144-412a-b2cf-0667f4228486 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.841275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68b224dd-7144-412a-b2cf-0667f4228486 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:44.841727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68b224dd-7144-412a-b2cf-0667f4228486 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:44.842384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68b224dd-7144-412a-b2cf-0667f4228486 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:44.880274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-68b224dd-7144-412a-b2cf-0667f4228486 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:55:44.976469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0cf9bd57-ebb6-42ae-858d-2bb473fe167f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:44.983621 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-68b224dd-7144-412a-b2cf-0667f4228486 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 204 len: 0 microversion: 2.1 time: 0.156281 Sep 10 20:55:44.984308 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 968/2015] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:55:44 2022] DELETE /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:55:44.987578 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0cf9bd57-ebb6-42ae-858d-2bb473fe167f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 0.199064 Sep 10 20:55:44.988380 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1048/2016] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:44 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:44.993963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-30e49671-0000-46d1-a0b9-754502359b53 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:44.996340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-30e49671-0000-46d1-a0b9-754502359b53 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:45.002686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e49671-0000-46d1-a0b9-754502359b53 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.003499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e49671-0000-46d1-a0b9-754502359b53 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.004312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e49671-0000-46d1-a0b9-754502359b53 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.005035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e49671-0000-46d1-a0b9-754502359b53 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.005488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e49671-0000-46d1-a0b9-754502359b53 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.006077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e49671-0000-46d1-a0b9-754502359b53 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.072158 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-30e49671-0000-46d1-a0b9-754502359b53 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082669 Sep 10 20:55:45.073565 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1049/2017] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 20:55:44 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:45.078667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-41dd9c8c-eed9-472d-99e1-3cb4845b3f2c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:45.079372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-41dd9c8c-eed9-472d-99e1-3cb4845b3f2c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:45.085806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41dd9c8c-eed9-472d-99e1-3cb4845b3f2c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.086376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41dd9c8c-eed9-472d-99e1-3cb4845b3f2c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.087094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41dd9c8c-eed9-472d-99e1-3cb4845b3f2c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.087835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41dd9c8c-eed9-472d-99e1-3cb4845b3f2c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.089018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41dd9c8c-eed9-472d-99e1-3cb4845b3f2c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.089292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41dd9c8c-eed9-472d-99e1-3cb4845b3f2c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.117424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-41dd9c8c-eed9-472d-99e1-3cb4845b3f2c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:55:45.139589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cde44990-aa47-43e3-9e62-fe5444f76eb0 tempest-FlavorsV2NegativeTest-1544764585 tempest-FlavorsV2NegativeTest-1544764585-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:45.148312 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cde44990-aa47-43e3-9e62-fe5444f76eb0 tempest-FlavorsV2NegativeTest-1544764585 tempest-FlavorsV2NegativeTest-1544764585-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.162615 Sep 10 20:55:45.148897 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 969/2018] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:55:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:45.154958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ef2b4ef2-9842-4c21-8587-bfc5d7114582 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:45.155671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ef2b4ef2-9842-4c21-8587-bfc5d7114582 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:45.163593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef2b4ef2-9842-4c21-8587-bfc5d7114582 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.164097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef2b4ef2-9842-4c21-8587-bfc5d7114582 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.164600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef2b4ef2-9842-4c21-8587-bfc5d7114582 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.165300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef2b4ef2-9842-4c21-8587-bfc5d7114582 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.166594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef2b4ef2-9842-4c21-8587-bfc5d7114582 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.167387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef2b4ef2-9842-4c21-8587-bfc5d7114582 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.212314 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-41dd9c8c-eed9-472d-99e1-3cb4845b3f2c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 204 len: 0 microversion: 2.1 time: 0.136947 Sep 10 20:55:45.213042 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1050/2019] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:55:45 2022] DELETE /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:55:45.218704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a4109c0c-1688-4745-ba09-1c1308a86d64 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:45.219726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a4109c0c-1688-4745-ba09-1c1308a86d64 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:45.226526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4109c0c-1688-4745-ba09-1c1308a86d64 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.227024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4109c0c-1688-4745-ba09-1c1308a86d64 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.227471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4109c0c-1688-4745-ba09-1c1308a86d64 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.228194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4109c0c-1688-4745-ba09-1c1308a86d64 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.229568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4109c0c-1688-4745-ba09-1c1308a86d64 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.231413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4109c0c-1688-4745-ba09-1c1308a86d64 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.337264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ef2b4ef2-9842-4c21-8587-bfc5d7114582 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:45.349658 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ef2b4ef2-9842-4c21-8587-bfc5d7114582 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1500 microversion: 2.1 time: 0.199468 Sep 10 20:55:45.350935 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 970/2020] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:45 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1500 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:45.356159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f2eb1f2b-04de-4def-97f1-fa488bdd26e1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:45.356876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f2eb1f2b-04de-4def-97f1-fa488bdd26e1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:45.363942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2eb1f2b-04de-4def-97f1-fa488bdd26e1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.364424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2eb1f2b-04de-4def-97f1-fa488bdd26e1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.364943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2eb1f2b-04de-4def-97f1-fa488bdd26e1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.365715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2eb1f2b-04de-4def-97f1-fa488bdd26e1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.366469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2eb1f2b-04de-4def-97f1-fa488bdd26e1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.367217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2eb1f2b-04de-4def-97f1-fa488bdd26e1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.419292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a4109c0c-1688-4745-ba09-1c1308a86d64 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:45.434249 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a4109c0c-1688-4745-ba09-1c1308a86d64 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1564 microversion: 2.1 time: 0.219204 Sep 10 20:55:45.435648 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1051/2021] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:45 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1564 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:45.461562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9a6eadcd-02d4-4872-9ecc-43cd43b1e74a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:45.462294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9a6eadcd-02d4-4872-9ecc-43cd43b1e74a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:45.471279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a6eadcd-02d4-4872-9ecc-43cd43b1e74a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.472161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a6eadcd-02d4-4872-9ecc-43cd43b1e74a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.472800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a6eadcd-02d4-4872-9ecc-43cd43b1e74a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.473687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a6eadcd-02d4-4872-9ecc-43cd43b1e74a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.474253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a6eadcd-02d4-4872-9ecc-43cd43b1e74a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.474916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a6eadcd-02d4-4872-9ecc-43cd43b1e74a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.549322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f2eb1f2b-04de-4def-97f1-fa488bdd26e1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:45.559659 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f2eb1f2b-04de-4def-97f1-fa488bdd26e1 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1609 microversion: 2.1 time: 0.208115 Sep 10 20:55:45.560455 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 971/2022] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:45 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1609 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:45.572968 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9a6eadcd-02d4-4872-9ecc-43cd43b1e74a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117092 Sep 10 20:55:45.574055 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1052/2023] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 20:55:45 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:55:45.591379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c1ccfab9-32d8-4aeb-a62f-798cab48ae90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:45.592243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c1ccfab9-32d8-4aeb-a62f-798cab48ae90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:45.599814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1ccfab9-32d8-4aeb-a62f-798cab48ae90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.600382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1ccfab9-32d8-4aeb-a62f-798cab48ae90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.600828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1ccfab9-32d8-4aeb-a62f-798cab48ae90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.601559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1ccfab9-32d8-4aeb-a62f-798cab48ae90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.602241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1ccfab9-32d8-4aeb-a62f-798cab48ae90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.602906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1ccfab9-32d8-4aeb-a62f-798cab48ae90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.627700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:45.822867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:45.822867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:45.823406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.824592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.825552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.826239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.826842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.827262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.874969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:45.875461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:45.876003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:45.876808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'fault' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:45.945251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:45.965023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:45.965753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c1ccfab9-32d8-4aeb-a62f-798cab48ae90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:45.967553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:45.969739 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8115df0e-08c9-4cd0-a1e2-bbebebf5f01f tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1351 microversion: 2.26 time: 0.159732 Sep 10 20:55:45.971153 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1053/2024] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:45 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:45.976954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39a75d64-e5d6-42c0-9694-e2df61f1b461 tempest-FlavorsV2NegativeTest-1544764585 tempest-FlavorsV2NegativeTest-1544764585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1343806450", "imageRef": "c12f70ce-b12c-4e34-944c-491f0d797c77", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:45.988089 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c1ccfab9-32d8-4aeb-a62f-798cab48ae90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 0.401611 Sep 10 20:55:46.004903 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 972/2025] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:45 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:46.013002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9b89cb62-db33-46f1-a302-4775bd0a14ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:46.014757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9b89cb62-db33-46f1-a302-4775bd0a14ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:46.049575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b89cb62-db33-46f1-a302-4775bd0a14ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:46.052531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b89cb62-db33-46f1-a302-4775bd0a14ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:46.055606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b89cb62-db33-46f1-a302-4775bd0a14ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:46.056477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b89cb62-db33-46f1-a302-4775bd0a14ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:46.058469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b89cb62-db33-46f1-a302-4775bd0a14ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:46.059030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b89cb62-db33-46f1-a302-4775bd0a14ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:46.069109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-39a75d64-e5d6-42c0-9694-e2df61f1b461 tempest-FlavorsV2NegativeTest-1544764585 tempest-FlavorsV2NegativeTest-1544764585-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:55:46.296558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9b89cb62-db33-46f1-a302-4775bd0a14ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:46.306415 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9b89cb62-db33-46f1-a302-4775bd0a14ae tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 0.297813 Sep 10 20:55:46.307772 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 973/2026] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:46 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:46.313801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-84961614-e927-45bb-ae5a-4765c096c84b tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:46.316929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-84961614-e927-45bb-ae5a-4765c096c84b tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:46.327577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84961614-e927-45bb-ae5a-4765c096c84b tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:46.328481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84961614-e927-45bb-ae5a-4765c096c84b tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:46.329067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84961614-e927-45bb-ae5a-4765c096c84b tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:46.330304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84961614-e927-45bb-ae5a-4765c096c84b tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:46.331151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84961614-e927-45bb-ae5a-4765c096c84b tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:46.331813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84961614-e927-45bb-ae5a-4765c096c84b tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:46.378096 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-84961614-e927-45bb-ae5a-4765c096c84b tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068632 Sep 10 20:55:46.385319 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 974/2027] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 20:55:46 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:55:46.392215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23d54411-3380-43a2-b430-a38ae820cc3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:46.393972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23d54411-3380-43a2-b430-a38ae820cc3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:46.403175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23d54411-3380-43a2-b430-a38ae820cc3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:46.404103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23d54411-3380-43a2-b430-a38ae820cc3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:46.405231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23d54411-3380-43a2-b430-a38ae820cc3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:46.406261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23d54411-3380-43a2-b430-a38ae820cc3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:46.406985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23d54411-3380-43a2-b430-a38ae820cc3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:46.407659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23d54411-3380-43a2-b430-a38ae820cc3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:46.566716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-23d54411-3380-43a2-b430-a38ae820cc3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:46.583699 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23d54411-3380-43a2-b430-a38ae820cc3c tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1458 microversion: 2.1 time: 0.190451 Sep 10 20:55:46.584567 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 975/2028] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:46 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1458 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:46.589728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d8d2e7d1-412d-4819-8a9c-6791cee470ad tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:46.590385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d8d2e7d1-412d-4819-8a9c-6791cee470ad tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:46.604456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8d2e7d1-412d-4819-8a9c-6791cee470ad tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:46.605932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8d2e7d1-412d-4819-8a9c-6791cee470ad tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:46.608091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8d2e7d1-412d-4819-8a9c-6791cee470ad tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:46.608855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8d2e7d1-412d-4819-8a9c-6791cee470ad tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:46.609322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8d2e7d1-412d-4819-8a9c-6791cee470ad tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:46.609754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8d2e7d1-412d-4819-8a9c-6791cee470ad tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:46.786769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d8d2e7d1-412d-4819-8a9c-6791cee470ad tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:46.795475 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d8d2e7d1-412d-4819-8a9c-6791cee470ad tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1609 microversion: 2.1 time: 0.210006 Sep 10 20:55:46.796475 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 976/2029] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:46 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1609 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:46.817410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1651379977", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "e56ef167-3e3c-4aa6-b5ed-721994e8e64c"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:46.879503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] validate_networks() for [('e56ef167-3e3c-4aa6-b5ed-721994e8e64c', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:55:46.953379 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-39a75d64-e5d6-42c0-9694-e2df61f1b461 tempest-FlavorsV2NegativeTest-1544764585 tempest-FlavorsV2NegativeTest-1544764585-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39a75d64-e5d6-42c0-9694-e2df61f1b461 tempest-FlavorsV2NegativeTest-1544764585 tempest-FlavorsV2NegativeTest-1544764585-project] Request method failure captured: Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 143 Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPnQ49SI_yUFtX1PGiAD9gZJXWCUTuq44PbHcJ3vc2AfqDOtlWU-aNPvGHt0ACoEsWwGpfXUFQfD_LVF-ceTPHAaRMywxtx8hSRu3r4_e6ZTcLFopXzl_HmNwC-M4NlcJo5vgqNNZWkevERuu7vMeB4El10Oa_2VMx-Iu3li9XUtufs Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 20eb61ef39584111b731fe161b76ce04 Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-FlavorsV2NegativeTest-1544764585 Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/20eb61ef39584111b731fe161b76ce04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/20eb61ef39584111b731fe161b76ce04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_20eb61ef39584111b731fe161b76ce04", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/20eb61ef39584111b731fe161b76ce04"}]}] Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-FlavorsV2NegativeTest-1544764585 Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 20eb61ef39584111b731fe161b76ce04 Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1544764585 Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-FlavorsV2NegativeTest-1544764585-project Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4fb714744b77463393388561809eebea Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-FlavorsV2NegativeTest-1544764585-project Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1343806450", "imageRef": "c12f70ce-b12c-4e34-944c-491f0d797c77", "flavorRef": "452"}} Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: exception: Flavor's memory is too small for requested image. Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1343806450', 'imageRef': 'c12f70ce-b12c-4e34-944c-491f0d797c77', 'flavorRef': '452'}}} Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:55:46.955361 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39a75d64-e5d6-42c0-9694-e2df61f1b461 tempest-FlavorsV2NegativeTest-1544764585 tempest-FlavorsV2NegativeTest-1544764585-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-39a75d64-e5d6-42c0-9694-e2df61f1b461 tempest-FlavorsV2NegativeTest-1544764585 tempest-FlavorsV2NegativeTest-1544764585-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.984279 Sep 10 20:55:46.961421 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1054/2030] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:55:45 2022] POST /compute/v2.1/servers => generated 93 bytes in 986 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:55:46.968257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0e1c4bd8-966f-4663-a502-08556a76bf1f req-b1888ef4-3524-4a8e-b3dd-2fe978af1b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09798018-2269-451d-8486-df991ba45b0c", "name": "network-vif-deleted", "tag": "815af22b-692f-4103-b475-aa7f8e8118cd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:46.986650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0e1c4bd8-966f-4663-a502-08556a76bf1f req-b1888ef4-3524-4a8e-b3dd-2fe978af1b9f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:46.987425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0e1c4bd8-966f-4663-a502-08556a76bf1f req-b1888ef4-3524-4a8e-b3dd-2fe978af1b9f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:46.987966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0e1c4bd8-966f-4663-a502-08556a76bf1f req-b1888ef4-3524-4a8e-b3dd-2fe978af1b9f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.010612 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0e1c4bd8-966f-4663-a502-08556a76bf1f req-b1888ef4-3524-4a8e-b3dd-2fe978af1b9f service nova] Creating event network-vif-deleted:815af22b-692f-4103-b475-aa7f8e8118cd for instance 09798018-2269-451d-8486-df991ba45b0c on nch2-master-1 Sep 10 20:55:47.018164 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0e1c4bd8-966f-4663-a502-08556a76bf1f req-b1888ef4-3524-4a8e-b3dd-2fe978af1b9f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054218 Sep 10 20:55:47.020151 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1055/2031] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:47.026253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:47.027259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:47.035247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.036045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.036795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.037749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.038508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.049944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.099219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.100703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.102144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.102888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'fault' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:47.166940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:47.176779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:47.178282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:47.179489 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-53839dba-7186-4149-9179-9e6a08369348 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1351 microversion: 2.26 time: 0.157682 Sep 10 20:55:47.203160 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1056/2032] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:47 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1351 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:55:47.211818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5cd1cd8b-bfee-4bb0-a048-cf075d0a7f66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:47.212670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5cd1cd8b-bfee-4bb0-a048-cf075d0a7f66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:47.219262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cd1cd8b-bfee-4bb0-a048-cf075d0a7f66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.219671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cd1cd8b-bfee-4bb0-a048-cf075d0a7f66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.221279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cd1cd8b-bfee-4bb0-a048-cf075d0a7f66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.222700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cd1cd8b-bfee-4bb0-a048-cf075d0a7f66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.223901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cd1cd8b-bfee-4bb0-a048-cf075d0a7f66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.224519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5cd1cd8b-bfee-4bb0-a048-cf075d0a7f66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.447463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:55:47.449421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:55:47.451092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:55:47.451550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:55:47.451977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:55:47.462237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5cd1cd8b-bfee-4bb0-a048-cf075d0a7f66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:47.464755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.465619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.466482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.468227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.468890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.470264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.477673 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5cd1cd8b-bfee-4bb0-a048-cf075d0a7f66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 0.271128 Sep 10 20:55:47.491007 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1057/2033] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:47 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:47.503037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3902e937-397d-4a81-8285-5d0aa9dde3ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:47.504158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3902e937-397d-4a81-8285-5d0aa9dde3ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:47.513320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3902e937-397d-4a81-8285-5d0aa9dde3ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.514190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3902e937-397d-4a81-8285-5d0aa9dde3ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.514804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3902e937-397d-4a81-8285-5d0aa9dde3ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.515523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3902e937-397d-4a81-8285-5d0aa9dde3ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.516165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3902e937-397d-4a81-8285-5d0aa9dde3ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.516756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3902e937-397d-4a81-8285-5d0aa9dde3ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.525170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Getting quotas for project f2836de68f8546259ebb0649f7567c4f. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:55:47.532716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Getting quotas for user eff0636f25bb459cb92e0c733bb51df8 and project f2836de68f8546259ebb0649f7567c4f. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:55:47.549942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:55:47.553903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:55:47.626658 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-61717317-96e6-4dca-b436-fcfd7b01f2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813256 Sep 10 20:55:47.629014 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 977/2034] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:55:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:55:47.636690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:47.637578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:47.645351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.646080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.646686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.647640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.648266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.648860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.729547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.730911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.734696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.735436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lazy-loading 'fault' on Instance uuid 09798018-2269-451d-8486-df991ba45b0c {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:47.794930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3902e937-397d-4a81-8285-5d0aa9dde3ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:47.814039 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3902e937-397d-4a81-8285-5d0aa9dde3ba tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 0.321394 Sep 10 20:55:47.814759 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1058/2035] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:47 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:47.830981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f74a2c8cd22c454fa8fdd7c2e1ef9230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd065954b0e4520a3c1deba0916db85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:47.834627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ba2db141-f779-48a4-a69b-b1abdb0e8d14 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:47.835371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ba2db141-f779-48a4-a69b-b1abdb0e8d14 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:47.840731 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c5e120da-37fd-4e86-bf97-6f5c363b6015 tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 200 len: 1301 microversion: 2.1 time: 0.210456 Sep 10 20:55:47.847127 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 978/2036] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:47 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 1301 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:47.856546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-32ce34e4-bbb0-4781-a62a-7bc9fac74a43 req-fa0202cb-3e43-4b67-b6f6-7ccd84cc3f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37fb692b-5186-4333-ad32-a567de472d62", "tag": "4e3266c3-685c-4364-9c48-5e262bf043c6"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:47.898002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-32ce34e4-bbb0-4781-a62a-7bc9fac74a43 req-fa0202cb-3e43-4b67-b6f6-7ccd84cc3f78 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.898719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-32ce34e4-bbb0-4781-a62a-7bc9fac74a43 req-fa0202cb-3e43-4b67-b6f6-7ccd84cc3f78 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.900250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-32ce34e4-bbb0-4781-a62a-7bc9fac74a43 req-fa0202cb-3e43-4b67-b6f6-7ccd84cc3f78 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.932606 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-32ce34e4-bbb0-4781-a62a-7bc9fac74a43 req-fa0202cb-3e43-4b67-b6f6-7ccd84cc3f78 service nova] Creating event network-changed:4e3266c3-685c-4364-9c48-5e262bf043c6 for instance 37fb692b-5186-4333-ad32-a567de472d62 on nch1-master-1 Sep 10 20:55:47.948062 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-32ce34e4-bbb0-4781-a62a-7bc9fac74a43 req-fa0202cb-3e43-4b67-b6f6-7ccd84cc3f78 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095423 Sep 10 20:55:47.950247 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 979/2037] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:47.963484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6eec55ce-0569-411a-be09-fc958288428b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:47.964361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6eec55ce-0569-411a-be09-fc958288428b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:47.972812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6eec55ce-0569-411a-be09-fc958288428b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.973582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6eec55ce-0569-411a-be09-fc958288428b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.974319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6eec55ce-0569-411a-be09-fc958288428b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:47.976191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6eec55ce-0569-411a-be09-fc958288428b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:47.976895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6eec55ce-0569-411a-be09-fc958288428b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:47.977559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6eec55ce-0569-411a-be09-fc958288428b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:48.018204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ba2db141-f779-48a4-a69b-b1abdb0e8d14 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:48.026090 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ba2db141-f779-48a4-a69b-b1abdb0e8d14 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1218 microversion: 2.1 time: 0.207438 Sep 10 20:55:48.026693 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1059/2038] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:47 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1218 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:48.211657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:48.212671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:48.229343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:48.242471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:48.243258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:48.245797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:48.246509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:48.247424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:48.266345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:48.311505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6eec55ce-0569-411a-be09-fc958288428b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:48.325254 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6eec55ce-0569-411a-be09-fc958288428b tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1609 microversion: 2.1 time: 0.371278 Sep 10 20:55:48.340241 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 980/2039] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:47 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1609 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:48.351683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:48.352801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:48.353545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:48.355028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lazy-loading 'fault' on Instance uuid d7c7829e-d133-4ea4-a691-b3d4bdb83615 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:48.456403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:48.480579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:48.482640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7130068051c4688a7759ccbfbb134a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcd2501efc564e63834afc0a474d486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:48.486731 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5eb610c3-647f-4b77-91a0-cbb53027b5fe tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 200 len: 1351 microversion: 2.26 time: 0.280653 Sep 10 20:55:48.489780 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1060/2040] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:48 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 1351 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:55:48.507303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-406aa72f-6299-4acd-a3d9-e77d88b5e1e8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:48.508460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-406aa72f-6299-4acd-a3d9-e77d88b5e1e8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:48.521653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-406aa72f-6299-4acd-a3d9-e77d88b5e1e8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:48.524742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-406aa72f-6299-4acd-a3d9-e77d88b5e1e8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:48.525203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-406aa72f-6299-4acd-a3d9-e77d88b5e1e8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:48.527824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-406aa72f-6299-4acd-a3d9-e77d88b5e1e8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:48.530994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-406aa72f-6299-4acd-a3d9-e77d88b5e1e8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:48.534436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-406aa72f-6299-4acd-a3d9-e77d88b5e1e8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:48.846233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8b9643e9-6505-43e3-8f97-d679b43d0582 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:48.847792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8b9643e9-6505-43e3-8f97-d679b43d0582 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:48.852754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:48.872452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b9643e9-6505-43e3-8f97-d679b43d0582 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:48.874167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b9643e9-6505-43e3-8f97-d679b43d0582 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:48.874914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b9643e9-6505-43e3-8f97-d679b43d0582 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:48.876575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b9643e9-6505-43e3-8f97-d679b43d0582 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:48.878365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b9643e9-6505-43e3-8f97-d679b43d0582 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:48.879597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b9643e9-6505-43e3-8f97-d679b43d0582 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:49.213290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8b9643e9-6505-43e3-8f97-d679b43d0582 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:49.224434 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8b9643e9-6505-43e3-8f97-d679b43d0582 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 0.384064 Sep 10 20:55:49.225107 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1061/2041] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:48 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:49.248686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:49.249463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] [instance: 09798018-2269-451d-8486-df991ba45b0c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:49.256204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:49.257116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:49.257905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:49.259019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:49.259794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:49.260583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:49.279777 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] HTTP exception thrown: Instance 09798018-2269-451d-8486-df991ba45b0c could not be found. Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Request method failure captured: Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c HTTP/1.1 Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPhvlcO4qle-WKUx9tRkOJFC0RqEhNmKoEL9cIlOPfkx2A87LtTAL4EC1h4nWqZefGKX9BSSoYkvFVsNaSBrkwTp5kqQTlGVXHRPWemD4Wzm-LsDm7ektMICHYp6pc5tKlbfRLhCtVgBYVasQ11jWTr1Tvrk1sDiiVnMSoF4JaK5rys Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 5bd065954b0e4520a3c1deba0916db85 Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd065954b0e4520a3c1deba0916db85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd065954b0e4520a3c1deba0916db85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5bd065954b0e4520a3c1deba0916db85", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5bd065954b0e4520a3c1deba0916db85"}]}] Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 5bd065954b0e4520a3c1deba0916db85 Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-LiveMigrationTest-1321581955 Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-LiveMigrationTest-1321581955-project Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f74a2c8cd22c454fa8fdd7c2e1ef9230 Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-LiveMigrationTest-1321581955-project Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 09798018-2269-451d-8486-df991ba45b0c could not be found. Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '09798018-2269-451d-8486-df991ba45b0c'} Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09798018-2269-451d-8486-df991ba45b0c could not be found. Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09798018-2269-451d-8486-df991ba45b0c could not be found. Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:49.281573 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:49.287128 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:49.287128 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:49.287128 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:49.287128 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:49.287128 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:49.287128 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09798018-2269-451d-8486-df991ba45b0c could not be found. Sep 10 20:55:49.287128 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:55:49.287128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] Returning 404 to user: Instance 09798018-2269-451d-8486-df991ba45b0c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:49.287128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5b7a5c5b-87e0-4abb-af88-f1c5e6d441bc tempest-LiveMigrationTest-1321581955 tempest-LiveMigrationTest-1321581955-project] 10.222.0.33 "GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c" status: 404 len: 111 microversion: 2.1 time: 0.056646 Sep 10 20:55:49.287128 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1062/2042] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:49 2022] GET /compute/v2.1/servers/09798018-2269-451d-8486-df991ba45b0c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:55:49.294124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92385332-50c2-4659-8b80-de381d77e7fb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:49.295065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-92385332-50c2-4659-8b80-de381d77e7fb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:49.302238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92385332-50c2-4659-8b80-de381d77e7fb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:49.303008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92385332-50c2-4659-8b80-de381d77e7fb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:49.303619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92385332-50c2-4659-8b80-de381d77e7fb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:49.304542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92385332-50c2-4659-8b80-de381d77e7fb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:49.305173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92385332-50c2-4659-8b80-de381d77e7fb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:49.305776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92385332-50c2-4659-8b80-de381d77e7fb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:49.404799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-92385332-50c2-4659-8b80-de381d77e7fb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:49.414251 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-92385332-50c2-4659-8b80-de381d77e7fb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1214 microversion: 2.1 time: 0.125300 Sep 10 20:55:49.414858 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1063/2043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:49 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:49.434576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4a829bf-b03c-45c4-85a4-220475d2d69c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:49.435458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e4a829bf-b03c-45c4-85a4-220475d2d69c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:49.442665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4a829bf-b03c-45c4-85a4-220475d2d69c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:49.443391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4a829bf-b03c-45c4-85a4-220475d2d69c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:49.444237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4a829bf-b03c-45c4-85a4-220475d2d69c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:49.445186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4a829bf-b03c-45c4-85a4-220475d2d69c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:49.445814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4a829bf-b03c-45c4-85a4-220475d2d69c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:49.446448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4a829bf-b03c-45c4-85a4-220475d2d69c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:49.688804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-406aa72f-6299-4acd-a3d9-e77d88b5e1e8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:49.702467 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-406aa72f-6299-4acd-a3d9-e77d88b5e1e8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 1.194811 Sep 10 20:55:49.707084 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 981/2044] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:48 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:49.722177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:49.723205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] [instance: d7c7829e-d133-4ea4-a691-b3d4bdb83615] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:49.732723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:49.735334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:49.736529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:49.742603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:49.745934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:49.746678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:49.788034 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] HTTP exception thrown: Instance d7c7829e-d133-4ea4-a691-b3d4bdb83615 could not be found. Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Request method failure captured: Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 HTTP/1.1 Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPmwUccVMGOHdX_Iki1GKVietIJP2oYYYTiT0bHv34J3hyYWpV2lsxTgYKgvBMAW1GaM1WcN-Fbw5iWbAWoleWxiSs_pjtZdRnkzSCn_FMLf_Pz-AHaF4lDdoB3R4LRUSV7Tq2xJbB4jTOvRpaS2QuiPK3vBRsx6_6vW2FOA87yr9FU Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.26 Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: fcd2501efc564e63834afc0a474d486d Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerTagsTestJSON-1139553710 Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcd2501efc564e63834afc0a474d486d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcd2501efc564e63834afc0a474d486d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcd2501efc564e63834afc0a474d486d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcd2501efc564e63834afc0a474d486d"}]}] Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerTagsTestJSON-1139553710 Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: fcd2501efc564e63834afc0a474d486d Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerTagsTestJSON-1139553710 Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerTagsTestJSON-1139553710-project Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a7130068051c4688a7759ccbfbb134a9 Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerTagsTestJSON-1139553710-project Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance d7c7829e-d133-4ea4-a691-b3d4bdb83615 could not be found. Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'd7c7829e-d133-4ea4-a691-b3d4bdb83615'} Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c7829e-d133-4ea4-a691-b3d4bdb83615 could not be found. Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c7829e-d133-4ea4-a691-b3d4bdb83615 could not be found. Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:49.791028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:49.817475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:49.817475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:49.817475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:49.817475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:49.817475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:49.817475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c7829e-d133-4ea4-a691-b3d4bdb83615 could not be found. Sep 10 20:55:49.817475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:49.836906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] Returning 404 to user: Instance d7c7829e-d133-4ea4-a691-b3d4bdb83615 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:49.841674 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-567ef363-289e-4fdc-81f6-52ac1ae70c88 tempest-ServerTagsTestJSON-1139553710 tempest-ServerTagsTestJSON-1139553710-project] 10.222.0.33 "GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615" status: 404 len: 111 microversion: 2.26 time: 0.132556 Sep 10 20:55:49.847006 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 982/2045] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:55:49 2022] GET /compute/v2.1/servers/d7c7829e-d133-4ea4-a691-b3d4bdb83615 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:55:50.045974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-4365185d-21c9-4529-b663-2723c1dc5da5 req-22266958-367a-4d96-973d-3d2cdfbaff3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ce24e3-3f43-497b-b523-e13026e634fa", "name": "network-vif-unplugged", "status": "completed", "tag": "52761b52-5f8b-4ae4-9fd8-6bcc0382f796"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:50.066159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4a829bf-b03c-45c4-85a4-220475d2d69c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:50.072234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4365185d-21c9-4529-b663-2723c1dc5da5 req-22266958-367a-4d96-973d-3d2cdfbaff3d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:50.073732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4365185d-21c9-4529-b663-2723c1dc5da5 req-22266958-367a-4d96-973d-3d2cdfbaff3d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:50.076557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4365185d-21c9-4529-b663-2723c1dc5da5 req-22266958-367a-4d96-973d-3d2cdfbaff3d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:50.078499 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e4a829bf-b03c-45c4-85a4-220475d2d69c tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1609 microversion: 2.1 time: 0.662593 Sep 10 20:55:50.079096 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1064/2046] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:49 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1609 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:50.102784 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-4365185d-21c9-4529-b663-2723c1dc5da5 req-22266958-367a-4d96-973d-3d2cdfbaff3d service nova] Creating event network-vif-unplugged:52761b52-5f8b-4ae4-9fd8-6bcc0382f796 for instance 58ce24e3-3f43-497b-b523-e13026e634fa on nch1-master-1 Sep 10 20:55:50.116362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-4365185d-21c9-4529-b663-2723c1dc5da5 req-22266958-367a-4d96-973d-3d2cdfbaff3d service nova] Instance 58ce24e3-3f43-497b-b523-e13026e634fa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:55:50.145165 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-4365185d-21c9-4529-b663-2723c1dc5da5 req-22266958-367a-4d96-973d-3d2cdfbaff3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107799 Sep 10 20:55:50.145846 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 983/2047] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:55:50.250864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-602b880f-a939-4303-9823-0c4c55c6224e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:50.252596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-602b880f-a939-4303-9823-0c4c55c6224e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:50.268261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-602b880f-a939-4303-9823-0c4c55c6224e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:50.270060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-602b880f-a939-4303-9823-0c4c55c6224e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:50.270514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-602b880f-a939-4303-9823-0c4c55c6224e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:50.274355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-602b880f-a939-4303-9823-0c4c55c6224e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:50.275112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-602b880f-a939-4303-9823-0c4c55c6224e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:50.279237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-602b880f-a939-4303-9823-0c4c55c6224e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:50.293623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-73b3b713-16c8-41b7-8b73-c10e656462c4 req-4eafdafb-77c0-4073-a392-eef86fb09ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7f8366-d0bc-4854-b822-a6775d0dc931", "name": "network-vif-plugged", "status": "completed", "tag": "a59227ae-40ff-48e2-ad01-586a234173ca"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:50.325005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-73b3b713-16c8-41b7-8b73-c10e656462c4 req-4eafdafb-77c0-4073-a392-eef86fb09ddb service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:50.325602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-73b3b713-16c8-41b7-8b73-c10e656462c4 req-4eafdafb-77c0-4073-a392-eef86fb09ddb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:50.325947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-73b3b713-16c8-41b7-8b73-c10e656462c4 req-4eafdafb-77c0-4073-a392-eef86fb09ddb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:50.359658 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-73b3b713-16c8-41b7-8b73-c10e656462c4 req-4eafdafb-77c0-4073-a392-eef86fb09ddb service nova] Creating event network-vif-plugged:a59227ae-40ff-48e2-ad01-586a234173ca for instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 on nch1-master-1 Sep 10 20:55:50.384149 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-73b3b713-16c8-41b7-8b73-c10e656462c4 req-4eafdafb-77c0-4073-a392-eef86fb09ddb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099888 Sep 10 20:55:50.395421 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 984/2048] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:55:50.440307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1da4dd76-e419-4b3d-bd95-465e597cb83e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:50.441764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1da4dd76-e419-4b3d-bd95-465e597cb83e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:50.464961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1da4dd76-e419-4b3d-bd95-465e597cb83e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:50.465688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1da4dd76-e419-4b3d-bd95-465e597cb83e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:50.466337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1da4dd76-e419-4b3d-bd95-465e597cb83e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:50.467241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1da4dd76-e419-4b3d-bd95-465e597cb83e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:50.468784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1da4dd76-e419-4b3d-bd95-465e597cb83e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:50.469414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1da4dd76-e419-4b3d-bd95-465e597cb83e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:50.590622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1da4dd76-e419-4b3d-bd95-465e597cb83e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:50.607540 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1da4dd76-e419-4b3d-bd95-465e597cb83e tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1278 microversion: 2.1 time: 0.171488 Sep 10 20:55:50.609075 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 985/2049] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:50 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:50.747175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-affd735f-4c55-4680-b350-6432f7792e86 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:50.748827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-affd735f-4c55-4680-b350-6432f7792e86 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:50.778889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-602b880f-a939-4303-9823-0c4c55c6224e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:50.788475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-affd735f-4c55-4680-b350-6432f7792e86 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:50.790330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-affd735f-4c55-4680-b350-6432f7792e86 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:50.793679 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-602b880f-a939-4303-9823-0c4c55c6224e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 0.546742 Sep 10 20:55:50.793968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-affd735f-4c55-4680-b350-6432f7792e86 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:50.799360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-affd735f-4c55-4680-b350-6432f7792e86 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:50.801507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-affd735f-4c55-4680-b350-6432f7792e86 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:50.804518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-affd735f-4c55-4680-b350-6432f7792e86 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:50.810370 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1065/2050] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:50 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:51.104906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fb934731-d3da-4c94-b27c-0311309c238f tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:51.105863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fb934731-d3da-4c94-b27c-0311309c238f tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:51.112913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb934731-d3da-4c94-b27c-0311309c238f tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:51.114040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb934731-d3da-4c94-b27c-0311309c238f tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:51.114658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb934731-d3da-4c94-b27c-0311309c238f tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:51.115900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb934731-d3da-4c94-b27c-0311309c238f tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:51.116654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb934731-d3da-4c94-b27c-0311309c238f tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:51.117486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb934731-d3da-4c94-b27c-0311309c238f tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:51.237455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fb934731-d3da-4c94-b27c-0311309c238f tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:51.257090 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fb934731-d3da-4c94-b27c-0311309c238f tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1541 microversion: 2.1 time: 0.156477 Sep 10 20:55:51.264551 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1066/2051] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:51 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1541 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:51.292656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-affd735f-4c55-4680-b350-6432f7792e86 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:51.307433 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-affd735f-4c55-4680-b350-6432f7792e86 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1308 microversion: 2.1 time: 0.576561 Sep 10 20:55:51.308506 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 986/2052] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:50 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:51.636483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6f99af47-8f77-447b-b53b-5f101e0a98f1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:51.638031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6f99af47-8f77-447b-b53b-5f101e0a98f1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:51.648171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f99af47-8f77-447b-b53b-5f101e0a98f1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:51.648945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f99af47-8f77-447b-b53b-5f101e0a98f1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:51.649691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f99af47-8f77-447b-b53b-5f101e0a98f1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:51.652192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f99af47-8f77-447b-b53b-5f101e0a98f1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:51.652877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f99af47-8f77-447b-b53b-5f101e0a98f1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:51.653469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f99af47-8f77-447b-b53b-5f101e0a98f1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:51.738523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5a36d998-9e84-4478-85c7-8ad37ff0616c req-574c48b0-d7d9-42cb-8eb0-dfb7254c5ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0c2412-dd72-4889-8cce-8ec836eaf5e9", "name": "network-vif-deleted", "tag": "420c3ef6-3c60-4b0b-b607-faebafccc318"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:51.750213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5a36d998-9e84-4478-85c7-8ad37ff0616c req-574c48b0-d7d9-42cb-8eb0-dfb7254c5ae1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:51.751536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5a36d998-9e84-4478-85c7-8ad37ff0616c req-574c48b0-d7d9-42cb-8eb0-dfb7254c5ae1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:51.752458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5a36d998-9e84-4478-85c7-8ad37ff0616c req-574c48b0-d7d9-42cb-8eb0-dfb7254c5ae1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:51.767183 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5a36d998-9e84-4478-85c7-8ad37ff0616c req-574c48b0-d7d9-42cb-8eb0-dfb7254c5ae1 service nova] Creating event network-vif-deleted:420c3ef6-3c60-4b0b-b607-faebafccc318 for instance 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 on nch1-master-1 Sep 10 20:55:51.773814 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5a36d998-9e84-4478-85c7-8ad37ff0616c req-574c48b0-d7d9-42cb-8eb0-dfb7254c5ae1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038821 Sep 10 20:55:51.775199 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 987/2053] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:51.825956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6f99af47-8f77-447b-b53b-5f101e0a98f1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:51.827062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d2486eb0-158d-4ded-a2b4-636da5cf0e14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:51.836557 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6f99af47-8f77-447b-b53b-5f101e0a98f1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1276 microversion: 2.1 time: 0.205362 Sep 10 20:55:51.849077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d2486eb0-158d-4ded-a2b4-636da5cf0e14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:51.853625 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1067/2054] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:51 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:51.870871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2486eb0-158d-4ded-a2b4-636da5cf0e14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:51.872164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2486eb0-158d-4ded-a2b4-636da5cf0e14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:51.875402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2486eb0-158d-4ded-a2b4-636da5cf0e14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:51.876438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2486eb0-158d-4ded-a2b4-636da5cf0e14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:51.877146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2486eb0-158d-4ded-a2b4-636da5cf0e14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:51.877810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2486eb0-158d-4ded-a2b4-636da5cf0e14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:52.197586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-5d29d77b-f6b6-4c55-8f85-c10828bf19d6 req-4711b487-76a5-43a2-b0bc-ba4c869d6561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ce24e3-3f43-497b-b523-e13026e634fa", "tag": "52761b52-5f8b-4ae4-9fd8-6bcc0382f796"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:52.212615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5d29d77b-f6b6-4c55-8f85-c10828bf19d6 req-4711b487-76a5-43a2-b0bc-ba4c869d6561 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:52.213629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5d29d77b-f6b6-4c55-8f85-c10828bf19d6 req-4711b487-76a5-43a2-b0bc-ba4c869d6561 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:52.216721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5d29d77b-f6b6-4c55-8f85-c10828bf19d6 req-4711b487-76a5-43a2-b0bc-ba4c869d6561 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:52.240648 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-5d29d77b-f6b6-4c55-8f85-c10828bf19d6 req-4711b487-76a5-43a2-b0bc-ba4c869d6561 service nova] Creating event network-changed:52761b52-5f8b-4ae4-9fd8-6bcc0382f796 for instance 58ce24e3-3f43-497b-b523-e13026e634fa on nch1-master-1 Sep 10 20:55:52.255361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-5d29d77b-f6b6-4c55-8f85-c10828bf19d6 req-4711b487-76a5-43a2-b0bc-ba4c869d6561 service nova] Instance 58ce24e3-3f43-497b-b523-e13026e634fa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 20:55:52.287044 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-5d29d77b-f6b6-4c55-8f85-c10828bf19d6 req-4711b487-76a5-43a2-b0bc-ba4c869d6561 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091713 Sep 10 20:55:52.288849 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1068/2055] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:52.307010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:52.307816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:52.321267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:52.321771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:52.322346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:52.323070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:52.323658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:52.329112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:52.409771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:52.411612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:52.412179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:52.412903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lazy-loading 'fault' on Instance uuid 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:55:52.583878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0c267722f14e7fa87395f796551ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee44bfe21341d295b8c2290f692085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:52.598734 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be5003fd-4f4b-4eec-893c-49f897fba329 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 200 len: 1256 microversion: 2.1 time: 0.301146 Sep 10 20:55:52.615645 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1069/2056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:52 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 1256 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:52.629407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b1d5b5e3-f91f-4343-89fd-72af760eec5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:52.630150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b1d5b5e3-f91f-4343-89fd-72af760eec5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:52.654485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1d5b5e3-f91f-4343-89fd-72af760eec5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:52.655159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1d5b5e3-f91f-4343-89fd-72af760eec5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:52.655896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1d5b5e3-f91f-4343-89fd-72af760eec5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:52.657049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1d5b5e3-f91f-4343-89fd-72af760eec5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:52.657701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1d5b5e3-f91f-4343-89fd-72af760eec5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:52.658324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1d5b5e3-f91f-4343-89fd-72af760eec5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:52.933687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d2486eb0-158d-4ded-a2b4-636da5cf0e14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:52.959926 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d2486eb0-158d-4ded-a2b4-636da5cf0e14 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 1.141057 Sep 10 20:55:52.975179 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 988/2057] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:51 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:52.998560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d0b83fa5-c464-434c-9fde-fea4ca135b04 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:52.999900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d0b83fa5-c464-434c-9fde-fea4ca135b04 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:53.028998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0b83fa5-c464-434c-9fde-fea4ca135b04 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:53.030020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0b83fa5-c464-434c-9fde-fea4ca135b04 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:53.030336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0b83fa5-c464-434c-9fde-fea4ca135b04 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:53.031144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0b83fa5-c464-434c-9fde-fea4ca135b04 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:53.032174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0b83fa5-c464-434c-9fde-fea4ca135b04 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:53.033225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0b83fa5-c464-434c-9fde-fea4ca135b04 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:53.422235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1d5b5e3-f91f-4343-89fd-72af760eec5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:53.432802 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b1d5b5e3-f91f-4343-89fd-72af760eec5b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1488 microversion: 2.1 time: 0.813237 Sep 10 20:55:53.434437 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1070/2058] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:52 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1488 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:53.464439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4eedb00-04ff-4b7c-926a-fc6530974bf8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:53.476406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4eedb00-04ff-4b7c-926a-fc6530974bf8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:53.478099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4eedb00-04ff-4b7c-926a-fc6530974bf8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:53.479449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4eedb00-04ff-4b7c-926a-fc6530974bf8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:53.601696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e4eedb00-04ff-4b7c-926a-fc6530974bf8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Going to try to stop instance {{(pid=145772) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 20:55:53.627059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d0b83fa5-c464-434c-9fde-fea4ca135b04 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:53.638464 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d0b83fa5-c464-434c-9fde-fea4ca135b04 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.654951 Sep 10 20:55:53.654194 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 989/2059] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:52 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:53.672563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:53.673514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] [instance: 6b0c2412-dd72-4889-8cce-8ec836eaf5e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:53.695802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:53.696616 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e4eedb00-04ff-4b7c-926a-fc6530974bf8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931/action" status: 202 len: 0 microversion: 2.1 time: 0.236666 Sep 10 20:55:53.698982 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1071/2060] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:55:53 2022] POST /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:55:53.699206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:53.699903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:53.700893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:53.701547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:53.705065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:53.714968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5adaac6c-3f90-4c5f-b900-c588f43b7f52 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:53.718713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5adaac6c-3f90-4c5f-b900-c588f43b7f52 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:53.736650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5adaac6c-3f90-4c5f-b900-c588f43b7f52 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:53.737157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5adaac6c-3f90-4c5f-b900-c588f43b7f52 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:53.737613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5adaac6c-3f90-4c5f-b900-c588f43b7f52 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:53.740185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5adaac6c-3f90-4c5f-b900-c588f43b7f52 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:53.740668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5adaac6c-3f90-4c5f-b900-c588f43b7f52 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:53.742189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5adaac6c-3f90-4c5f-b900-c588f43b7f52 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:53.749223 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] HTTP exception thrown: Instance 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 could not be found. Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Request method failure captured: Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 HTTP/1.1 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPlQ8Mrl6bY-ZRlw7otBWTzPxaXZW0Dk__OUf5Qo1cmgTsdfOqSSu5poYhlv7rWb4WX7h1X-lQ3nmwZdOfav6m77XWbwCKUZYwe4324pcsPC0fM_4js12TyaCPY7kYCE2S8WcJGpssuCPlLttJq_sSvYrkYoo4r3tjow1_D2pnAcX00 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: bbee44bfe21341d295b8c2290f692085 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestBootFromVolume-1201234862 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbee44bfe21341d295b8c2290f692085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bbee44bfe21341d295b8c2290f692085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bbee44bfe21341d295b8c2290f692085", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bbee44bfe21341d295b8c2290f692085"}]}] Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestBootFromVolume-1201234862 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: bbee44bfe21341d295b8c2290f692085 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1201234862 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestBootFromVolume-1201234862-project Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5b0c267722f14e7fa87395f796551ab5 Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestBootFromVolume-1201234862-project Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 could not be found. Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '6b0c2412-dd72-4889-8cce-8ec836eaf5e9'} Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 could not be found. Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 could not be found. Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:55:53.758401 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:53.766657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:55:53.766657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:55:53.766657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:55:53.766657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:55:53.766657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:55:53.766657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 could not be found. Sep 10 20:55:53.766657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:55:53.774106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Returning 404 to user: Instance 6b0c2412-dd72-4889-8cce-8ec836eaf5e9 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:55:53.775271 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e54be86-329f-4474-a178-85b62a78ce1a tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9" status: 404 len: 111 microversion: 2.1 time: 0.119734 Sep 10 20:55:53.776543 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 990/2061] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:53 2022] GET /compute/v2.1/servers/6b0c2412-dd72-4889-8cce-8ec836eaf5e9 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:55:53.790217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5479bcb1-0e2b-466a-9a6e-1b810164bbf0 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] Calling method '.version_select at 0x7f9944693ee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:53.838200 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5479bcb1-0e2b-466a-9a6e-1b810164bbf0 tempest-ServersTestBootFromVolume-1201234862 tempest-ServersTestBootFromVolume-1201234862-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-478697339" status: 202 len: 0 microversion: 2.1 time: 0.055216 Sep 10 20:55:53.839208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 991/2062] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 20:55:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-478697339 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:55:53.988717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-42d19fc1-82c0-4349-908b-ebddb1d4e5f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:53.989516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-42d19fc1-82c0-4349-908b-ebddb1d4e5f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:54.006806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d19fc1-82c0-4349-908b-ebddb1d4e5f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:54.007541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d19fc1-82c0-4349-908b-ebddb1d4e5f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:54.008212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d19fc1-82c0-4349-908b-ebddb1d4e5f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:54.009143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d19fc1-82c0-4349-908b-ebddb1d4e5f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:54.010474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d19fc1-82c0-4349-908b-ebddb1d4e5f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:54.011132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d19fc1-82c0-4349-908b-ebddb1d4e5f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:54.165749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:54.353165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5adaac6c-3f90-4c5f-b900-c588f43b7f52 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:54.366055 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5adaac6c-3f90-4c5f-b900-c588f43b7f52 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.664156 Sep 10 20:55:54.366653 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1072/2063] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:53 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:54.664514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56f36c02-6f32-41ed-9b98-c90997411acb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:54.665124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-56f36c02-6f32-41ed-9b98-c90997411acb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:54.671979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56f36c02-6f32-41ed-9b98-c90997411acb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:54.672748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56f36c02-6f32-41ed-9b98-c90997411acb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:54.673377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56f36c02-6f32-41ed-9b98-c90997411acb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:54.674133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56f36c02-6f32-41ed-9b98-c90997411acb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:54.674776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56f36c02-6f32-41ed-9b98-c90997411acb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:54.675208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56f36c02-6f32-41ed-9b98-c90997411acb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:54.927061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-42d19fc1-82c0-4349-908b-ebddb1d4e5f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:54.942854 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-42d19fc1-82c0-4349-908b-ebddb1d4e5f1 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 0.957572 Sep 10 20:55:54.945575 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 992/2064] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:53 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:55.298507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-56f36c02-6f32-41ed-9b98-c90997411acb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:55.328803 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-56f36c02-6f32-41ed-9b98-c90997411acb tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.668051 Sep 10 20:55:55.345243 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1073/2065] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:54 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:55.392677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7d4ba6ad-d845-4976-8b43-17425180bb66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:55.393293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7d4ba6ad-d845-4976-8b43-17425180bb66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:55.407696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d4ba6ad-d845-4976-8b43-17425180bb66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:55.409141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d4ba6ad-d845-4976-8b43-17425180bb66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:55.409672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d4ba6ad-d845-4976-8b43-17425180bb66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:55.411062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d4ba6ad-d845-4976-8b43-17425180bb66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:55.411912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d4ba6ad-d845-4976-8b43-17425180bb66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:55.414352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d4ba6ad-d845-4976-8b43-17425180bb66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:55.890889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7d4ba6ad-d845-4976-8b43-17425180bb66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:55.908300 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7d4ba6ad-d845-4976-8b43-17425180bb66 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.519906 Sep 10 20:55:55.909305 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 993/2066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:55 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:55.970528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5edf1e92-6796-42df-b160-d461cca9cbce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:55.971192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5edf1e92-6796-42df-b160-d461cca9cbce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:55.985803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5edf1e92-6796-42df-b160-d461cca9cbce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:55.986884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5edf1e92-6796-42df-b160-d461cca9cbce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:55.987979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5edf1e92-6796-42df-b160-d461cca9cbce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:55.991201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5edf1e92-6796-42df-b160-d461cca9cbce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:55.991758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5edf1e92-6796-42df-b160-d461cca9cbce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:55.992280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5edf1e92-6796-42df-b160-d461cca9cbce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:56.361441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7abfcd36-d5cc-4a7b-a84b-5702b82614d8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:56.362650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7abfcd36-d5cc-4a7b-a84b-5702b82614d8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:56.377751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7abfcd36-d5cc-4a7b-a84b-5702b82614d8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:56.378839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7abfcd36-d5cc-4a7b-a84b-5702b82614d8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:56.388997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7abfcd36-d5cc-4a7b-a84b-5702b82614d8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:56.391935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7abfcd36-d5cc-4a7b-a84b-5702b82614d8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:56.395057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7abfcd36-d5cc-4a7b-a84b-5702b82614d8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:56.399185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7abfcd36-d5cc-4a7b-a84b-5702b82614d8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:56.408995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:56.427581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5edf1e92-6796-42df-b160-d461cca9cbce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:56.437234 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5edf1e92-6796-42df-b160-d461cca9cbce tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 0.472018 Sep 10 20:55:56.437859 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1074/2067] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:55 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:56.658062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7a7f343b-d529-46ba-a523-dd5d46ce059a req-dd0c67f2-52f0-481d-a660-0b2ae0a227d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "737acbf5-3c07-4dd1-8798-2214cb1bf7a3", "tag": "15efa8de-b0bd-4550-af77-12a26cc4db38"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:55:56.689976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a7f343b-d529-46ba-a523-dd5d46ce059a req-dd0c67f2-52f0-481d-a660-0b2ae0a227d4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:56.690499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a7f343b-d529-46ba-a523-dd5d46ce059a req-dd0c67f2-52f0-481d-a660-0b2ae0a227d4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:56.690891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a7f343b-d529-46ba-a523-dd5d46ce059a req-dd0c67f2-52f0-481d-a660-0b2ae0a227d4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:56.730973 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7a7f343b-d529-46ba-a523-dd5d46ce059a req-dd0c67f2-52f0-481d-a660-0b2ae0a227d4 service nova] Creating event network-changed:15efa8de-b0bd-4550-af77-12a26cc4db38 for instance 737acbf5-3c07-4dd1-8798-2214cb1bf7a3 on nch2-master-1 Sep 10 20:55:56.750140 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7a7f343b-d529-46ba-a523-dd5d46ce059a req-dd0c67f2-52f0-481d-a660-0b2ae0a227d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095783 Sep 10 20:55:56.751468 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1075/2068] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:55:56.942651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-66d25cc1-726b-44bf-bce2-c398ba2c7358 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:56.943663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-66d25cc1-726b-44bf-bce2-c398ba2c7358 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:56.951159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66d25cc1-726b-44bf-bce2-c398ba2c7358 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:56.952580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66d25cc1-726b-44bf-bce2-c398ba2c7358 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:56.953230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66d25cc1-726b-44bf-bce2-c398ba2c7358 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:56.955113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66d25cc1-726b-44bf-bce2-c398ba2c7358 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:56.955902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66d25cc1-726b-44bf-bce2-c398ba2c7358 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:56.970629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66d25cc1-726b-44bf-bce2-c398ba2c7358 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:57.466536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7abfcd36-d5cc-4a7b-a84b-5702b82614d8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:57.491392 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7abfcd36-d5cc-4a7b-a84b-5702b82614d8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 1.142219 Sep 10 20:55:57.506270 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 994/2069] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:56 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:55:57.513311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cb84f501-9748-460b-9293-931b0c698e3d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:57.514375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cb84f501-9748-460b-9293-931b0c698e3d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:57.520089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:57.523079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb84f501-9748-460b-9293-931b0c698e3d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:57.524107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb84f501-9748-460b-9293-931b0c698e3d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:57.524741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb84f501-9748-460b-9293-931b0c698e3d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:57.525699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb84f501-9748-460b-9293-931b0c698e3d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:57.526571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb84f501-9748-460b-9293-931b0c698e3d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:57.527180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb84f501-9748-460b-9293-931b0c698e3d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:57.547109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:57.704658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-66d25cc1-726b-44bf-bce2-c398ba2c7358 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:57.714853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:57.720615 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-66d25cc1-726b-44bf-bce2-c398ba2c7358 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.787077 Sep 10 20:55:57.734473 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1076/2070] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:56 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:57.982943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cb84f501-9748-460b-9293-931b0c698e3d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:57.997785 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cb84f501-9748-460b-9293-931b0c698e3d tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1468 microversion: 2.1 time: 0.489662 Sep 10 20:55:57.999196 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 995/2071] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:57 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1468 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:58.518984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-53fb989f-5411-4bb5-b914-524ae4c869b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:58.519855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-53fb989f-5411-4bb5-b914-524ae4c869b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:58.528875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:55:58.530939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53fb989f-5411-4bb5-b914-524ae4c869b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:58.531433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53fb989f-5411-4bb5-b914-524ae4c869b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:58.531884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53fb989f-5411-4bb5-b914-524ae4c869b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:58.532598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53fb989f-5411-4bb5-b914-524ae4c869b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:58.533058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53fb989f-5411-4bb5-b914-524ae4c869b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:58.533492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53fb989f-5411-4bb5-b914-524ae4c869b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:58.756073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f2b059ca-84d2-457c-a7db-75dbf4e986ad tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:58.757749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f2b059ca-84d2-457c-a7db-75dbf4e986ad tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:58.766512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2b059ca-84d2-457c-a7db-75dbf4e986ad tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:58.767369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2b059ca-84d2-457c-a7db-75dbf4e986ad tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:58.768141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2b059ca-84d2-457c-a7db-75dbf4e986ad tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:58.769273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2b059ca-84d2-457c-a7db-75dbf4e986ad tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:58.770708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2b059ca-84d2-457c-a7db-75dbf4e986ad tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:58.771400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2b059ca-84d2-457c-a7db-75dbf4e986ad tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:59.194822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f2b059ca-84d2-457c-a7db-75dbf4e986ad tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:59.208680 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f2b059ca-84d2-457c-a7db-75dbf4e986ad tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.458481 Sep 10 20:55:59.223616 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 996/2072] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:58 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:59.244769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d8839026-0bae-4291-a891-3bf1786aae5f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:59.245406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d8839026-0bae-4291-a891-3bf1786aae5f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:59.256309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8839026-0bae-4291-a891-3bf1786aae5f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:59.257103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8839026-0bae-4291-a891-3bf1786aae5f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:59.265206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8839026-0bae-4291-a891-3bf1786aae5f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:59.266278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8839026-0bae-4291-a891-3bf1786aae5f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:59.268266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8839026-0bae-4291-a891-3bf1786aae5f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:59.268266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8839026-0bae-4291-a891-3bf1786aae5f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:59.417939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-53fb989f-5411-4bb5-b914-524ae4c869b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:59.431775 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-53fb989f-5411-4bb5-b914-524ae4c869b7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.916913 Sep 10 20:55:59.433320 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1077/2073] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:58 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:59.781443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d8839026-0bae-4291-a891-3bf1786aae5f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:55:59.807949 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d8839026-0bae-4291-a891-3bf1786aae5f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1461 microversion: 2.1 time: 0.580349 Sep 10 20:55:59.811174 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 997/2074] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:59 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1461 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:55:59.831755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b5444fcb-d6d1-4b88-a59e-df74292172f7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:55:59.832336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b5444fcb-d6d1-4b88-a59e-df74292172f7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:55:59.840204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5444fcb-d6d1-4b88-a59e-df74292172f7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:59.840987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5444fcb-d6d1-4b88-a59e-df74292172f7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:59.841659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5444fcb-d6d1-4b88-a59e-df74292172f7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:55:59.842655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5444fcb-d6d1-4b88-a59e-df74292172f7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:55:59.843415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5444fcb-d6d1-4b88-a59e-df74292172f7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:55:59.844129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5444fcb-d6d1-4b88-a59e-df74292172f7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:00.082540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a1079058-f23d-467a-8cb2-2dad0088f6d4 req-d6227ad1-3817-4b9e-b439-05f34833dcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ce24e3-3f43-497b-b523-e13026e634fa", "name": "network-vif-plugged", "status": "completed", "tag": "52761b52-5f8b-4ae4-9fd8-6bcc0382f796"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:00.100872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:00.112991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a1079058-f23d-467a-8cb2-2dad0088f6d4 req-d6227ad1-3817-4b9e-b439-05f34833dcf0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:00.113487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a1079058-f23d-467a-8cb2-2dad0088f6d4 req-d6227ad1-3817-4b9e-b439-05f34833dcf0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:00.117878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a1079058-f23d-467a-8cb2-2dad0088f6d4 req-d6227ad1-3817-4b9e-b439-05f34833dcf0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:00.144320 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a1079058-f23d-467a-8cb2-2dad0088f6d4 req-d6227ad1-3817-4b9e-b439-05f34833dcf0 service nova] Creating event network-vif-plugged:52761b52-5f8b-4ae4-9fd8-6bcc0382f796 for instance 58ce24e3-3f43-497b-b523-e13026e634fa on nch1-master-1 Sep 10 20:56:00.155520 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a1079058-f23d-467a-8cb2-2dad0088f6d4 req-d6227ad1-3817-4b9e-b439-05f34833dcf0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076065 Sep 10 20:56:00.156718 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 998/2075] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:56:00.201468 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b5444fcb-d6d1-4b88-a59e-df74292172f7 tempest-MigrationsAdminTest-337118017 tempest-MigrationsAdminTest-337118017-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1612 microversion: 2.1 time: 0.374060 Sep 10 20:56:00.202102 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1078/2076] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:55:59 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1612 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:00.253659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6d32290-df00-4e05-b3a9-fb7cf7da1b51 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:00.254094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-defd01f2-afff-4f93-9304-c3300b43ab31 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:00.255455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6d32290-df00-4e05-b3a9-fb7cf7da1b51 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:00.256176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-defd01f2-afff-4f93-9304-c3300b43ab31 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:00.273846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-defd01f2-afff-4f93-9304-c3300b43ab31 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:00.274406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-defd01f2-afff-4f93-9304-c3300b43ab31 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:00.275411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-defd01f2-afff-4f93-9304-c3300b43ab31 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:00.276202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6d32290-df00-4e05-b3a9-fb7cf7da1b51 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:00.276701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6d32290-df00-4e05-b3a9-fb7cf7da1b51 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:00.277144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6d32290-df00-4e05-b3a9-fb7cf7da1b51 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:00.278542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-defd01f2-afff-4f93-9304-c3300b43ab31 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:00.279126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-defd01f2-afff-4f93-9304-c3300b43ab31 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:00.279568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-defd01f2-afff-4f93-9304-c3300b43ab31 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:00.282819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6d32290-df00-4e05-b3a9-fb7cf7da1b51 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:00.283348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6d32290-df00-4e05-b3a9-fb7cf7da1b51 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:00.283792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6d32290-df00-4e05-b3a9-fb7cf7da1b51 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:00.366166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6d32290-df00-4e05-b3a9-fb7cf7da1b51 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:56:00.520853 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6d32290-df00-4e05-b3a9-fb7cf7da1b51 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "DELETE /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 204 len: 0 microversion: 2.1 time: 0.288897 Sep 10 20:56:00.522329 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 999/2077] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:56:00 2022] DELETE /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 20:56:00.530377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d782222c-fbf6-4925-927b-918d9c5d9000 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:00.531371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d782222c-fbf6-4925-927b-918d9c5d9000 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:00.539500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d782222c-fbf6-4925-927b-918d9c5d9000 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:00.540242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d782222c-fbf6-4925-927b-918d9c5d9000 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:00.541497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d782222c-fbf6-4925-927b-918d9c5d9000 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:00.542658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d782222c-fbf6-4925-927b-918d9c5d9000 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:00.543357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d782222c-fbf6-4925-927b-918d9c5d9000 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:00.543955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d782222c-fbf6-4925-927b-918d9c5d9000 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:00.871994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-defd01f2-afff-4f93-9304-c3300b43ab31 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:00.887694 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-defd01f2-afff-4f93-9304-c3300b43ab31 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.649465 Sep 10 20:56:00.888628 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1079/2078] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:00 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:00.903670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3cc7af89-1a6b-4300-b369-d40782d192ca tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:00.904286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3cc7af89-1a6b-4300-b369-d40782d192ca tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:00.923292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cc7af89-1a6b-4300-b369-d40782d192ca tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:00.923782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cc7af89-1a6b-4300-b369-d40782d192ca tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:00.924435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cc7af89-1a6b-4300-b369-d40782d192ca tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:00.925346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cc7af89-1a6b-4300-b369-d40782d192ca tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:00.926033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cc7af89-1a6b-4300-b369-d40782d192ca tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:00.931155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cc7af89-1a6b-4300-b369-d40782d192ca tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:01.475263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d782222c-fbf6-4925-927b-918d9c5d9000 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:01.490542 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d782222c-fbf6-4925-927b-918d9c5d9000 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.966380 Sep 10 20:56:01.494669 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1000/2079] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:00 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:01.887966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3cc7af89-1a6b-4300-b369-d40782d192ca tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:01.901537 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3cc7af89-1a6b-4300-b369-d40782d192ca tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1467 microversion: 2.1 time: 1.009166 Sep 10 20:56:01.904313 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1080/2080] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:00 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1467 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:01.933370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16e56998-812e-4971-a242-7ea7f0fcc0d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:01.934377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-16e56998-812e-4971-a242-7ea7f0fcc0d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:01.949355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16e56998-812e-4971-a242-7ea7f0fcc0d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:01.949877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16e56998-812e-4971-a242-7ea7f0fcc0d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:01.950312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16e56998-812e-4971-a242-7ea7f0fcc0d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:01.953036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16e56998-812e-4971-a242-7ea7f0fcc0d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:01.955862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16e56998-812e-4971-a242-7ea7f0fcc0d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:01.957106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16e56998-812e-4971-a242-7ea7f0fcc0d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:02.476378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-16e56998-812e-4971-a242-7ea7f0fcc0d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:02.495287 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-16e56998-812e-4971-a242-7ea7f0fcc0d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.572319 Sep 10 20:56:02.496651 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1001/2081] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:01 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:02.518733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bde17a69-50a2-4b87-ad47-561eb15daf08 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:02.519356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bde17a69-50a2-4b87-ad47-561eb15daf08 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:02.526286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bde17a69-50a2-4b87-ad47-561eb15daf08 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:02.527087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bde17a69-50a2-4b87-ad47-561eb15daf08 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:02.527717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bde17a69-50a2-4b87-ad47-561eb15daf08 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:02.528661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bde17a69-50a2-4b87-ad47-561eb15daf08 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:02.529350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bde17a69-50a2-4b87-ad47-561eb15daf08 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:02.529980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bde17a69-50a2-4b87-ad47-561eb15daf08 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:02.933662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-473343d1-3a68-499d-9a36-db277529786b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:02.934610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-473343d1-3a68-499d-9a36-db277529786b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:02.949784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473343d1-3a68-499d-9a36-db277529786b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:02.950561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473343d1-3a68-499d-9a36-db277529786b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:02.951011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473343d1-3a68-499d-9a36-db277529786b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:02.952251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473343d1-3a68-499d-9a36-db277529786b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:02.952780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473343d1-3a68-499d-9a36-db277529786b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:02.953296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473343d1-3a68-499d-9a36-db277529786b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:03.028115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bde17a69-50a2-4b87-ad47-561eb15daf08 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:03.038829 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bde17a69-50a2-4b87-ad47-561eb15daf08 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.523861 Sep 10 20:56:03.043436 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1081/2082] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:02 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:03.486001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-473343d1-3a68-499d-9a36-db277529786b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:03.496959 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-473343d1-3a68-499d-9a36-db277529786b tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 200 len: 1467 microversion: 2.1 time: 0.567122 Sep 10 20:56:03.499258 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1002/2083] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:02 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 1467 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:03.514591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-bf00dfd8-d78b-4903-9fe7-0d6a451f94d4 req-a8814118-0135-4308-86cd-78a95ed66345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ce24e3-3f43-497b-b523-e13026e634fa", "name": "network-vif-deleted", "tag": "52761b52-5f8b-4ae4-9fd8-6bcc0382f796"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:03.549732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a2d5d152-bb1c-496d-83e8-3804c8954df5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:03.552488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a2d5d152-bb1c-496d-83e8-3804c8954df5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:03.554373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bf00dfd8-d78b-4903-9fe7-0d6a451f94d4 req-a8814118-0135-4308-86cd-78a95ed66345 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:03.557037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bf00dfd8-d78b-4903-9fe7-0d6a451f94d4 req-a8814118-0135-4308-86cd-78a95ed66345 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:03.559604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bf00dfd8-d78b-4903-9fe7-0d6a451f94d4 req-a8814118-0135-4308-86cd-78a95ed66345 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:03.566161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d5d152-bb1c-496d-83e8-3804c8954df5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:03.568948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d5d152-bb1c-496d-83e8-3804c8954df5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:03.569816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d5d152-bb1c-496d-83e8-3804c8954df5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:03.571196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d5d152-bb1c-496d-83e8-3804c8954df5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:03.576082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d5d152-bb1c-496d-83e8-3804c8954df5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:03.578204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2d5d152-bb1c-496d-83e8-3804c8954df5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:03.603420 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-bf00dfd8-d78b-4903-9fe7-0d6a451f94d4 req-a8814118-0135-4308-86cd-78a95ed66345 service nova] Creating event network-vif-deleted:52761b52-5f8b-4ae4-9fd8-6bcc0382f796 for instance 58ce24e3-3f43-497b-b523-e13026e634fa on nch1-master-1 Sep 10 20:56:03.621333 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-bf00dfd8-d78b-4903-9fe7-0d6a451f94d4 req-a8814118-0135-4308-86cd-78a95ed66345 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113719 Sep 10 20:56:03.622279 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1082/2084] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:04.073658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7c96dd2-806b-47a7-ba34-182c06324e16 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:04.075151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f7c96dd2-806b-47a7-ba34-182c06324e16 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:04.084183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7c96dd2-806b-47a7-ba34-182c06324e16 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:04.085040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7c96dd2-806b-47a7-ba34-182c06324e16 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:04.085661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7c96dd2-806b-47a7-ba34-182c06324e16 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:04.086711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7c96dd2-806b-47a7-ba34-182c06324e16 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:04.087861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7c96dd2-806b-47a7-ba34-182c06324e16 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:04.088504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7c96dd2-806b-47a7-ba34-182c06324e16 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:04.278129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7c96dd2-806b-47a7-ba34-182c06324e16 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:04.295001 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f7c96dd2-806b-47a7-ba34-182c06324e16 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.225600 Sep 10 20:56:04.296643 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1083/2085] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:04 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:04.525263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:04.526056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 58ce24e3-3f43-497b-b523-e13026e634fa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:04.532659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:04.533517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:04.534457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:04.535291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:04.536039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:04.536701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:04.555435 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] HTTP exception thrown: Instance 58ce24e3-3f43-497b-b523-e13026e634fa could not be found. Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Request method failure captured: Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa HTTP/1.1 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPigZVPOpCh9XNZEoiKAjstHtwCC1cWzYVoo9-egRrTI6vcIspKu1dcq8wJ7YlF8RRhvaYMarajVefHiYr3FuBNVjRY0dVMrP3fBfFO1famVTYcr1-g0H9wO6sMkt4SXut0v13WWVZVuIkWernH8czz-8ajtbkBO8mttnUGFB-dri84 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d969d135196e409584d6647d5186c9c9 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d969d135196e409584d6647d5186c9c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d969d135196e409584d6647d5186c9c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d969d135196e409584d6647d5186c9c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d969d135196e409584d6647d5186c9c9"}]}] Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d969d135196e409584d6647d5186c9c9 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-MigrationsAdminTest-2115713060-project Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 870c4c66a15b4546bd981cfb5932b214 Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-MigrationsAdminTest-2115713060-project Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 58ce24e3-3f43-497b-b523-e13026e634fa could not be found. Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '58ce24e3-3f43-497b-b523-e13026e634fa'} Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ce24e3-3f43-497b-b523-e13026e634fa could not be found. Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ce24e3-3f43-497b-b523-e13026e634fa could not be found. Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:04.559211 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:04.566065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:04.566065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:04.566065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:04.566065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:04.566065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:04.566065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ce24e3-3f43-497b-b523-e13026e634fa could not be found. Sep 10 20:56:04.566065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:04.567634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Returning 404 to user: Instance 58ce24e3-3f43-497b-b523-e13026e634fa could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:04.568681 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09d2404f-11c6-49e5-b893-7f17cf387454 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa" status: 404 len: 111 microversion: 2.1 time: 0.048105 Sep 10 20:56:04.569759 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1084/2086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:04 2022] GET /compute/v2.1/servers/58ce24e3-3f43-497b-b523-e13026e634fa => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:56:04.578683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-63f5f425-bd5f-489c-82bf-a7444da85c1e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:04.580000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-63f5f425-bd5f-489c-82bf-a7444da85c1e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:04.589118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63f5f425-bd5f-489c-82bf-a7444da85c1e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:04.589942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63f5f425-bd5f-489c-82bf-a7444da85c1e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:04.591088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63f5f425-bd5f-489c-82bf-a7444da85c1e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:04.592179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63f5f425-bd5f-489c-82bf-a7444da85c1e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:04.593022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63f5f425-bd5f-489c-82bf-a7444da85c1e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:04.593706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63f5f425-bd5f-489c-82bf-a7444da85c1e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:04.632634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a2d5d152-bb1c-496d-83e8-3804c8954df5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:04.642113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-63f5f425-bd5f-489c-82bf-a7444da85c1e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:56:04.653984 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a2d5d152-bb1c-496d-83e8-3804c8954df5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 1.118840 Sep 10 20:56:04.657236 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1003/2087] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:03 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:04.804421 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-63f5f425-bd5f-489c-82bf-a7444da85c1e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 204 len: 0 microversion: 2.1 time: 0.227140 Sep 10 20:56:04.811814 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1085/2088] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:56:04 2022] DELETE /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 20:56:04.825130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a2c1eb16-c163-4dbf-9cd8-caf188b8a15a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:04.826081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a2c1eb16-c163-4dbf-9cd8-caf188b8a15a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:04.840428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c1eb16-c163-4dbf-9cd8-caf188b8a15a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:04.843347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c1eb16-c163-4dbf-9cd8-caf188b8a15a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:04.843998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c1eb16-c163-4dbf-9cd8-caf188b8a15a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:04.845781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c1eb16-c163-4dbf-9cd8-caf188b8a15a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:04.847977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c1eb16-c163-4dbf-9cd8-caf188b8a15a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:04.848669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c1eb16-c163-4dbf-9cd8-caf188b8a15a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:04.924213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2069353406", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": "none"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:05.039515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:05.040071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:05.040749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:05.042271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:05.042800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:05.059970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a2c1eb16-c163-4dbf-9cd8-caf188b8a15a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:05.077410 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a2c1eb16-c163-4dbf-9cd8-caf188b8a15a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1535 microversion: 2.1 time: 0.262176 Sep 10 20:56:05.078500 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1086/2089] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:04 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1535 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:05.083022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:05.083743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:05.084358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:05.085301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:05.085956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:05.086582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:05.115158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Getting quotas for project 639eb01bc0484295b917ab8d0ceee6ab. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:56:05.123339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Getting quotas for user a681592c2d1043a4afa67838812e7fe9 and project 639eb01bc0484295b917ab8d0ceee6ab. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:56:05.141581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:56:05.144628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:56:05.213648 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f186013-5a97-4aa1-a0c7-68f4f97f5909 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.472433 Sep 10 20:56:05.214966 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1004/2090] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 20:56:05.227205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dad347bd-e0ae-498e-a281-2da86da24e4c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:05.228857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dad347bd-e0ae-498e-a281-2da86da24e4c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:05.324853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aa92631b-6442-44cd-9da1-4262b875cbe7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:05.326204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aa92631b-6442-44cd-9da1-4262b875cbe7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:05.354372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa92631b-6442-44cd-9da1-4262b875cbe7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:05.358250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa92631b-6442-44cd-9da1-4262b875cbe7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:05.359153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa92631b-6442-44cd-9da1-4262b875cbe7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:05.360253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa92631b-6442-44cd-9da1-4262b875cbe7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:05.364819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dad347bd-e0ae-498e-a281-2da86da24e4c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:05.377071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa92631b-6442-44cd-9da1-4262b875cbe7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:05.377432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa92631b-6442-44cd-9da1-4262b875cbe7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:05.379815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dad347bd-e0ae-498e-a281-2da86da24e4c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:05.404725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dad347bd-e0ae-498e-a281-2da86da24e4c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:05.406496 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dad347bd-e0ae-498e-a281-2da86da24e4c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1278 microversion: 2.54 time: 0.184408 Sep 10 20:56:05.407092 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1087/2091] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:05 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:05.688547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1374e220-e4a2-47ec-a36b-11bc05666de0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:05.701337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1374e220-e4a2-47ec-a36b-11bc05666de0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:05.711364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1374e220-e4a2-47ec-a36b-11bc05666de0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:05.712902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1374e220-e4a2-47ec-a36b-11bc05666de0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:05.713618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1374e220-e4a2-47ec-a36b-11bc05666de0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:05.718840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1374e220-e4a2-47ec-a36b-11bc05666de0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:05.720296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1374e220-e4a2-47ec-a36b-11bc05666de0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:05.721538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1374e220-e4a2-47ec-a36b-11bc05666de0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:05.953341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1374e220-e4a2-47ec-a36b-11bc05666de0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:05.969364 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1374e220-e4a2-47ec-a36b-11bc05666de0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.285259 Sep 10 20:56:05.970339 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1088/2092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:05 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:06.045401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aa92631b-6442-44cd-9da1-4262b875cbe7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:06.059552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aa92631b-6442-44cd-9da1-4262b875cbe7 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.740397 Sep 10 20:56:06.085623 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1005/2093] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:05 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:06.102860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c5c6d500-3196-4be6-9f00-0b7979cdf2c4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:06.103566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c5c6d500-3196-4be6-9f00-0b7979cdf2c4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:06.117321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5c6d500-3196-4be6-9f00-0b7979cdf2c4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:06.118180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5c6d500-3196-4be6-9f00-0b7979cdf2c4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:06.118766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5c6d500-3196-4be6-9f00-0b7979cdf2c4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:06.122878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5c6d500-3196-4be6-9f00-0b7979cdf2c4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:06.123711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5c6d500-3196-4be6-9f00-0b7979cdf2c4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:06.124261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5c6d500-3196-4be6-9f00-0b7979cdf2c4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:06.426602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c5c6d500-3196-4be6-9f00-0b7979cdf2c4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:06.437172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:06.437786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:06.442177 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c5c6d500-3196-4be6-9f00-0b7979cdf2c4 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1535 microversion: 2.1 time: 0.342981 Sep 10 20:56:06.443855 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1089/2094] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:06 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1535 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:06.451758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:06.452836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:06.453501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:06.454514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:06.455058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:06.457574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:06.599975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:06.612191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:06.614125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:06.615417 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d1145aea-1946-4518-9ac3-cf573a2b2bdd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1330 microversion: 2.54 time: 0.182187 Sep 10 20:56:06.622357 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1006/2095] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:06 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1330 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:56:06.999576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-113f876f-d3fb-461c-8f6a-fef3ad0859db tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:07.000206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-113f876f-d3fb-461c-8f6a-fef3ad0859db tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:07.018821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-113f876f-d3fb-461c-8f6a-fef3ad0859db tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:07.019349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-113f876f-d3fb-461c-8f6a-fef3ad0859db tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:07.020379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-113f876f-d3fb-461c-8f6a-fef3ad0859db tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:07.021130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-113f876f-d3fb-461c-8f6a-fef3ad0859db tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:07.021581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-113f876f-d3fb-461c-8f6a-fef3ad0859db tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:07.022761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-113f876f-d3fb-461c-8f6a-fef3ad0859db tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:07.094518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-607bb7aa-65a4-4604-bc51-49a1517cea0a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:07.095759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-607bb7aa-65a4-4604-bc51-49a1517cea0a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:07.107666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-607bb7aa-65a4-4604-bc51-49a1517cea0a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:07.109751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-607bb7aa-65a4-4604-bc51-49a1517cea0a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:07.114559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-607bb7aa-65a4-4604-bc51-49a1517cea0a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:07.115822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-607bb7aa-65a4-4604-bc51-49a1517cea0a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:07.120762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-607bb7aa-65a4-4604-bc51-49a1517cea0a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:07.124591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-607bb7aa-65a4-4604-bc51-49a1517cea0a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:07.399424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-113f876f-d3fb-461c-8f6a-fef3ad0859db tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:07.414681 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-113f876f-d3fb-461c-8f6a-fef3ad0859db tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.420985 Sep 10 20:56:07.418163 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1090/2096] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:06 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:07.481949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b615cabc-a851-4a96-9281-f45c2190664c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:07.484688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b615cabc-a851-4a96-9281-f45c2190664c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:07.499301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b615cabc-a851-4a96-9281-f45c2190664c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:07.511782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b615cabc-a851-4a96-9281-f45c2190664c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:07.514015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b615cabc-a851-4a96-9281-f45c2190664c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:07.516157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b615cabc-a851-4a96-9281-f45c2190664c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:07.519203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b615cabc-a851-4a96-9281-f45c2190664c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:07.520496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b615cabc-a851-4a96-9281-f45c2190664c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:07.750099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-607bb7aa-65a4-4604-bc51-49a1517cea0a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:07.767433 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-607bb7aa-65a4-4604-bc51-49a1517cea0a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.678863 Sep 10 20:56:07.769523 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1007/2097] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:07 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:07.777295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:07.778272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:07.793797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b615cabc-a851-4a96-9281-f45c2190664c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:07.795457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:07.795839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:07.796266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:07.797152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:07.807623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:07.807926 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b615cabc-a851-4a96-9281-f45c2190664c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1535 microversion: 2.1 time: 0.339365 Sep 10 20:56:07.808251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:07.840184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1091/2098] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:07 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1535 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:07.864993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4183f0ee-5582-4479-a93a-73d7409df6e1 req-cc5f0f55-1c38-48bf-81ca-f036c3818069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737acbf5-3c07-4dd1-8798-2214cb1bf7a3", "name": "network-vif-plugged", "status": "completed", "tag": "15efa8de-b0bd-4550-af77-12a26cc4db38"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:07.888673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4183f0ee-5582-4479-a93a-73d7409df6e1 req-cc5f0f55-1c38-48bf-81ca-f036c3818069 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:07.889556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4183f0ee-5582-4479-a93a-73d7409df6e1 req-cc5f0f55-1c38-48bf-81ca-f036c3818069 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:07.890212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4183f0ee-5582-4479-a93a-73d7409df6e1 req-cc5f0f55-1c38-48bf-81ca-f036c3818069 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:07.904169 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4183f0ee-5582-4479-a93a-73d7409df6e1 req-cc5f0f55-1c38-48bf-81ca-f036c3818069 service nova] Creating event network-vif-plugged:15efa8de-b0bd-4550-af77-12a26cc4db38 for instance 737acbf5-3c07-4dd1-8798-2214cb1bf7a3 on nch2-master-1 Sep 10 20:56:07.909365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4183f0ee-5582-4479-a93a-73d7409df6e1 req-cc5f0f55-1c38-48bf-81ca-f036c3818069 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067453 Sep 10 20:56:07.910351 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1092/2099] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:07.954949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:07.963913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:07.965376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:07.977071 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d42dccec-0531-4fe1-b093-5fd3847b021f tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1336 microversion: 2.54 time: 0.195647 Sep 10 20:56:07.978604 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1008/2100] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:07 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1336 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:08.445479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-80bbd0db-ffa7-410d-9fd9-7a1762835ac0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:08.447859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-80bbd0db-ffa7-410d-9fd9-7a1762835ac0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:08.461213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80bbd0db-ffa7-410d-9fd9-7a1762835ac0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:08.463427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80bbd0db-ffa7-410d-9fd9-7a1762835ac0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:08.475379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80bbd0db-ffa7-410d-9fd9-7a1762835ac0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:08.476546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80bbd0db-ffa7-410d-9fd9-7a1762835ac0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:08.477382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80bbd0db-ffa7-410d-9fd9-7a1762835ac0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:08.478646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80bbd0db-ffa7-410d-9fd9-7a1762835ac0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:08.724490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e5aa06d5-df92-4acc-9520-d524b8a0ba6b req-e9ad3ed2-cb6c-4bf1-847a-c5ecd1f7eedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e1970c-5740-4466-911f-5aef17b7336e", "name": "network-vif-deleted", "tag": "fd86c8ba-198f-490e-a5da-475f9082b557"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:08.737991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e5aa06d5-df92-4acc-9520-d524b8a0ba6b req-e9ad3ed2-cb6c-4bf1-847a-c5ecd1f7eedd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:08.738477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e5aa06d5-df92-4acc-9520-d524b8a0ba6b req-e9ad3ed2-cb6c-4bf1-847a-c5ecd1f7eedd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:08.738907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e5aa06d5-df92-4acc-9520-d524b8a0ba6b req-e9ad3ed2-cb6c-4bf1-847a-c5ecd1f7eedd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:08.772371 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e5aa06d5-df92-4acc-9520-d524b8a0ba6b req-e9ad3ed2-cb6c-4bf1-847a-c5ecd1f7eedd service nova] Creating event network-vif-deleted:fd86c8ba-198f-490e-a5da-475f9082b557 for instance a4e1970c-5740-4466-911f-5aef17b7336e on nch2-master-1 Sep 10 20:56:08.779199 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e5aa06d5-df92-4acc-9520-d524b8a0ba6b req-e9ad3ed2-cb6c-4bf1-847a-c5ecd1f7eedd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062863 Sep 10 20:56:08.780358 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1009/2101] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:56:08.793736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2dc2e08e-c00a-4197-8f0d-340af0754aea tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:08.799821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2dc2e08e-c00a-4197-8f0d-340af0754aea tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:08.811801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dc2e08e-c00a-4197-8f0d-340af0754aea tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:08.817421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dc2e08e-c00a-4197-8f0d-340af0754aea tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:08.818311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dc2e08e-c00a-4197-8f0d-340af0754aea tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:08.819416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dc2e08e-c00a-4197-8f0d-340af0754aea tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:08.820186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dc2e08e-c00a-4197-8f0d-340af0754aea tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:08.820806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dc2e08e-c00a-4197-8f0d-340af0754aea tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:08.838970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-80bbd0db-ffa7-410d-9fd9-7a1762835ac0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:08.870028 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-80bbd0db-ffa7-410d-9fd9-7a1762835ac0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.428004 Sep 10 20:56:08.887396 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1093/2102] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:08 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:08.894663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:08.895291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:08.903686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:08.904442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:08.905170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:08.907775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:08.908454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:08.909166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:08.958296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:08.959089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:08.959745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:08.960428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lazy-loading 'fault' on Instance uuid a4e1970c-5740-4466-911f-5aef17b7336e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:56:08.969291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:09.046734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:09.055772 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-01a56a17-a369-42c1-912b-444787b9724c tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1369 microversion: 2.1 time: 0.166079 Sep 10 20:56:09.057148 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1094/2103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:08 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:09.065372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:09.066379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:09.075789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:09.076502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:09.077498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:09.078743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:09.079357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:09.079956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:09.234452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:09.253167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:09.255275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:09.256498 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-34591133-406d-43f4-9c92-7c6908327e00 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1336 microversion: 2.54 time: 0.198098 Sep 10 20:56:09.257065 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1095/2104] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:09 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1336 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:09.428743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2dc2e08e-c00a-4197-8f0d-340af0754aea tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:09.446808 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2dc2e08e-c00a-4197-8f0d-340af0754aea tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.657198 Sep 10 20:56:09.462623 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1010/2105] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:08 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:09.894947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1c5b725-a7db-4232-85a0-50f0ed6b3d8f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:09.897999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a1c5b725-a7db-4232-85a0-50f0ed6b3d8f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:09.911823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c5b725-a7db-4232-85a0-50f0ed6b3d8f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:09.912318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c5b725-a7db-4232-85a0-50f0ed6b3d8f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:09.912759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c5b725-a7db-4232-85a0-50f0ed6b3d8f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:09.913471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c5b725-a7db-4232-85a0-50f0ed6b3d8f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:09.913959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c5b725-a7db-4232-85a0-50f0ed6b3d8f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:09.925287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8f8f6e44-8e94-479e-92b4-4898276b9985 tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] Calling method '.version_select at 0x7f9944bab280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:09.926302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c5b725-a7db-4232-85a0-50f0ed6b3d8f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:09.998181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:10.152597 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8f8f6e44-8e94-479e-92b4-4898276b9985 tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.514159 Sep 10 20:56:10.153352 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1096/2106] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 20:56:09 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:56:10.160025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:10.163064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:10.182590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:10.188580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:10.190810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:10.194089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:10.194737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:10.196183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:10.288176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:10.290877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:10.295309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:10.296054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lazy-loading 'fault' on Instance uuid a4e1970c-5740-4466-911f-5aef17b7336e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:56:10.308702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a1c5b725-a7db-4232-85a0-50f0ed6b3d8f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:10.322711 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a1c5b725-a7db-4232-85a0-50f0ed6b3d8f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.431078 Sep 10 20:56:10.325222 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1011/2107] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:09 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:10.331209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a0574c6-6365-4288-9032-cda8c59bd121 tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] Action: 'create', calling method: .version_select at 0x7f99444d04c0>, body: {"pool": "non_exist_pool"} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:10.372351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:10.380751 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-4a0574c6-6365-4288-9032-cda8c59bd121 tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] HTTP exception thrown: Floating IP pool not found. Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a0574c6-6365-4288-9032-cda8c59bd121 tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] Request method failure captured: Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 26 Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPnporR8TIljk1Hfg5WgXmGcxTDKc149M56YzJ84o61gy-U7DX2uDpLlkOYaXfWEMqvETxo2muwVJiGuLK5_6C4hWn6RRigls8KO9lnL3HcnDhNiNwR5XLGVdVfb9IrbtmYsp201GRQwTt9degITcVL-Mt9-FFRnkbaR4MUQPUD8Tlo Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 2d920a0c09bf4fd4a7b60fc7106a598f Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-783387309 Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d920a0c09bf4fd4a7b60fc7106a598f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d920a0c09bf4fd4a7b60fc7106a598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d920a0c09bf4fd4a7b60fc7106a598f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d920a0c09bf4fd4a7b60fc7106a598f"}]}] Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-783387309 Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 2d920a0c09bf4fd4a7b60fc7106a598f Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-783387309 Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FloatingIPsNegativeTestJSON-783387309-project Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: fb3043f55aad4e91a1c3ceb734d77af3 Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-783387309-project Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: {"pool": "non_exist_pool"} Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: exception: Floating IP pool not found. Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:10.382957 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:10.392006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 10 20:56:10.392006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.392585 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1cbf9685-dd52-42f6-93b5-c1dcac33ed81 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 200 len: 1369 microversion: 2.1 time: 0.231329 Sep 10 20:56:10.392585 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1097/2108] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:10 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 1369 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:10.394025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a0574c6-6365-4288-9032-cda8c59bd121 tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] Returning 404 to user: Floating IP pool not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:10.395405 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a0574c6-6365-4288-9032-cda8c59bd121 tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.068124 Sep 10 20:56:10.396670 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1012/2109] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 20:56:10 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:56:10.398600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:10.401141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:10.407463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7f5776dc-6ffc-4073-a35e-87be9fd7273f tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] Calling method '.version_select at 0x7f99444d9430>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:10.423246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:10.427896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:10.428682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:10.429680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:10.434751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:10.435550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:10.499621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-7f5776dc-6ffc-4073-a35e-87be9fd7273f tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d6c0a3bb-5d3b-4eec-ad8e-9d239da94530 could not be found", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:56:10.500314 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-7f5776dc-6ffc-4073-a35e-87be9fd7273f tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] HTTP exception thrown: Floating IP not found for ID d6c0a3bb-5d3b-4eec-ad8e-9d239da94530 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7f5776dc-6ffc-4073-a35e-87be9fd7273f tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] Request method failure captured: Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/os-floating-ips/d6c0a3bb-5d3b-4eec-ad8e-9d239da94530 HTTP/1.1 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPnporR8TIljk1Hfg5WgXmGcxTDKc149M56YzJ84o61gy-U7DX2uDpLlkOYaXfWEMqvETxo2muwVJiGuLK5_6C4hWn6RRigls8KO9lnL3HcnDhNiNwR5XLGVdVfb9IrbtmYsp201GRQwTt9degITcVL-Mt9-FFRnkbaR4MUQPUD8Tlo Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 2d920a0c09bf4fd4a7b60fc7106a598f Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-783387309 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d920a0c09bf4fd4a7b60fc7106a598f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d920a0c09bf4fd4a7b60fc7106a598f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d920a0c09bf4fd4a7b60fc7106a598f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d920a0c09bf4fd4a7b60fc7106a598f"}]}] Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-783387309 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 2d920a0c09bf4fd4a7b60fc7106a598f Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-783387309 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FloatingIPsNegativeTestJSON-783387309-project Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: fb3043f55aad4e91a1c3ceb734d77af3 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-783387309-project Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: exception: Floating IP not found for ID d6c0a3bb-5d3b-4eec-ad8e-9d239da94530 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'd6c0a3bb-5d3b-4eec-ad8e-9d239da94530'} Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d6c0a3bb-5d3b-4eec-ad8e-9d239da94530 could not be found Sep 10 20:56:10.502520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a34cd580-75a3-4ab6-8692-7d730e8ac0cb'] Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d6c0a3bb-5d3b-4eec-ad8e-9d239da94530. Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d6c0a3bb-5d3b-4eec-ad8e-9d239da94530 Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d6c0a3bb-5d3b-4eec-ad8e-9d239da94530 Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7f5776dc-6ffc-4073-a35e-87be9fd7273f tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] Returning 404 to user: Floating IP not found for ID d6c0a3bb-5d3b-4eec-ad8e-9d239da94530 {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7f5776dc-6ffc-4073-a35e-87be9fd7273f tempest-FloatingIPsNegativeTestJSON-783387309 tempest-FloatingIPsNegativeTestJSON-783387309-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/d6c0a3bb-5d3b-4eec-ad8e-9d239da94530" status: 404 len: 111 microversion: 2.1 time: 0.100875 Sep 10 20:56:10.511720 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1013/2110] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:56:10 2022] DELETE /compute/v2.1/os-floating-ips/d6c0a3bb-5d3b-4eec-ad8e-9d239da94530 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:56:10.520607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0a843e14-5655-46ef-a3a4-635926e779a6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:10.520607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0a843e14-5655-46ef-a3a4-635926e779a6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:10.530981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a843e14-5655-46ef-a3a4-635926e779a6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:10.531480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a843e14-5655-46ef-a3a4-635926e779a6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:10.531922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a843e14-5655-46ef-a3a4-635926e779a6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:10.532637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a843e14-5655-46ef-a3a4-635926e779a6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:10.533094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a843e14-5655-46ef-a3a4-635926e779a6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:10.533524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a843e14-5655-46ef-a3a4-635926e779a6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:10.680245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:10.693316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:10.695098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:10.698889 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-282865c6-f527-4891-b01d-c40a9df113b2 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1357 microversion: 2.54 time: 0.307706 Sep 10 20:56:10.733312 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1098/2111] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:10 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1357 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:10.747943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ac7957a-dfb8-45ea-b820-4453060179cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Action: 'create', calling method: .version_select at 0x7f9944d0e4c0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-61475335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVC4ZW0Q6vVSBd7BlJteEUZkBGN9YT1Ms5uURulVH7cduiaD97Tfdy18FZJNC9cjxBDnE+L11aed8U+I0bPFupIFI8Nb4dhwh/Apkfpktb9bK8ZUBPDijsIVuuVHwmXZw=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:10.778192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-6ac7957a-dfb8-45ea-b820-4453060179cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Getting quotas for project 639eb01bc0484295b917ab8d0ceee6ab. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:56:10.788428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-6ac7957a-dfb8-45ea-b820-4453060179cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Getting quotas for user a681592c2d1043a4afa67838812e7fe9 and project 639eb01bc0484295b917ab8d0ceee6ab. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:56:10.828990 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ac7957a-dfb8-45ea-b820-4453060179cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.54 time: 0.093606 Sep 10 20:56:10.838576 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1099/2112] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Sep 10 20:56:10 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 20:56:10.859407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-61475335", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:10.863080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:10.866990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:10.875046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:10.875925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:10.876567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:10.877695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:10.878384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:10.879161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:11.089756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:11.090482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:11.090742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:11.091214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:11.091667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:11.175608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0a843e14-5655-46ef-a3a4-635926e779a6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:11.189365 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0a843e14-5655-46ef-a3a4-635926e779a6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.681705 Sep 10 20:56:11.207330 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1014/2113] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:10 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1318 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:11.230231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:11.239065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:11.240167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:11.241695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:11.243091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:11.244753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:11.245669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:11.299062 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f671e288-76af-43a1-b070-e39caca99377 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "POST /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038/action" status: 202 len: 1138 microversion: 2.54 time: 0.458190 Sep 10 20:56:11.319593 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1100/2114] 10.222.0.33 () {62 vars in 1320 bytes} [Sat Sep 10 20:56:10 2022] POST /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038/action => generated 1138 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 20:56:11.325536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:11.326058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:11.342760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:11.343288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:11.343743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:11.345494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:11.345494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:11.345764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:11.367828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1ad18d5b-d55b-4374-8bcc-6382d5105c55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:11.370264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1ad18d5b-d55b-4374-8bcc-6382d5105c55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:11.405231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad18d5b-d55b-4374-8bcc-6382d5105c55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:11.411272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad18d5b-d55b-4374-8bcc-6382d5105c55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:11.413255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad18d5b-d55b-4374-8bcc-6382d5105c55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:11.414097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad18d5b-d55b-4374-8bcc-6382d5105c55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:11.414588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad18d5b-d55b-4374-8bcc-6382d5105c55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:11.416991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1ad18d5b-d55b-4374-8bcc-6382d5105c55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:11.602387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:11.617916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:11.620337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:11.621570 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9e599efc-c9cd-483e-aa43-ae1e5b87f8e1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.300501 Sep 10 20:56:11.622189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1015/2115] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:11 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:11.639674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:11.640295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: a4e1970c-5740-4466-911f-5aef17b7336e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:11.654505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:11.655009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:11.655462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:11.656194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:11.656660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:11.657095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:11.714089 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] HTTP exception thrown: Instance a4e1970c-5740-4466-911f-5aef17b7336e could not be found. Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Request method failure captured: Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e HTTP/1.1 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPigZVPOpCh9XNZEoiKAjstHtwCC1cWzYVoo9-egRrTI6vcIspKu1dcq8wJ7YlF8RRhvaYMarajVefHiYr3FuBNVjRY0dVMrP3fBfFO1famVTYcr1-g0H9wO6sMkt4SXut0v13WWVZVuIkWernH8czz-8ajtbkBO8mttnUGFB-dri84 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d969d135196e409584d6647d5186c9c9 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d969d135196e409584d6647d5186c9c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d969d135196e409584d6647d5186c9c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d969d135196e409584d6647d5186c9c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d969d135196e409584d6647d5186c9c9"}]}] Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d969d135196e409584d6647d5186c9c9 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-MigrationsAdminTest-2115713060-project Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 870c4c66a15b4546bd981cfb5932b214 Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-MigrationsAdminTest-2115713060-project Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance a4e1970c-5740-4466-911f-5aef17b7336e could not be found. Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'a4e1970c-5740-4466-911f-5aef17b7336e'} Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e1970c-5740-4466-911f-5aef17b7336e could not be found. Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e1970c-5740-4466-911f-5aef17b7336e could not be found. Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:11.715944 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:11.721522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:11.721522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:11.721522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:11.721522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:11.721522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:11.721522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e1970c-5740-4466-911f-5aef17b7336e could not be found. Sep 10 20:56:11.721522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:11.730799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Returning 404 to user: Instance a4e1970c-5740-4466-911f-5aef17b7336e could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:11.732621 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3cb5c4e9-487f-452a-be55-d0f95676089f tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e" status: 404 len: 111 microversion: 2.1 time: 0.109421 Sep 10 20:56:11.739240 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1016/2116] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:11 2022] GET /compute/v2.1/servers/a4e1970c-5740-4466-911f-5aef17b7336e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:56:11.745094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-69d4eb92-76fc-4be3-84c5-2912ce7c6887 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '.version_select at 0x7f99446549d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:11.798371 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-69d4eb92-76fc-4be3-84c5-2912ce7c6887 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409619840" status: 202 len: 0 microversion: 2.1 time: 0.057247 Sep 10 20:56:11.799191 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1017/2117] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 20:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409619840 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:56:11.872071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1ad18d5b-d55b-4374-8bcc-6382d5105c55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:11.890971 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1ad18d5b-d55b-4374-8bcc-6382d5105c55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.536181 Sep 10 20:56:11.892242 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1101/2118] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:11 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:12.214762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cfc04077-6bd7-4c21-9223-f426ab5eb22a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:12.216641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cfc04077-6bd7-4c21-9223-f426ab5eb22a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:12.238068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cfc04077-6bd7-4c21-9223-f426ab5eb22a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:12.241659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cfc04077-6bd7-4c21-9223-f426ab5eb22a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:12.242399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cfc04077-6bd7-4c21-9223-f426ab5eb22a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:12.245401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cfc04077-6bd7-4c21-9223-f426ab5eb22a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:12.249027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cfc04077-6bd7-4c21-9223-f426ab5eb22a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:12.249897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cfc04077-6bd7-4c21-9223-f426ab5eb22a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:12.650787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:12.651439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:12.666227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:12.666924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:12.667397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:12.668165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:12.668634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:12.669067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:12.974821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:12.992961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:12.995867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:12.997295 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9df79505-282c-42c6-9e59-bc818775f764 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.351234 Sep 10 20:56:13.012367 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1102/2119] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:12 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:56:13.023664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3353b0f9-1faf-453d-85cd-78840c171fe2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:13.025449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3353b0f9-1faf-453d-85cd-78840c171fe2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:13.036092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3353b0f9-1faf-453d-85cd-78840c171fe2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:13.036867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3353b0f9-1faf-453d-85cd-78840c171fe2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:13.037609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3353b0f9-1faf-453d-85cd-78840c171fe2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:13.038700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3353b0f9-1faf-453d-85cd-78840c171fe2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:13.039291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3353b0f9-1faf-453d-85cd-78840c171fe2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:13.040117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3353b0f9-1faf-453d-85cd-78840c171fe2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:13.122021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cfc04077-6bd7-4c21-9223-f426ab5eb22a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:13.133788 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cfc04077-6bd7-4c21-9223-f426ab5eb22a tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1508 microversion: 2.1 time: 0.924518 Sep 10 20:56:13.144266 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1018/2120] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:12 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1508 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:13.619284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3353b0f9-1faf-453d-85cd-78840c171fe2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:13.636120 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3353b0f9-1faf-453d-85cd-78840c171fe2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.621842 Sep 10 20:56:13.637093 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1103/2121] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:13 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:14.031449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:14.032068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:14.045461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:14.046292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:14.046953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:14.047852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:14.048490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:14.049095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:14.199301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:14.217526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:14.223225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:14.225391 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f274e8f3-c89a-4cd6-a437-7e39cf5883ff tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.198722 Sep 10 20:56:14.228922 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1019/2122] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:14 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:14.678159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1f14e93f-0a09-4b2a-8200-e9960ec82ac8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:14.683112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1f14e93f-0a09-4b2a-8200-e9960ec82ac8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:14.707821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-924de09a-6729-464d-8347-a90ebd6ec265 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:14.713738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-924de09a-6729-464d-8347-a90ebd6ec265 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:14.725187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-924de09a-6729-464d-8347-a90ebd6ec265 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:14.725491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f14e93f-0a09-4b2a-8200-e9960ec82ac8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:14.725691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-924de09a-6729-464d-8347-a90ebd6ec265 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:14.726054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f14e93f-0a09-4b2a-8200-e9960ec82ac8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:14.730426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-924de09a-6729-464d-8347-a90ebd6ec265 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:14.730954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f14e93f-0a09-4b2a-8200-e9960ec82ac8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:14.731789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f14e93f-0a09-4b2a-8200-e9960ec82ac8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:14.732176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-924de09a-6729-464d-8347-a90ebd6ec265 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:14.732307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f14e93f-0a09-4b2a-8200-e9960ec82ac8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:14.732664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f14e93f-0a09-4b2a-8200-e9960ec82ac8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:14.732787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-924de09a-6729-464d-8347-a90ebd6ec265 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:14.733097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-924de09a-6729-464d-8347-a90ebd6ec265 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:14.828796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-924de09a-6729-464d-8347-a90ebd6ec265 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:56:15.103614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:15.117251 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-924de09a-6729-464d-8347-a90ebd6ec265 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "DELETE /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 204 len: 0 microversion: 2.1 time: 0.414007 Sep 10 20:56:15.118051 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1020/2123] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:56:14 2022] DELETE /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:56:15.127991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0e1a9230-921e-4c02-82ca-66b35992c700"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:15.132129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:15.139298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:15.141633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:15.142356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:15.142972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:15.144129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:15.144830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:15.145489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:15.216629 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] HTTP exception thrown: Volume 23bb6f0a-3bdc-43af-b06e-e0ffeab2065e could not be found. Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Request method failure captured: Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3/os-volume_attachments/23bb6f0a-3bdc-43af-b06e-e0ffeab2065e HTTP/1.1 Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 74 Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPl3jZJoruk7E5vZLhJIiVrQoo2XwDiF7KOskL3TtXAkmheEj5-wJUj3BMVrUY9M6LJgfb5sDdEnU-2xHGfJsKdzh5g4QNjmQESJqiOI6zodpjn67ba-5pxyWnCLh37sC3nNqWBm9sB7js8z2rBpzYIipjaMiU66H8KCUoFSolT1Dtc Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 8d8536a456e94f5b842c0f9be5caf0ff Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-VolumesAdminNegativeTest-1848135853 Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d8536a456e94f5b842c0f9be5caf0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8d8536a456e94f5b842c0f9be5caf0ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8d8536a456e94f5b842c0f9be5caf0ff", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8d8536a456e94f5b842c0f9be5caf0ff"}]}] Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-VolumesAdminNegativeTest-1848135853 Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 8d8536a456e94f5b842c0f9be5caf0ff Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1848135853 Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-VolumesAdminNegativeTest-1848135853-project-admin Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5fa4298166524e10a0cf869cdec9df34 Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-VolumesAdminNegativeTest-1848135853-project-admin Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: {"volumeAttachment": {"volumeId": "0e1a9230-921e-4c02-82ca-66b35992c700"}} Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: exception: Volume 23bb6f0a-3bdc-43af-b06e-e0ffeab2065e could not be found. Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'server_id': '737acbf5-3c07-4dd1-8798-2214cb1bf7a3', 'id': '23bb6f0a-3bdc-43af-b06e-e0ffeab2065e', 'body': {'volumeAttachment': {'volumeId': '0e1a9230-921e-4c02-82ca-66b35992c700'}}} Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 23bb6f0a-3bdc-43af-b06e-e0ffeab2065e could not be found. (HTTP 404) (Request-ID: req-7957bd87-7879-4ba8-b880-d79a29df943e) Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 20:56:15.219353 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 23bb6f0a-3bdc-43af-b06e-e0ffeab2065e could not be found. Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 23bb6f0a-3bdc-43af-b06e-e0ffeab2065e could not be found. Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 23bb6f0a-3bdc-43af-b06e-e0ffeab2065e could not be found. Sep 10 20:56:15.225749 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:15.236814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] Returning 404 to user: Volume 23bb6f0a-3bdc-43af-b06e-e0ffeab2065e could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:15.240847 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2725f595-e7dc-437a-9062-a166b8c4db37 tempest-VolumesAdminNegativeTest-1848135853 tempest-VolumesAdminNegativeTest-1848135853-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3/os-volume_attachments/23bb6f0a-3bdc-43af-b06e-e0ffeab2065e" status: 404 len: 109 microversion: 2.1 time: 0.120827 Sep 10 20:56:15.242190 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1021/2124] 10.222.0.33 () {60 vars in 1433 bytes} [Sat Sep 10 20:56:15 2022] PUT /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3/os-volume_attachments/23bb6f0a-3bdc-43af-b06e-e0ffeab2065e => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:56:15.255543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3ae2c622-7c0e-4993-848a-8ea90ad2b51a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:15.256180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3ae2c622-7c0e-4993-848a-8ea90ad2b51a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:15.264093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ae2c622-7c0e-4993-848a-8ea90ad2b51a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:15.264601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ae2c622-7c0e-4993-848a-8ea90ad2b51a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:15.265044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ae2c622-7c0e-4993-848a-8ea90ad2b51a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:15.265754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ae2c622-7c0e-4993-848a-8ea90ad2b51a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:15.266351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ae2c622-7c0e-4993-848a-8ea90ad2b51a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:15.266782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ae2c622-7c0e-4993-848a-8ea90ad2b51a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:15.559880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1f14e93f-0a09-4b2a-8200-e9960ec82ac8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:15.574107 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1f14e93f-0a09-4b2a-8200-e9960ec82ac8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.909313 Sep 10 20:56:15.576574 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1104/2125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:14 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:15.581843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:15.583743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:15.590636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:15.591397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:15.592059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:15.593510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:15.595144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:15.595853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:15.720636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:15.731431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3ae2c622-7c0e-4993-848a-8ea90ad2b51a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:15.742740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:15.744909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:15.745756 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3ae2c622-7c0e-4993-848a-8ea90ad2b51a tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1468 microversion: 2.1 time: 0.497874 Sep 10 20:56:15.748172 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-58903651-50df-4a1b-8f87-0be6a9a31dc4 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.168416 Sep 10 20:56:15.762298 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1105/2126] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:15 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:15.787110 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1022/2127] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:15 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1468 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:16.507121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1afb78a5-76d7-4a3c-8079-2acf64df24d6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:16.507889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1afb78a5-76d7-4a3c-8079-2acf64df24d6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:16.518316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1afb78a5-76d7-4a3c-8079-2acf64df24d6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:16.521468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1afb78a5-76d7-4a3c-8079-2acf64df24d6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:16.522319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1afb78a5-76d7-4a3c-8079-2acf64df24d6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:16.526407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1afb78a5-76d7-4a3c-8079-2acf64df24d6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:16.526921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1afb78a5-76d7-4a3c-8079-2acf64df24d6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:16.527367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1afb78a5-76d7-4a3c-8079-2acf64df24d6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:16.601018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1afb78a5-76d7-4a3c-8079-2acf64df24d6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:56:16.606790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-87bb8b56-7cf3-45a0-8a5a-59797db91586 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:16.609312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-87bb8b56-7cf3-45a0-8a5a-59797db91586 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:16.620919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87bb8b56-7cf3-45a0-8a5a-59797db91586 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:16.621426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87bb8b56-7cf3-45a0-8a5a-59797db91586 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:16.621895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87bb8b56-7cf3-45a0-8a5a-59797db91586 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:16.622620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87bb8b56-7cf3-45a0-8a5a-59797db91586 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:16.623085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87bb8b56-7cf3-45a0-8a5a-59797db91586 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:16.623633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87bb8b56-7cf3-45a0-8a5a-59797db91586 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:16.815804 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1afb78a5-76d7-4a3c-8079-2acf64df24d6 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "DELETE /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 204 len: 0 microversion: 2.1 time: 0.316875 Sep 10 20:56:16.822872 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1106/2128] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:56:16 2022] DELETE /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:56:16.830198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8f8f179-bbce-4475-b83f-f1ae5e4bdb91 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:16.832271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8f8f179-bbce-4475-b83f-f1ae5e4bdb91 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:16.844299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8f8f179-bbce-4475-b83f-f1ae5e4bdb91 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:16.844990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8f8f179-bbce-4475-b83f-f1ae5e4bdb91 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:16.845439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8f8f179-bbce-4475-b83f-f1ae5e4bdb91 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:16.846255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8f8f179-bbce-4475-b83f-f1ae5e4bdb91 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:16.846720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8f8f179-bbce-4475-b83f-f1ae5e4bdb91 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:16.852214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8f8f179-bbce-4475-b83f-f1ae5e4bdb91 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:17.150610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8f8f179-bbce-4475-b83f-f1ae5e4bdb91 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:17.166395 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8f8f179-bbce-4475-b83f-f1ae5e4bdb91 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1468 microversion: 2.1 time: 0.344316 Sep 10 20:56:17.183843 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1107/2129] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:16 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1468 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:17.183843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:17.183843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:17.191827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:17.195544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:17.196021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:17.197634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:17.198319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:17.198669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:17.362663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87bb8b56-7cf3-45a0-8a5a-59797db91586 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:17.370134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:17.378309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:17.378848 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-87bb8b56-7cf3-45a0-8a5a-59797db91586 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.777444 Sep 10 20:56:17.380118 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1023/2130] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:16 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:17.387254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b1d39993-5a42-4f36-98f1-383c5c80fa77 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:17.388219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b1d39993-5a42-4f36-98f1-383c5c80fa77 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:17.401790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:17.412951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:17.421495 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fb909fc4-67e8-4f24-b492-6acc0cb52b70 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.243540 Sep 10 20:56:17.436764 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1108/2131] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:17 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:17.441180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1d39993-5a42-4f36-98f1-383c5c80fa77 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:17.450675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1d39993-5a42-4f36-98f1-383c5c80fa77 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:17.451368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1d39993-5a42-4f36-98f1-383c5c80fa77 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:17.452137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1d39993-5a42-4f36-98f1-383c5c80fa77 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:17.452605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1d39993-5a42-4f36-98f1-383c5c80fa77 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:17.453042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1d39993-5a42-4f36-98f1-383c5c80fa77 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:18.083298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a8d50c0b-db2f-4732-ba61-ed2639c265a0 req-ee927888-f350-4159-b229-aebf59d9c349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435d0526-f990-4ec6-b38f-13aa30486469", "name": "network-vif-deleted", "tag": "bfa95032-3491-453d-9ca4-83b61c66730d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:18.085605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b1d39993-5a42-4f36-98f1-383c5c80fa77 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:18.109732 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b1d39993-5a42-4f36-98f1-383c5c80fa77 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1514 microversion: 2.1 time: 0.728240 Sep 10 20:56:18.115667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a8d50c0b-db2f-4732-ba61-ed2639c265a0 req-ee927888-f350-4159-b229-aebf59d9c349 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:18.116234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a8d50c0b-db2f-4732-ba61-ed2639c265a0 req-ee927888-f350-4159-b229-aebf59d9c349 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:18.116834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a8d50c0b-db2f-4732-ba61-ed2639c265a0 req-ee927888-f350-4159-b229-aebf59d9c349 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:18.125720 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1024/2132] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:17 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1514 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:18.148590 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a8d50c0b-db2f-4732-ba61-ed2639c265a0 req-ee927888-f350-4159-b229-aebf59d9c349 service nova] Creating event network-vif-deleted:bfa95032-3491-453d-9ca4-83b61c66730d for instance 435d0526-f990-4ec6-b38f-13aa30486469 on nch2-master-1 Sep 10 20:56:18.174566 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a8d50c0b-db2f-4732-ba61-ed2639c265a0 req-ee927888-f350-4159-b229-aebf59d9c349 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094908 Sep 10 20:56:18.177667 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1109/2133] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:18.195923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f31dd95d-d0a6-4f77-a3b8-c65231392254 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:18.198815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f31dd95d-d0a6-4f77-a3b8-c65231392254 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:18.212739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f31dd95d-d0a6-4f77-a3b8-c65231392254 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:18.214522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f31dd95d-d0a6-4f77-a3b8-c65231392254 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:18.215556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f31dd95d-d0a6-4f77-a3b8-c65231392254 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:18.216613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f31dd95d-d0a6-4f77-a3b8-c65231392254 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:18.217341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f31dd95d-d0a6-4f77-a3b8-c65231392254 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:18.219373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f31dd95d-d0a6-4f77-a3b8-c65231392254 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:18.408114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-64f204b8-b3de-41c8-a623-1d6ea62429dc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:18.410734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-64f204b8-b3de-41c8-a623-1d6ea62429dc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:18.424717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64f204b8-b3de-41c8-a623-1d6ea62429dc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:18.431260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64f204b8-b3de-41c8-a623-1d6ea62429dc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:18.431831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64f204b8-b3de-41c8-a623-1d6ea62429dc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:18.432684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64f204b8-b3de-41c8-a623-1d6ea62429dc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:18.433174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64f204b8-b3de-41c8-a623-1d6ea62429dc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:18.433611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64f204b8-b3de-41c8-a623-1d6ea62429dc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:18.607251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f31dd95d-d0a6-4f77-a3b8-c65231392254 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:18.648449 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f31dd95d-d0a6-4f77-a3b8-c65231392254 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 200 len: 1298 microversion: 2.1 time: 0.459219 Sep 10 20:56:18.653413 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1025/2134] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:18 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 1298 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:18.670131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:18.689381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:18.725860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:18.726417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:18.726870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:18.728364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:18.729281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:18.729746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:18.804350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-64f204b8-b3de-41c8-a623-1d6ea62429dc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:18.817056 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-64f204b8-b3de-41c8-a623-1d6ea62429dc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1498 microversion: 2.1 time: 0.414746 Sep 10 20:56:18.822025 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1110/2135] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:18 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1498 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:19.102217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:19.128650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:19.134460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:19.143915 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d20ea4b1-9819-471b-8041-1dd3b41e798b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.485613 Sep 10 20:56:19.147845 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1026/2136] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:18 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:19.169409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2c2faca4-15bf-48eb-8da6-63e9221e50b0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:19.177446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2c2faca4-15bf-48eb-8da6-63e9221e50b0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:19.205459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c2faca4-15bf-48eb-8da6-63e9221e50b0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:19.208294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c2faca4-15bf-48eb-8da6-63e9221e50b0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:19.208787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c2faca4-15bf-48eb-8da6-63e9221e50b0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:19.212315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c2faca4-15bf-48eb-8da6-63e9221e50b0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:19.216185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c2faca4-15bf-48eb-8da6-63e9221e50b0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:19.220804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c2faca4-15bf-48eb-8da6-63e9221e50b0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:19.247816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2083774589", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "4f12ae9c-3aad-4e6b-a7d6-742005ff2d43"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:19.431359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] validate_networks() for [('4f12ae9c-3aad-4e6b-a7d6-742005ff2d43', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:56:19.688103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2c2faca4-15bf-48eb-8da6-63e9221e50b0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:19.705644 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2c2faca4-15bf-48eb-8da6-63e9221e50b0 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1514 microversion: 2.1 time: 0.556570 Sep 10 20:56:19.707567 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1027/2137] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:19 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1514 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:19.716533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:19.721469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 435d0526-f990-4ec6-b38f-13aa30486469] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:19.737293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:19.738339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:19.739044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:19.741796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:19.742571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:19.744371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:19.776274 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] HTTP exception thrown: Instance 435d0526-f990-4ec6-b38f-13aa30486469 could not be found. Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Request method failure captured: Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 HTTP/1.1 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPigZVPOpCh9XNZEoiKAjstHtwCC1cWzYVoo9-egRrTI6vcIspKu1dcq8wJ7YlF8RRhvaYMarajVefHiYr3FuBNVjRY0dVMrP3fBfFO1famVTYcr1-g0H9wO6sMkt4SXut0v13WWVZVuIkWernH8czz-8ajtbkBO8mttnUGFB-dri84 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d969d135196e409584d6647d5186c9c9 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d969d135196e409584d6647d5186c9c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d969d135196e409584d6647d5186c9c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d969d135196e409584d6647d5186c9c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d969d135196e409584d6647d5186c9c9"}]}] Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d969d135196e409584d6647d5186c9c9 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-MigrationsAdminTest-2115713060-project Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 870c4c66a15b4546bd981cfb5932b214 Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-MigrationsAdminTest-2115713060-project Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 435d0526-f990-4ec6-b38f-13aa30486469 could not be found. Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '435d0526-f990-4ec6-b38f-13aa30486469'} Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435d0526-f990-4ec6-b38f-13aa30486469 could not be found. Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435d0526-f990-4ec6-b38f-13aa30486469 could not be found. Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:19.778210 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:19.784175 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:19.784175 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:19.784175 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:19.784175 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:19.784175 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:19.784175 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435d0526-f990-4ec6-b38f-13aa30486469 could not be found. Sep 10 20:56:19.784175 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:19.786329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Returning 404 to user: Instance 435d0526-f990-4ec6-b38f-13aa30486469 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:19.787432 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2532364c-2367-49da-955a-beda6a651828 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469" status: 404 len: 111 microversion: 2.1 time: 0.077849 Sep 10 20:56:19.792363 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1028/2138] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:19 2022] GET /compute/v2.1/servers/435d0526-f990-4ec6-b38f-13aa30486469 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:56:19.797655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3f949c3-df88-482d-8521-7829058732e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:19.798522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b3f949c3-df88-482d-8521-7829058732e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:19.805405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3f949c3-df88-482d-8521-7829058732e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:19.806271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3f949c3-df88-482d-8521-7829058732e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:19.807059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3f949c3-df88-482d-8521-7829058732e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:19.808038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3f949c3-df88-482d-8521-7829058732e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:19.809185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3f949c3-df88-482d-8521-7829058732e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:19.809850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3f949c3-df88-482d-8521-7829058732e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:19.849632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b3f949c3-df88-482d-8521-7829058732e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:56:19.896786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:19.963603 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b3f949c3-df88-482d-8521-7829058732e5 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 204 len: 0 microversion: 2.1 time: 0.169575 Sep 10 20:56:19.967802 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1029/2139] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:56:19 2022] DELETE /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:56:19.974298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-163e5aa1-d5a2-4705-83d5-65efeaeb67e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:19.975240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-163e5aa1-d5a2-4705-83d5-65efeaeb67e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:19.983874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-163e5aa1-d5a2-4705-83d5-65efeaeb67e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:19.984856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-163e5aa1-d5a2-4705-83d5-65efeaeb67e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:19.985472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-163e5aa1-d5a2-4705-83d5-65efeaeb67e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:19.986657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-163e5aa1-d5a2-4705-83d5-65efeaeb67e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:19.987313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-163e5aa1-d5a2-4705-83d5-65efeaeb67e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:19.987918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-163e5aa1-d5a2-4705-83d5-65efeaeb67e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:20.363246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-163e5aa1-d5a2-4705-83d5-65efeaeb67e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:20.374131 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-163e5aa1-d5a2-4705-83d5-65efeaeb67e7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 200 len: 1475 microversion: 2.1 time: 0.404552 Sep 10 20:56:20.374802 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1030/2140] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:19 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 1475 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:20.380822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8eb96d4e-ff35-4246-b575-2b0455d93953 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:20.381547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8eb96d4e-ff35-4246-b575-2b0455d93953 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:20.388783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eb96d4e-ff35-4246-b575-2b0455d93953 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:20.390096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eb96d4e-ff35-4246-b575-2b0455d93953 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:20.390639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eb96d4e-ff35-4246-b575-2b0455d93953 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:20.391447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eb96d4e-ff35-4246-b575-2b0455d93953 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:20.392154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eb96d4e-ff35-4246-b575-2b0455d93953 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:20.392811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eb96d4e-ff35-4246-b575-2b0455d93953 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:20.600890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8eb96d4e-ff35-4246-b575-2b0455d93953 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:20.612880 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8eb96d4e-ff35-4246-b575-2b0455d93953 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1469 microversion: 2.1 time: 0.236933 Sep 10 20:56:20.614070 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1031/2141] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:20 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1469 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:20.626775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:20.629861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:20.643400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:20.651786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:20.652417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:20.654934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:20.655730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:20.658581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:20.808646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:20.814133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:20.816847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:20.817413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:20.817923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:20.818345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:20.819063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:20.826878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:20.829958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:20.831546 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d25e483f-3880-4904-9d32-76af57fee8cc tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.216025 Sep 10 20:56:20.832291 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1032/2142] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:20 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:20.836379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:20.836913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:20.837389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:20.840396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:20.841101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:20.841911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:20.851986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-173c10b7-aba0-47de-b16f-3af6f4bf68ab req-990d8bd4-e847-426a-a8b8-4b905f3ec62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737acbf5-3c07-4dd1-8798-2214cb1bf7a3", "name": "network-vif-deleted", "tag": "15efa8de-b0bd-4550-af77-12a26cc4db38"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:20.862561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Getting quotas for project c14add960abe42f580aeeade3e6f27d9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:56:20.869507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Getting quotas for user 4c3e0565f75c4f558a8936f547ae9d76 and project c14add960abe42f580aeeade3e6f27d9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:56:20.876349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:20.888764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:56:20.891641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:56:20.892310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-173c10b7-aba0-47de-b16f-3af6f4bf68ab req-990d8bd4-e847-426a-a8b8-4b905f3ec62d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:20.894114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-173c10b7-aba0-47de-b16f-3af6f4bf68ab req-990d8bd4-e847-426a-a8b8-4b905f3ec62d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:20.895673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-173c10b7-aba0-47de-b16f-3af6f4bf68ab req-990d8bd4-e847-426a-a8b8-4b905f3ec62d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:20.929629 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-173c10b7-aba0-47de-b16f-3af6f4bf68ab req-990d8bd4-e847-426a-a8b8-4b905f3ec62d service nova] Creating event network-vif-deleted:15efa8de-b0bd-4550-af77-12a26cc4db38 for instance 737acbf5-3c07-4dd1-8798-2214cb1bf7a3 on nch2-master-1 Sep 10 20:56:20.943843 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-173c10b7-aba0-47de-b16f-3af6f4bf68ab req-990d8bd4-e847-426a-a8b8-4b905f3ec62d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108614 Sep 10 20:56:20.945273 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1033/2143] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:20.961132 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e4b75a53-003f-4d7f-9a41-d54ae7d6d22d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.141810 Sep 10 20:56:20.961851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9406185b-0bc3-4fbc-8b7f-9b900a58ca40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-560205784"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:20.964612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9406185b-0bc3-4fbc-8b7f-9b900a58ca40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:20.968927 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1111/2144] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:56:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:56:20.984044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-32507438-a1ff-4409-94db-7bbde8fde2a9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:20.987377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-32507438-a1ff-4409-94db-7bbde8fde2a9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:21.003742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32507438-a1ff-4409-94db-7bbde8fde2a9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:21.005009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32507438-a1ff-4409-94db-7bbde8fde2a9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:21.005863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32507438-a1ff-4409-94db-7bbde8fde2a9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:21.006787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32507438-a1ff-4409-94db-7bbde8fde2a9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:21.007433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32507438-a1ff-4409-94db-7bbde8fde2a9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:21.007870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32507438-a1ff-4409-94db-7bbde8fde2a9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:21.018114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9406185b-0bc3-4fbc-8b7f-9b900a58ca40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:21.018809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9406185b-0bc3-4fbc-8b7f-9b900a58ca40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:21.020454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9406185b-0bc3-4fbc-8b7f-9b900a58ca40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:21.021389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9406185b-0bc3-4fbc-8b7f-9b900a58ca40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:21.024054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9406185b-0bc3-4fbc-8b7f-9b900a58ca40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:21.029449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9406185b-0bc3-4fbc-8b7f-9b900a58ca40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:21.177879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-32507438-a1ff-4409-94db-7bbde8fde2a9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:21.206319 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-32507438-a1ff-4409-94db-7bbde8fde2a9 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1472 microversion: 2.1 time: 0.235498 Sep 10 20:56:21.210367 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1112/2145] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:20 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1472 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:21.231251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8dde0045-7878-42e7-89d0-11c6059f40cc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:21.234765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8dde0045-7878-42e7-89d0-11c6059f40cc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:21.390546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8dde0045-7878-42e7-89d0-11c6059f40cc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:21.397681 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8dde0045-7878-42e7-89d0-11c6059f40cc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1218 microversion: 2.1 time: 0.186261 Sep 10 20:56:21.398306 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1113/2146] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:21 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:21.516179 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9406185b-0bc3-4fbc-8b7f-9b900a58ca40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931/action" status: 202 len: 0 microversion: 2.1 time: 0.567155 Sep 10 20:56:21.518120 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1034/2147] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:56:20 2022] POST /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 20:56:21.534122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3aeb9c1a-3b05-434c-8772-5835ee9745d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99444883a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:21.631908 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3aeb9c1a-3b05-434c-8772-5835ee9745d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.106383 Sep 10 20:56:21.639326 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1035/2148] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:21 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:21.668547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c8bff75a-e136-4cae-8d14-3b0382bc5e92 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:21.672742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c8bff75a-e136-4cae-8d14-3b0382bc5e92 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:21.703306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bff75a-e136-4cae-8d14-3b0382bc5e92 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:21.705067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bff75a-e136-4cae-8d14-3b0382bc5e92 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:21.706022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bff75a-e136-4cae-8d14-3b0382bc5e92 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:21.710218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bff75a-e136-4cae-8d14-3b0382bc5e92 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:21.711349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bff75a-e136-4cae-8d14-3b0382bc5e92 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:21.714737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8bff75a-e136-4cae-8d14-3b0382bc5e92 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:21.738652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5417452b-0edf-4217-8065-5e4241205b2f tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Action: 'update', calling method: .version_select at 0x7f9944ad8e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:21.888452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5417452b-0edf-4217-8065-5e4241205b2f tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:21.890135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5417452b-0edf-4217-8065-5e4241205b2f tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:21.890850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5417452b-0edf-4217-8065-5e4241205b2f tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:21.892488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5417452b-0edf-4217-8065-5e4241205b2f tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:21.893215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5417452b-0edf-4217-8065-5e4241205b2f tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:21.894615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5417452b-0edf-4217-8065-5e4241205b2f tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:21.972960 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5417452b-0edf-4217-8065-5e4241205b2f tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/a7dc1f22c575422ea13061e90e0aeb49" status: 200 len: 148 microversion: 2.57 time: 0.573553 Sep 10 20:56:21.974379 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1114/2149] 10.222.0.33 () {62 vars in 1303 bytes} [Sat Sep 10 20:56:21 2022] PUT /compute/v2.1/os-quota-sets/a7dc1f22c575422ea13061e90e0aeb49 => generated 148 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:56:21.986988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:21.989601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:22.001378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:22.002479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:22.003178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:22.004535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:22.005432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:22.006089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:22.130089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:22.137867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c8bff75a-e136-4cae-8d14-3b0382bc5e92 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:22.141999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:22.144385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:22.146185 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a984daac-e216-4a96-aa2e-e5e8e7285865 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.169926 Sep 10 20:56:22.147176 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1115/2150] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:21 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:22.159867 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c8bff75a-e136-4cae-8d14-3b0382bc5e92 tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1469 microversion: 2.1 time: 0.518909 Sep 10 20:56:22.161725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09593d76-7b5d-41cc-8751-69441f965461 tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Calling method '.version_select at 0x7f9944b26dc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:22.168613 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1036/2151] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:21 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1469 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:22.235405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:22.236073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:22.249482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:22.251031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:22.252027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:22.253133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:22.254074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:22.254840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:22.264048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09593d76-7b5d-41cc-8751-69441f965461 tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:22.264934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09593d76-7b5d-41cc-8751-69441f965461 tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:22.265688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09593d76-7b5d-41cc-8751-69441f965461 tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:22.267603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09593d76-7b5d-41cc-8751-69441f965461 tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:22.268600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09593d76-7b5d-41cc-8751-69441f965461 tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:22.269456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09593d76-7b5d-41cc-8751-69441f965461 tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:22.309867 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09593d76-7b5d-41cc-8751-69441f965461 tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/a7dc1f22c575422ea13061e90e0aeb49/detail" status: 200 len: 463 microversion: 2.57 time: 0.161398 Sep 10 20:56:22.323415 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1116/2152] 10.222.0.33 () {60 vars in 1304 bytes} [Sat Sep 10 20:56:22 2022] GET /compute/v2.1/os-quota-sets/a7dc1f22c575422ea13061e90e0aeb49/detail => generated 463 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:56:22.356169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:22.356676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:22.360924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:22.361557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lazy-loading 'fault' on Instance uuid 737acbf5-3c07-4dd1-8798-2214cb1bf7a3 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:56:22.422634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cd372638-4ae1-490b-9a94-102ba833bb74 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:22.425383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cd372638-4ae1-490b-9a94-102ba833bb74 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:22.439275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd372638-4ae1-490b-9a94-102ba833bb74 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:22.441583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd372638-4ae1-490b-9a94-102ba833bb74 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:22.442455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd372638-4ae1-490b-9a94-102ba833bb74 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:22.443438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd372638-4ae1-490b-9a94-102ba833bb74 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:22.443778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:22.444815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd372638-4ae1-490b-9a94-102ba833bb74 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:22.445646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd372638-4ae1-490b-9a94-102ba833bb74 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:22.453418 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-45b779b6-5ea8-4b8e-9983-d4a01754579f tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 200 len: 1308 microversion: 2.1 time: 0.222817 Sep 10 20:56:22.465851 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1037/2153] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:22 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 1308 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:22.629564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cd372638-4ae1-490b-9a94-102ba833bb74 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:22.644142 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cd372638-4ae1-490b-9a94-102ba833bb74 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1214 microversion: 2.1 time: 0.227125 Sep 10 20:56:22.645101 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1117/2154] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:22 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1214 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:22.655060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e59a010-7a5d-4125-9f02-1594497e3775 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944545820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:22.731664 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e59a010-7a5d-4125-9f02-1594497e3775 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.080672 Sep 10 20:56:22.744069 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1038/2155] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:22 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:22.751979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Action: 'update', calling method: .version_select at 0x7f9944b26d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:22.968773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-ba055344-a5f6-4d8f-b21e-4a4a72efb558 req-15e3e3a8-b5bf-4288-ba2e-e53688911641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7", "name": "network-vif-deleted", "tag": "871c6aba-a220-472d-bb9a-015670319816"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:22.984637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ba055344-a5f6-4d8f-b21e-4a4a72efb558 req-15e3e3a8-b5bf-4288-ba2e-e53688911641 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:22.985225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ba055344-a5f6-4d8f-b21e-4a4a72efb558 req-15e3e3a8-b5bf-4288-ba2e-e53688911641 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:22.985737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ba055344-a5f6-4d8f-b21e-4a4a72efb558 req-15e3e3a8-b5bf-4288-ba2e-e53688911641 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.007257 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-ba055344-a5f6-4d8f-b21e-4a4a72efb558 req-15e3e3a8-b5bf-4288-ba2e-e53688911641 service nova] Creating event network-vif-deleted:871c6aba-a220-472d-bb9a-015670319816 for instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 on nch2-master-1 Sep 10 20:56:23.020994 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-ba055344-a5f6-4d8f-b21e-4a4a72efb558 req-15e3e3a8-b5bf-4288-ba2e-e53688911641 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055920 Sep 10 20:56:23.024062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.025606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.026296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.026463 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1039/2156] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:56:23.027593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.028548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.029142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.092988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.093507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.094236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.095841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.096476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.097342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.176223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:23.176843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:23.197657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.200017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.200942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.201962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.204787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.207975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.257197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:23.316473 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-690b2298-77b3-4a3c-a270-4a10dc0998bc tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/a7dc1f22c575422ea13061e90e0aeb49?user_id=2aedf4145553484089d22f87ae3e5cd9" status: 200 len: 148 microversion: 2.57 time: 0.568206 Sep 10 20:56:23.323177 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1118/2157] 10.222.0.33 () {62 vars in 1384 bytes} [Sat Sep 10 20:56:22 2022] PUT /compute/v2.1/os-quota-sets/a7dc1f22c575422ea13061e90e0aeb49?user_id=2aedf4145553484089d22f87ae3e5cd9 => generated 148 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:56:23.323850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:23.324484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:23.327914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:23.333524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.334061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.334503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.335216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.335674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.336094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.337651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:23.339248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:23.340440 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4bbd1b57-d1b0-4439-a983-3eeee39b3ff1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.168571 Sep 10 20:56:23.352801 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1040/2158] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:23 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:56:23.358002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-073c0bd0-37b0-4877-8322-c960784507c1 tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] Calling method '.version_select at 0x7f99444be790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:23.379205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.379762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.380214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.380675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lazy-loading 'fault' on Instance uuid 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:56:23.599293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870c4c66a15b4546bd981cfb5932b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd969d135196e409584d6647d5186c9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:23.617937 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-adc2238b-d0b9-47b8-9083-68f067e1902e tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 200 len: 1303 microversion: 2.1 time: 0.299052 Sep 10 20:56:23.619074 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1119/2159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:23 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 1303 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:23.625959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:23.626731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: 737acbf5-3c07-4dd1-8798-2214cb1bf7a3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:23.652666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.653610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.654824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.656779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.657257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.657692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.706107 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] HTTP exception thrown: Instance 737acbf5-3c07-4dd1-8798-2214cb1bf7a3 could not be found. Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Request method failure captured: Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 HTTP/1.1 Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPlmfvSV372jqDfdjgKswudFJYr8tTPUjSA2uB8Nr9jY1SFZDJAKCtpYEL5AZRR2j1dwffpW68u5pvlC_1PcMFn75ELXXQ-5EQxXe7K7YAsn1ySYPXEfwCy7ujJkCCLkAHmRDfOdB3_YUvymAHcvzLxdy76XmSacPXy1_5m6mFGlhEE Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f2836de68f8546259ebb0649f7567c4f Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesAdminNegativeTest-1511206786 Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2836de68f8546259ebb0649f7567c4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2836de68f8546259ebb0649f7567c4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f2836de68f8546259ebb0649f7567c4f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f2836de68f8546259ebb0649f7567c4f"}]}] Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesAdminNegativeTest-1511206786 Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f2836de68f8546259ebb0649f7567c4f Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1511206786 Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesAdminNegativeTest-1511206786-project Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: eff0636f25bb459cb92e0c733bb51df8 Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesAdminNegativeTest-1511206786-project Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 737acbf5-3c07-4dd1-8798-2214cb1bf7a3 could not be found. Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '737acbf5-3c07-4dd1-8798-2214cb1bf7a3'} Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737acbf5-3c07-4dd1-8798-2214cb1bf7a3 could not be found. Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737acbf5-3c07-4dd1-8798-2214cb1bf7a3 could not be found. Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:23.710801 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:23.714684 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:23.714684 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:23.714684 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:23.714684 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:23.714684 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:23.714684 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737acbf5-3c07-4dd1-8798-2214cb1bf7a3 could not be found. Sep 10 20:56:23.714684 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:23.714684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Returning 404 to user: Instance 737acbf5-3c07-4dd1-8798-2214cb1bf7a3 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:23.716295 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3254ee47-11ac-42a0-bf94-a6df4ec2b504 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3" status: 404 len: 111 microversion: 2.1 time: 0.094291 Sep 10 20:56:23.716295 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1120/2160] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:23 2022] GET /compute/v2.1/servers/737acbf5-3c07-4dd1-8798-2214cb1bf7a3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:56:23.726822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fcf5fe2f-a00f-47e8-b782-cc4de5824edb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:23.728344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fcf5fe2f-a00f-47e8-b782-cc4de5824edb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:23.744747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcf5fe2f-a00f-47e8-b782-cc4de5824edb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.745283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcf5fe2f-a00f-47e8-b782-cc4de5824edb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.746751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcf5fe2f-a00f-47e8-b782-cc4de5824edb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.747482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcf5fe2f-a00f-47e8-b782-cc4de5824edb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:23.747942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcf5fe2f-a00f-47e8-b782-cc4de5824edb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:23.748379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcf5fe2f-a00f-47e8-b782-cc4de5824edb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:23.878302 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-073c0bd0-37b0-4877-8322-c960784507c1 tempest-QuotasAdminTestV257-1397415925 tempest-QuotasAdminTestV257-1397415925-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/a7dc1f22c575422ea13061e90e0aeb49?user_id=2aedf4145553484089d22f87ae3e5cd9" status: 200 len: 190 microversion: 2.57 time: 0.523894 Sep 10 20:56:23.896440 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1041/2161] 10.222.0.33 () {60 vars in 1364 bytes} [Sat Sep 10 20:56:23 2022] GET /compute/v2.1/os-quota-sets/a7dc1f22c575422ea13061e90e0aeb49?user_id=2aedf4145553484089d22f87ae3e5cd9 => generated 190 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:56:23.908604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9a387c80-b633-47b8-b57f-3260e06f82e2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994447cee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:23.989812 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9a387c80-b633-47b8-b57f-3260e06f82e2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.092093 Sep 10 20:56:23.990868 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1042/2162] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:23 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:24.085205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fcf5fe2f-a00f-47e8-b782-cc4de5824edb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:24.101468 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fcf5fe2f-a00f-47e8-b782-cc4de5824edb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1288 microversion: 2.1 time: 0.384903 Sep 10 20:56:24.122713 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1121/2163] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:23 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1288 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:24.378690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:24.380186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:24.391026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:24.391769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:24.392630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:24.393383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:24.394143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:24.394793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:24.560973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:24.575300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:24.579969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:24.582164 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e6901eec-630a-450a-9f77-d908ef6ea33d tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.215662 Sep 10 20:56:24.583692 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1043/2164] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:24 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:24.645669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:24.646780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] [instance: 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:24.660246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:24.660833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:24.663778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:24.666325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:24.667914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:24.669629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:24.709112 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] HTTP exception thrown: Instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 could not be found. Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Request method failure captured: Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 HTTP/1.1 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPigZVPOpCh9XNZEoiKAjstHtwCC1cWzYVoo9-egRrTI6vcIspKu1dcq8wJ7YlF8RRhvaYMarajVefHiYr3FuBNVjRY0dVMrP3fBfFO1famVTYcr1-g0H9wO6sMkt4SXut0v13WWVZVuIkWernH8czz-8ajtbkBO8mttnUGFB-dri84 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d969d135196e409584d6647d5186c9c9 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d969d135196e409584d6647d5186c9c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d969d135196e409584d6647d5186c9c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d969d135196e409584d6647d5186c9c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d969d135196e409584d6647d5186c9c9"}]}] Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d969d135196e409584d6647d5186c9c9 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-MigrationsAdminTest-2115713060 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-MigrationsAdminTest-2115713060-project Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 870c4c66a15b4546bd981cfb5932b214 Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-MigrationsAdminTest-2115713060-project Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 could not be found. Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7'} Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 could not be found. Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 could not be found. Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:24.714671 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.718463 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.718463 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:24.718463 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:24.718463 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:24.718463 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:24.718463 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 could not be found. Sep 10 20:56:24.718463 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.718463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] Returning 404 to user: Instance 0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:24.719225 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d9bd166-e08e-498d-bd5e-8b4a4e30a6ac tempest-MigrationsAdminTest-2115713060 tempest-MigrationsAdminTest-2115713060-project] 10.222.0.33 "GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7" status: 404 len: 111 microversion: 2.1 time: 0.077750 Sep 10 20:56:24.720293 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1044/2165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:24 2022] GET /compute/v2.1/servers/0c84bb7f-3936-4c15-a7e4-bdb5cb6e66b7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:56:24.801206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8f69e009-2071-4c2d-8ba1-90bb2cb5334d tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Calling method '.version_select at 0x7f99450df700>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:24.851011 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-8f69e009-2071-4c2d-8ba1-90bb2cb5334d tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] HTTP exception thrown: Image not found. Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8f69e009-2071-4c2d-8ba1-90bb2cb5334d tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Request method failure captured: Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/images/4e23cbe9-7802-4a10-b8d0-2fe2899671cb/metadata/os_distro HTTP/1.1 Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPn45bFn69V_Zm7qTF9-2A2DugxkoJJWDLdKGkbGSupSvEsLRZ4ZZfT3nZMM3g5XF47Y3OA3wdnEVm9SNFc0SGvMGViu7jwR8lZIMkNAYpkUQdrPx4012zYZ4SkZg6smv1acHJ27sWBDkYb-FBo7pTuXtoWw5i0qHVEMhV7LN3rGrrc Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1d08fe3ab2a4e8ebe566c13c72d3b5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}] Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d6f9c9d09c354be3b9fa0595514745bd Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: exception: Image not found. Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'image_id': '4e23cbe9-7802-4a10-b8d0-2fe2899671cb', 'id': 'os_distro'} Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4e23cbe9-7802-4a10-b8d0-2fe2899671cb Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 20:56:24.873620 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4e23cbe9-7802-4a10-b8d0-2fe2899671cb could not be found. Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8f69e009-2071-4c2d-8ba1-90bb2cb5334d tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Returning 404 to user: Image not found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8f69e009-2071-4c2d-8ba1-90bb2cb5334d tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] 10.222.0.33 "DELETE /compute/v2.1/images/4e23cbe9-7802-4a10-b8d0-2fe2899671cb/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.348952 Sep 10 20:56:24.876559 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1122/2166] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Sep 10 20:56:24 2022] DELETE /compute/v2.1/images/4e23cbe9-7802-4a10-b8d0-2fe2899671cb/metadata/os_distro => generated 62 bytes in 351 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 20:56:24.905413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54100d4f-0689-4802-a205-f8503ded21d1 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Calling method '.version_select at 0x7f9944487550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:24.950459 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-54100d4f-0689-4802-a205-f8503ded21d1 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] HTTP exception thrown: Image not found. Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54100d4f-0689-4802-a205-f8503ded21d1 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Request method failure captured: Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/images/c8a5d590-9c92-40f4-9cbb-0a7581a623d3/metadata/os_version HTTP/1.1 Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPn45bFn69V_Zm7qTF9-2A2DugxkoJJWDLdKGkbGSupSvEsLRZ4ZZfT3nZMM3g5XF47Y3OA3wdnEVm9SNFc0SGvMGViu7jwR8lZIMkNAYpkUQdrPx4012zYZ4SkZg6smv1acHJ27sWBDkYb-FBo7pTuXtoWw5i0qHVEMhV7LN3rGrrc Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1d08fe3ab2a4e8ebe566c13c72d3b5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}] Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d6f9c9d09c354be3b9fa0595514745bd Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'image_id': 'c8a5d590-9c92-40f4-9cbb-0a7581a623d3', 'id': 'os_version'} Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c8a5d590-9c92-40f4-9cbb-0a7581a623d3 Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 20:56:24.954254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8a5d590-9c92-40f4-9cbb-0a7581a623d3 could not be found. Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:24.957259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:24.965816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54100d4f-0689-4802-a205-f8503ded21d1 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:24.965816 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-54100d4f-0689-4802-a205-f8503ded21d1 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] 10.222.0.33 "GET /compute/v2.1/images/c8a5d590-9c92-40f4-9cbb-0a7581a623d3/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.076999 Sep 10 20:56:24.965816 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1045/2167] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Sep 10 20:56:24 2022] GET /compute/v2.1/images/c8a5d590-9c92-40f4-9cbb-0a7581a623d3/metadata/os_version => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:56:24.973600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a707a782-8540-4cc6-8b0f-8a22ec381e7c tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Calling method '.version_select at 0x7f994519c700>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:25.006152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7f8d2c7a-b704-459a-9d09-124c34dea2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:25.013147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7f8d2c7a-b704-459a-9d09-124c34dea2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:25.020406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f8d2c7a-b704-459a-9d09-124c34dea2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:25.021190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f8d2c7a-b704-459a-9d09-124c34dea2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:25.021879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f8d2c7a-b704-459a-9d09-124c34dea2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:25.022988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f8d2c7a-b704-459a-9d09-124c34dea2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:25.023652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f8d2c7a-b704-459a-9d09-124c34dea2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:25.025264 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-a707a782-8540-4cc6-8b0f-8a22ec381e7c tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] HTTP exception thrown: Image not found. Sep 10 20:56:25.025915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f8d2c7a-b704-459a-9d09-124c34dea2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a707a782-8540-4cc6-8b0f-8a22ec381e7c tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Request method failure captured: Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/images/9944802c-53e1-43b4-b442-89f8028129d1/metadata HTTP/1.1 Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPn45bFn69V_Zm7qTF9-2A2DugxkoJJWDLdKGkbGSupSvEsLRZ4ZZfT3nZMM3g5XF47Y3OA3wdnEVm9SNFc0SGvMGViu7jwR8lZIMkNAYpkUQdrPx4012zYZ4SkZg6smv1acHJ27sWBDkYb-FBo7pTuXtoWw5i0qHVEMhV7LN3rGrrc Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1d08fe3ab2a4e8ebe566c13c72d3b5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}] Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d6f9c9d09c354be3b9fa0595514745bd Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: exception: Image not found. Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'image_id': '9944802c-53e1-43b4-b442-89f8028129d1'} Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9944802c-53e1-43b4-b442-89f8028129d1 Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 20:56:25.034351 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9944802c-53e1-43b4-b442-89f8028129d1 could not be found. Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:25.037648 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.045997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a707a782-8540-4cc6-8b0f-8a22ec381e7c tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Returning 404 to user: Image not found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:25.047118 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a707a782-8540-4cc6-8b0f-8a22ec381e7c tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] 10.222.0.33 "GET /compute/v2.1/images/9944802c-53e1-43b4-b442-89f8028129d1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.081548 Sep 10 20:56:25.050109 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1123/2168] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:56:24 2022] GET /compute/v2.1/images/9944802c-53e1-43b4-b442-89f8028129d1/metadata => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:56:25.065877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e050d8ae-156b-43bf-8c3c-1bac26b9f0b9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944bc0f70>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:25.066231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7f8d2c7a-b704-459a-9d09-124c34dea2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:56:25.154208 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e050d8ae-156b-43bf-8c3c-1bac26b9f0b9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.098562 Sep 10 20:56:25.157197 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1124/2169] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:25 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:25.168032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-881db3e6-c442-4956-9189-85bc44ff4031 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Action: 'update_all', calling method: .version_select at 0x7f9945289700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:25.213365 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7f8d2c7a-b704-459a-9d09-124c34dea2ee tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 204 len: 0 microversion: 2.1 time: 0.218521 Sep 10 20:56:25.217599 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1046/2170] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:56:24 2022] DELETE /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:56:25.221583 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-881db3e6-c442-4956-9189-85bc44ff4031 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] HTTP exception thrown: Image not found. Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-881db3e6-c442-4956-9189-85bc44ff4031 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Request method failure captured: Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: request: PUT /compute/v2.1/images/b14441ae-1db6-46c3-96fd-f7cf8a70eb75/metadata HTTP/1.1 Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 57 Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPn45bFn69V_Zm7qTF9-2A2DugxkoJJWDLdKGkbGSupSvEsLRZ4ZZfT3nZMM3g5XF47Y3OA3wdnEVm9SNFc0SGvMGViu7jwR8lZIMkNAYpkUQdrPx4012zYZ4SkZg6smv1acHJ27sWBDkYb-FBo7pTuXtoWw5i0qHVEMhV7LN3rGrrc Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1d08fe3ab2a4e8ebe566c13c72d3b5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}] Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d6f9c9d09c354be3b9fa0595514745bd Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: exception: Image not found. Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'image_id': 'b14441ae-1db6-46c3-96fd-f7cf8a70eb75', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b14441ae-1db6-46c3-96fd-f7cf8a70eb75 Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 20:56:25.224947 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b14441ae-1db6-46c3-96fd-f7cf8a70eb75 could not be found. Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:25.228560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.235437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-04d1129b-bb57-4658-9b20-d479e30174fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:25.236106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-881db3e6-c442-4956-9189-85bc44ff4031 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Returning 404 to user: Image not found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:25.236205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-04d1129b-bb57-4658-9b20-d479e30174fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:25.237328 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-881db3e6-c442-4956-9189-85bc44ff4031 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] 10.222.0.33 "PUT /compute/v2.1/images/b14441ae-1db6-46c3-96fd-f7cf8a70eb75/metadata" status: 404 len: 62 microversion: 2.1 time: 0.079094 Sep 10 20:56:25.238214 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1125/2171] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:56:25 2022] PUT /compute/v2.1/images/b14441ae-1db6-46c3-96fd-f7cf8a70eb75/metadata => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:56:25.247811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-870392eb-4dcc-41ae-9943-392d41ed6632 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:25.249386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-870392eb-4dcc-41ae-9943-392d41ed6632 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:25.250220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04d1129b-bb57-4658-9b20-d479e30174fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:25.250929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04d1129b-bb57-4658-9b20-d479e30174fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:25.269560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04d1129b-bb57-4658-9b20-d479e30174fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:25.270373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04d1129b-bb57-4658-9b20-d479e30174fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:25.270865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04d1129b-bb57-4658-9b20-d479e30174fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:25.273462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04d1129b-bb57-4658-9b20-d479e30174fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:25.275653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-870392eb-4dcc-41ae-9943-392d41ed6632 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:25.276466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-870392eb-4dcc-41ae-9943-392d41ed6632 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:25.279461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-870392eb-4dcc-41ae-9943-392d41ed6632 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:25.280228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-870392eb-4dcc-41ae-9943-392d41ed6632 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:25.280706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-870392eb-4dcc-41ae-9943-392d41ed6632 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:25.281149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-870392eb-4dcc-41ae-9943-392d41ed6632 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:25.521042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-04d1129b-bb57-4658-9b20-d479e30174fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:25.531371 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-04d1129b-bb57-4658-9b20-d479e30174fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1318 microversion: 2.1 time: 0.312309 Sep 10 20:56:25.532244 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1047/2172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:25 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:25.545725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-84546201-09ec-47b4-95d5-54bddd29ea53 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Action: 'update', calling method: .version_select at 0x7f9944487940>, body: {"meta": {"os_distro": "alt"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:25.580735 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-84546201-09ec-47b4-95d5-54bddd29ea53 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] HTTP exception thrown: Image not found. Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-84546201-09ec-47b4-95d5-54bddd29ea53 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Request method failure captured: Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/images/41152e2e-c324-46d8-ade9-127db88de6df/metadata/os_distro HTTP/1.1 Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 30 Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPn45bFn69V_Zm7qTF9-2A2DugxkoJJWDLdKGkbGSupSvEsLRZ4ZZfT3nZMM3g5XF47Y3OA3wdnEVm9SNFc0SGvMGViu7jwR8lZIMkNAYpkUQdrPx4012zYZ4SkZg6smv1acHJ27sWBDkYb-FBo7pTuXtoWw5i0qHVEMhV7LN3rGrrc Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1d08fe3ab2a4e8ebe566c13c72d3b5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}] Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d6f9c9d09c354be3b9fa0595514745bd Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: {"meta": {"os_distro": "alt"}} Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'image_id': '41152e2e-c324-46d8-ade9-127db88de6df', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 41152e2e-c324-46d8-ade9-127db88de6df Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 20:56:25.586462 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 41152e2e-c324-46d8-ade9-127db88de6df could not be found. Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:25.589789 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.594345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-84546201-09ec-47b4-95d5-54bddd29ea53 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:25.594345 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-84546201-09ec-47b4-95d5-54bddd29ea53 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] 10.222.0.33 "PUT /compute/v2.1/images/41152e2e-c324-46d8-ade9-127db88de6df/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.057709 Sep 10 20:56:25.600320 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1048/2173] 10.222.0.33 () {60 vars in 1310 bytes} [Sat Sep 10 20:56:25 2022] PUT /compute/v2.1/images/41152e2e-c324-46d8-ade9-127db88de6df/metadata/os_distro => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:56:25.606989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ba3ea86-d199-4f02-a01b-304da20e0715 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Action: 'create', calling method: .version_select at 0x7f9944477670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:25.637513 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-7ba3ea86-d199-4f02-a01b-304da20e0715 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] HTTP exception thrown: Image not found. Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ba3ea86-d199-4f02-a01b-304da20e0715 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Request method failure captured: Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/images/6521a093-0794-4a3a-9afa-44796eb34f8d/metadata HTTP/1.1 Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 57 Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPn45bFn69V_Zm7qTF9-2A2DugxkoJJWDLdKGkbGSupSvEsLRZ4ZZfT3nZMM3g5XF47Y3OA3wdnEVm9SNFc0SGvMGViu7jwR8lZIMkNAYpkUQdrPx4012zYZ4SkZg6smv1acHJ27sWBDkYb-FBo7pTuXtoWw5i0qHVEMhV7LN3rGrrc Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d1d08fe3ab2a4e8ebe566c13c72d3b5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d1d08fe3ab2a4e8ebe566c13c72d3b5f"}]}] Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d1d08fe3ab2a4e8ebe566c13c72d3b5f Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112 Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d6f9c9d09c354be3b9fa0595514745bd Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1323270112-project Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'image_id': '6521a093-0794-4a3a-9afa-44796eb34f8d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6521a093-0794-4a3a-9afa-44796eb34f8d Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 20:56:25.642679 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6521a093-0794-4a3a-9afa-44796eb34f8d could not be found. Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ba3ea86-d199-4f02-a01b-304da20e0715 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:25.646590 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ba3ea86-d199-4f02-a01b-304da20e0715 tempest-ImagesMetadataNegativeTestJSON-1323270112 tempest-ImagesMetadataNegativeTestJSON-1323270112-project] 10.222.0.33 "POST /compute/v2.1/images/6521a093-0794-4a3a-9afa-44796eb34f8d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043264 Sep 10 20:56:25.651775 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1049/2174] 10.222.0.33 () {60 vars in 1281 bytes} [Sat Sep 10 20:56:25 2022] POST /compute/v2.1/images/6521a093-0794-4a3a-9afa-44796eb34f8d/metadata => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 20:56:25.660623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:25.661959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:25.669330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:25.669851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:25.670274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:25.671125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:25.671587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:25.672151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:25.749860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-870392eb-4dcc-41ae-9943-392d41ed6632 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:25.768932 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-870392eb-4dcc-41ae-9943-392d41ed6632 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1682 microversion: 2.1 time: 0.524952 Sep 10 20:56:25.769819 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1126/2175] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:25 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1682 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:25.830251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:25.839295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:25.840734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:25.841912 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c144e977-9b12-4b5f-a677-fa22c2d719bd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.190557 Sep 10 20:56:25.842988 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1050/2176] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:25 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:26.017864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ad0b746d-8c4e-4bfd-a6ba-1ba13a1edace req-b2619167-6d0f-4d26-bfb7-a071bdfb427f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e202f7e-4e8a-49a1-a144-5754c6a2c005", "tag": "f9967362-03f6-4720-8b3e-3443719720ec"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:26.042519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ad0b746d-8c4e-4bfd-a6ba-1ba13a1edace req-b2619167-6d0f-4d26-bfb7-a071bdfb427f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:26.043087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ad0b746d-8c4e-4bfd-a6ba-1ba13a1edace req-b2619167-6d0f-4d26-bfb7-a071bdfb427f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:26.043530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ad0b746d-8c4e-4bfd-a6ba-1ba13a1edace req-b2619167-6d0f-4d26-bfb7-a071bdfb427f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:26.105431 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ad0b746d-8c4e-4bfd-a6ba-1ba13a1edace req-b2619167-6d0f-4d26-bfb7-a071bdfb427f service nova] Creating event network-changed:f9967362-03f6-4720-8b3e-3443719720ec for instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 on nch1-master-1 Sep 10 20:56:26.122245 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ad0b746d-8c4e-4bfd-a6ba-1ba13a1edace req-b2619167-6d0f-4d26-bfb7-a071bdfb427f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111251 Sep 10 20:56:26.123165 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1127/2177] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:26.176564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-edd560e5-bd63-4e74-93b6-ffb729386714 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944488040>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:26.221058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c2df6898-bae7-405c-bc29-b677fe35a8de req-e93dbbca-cea1-49c4-b3a7-724e0c92ba19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7f8366-d0bc-4854-b822-a6775d0dc931", "name": "network-vif-plugged", "status": "completed", "tag": "a59227ae-40ff-48e2-ad01-586a234173ca"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:26.255564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c2df6898-bae7-405c-bc29-b677fe35a8de req-e93dbbca-cea1-49c4-b3a7-724e0c92ba19 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:26.266813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c2df6898-bae7-405c-bc29-b677fe35a8de req-e93dbbca-cea1-49c4-b3a7-724e0c92ba19 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:26.267368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c2df6898-bae7-405c-bc29-b677fe35a8de req-e93dbbca-cea1-49c4-b3a7-724e0c92ba19 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:26.283647 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-edd560e5-bd63-4e74-93b6-ffb729386714 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.115183 Sep 10 20:56:26.286539 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1051/2178] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:26 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:26.303547 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c2df6898-bae7-405c-bc29-b677fe35a8de req-e93dbbca-cea1-49c4-b3a7-724e0c92ba19 service nova] Creating event network-vif-plugged:a59227ae-40ff-48e2-ad01-586a234173ca for instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 on nch1-master-1 Sep 10 20:56:26.320178 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c2df6898-bae7-405c-bc29-b677fe35a8de req-e93dbbca-cea1-49c4-b3a7-724e0c92ba19 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101884 Sep 10 20:56:26.322321 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1128/2179] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:56:26.558279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d9840f1c-495e-4592-bb5c-6b7b8c4131bb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:26.559004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d9840f1c-495e-4592-bb5c-6b7b8c4131bb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:26.570526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9840f1c-495e-4592-bb5c-6b7b8c4131bb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:26.571832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9840f1c-495e-4592-bb5c-6b7b8c4131bb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:26.573422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9840f1c-495e-4592-bb5c-6b7b8c4131bb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:26.574527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9840f1c-495e-4592-bb5c-6b7b8c4131bb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:26.575499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9840f1c-495e-4592-bb5c-6b7b8c4131bb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:26.576340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9840f1c-495e-4592-bb5c-6b7b8c4131bb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:26.606614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:26.745557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d9840f1c-495e-4592-bb5c-6b7b8c4131bb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:26.753699 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d9840f1c-495e-4592-bb5c-6b7b8c4131bb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1318 microversion: 2.1 time: 0.200511 Sep 10 20:56:26.754875 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1052/2180] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:26 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:26.796972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb192eab-9fc7-4e02-8dd8-d89fe5e0f91d tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:26.798678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bb192eab-9fc7-4e02-8dd8-d89fe5e0f91d tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:26.811131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb192eab-9fc7-4e02-8dd8-d89fe5e0f91d tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:26.812317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb192eab-9fc7-4e02-8dd8-d89fe5e0f91d tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:26.812962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb192eab-9fc7-4e02-8dd8-d89fe5e0f91d tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:26.817589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb192eab-9fc7-4e02-8dd8-d89fe5e0f91d tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:26.817589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb192eab-9fc7-4e02-8dd8-d89fe5e0f91d tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:26.817589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb192eab-9fc7-4e02-8dd8-d89fe5e0f91d tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:26.879657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:26.882341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:26.903765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:26.904468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:26.905070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:26.906184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:26.906841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:26.907639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:27.030706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:27.043091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:27.043091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:27.044661 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1348b716-9840-4ebb-af8d-b5677ccda933 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.179731 Sep 10 20:56:27.059027 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1053/2181] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:26 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:27.116358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bb192eab-9fc7-4e02-8dd8-d89fe5e0f91d tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:27.128518 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bb192eab-9fc7-4e02-8dd8-d89fe5e0f91d tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1682 microversion: 2.1 time: 0.338432 Sep 10 20:56:27.129343 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1129/2182] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:26 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1682 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:27.302968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c1d08f9e-c447-4dc6-b591-185648bfbd40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944443e50>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:27.377133 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c1d08f9e-c447-4dc6-b591-185648bfbd40 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.081038 Sep 10 20:56:27.378153 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1054/2183] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:27 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:27.777173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-275e678e-ff57-4d36-9161-bcac2185bb70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:27.778550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-275e678e-ff57-4d36-9161-bcac2185bb70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:27.784811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-275e678e-ff57-4d36-9161-bcac2185bb70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:27.785297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-275e678e-ff57-4d36-9161-bcac2185bb70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:27.786135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-275e678e-ff57-4d36-9161-bcac2185bb70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:27.787163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-275e678e-ff57-4d36-9161-bcac2185bb70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:27.787822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-275e678e-ff57-4d36-9161-bcac2185bb70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:27.788520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-275e678e-ff57-4d36-9161-bcac2185bb70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:27.997368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-275e678e-ff57-4d36-9161-bcac2185bb70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:28.007638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e1d69028-3fc4-47a1-853f-837ea84b871d req-042ad8a2-5454-4cd8-8a46-0b7f1d497b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb03fb54-1b7b-42ec-b71b-b73d7f96b657", "name": "network-vif-deleted", "tag": "c88c7c1f-fddc-4804-9ba5-5dfaae6029f9"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:28.031594 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-275e678e-ff57-4d36-9161-bcac2185bb70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1318 microversion: 2.1 time: 0.258787 Sep 10 20:56:28.034612 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1130/2184] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:27 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:28.058485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e1d69028-3fc4-47a1-853f-837ea84b871d req-042ad8a2-5454-4cd8-8a46-0b7f1d497b70 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:28.058970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e1d69028-3fc4-47a1-853f-837ea84b871d req-042ad8a2-5454-4cd8-8a46-0b7f1d497b70 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:28.059397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e1d69028-3fc4-47a1-853f-837ea84b871d req-042ad8a2-5454-4cd8-8a46-0b7f1d497b70 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:28.074506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:28.075121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:28.088414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:28.088915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:28.089359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:28.090120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:28.090614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:28.091047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:28.097750 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e1d69028-3fc4-47a1-853f-837ea84b871d req-042ad8a2-5454-4cd8-8a46-0b7f1d497b70 service nova] Creating event network-vif-deleted:c88c7c1f-fddc-4804-9ba5-5dfaae6029f9 for instance cb03fb54-1b7b-42ec-b71b-b73d7f96b657 on nch2-master-1 Sep 10 20:56:28.111644 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e1d69028-3fc4-47a1-853f-837ea84b871d req-042ad8a2-5454-4cd8-8a46-0b7f1d497b70 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111120 Sep 10 20:56:28.116051 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1055/2185] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:28.153927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:28.154832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:28.166950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:28.169708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:28.170460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:28.171843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:28.172567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:28.173216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:28.232957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:28.246134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:28.251816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:28.253252 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-faf6c320-5fd6-443c-bab4-bc80654708dd tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.182868 Sep 10 20:56:28.256064 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1131/2186] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:28 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:28.286674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:28.287652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:28.302760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:28.303742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lazy-loading 'fault' on Instance uuid cb03fb54-1b7b-42ec-b71b-b73d7f96b657 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:56:28.396437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fcd16753-c85c-4310-951e-9a823fe947d0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99448afaf0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:28.400106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff0636f25bb459cb92e0c733bb51df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2836de68f8546259ebb0649f7567c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:28.423911 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c5741d9f-83df-4768-a86a-67f6c2351bc1 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 200 len: 1331 microversion: 2.1 time: 0.274333 Sep 10 20:56:28.439090 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1056/2187] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:28 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 1331 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:28.466405 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fcd16753-c85c-4310-951e-9a823fe947d0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.074410 Sep 10 20:56:28.468030 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1132/2188] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:28 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:29.061913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d019ca1d-f10b-459e-93f1-3591973c473d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:29.062831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d019ca1d-f10b-459e-93f1-3591973c473d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:29.073032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d019ca1d-f10b-459e-93f1-3591973c473d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:29.073528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d019ca1d-f10b-459e-93f1-3591973c473d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:29.073999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d019ca1d-f10b-459e-93f1-3591973c473d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:29.074924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d019ca1d-f10b-459e-93f1-3591973c473d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:29.075392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d019ca1d-f10b-459e-93f1-3591973c473d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:29.076184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d019ca1d-f10b-459e-93f1-3591973c473d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:29.284758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:29.285961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:29.308393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:29.308891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:29.309344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:29.310114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:29.312154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:29.312613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:29.377227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d019ca1d-f10b-459e-93f1-3591973c473d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:29.395427 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d019ca1d-f10b-459e-93f1-3591973c473d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1318 microversion: 2.1 time: 0.341547 Sep 10 20:56:29.402506 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1057/2189] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:29 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:29.454247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:29.455307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] [instance: cb03fb54-1b7b-42ec-b71b-b73d7f96b657] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:29.467795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:29.471071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:29.473272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:29.474276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:29.479997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:29.480969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:29.507963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:29.518512 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] HTTP exception thrown: Instance cb03fb54-1b7b-42ec-b71b-b73d7f96b657 could not be found. Sep 10 20:56:29.520056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:29.521510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Request method failure captured: Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 HTTP/1.1 Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPlmfvSV372jqDfdjgKswudFJYr8tTPUjSA2uB8Nr9jY1SFZDJAKCtpYEL5AZRR2j1dwffpW68u5pvlC_1PcMFn75ELXXQ-5EQxXe7K7YAsn1ySYPXEfwCy7ujJkCCLkAHmRDfOdB3_YUvymAHcvzLxdy76XmSacPXy1_5m6mFGlhEE Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f2836de68f8546259ebb0649f7567c4f Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-VolumesAdminNegativeTest-1511206786 Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2836de68f8546259ebb0649f7567c4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f2836de68f8546259ebb0649f7567c4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f2836de68f8546259ebb0649f7567c4f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f2836de68f8546259ebb0649f7567c4f"}]}] Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-VolumesAdminNegativeTest-1511206786 Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f2836de68f8546259ebb0649f7567c4f Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1511206786 Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-VolumesAdminNegativeTest-1511206786-project Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: eff0636f25bb459cb92e0c733bb51df8 Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-VolumesAdminNegativeTest-1511206786-project Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance cb03fb54-1b7b-42ec-b71b-b73d7f96b657 could not be found. Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'cb03fb54-1b7b-42ec-b71b-b73d7f96b657'} Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb03fb54-1b7b-42ec-b71b-b73d7f96b657 could not be found. Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb03fb54-1b7b-42ec-b71b-b73d7f96b657 could not be found. Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:29.522307 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:29.528330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:29.528330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:29.528330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:29.528330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:29.528330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:29.528330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb03fb54-1b7b-42ec-b71b-b73d7f96b657 could not be found. Sep 10 20:56:29.528330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:29.528847 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4208ce9d-694c-4e6f-9f33-dc9693d05051 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.244207 Sep 10 20:56:29.528937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Returning 404 to user: Instance cb03fb54-1b7b-42ec-b71b-b73d7f96b657 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:29.529058 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1133/2190] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:29 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:29.531130 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d95d28e-3ec5-4580-8e61-92010c2e94b8 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657" status: 404 len: 111 microversion: 2.1 time: 0.075264 Sep 10 20:56:29.532340 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1058/2191] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:29 2022] GET /compute/v2.1/servers/cb03fb54-1b7b-42ec-b71b-b73d7f96b657 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:56:29.542960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-49ffa3b2-d717-489d-910c-d22cae288133 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] Calling method '.version_select at 0x7f994444f700>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:29.555052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9e653482-ac64-4e4e-874c-61727de98e42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99496fa430>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:29.583676 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-49ffa3b2-d717-489d-910c-d22cae288133 tempest-VolumesAdminNegativeTest-1511206786 tempest-VolumesAdminNegativeTest-1511206786-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273144398" status: 202 len: 0 microversion: 2.1 time: 0.045523 Sep 10 20:56:29.586214 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1059/2192] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 20:56:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273144398 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:56:29.671139 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9e653482-ac64-4e4e-874c-61727de98e42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.145401 Sep 10 20:56:29.673211 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1134/2193] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:29 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:30.423558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f26a8c14-841f-4356-8fbd-6d005e5e0005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:30.424479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f26a8c14-841f-4356-8fbd-6d005e5e0005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:30.470395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f26a8c14-841f-4356-8fbd-6d005e5e0005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:30.471741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f26a8c14-841f-4356-8fbd-6d005e5e0005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:30.473138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f26a8c14-841f-4356-8fbd-6d005e5e0005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:30.475418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f26a8c14-841f-4356-8fbd-6d005e5e0005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:30.476404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f26a8c14-841f-4356-8fbd-6d005e5e0005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:30.478443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f26a8c14-841f-4356-8fbd-6d005e5e0005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:30.634525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-654d1688-ab63-497c-bbfe-04232f8e5699 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Action: 'update', calling method: .version_select at 0x7f9944450700>, body: {"quota_set": {"ram": "5120"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:30.746490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f26a8c14-841f-4356-8fbd-6d005e5e0005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:30.756015 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f26a8c14-841f-4356-8fbd-6d005e5e0005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1318 microversion: 2.1 time: 0.339295 Sep 10 20:56:30.757407 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1135/2194] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:30 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:30.770353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:30.772885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:30.790883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:30.791624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:30.792347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:30.793457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:30.794156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:30.794827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:30.879691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-654d1688-ab63-497c-bbfe-04232f8e5699 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:30.880341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-654d1688-ab63-497c-bbfe-04232f8e5699 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:30.880786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-654d1688-ab63-497c-bbfe-04232f8e5699 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:30.884367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-654d1688-ab63-497c-bbfe-04232f8e5699 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:30.884897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-654d1688-ab63-497c-bbfe-04232f8e5699 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:30.885332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-654d1688-ab63-497c-bbfe-04232f8e5699 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:30.901016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:30.918343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:30.923911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:30.927862 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c6a3847-9e75-4f0d-a318-d5008df76638 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.168951 Sep 10 20:56:30.938702 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1136/2195] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:30 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:30.952533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1d8125d6-f477-47e8-9a80-e7d9935d1f69 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944893700>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:31.052387 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-654d1688-ab63-497c-bbfe-04232f8e5699 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/ecb5991c55d944b7b1f57970d2a94bad" status: 200 len: 240 microversion: 2.36 time: 0.680427 Sep 10 20:56:31.057878 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1d8125d6-f477-47e8-9a80-e7d9935d1f69 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.111408 Sep 10 20:56:31.057878 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1137/2196] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:30 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:31.058186 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1060/2197] 10.222.0.33 () {62 vars in 1303 bytes} [Sat Sep 10 20:56:30 2022] PUT /compute/v2.1/os-quota-sets/ecb5991c55d944b7b1f57970d2a94bad => generated 240 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:56:31.067059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8305059c-943d-4c13-947a-fa67cad8efb0 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Calling method '.version_select at 0x7f9944893af0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:31.437635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8305059c-943d-4c13-947a-fa67cad8efb0 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:31.438224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8305059c-943d-4c13-947a-fa67cad8efb0 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:31.438631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8305059c-943d-4c13-947a-fa67cad8efb0 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:31.441996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8305059c-943d-4c13-947a-fa67cad8efb0 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:31.442504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8305059c-943d-4c13-947a-fa67cad8efb0 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:31.444835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8305059c-943d-4c13-947a-fa67cad8efb0 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:31.463571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:31.506526 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8305059c-943d-4c13-947a-fa67cad8efb0 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/ecb5991c55d944b7b1f57970d2a94bad/detail" status: 200 len: 672 microversion: 2.36 time: 0.441722 Sep 10 20:56:31.507910 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1138/2198] 10.222.0.33 () {60 vars in 1304 bytes} [Sat Sep 10 20:56:31 2022] GET /compute/v2.1/os-quota-sets/ecb5991c55d944b7b1f57970d2a94bad/detail => generated 672 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:56:31.748698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Action: 'update', calling method: .version_select at 0x7f9944545f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:31.783010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1b62c336-4a77-41ae-bbe1-e66da530c0e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:31.783820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1b62c336-4a77-41ae-bbe1-e66da530c0e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:31.803121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b62c336-4a77-41ae-bbe1-e66da530c0e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:31.810478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b62c336-4a77-41ae-bbe1-e66da530c0e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:31.812844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b62c336-4a77-41ae-bbe1-e66da530c0e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:31.815258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b62c336-4a77-41ae-bbe1-e66da530c0e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:31.818236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b62c336-4a77-41ae-bbe1-e66da530c0e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:31.818924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b62c336-4a77-41ae-bbe1-e66da530c0e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:32.036187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:32.038542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:32.039892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:32.042730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:32.043462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:32.045411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:32.130767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:32.131325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:32.131874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:32.132898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:32.133513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:32.134073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:32.262668 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-65265c6b-fbcc-4b3d-9904-fca8e543958e tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/ecb5991c55d944b7b1f57970d2a94bad?user_id=bcba5f391e5845c88802f9b67012c019" status: 200 len: 240 microversion: 2.36 time: 0.517721 Sep 10 20:56:32.268976 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1061/2199] 10.222.0.33 () {62 vars in 1384 bytes} [Sat Sep 10 20:56:31 2022] PUT /compute/v2.1/os-quota-sets/ecb5991c55d944b7b1f57970d2a94bad?user_id=bcba5f391e5845c88802f9b67012c019 => generated 240 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:56:32.274295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:32.278769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:32.302996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:32.303876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:32.306542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:32.307734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:32.309777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:32.313984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:32.513613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:32.531789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:32.533773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:32.535212 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f30478d-cf8b-4ec6-82c4-d60c2791ab4e tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.264926 Sep 10 20:56:32.536270 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1062/2200] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:32 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:32.542486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d41350c9-9d86-44d1-b0fe-4bfb66946f7e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994444f550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:32.663099 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d41350c9-9d86-44d1-b0fe-4bfb66946f7e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.125293 Sep 10 20:56:32.670990 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1063/2201] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:32 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:32.697421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3c654ed3-af23-4e10-ab99-438bdd8cedd1 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] Calling method '.version_select at 0x7f9944453b80>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:32.903354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b62c336-4a77-41ae-bbe1-e66da530c0e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:32.924747 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1b62c336-4a77-41ae-bbe1-e66da530c0e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1318 microversion: 2.1 time: 1.148442 Sep 10 20:56:32.926947 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1139/2202] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:31 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1318 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:33.083578 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3c654ed3-af23-4e10-ab99-438bdd8cedd1 tempest-QuotasAdminTestV236-1898887567 tempest-QuotasAdminTestV236-1898887567-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/ecb5991c55d944b7b1f57970d2a94bad?user_id=bcba5f391e5845c88802f9b67012c019" status: 200 len: 282 microversion: 2.36 time: 0.410978 Sep 10 20:56:33.084663 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1064/2203] 10.222.0.33 () {60 vars in 1364 bytes} [Sat Sep 10 20:56:32 2022] GET /compute/v2.1/os-quota-sets/ecb5991c55d944b7b1f57970d2a94bad?user_id=bcba5f391e5845c88802f9b67012c019 => generated 282 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:56:33.241323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-47b29552-3eec-4f37-a74f-6d923b6ed4ed req-eccd273a-b30e-433e-9eea-35536752a535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e202f7e-4e8a-49a1-a144-5754c6a2c005", "name": "network-vif-plugged", "status": "completed", "tag": "f9967362-03f6-4720-8b3e-3443719720ec"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:33.278102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-47b29552-3eec-4f37-a74f-6d923b6ed4ed req-eccd273a-b30e-433e-9eea-35536752a535 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:33.278697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-47b29552-3eec-4f37-a74f-6d923b6ed4ed req-eccd273a-b30e-433e-9eea-35536752a535 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:33.280296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-47b29552-3eec-4f37-a74f-6d923b6ed4ed req-eccd273a-b30e-433e-9eea-35536752a535 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:33.318085 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-47b29552-3eec-4f37-a74f-6d923b6ed4ed req-eccd273a-b30e-433e-9eea-35536752a535 service nova] Creating event network-vif-plugged:f9967362-03f6-4720-8b3e-3443719720ec for instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 on nch1-master-1 Sep 10 20:56:33.333022 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-47b29552-3eec-4f37-a74f-6d923b6ed4ed req-eccd273a-b30e-433e-9eea-35536752a535 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096332 Sep 10 20:56:33.340041 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1140/2204] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:33.566674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:33.567289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:33.602534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:33.603351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:33.603815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:33.613652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:33.622226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:33.623430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:33.684816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-03662039-50aa-457a-bcb3-3bf0be419b1b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99450df040>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:33.812641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:33.827179 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-03662039-50aa-457a-bcb3-3bf0be419b1b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.147868 Sep 10 20:56:33.828401 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1141/2205] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:33 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:33.840150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:33.842032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:33.843481 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8fa21458-66d2-4494-9787-5761e82ba9b9 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.281550 Sep 10 20:56:33.845610 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1065/2206] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:33 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:33.956795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae13c8e2-71c9-418c-a8c0-4085dc8c26da tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:33.957461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ae13c8e2-71c9-418c-a8c0-4085dc8c26da tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:33.986450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae13c8e2-71c9-418c-a8c0-4085dc8c26da tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:33.987178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae13c8e2-71c9-418c-a8c0-4085dc8c26da tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:33.994498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae13c8e2-71c9-418c-a8c0-4085dc8c26da tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:33.995502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae13c8e2-71c9-418c-a8c0-4085dc8c26da tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:33.999378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae13c8e2-71c9-418c-a8c0-4085dc8c26da tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:34.000343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae13c8e2-71c9-418c-a8c0-4085dc8c26da tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:34.550478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ae13c8e2-71c9-418c-a8c0-4085dc8c26da tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:34.562512 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ae13c8e2-71c9-418c-a8c0-4085dc8c26da tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1318 microversion: 2.1 time: 0.610638 Sep 10 20:56:34.566443 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1142/2207] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:33 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:34.843886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4aaaaefd-81a4-46ac-8182-70c85405a926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944443820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:34.873693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:34.875153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:34.892732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:34.894028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:34.894592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:34.895498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:34.896261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:34.896781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:34.942030 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4aaaaefd-81a4-46ac-8182-70c85405a926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.102223 Sep 10 20:56:34.942916 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1066/2208] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:34 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:35.179143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:35.205429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:35.210821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:35.231396 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9befb602-2086-44bd-9b2c-3a32a8fe5058 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.361455 Sep 10 20:56:35.236593 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1143/2209] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:34 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:56:35.596256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f4825ec1-7348-442c-a893-364be5e84247 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:35.597353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f4825ec1-7348-442c-a893-364be5e84247 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:35.608285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:35.610125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4825ec1-7348-442c-a893-364be5e84247 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:35.614661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4825ec1-7348-442c-a893-364be5e84247 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:35.615306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4825ec1-7348-442c-a893-364be5e84247 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:35.616455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4825ec1-7348-442c-a893-364be5e84247 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:35.617070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4825ec1-7348-442c-a893-364be5e84247 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:35.624509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4825ec1-7348-442c-a893-364be5e84247 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:35.960045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-637234f4-c6d6-4164-aa1f-0816f7569766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944b22280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:36.056164 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-637234f4-c6d6-4164-aa1f-0816f7569766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.100606 Sep 10 20:56:36.057108 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1144/2210] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:35 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:36.263956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:36.266798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:36.300947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:36.304012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:36.307502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:36.308866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:36.314315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:36.317501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:36.470671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f4825ec1-7348-442c-a893-364be5e84247 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:36.483996 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f4825ec1-7348-442c-a893-364be5e84247 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1318 microversion: 2.1 time: 0.892825 Sep 10 20:56:36.489077 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1067/2211] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:35 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1318 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:36.530118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:36.551472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:36.559374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:36.565118 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c81a0817-fa75-452d-9243-6bfd62bb2985 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.308015 Sep 10 20:56:36.569721 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1145/2212] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:36 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:37.071891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-46e413d2-761f-4c67-9c6a-94f17a562e55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994452bdc0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:37.139271 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-46e413d2-761f-4c67-9c6a-94f17a562e55 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.071547 Sep 10 20:56:37.140523 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1068/2213] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:37 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:37.511119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-71d760ea-a69e-412f-836b-758d72e61fbb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:37.512136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-71d760ea-a69e-412f-836b-758d72e61fbb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:37.525188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71d760ea-a69e-412f-836b-758d72e61fbb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:37.528978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71d760ea-a69e-412f-836b-758d72e61fbb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:37.533092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71d760ea-a69e-412f-836b-758d72e61fbb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:37.534172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71d760ea-a69e-412f-836b-758d72e61fbb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:37.534836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71d760ea-a69e-412f-836b-758d72e61fbb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:37.535488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71d760ea-a69e-412f-836b-758d72e61fbb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:37.597448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:37.598231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:37.663027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:37.667650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:37.682823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:37.689281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:37.689962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:37.690420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:37.762464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-71d760ea-a69e-412f-836b-758d72e61fbb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:37.773009 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-71d760ea-a69e-412f-836b-758d72e61fbb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1507 microversion: 2.1 time: 0.266437 Sep 10 20:56:37.774999 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1146/2214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:37 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:37.800734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-98581b96-fa77-4961-932a-4ea8a42c5d8b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:37.801780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-98581b96-fa77-4961-932a-4ea8a42c5d8b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:37.822022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98581b96-fa77-4961-932a-4ea8a42c5d8b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:37.822773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98581b96-fa77-4961-932a-4ea8a42c5d8b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:37.823534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98581b96-fa77-4961-932a-4ea8a42c5d8b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:37.824644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98581b96-fa77-4961-932a-4ea8a42c5d8b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:37.825289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98581b96-fa77-4961-932a-4ea8a42c5d8b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:37.825928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98581b96-fa77-4961-932a-4ea8a42c5d8b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:38.067683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:38.102833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:38.110475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:38.114433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-98581b96-fa77-4961-932a-4ea8a42c5d8b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:38.119024 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-020f8af9-6ef3-42c9-9c8a-19107de0a540 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.526121 Sep 10 20:56:38.120528 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1069/2215] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:37 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:38.131439 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-98581b96-fa77-4961-932a-4ea8a42c5d8b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1507 microversion: 2.1 time: 0.336134 Sep 10 20:56:38.132276 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1147/2216] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:37 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:38.156423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bbded3ce-3be1-4812-88d2-ad7a022efce5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944453d30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:38.167386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "OS-DCF:diskConfig": "AUTO"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:38.176746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:38.188817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:38.189590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:38.190196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:38.191953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:38.192567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:38.193641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:38.282999 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bbded3ce-3be1-4812-88d2-ad7a022efce5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.130817 Sep 10 20:56:38.299016 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1070/2217] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:38 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:38.423465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:38.425618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:38.427197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:38.429772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:38.434201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:38.658949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:38.676022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:38.676710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:38.676973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:38.677715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:38.678208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:38.678641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:38.757126 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f179bbc0-42d9-4437-9b96-7958c37111eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "POST /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005/action" status: 202 len: 1109 microversion: 2.1 time: 0.603016 Sep 10 20:56:38.770682 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1148/2218] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:56:38 2022] POST /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005/action => generated 1109 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 20:56:38.795450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1a447e4f-98c7-498e-81f1-8b8d5b431ca6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:38.796429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1a447e4f-98c7-498e-81f1-8b8d5b431ca6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:38.805364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a447e4f-98c7-498e-81f1-8b8d5b431ca6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:38.809648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a447e4f-98c7-498e-81f1-8b8d5b431ca6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:38.817609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a447e4f-98c7-498e-81f1-8b8d5b431ca6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:38.818554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a447e4f-98c7-498e-81f1-8b8d5b431ca6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:38.819805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a447e4f-98c7-498e-81f1-8b8d5b431ca6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:38.819805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a447e4f-98c7-498e-81f1-8b8d5b431ca6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:39.157235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1a447e4f-98c7-498e-81f1-8b8d5b431ca6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:39.189326 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1a447e4f-98c7-498e-81f1-8b8d5b431ca6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.396866 Sep 10 20:56:39.203729 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1149/2219] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:38 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:39.229568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:39.231398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:39.250190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:39.251443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:39.253135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:39.256253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:39.276819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:39.280452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:39.428849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1110412356", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:39.537102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:39.551811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:39.559857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:39.561517 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b509a43b-8da2-42e4-83e6-e5561a625c9c tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1407 microversion: 2.54 time: 0.356323 Sep 10 20:56:39.563309 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1150/2220] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:39 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:39.582561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35dee83c-cb91-4b58-ba23-297499b70f98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944b995e0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:39.786646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:56:39.839623 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35dee83c-cb91-4b58-ba23-297499b70f98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.274901 Sep 10 20:56:39.841409 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1151/2221] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:39 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:40.218235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6cff8ee9-a0e9-427b-bf5c-5bec5283f633 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:40.219164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6cff8ee9-a0e9-427b-bf5c-5bec5283f633 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:40.228796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cff8ee9-a0e9-427b-bf5c-5bec5283f633 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:40.232097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cff8ee9-a0e9-427b-bf5c-5bec5283f633 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:40.233039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cff8ee9-a0e9-427b-bf5c-5bec5283f633 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:40.235724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cff8ee9-a0e9-427b-bf5c-5bec5283f633 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:40.236442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cff8ee9-a0e9-427b-bf5c-5bec5283f633 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:40.237679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cff8ee9-a0e9-427b-bf5c-5bec5283f633 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:40.536777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:40.538896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:40.540419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:40.549677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:40.550385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:40.569204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:40.571053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:40.572147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:40.573151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:40.573805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:40.574489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:40.600998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Getting quotas for project a9327061a3ba468f83e978315b6ed753. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:56:40.607293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6cff8ee9-a0e9-427b-bf5c-5bec5283f633 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:40.617315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Getting quotas for user 87df880447e941f0b336470ac8aba19f and project a9327061a3ba468f83e978315b6ed753. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:56:40.623735 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6cff8ee9-a0e9-427b-bf5c-5bec5283f633 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.409473 Sep 10 20:56:40.636252 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1152/2222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:40 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:40.637245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:56:40.640367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:56:40.649657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:40.656630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:40.674970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:40.677638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:40.678280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:40.682541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:40.683259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:40.683856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:40.752754 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c78cb2f-6401-4ad6-a6db-dc4f2a923035 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.071530 Sep 10 20:56:40.753456 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1071/2223] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:56:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:56:40.783766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d97562d0-d1ad-4f82-80eb-f1bdb2515b6f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:40.792798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d97562d0-d1ad-4f82-80eb-f1bdb2515b6f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:40.858422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:40.869399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:40.873707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:40.875485 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5bd3a662-86c1-43b7-b16f-32f064f35cab tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1413 microversion: 2.54 time: 0.238166 Sep 10 20:56:40.899577 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1153/2224] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:40 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1413 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:40.909029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e311b4d3-e473-4cfa-a166-99510a1f5cf1 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944ac8dc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:41.027724 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e311b4d3-e473-4cfa-a166-99510a1f5cf1 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.124651 Sep 10 20:56:41.036339 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1154/2225] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:40 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:41.432599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=32 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:41.443904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d97562d0-d1ad-4f82-80eb-f1bdb2515b6f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:41.454277 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d97562d0-d1ad-4f82-80eb-f1bdb2515b6f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1222 microversion: 2.1 time: 0.692644 Sep 10 20:56:41.463737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=13 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:41.464367 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1072/2226] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:40 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1222 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:41.651842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f64b1efb-0a91-46ed-86b5-0427c70766b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:41.652368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f64b1efb-0a91-46ed-86b5-0427c70766b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:41.661635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64b1efb-0a91-46ed-86b5-0427c70766b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:41.662335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64b1efb-0a91-46ed-86b5-0427c70766b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:41.662916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64b1efb-0a91-46ed-86b5-0427c70766b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:41.663778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64b1efb-0a91-46ed-86b5-0427c70766b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:41.668777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64b1efb-0a91-46ed-86b5-0427c70766b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:41.669459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f64b1efb-0a91-46ed-86b5-0427c70766b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:41.685503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-53dd7c71-69cc-4b75-acd4-a9ae90fe6230 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Calling method '.version_select at 0x7f9944b71a60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:41.795576 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-53dd7c71-69cc-4b75-acd4-a9ae90fe6230 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15" status: 200 len: 371 microversion: 2.1 time: 0.390724 Sep 10 20:56:41.796764 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1155/2227] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Sep 10 20:56:41 2022] GET /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 => generated 371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:41.811262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b509dd6f-18ab-45ab-9d5c-0d315bdc91aa tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Action: 'update', calling method: .version_select at 0x7f9949571f70>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:41.893944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509dd6f-18ab-45ab-9d5c-0d315bdc91aa tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:41.895913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509dd6f-18ab-45ab-9d5c-0d315bdc91aa tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:41.896590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509dd6f-18ab-45ab-9d5c-0d315bdc91aa tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:41.897651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509dd6f-18ab-45ab-9d5c-0d315bdc91aa tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:41.898372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509dd6f-18ab-45ab-9d5c-0d315bdc91aa tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:41.899586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b509dd6f-18ab-45ab-9d5c-0d315bdc91aa tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:42.008495 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b509dd6f-18ab-45ab-9d5c-0d315bdc91aa tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15" status: 200 len: 328 microversion: 2.1 time: 0.201576 Sep 10 20:56:42.012435 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1156/2228] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:56:41 2022] PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 => generated 328 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:42.058579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:42.059503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:42.070698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:42.071584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:42.072046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:42.072763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:42.073214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:42.076202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:42.157036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f64b1efb-0a91-46ed-86b5-0427c70766b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:42.171791 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f64b1efb-0a91-46ed-86b5-0427c70766b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.524413 Sep 10 20:56:42.176702 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1073/2229] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:41 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:42.189126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-53e4b083-a338-43ab-b0ce-61aab074cd23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944453820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:42.235384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:42.245708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:42.247215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:42.250769 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bdb2b0c6-c274-4d6d-8868-591c6985f43b tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1413 microversion: 2.54 time: 0.237023 Sep 10 20:56:42.254290 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1157/2230] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:42 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1413 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:42.292306 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-53e4b083-a338-43ab-b0ce-61aab074cd23 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.111260 Sep 10 20:56:42.294796 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1074/2231] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:42 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:42.373506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1454193158", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:42.489147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:56:42.490736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c3d4fa2-a76c-455e-91c4-696f85329d5c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:42.491644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c3d4fa2-a76c-455e-91c4-696f85329d5c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:42.508627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c3d4fa2-a76c-455e-91c4-696f85329d5c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:42.509988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c3d4fa2-a76c-455e-91c4-696f85329d5c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:42.510928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c3d4fa2-a76c-455e-91c4-696f85329d5c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:42.512400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c3d4fa2-a76c-455e-91c4-696f85329d5c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:42.513340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c3d4fa2-a76c-455e-91c4-696f85329d5c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:42.514146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c3d4fa2-a76c-455e-91c4-696f85329d5c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:42.707966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6c3d4fa2-a76c-455e-91c4-696f85329d5c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:42.721521 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c3d4fa2-a76c-455e-91c4-696f85329d5c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1218 microversion: 2.1 time: 0.236567 Sep 10 20:56:42.722984 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1075/2232] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:42 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:42.843346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e878960f-5bb9-4bdd-8a78-34b93998fd7e tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f9944453a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-430075240", "description": "tempest-description-989290363"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:42.903488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:42.904514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:42.905204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:42.905812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:42.920483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:42.935907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:42.938697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:42.941567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:42.941727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:42.942347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:42.944700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:42.984054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Getting quotas for project 57854db577054fa3acf6b2ff3704ab15. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:56:42.989994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Getting quotas for user a72b2314d1d2485fb47f53ed60195110 and project 57854db577054fa3acf6b2ff3704ab15. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:56:43.015608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.utils [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] cores quota exceeded for 57854db577054fa3acf6b2ff3704ab15, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=145772) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 10 20:56:43.019905 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Request method failure captured: Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 145 Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoHj_uTsA_FwCaBHMYeerMJR6HrsuYd4txxuYGjzSqbQCWZdUBEWNBU4xK-x3EuP5pl0pJgksdjceJCBYOU9ZvJq2iVyjTyh8NZe4DbQQyY9LkLo_OmXgDEyWlZxlXdR9Q8F2eSjzqRk1HdI4iB8brWl9RuOJQoBC_zV4MEVZVQoFg Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 57854db577054fa3acf6b2ff3704ab15 Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57854db577054fa3acf6b2ff3704ab15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57854db577054fa3acf6b2ff3704ab15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_57854db577054fa3acf6b2ff3704ab15", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/57854db577054fa3acf6b2ff3704ab15"}]}] Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 57854db577054fa3acf6b2ff3704ab15 Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-QuotasAdminNegativeTest-1144212934-project Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a72b2314d1d2485fb47f53ed60195110 Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-QuotasAdminNegativeTest-1144212934-project Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1454193158", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1454193158', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452'}}} Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 20:56:43.023249 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 20:56:43.028171 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:43.035356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:43.038414 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4bc6c0d1-d1b6-4f22-ab51-275484d272c9 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.782904 Sep 10 20:56:43.045580 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1158/2233] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:56:42 2022] POST /compute/v2.1/servers => generated 111 bytes in 790 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:56:43.058237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be109b14-374a-475f-869f-a84bc9d7015f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Action: 'update', calling method: .version_select at 0x7f99495711f0>, body: {"quota_set": {"cores": 20}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:43.204215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be109b14-374a-475f-869f-a84bc9d7015f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:43.205083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be109b14-374a-475f-869f-a84bc9d7015f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:43.205738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be109b14-374a-475f-869f-a84bc9d7015f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:43.206722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be109b14-374a-475f-869f-a84bc9d7015f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:43.207393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be109b14-374a-475f-869f-a84bc9d7015f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:43.208060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be109b14-374a-475f-869f-a84bc9d7015f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:43.241187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:43.388065 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be109b14-374a-475f-869f-a84bc9d7015f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15" status: 200 len: 329 microversion: 2.1 time: 0.340930 Sep 10 20:56:43.389588 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1159/2234] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:56:43 2022] PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 => generated 329 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:43.407575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1a0f7316-c984-4ec8-8589-5e6d7f7b4af9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:43.410171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1a0f7316-c984-4ec8-8589-5e6d7f7b4af9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:43.433479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a0f7316-c984-4ec8-8589-5e6d7f7b4af9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:43.434096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a0f7316-c984-4ec8-8589-5e6d7f7b4af9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:43.434544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a0f7316-c984-4ec8-8589-5e6d7f7b4af9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:43.439793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a0f7316-c984-4ec8-8589-5e6d7f7b4af9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:43.440591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a0f7316-c984-4ec8-8589-5e6d7f7b4af9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:43.441336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a0f7316-c984-4ec8-8589-5e6d7f7b4af9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:43.678390 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e878960f-5bb9-4bdd-8a78-34b93998fd7e tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.953636 Sep 10 20:56:43.680676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1076/2235] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:56:42 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:43.686464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:43.687806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:43.709648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:43.711508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:43.715215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:43.716240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:43.717047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:43.717709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:43.759893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1a0f7316-c984-4ec8-8589-5e6d7f7b4af9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:43.770435 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1a0f7316-c984-4ec8-8589-5e6d7f7b4af9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.377030 Sep 10 20:56:43.771779 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1160/2236] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:43 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:43.794979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42634ed3-818f-45bf-b867-983889de5f77 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99496c8b80>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:43.865984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:43.891153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:43.893463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:43.896083 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e801f68-431a-43f4-b1d5-a40ccc608577 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1398 microversion: 2.54 time: 0.214135 Sep 10 20:56:43.897185 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1077/2237] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:43 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1398 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:43.901925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-94f1b9ce-af89-4ee6-89b4-66ced86ee048 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Calling method '.version_select at 0x7f9944487d30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:43.913685 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-42634ed3-818f-45bf-b867-983889de5f77 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.139970 Sep 10 20:56:43.914301 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1161/2238] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:43 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:43.928430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3a4f344-f3a4-4e50-8905-f4379807289a tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f9944ac8ee0>, body: {"security_group_rule": {"parent_group_id": "13670947-c7c5-40da-b37d-8313371ef54b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:44.046260 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-94f1b9ce-af89-4ee6-89b4-66ced86ee048 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15" status: 200 len: 371 microversion: 2.1 time: 0.144158 Sep 10 20:56:44.047029 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1078/2239] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Sep 10 20:56:43 2022] GET /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 => generated 371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:44.068656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4b64b7f0-7633-4917-9009-863a7edc336a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:44.071609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4b64b7f0-7633-4917-9009-863a7edc336a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:44.086400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b64b7f0-7633-4917-9009-863a7edc336a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:44.098551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b64b7f0-7633-4917-9009-863a7edc336a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:44.099180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b64b7f0-7633-4917-9009-863a7edc336a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:44.100064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b64b7f0-7633-4917-9009-863a7edc336a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:44.100654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b64b7f0-7633-4917-9009-863a7edc336a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:44.101183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b64b7f0-7633-4917-9009-863a7edc336a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:44.275354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3a4f344-f3a4-4e50-8905-f4379807289a tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.350553 Sep 10 20:56:44.276383 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1162/2240] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:56:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:44.283378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ba2735bd-bfe3-48b8-80f5-e1b77cb72693 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '.version_select at 0x7f9944b71790>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:44.328566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b64b7f0-7633-4917-9009-863a7edc336a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:44.340514 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ba2735bd-bfe3-48b8-80f5-e1b77cb72693 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-61475335" status: 204 len: 0 microversion: 2.54 time: 0.060786 Sep 10 20:56:44.341123 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1163/2241] 10.222.0.33 () {60 vars in 1313 bytes} [Sat Sep 10 20:56:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-61475335 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:56:44.349390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-69eea0c2-6dff-4294-abdb-4d5670aa587f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Action: 'update', calling method: .version_select at 0x7f994493b040>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:44.352719 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4b64b7f0-7633-4917-9009-863a7edc336a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1280 microversion: 2.1 time: 0.296907 Sep 10 20:56:44.359755 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1079/2242] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:44 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1280 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:44.375620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab1e4079-f5f6-4258-88f4-aa4c8ac8f1b0 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f9944443dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-764657695", "description": "tempest-description-56839176"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:44.485007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69eea0c2-6dff-4294-abdb-4d5670aa587f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:44.485810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69eea0c2-6dff-4294-abdb-4d5670aa587f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:44.486289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69eea0c2-6dff-4294-abdb-4d5670aa587f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:44.487034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69eea0c2-6dff-4294-abdb-4d5670aa587f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:44.487498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69eea0c2-6dff-4294-abdb-4d5670aa587f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:44.487935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69eea0c2-6dff-4294-abdb-4d5670aa587f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:44.512847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:44.610416 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-69eea0c2-6dff-4294-abdb-4d5670aa587f tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15" status: 200 len: 328 microversion: 2.1 time: 0.263094 Sep 10 20:56:44.610416 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1164/2243] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:56:44 2022] PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 => generated 328 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:44.626059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-55fcdc13-1500-47c8-9dea-575fef2e22ef tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:44.627372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-55fcdc13-1500-47c8-9dea-575fef2e22ef tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:44.645234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55fcdc13-1500-47c8-9dea-575fef2e22ef tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:44.645868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55fcdc13-1500-47c8-9dea-575fef2e22ef tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:44.646300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55fcdc13-1500-47c8-9dea-575fef2e22ef tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:44.649628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55fcdc13-1500-47c8-9dea-575fef2e22ef tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:44.650210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55fcdc13-1500-47c8-9dea-575fef2e22ef tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:44.653289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55fcdc13-1500-47c8-9dea-575fef2e22ef tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:44.693046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-55fcdc13-1500-47c8-9dea-575fef2e22ef tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:56:44.843623 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-55fcdc13-1500-47c8-9dea-575fef2e22ef tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 204 len: 0 microversion: 2.54 time: 0.230465 Sep 10 20:56:44.843623 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1165/2244] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:56:44 2022] DELETE /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:56:44.854670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1426489951", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:44.997417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:56:45.137088 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab1e4079-f5f6-4258-88f4-aa4c8ac8f1b0 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.775672 Sep 10 20:56:45.138575 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1080/2245] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:56:44 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:45.143277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-44b42252-f04c-47c9-9198-57a9017be7b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:45.144075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-44b42252-f04c-47c9-9198-57a9017be7b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:45.161530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44b42252-f04c-47c9-9198-57a9017be7b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:45.162101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44b42252-f04c-47c9-9198-57a9017be7b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:45.162549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44b42252-f04c-47c9-9198-57a9017be7b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:45.163278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44b42252-f04c-47c9-9198-57a9017be7b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:45.163744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44b42252-f04c-47c9-9198-57a9017be7b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:45.164218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44b42252-f04c-47c9-9198-57a9017be7b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:45.440684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:45.441113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:45.442455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:45.443055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:45.443487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:45.458411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:45.458964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:45.459547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:45.460633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:45.462254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:45.464017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:45.487156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Getting quotas for project 57854db577054fa3acf6b2ff3704ab15. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:56:45.499527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Getting quotas for user a72b2314d1d2485fb47f53ed60195110 and project 57854db577054fa3acf6b2ff3704ab15. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:56:45.516352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.utils [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] instances quota exceeded for 57854db577054fa3acf6b2ff3704ab15, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=145772) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 10 20:56:45.516790 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Request method failure captured: Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 145 Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoHj_uTsA_FwCaBHMYeerMJR6HrsuYd4txxuYGjzSqbQCWZdUBEWNBU4xK-x3EuP5pl0pJgksdjceJCBYOU9ZvJq2iVyjTyh8NZe4DbQQyY9LkLo_OmXgDEyWlZxlXdR9Q8F2eSjzqRk1HdI4iB8brWl9RuOJQoBC_zV4MEVZVQoFg Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 57854db577054fa3acf6b2ff3704ab15 Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57854db577054fa3acf6b2ff3704ab15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57854db577054fa3acf6b2ff3704ab15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_57854db577054fa3acf6b2ff3704ab15", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/57854db577054fa3acf6b2ff3704ab15"}]}] Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 57854db577054fa3acf6b2ff3704ab15 Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-QuotasAdminNegativeTest-1144212934-project Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a72b2314d1d2485fb47f53ed60195110 Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-QuotasAdminNegativeTest-1144212934-project Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1426489951", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1426489951', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452'}}} Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 20:56:45.519223 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:45.523065 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59436846-bc60-47f4-9498-3eac36330c90 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.672485 Sep 10 20:56:45.526748 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1166/2246] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:56:44 2022] POST /compute/v2.1/servers => generated 119 bytes in 682 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:56:45.531779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:45.532586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:45.540692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:45.541191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:45.541634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:45.542384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:45.542847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:45.543379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:45.698845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:45.749304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:45.752736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:45.754942 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c24ad87b-ce53-4635-afc1-2b40864ac70a tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1404 microversion: 2.54 time: 0.227801 Sep 10 20:56:45.772945 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1167/2247] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:45 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1404 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:45.786160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4660b821-9903-429f-b7da-9f00bbd29319 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99496c8c10>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:45.827953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-44b42252-f04c-47c9-9198-57a9017be7b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:45.837980 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-44b42252-f04c-47c9-9198-57a9017be7b7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.698162 Sep 10 20:56:45.865021 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1081/2248] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:45 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:45.874871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a2668a1d-d7fd-4ffb-b89a-41a48c9b5357 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f99444131f0>, body: {"security_group_rule": {"parent_group_id": "6dbfd864-eec2-45ff-8cda-198fa4cca03e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:45.892745 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4660b821-9903-429f-b7da-9f00bbd29319 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.118194 Sep 10 20:56:45.901706 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1168/2249] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:45 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:45.901706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5b40659-9747-4214-b247-58df237e9ecc tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:45.901706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5b40659-9747-4214-b247-58df237e9ecc tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:45.908139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b40659-9747-4214-b247-58df237e9ecc tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:45.908754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b40659-9747-4214-b247-58df237e9ecc tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:45.909284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b40659-9747-4214-b247-58df237e9ecc tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:45.910115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b40659-9747-4214-b247-58df237e9ecc tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:45.911242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b40659-9747-4214-b247-58df237e9ecc tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:45.913089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b40659-9747-4214-b247-58df237e9ecc tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:46.017352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5b40659-9747-4214-b247-58df237e9ecc tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:46.028107 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5b40659-9747-4214-b247-58df237e9ecc tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1280 microversion: 2.1 time: 0.132434 Sep 10 20:56:46.030093 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1169/2250] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:45 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1280 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:46.049109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a3c793b6-d65b-43d5-a709-347cfa94cb18 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Action: 'update', calling method: .version_select at 0x7f9944b99e50>, body: {"quota_set": {"instances": 10}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:46.152645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3c793b6-d65b-43d5-a709-347cfa94cb18 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:46.153133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3c793b6-d65b-43d5-a709-347cfa94cb18 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:46.153571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3c793b6-d65b-43d5-a709-347cfa94cb18 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:46.154509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3c793b6-d65b-43d5-a709-347cfa94cb18 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:46.155186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3c793b6-d65b-43d5-a709-347cfa94cb18 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:46.155863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3c793b6-d65b-43d5-a709-347cfa94cb18 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:46.241584 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a3c793b6-d65b-43d5-a709-347cfa94cb18 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15" status: 200 len: 329 microversion: 2.1 time: 0.210343 Sep 10 20:56:46.242628 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1170/2251] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:56:46 2022] PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 => generated 329 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:46.259413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-555b1c0c-bcce-4858-a7e2-5dece3e7bcf4 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Calling method '.version_select at 0x7f99494fb0d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:46.398227 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-555b1c0c-bcce-4858-a7e2-5dece3e7bcf4 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15" status: 200 len: 371 microversion: 2.1 time: 0.145544 Sep 10 20:56:46.400124 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1171/2252] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Sep 10 20:56:46 2022] GET /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 => generated 371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:46.414477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-50f7fb94-8094-4a9b-861e-a2a6d214eb5b tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Action: 'update', calling method: .version_select at 0x7f9945289c10>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:46.560830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50f7fb94-8094-4a9b-861e-a2a6d214eb5b tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:46.561493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50f7fb94-8094-4a9b-861e-a2a6d214eb5b tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:46.566543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50f7fb94-8094-4a9b-861e-a2a6d214eb5b tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:46.567580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50f7fb94-8094-4a9b-861e-a2a6d214eb5b tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:46.568591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50f7fb94-8094-4a9b-861e-a2a6d214eb5b tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:46.570692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50f7fb94-8094-4a9b-861e-a2a6d214eb5b tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:46.727178 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-50f7fb94-8094-4a9b-861e-a2a6d214eb5b tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15" status: 200 len: 325 microversion: 2.1 time: 0.318099 Sep 10 20:56:46.728090 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1172/2253] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:56:46 2022] PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 => generated 325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:46.792336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:46.792967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:46.808342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:46.809040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:46.809702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:46.810478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:46.811004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:46.811451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:46.956720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:46.975275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:46.977118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:46.980630 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-12d777cb-fb05-48c9-8acf-d4e9ca005f99 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1404 microversion: 2.54 time: 0.197582 Sep 10 20:56:47.001493 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1173/2254] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:46 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:47.007207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-183930065", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:47.076601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:56:47.225381 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a2668a1d-d7fd-4ffb-b89a-41a48c9b5357 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.358790 Sep 10 20:56:47.228228 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1082/2255] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:56:45 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:47.244103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab8568c9-8027-42d2-91d8-b0498ea9e14a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:47.253654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ab8568c9-8027-42d2-91d8-b0498ea9e14a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:47.283575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8568c9-8027-42d2-91d8-b0498ea9e14a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:47.284110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8568c9-8027-42d2-91d8-b0498ea9e14a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:47.284521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8568c9-8027-42d2-91d8-b0498ea9e14a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:47.285249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8568c9-8027-42d2-91d8-b0498ea9e14a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:47.289581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8568c9-8027-42d2-91d8-b0498ea9e14a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:47.291896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8568c9-8027-42d2-91d8-b0498ea9e14a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:47.411788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:47.412510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:47.413139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:47.413615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:47.414197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:47.433085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:47.433938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:47.434425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:47.435160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:47.435629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:47.436097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:47.459288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Getting quotas for project 57854db577054fa3acf6b2ff3704ab15. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:56:47.465977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Getting quotas for user a72b2314d1d2485fb47f53ed60195110 and project 57854db577054fa3acf6b2ff3704ab15. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:56:47.471411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:47.506620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.utils [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] ram quota exceeded for 57854db577054fa3acf6b2ff3704ab15, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=145772) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 10 20:56:47.507174 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Request method failure captured: Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 144 Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoHj_uTsA_FwCaBHMYeerMJR6HrsuYd4txxuYGjzSqbQCWZdUBEWNBU4xK-x3EuP5pl0pJgksdjceJCBYOU9ZvJq2iVyjTyh8NZe4DbQQyY9LkLo_OmXgDEyWlZxlXdR9Q8F2eSjzqRk1HdI4iB8brWl9RuOJQoBC_zV4MEVZVQoFg Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 57854db577054fa3acf6b2ff3704ab15 Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57854db577054fa3acf6b2ff3704ab15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57854db577054fa3acf6b2ff3704ab15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_57854db577054fa3acf6b2ff3704ab15", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/57854db577054fa3acf6b2ff3704ab15"}]}] Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 57854db577054fa3acf6b2ff3704ab15 Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-QuotasAdminNegativeTest-1144212934-project Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a72b2314d1d2485fb47f53ed60195110 Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-QuotasAdminNegativeTest-1144212934-project Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-183930065", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-183930065', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452'}}} Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 20:56:47.514889 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 20:56:47.518240 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:47.520057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:47.520606 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fcad086d-aeb1-4c78-b01f-998d8f51ee8c tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.517874 Sep 10 20:56:47.526677 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1174/2256] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:56:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 525 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:56:47.531974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ce68b1ac-800a-4a0b-a5c3-628127dd6ec5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944893280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:47.618312 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ce68b1ac-800a-4a0b-a5c3-628127dd6ec5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.090250 Sep 10 20:56:47.618754 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1175/2257] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:47 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:47.630300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6b020ec8-ef90-4167-a339-e0d4fa7a660d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:47.631604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6b020ec8-ef90-4167-a339-e0d4fa7a660d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:47.642582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b020ec8-ef90-4167-a339-e0d4fa7a660d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:47.643281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b020ec8-ef90-4167-a339-e0d4fa7a660d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:47.644482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b020ec8-ef90-4167-a339-e0d4fa7a660d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:47.645333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b020ec8-ef90-4167-a339-e0d4fa7a660d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:47.645968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b020ec8-ef90-4167-a339-e0d4fa7a660d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:47.646480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b020ec8-ef90-4167-a339-e0d4fa7a660d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:47.786590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab8568c9-8027-42d2-91d8-b0498ea9e14a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:47.834768 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab8568c9-8027-42d2-91d8-b0498ea9e14a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.605123 Sep 10 20:56:47.845152 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1083/2258] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:47 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:47.854778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6b020ec8-ef90-4167-a339-e0d4fa7a660d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:47.868100 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6b020ec8-ef90-4167-a339-e0d4fa7a660d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1322 microversion: 2.1 time: 0.246324 Sep 10 20:56:47.869119 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1176/2259] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:47 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:47.873136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b2f84c93-c34d-4a73-96f8-21867cf2429c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f9944413820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-420832657", "description": "tempest-description-839959771"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:47.877874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c049532a-777a-450a-94e1-cbb003a901c3 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Action: 'update', calling method: .version_select at 0x7f99494fb8b0>, body: {"quota_set": {"ram": 51200}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:48.004412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c049532a-777a-450a-94e1-cbb003a901c3 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:48.004855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c049532a-777a-450a-94e1-cbb003a901c3 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:48.005438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c049532a-777a-450a-94e1-cbb003a901c3 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:48.006207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c049532a-777a-450a-94e1-cbb003a901c3 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:48.006770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c049532a-777a-450a-94e1-cbb003a901c3 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:48.007328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c049532a-777a-450a-94e1-cbb003a901c3 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:48.082814 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c049532a-777a-450a-94e1-cbb003a901c3 tempest-QuotasAdminNegativeTest-99224850 tempest-QuotasAdminNegativeTest-99224850-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15" status: 200 len: 329 microversion: 2.1 time: 0.211971 Sep 10 20:56:48.084316 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1177/2260] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:56:47 2022] PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 => generated 329 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:48.095599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:48.096356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:48.114071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:48.115417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:48.116069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:48.119815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:48.119815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:48.120203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:48.180456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:48.181120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:48.181472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:48.181948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lazy-loading 'fault' on Instance uuid e246b092-52ab-4ecc-b934-dbc01babf038 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:56:48.244548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:48.252077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:48.253527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a681592c2d1043a4afa67838812e7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639eb01bc0484295b917ab8d0ceee6ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:48.259948 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-83c94750-8c68-46c4-932b-2d4e6cab4295 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 200 len: 1409 microversion: 2.54 time: 0.174508 Sep 10 20:56:48.260738 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1178/2261] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:48 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 1409 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:48.283076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62c94e85-226e-4007-9612-7a153fbbed47 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Action: 'update', calling method: .version_select at 0x7f9949571820>, body: {"quota_set": {"ram": 0}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:48.288531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-62c94e85-226e-4007-9612-7a153fbbed47 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'a72b2314d1d2485fb47f53ed60195110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57854db577054fa3acf6b2ff3704ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62c94e85-226e-4007-9612-7a153fbbed47 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Request method failure captured: Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: request: PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 HTTP/1.1 Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 25 Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoHj_uTsA_FwCaBHMYeerMJR6HrsuYd4txxuYGjzSqbQCWZdUBEWNBU4xK-x3EuP5pl0pJgksdjceJCBYOU9ZvJq2iVyjTyh8NZe4DbQQyY9LkLo_OmXgDEyWlZxlXdR9Q8F2eSjzqRk1HdI4iB8brWl9RuOJQoBC_zV4MEVZVQoFg Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 57854db577054fa3acf6b2ff3704ab15 Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57854db577054fa3acf6b2ff3704ab15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57854db577054fa3acf6b2ff3704ab15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_57854db577054fa3acf6b2ff3704ab15", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/57854db577054fa3acf6b2ff3704ab15"}]}] Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 57854db577054fa3acf6b2ff3704ab15 Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1144212934 Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-QuotasAdminNegativeTest-1144212934-project Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a72b2314d1d2485fb47f53ed60195110 Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-QuotasAdminNegativeTest-1144212934-project Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: {"quota_set": {"ram": 0}} Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '57854db577054fa3acf6b2ff3704ab15', 'body': {'quota_set': {'ram': 0}}} Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:56:48.290661 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62c94e85-226e-4007-9612-7a153fbbed47 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:48.293940 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-62c94e85-226e-4007-9612-7a153fbbed47 tempest-QuotasAdminNegativeTest-1144212934 tempest-QuotasAdminNegativeTest-1144212934-project] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15" status: 403 len: 116 microversion: 2.1 time: 0.029373 Sep 10 20:56:48.297947 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1179/2262] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 20:56:48 2022] PUT /compute/v2.1/os-quota-sets/57854db577054fa3acf6b2ff3704ab15 => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:56:48.634316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-06b66d1a-9bab-4fc4-bbd4-515a7a8d3229 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99441c88b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:48.667537 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b2f84c93-c34d-4a73-96f8-21867cf2429c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.816358 Sep 10 20:56:48.668790 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1084/2263] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:56:47 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:48.684981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a84f7b8-0a87-4a06-9696-d13af21dc922 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f9944405790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1960509407", "description": "tempest-description-459621676"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:48.755187 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-06b66d1a-9bab-4fc4-bbd4-515a7a8d3229 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.123766 Sep 10 20:56:48.757561 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1180/2264] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:48 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:48.869260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f70916a6-49fc-432e-b930-31a36348952d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:48.870390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f70916a6-49fc-432e-b930-31a36348952d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:48.880967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f70916a6-49fc-432e-b930-31a36348952d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:48.888807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f70916a6-49fc-432e-b930-31a36348952d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:48.889112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f70916a6-49fc-432e-b930-31a36348952d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:48.890010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f70916a6-49fc-432e-b930-31a36348952d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:48.891137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f70916a6-49fc-432e-b930-31a36348952d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:48.891712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f70916a6-49fc-432e-b930-31a36348952d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:49.091438 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2a84f7b8-0a87-4a06-9696-d13af21dc922 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.411558 Sep 10 20:56:49.097338 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1085/2265] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:56:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:49.109631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2cc2c34b-e259-472a-b5a9-14d7475c5819 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:49.113497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2cc2c34b-e259-472a-b5a9-14d7475c5819 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:49.127223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cc2c34b-e259-472a-b5a9-14d7475c5819 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:49.128435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cc2c34b-e259-472a-b5a9-14d7475c5819 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:49.129229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cc2c34b-e259-472a-b5a9-14d7475c5819 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:49.130504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cc2c34b-e259-472a-b5a9-14d7475c5819 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:49.131291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cc2c34b-e259-472a-b5a9-14d7475c5819 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:49.131938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cc2c34b-e259-472a-b5a9-14d7475c5819 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:49.473068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2cc2c34b-e259-472a-b5a9-14d7475c5819 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:49.475832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:49.494029 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2cc2c34b-e259-472a-b5a9-14d7475c5819 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1322 microversion: 2.1 time: 0.392051 Sep 10 20:56:49.498676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1086/2266] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:49 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:49.531745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eacf1538-8436-42fa-b842-2f20b3dbffed tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f9944450280>, body: {"security_group_rule": {"parent_group_id": "0ff83790-67a2-421f-9582-161c12090e70", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e5fdc8a8-4110-4054-bd9b-437cfc5323ac"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:49.715147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f70916a6-49fc-432e-b930-31a36348952d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:49.730808 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f70916a6-49fc-432e-b930-31a36348952d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.867497 Sep 10 20:56:49.732438 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1181/2267] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:48 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:49.747106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:49.754603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] [instance: e246b092-52ab-4ecc-b934-dbc01babf038] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:49.765447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:49.768955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:49.768955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:49.768955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:49.769422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:49.769663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:49.796655 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] HTTP exception thrown: Instance e246b092-52ab-4ecc-b934-dbc01babf038 could not be found. Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Request method failure captured: Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 HTTP/1.1 Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPnkOFJ1EPgO7PCqj4rJD93HfuKg4TSOx6Fr656g022WdsdU67pBm07lXfq6JIEl8k0WG6lPEpk3ZUAa4SxwY6bBZ707zcz_iVKcl78MfYK4UzgftEe1KJFt5og95lsVpLIaL-R_WtvL-zjaXgjgAKyID7EUJ_rm_kB4c8Wf_uFYh-8 Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.54 Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 639eb01bc0484295b917ab8d0ceee6ab Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerShowV254Test-1832547371 Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/639eb01bc0484295b917ab8d0ceee6ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/639eb01bc0484295b917ab8d0ceee6ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_639eb01bc0484295b917ab8d0ceee6ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/639eb01bc0484295b917ab8d0ceee6ab"}]}] Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerShowV254Test-1832547371 Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 639eb01bc0484295b917ab8d0ceee6ab Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerShowV254Test-1832547371 Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerShowV254Test-1832547371-project Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a681592c2d1043a4afa67838812e7fe9 Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerShowV254Test-1832547371-project Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance e246b092-52ab-4ecc-b934-dbc01babf038 could not be found. Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e246b092-52ab-4ecc-b934-dbc01babf038'} Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e246b092-52ab-4ecc-b934-dbc01babf038 could not be found. Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e246b092-52ab-4ecc-b934-dbc01babf038 could not be found. Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:49.798698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:49.808060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:49.808060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:49.808060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:49.808060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:49.808060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:49.808060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e246b092-52ab-4ecc-b934-dbc01babf038 could not be found. Sep 10 20:56:49.808060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:49.808060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] Returning 404 to user: Instance e246b092-52ab-4ecc-b934-dbc01babf038 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:49.808060 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea057ee8-4104-4591-a5f0-e33e753a0da1 tempest-ServerShowV254Test-1832547371 tempest-ServerShowV254Test-1832547371-project] 10.222.0.33 "GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038" status: 404 len: 111 microversion: 2.54 time: 0.065490 Sep 10 20:56:49.808060 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1182/2268] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:49 2022] GET /compute/v2.1/servers/e246b092-52ab-4ecc-b934-dbc01babf038 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:56:49.809711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c4cc28d7-1660-4f62-bfa9-f540d254c1d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99496c8670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:49.889640 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c4cc28d7-1660-4f62-bfa9-f540d254c1d7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.082873 Sep 10 20:56:49.901717 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1183/2269] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:49 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:49.966943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-86759ecf-2cc6-4a1a-9388-a7ddbd9ca910 req-8d81cd9c-0914-434d-8ca0-6673a7698126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b30526-2510-4bcf-a301-5ece42aee258", "tag": "c6834fdd-5b6e-4abd-802a-8a87ded92098"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:50.005773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-86759ecf-2cc6-4a1a-9388-a7ddbd9ca910 req-8d81cd9c-0914-434d-8ca0-6673a7698126 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:50.006645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-86759ecf-2cc6-4a1a-9388-a7ddbd9ca910 req-8d81cd9c-0914-434d-8ca0-6673a7698126 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:50.008604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-86759ecf-2cc6-4a1a-9388-a7ddbd9ca910 req-8d81cd9c-0914-434d-8ca0-6673a7698126 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:50.025797 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-86759ecf-2cc6-4a1a-9388-a7ddbd9ca910 req-8d81cd9c-0914-434d-8ca0-6673a7698126 service nova] Creating event network-changed:c6834fdd-5b6e-4abd-802a-8a87ded92098 for instance 36b30526-2510-4bcf-a301-5ece42aee258 on nch2-master-1 Sep 10 20:56:50.037978 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-86759ecf-2cc6-4a1a-9388-a7ddbd9ca910 req-8d81cd9c-0914-434d-8ca0-6673a7698126 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075437 Sep 10 20:56:50.039385 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1184/2270] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:50.532352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-886865f2-34f5-423f-ad08-e15b40f7ac10 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:50.533667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-886865f2-34f5-423f-ad08-e15b40f7ac10 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:50.547317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-886865f2-34f5-423f-ad08-e15b40f7ac10 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:50.548237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-886865f2-34f5-423f-ad08-e15b40f7ac10 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:50.549800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-886865f2-34f5-423f-ad08-e15b40f7ac10 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:50.551910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-886865f2-34f5-423f-ad08-e15b40f7ac10 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:50.552647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-886865f2-34f5-423f-ad08-e15b40f7ac10 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:50.554267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-886865f2-34f5-423f-ad08-e15b40f7ac10 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:50.586509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=9 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:50.835058 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eacf1538-8436-42fa-b842-2f20b3dbffed tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.316916 Sep 10 20:56:50.846883 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1087/2271] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:56:49 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:50.865247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8596915d-2dbd-40ad-9625-d7d4a436bf10 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:50.870223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8596915d-2dbd-40ad-9625-d7d4a436bf10 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:50.879783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8596915d-2dbd-40ad-9625-d7d4a436bf10 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:50.880738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8596915d-2dbd-40ad-9625-d7d4a436bf10 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:50.881465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8596915d-2dbd-40ad-9625-d7d4a436bf10 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:50.882419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8596915d-2dbd-40ad-9625-d7d4a436bf10 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:50.883260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8596915d-2dbd-40ad-9625-d7d4a436bf10 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:50.883926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8596915d-2dbd-40ad-9625-d7d4a436bf10 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:50.927442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-886865f2-34f5-423f-ad08-e15b40f7ac10 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:50.940228 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-886865f2-34f5-423f-ad08-e15b40f7ac10 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1322 microversion: 2.1 time: 0.412337 Sep 10 20:56:50.940829 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1185/2272] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:50 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:50.969646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-26a40f50-858d-47b5-a100-7d90215db0ea tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f9944ac83a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-628828130", "description": "tempest-description-856353061"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:51.453252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8596915d-2dbd-40ad-9625-d7d4a436bf10 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:51.489601 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8596915d-2dbd-40ad-9625-d7d4a436bf10 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.641014 Sep 10 20:56:51.512287 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1088/2273] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:50 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:51.523862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5cd38e7b-8379-4db7-a0ab-63a557bb2a98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994444f9d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:51.610024 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-26a40f50-858d-47b5-a100-7d90215db0ea tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.662194 Sep 10 20:56:51.611218 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1186/2274] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:56:50 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:51.621105 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5cd38e7b-8379-4db7-a0ab-63a557bb2a98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.107378 Sep 10 20:56:51.624620 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1089/2275] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:51 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:51.624951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a4f380a3-887c-4a96-be61-a6fd2587cd2d tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f9949565d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-306525922", "description": "tempest-description-1014162045"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:51.964577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e8019cc3-f38c-4069-af68-1b034a8a4cf4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:51.967755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e8019cc3-f38c-4069-af68-1b034a8a4cf4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:51.980747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8019cc3-f38c-4069-af68-1b034a8a4cf4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:51.981740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8019cc3-f38c-4069-af68-1b034a8a4cf4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:51.983427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8019cc3-f38c-4069-af68-1b034a8a4cf4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:52.026546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8019cc3-f38c-4069-af68-1b034a8a4cf4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:52.032764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8019cc3-f38c-4069-af68-1b034a8a4cf4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:52.034037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8019cc3-f38c-4069-af68-1b034a8a4cf4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:52.315043 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a4f380a3-887c-4a96-be61-a6fd2587cd2d tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.694434 Sep 10 20:56:52.316550 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1187/2276] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:56:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:56:52.329939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cbf4e8ed-0b4c-4c39-b277-6bf4d50faf3e tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f99441c84c0>, body: {"security_group_rule": {"parent_group_id": "a3dd3b0c-e900-4e2e-b9a5-24b49a696725", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "37fe4b23-47f1-4b87-b11a-20cd9ca22f57"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:52.487774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e8019cc3-f38c-4069-af68-1b034a8a4cf4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:52.502898 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e8019cc3-f38c-4069-af68-1b034a8a4cf4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1322 microversion: 2.1 time: 0.543187 Sep 10 20:56:52.506429 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1090/2277] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:51 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1322 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:52.515226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ff186584-4544-4240-ba0d-06e9ca79c006 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:52.525697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ff186584-4544-4240-ba0d-06e9ca79c006 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:52.551171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff186584-4544-4240-ba0d-06e9ca79c006 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:52.555641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff186584-4544-4240-ba0d-06e9ca79c006 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:52.556322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff186584-4544-4240-ba0d-06e9ca79c006 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:52.559902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff186584-4544-4240-ba0d-06e9ca79c006 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:52.563398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff186584-4544-4240-ba0d-06e9ca79c006 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:52.567765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff186584-4544-4240-ba0d-06e9ca79c006 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:52.902299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ff186584-4544-4240-ba0d-06e9ca79c006 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:52.911059 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ff186584-4544-4240-ba0d-06e9ca79c006 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.399936 Sep 10 20:56:52.931519 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1091/2278] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:52 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:52.941149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d858f917-6a86-4614-8669-579192ed107b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994444f1f0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:53.011304 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d858f917-6a86-4614-8669-579192ed107b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.078859 Sep 10 20:56:53.012353 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1092/2279] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:52 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:53.077779 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cbf4e8ed-0b4c-4c39-b277-6bf4d50faf3e tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.751204 Sep 10 20:56:53.078428 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1188/2280] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:56:52 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:56:53.114312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d8508b32-d526-4e59-ae95-9b4acfc1db98 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f9944488940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:53.539217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-217dc9cd-05b9-4a6f-bcab-e5cd048ad1ff tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:53.540058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-217dc9cd-05b9-4a6f-bcab-e5cd048ad1ff tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:53.555209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-217dc9cd-05b9-4a6f-bcab-e5cd048ad1ff tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:53.555814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-217dc9cd-05b9-4a6f-bcab-e5cd048ad1ff tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:53.556289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-217dc9cd-05b9-4a6f-bcab-e5cd048ad1ff tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:53.557043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-217dc9cd-05b9-4a6f-bcab-e5cd048ad1ff tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:53.557504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-217dc9cd-05b9-4a6f-bcab-e5cd048ad1ff tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:53.557962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-217dc9cd-05b9-4a6f-bcab-e5cd048ad1ff tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:53.817502 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d8508b32-d526-4e59-ae95-9b4acfc1db98 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/37fe4b23-47f1-4b87-b11a-20cd9ca22f57" status: 202 len: 0 microversion: 2.1 time: 0.725076 Sep 10 20:56:53.818583 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1093/2281] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:56:53 2022] DELETE /compute/v2.1/os-security-groups/37fe4b23-47f1-4b87-b11a-20cd9ca22f57 => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:56:53.830551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-37b3a28c-f345-4dc2-8f71-b79af9cc1cba tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f99444504c0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:53.907383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-217dc9cd-05b9-4a6f-bcab-e5cd048ad1ff tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:53.928103 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-217dc9cd-05b9-4a6f-bcab-e5cd048ad1ff tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1322 microversion: 2.1 time: 0.394426 Sep 10 20:56:53.930680 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1189/2282] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:53 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:56:53.946546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d6e23da3-0662-4a2b-a5a7-067f7e4dbc70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:53.948092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d6e23da3-0662-4a2b-a5a7-067f7e4dbc70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:53.959644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6e23da3-0662-4a2b-a5a7-067f7e4dbc70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:53.962318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6e23da3-0662-4a2b-a5a7-067f7e4dbc70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:53.965046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6e23da3-0662-4a2b-a5a7-067f7e4dbc70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:53.967902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6e23da3-0662-4a2b-a5a7-067f7e4dbc70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:53.969058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6e23da3-0662-4a2b-a5a7-067f7e4dbc70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:53.970067 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-37b3a28c-f345-4dc2-8f71-b79af9cc1cba tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/a3dd3b0c-e900-4e2e-b9a5-24b49a696725" status: 200 len: 246 microversion: 2.1 time: 0.145756 Sep 10 20:56:53.970510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6e23da3-0662-4a2b-a5a7-067f7e4dbc70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:53.982879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1094/2283] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 20:56:53 2022] GET /compute/v2.1/os-security-groups/a3dd3b0c-e900-4e2e-b9a5-24b49a696725 => generated 246 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:53.997514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-53710e21-14d2-4d20-b5b0-9f92bba345c2 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f9944453940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2014959858", "description": "tempest-description-911686538"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:54.028963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=38 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:54.182079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d6e23da3-0662-4a2b-a5a7-067f7e4dbc70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:54.194299 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d6e23da3-0662-4a2b-a5a7-067f7e4dbc70 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.259131 Sep 10 20:56:54.195705 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1190/2284] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:53 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:54.216528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b9dc895b-4343-4794-b736-77031566d31b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944178550>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:54.268963 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b9dc895b-4343-4794-b736-77031566d31b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1413 microversion: 2.1 time: 0.071227 Sep 10 20:56:54.269783 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1191/2285] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:54 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:54.311459 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-53710e21-14d2-4d20-b5b0-9f92bba345c2 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.318317 Sep 10 20:56:54.312066 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1095/2286] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:56:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:54.332951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5451db4e-d4ba-4453-a50a-3aa506a5b9a0 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f99444bed30>, body: {"security_group_rule": {"parent_group_id": "13cb9a6d-bccd-45f7-89f4-40a7249ce54a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:54.627739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-160922698", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": "none"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:54.706568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:54.707271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:54.708152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:54.708697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:54.709701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:54.724571 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5451db4e-d4ba-4453-a50a-3aa506a5b9a0 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.402917 Sep 10 20:56:54.725203 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1096/2287] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:56:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:56:54.733811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:54.734813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:54.735768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:54.739872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:54.740514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:54.743065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:54.778647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Getting quotas for project c2e6f2d4d90d489d88762a6a0a97ed81. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:56:54.784762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Getting quotas for user c0c4e26a7d1d423392c05c3a1b25c8c0 and project c2e6f2d4d90d489d88762a6a0a97ed81. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:56:54.791086 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5bf7023c-6aa2-4cd5-a095-f8bf23be5bcc tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] 10.222.0.33 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.064896 Sep 10 20:56:54.791995 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1097/2288] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Sep 10 20:56:54 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 20:56:54.798939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-84b2c687-d2f5-4b35-ad72-c956c1d127c4 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Action: 'create', calling method: .version_select at 0x7f994441f160>, body: {"security_group_rule": {"parent_group_id": "13cb9a6d-bccd-45f7-89f4-40a7249ce54a", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:54.807404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:56:54.810332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:56:54.871118 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-34411a01-174f-463a-a355-7a34412fc644 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.599438 Sep 10 20:56:54.872216 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1192/2289] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:56:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 20:56:54.878243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c1c91cd-ed54-47c4-81dc-46931c39cc65 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Calling method '.version_select at 0x7f9944178280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:54.943348 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-1c1c91cd-ed54-47c4-81dc-46931c39cc65 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] HTTP exception thrown: Image not found. Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c1c91cd-ed54-47c4-81dc-46931c39cc65 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Request method failure captured: Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoWrq-pTBXYpxkO_Tzrq9uOddSJskM4ZLdtXaSo4HC5pmz55rmAWRnhAC9xHM8zmJqWSqXLEka0VBPHCoUpLVCnWuwzmtQ3tIhMyGpqgbJur6DWE_h7m_N1FMh-Wuqa7S6cp1WNRARTGmXw4bX2fhTS-_6INsEPFzVY4vx8JTxPpcI Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: bb3b6560487b4adc8e7e655a6fbf1513 Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb3b6560487b4adc8e7e655a6fbf1513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb3b6560487b4adc8e7e655a6fbf1513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bb3b6560487b4adc8e7e655a6fbf1513", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bb3b6560487b4adc8e7e655a6fbf1513"}]}] Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: bb3b6560487b4adc8e7e655a6fbf1513 Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesDeleteNegativeTestJSON-30750912-project Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: c7a7eb073a03410c8183ae02fab0e74e Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-30750912-project Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: exception: Image not found. Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '-1'} Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:54.945647 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:54.949875 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:54.958197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c1c91cd-ed54-47c4-81dc-46931c39cc65 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Returning 404 to user: Image not found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:54.959372 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1c1c91cd-ed54-47c4-81dc-46931c39cc65 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] 10.222.0.33 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.085572 Sep 10 20:56:54.960687 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1193/2290] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Sep 10 20:56:54 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:56:54.987075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f15f29d1-f60e-44c6-8940-c5d6ea4f6b2b tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:54.987863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f15f29d1-f60e-44c6-8940-c5d6ea4f6b2b tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:55.057935 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-84b2c687-d2f5-4b35-ad72-c956c1d127c4 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.264367 Sep 10 20:56:55.058976 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1098/2291] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Sep 10 20:56:54 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:55.063945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0cb120b6-89eb-4a6b-8448-bbd8cb200f33 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.064561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0cb120b6-89eb-4a6b-8448-bbd8cb200f33 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:55.071545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f15f29d1-f60e-44c6-8940-c5d6ea4f6b2b tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:55.075481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cb120b6-89eb-4a6b-8448-bbd8cb200f33 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:55.075981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cb120b6-89eb-4a6b-8448-bbd8cb200f33 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:55.076403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cb120b6-89eb-4a6b-8448-bbd8cb200f33 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:55.077110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cb120b6-89eb-4a6b-8448-bbd8cb200f33 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:55.077646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cb120b6-89eb-4a6b-8448-bbd8cb200f33 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:55.078031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cb120b6-89eb-4a6b-8448-bbd8cb200f33 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:55.079563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f15f29d1-f60e-44c6-8940-c5d6ea4f6b2b tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:55.080987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f15f29d1-f60e-44c6-8940-c5d6ea4f6b2b tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:55.082176 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f15f29d1-f60e-44c6-8940-c5d6ea4f6b2b tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1277 microversion: 2.57 time: 0.113724 Sep 10 20:56:55.083330 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1194/2292] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:54 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:55.088497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6357b2dc-3b69-4bb7-8522-47470ce978c6 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Calling method '.version_select at 0x7f9949571820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.116418 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-6357b2dc-3b69-4bb7-8522-47470ce978c6 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] HTTP exception thrown: Image not found. Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6357b2dc-3b69-4bb7-8522-47470ce978c6 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Request method failure captured: Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/images/e58083c6-9a8f-4c8e-b621-0554ddaf2daj HTTP/1.1 Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoWrq-pTBXYpxkO_Tzrq9uOddSJskM4ZLdtXaSo4HC5pmz55rmAWRnhAC9xHM8zmJqWSqXLEka0VBPHCoUpLVCnWuwzmtQ3tIhMyGpqgbJur6DWE_h7m_N1FMh-Wuqa7S6cp1WNRARTGmXw4bX2fhTS-_6INsEPFzVY4vx8JTxPpcI Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: bb3b6560487b4adc8e7e655a6fbf1513 Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb3b6560487b4adc8e7e655a6fbf1513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb3b6560487b4adc8e7e655a6fbf1513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bb3b6560487b4adc8e7e655a6fbf1513", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bb3b6560487b4adc8e7e655a6fbf1513"}]}] Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: bb3b6560487b4adc8e7e655a6fbf1513 Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesDeleteNegativeTestJSON-30750912-project Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: c7a7eb073a03410c8183ae02fab0e74e Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-30750912-project Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: exception: Image not found. Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e58083c6-9a8f-4c8e-b621-0554ddaf2daj'} Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e58083c6-9a8f-4c8e-b621-0554ddaf2daj to delete Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e58083c6-9a8f-4c8e-b621-0554ddaf2daj could not be found. Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.118865 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6357b2dc-3b69-4bb7-8522-47470ce978c6 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Returning 404 to user: Image not found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6357b2dc-3b69-4bb7-8522-47470ce978c6 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] 10.222.0.33 "DELETE /compute/v2.1/images/e58083c6-9a8f-4c8e-b621-0554ddaf2daj" status: 404 len: 62 microversion: 2.1 time: 0.035968 Sep 10 20:56:55.123441 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1195/2293] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:55 2022] DELETE /compute/v2.1/images/e58083c6-9a8f-4c8e-b621-0554ddaf2daj => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:56:55.126758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3f9e7dba-8da3-446e-a8d2-1ce647168182 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f99441780d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.220585 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3f9e7dba-8da3-446e-a8d2-1ce647168182 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/13cb9a6d-bccd-45f7-89f4-40a7249ce54a" status: 200 len: 664 microversion: 2.1 time: 0.090254 Sep 10 20:56:55.221447 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1196/2294] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 20:56:55 2022] GET /compute/v2.1/os-security-groups/13cb9a6d-bccd-45f7-89f4-40a7249ce54a => generated 664 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:55.233406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc8b6403-bb86-418f-9b5c-788976399050 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Calling method '.version_select at 0x7f99441c89d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.254162 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-fc8b6403-bb86-418f-9b5c-788976399050 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] HTTP exception thrown: Image not found. Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc8b6403-bb86-418f-9b5c-788976399050 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Request method failure captured: Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/images/0f0df534-1b5d-49cf-aeca-59cb22ee2ae81 HTTP/1.1 Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoWrq-pTBXYpxkO_Tzrq9uOddSJskM4ZLdtXaSo4HC5pmz55rmAWRnhAC9xHM8zmJqWSqXLEka0VBPHCoUpLVCnWuwzmtQ3tIhMyGpqgbJur6DWE_h7m_N1FMh-Wuqa7S6cp1WNRARTGmXw4bX2fhTS-_6INsEPFzVY4vx8JTxPpcI Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: bb3b6560487b4adc8e7e655a6fbf1513 Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb3b6560487b4adc8e7e655a6fbf1513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb3b6560487b4adc8e7e655a6fbf1513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bb3b6560487b4adc8e7e655a6fbf1513", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bb3b6560487b4adc8e7e655a6fbf1513"}]}] Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: bb3b6560487b4adc8e7e655a6fbf1513 Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesDeleteNegativeTestJSON-30750912-project Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: c7a7eb073a03410c8183ae02fab0e74e Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-30750912-project Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: exception: Image not found. Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '0f0df534-1b5d-49cf-aeca-59cb22ee2ae81'} Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0f0df534-1b5d-49cf-aeca-59cb22ee2ae81 to delete Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f0df534-1b5d-49cf-aeca-59cb22ee2ae81 could not be found. Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.256118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc8b6403-bb86-418f-9b5c-788976399050 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Returning 404 to user: Image not found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc8b6403-bb86-418f-9b5c-788976399050 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] 10.222.0.33 "DELETE /compute/v2.1/images/0f0df534-1b5d-49cf-aeca-59cb22ee2ae81" status: 404 len: 62 microversion: 2.1 time: 0.029310 Sep 10 20:56:55.264078 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1197/2295] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:56:55 2022] DELETE /compute/v2.1/images/0f0df534-1b5d-49cf-aeca-59cb22ee2ae81 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:56:55.265444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-423eaaa6-79ce-4490-a815-2543613bd7e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.266384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-423eaaa6-79ce-4490-a815-2543613bd7e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:55.276500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-423eaaa6-79ce-4490-a815-2543613bd7e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:55.282594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-423eaaa6-79ce-4490-a815-2543613bd7e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:55.283247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-423eaaa6-79ce-4490-a815-2543613bd7e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:55.284191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-423eaaa6-79ce-4490-a815-2543613bd7e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:55.284843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-423eaaa6-79ce-4490-a815-2543613bd7e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:55.285553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-423eaaa6-79ce-4490-a815-2543613bd7e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:55.531894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-423eaaa6-79ce-4490-a815-2543613bd7e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:55.540596 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-423eaaa6-79ce-4490-a815-2543613bd7e1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.280418 Sep 10 20:56:55.551368 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1198/2296] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:55 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:55.555729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0cb120b6-89eb-4a6b-8448-bbd8cb200f33 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:55.565908 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0cb120b6-89eb-4a6b-8448-bbd8cb200f33 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1322 microversion: 2.1 time: 0.504526 Sep 10 20:56:55.566205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d19b5d71-8858-403e-8462-acc100457d3c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f9944178a60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.567631 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1099/2297] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:55 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:55.573269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b6c4d386-517b-4ae8-989b-5f6b748c2a37 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Calling method '.version_select at 0x7f9944443160>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.599354 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-b6c4d386-517b-4ae8-989b-5f6b748c2a37 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] HTTP exception thrown: Image not found. Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b6c4d386-517b-4ae8-989b-5f6b748c2a37 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Request method failure captured: Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/images/tempest-invalid-1901909364 HTTP/1.1 Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoWrq-pTBXYpxkO_Tzrq9uOddSJskM4ZLdtXaSo4HC5pmz55rmAWRnhAC9xHM8zmJqWSqXLEka0VBPHCoUpLVCnWuwzmtQ3tIhMyGpqgbJur6DWE_h7m_N1FMh-Wuqa7S6cp1WNRARTGmXw4bX2fhTS-_6INsEPFzVY4vx8JTxPpcI Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: bb3b6560487b4adc8e7e655a6fbf1513 Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb3b6560487b4adc8e7e655a6fbf1513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb3b6560487b4adc8e7e655a6fbf1513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bb3b6560487b4adc8e7e655a6fbf1513", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bb3b6560487b4adc8e7e655a6fbf1513"}]}] Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: bb3b6560487b4adc8e7e655a6fbf1513 Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesDeleteNegativeTestJSON-30750912-project Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: c7a7eb073a03410c8183ae02fab0e74e Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-30750912-project Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'tempest-invalid-1901909364'} Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1901909364 to delete Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1901909364 could not be found. Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.601564 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b6c4d386-517b-4ae8-989b-5f6b748c2a37 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b6c4d386-517b-4ae8-989b-5f6b748c2a37 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] 10.222.0.33 "DELETE /compute/v2.1/images/tempest-invalid-1901909364" status: 404 len: 62 microversion: 2.1 time: 0.036124 Sep 10 20:56:55.611424 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1100/2298] 10.222.0.33 () {58 vars in 1206 bytes} [Sat Sep 10 20:56:55 2022] DELETE /compute/v2.1/images/tempest-invalid-1901909364 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:56:55.617457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3eb12efb-f27e-4ac3-9a86-55be4051fd87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994441f5e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.692936 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3eb12efb-f27e-4ac3-9a86-55be4051fd87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1422 microversion: 2.1 time: 0.085567 Sep 10 20:56:55.694057 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1101/2299] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:55 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:55.700489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d66ed57b-6aff-49c5-8aac-c4bf4e355fa6 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Calling method '.version_select at 0x7f9944443c10>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.748665 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-d66ed57b-6aff-49c5-8aac-c4bf4e355fa6 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] HTTP exception thrown: Image not found. Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d66ed57b-6aff-49c5-8aac-c4bf4e355fa6 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Request method failure captured: Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/images/eb6028ac-2fb8-4ddd-998a-5c5d2fe44e0d HTTP/1.1 Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoWrq-pTBXYpxkO_Tzrq9uOddSJskM4ZLdtXaSo4HC5pmz55rmAWRnhAC9xHM8zmJqWSqXLEka0VBPHCoUpLVCnWuwzmtQ3tIhMyGpqgbJur6DWE_h7m_N1FMh-Wuqa7S6cp1WNRARTGmXw4bX2fhTS-_6INsEPFzVY4vx8JTxPpcI Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: bb3b6560487b4adc8e7e655a6fbf1513 Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb3b6560487b4adc8e7e655a6fbf1513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb3b6560487b4adc8e7e655a6fbf1513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bb3b6560487b4adc8e7e655a6fbf1513", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bb3b6560487b4adc8e7e655a6fbf1513"}]}] Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: bb3b6560487b4adc8e7e655a6fbf1513 Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-30750912 Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesDeleteNegativeTestJSON-30750912-project Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: c7a7eb073a03410c8183ae02fab0e74e Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-30750912-project Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'eb6028ac-2fb8-4ddd-998a-5c5d2fe44e0d'} Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eb6028ac-2fb8-4ddd-998a-5c5d2fe44e0d to delete Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eb6028ac-2fb8-4ddd-998a-5c5d2fe44e0d could not be found. Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.750471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d66ed57b-6aff-49c5-8aac-c4bf4e355fa6 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d66ed57b-6aff-49c5-8aac-c4bf4e355fa6 tempest-ImagesDeleteNegativeTestJSON-30750912 tempest-ImagesDeleteNegativeTestJSON-30750912-project] 10.222.0.33 "DELETE /compute/v2.1/images/eb6028ac-2fb8-4ddd-998a-5c5d2fe44e0d" status: 404 len: 62 microversion: 2.1 time: 0.056689 Sep 10 20:56:55.755802 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1102/2300] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:55 2022] DELETE /compute/v2.1/images/eb6028ac-2fb8-4ddd-998a-5c5d2fe44e0d => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:56:55.766654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d7c6870b-a213-4f3b-aa0c-ed249c3feade tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994441f3a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.771015 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d19b5d71-8858-403e-8462-acc100457d3c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/a82e3ed3-d0d6-48d0-97a3-64df367aa8ac" status: 202 len: 0 microversion: 2.1 time: 0.217620 Sep 10 20:56:55.771612 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1199/2301] 10.222.0.33 () {58 vars in 1287 bytes} [Sat Sep 10 20:56:55 2022] DELETE /compute/v2.1/os-security-group-rules/a82e3ed3-d0d6-48d0-97a3-64df367aa8ac => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:56:55.780619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-441200e2-eae5-40c7-8bf5-8f94be17a444 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f9949571d30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:55.873490 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d7c6870b-a213-4f3b-aa0c-ed249c3feade tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 200 len: 1422 microversion: 2.1 time: 0.118764 Sep 10 20:56:55.874652 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1103/2302] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:56:55 2022] GET /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:55.890770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8a466f31-eb8c-4f4f-9fde-fd450106fcb5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944443a60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:56.063941 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-441200e2-eae5-40c7-8bf5-8f94be17a444 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/13cb9a6d-bccd-45f7-89f4-40a7249ce54a" status: 202 len: 0 microversion: 2.1 time: 0.287226 Sep 10 20:56:56.064746 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1200/2303] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:56:55 2022] DELETE /compute/v2.1/os-security-groups/13cb9a6d-bccd-45f7-89f4-40a7249ce54a => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:56:56.326867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28ff3d2a-394d-4067-92b2-8c116873e968 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:56.335339 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-28ff3d2a-394d-4067-92b2-8c116873e968 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.269319 Sep 10 20:56:56.336002 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1201/2304] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:56:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:56.354739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8482cf10-3325-4592-971d-2134bdecc41c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f9944178160>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:56.381088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-8482cf10-3325-4592-971d-2134bdecc41c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37fe4b23-47f1-4b87-b11a-20cd9ca22f57 does not exist", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:56:56.381705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.security_group_api [None req-8482cf10-3325-4592-971d-2134bdecc41c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Neutron security group 37fe4b23-47f1-4b87-b11a-20cd9ca22f57 not found {{(pid=145772) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 20:56:56.382281 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-8482cf10-3325-4592-971d-2134bdecc41c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] HTTP exception thrown: Security group 37fe4b23-47f1-4b87-b11a-20cd9ca22f57 does not exist Sep 10 20:56:56.382281 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-ee8ca924-758d-4a52-98af-76b9b56d544e'] Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8482cf10-3325-4592-971d-2134bdecc41c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Request method failure captured: Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-security-groups/37fe4b23-47f1-4b87-b11a-20cd9ca22f57 HTTP/1.1 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoKaTsHbKO1cAwMjMsYg71nVRIbPq7fEYCHWih8yhiokGt5Xsl9h5StB_GWhuDQoN0uRtaBT8sbish79BqFzHgLfmf4NZRDKQW9KedNKpNe_tXYFs5iqkId2b_ajPth1NOyyVtgTUH0frRvevSPtkWP_v8egunqMLt048NTgLbpb2E Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 02dadff0c0cd4e94ab17400e30e43ba6 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-421856000 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/02dadff0c0cd4e94ab17400e30e43ba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/02dadff0c0cd4e94ab17400e30e43ba6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_02dadff0c0cd4e94ab17400e30e43ba6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/02dadff0c0cd4e94ab17400e30e43ba6"}]}] Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupRulesTestJSON-421856000 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 02dadff0c0cd4e94ab17400e30e43ba6 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-421856000 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupRulesTestJSON-421856000-project Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2ec3657e512a404db2270dee3d9d1c65 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupRulesTestJSON-421856000-project Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: exception: Security group 37fe4b23-47f1-4b87-b11a-20cd9ca22f57 does not exist Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-ee8ca924-758d-4a52-98af-76b9b56d544e'] Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '37fe4b23-47f1-4b87-b11a-20cd9ca22f57'} Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:56:56.384870 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37fe4b23-47f1-4b87-b11a-20cd9ca22f57 does not exist Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee8ca924-758d-4a52-98af-76b9b56d544e'] Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37fe4b23-47f1-4b87-b11a-20cd9ca22f57 does not exist Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee8ca924-758d-4a52-98af-76b9b56d544e'] Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37fe4b23-47f1-4b87-b11a-20cd9ca22f57 does not exist Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee8ca924-758d-4a52-98af-76b9b56d544e'] Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37fe4b23-47f1-4b87-b11a-20cd9ca22f57 does not exist Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee8ca924-758d-4a52-98af-76b9b56d544e'] Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8482cf10-3325-4592-971d-2134bdecc41c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Returning 404 to user: Security group 37fe4b23-47f1-4b87-b11a-20cd9ca22f57 does not exist Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-ee8ca924-758d-4a52-98af-76b9b56d544e'] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:56:56.388155 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8482cf10-3325-4592-971d-2134bdecc41c tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/37fe4b23-47f1-4b87-b11a-20cd9ca22f57" status: 404 len: 194 microversion: 2.1 time: 0.035995 Sep 10 20:56:56.391244 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1202/2305] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:56:56 2022] DELETE /compute/v2.1/os-security-groups/37fe4b23-47f1-4b87-b11a-20cd9ca22f57 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:56:56.396021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:56.396598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:56.404489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:56.405287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:56.405847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:56.406562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:56.407034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:56.407522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:56.490534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:56.494961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:56.507456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:56.509735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:56.510995 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b27c552e-2a25-485e-947e-e784ce18fd67 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1329 microversion: 2.57 time: 0.118898 Sep 10 20:56:56.511581 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1203/2306] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:56 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1329 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:56.516865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-74e0f2d4-4438-4c72-a521-4417821db24b tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:56.539213 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-74e0f2d4-4438-4c72-a521-4417821db24b tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.026086 Sep 10 20:56:56.549642 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1204/2307] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 20:56:56 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:56.556486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2538bcf9-7e47-4ca8-8e0d-7cf21b3c91b5 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f99494fb820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:56.703503 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8a466f31-eb8c-4f4f-9fde-fd450106fcb5 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 204 len: 0 microversion: 2.1 time: 0.817471 Sep 10 20:56:56.704905 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1104/2308] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:55 2022] DELETE /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 20:56:56.712472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-33475d26-ba8c-4e5d-951f-3f868d0ee068 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:56.721406 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-33475d26-ba8c-4e5d-951f-3f868d0ee068 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014546 Sep 10 20:56:56.721937 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1105/2309] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:56:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:56.750850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d830e49f-23ee-49c1-acdf-285cc81a0c2c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:56.752055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d830e49f-23ee-49c1-acdf-285cc81a0c2c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:56.761959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d830e49f-23ee-49c1-acdf-285cc81a0c2c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:56.762691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d830e49f-23ee-49c1-acdf-285cc81a0c2c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:56.763660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d830e49f-23ee-49c1-acdf-285cc81a0c2c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:56.764524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d830e49f-23ee-49c1-acdf-285cc81a0c2c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:56.765658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d830e49f-23ee-49c1-acdf-285cc81a0c2c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:56.766266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d830e49f-23ee-49c1-acdf-285cc81a0c2c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:56.865176 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2538bcf9-7e47-4ca8-8e0d-7cf21b3c91b5 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a3dd3b0c-e900-4e2e-b9a5-24b49a696725" status: 202 len: 0 microversion: 2.1 time: 0.314070 Sep 10 20:56:56.870069 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1205/2310] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:56:56 2022] DELETE /compute/v2.1/os-security-groups/a3dd3b0c-e900-4e2e-b9a5-24b49a696725 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:56:56.872522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4d4f4b6c-348f-4c9d-81c5-79c3a47be8da tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:56.873207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4d4f4b6c-348f-4c9d-81c5-79c3a47be8da tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:56.882476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d4f4b6c-348f-4c9d-81c5-79c3a47be8da tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:56.882989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d4f4b6c-348f-4c9d-81c5-79c3a47be8da tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:56.883432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d4f4b6c-348f-4c9d-81c5-79c3a47be8da tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:56.884179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d4f4b6c-348f-4c9d-81c5-79c3a47be8da tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:56.884644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d4f4b6c-348f-4c9d-81c5-79c3a47be8da tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:56.885127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d4f4b6c-348f-4c9d-81c5-79c3a47be8da tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:57.303256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d830e49f-23ee-49c1-acdf-285cc81a0c2c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:57.314305 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d830e49f-23ee-49c1-acdf-285cc81a0c2c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.570282 Sep 10 20:56:57.326360 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1106/2311] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:56 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:57.342297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f6a3473f-e341-4614-892a-119861eeb2a4 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:57.342803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f6a3473f-e341-4614-892a-119861eeb2a4 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:57.349724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6a3473f-e341-4614-892a-119861eeb2a4 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:57.350469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6a3473f-e341-4614-892a-119861eeb2a4 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:57.350892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6a3473f-e341-4614-892a-119861eeb2a4 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:57.352512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6a3473f-e341-4614-892a-119861eeb2a4 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:57.353284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6a3473f-e341-4614-892a-119861eeb2a4 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:57.353958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6a3473f-e341-4614-892a-119861eeb2a4 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:57.360271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4d4f4b6c-348f-4c9d-81c5-79c3a47be8da tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:57.371084 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4d4f4b6c-348f-4c9d-81c5-79c3a47be8da tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1322 microversion: 2.1 time: 0.502644 Sep 10 20:56:57.371810 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1206/2312] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:56 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:57.386138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-829d00e1-3f80-416e-8ebf-2c1d1fdc0492 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:57.387391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f6a3473f-e341-4614-892a-119861eeb2a4 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:56:57.395736 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-829d00e1-3f80-416e-8ebf-2c1d1fdc0492 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015944 Sep 10 20:56:57.396310 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1207/2313] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:56:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:57.403139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-507f6909-31ac-4afb-8566-1e5555147bd8 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f9949571d30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:57.478011 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f6a3473f-e341-4614-892a-119861eeb2a4 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 204 len: 0 microversion: 2.1 time: 0.140220 Sep 10 20:56:57.478901 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1107/2314] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:56:57 2022] DELETE /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:56:57.497756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-370d50e4-fbf2-4d36-be8b-4034f614fafc tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:57.560506 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-370d50e4-fbf2-4d36-be8b-4034f614fafc tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.080104 Sep 10 20:56:57.564013 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1108/2315] 10.222.0.33 () {58 vars in 1165 bytes} [Sat Sep 10 20:56:57 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:57.575260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:57.581098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:57.594859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:57.597874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:57.599069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:57.599805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:57.600264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:57.600700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:57.690265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:57.700549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:57.703346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:57.704677 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3159ede1-c4b8-4cb9-b72d-50b3dc4de9b7 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1335 microversion: 2.57 time: 0.139657 Sep 10 20:56:57.705969 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1109/2316] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:57 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1335 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:57.717587 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-507f6909-31ac-4afb-8566-1e5555147bd8 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e5fdc8a8-4110-4054-bd9b-437cfc5323ac" status: 202 len: 0 microversion: 2.1 time: 0.320072 Sep 10 20:56:57.718674 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1208/2317] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:56:57 2022] DELETE /compute/v2.1/os-security-groups/e5fdc8a8-4110-4054-bd9b-437cfc5323ac => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:56:57.722884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-02b60a0d-69b3-4317-80ab-3e966f1de60c tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:57.726686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1432919607", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "fb7a08eb-859f-4d5a-a729-24ed5c968d62"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:57.743578 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-02b60a0d-69b3-4317-80ab-3e966f1de60c tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035648 Sep 10 20:56:57.744192 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1110/2318] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:56:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:57.750179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-03ad4012-0b3e-401f-8896-aed0ebe8c834 req-c86284ab-5903-4dce-be7e-8771e91cf5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b30526-2510-4bcf-a301-5ece42aee258", "name": "network-vif-plugged", "status": "completed", "tag": "c6834fdd-5b6e-4abd-802a-8a87ded92098"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:57.761419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-03ad4012-0b3e-401f-8896-aed0ebe8c834 req-c86284ab-5903-4dce-be7e-8771e91cf5d0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:57.762943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-03ad4012-0b3e-401f-8896-aed0ebe8c834 req-c86284ab-5903-4dce-be7e-8771e91cf5d0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:57.763617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-03ad4012-0b3e-401f-8896-aed0ebe8c834 req-c86284ab-5903-4dce-be7e-8771e91cf5d0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:57.775682 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-03ad4012-0b3e-401f-8896-aed0ebe8c834 req-c86284ab-5903-4dce-be7e-8771e91cf5d0 service nova] Creating event network-vif-plugged:c6834fdd-5b6e-4abd-802a-8a87ded92098 for instance 36b30526-2510-4bcf-a301-5ece42aee258 on nch2-master-1 Sep 10 20:56:57.780839 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-03ad4012-0b3e-401f-8896-aed0ebe8c834 req-c86284ab-5903-4dce-be7e-8771e91cf5d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035203 Sep 10 20:56:57.781606 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1111/2319] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:57.787294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eaf95e2e-1fc7-4b21-823f-6a9c3a9ec88e tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f99445f2d30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:57.810276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] validate_networks() for [('fb7a08eb-859f-4d5a-a729-24ed5c968d62', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:56:58.183860 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eaf95e2e-1fc7-4b21-823f-6a9c3a9ec88e tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/0ff83790-67a2-421f-9582-161c12090e70" status: 202 len: 0 microversion: 2.1 time: 0.400745 Sep 10 20:56:58.184662 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1112/2320] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:56:57 2022] DELETE /compute/v2.1/os-security-groups/0ff83790-67a2-421f-9582-161c12090e70 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:56:58.191155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-72f2914e-a366-4fb2-85cd-8f18258e9e6f tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:58.222553 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-72f2914e-a366-4fb2-85cd-8f18258e9e6f tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.035048 Sep 10 20:56:58.223764 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1113/2321] 10.222.0.33 () {58 vars in 1169 bytes} [Sat Sep 10 20:56:58 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:58.230242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-94c5ae7f-a412-48b2-b287-e8e71cd6cef0 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f9944488700>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:58.306106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:58.307114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:58.307593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:58.308035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:58.308619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:58.318499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:58.318981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:58.319558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:58.320544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:58.321002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:58.321427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:58.341684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Getting quotas for project e8f7f9f3112545e9b40d88a7cc48e3fe. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:56:58.347237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Getting quotas for user 687eef270165450a97b4d260b2724b3e and project e8f7f9f3112545e9b40d88a7cc48e3fe. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:56:58.360469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:56:58.362666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:56:58.410645 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5914e00-76e1-4abe-acce-7aa92cebff98 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690667 Sep 10 20:56:58.411307 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1209/2322] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:56:58.422577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7c122849-5794-4543-aef4-53ab49d5cc2b tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:58.441159 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7c122849-5794-4543-aef4-53ab49d5cc2b tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.028397 Sep 10 20:56:58.441745 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1210/2323] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 20:56:58 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:58.539498 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-94c5ae7f-a412-48b2-b287-e8e71cd6cef0 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6dbfd864-eec2-45ff-8cda-198fa4cca03e" status: 202 len: 0 microversion: 2.1 time: 0.314363 Sep 10 20:56:58.540094 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1114/2324] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:56:58 2022] DELETE /compute/v2.1/os-security-groups/6dbfd864-eec2-45ff-8cda-198fa4cca03e => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:56:58.548326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-165e5e30-16c2-4414-8c5d-7d051417017e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:58.549073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-165e5e30-16c2-4414-8c5d-7d051417017e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:58.557805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165e5e30-16c2-4414-8c5d-7d051417017e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:58.558562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165e5e30-16c2-4414-8c5d-7d051417017e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:58.559463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165e5e30-16c2-4414-8c5d-7d051417017e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:58.560326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165e5e30-16c2-4414-8c5d-7d051417017e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:58.560931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165e5e30-16c2-4414-8c5d-7d051417017e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:58.561661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-165e5e30-16c2-4414-8c5d-7d051417017e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:58.602358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1997304777", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:58.672820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:56:58.746477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-165e5e30-16c2-4414-8c5d-7d051417017e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:58.760778 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-165e5e30-16c2-4414-8c5d-7d051417017e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.214437 Sep 10 20:56:58.761794 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1115/2325] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:58 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:58.769638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-37c5b5ea-a9e7-42d6-b671-507c88550e7d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:58.770432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-37c5b5ea-a9e7-42d6-b671-507c88550e7d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:58.777071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37c5b5ea-a9e7-42d6-b671-507c88550e7d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:58.777915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37c5b5ea-a9e7-42d6-b671-507c88550e7d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:58.778419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37c5b5ea-a9e7-42d6-b671-507c88550e7d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:58.779193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37c5b5ea-a9e7-42d6-b671-507c88550e7d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:58.779718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37c5b5ea-a9e7-42d6-b671-507c88550e7d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:58.780215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37c5b5ea-a9e7-42d6-b671-507c88550e7d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:58.915808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:56:58.916352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:56:58.916932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:56:58.917358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:56:58.917776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:56:58.927690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:58.928184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:58.928628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:58.930193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:58.930669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:58.931400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:58.949719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Getting quotas for project f57a1c44d4684b2fa210973f062adbce. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:56:58.955127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Getting quotas for user bec33de4067d4b1bb6e4ad866ddf2d01 and project f57a1c44d4684b2fa210973f062adbce. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:56:58.976146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-37c5b5ea-a9e7-42d6-b671-507c88550e7d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:58.982875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:56:58.985139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:56:58.985415 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-37c5b5ea-a9e7-42d6-b671-507c88550e7d tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1322 microversion: 2.1 time: 0.221252 Sep 10 20:56:58.986122 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1116/2326] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:58 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:58.990640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-025ce59a-16ae-4fe5-b375-5ee6863959a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:58.991373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-025ce59a-16ae-4fe5-b375-5ee6863959a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:58.997574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:56:59.006940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-025ce59a-16ae-4fe5-b375-5ee6863959a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:59.008219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-025ce59a-16ae-4fe5-b375-5ee6863959a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:59.008737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-025ce59a-16ae-4fe5-b375-5ee6863959a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:59.009643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-025ce59a-16ae-4fe5-b375-5ee6863959a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:59.010142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-025ce59a-16ae-4fe5-b375-5ee6863959a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:59.010580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-025ce59a-16ae-4fe5-b375-5ee6863959a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:59.038783 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2229d1a6-4737-4835-81cc-5a90fdc2bdae tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595646 Sep 10 20:56:59.040082 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1211/2327] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:56:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:56:59.045251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a1a26b9f-00e1-45f4-bd86-d79a4cca5543 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.058854 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a1a26b9f-00e1-45f4-bd86-d79a4cca5543 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017373 Sep 10 20:56:59.059496 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1212/2328] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:59.069684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0c730ff-8b94-4d65-9822-381442d56550 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] Calling method '.version_select at 0x7f99494fb550>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.089313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-025ce59a-16ae-4fe5-b375-5ee6863959a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:59.098536 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-025ce59a-16ae-4fe5-b375-5ee6863959a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1212 microversion: 2.1 time: 0.111369 Sep 10 20:56:59.099539 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1117/2329] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:58 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:59.105045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.105672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:59.113169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:59.113972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:59.114430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:59.115150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:59.115609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:59.116203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:59.222388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:59.233307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:59.234930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:59.236064 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-67b1383e-c878-414a-a7bf-1f97461ddf46 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1335 microversion: 2.57 time: 0.135309 Sep 10 20:56:59.236621 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1118/2330] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1335 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:56:59.241463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f20f32a-ef71-48b3-ae36-045685d6583d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.242845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f20f32a-ef71-48b3-ae36-045685d6583d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:59.314205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3f20f32a-ef71-48b3-ae36-045685d6583d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:56:59.328294 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f20f32a-ef71-48b3-ae36-045685d6583d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1217 microversion: 2.1 time: 0.090611 Sep 10 20:56:59.329041 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1119/2331] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:59.333931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3c2e2c94-e684-424c-99e7-9cdd53b867a7 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.338776 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0c730ff-8b94-4d65-9822-381442d56550 tempest-SecurityGroupRulesTestJSON-421856000 tempest-SecurityGroupRulesTestJSON-421856000-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/13670947-c7c5-40da-b37d-8313371ef54b" status: 202 len: 0 microversion: 2.1 time: 0.278214 Sep 10 20:56:59.339669 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1213/2332] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:56:59 2022] DELETE /compute/v2.1/os-security-groups/13670947-c7c5-40da-b37d-8313371ef54b => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:56:59.388792 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3c2e2c94-e684-424c-99e7-9cdd53b867a7 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.058393 Sep 10 20:56:59.390211 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1120/2333] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:59.409698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7f2a0c59-2e5f-4838-a493-8feaba837770 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.419853 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7f2a0c59-2e5f-4838-a493-8feaba837770 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016932 Sep 10 20:56:59.432367 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1214/2334] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:59.438288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ddfe1213-d7e8-4a35-b15b-eb1ce66276df tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.475691 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ddfe1213-d7e8-4a35-b15b-eb1ce66276df tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.042761 Sep 10 20:56:59.480009 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1121/2335] 10.222.0.33 () {58 vars in 1144 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:59.495938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1534d515-7bf9-4849-99bc-45f07fda3356 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.514369 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1534d515-7bf9-4849-99bc-45f07fda3356 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024573 Sep 10 20:56:59.515335 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1215/2336] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:56:59.528951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e26ad462-dfec-48b1-aef3-124d1ceb2bac tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.555187 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e26ad462-dfec-48b1-aef3-124d1ceb2bac tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.030442 Sep 10 20:56:59.556319 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1122/2337] 10.222.0.33 () {58 vars in 1148 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:59.574048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4b64abfb-6abe-43a1-a44b-9c808233690f tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.590312 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4b64abfb-6abe-43a1-a44b-9c808233690f tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.022727 Sep 10 20:56:59.600208 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1216/2338] 10.222.0.33 () {58 vars in 1140 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:59.609040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c219c51-0348-4029-9510-261f4e6c9244 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.620429 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c219c51-0348-4029-9510-261f4e6c9244 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018876 Sep 10 20:56:59.621788 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1123/2339] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:59.634261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a44841ad-4d4c-4766-ac1b-a6b180a3e9e8 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.764412 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a44841ad-4d4c-4766-ac1b-a6b180a3e9e8 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.133676 Sep 10 20:56:59.765526 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1217/2340] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:59.788299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5bf652eb-fcdf-4556-afe8-181e167fc005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.790417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5bf652eb-fcdf-4556-afe8-181e167fc005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:56:59.791250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-adb37d29-be3e-4c78-8813-6b2056b89bd8 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.817649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bf652eb-fcdf-4556-afe8-181e167fc005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:59.819447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bf652eb-fcdf-4556-afe8-181e167fc005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:59.836830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bf652eb-fcdf-4556-afe8-181e167fc005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:59.837864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bf652eb-fcdf-4556-afe8-181e167fc005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:59.838579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bf652eb-fcdf-4556-afe8-181e167fc005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:59.839446 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-adb37d29-be3e-4c78-8813-6b2056b89bd8 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059952 Sep 10 20:56:59.840091 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1124/2341] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:56:59.843151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bf652eb-fcdf-4556-afe8-181e167fc005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:59.865560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a27f8bc1-25fd-4da8-ba5b-1cd719fb8726 req-a8bb433f-d0fa-4b94-b98b-14444880e4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7f8366-d0bc-4854-b822-a6775d0dc931", "name": "network-vif-unplugged", "status": "completed", "tag": "a59227ae-40ff-48e2-ad01-586a234173ca"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:56:59.877176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a27f8bc1-25fd-4da8-ba5b-1cd719fb8726 req-a8bb433f-d0fa-4b94-b98b-14444880e4d6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:56:59.878154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a27f8bc1-25fd-4da8-ba5b-1cd719fb8726 req-a8bb433f-d0fa-4b94-b98b-14444880e4d6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:56:59.878879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a27f8bc1-25fd-4da8-ba5b-1cd719fb8726 req-a8bb433f-d0fa-4b94-b98b-14444880e4d6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:56:59.896455 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a27f8bc1-25fd-4da8-ba5b-1cd719fb8726 req-a8bb433f-d0fa-4b94-b98b-14444880e4d6 service nova] Creating event network-vif-unplugged:a59227ae-40ff-48e2-ad01-586a234173ca for instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 on nch1-master-1 Sep 10 20:56:59.903817 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a27f8bc1-25fd-4da8-ba5b-1cd719fb8726 req-a8bb433f-d0fa-4b94-b98b-14444880e4d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050399 Sep 10 20:56:59.904734 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1125/2342] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:56:59.912418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-69f8f4a8-3d7e-45e4-985f-17cb5594b4d1 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:56:59.921059 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-69f8f4a8-3d7e-45e4-985f-17cb5594b4d1 tempest-FlavorsV2TestJSON-1775528849 tempest-FlavorsV2TestJSON-1775528849-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014775 Sep 10 20:56:59.922720 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1126/2343] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:00.014984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-473158cf-9cc2-4f84-bd71-ef024d6e1bc0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:00.016086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-473158cf-9cc2-4f84-bd71-ef024d6e1bc0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:00.021248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:00.029927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473158cf-9cc2-4f84-bd71-ef024d6e1bc0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.030850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473158cf-9cc2-4f84-bd71-ef024d6e1bc0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.031644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473158cf-9cc2-4f84-bd71-ef024d6e1bc0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.032555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473158cf-9cc2-4f84-bd71-ef024d6e1bc0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.033448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473158cf-9cc2-4f84-bd71-ef024d6e1bc0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.034347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-473158cf-9cc2-4f84-bd71-ef024d6e1bc0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.213070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5bf652eb-fcdf-4556-afe8-181e167fc005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:00.246897 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5bf652eb-fcdf-4556-afe8-181e167fc005 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.462430 Sep 10 20:57:00.247552 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1218/2344] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:56:59 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:00.253947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fcebccbd-8982-4609-ae74-5f3b2d5d3909 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:00.255033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fcebccbd-8982-4609-ae74-5f3b2d5d3909 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:00.264282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcebccbd-8982-4609-ae74-5f3b2d5d3909 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.264939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcebccbd-8982-4609-ae74-5f3b2d5d3909 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.265380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcebccbd-8982-4609-ae74-5f3b2d5d3909 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.266119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcebccbd-8982-4609-ae74-5f3b2d5d3909 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.266573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcebccbd-8982-4609-ae74-5f3b2d5d3909 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.266996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcebccbd-8982-4609-ae74-5f3b2d5d3909 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.396521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-473158cf-9cc2-4f84-bd71-ef024d6e1bc0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:00.422663 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-473158cf-9cc2-4f84-bd71-ef024d6e1bc0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1472 microversion: 2.1 time: 0.410871 Sep 10 20:57:00.425971 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1127/2345] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:00 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:00.443376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fcebccbd-8982-4609-ae74-5f3b2d5d3909 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:00.448777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:00.449819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:00.456537 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fcebccbd-8982-4609-ae74-5f3b2d5d3909 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1260 microversion: 2.1 time: 0.206924 Sep 10 20:57:00.459060 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1219/2346] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:00 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:00.470104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-06d22f3e-e900-470f-ba57-173654454de3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:00.471101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-06d22f3e-e900-470f-ba57-173654454de3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:00.475122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.475753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.476339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.477226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.478446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.479506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.487050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06d22f3e-e900-470f-ba57-173654454de3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.487792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06d22f3e-e900-470f-ba57-173654454de3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.488398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06d22f3e-e900-470f-ba57-173654454de3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.489311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06d22f3e-e900-470f-ba57-173654454de3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.491103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06d22f3e-e900-470f-ba57-173654454de3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.492256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06d22f3e-e900-470f-ba57-173654454de3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.582003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-06d22f3e-e900-470f-ba57-173654454de3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:00.591275 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-06d22f3e-e900-470f-ba57-173654454de3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1269 microversion: 2.1 time: 0.130775 Sep 10 20:57:00.593588 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1220/2347] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:00 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:00.800143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:00.811038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:00.812908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:00.814497 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-abe7bd9b-2ea7-4b18-b97d-b556d3b84f83 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1356 microversion: 2.57 time: 0.385421 Sep 10 20:57:00.815532 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1128/2348] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:00 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1356 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:00.820677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-41092cc4-1b75-4d6f-9ed8-dd027d1b532d req-578d2867-c8c2-47d2-95fd-fa153f4eb826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7f8366-d0bc-4854-b822-a6775d0dc931", "name": "network-vif-deleted", "tag": "a59227ae-40ff-48e2-ad01-586a234173ca"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:00.830501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-41092cc4-1b75-4d6f-9ed8-dd027d1b532d req-578d2867-c8c2-47d2-95fd-fa153f4eb826 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.831232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-41092cc4-1b75-4d6f-9ed8-dd027d1b532d req-578d2867-c8c2-47d2-95fd-fa153f4eb826 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.831849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-41092cc4-1b75-4d6f-9ed8-dd027d1b532d req-578d2867-c8c2-47d2-95fd-fa153f4eb826 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.844232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a58d96ea-c9e9-4991-8cdf-dcfb3ae05362 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:00.845020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a58d96ea-c9e9-4991-8cdf-dcfb3ae05362 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] [instance: 9f2d674a-7c7d-42bf-bb84-49d03faae8d7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:00.847486 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-41092cc4-1b75-4d6f-9ed8-dd027d1b532d req-578d2867-c8c2-47d2-95fd-fa153f4eb826 service nova] Creating event network-vif-deleted:a59227ae-40ff-48e2-ad01-586a234173ca for instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 on nch1-master-1 Sep 10 20:57:00.852560 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-41092cc4-1b75-4d6f-9ed8-dd027d1b532d req-578d2867-c8c2-47d2-95fd-fa153f4eb826 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035629 Sep 10 20:57:00.853261 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1129/2349] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:00.854333 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-a58d96ea-c9e9-4991-8cdf-dcfb3ae05362 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] HTTP exception thrown: Instance 9f2d674a-7c7d-42bf-bb84-49d03faae8d7 could not be found. Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a58d96ea-c9e9-4991-8cdf-dcfb3ae05362 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Request method failure captured: Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/9f2d674a-7c7d-42bf-bb84-49d03faae8d7/action HTTP/1.1 Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 15 Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoGXhuFxx_R6LRJzBeoi2UEndRTM1IOhDHqWTbfj77xuMVtMWqgKSYBCdc8_mK9ilvOFT-hJMGI10pBPs1gr4k5fN2fHNNwamuZahnmP-SCQZd4NNiNsFl7ylDgF1VOnY2S2r7ZFUU-IUNQc44_rD41ZjBYSO5E_r7xg1ZiyP8yMio Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 275fe06a58ac4e0994c87079255a7faa Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/275fe06a58ac4e0994c87079255a7faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/275fe06a58ac4e0994c87079255a7faa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_275fe06a58ac4e0994c87079255a7faa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/275fe06a58ac4e0994c87079255a7faa"}]}] Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 275fe06a58ac4e0994c87079255a7faa Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdminNegativeTestJSON-1892842719-project-admin Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 860c77c7bfb14a69a9a1ea46446621c7 Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1892842719-project-admin Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: {"migrate": {}} Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 9f2d674a-7c7d-42bf-bb84-49d03faae8d7 could not be found. Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '9f2d674a-7c7d-42bf-bb84-49d03faae8d7', 'body': {'migrate': {}}} Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2d674a-7c7d-42bf-bb84-49d03faae8d7 could not be found. Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2d674a-7c7d-42bf-bb84-49d03faae8d7 could not be found. Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:00.857329 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:00.861474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:00.861474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:00.861474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:57:00.861474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:57:00.861474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2d674a-7c7d-42bf-bb84-49d03faae8d7 could not be found. Sep 10 20:57:00.861474 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:00.863749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:00.863749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:00.864993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a58d96ea-c9e9-4991-8cdf-dcfb3ae05362 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Returning 404 to user: Instance 9f2d674a-7c7d-42bf-bb84-49d03faae8d7 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:57:00.866619 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a58d96ea-c9e9-4991-8cdf-dcfb3ae05362 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9f2d674a-7c7d-42bf-bb84-49d03faae8d7/action" status: 404 len: 111 microversion: 2.1 time: 0.271426 Sep 10 20:57:00.867996 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1221/2350] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:00 2022] POST /compute/v2.1/servers/9f2d674a-7c7d-42bf-bb84-49d03faae8d7/action => generated 111 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:57:00.871336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.871336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.871336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.871624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:00.871924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:00.872359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:00.948486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:00.965595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:57:00.966277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:57:00.967140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:57:00.967732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:57:00.968329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:57:01.003992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-698914770", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:01.059102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:01.066673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.067362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.067779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:57:01.067900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.068872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.069053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.069502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.117671 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0d69c74e-a548-4c35-85ed-8790bda08735 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "POST /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7/action" status: 202 len: 1137 microversion: 2.57 time: 0.250898 Sep 10 20:57:01.121570 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1130/2351] 10.222.0.33 () {62 vars in 1320 bytes} [Sat Sep 10 20:57:00 2022] POST /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7/action => generated 1137 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 20:57:01.143227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:01.144025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:01.150449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.151167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.151577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.152281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.152824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.153151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.295625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:01.310687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:01.313334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:01.317182 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f9dd976-8d1a-4ff3-827c-0785be5c6e8f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.177906 Sep 10 20:57:01.338993 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1131/2352] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:01 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:01.344111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6f6b1ccb-74a9-42eb-822f-49a47d25dfad tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:01.344722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6f6b1ccb-74a9-42eb-822f-49a47d25dfad tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:01.355514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:57:01.356147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:57:01.356779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:57:01.357400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:57:01.358050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:57:01.367062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f6b1ccb-74a9-42eb-822f-49a47d25dfad tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.367940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f6b1ccb-74a9-42eb-822f-49a47d25dfad tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.368580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f6b1ccb-74a9-42eb-822f-49a47d25dfad tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.369793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f6b1ccb-74a9-42eb-822f-49a47d25dfad tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.371602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f6b1ccb-74a9-42eb-822f-49a47d25dfad tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.372264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f6b1ccb-74a9-42eb-822f-49a47d25dfad tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.373724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.378464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.379599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.380886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.381895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.383160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.431831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Getting quotas for project a9327061a3ba468f83e978315b6ed753. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:57:01.439115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Getting quotas for user 87df880447e941f0b336470ac8aba19f and project a9327061a3ba468f83e978315b6ed753. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:57:01.453691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:57:01.456058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:57:01.562617 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-28680dc8-8f04-4939-87e9-5229842c4d60 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562919 Sep 10 20:57:01.564359 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1222/2353] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:57:01.571244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21b760eb-9231-4ff1-9065-a486fc5a6a42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:01.572098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21b760eb-9231-4ff1-9065-a486fc5a6a42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:01.594999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21b760eb-9231-4ff1-9065-a486fc5a6a42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.606391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21b760eb-9231-4ff1-9065-a486fc5a6a42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.606645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21b760eb-9231-4ff1-9065-a486fc5a6a42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.607942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21b760eb-9231-4ff1-9065-a486fc5a6a42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.608442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21b760eb-9231-4ff1-9065-a486fc5a6a42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.609393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21b760eb-9231-4ff1-9065-a486fc5a6a42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.745498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6f6b1ccb-74a9-42eb-822f-49a47d25dfad tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:01.764072 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6f6b1ccb-74a9-42eb-822f-49a47d25dfad tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.423950 Sep 10 20:57:01.778605 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1132/2354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:01 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:01.791873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6edbf34-2db2-4bf9-b402-3b722319f251 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:01.793664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6edbf34-2db2-4bf9-b402-3b722319f251 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:01.813470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-21b760eb-9231-4ff1-9065-a486fc5a6a42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:01.826406 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21b760eb-9231-4ff1-9065-a486fc5a6a42 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1266 microversion: 2.1 time: 0.259237 Sep 10 20:57:01.853731 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1223/2355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:01 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:01.860025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42656147-2512-4ebb-b4a6-0c5c7d26194b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:01.861434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-42656147-2512-4ebb-b4a6-0c5c7d26194b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:01.872551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42656147-2512-4ebb-b4a6-0c5c7d26194b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.873301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42656147-2512-4ebb-b4a6-0c5c7d26194b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.874042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42656147-2512-4ebb-b4a6-0c5c7d26194b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:01.888551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42656147-2512-4ebb-b4a6-0c5c7d26194b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:01.890568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42656147-2512-4ebb-b4a6-0c5c7d26194b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:01.892083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42656147-2512-4ebb-b4a6-0c5c7d26194b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:02.049913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-42656147-2512-4ebb-b4a6-0c5c7d26194b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:02.058141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c6edbf34-2db2-4bf9-b402-3b722319f251 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:02.067304 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-42656147-2512-4ebb-b4a6-0c5c7d26194b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1275 microversion: 2.1 time: 0.210851 Sep 10 20:57:02.081245 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6edbf34-2db2-4bf9-b402-3b722319f251 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1221 microversion: 2.1 time: 0.301456 Sep 10 20:57:02.084284 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1133/2356] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:01 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1221 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:02.087467 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1224/2357] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:01 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:02.361154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:02.361782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:02.373869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:02.374373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:02.374809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:02.388953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:02.389496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:02.391583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:02.793329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-46c5c6a3-1203-45fe-8452-753e52223ea0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:02.794756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-46c5c6a3-1203-45fe-8452-753e52223ea0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:02.812345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46c5c6a3-1203-45fe-8452-753e52223ea0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:02.813497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46c5c6a3-1203-45fe-8452-753e52223ea0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:02.813992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46c5c6a3-1203-45fe-8452-753e52223ea0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:02.815094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46c5c6a3-1203-45fe-8452-753e52223ea0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:02.817360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46c5c6a3-1203-45fe-8452-753e52223ea0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:02.817965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46c5c6a3-1203-45fe-8452-753e52223ea0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:02.870424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:02.888549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:02.891288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:02.892974 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fd39e192-ac95-4a0f-a700-e7a93564f55a tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.542346 Sep 10 20:57:02.893793 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1134/2358] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:02 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:02.923784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cae93091-67f1-442a-9c8b-3b7f8f0efe39 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:02.924676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cae93091-67f1-442a-9c8b-3b7f8f0efe39 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:02.932246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cae93091-67f1-442a-9c8b-3b7f8f0efe39 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:02.932987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cae93091-67f1-442a-9c8b-3b7f8f0efe39 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:02.933778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cae93091-67f1-442a-9c8b-3b7f8f0efe39 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:02.935212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cae93091-67f1-442a-9c8b-3b7f8f0efe39 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:02.938477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cae93091-67f1-442a-9c8b-3b7f8f0efe39 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:02.939285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cae93091-67f1-442a-9c8b-3b7f8f0efe39 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:03.318832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-46c5c6a3-1203-45fe-8452-753e52223ea0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:03.332268 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-46c5c6a3-1203-45fe-8452-753e52223ea0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.543906 Sep 10 20:57:03.333290 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1225/2359] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:02 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:03.347833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c991f6e7-151e-4dae-87fb-ec543798c865 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:03.348490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c991f6e7-151e-4dae-87fb-ec543798c865 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:03.365273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c991f6e7-151e-4dae-87fb-ec543798c865 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:03.365784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c991f6e7-151e-4dae-87fb-ec543798c865 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:03.366258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c991f6e7-151e-4dae-87fb-ec543798c865 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:03.367038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c991f6e7-151e-4dae-87fb-ec543798c865 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:03.367536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c991f6e7-151e-4dae-87fb-ec543798c865 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:03.367970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c991f6e7-151e-4dae-87fb-ec543798c865 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:03.530990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cae93091-67f1-442a-9c8b-3b7f8f0efe39 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:03.590649 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cae93091-67f1-442a-9c8b-3b7f8f0efe39 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.673716 Sep 10 20:57:03.593955 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1135/2360] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:02 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:03.611021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6d6ebcc8-4a16-4f13-8278-9236f35f4429 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:03.612066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6d6ebcc8-4a16-4f13-8278-9236f35f4429 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:03.631516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d6ebcc8-4a16-4f13-8278-9236f35f4429 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:03.631516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d6ebcc8-4a16-4f13-8278-9236f35f4429 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:03.631516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d6ebcc8-4a16-4f13-8278-9236f35f4429 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:03.632782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d6ebcc8-4a16-4f13-8278-9236f35f4429 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:03.634419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d6ebcc8-4a16-4f13-8278-9236f35f4429 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:03.636455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d6ebcc8-4a16-4f13-8278-9236f35f4429 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:03.772265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c991f6e7-151e-4dae-87fb-ec543798c865 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:03.783093 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c991f6e7-151e-4dae-87fb-ec543798c865 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.448526 Sep 10 20:57:03.784585 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1226/2361] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:03 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:03.795654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6d6ebcc8-4a16-4f13-8278-9236f35f4429 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:03.811025 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6d6ebcc8-4a16-4f13-8278-9236f35f4429 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1291 microversion: 2.1 time: 0.214765 Sep 10 20:57:03.811883 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1136/2362] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:03 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1291 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:03.813506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5850c898-be99-4cf3-8458-912de1c63bf5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "584966b6-2b79-498b-a36c-920cb089d0f8"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:03.816048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5850c898-be99-4cf3-8458-912de1c63bf5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:03.824365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5850c898-be99-4cf3-8458-912de1c63bf5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:03.824863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5850c898-be99-4cf3-8458-912de1c63bf5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:03.825542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5850c898-be99-4cf3-8458-912de1c63bf5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:03.826495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5850c898-be99-4cf3-8458-912de1c63bf5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:03.827142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5850c898-be99-4cf3-8458-912de1c63bf5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:03.827847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5850c898-be99-4cf3-8458-912de1c63bf5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:03.928774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:03.930734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:03.939715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:03.941013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:03.941970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:03.942954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:03.943988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:03.944630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:04.081913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:04.104392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:04.106394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:04.108215 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-26bbb695-31bc-4fc1-9c98-74cb4352267f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.185318 Sep 10 20:57:04.125728 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1137/2363] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:03 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:04.295000 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5850c898-be99-4cf3-8458-912de1c63bf5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508812 Sep 10 20:57:04.311263 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1227/2364] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 20:57:03 2022] POST /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:04.382870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b4be677-d605-4a79-85ca-aba81adec8f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:04.383567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b4be677-d605-4a79-85ca-aba81adec8f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:04.404736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b4be677-d605-4a79-85ca-aba81adec8f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:04.408699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b4be677-d605-4a79-85ca-aba81adec8f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:04.410501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b4be677-d605-4a79-85ca-aba81adec8f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:04.412684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b4be677-d605-4a79-85ca-aba81adec8f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:04.416023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b4be677-d605-4a79-85ca-aba81adec8f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:04.419614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b4be677-d605-4a79-85ca-aba81adec8f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:04.628343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f4b1c27-f08c-4512-8404-d3e64a1353fa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:04.632298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2f4b1c27-f08c-4512-8404-d3e64a1353fa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:04.648261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f4b1c27-f08c-4512-8404-d3e64a1353fa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:04.649398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f4b1c27-f08c-4512-8404-d3e64a1353fa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:04.654583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f4b1c27-f08c-4512-8404-d3e64a1353fa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:04.658937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f4b1c27-f08c-4512-8404-d3e64a1353fa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:04.662809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f4b1c27-f08c-4512-8404-d3e64a1353fa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:04.665620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f4b1c27-f08c-4512-8404-d3e64a1353fa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:04.949122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b4be677-d605-4a79-85ca-aba81adec8f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:04.965460 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6b4be677-d605-4a79-85ca-aba81adec8f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1514 microversion: 2.1 time: 0.604410 Sep 10 20:57:04.966099 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1138/2365] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:04 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1514 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:04.984122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cb604d5f-c050-4a90-8504-59f57fb0c22d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:04.984744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cb604d5f-c050-4a90-8504-59f57fb0c22d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:04.991145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb604d5f-c050-4a90-8504-59f57fb0c22d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:04.992247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb604d5f-c050-4a90-8504-59f57fb0c22d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:04.992861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb604d5f-c050-4a90-8504-59f57fb0c22d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:04.993598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb604d5f-c050-4a90-8504-59f57fb0c22d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:04.994098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb604d5f-c050-4a90-8504-59f57fb0c22d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:04.994529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb604d5f-c050-4a90-8504-59f57fb0c22d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:05.006726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2f4b1c27-f08c-4512-8404-d3e64a1353fa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:05.021419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f4b1c27-f08c-4512-8404-d3e64a1353fa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.403548 Sep 10 20:57:05.039265 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1228/2366] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:04 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:05.044418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d2726d70-3132-4677-b78a-864e0963d9af tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:05.045293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d2726d70-3132-4677-b78a-864e0963d9af tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:05.059890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2726d70-3132-4677-b78a-864e0963d9af tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:05.060695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2726d70-3132-4677-b78a-864e0963d9af tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:05.061435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2726d70-3132-4677-b78a-864e0963d9af tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:05.062418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2726d70-3132-4677-b78a-864e0963d9af tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:05.064342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2726d70-3132-4677-b78a-864e0963d9af tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:05.065242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2726d70-3132-4677-b78a-864e0963d9af tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:05.168778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d2726d70-3132-4677-b78a-864e0963d9af tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:05.177418 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d2726d70-3132-4677-b78a-864e0963d9af tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1279 microversion: 2.1 time: 0.136788 Sep 10 20:57:05.178865 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1229/2367] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:05 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1279 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:05.186801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a59fa985-d1c2-49a1-abaa-4fd22f5c254a req-bce3c897-a689-44f9-a752-4bc53d00e69d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f096440-3a63-40a0-bd51-42ab451bef64", "tag": "6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:05.202447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a59fa985-d1c2-49a1-abaa-4fd22f5c254a req-bce3c897-a689-44f9-a752-4bc53d00e69d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:05.202944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a59fa985-d1c2-49a1-abaa-4fd22f5c254a req-bce3c897-a689-44f9-a752-4bc53d00e69d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:05.203381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a59fa985-d1c2-49a1-abaa-4fd22f5c254a req-bce3c897-a689-44f9-a752-4bc53d00e69d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:05.227247 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a59fa985-d1c2-49a1-abaa-4fd22f5c254a req-bce3c897-a689-44f9-a752-4bc53d00e69d service nova] Creating event network-changed:6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2 for instance 4f096440-3a63-40a0-bd51-42ab451bef64 on nch1-master-1 Sep 10 20:57:05.236509 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a59fa985-d1c2-49a1-abaa-4fd22f5c254a req-bce3c897-a689-44f9-a752-4bc53d00e69d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056241 Sep 10 20:57:05.239632 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1230/2368] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:05.248483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:05.249988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:05.259225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:05.260773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:05.261638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:05.262769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:05.264118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:05.268453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:05.391939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:05.405625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:05.407537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:05.409120 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-76344dbc-2bbf-411e-a2c6-e75753265df2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.167769 Sep 10 20:57:05.413082 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1231/2369] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:05 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:05.458041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cb604d5f-c050-4a90-8504-59f57fb0c22d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:05.474748 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cb604d5f-c050-4a90-8504-59f57fb0c22d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.507391 Sep 10 20:57:05.475360 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1139/2370] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:04 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:05.997009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81fc8c14-9917-4606-8a9f-8a4c8efe3cff tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:05.997647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81fc8c14-9917-4606-8a9f-8a4c8efe3cff tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:06.011059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fc8c14-9917-4606-8a9f-8a4c8efe3cff tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:06.012186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fc8c14-9917-4606-8a9f-8a4c8efe3cff tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:06.018125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fc8c14-9917-4606-8a9f-8a4c8efe3cff tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:06.019334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fc8c14-9917-4606-8a9f-8a4c8efe3cff tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:06.026506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fc8c14-9917-4606-8a9f-8a4c8efe3cff tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:06.027232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81fc8c14-9917-4606-8a9f-8a4c8efe3cff tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:06.033040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-cfd32784-d849-4582-9963-41604613a672 req-2a2bdc2d-abcb-4fb2-9379-dfa40f799028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f35f1515-600f-4bea-850a-28ce09db77fb", "tag": "ac0ed0f0-5842-4c84-a7f5-f1d58d027926"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:06.066789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cfd32784-d849-4582-9963-41604613a672 req-2a2bdc2d-abcb-4fb2-9379-dfa40f799028 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:06.068219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cfd32784-d849-4582-9963-41604613a672 req-2a2bdc2d-abcb-4fb2-9379-dfa40f799028 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:06.070494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cfd32784-d849-4582-9963-41604613a672 req-2a2bdc2d-abcb-4fb2-9379-dfa40f799028 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:06.111203 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cfd32784-d849-4582-9963-41604613a672 req-2a2bdc2d-abcb-4fb2-9379-dfa40f799028 service nova] Creating event network-changed:ac0ed0f0-5842-4c84-a7f5-f1d58d027926 for instance f35f1515-600f-4bea-850a-28ce09db77fb on nch1-master-1 Sep 10 20:57:06.140860 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-cfd32784-d849-4582-9963-41604613a672 req-2a2bdc2d-abcb-4fb2-9379-dfa40f799028 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109408 Sep 10 20:57:06.142568 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1140/2371] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:57:06.172132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80557c38-ee07-4fcc-ab05-3e8fff1bdae2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:06.172951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-80557c38-ee07-4fcc-ab05-3e8fff1bdae2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:06.182592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80557c38-ee07-4fcc-ab05-3e8fff1bdae2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:06.183433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80557c38-ee07-4fcc-ab05-3e8fff1bdae2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:06.184128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80557c38-ee07-4fcc-ab05-3e8fff1bdae2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:06.187202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80557c38-ee07-4fcc-ab05-3e8fff1bdae2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:06.187980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80557c38-ee07-4fcc-ab05-3e8fff1bdae2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:06.188643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80557c38-ee07-4fcc-ab05-3e8fff1bdae2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:06.922667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-81fc8c14-9917-4606-8a9f-8a4c8efe3cff tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:06.935834 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81fc8c14-9917-4606-8a9f-8a4c8efe3cff tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1532 microversion: 2.1 time: 0.941818 Sep 10 20:57:06.940939 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1232/2372] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:05 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1532 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:06.947078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-243657cd-a812-462a-9403-9d360431cf06 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:06.950087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-243657cd-a812-462a-9403-9d360431cf06 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:06.961249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-243657cd-a812-462a-9403-9d360431cf06 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:06.962191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-243657cd-a812-462a-9403-9d360431cf06 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:06.962826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-243657cd-a812-462a-9403-9d360431cf06 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:06.963857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-243657cd-a812-462a-9403-9d360431cf06 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:06.964486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-243657cd-a812-462a-9403-9d360431cf06 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:06.964931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-243657cd-a812-462a-9403-9d360431cf06 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:07.200529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-243657cd-a812-462a-9403-9d360431cf06 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:07.208849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:07.215424 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-243657cd-a812-462a-9403-9d360431cf06 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1321 microversion: 2.1 time: 0.272219 Sep 10 20:57:07.238356 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1233/2373] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:06 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:07.245710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:07.247038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:07.269008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:07.270052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:07.270901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:07.271840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:07.273544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:07.274274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:07.329596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-80557c38-ee07-4fcc-ab05-3e8fff1bdae2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:07.358364 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-80557c38-ee07-4fcc-ab05-3e8fff1bdae2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 1.209894 Sep 10 20:57:07.359413 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1141/2374] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:06 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:07.368912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e830a0f4-3fd7-4226-982f-ff1bed292968 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:07.370690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e830a0f4-3fd7-4226-982f-ff1bed292968 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:07.384054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e830a0f4-3fd7-4226-982f-ff1bed292968 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:07.385204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e830a0f4-3fd7-4226-982f-ff1bed292968 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:07.386227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e830a0f4-3fd7-4226-982f-ff1bed292968 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:07.388483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e830a0f4-3fd7-4226-982f-ff1bed292968 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:07.389573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e830a0f4-3fd7-4226-982f-ff1bed292968 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:07.393662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e830a0f4-3fd7-4226-982f-ff1bed292968 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:07.413041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:07.430699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:07.433816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:07.436968 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cc9dd15b-2f04-4d11-b32b-6b57b20562ad tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.195466 Sep 10 20:57:07.449516 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1234/2375] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:07 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:07.856258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e830a0f4-3fd7-4226-982f-ff1bed292968 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:07.867173 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e830a0f4-3fd7-4226-982f-ff1bed292968 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.505255 Sep 10 20:57:07.872819 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1142/2376] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:07 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:07.964895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21f6bda7-bab3-42e4-b2d2-12cf575f9f42 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:07.965747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21f6bda7-bab3-42e4-b2d2-12cf575f9f42 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:07.975320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21f6bda7-bab3-42e4-b2d2-12cf575f9f42 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:07.982172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21f6bda7-bab3-42e4-b2d2-12cf575f9f42 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:07.982830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21f6bda7-bab3-42e4-b2d2-12cf575f9f42 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:07.983586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21f6bda7-bab3-42e4-b2d2-12cf575f9f42 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:07.983931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21f6bda7-bab3-42e4-b2d2-12cf575f9f42 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:07.984363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21f6bda7-bab3-42e4-b2d2-12cf575f9f42 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:08.249195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-04e969e9-0389-4c10-94fc-f7384dab29a9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:08.249773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-04e969e9-0389-4c10-94fc-f7384dab29a9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:08.264563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e969e9-0389-4c10-94fc-f7384dab29a9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:08.266476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e969e9-0389-4c10-94fc-f7384dab29a9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:08.268956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e969e9-0389-4c10-94fc-f7384dab29a9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:08.272952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e969e9-0389-4c10-94fc-f7384dab29a9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:08.273767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e969e9-0389-4c10-94fc-f7384dab29a9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:08.275451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04e969e9-0389-4c10-94fc-f7384dab29a9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:08.290845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-21f6bda7-bab3-42e4-b2d2-12cf575f9f42 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:08.306579 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21f6bda7-bab3-42e4-b2d2-12cf575f9f42 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1520 microversion: 2.1 time: 0.345722 Sep 10 20:57:08.310403 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1235/2377] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:07 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:08.387386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-129f9282-f58f-477e-af67-e71052c53949 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:08.388004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-129f9282-f58f-477e-af67-e71052c53949 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:08.400579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-129f9282-f58f-477e-af67-e71052c53949 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:08.401088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-129f9282-f58f-477e-af67-e71052c53949 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:08.401536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-129f9282-f58f-477e-af67-e71052c53949 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:08.402291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-129f9282-f58f-477e-af67-e71052c53949 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:08.402758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-129f9282-f58f-477e-af67-e71052c53949 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:08.403187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-129f9282-f58f-477e-af67-e71052c53949 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:08.659410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-04e969e9-0389-4c10-94fc-f7384dab29a9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:08.672563 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-04e969e9-0389-4c10-94fc-f7384dab29a9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1321 microversion: 2.1 time: 0.432042 Sep 10 20:57:08.677375 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1143/2378] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:08 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:08.690459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:08.694391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:08.706415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-129f9282-f58f-477e-af67-e71052c53949 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:08.710344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:08.712507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:08.717932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:08.718637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:08.719037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:08.719583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:08.725043 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-129f9282-f58f-477e-af67-e71052c53949 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.341410 Sep 10 20:57:08.725911 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1236/2379] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:08 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:08.892620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a507856b-27b5-4ffe-b783-5e85eee95e3a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:08.893427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a507856b-27b5-4ffe-b783-5e85eee95e3a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:08.903483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a507856b-27b5-4ffe-b783-5e85eee95e3a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:08.905509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a507856b-27b5-4ffe-b783-5e85eee95e3a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:08.906170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a507856b-27b5-4ffe-b783-5e85eee95e3a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:08.907622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a507856b-27b5-4ffe-b783-5e85eee95e3a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:08.908581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a507856b-27b5-4ffe-b783-5e85eee95e3a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:08.911082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a507856b-27b5-4ffe-b783-5e85eee95e3a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:09.221467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:09.243038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:09.244915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:09.251260 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-19aaacec-f2e6-4258-9e97-ccda3197afa0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.572319 Sep 10 20:57:09.254211 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1144/2380] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:08 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:09.265634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d08aa8ec-af43-4228-835b-cd730358015c req-f49a5107-abc2-45f4-bf6e-f405a368882d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e202f7e-4e8a-49a1-a144-5754c6a2c005", "name": "network-vif-unplugged", "status": "completed", "tag": "f9967362-03f6-4720-8b3e-3443719720ec"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:09.294769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d08aa8ec-af43-4228-835b-cd730358015c req-f49a5107-abc2-45f4-bf6e-f405a368882d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:09.295154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d08aa8ec-af43-4228-835b-cd730358015c req-f49a5107-abc2-45f4-bf6e-f405a368882d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:09.296803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d08aa8ec-af43-4228-835b-cd730358015c req-f49a5107-abc2-45f4-bf6e-f405a368882d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:09.317424 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d08aa8ec-af43-4228-835b-cd730358015c req-f49a5107-abc2-45f4-bf6e-f405a368882d service nova] Creating event network-vif-unplugged:f9967362-03f6-4720-8b3e-3443719720ec for instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 on nch1-master-1 Sep 10 20:57:09.323919 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d08aa8ec-af43-4228-835b-cd730358015c req-f49a5107-abc2-45f4-bf6e-f405a368882d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063676 Sep 10 20:57:09.325039 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1145/2381] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:09.334341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a290a6c4-a1e6-4edf-ba67-982c4ff8869e req-0296e09b-48d1-4422-acdb-65571c5a8a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17cecce-d3c1-4b96-9799-1d187c722fc7", "tag": "24d42610-30a3-4abb-af96-a3994d86cc82"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:09.346651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a290a6c4-a1e6-4edf-ba67-982c4ff8869e req-0296e09b-48d1-4422-acdb-65571c5a8a67 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:09.347677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a290a6c4-a1e6-4edf-ba67-982c4ff8869e req-0296e09b-48d1-4422-acdb-65571c5a8a67 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:09.348291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a290a6c4-a1e6-4edf-ba67-982c4ff8869e req-0296e09b-48d1-4422-acdb-65571c5a8a67 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:09.361471 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a290a6c4-a1e6-4edf-ba67-982c4ff8869e req-0296e09b-48d1-4422-acdb-65571c5a8a67 service nova] Creating event network-changed:24d42610-30a3-4abb-af96-a3994d86cc82 for instance a17cecce-d3c1-4b96-9799-1d187c722fc7 on nch2-master-1 Sep 10 20:57:09.376280 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a290a6c4-a1e6-4edf-ba67-982c4ff8869e req-0296e09b-48d1-4422-acdb-65571c5a8a67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045968 Sep 10 20:57:09.377047 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1146/2382] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:09.384728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ffde5276-d2e5-4d73-903d-89b9b2d63c35 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:09.385713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ffde5276-d2e5-4d73-903d-89b9b2d63c35 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:09.393143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffde5276-d2e5-4d73-903d-89b9b2d63c35 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:09.393794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffde5276-d2e5-4d73-903d-89b9b2d63c35 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:09.394929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffde5276-d2e5-4d73-903d-89b9b2d63c35 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:09.395934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffde5276-d2e5-4d73-903d-89b9b2d63c35 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:09.396537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffde5276-d2e5-4d73-903d-89b9b2d63c35 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:09.397121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffde5276-d2e5-4d73-903d-89b9b2d63c35 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:09.602305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a507856b-27b5-4ffe-b783-5e85eee95e3a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:09.619714 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a507856b-27b5-4ffe-b783-5e85eee95e3a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.729116 Sep 10 20:57:09.620842 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1237/2383] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:08 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:09.704060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-669ae171-a256-4d7e-aa3d-009ff73ea4b5 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:09.705184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-669ae171-a256-4d7e-aa3d-009ff73ea4b5 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:09.722273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-669ae171-a256-4d7e-aa3d-009ff73ea4b5 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:09.724154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-669ae171-a256-4d7e-aa3d-009ff73ea4b5 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:09.724836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-669ae171-a256-4d7e-aa3d-009ff73ea4b5 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:09.727413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-669ae171-a256-4d7e-aa3d-009ff73ea4b5 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:09.728771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-669ae171-a256-4d7e-aa3d-009ff73ea4b5 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:09.730820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-669ae171-a256-4d7e-aa3d-009ff73ea4b5 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:10.047121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ffde5276-d2e5-4d73-903d-89b9b2d63c35 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:10.056350 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ffde5276-d2e5-4d73-903d-89b9b2d63c35 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1520 microversion: 2.1 time: 0.678150 Sep 10 20:57:10.070564 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1147/2384] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:09 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1520 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:10.078743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-00caa25b-8514-428e-ad1a-545d245285c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:10.079697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-00caa25b-8514-428e-ad1a-545d245285c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:10.086803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00caa25b-8514-428e-ad1a-545d245285c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:10.087605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00caa25b-8514-428e-ad1a-545d245285c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:10.088282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00caa25b-8514-428e-ad1a-545d245285c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:10.089203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00caa25b-8514-428e-ad1a-545d245285c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:10.089887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00caa25b-8514-428e-ad1a-545d245285c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:10.090661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00caa25b-8514-428e-ad1a-545d245285c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:10.108495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:10.148289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-669ae171-a256-4d7e-aa3d-009ff73ea4b5 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:10.160878 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-669ae171-a256-4d7e-aa3d-009ff73ea4b5 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1321 microversion: 2.1 time: 0.460930 Sep 10 20:57:10.161491 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1238/2385] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:09 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:10.287846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:10.289104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:10.299955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:10.300819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:10.302188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:10.303431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:10.305006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:10.305741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:10.347844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-00caa25b-8514-428e-ad1a-545d245285c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:10.361703 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-00caa25b-8514-428e-ad1a-545d245285c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.289541 Sep 10 20:57:10.372365 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1148/2386] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:10 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:10.463699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:10.481278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:10.483132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:10.484689 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bbd8bd4b-1dc9-4917-802e-f3a646a95ff2 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.203639 Sep 10 20:57:10.499117 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1239/2387] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:10 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:57:10.663378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7dc6568a-305b-45e7-8b15-1ffe86b45b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:10.664819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7dc6568a-305b-45e7-8b15-1ffe86b45b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:10.704191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc6568a-305b-45e7-8b15-1ffe86b45b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:10.704738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc6568a-305b-45e7-8b15-1ffe86b45b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:10.705175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc6568a-305b-45e7-8b15-1ffe86b45b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:10.718377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc6568a-305b-45e7-8b15-1ffe86b45b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:10.723562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc6568a-305b-45e7-8b15-1ffe86b45b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:10.736028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7dc6568a-305b-45e7-8b15-1ffe86b45b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.092039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-848b0df1-2af0-4c63-84b8-ad3c9a6f3f72 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:11.092566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-848b0df1-2af0-4c63-84b8-ad3c9a6f3f72 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:11.102845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-848b0df1-2af0-4c63-84b8-ad3c9a6f3f72 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.103504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-848b0df1-2af0-4c63-84b8-ad3c9a6f3f72 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.103801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-848b0df1-2af0-4c63-84b8-ad3c9a6f3f72 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.104520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-848b0df1-2af0-4c63-84b8-ad3c9a6f3f72 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.105716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-848b0df1-2af0-4c63-84b8-ad3c9a6f3f72 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.106433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-848b0df1-2af0-4c63-84b8-ad3c9a6f3f72 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.118430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7dc6568a-305b-45e7-8b15-1ffe86b45b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:11.136740 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7dc6568a-305b-45e7-8b15-1ffe86b45b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.491129 Sep 10 20:57:11.137710 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1149/2388] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:10 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:11.184894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-510b9709-b722-4a0f-9b85-b6801128bab3 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:11.185608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-510b9709-b722-4a0f-9b85-b6801128bab3 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:11.194275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-510b9709-b722-4a0f-9b85-b6801128bab3 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.195592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-510b9709-b722-4a0f-9b85-b6801128bab3 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.196230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-510b9709-b722-4a0f-9b85-b6801128bab3 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.197145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-510b9709-b722-4a0f-9b85-b6801128bab3 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.197792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-510b9709-b722-4a0f-9b85-b6801128bab3 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.198445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-510b9709-b722-4a0f-9b85-b6801128bab3 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.384434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-510b9709-b722-4a0f-9b85-b6801128bab3 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:11.394208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=26 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:11.397465 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-510b9709-b722-4a0f-9b85-b6801128bab3 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1321 microversion: 2.1 time: 0.217661 Sep 10 20:57:11.398595 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1150/2389] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:11 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:11.406073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4961c482-1476-42d7-8ddd-b7b86e920c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:11.408838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4961c482-1476-42d7-8ddd-b7b86e920c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:11.417783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4961c482-1476-42d7-8ddd-b7b86e920c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.419865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4961c482-1476-42d7-8ddd-b7b86e920c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.420661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4961c482-1476-42d7-8ddd-b7b86e920c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.422059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4961c482-1476-42d7-8ddd-b7b86e920c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.422749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4961c482-1476-42d7-8ddd-b7b86e920c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.423395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4961c482-1476-42d7-8ddd-b7b86e920c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.447747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=96 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:11.461937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-4961c482-1476-42d7-8ddd-b7b86e920c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lazy-loading 'flavor' on Instance uuid 37fb692b-5186-4333-ad32-a567de472d62 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:57:11.485396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-848b0df1-2af0-4c63-84b8-ad3c9a6f3f72 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:11.496587 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-848b0df1-2af0-4c63-84b8-ad3c9a6f3f72 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1520 microversion: 2.1 time: 0.412810 Sep 10 20:57:11.497546 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1240/2390] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:11 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1520 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:11.502540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e2272ba7-cc16-444c-81a0-4e0293903790 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:11.510292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e2272ba7-cc16-444c-81a0-4e0293903790 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:11.531353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2272ba7-cc16-444c-81a0-4e0293903790 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.531926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2272ba7-cc16-444c-81a0-4e0293903790 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.540646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2272ba7-cc16-444c-81a0-4e0293903790 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.541864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2272ba7-cc16-444c-81a0-4e0293903790 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.542499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2272ba7-cc16-444c-81a0-4e0293903790 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.543090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2272ba7-cc16-444c-81a0-4e0293903790 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.738214 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4961c482-1476-42d7-8ddd-b7b86e920c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/action" status: 200 len: 32 microversion: 2.1 time: 0.337099 Sep 10 20:57:11.739466 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1151/2391] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:11 2022] POST /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/action => generated 32 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:57:11.747375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:11.748604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:11.755828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.756627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.758136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.759638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.761937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.762826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.885293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:11.921933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:11.923628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:11.924862 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3cd31b19-5a29-41d6-857d-1828af36d46f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.184072 Sep 10 20:57:11.925973 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1152/2392] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:11 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:11.934946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ecaf4059-51a4-4a85-bf35-5681838bbdf4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:11.936058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ecaf4059-51a4-4a85-bf35-5681838bbdf4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:11.953703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecaf4059-51a4-4a85-bf35-5681838bbdf4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.956803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecaf4059-51a4-4a85-bf35-5681838bbdf4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.957460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecaf4059-51a4-4a85-bf35-5681838bbdf4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:11.959196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecaf4059-51a4-4a85-bf35-5681838bbdf4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:11.960267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecaf4059-51a4-4a85-bf35-5681838bbdf4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:11.960872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecaf4059-51a4-4a85-bf35-5681838bbdf4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:12.065247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e2272ba7-cc16-444c-81a0-4e0293903790 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:12.076825 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e2272ba7-cc16-444c-81a0-4e0293903790 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.577766 Sep 10 20:57:12.077425 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1241/2393] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:11 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:12.090488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:12.161985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-26d0c3bd-ebb8-40db-9b10-8cf03585aa68 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:12.162722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-26d0c3bd-ebb8-40db-9b10-8cf03585aa68 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:12.180846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26d0c3bd-ebb8-40db-9b10-8cf03585aa68 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:12.181917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26d0c3bd-ebb8-40db-9b10-8cf03585aa68 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:12.184803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26d0c3bd-ebb8-40db-9b10-8cf03585aa68 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:12.186305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26d0c3bd-ebb8-40db-9b10-8cf03585aa68 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:12.186903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26d0c3bd-ebb8-40db-9b10-8cf03585aa68 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:12.187452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26d0c3bd-ebb8-40db-9b10-8cf03585aa68 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:12.327939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ecaf4059-51a4-4a85-bf35-5681838bbdf4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:12.338005 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ecaf4059-51a4-4a85-bf35-5681838bbdf4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.410406 Sep 10 20:57:12.339531 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1153/2394] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:11 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:12.424532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-648c65d8-e1d8-41f4-9c7d-88c4ccd8e189 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:12.425699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-648c65d8-e1d8-41f4-9c7d-88c4ccd8e189 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:12.438411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-648c65d8-e1d8-41f4-9c7d-88c4ccd8e189 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:12.440829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-648c65d8-e1d8-41f4-9c7d-88c4ccd8e189 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:12.441351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-648c65d8-e1d8-41f4-9c7d-88c4ccd8e189 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:12.443904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-648c65d8-e1d8-41f4-9c7d-88c4ccd8e189 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:12.445641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-648c65d8-e1d8-41f4-9c7d-88c4ccd8e189 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:12.447011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-648c65d8-e1d8-41f4-9c7d-88c4ccd8e189 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:12.572556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-26d0c3bd-ebb8-40db-9b10-8cf03585aa68 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:12.584835 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-26d0c3bd-ebb8-40db-9b10-8cf03585aa68 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.427050 Sep 10 20:57:12.598473 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1242/2395] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:12 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:12.614951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4691b3df-6659-4942-ab2a-7c29679d4bf5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:12.615837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4691b3df-6659-4942-ab2a-7c29679d4bf5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:12.622775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4691b3df-6659-4942-ab2a-7c29679d4bf5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:12.623274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4691b3df-6659-4942-ab2a-7c29679d4bf5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:12.623714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4691b3df-6659-4942-ab2a-7c29679d4bf5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:12.624428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4691b3df-6659-4942-ab2a-7c29679d4bf5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:12.624902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4691b3df-6659-4942-ab2a-7c29679d4bf5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:12.625322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4691b3df-6659-4942-ab2a-7c29679d4bf5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:12.780578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4691b3df-6659-4942-ab2a-7c29679d4bf5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:12.791397 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4691b3df-6659-4942-ab2a-7c29679d4bf5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1520 microversion: 2.1 time: 0.191734 Sep 10 20:57:12.792129 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1243/2396] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:12 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:12.808255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-648c65d8-e1d8-41f4-9c7d-88c4ccd8e189 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:12.824576 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-648c65d8-e1d8-41f4-9c7d-88c4ccd8e189 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1321 microversion: 2.1 time: 0.403102 Sep 10 20:57:12.834077 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1154/2397] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:12 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:12.930067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-646344636", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "8ebd484f-aa16-4b34-a7ba-62aa8d6c126a"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:12.952404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:12.953022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:12.981010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:12.982075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:12.983612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:12.984668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:12.985283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:12.987950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:12.991412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] validate_networks() for [('8ebd484f-aa16-4b34-a7ba-62aa8d6c126a', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:57:13.101808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:13.117114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:13.120482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:13.124878 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e4426027-48c1-4350-b440-776c163c94f6 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.176525 Sep 10 20:57:13.127467 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1155/2398] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:12 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:57:13.158248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c224fde3-f74f-4958-9c02-fe25c760f13b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:13.158967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c224fde3-f74f-4958-9c02-fe25c760f13b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:13.167488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c224fde3-f74f-4958-9c02-fe25c760f13b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:13.168311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c224fde3-f74f-4958-9c02-fe25c760f13b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:13.168959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c224fde3-f74f-4958-9c02-fe25c760f13b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:13.169963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c224fde3-f74f-4958-9c02-fe25c760f13b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:13.170731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c224fde3-f74f-4958-9c02-fe25c760f13b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:13.171353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c224fde3-f74f-4958-9c02-fe25c760f13b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:13.331112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c224fde3-f74f-4958-9c02-fe25c760f13b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:13.341113 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c224fde3-f74f-4958-9c02-fe25c760f13b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.212313 Sep 10 20:57:13.357222 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1156/2399] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:13 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:13.364538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a51aa5e5-3dad-4f47-8ee6-90646314c519 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:13.365167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a51aa5e5-3dad-4f47-8ee6-90646314c519 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:13.379078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a51aa5e5-3dad-4f47-8ee6-90646314c519 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:13.379985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a51aa5e5-3dad-4f47-8ee6-90646314c519 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:13.380673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a51aa5e5-3dad-4f47-8ee6-90646314c519 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:13.381619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a51aa5e5-3dad-4f47-8ee6-90646314c519 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:13.382370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a51aa5e5-3dad-4f47-8ee6-90646314c519 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:13.383342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a51aa5e5-3dad-4f47-8ee6-90646314c519 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:13.540965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a51aa5e5-3dad-4f47-8ee6-90646314c519 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:13.551736 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a51aa5e5-3dad-4f47-8ee6-90646314c519 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.191284 Sep 10 20:57:13.560919 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1157/2400] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:13 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:13.613731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-459be2ef-dc02-4035-a8c2-4ae70bdf3b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:13.614513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-459be2ef-dc02-4035-a8c2-4ae70bdf3b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:13.621066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-459be2ef-dc02-4035-a8c2-4ae70bdf3b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:13.621690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-459be2ef-dc02-4035-a8c2-4ae70bdf3b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:13.622402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-459be2ef-dc02-4035-a8c2-4ae70bdf3b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:13.623189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-459be2ef-dc02-4035-a8c2-4ae70bdf3b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:13.623837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-459be2ef-dc02-4035-a8c2-4ae70bdf3b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:13.624467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-459be2ef-dc02-4035-a8c2-4ae70bdf3b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:13.771131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-459be2ef-dc02-4035-a8c2-4ae70bdf3b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:13.779914 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-459be2ef-dc02-4035-a8c2-4ae70bdf3b41 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.170891 Sep 10 20:57:13.793891 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1158/2401] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:13 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:13.823656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0c98353a-148c-45ce-a39f-d21161cb5a49 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:13.823656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0c98353a-148c-45ce-a39f-d21161cb5a49 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:13.832690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c98353a-148c-45ce-a39f-d21161cb5a49 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:13.833188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c98353a-148c-45ce-a39f-d21161cb5a49 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:13.833631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c98353a-148c-45ce-a39f-d21161cb5a49 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:13.834446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c98353a-148c-45ce-a39f-d21161cb5a49 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:13.834923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c98353a-148c-45ce-a39f-d21161cb5a49 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:13.835630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c98353a-148c-45ce-a39f-d21161cb5a49 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.023987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:57:14.024506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:57:14.024873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:57:14.025520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:57:14.026361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:57:14.041473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.042435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.043638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.045112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.045738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.046449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.068737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Getting quotas for project f1f9b47aca3845d6a3fc34662d34ccf1. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:57:14.076222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Getting quotas for user 609617a03387478b9b72cbe52d25dbf0 and project f1f9b47aca3845d6a3fc34662d34ccf1. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:57:14.094156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:57:14.096883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:57:14.162632 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-26c93f5d-9ca1-4cfc-8495-4df2e2051e01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368217 Sep 10 20:57:14.164751 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1244/2402] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:57:14.172324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bcf0a771-84fb-4d2d-be61-9807599ff3c9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:14.173702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bcf0a771-84fb-4d2d-be61-9807599ff3c9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:14.185501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcf0a771-84fb-4d2d-be61-9807599ff3c9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.186628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcf0a771-84fb-4d2d-be61-9807599ff3c9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.187225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcf0a771-84fb-4d2d-be61-9807599ff3c9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.188102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcf0a771-84fb-4d2d-be61-9807599ff3c9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.188707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcf0a771-84fb-4d2d-be61-9807599ff3c9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.189316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcf0a771-84fb-4d2d-be61-9807599ff3c9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.450436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0c98353a-148c-45ce-a39f-d21161cb5a49 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:14.464663 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0c98353a-148c-45ce-a39f-d21161cb5a49 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1520 microversion: 2.1 time: 0.651132 Sep 10 20:57:14.466347 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1159/2403] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:13 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1520 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:14.474532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b9207e73-e38a-4ab5-9499-3d3deff7c606 req-11761b83-4bc6-4b44-97be-b7fbc4a598f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e202f7e-4e8a-49a1-a144-5754c6a2c005", "name": "network-vif-plugged", "status": "completed", "tag": "f9967362-03f6-4720-8b3e-3443719720ec"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:14.495052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b9207e73-e38a-4ab5-9499-3d3deff7c606 req-11761b83-4bc6-4b44-97be-b7fbc4a598f9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.495913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b9207e73-e38a-4ab5-9499-3d3deff7c606 req-11761b83-4bc6-4b44-97be-b7fbc4a598f9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.496782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b9207e73-e38a-4ab5-9499-3d3deff7c606 req-11761b83-4bc6-4b44-97be-b7fbc4a598f9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.513999 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b9207e73-e38a-4ab5-9499-3d3deff7c606 req-11761b83-4bc6-4b44-97be-b7fbc4a598f9 service nova] Creating event network-vif-plugged:f9967362-03f6-4720-8b3e-3443719720ec for instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 on nch1-master-1 Sep 10 20:57:14.517638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bcf0a771-84fb-4d2d-be61-9807599ff3c9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:14.527079 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bcf0a771-84fb-4d2d-be61-9807599ff3c9 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1321 microversion: 2.1 time: 0.360265 Sep 10 20:57:14.527925 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b9207e73-e38a-4ab5-9499-3d3deff7c606 req-11761b83-4bc6-4b44-97be-b7fbc4a598f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057778 Sep 10 20:57:14.529711 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1160/2404] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:14.537093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:14.539232 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1245/2405] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:14 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:14.554157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:14.554157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.554157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.554157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.554157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.554157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.554157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.560585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6e3caed-ba6c-4b05-ae11-a6b8e4f56774 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:14.561204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f6e3caed-ba6c-4b05-ae11-a6b8e4f56774 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:14.568775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:14.645597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f6e3caed-ba6c-4b05-ae11-a6b8e4f56774 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:14.655907 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f6e3caed-ba6c-4b05-ae11-a6b8e4f56774 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1231 microversion: 2.1 time: 0.098938 Sep 10 20:57:14.657814 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1246/2406] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:14 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:14.665347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-828d2725-992a-40d6-8cf4-d14c59b991c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:14.667205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-828d2725-992a-40d6-8cf4-d14c59b991c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:14.678825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-828d2725-992a-40d6-8cf4-d14c59b991c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.679586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-828d2725-992a-40d6-8cf4-d14c59b991c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.680220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-828d2725-992a-40d6-8cf4-d14c59b991c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.681128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-828d2725-992a-40d6-8cf4-d14c59b991c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.681749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-828d2725-992a-40d6-8cf4-d14c59b991c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.682487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-828d2725-992a-40d6-8cf4-d14c59b991c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.707523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:14.723296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:14.725485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:14.727881 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-98c79818-aca5-424c-8733-2563fc2ffd0d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.196591 Sep 10 20:57:14.729259 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1161/2407] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:14 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:14.735521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-87a31896-074e-4c07-98ce-a2f7561dd7e0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:14.736363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-87a31896-074e-4c07-98ce-a2f7561dd7e0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:14.742809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a31896-074e-4c07-98ce-a2f7561dd7e0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.743542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a31896-074e-4c07-98ce-a2f7561dd7e0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.744168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a31896-074e-4c07-98ce-a2f7561dd7e0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.745031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a31896-074e-4c07-98ce-a2f7561dd7e0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.745624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a31896-074e-4c07-98ce-a2f7561dd7e0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.746231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a31896-074e-4c07-98ce-a2f7561dd7e0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.916270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87a31896-074e-4c07-98ce-a2f7561dd7e0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:14.925399 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-87a31896-074e-4c07-98ce-a2f7561dd7e0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.194742 Sep 10 20:57:14.933895 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1162/2408] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:14 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:14.933895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e2ffe067-79f0-4d06-bba9-f217826d0955 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:14.933895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e2ffe067-79f0-4d06-bba9-f217826d0955 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:14.937952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2ffe067-79f0-4d06-bba9-f217826d0955 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.938457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2ffe067-79f0-4d06-bba9-f217826d0955 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.939306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2ffe067-79f0-4d06-bba9-f217826d0955 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:14.939617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2ffe067-79f0-4d06-bba9-f217826d0955 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:14.940079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2ffe067-79f0-4d06-bba9-f217826d0955 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:14.940563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2ffe067-79f0-4d06-bba9-f217826d0955 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:15.010891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-828d2725-992a-40d6-8cf4-d14c59b991c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:15.025435 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-828d2725-992a-40d6-8cf4-d14c59b991c7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.366108 Sep 10 20:57:15.042119 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1247/2409] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:14 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:15.101866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e2ffe067-79f0-4d06-bba9-f217826d0955 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:15.104686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:15.112574 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e2ffe067-79f0-4d06-bba9-f217826d0955 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.184898 Sep 10 20:57:15.113316 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1163/2410] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:14 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:15.491715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-908fe774-4078-433f-a31c-43a9c88eac22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:15.492497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-908fe774-4078-433f-a31c-43a9c88eac22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:15.515229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-908fe774-4078-433f-a31c-43a9c88eac22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:15.515965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-908fe774-4078-433f-a31c-43a9c88eac22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:15.516604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-908fe774-4078-433f-a31c-43a9c88eac22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:15.517924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-908fe774-4078-433f-a31c-43a9c88eac22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:15.518579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-908fe774-4078-433f-a31c-43a9c88eac22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:15.519273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-908fe774-4078-433f-a31c-43a9c88eac22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:15.571498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ea580ccd-82f7-4c9c-848c-4a6c1ce86113 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:15.572897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ea580ccd-82f7-4c9c-848c-4a6c1ce86113 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:15.582507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea580ccd-82f7-4c9c-848c-4a6c1ce86113 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:15.583244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea580ccd-82f7-4c9c-848c-4a6c1ce86113 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:15.583864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea580ccd-82f7-4c9c-848c-4a6c1ce86113 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:15.585513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea580ccd-82f7-4c9c-848c-4a6c1ce86113 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:15.586165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea580ccd-82f7-4c9c-848c-4a6c1ce86113 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:15.586805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea580ccd-82f7-4c9c-848c-4a6c1ce86113 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:15.776777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ea580ccd-82f7-4c9c-848c-4a6c1ce86113 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:15.789741 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ea580ccd-82f7-4c9c-848c-4a6c1ce86113 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1321 microversion: 2.1 time: 0.221565 Sep 10 20:57:15.791948 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1164/2411] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:15 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:15.798324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7be34b85-ed7d-48a9-a9d7-39c22f0d887f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:15.799612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7be34b85-ed7d-48a9-a9d7-39c22f0d887f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:15.808151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7be34b85-ed7d-48a9-a9d7-39c22f0d887f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:15.809108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7be34b85-ed7d-48a9-a9d7-39c22f0d887f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:15.809398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7be34b85-ed7d-48a9-a9d7-39c22f0d887f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:15.810710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7be34b85-ed7d-48a9-a9d7-39c22f0d887f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:15.811748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7be34b85-ed7d-48a9-a9d7-39c22f0d887f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:15.812331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7be34b85-ed7d-48a9-a9d7-39c22f0d887f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:15.884081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-908fe774-4078-433f-a31c-43a9c88eac22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:15.897696 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-908fe774-4078-433f-a31c-43a9c88eac22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1520 microversion: 2.1 time: 0.408578 Sep 10 20:57:15.898737 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1248/2412] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:15 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:15.911215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:15.914463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:15.934319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:15.936257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:15.936869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:15.937855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:15.938467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:15.939907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.009435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7be34b85-ed7d-48a9-a9d7-39c22f0d887f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:16.020642 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7be34b85-ed7d-48a9-a9d7-39c22f0d887f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1235 microversion: 2.1 time: 0.227045 Sep 10 20:57:16.023690 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1165/2413] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:15 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1235 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:16.035959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-352c0f8a-b19f-43d6-9715-5058c2dd8842 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:16.039227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-352c0f8a-b19f-43d6-9715-5058c2dd8842 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:16.054451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-352c0f8a-b19f-43d6-9715-5058c2dd8842 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.055549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-352c0f8a-b19f-43d6-9715-5058c2dd8842 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.059213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-352c0f8a-b19f-43d6-9715-5058c2dd8842 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.060141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-352c0f8a-b19f-43d6-9715-5058c2dd8842 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.061412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-352c0f8a-b19f-43d6-9715-5058c2dd8842 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.062124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-352c0f8a-b19f-43d6-9715-5058c2dd8842 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.186397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:16.204395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:16.205933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:16.217229 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b7c19128-d6d0-4d8d-ab42-c4d7753bc1f4 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.312013 Sep 10 20:57:16.218224 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1249/2414] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:15 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:16.226591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fbff6639-cc34-439d-8bef-b22f6b9cea95 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:16.228359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fbff6639-cc34-439d-8bef-b22f6b9cea95 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:16.257771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbff6639-cc34-439d-8bef-b22f6b9cea95 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.258499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbff6639-cc34-439d-8bef-b22f6b9cea95 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.259137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbff6639-cc34-439d-8bef-b22f6b9cea95 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.260276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbff6639-cc34-439d-8bef-b22f6b9cea95 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.260683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbff6639-cc34-439d-8bef-b22f6b9cea95 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.261120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbff6639-cc34-439d-8bef-b22f6b9cea95 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.385563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-352c0f8a-b19f-43d6-9715-5058c2dd8842 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:16.395868 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-352c0f8a-b19f-43d6-9715-5058c2dd8842 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.370150 Sep 10 20:57:16.397050 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1166/2415] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:16 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:16.406394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-388c0cfc-71e2-40a4-92df-2d1bbf91c32e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:16.420433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-388c0cfc-71e2-40a4-92df-2d1bbf91c32e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:16.442821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-388c0cfc-71e2-40a4-92df-2d1bbf91c32e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.443557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-388c0cfc-71e2-40a4-92df-2d1bbf91c32e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.444442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-388c0cfc-71e2-40a4-92df-2d1bbf91c32e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.445575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-388c0cfc-71e2-40a4-92df-2d1bbf91c32e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.446283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-388c0cfc-71e2-40a4-92df-2d1bbf91c32e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.446932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-388c0cfc-71e2-40a4-92df-2d1bbf91c32e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.637078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-388c0cfc-71e2-40a4-92df-2d1bbf91c32e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:16.642898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fbff6639-cc34-439d-8bef-b22f6b9cea95 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:16.649040 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-388c0cfc-71e2-40a4-92df-2d1bbf91c32e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.249821 Sep 10 20:57:16.653471 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fbff6639-cc34-439d-8bef-b22f6b9cea95 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.433270 Sep 10 20:57:16.654711 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1250/2416] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:16 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:16.662895 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1167/2417] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:16 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:16.817680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-64c7cf9e-a9e0-475b-b53f-9a230571b02e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:16.818332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-64c7cf9e-a9e0-475b-b53f-9a230571b02e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:16.830304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64c7cf9e-a9e0-475b-b53f-9a230571b02e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.830872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64c7cf9e-a9e0-475b-b53f-9a230571b02e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.831326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64c7cf9e-a9e0-475b-b53f-9a230571b02e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.839372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2e050fc9-d4d7-498e-a57e-e6c9239c9e99 req-20fcfcb6-b7b7-49d2-a703-9f653872a2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17cecce-d3c1-4b96-9799-1d187c722fc7", "name": "network-vif-plugged", "status": "completed", "tag": "24d42610-30a3-4abb-af96-a3994d86cc82"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:16.846774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64c7cf9e-a9e0-475b-b53f-9a230571b02e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.847640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64c7cf9e-a9e0-475b-b53f-9a230571b02e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.853881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64c7cf9e-a9e0-475b-b53f-9a230571b02e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.868008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2e050fc9-d4d7-498e-a57e-e6c9239c9e99 req-20fcfcb6-b7b7-49d2-a703-9f653872a2d3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.868506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2e050fc9-d4d7-498e-a57e-e6c9239c9e99 req-20fcfcb6-b7b7-49d2-a703-9f653872a2d3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.868946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2e050fc9-d4d7-498e-a57e-e6c9239c9e99 req-20fcfcb6-b7b7-49d2-a703-9f653872a2d3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.889700 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2e050fc9-d4d7-498e-a57e-e6c9239c9e99 req-20fcfcb6-b7b7-49d2-a703-9f653872a2d3 service nova] Creating event network-vif-plugged:24d42610-30a3-4abb-af96-a3994d86cc82 for instance a17cecce-d3c1-4b96-9799-1d187c722fc7 on nch2-master-1 Sep 10 20:57:16.903643 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2e050fc9-d4d7-498e-a57e-e6c9239c9e99 req-20fcfcb6-b7b7-49d2-a703-9f653872a2d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069376 Sep 10 20:57:16.904559 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1168/2418] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:57:16.930307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f7ce1e58-08f5-408b-ba06-9bd0e6f4797d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:16.931027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f7ce1e58-08f5-408b-ba06-9bd0e6f4797d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:16.949053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ce1e58-08f5-408b-ba06-9bd0e6f4797d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.949579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ce1e58-08f5-408b-ba06-9bd0e6f4797d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.950462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ce1e58-08f5-408b-ba06-9bd0e6f4797d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:16.966697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ce1e58-08f5-408b-ba06-9bd0e6f4797d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:16.967297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ce1e58-08f5-408b-ba06-9bd0e6f4797d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:16.970105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7ce1e58-08f5-408b-ba06-9bd0e6f4797d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:17.497478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-64c7cf9e-a9e0-475b-b53f-9a230571b02e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:17.509756 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-64c7cf9e-a9e0-475b-b53f-9a230571b02e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1321 microversion: 2.1 time: 0.696596 Sep 10 20:57:17.511307 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1251/2419] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:16 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1321 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:17.518238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-52a9ec6c-537a-4fe7-b3b7-d0696b1a84c3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:17.519265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-52a9ec6c-537a-4fe7-b3b7-d0696b1a84c3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:17.529376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52a9ec6c-537a-4fe7-b3b7-d0696b1a84c3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:17.534565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52a9ec6c-537a-4fe7-b3b7-d0696b1a84c3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:17.535143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52a9ec6c-537a-4fe7-b3b7-d0696b1a84c3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:17.535994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52a9ec6c-537a-4fe7-b3b7-d0696b1a84c3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:17.536556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52a9ec6c-537a-4fe7-b3b7-d0696b1a84c3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:17.537654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52a9ec6c-537a-4fe7-b3b7-d0696b1a84c3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:17.544502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:17.620586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-52a9ec6c-537a-4fe7-b3b7-d0696b1a84c3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:17.634844 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-52a9ec6c-537a-4fe7-b3b7-d0696b1a84c3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1283 microversion: 2.1 time: 0.121060 Sep 10 20:57:17.635598 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1252/2420] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:17 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1283 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:17.647821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:17.649480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:17.670297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:17.672599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f7ce1e58-08f5-408b-ba06-9bd0e6f4797d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:17.682097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:17.682776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:17.683814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:17.685004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:17.688315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:17.692083 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f7ce1e58-08f5-408b-ba06-9bd0e6f4797d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1520 microversion: 2.1 time: 0.768791 Sep 10 20:57:17.693911 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1169/2421] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:16 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1520 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:17.708074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-010c8131-266b-406d-9747-e6fa9bcfc492 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:17.708998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-010c8131-266b-406d-9747-e6fa9bcfc492 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:17.725245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-010c8131-266b-406d-9747-e6fa9bcfc492 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:17.728308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-010c8131-266b-406d-9747-e6fa9bcfc492 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:17.729149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-010c8131-266b-406d-9747-e6fa9bcfc492 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:17.735111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-010c8131-266b-406d-9747-e6fa9bcfc492 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:17.735853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-010c8131-266b-406d-9747-e6fa9bcfc492 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:17.736651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-010c8131-266b-406d-9747-e6fa9bcfc492 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:17.929232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:17.943507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:17.948907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:17.953118 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aff34c03-f57e-4a98-a93c-f4bd089a801d tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.315283 Sep 10 20:57:17.954739 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1253/2422] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:17 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:17.964435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-de8aabda-43bd-48cc-832d-3fb060f66af4 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:17.971427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de8aabda-43bd-48cc-832d-3fb060f66af4 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:17.994963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8aabda-43bd-48cc-832d-3fb060f66af4 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:18.002383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8aabda-43bd-48cc-832d-3fb060f66af4 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:18.009354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8aabda-43bd-48cc-832d-3fb060f66af4 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:18.010439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8aabda-43bd-48cc-832d-3fb060f66af4 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:18.011125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8aabda-43bd-48cc-832d-3fb060f66af4 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:18.012084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8aabda-43bd-48cc-832d-3fb060f66af4 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:18.129726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-010c8131-266b-406d-9747-e6fa9bcfc492 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:18.144669 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-010c8131-266b-406d-9747-e6fa9bcfc492 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.446834 Sep 10 20:57:18.145467 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1170/2423] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:17 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:18.158238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4aebc8c9-f29d-4b3c-98c4-1e4c19644cd7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:18.159085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4aebc8c9-f29d-4b3c-98c4-1e4c19644cd7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:18.171604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aebc8c9-f29d-4b3c-98c4-1e4c19644cd7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:18.176068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aebc8c9-f29d-4b3c-98c4-1e4c19644cd7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:18.176690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aebc8c9-f29d-4b3c-98c4-1e4c19644cd7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:18.183320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aebc8c9-f29d-4b3c-98c4-1e4c19644cd7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:18.184008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aebc8c9-f29d-4b3c-98c4-1e4c19644cd7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:18.184982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aebc8c9-f29d-4b3c-98c4-1e4c19644cd7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:18.348464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de8aabda-43bd-48cc-832d-3fb060f66af4 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:18.358134 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-de8aabda-43bd-48cc-832d-3fb060f66af4 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.401946 Sep 10 20:57:18.362387 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1254/2424] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:17 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:18.537513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d2d40f1c-7a59-4314-9378-c3a00900505e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:18.540855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d2d40f1c-7a59-4314-9378-c3a00900505e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:18.558064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2d40f1c-7a59-4314-9378-c3a00900505e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:18.561483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2d40f1c-7a59-4314-9378-c3a00900505e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:18.562316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2d40f1c-7a59-4314-9378-c3a00900505e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:18.563452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2d40f1c-7a59-4314-9378-c3a00900505e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:18.573275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2d40f1c-7a59-4314-9378-c3a00900505e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:18.576011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2d40f1c-7a59-4314-9378-c3a00900505e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:18.701900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4aebc8c9-f29d-4b3c-98c4-1e4c19644cd7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:18.712504 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4aebc8c9-f29d-4b3c-98c4-1e4c19644cd7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.565349 Sep 10 20:57:18.715683 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1171/2425] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:18 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:18.729946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be3fbf4d-e01f-4261-920c-b3b89fd38d86 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:18.731798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-be3fbf4d-e01f-4261-920c-b3b89fd38d86 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:18.752720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be3fbf4d-e01f-4261-920c-b3b89fd38d86 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:18.753170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be3fbf4d-e01f-4261-920c-b3b89fd38d86 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:18.756261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be3fbf4d-e01f-4261-920c-b3b89fd38d86 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:18.760464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be3fbf4d-e01f-4261-920c-b3b89fd38d86 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:18.761676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be3fbf4d-e01f-4261-920c-b3b89fd38d86 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:18.763267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be3fbf4d-e01f-4261-920c-b3b89fd38d86 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:18.933360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-be3fbf4d-e01f-4261-920c-b3b89fd38d86 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:18.947009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be3fbf4d-e01f-4261-920c-b3b89fd38d86 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1289 microversion: 2.1 time: 0.229410 Sep 10 20:57:18.947855 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1172/2426] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:18 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1289 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:18.963347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-31035864-6f70-4a67-9fa9-66ebd4c18ff7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:18.964779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-31035864-6f70-4a67-9fa9-66ebd4c18ff7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:18.973639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31035864-6f70-4a67-9fa9-66ebd4c18ff7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:18.979840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31035864-6f70-4a67-9fa9-66ebd4c18ff7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:18.980384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31035864-6f70-4a67-9fa9-66ebd4c18ff7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:18.981211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31035864-6f70-4a67-9fa9-66ebd4c18ff7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:18.982236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31035864-6f70-4a67-9fa9-66ebd4c18ff7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:18.985354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31035864-6f70-4a67-9fa9-66ebd4c18ff7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:19.376134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-31035864-6f70-4a67-9fa9-66ebd4c18ff7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:19.396166 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-31035864-6f70-4a67-9fa9-66ebd4c18ff7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1505 microversion: 2.1 time: 0.446984 Sep 10 20:57:19.409863 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1173/2427] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:18 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:19.409863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:19.409863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:19.422169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:19.423786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:19.424281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:19.426771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:19.431259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:19.434595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:19.438337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:19.538139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d2d40f1c-7a59-4314-9378-c3a00900505e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:19.552292 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d2d40f1c-7a59-4314-9378-c3a00900505e tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1321 microversion: 2.1 time: 1.021628 Sep 10 20:57:19.558312 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1255/2428] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:18 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1321 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:19.575510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4e68334b-016e-498b-a09e-06cad8ff6b02 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:19.576432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4e68334b-016e-498b-a09e-06cad8ff6b02 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:19.602649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e68334b-016e-498b-a09e-06cad8ff6b02 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:19.603451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e68334b-016e-498b-a09e-06cad8ff6b02 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:19.604087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e68334b-016e-498b-a09e-06cad8ff6b02 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:19.605002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e68334b-016e-498b-a09e-06cad8ff6b02 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:19.605670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e68334b-016e-498b-a09e-06cad8ff6b02 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:19.606317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e68334b-016e-498b-a09e-06cad8ff6b02 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:19.626504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:19.663254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:19.665261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:19.666929 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ba4a0650-2478-469f-9b4c-4d86359d7150 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.267700 Sep 10 20:57:19.682058 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1174/2429] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:19 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:19.695276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a3580a10-49c6-4f52-84f6-0890b62cd234 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:19.696254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a3580a10-49c6-4f52-84f6-0890b62cd234 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:19.706983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3580a10-49c6-4f52-84f6-0890b62cd234 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:19.708421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3580a10-49c6-4f52-84f6-0890b62cd234 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:19.711304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3580a10-49c6-4f52-84f6-0890b62cd234 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:19.713278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3580a10-49c6-4f52-84f6-0890b62cd234 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:19.714073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3580a10-49c6-4f52-84f6-0890b62cd234 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:19.715480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3580a10-49c6-4f52-84f6-0890b62cd234 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.124679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3580a10-49c6-4f52-84f6-0890b62cd234 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:20.138398 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a3580a10-49c6-4f52-84f6-0890b62cd234 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.454719 Sep 10 20:57:20.150609 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1175/2430] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:19 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:20.173341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f1ace5fe-235e-4b77-b214-49e84487ee9b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:20.174389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f1ace5fe-235e-4b77-b214-49e84487ee9b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:20.200669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1ace5fe-235e-4b77-b214-49e84487ee9b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.201682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1ace5fe-235e-4b77-b214-49e84487ee9b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.203101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1ace5fe-235e-4b77-b214-49e84487ee9b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.204054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1ace5fe-235e-4b77-b214-49e84487ee9b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.205196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1ace5fe-235e-4b77-b214-49e84487ee9b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.207602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1ace5fe-235e-4b77-b214-49e84487ee9b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.460790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f1ace5fe-235e-4b77-b214-49e84487ee9b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:20.475082 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f1ace5fe-235e-4b77-b214-49e84487ee9b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 200 len: 1505 microversion: 2.1 time: 0.313262 Sep 10 20:57:20.489900 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1176/2431] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:20 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:20.495743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-28963d28-308f-4112-92a6-f87cf34ef44f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:20.496668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-28963d28-308f-4112-92a6-f87cf34ef44f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:20.508507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28963d28-308f-4112-92a6-f87cf34ef44f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.509182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28963d28-308f-4112-92a6-f87cf34ef44f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.509708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28963d28-308f-4112-92a6-f87cf34ef44f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.510544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28963d28-308f-4112-92a6-f87cf34ef44f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.516234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28963d28-308f-4112-92a6-f87cf34ef44f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.516793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28963d28-308f-4112-92a6-f87cf34ef44f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.748541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4e68334b-016e-498b-a09e-06cad8ff6b02 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:20.758437 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4e68334b-016e-498b-a09e-06cad8ff6b02 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 1.196374 Sep 10 20:57:20.759037 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1256/2432] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:19 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:20.763682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bbc14b62-48ad-42c4-be20-c18bc86dd3ed tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:20.766545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bbc14b62-48ad-42c4-be20-c18bc86dd3ed tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:20.781400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28963d28-308f-4112-92a6-f87cf34ef44f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:20.782574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc14b62-48ad-42c4-be20-c18bc86dd3ed tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.783162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc14b62-48ad-42c4-be20-c18bc86dd3ed tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.783583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc14b62-48ad-42c4-be20-c18bc86dd3ed tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.784250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc14b62-48ad-42c4-be20-c18bc86dd3ed tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.791442 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-28963d28-308f-4112-92a6-f87cf34ef44f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.313439 Sep 10 20:57:20.792546 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1177/2433] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:20 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:20.797606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a57190a2-73ce-4be1-81fb-c87143f87683 req-15d7065e-e896-4117-a681-67f71d31829a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35f1515-600f-4bea-850a-28ce09db77fb", "name": "network-vif-plugged", "status": "completed", "tag": "ac0ed0f0-5842-4c84-a7f5-f1d58d027926"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:20.797778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc14b62-48ad-42c4-be20-c18bc86dd3ed tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.798121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc14b62-48ad-42c4-be20-c18bc86dd3ed tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.817128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a57190a2-73ce-4be1-81fb-c87143f87683 req-15d7065e-e896-4117-a681-67f71d31829a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.817886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a57190a2-73ce-4be1-81fb-c87143f87683 req-15d7065e-e896-4117-a681-67f71d31829a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.818475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a57190a2-73ce-4be1-81fb-c87143f87683 req-15d7065e-e896-4117-a681-67f71d31829a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.837277 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a57190a2-73ce-4be1-81fb-c87143f87683 req-15d7065e-e896-4117-a681-67f71d31829a service nova] Creating event network-vif-plugged:ac0ed0f0-5842-4c84-a7f5-f1d58d027926 for instance f35f1515-600f-4bea-850a-28ce09db77fb on nch1-master-1 Sep 10 20:57:20.846970 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a57190a2-73ce-4be1-81fb-c87143f87683 req-15d7065e-e896-4117-a681-67f71d31829a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053046 Sep 10 20:57:20.848190 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1178/2434] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:20.854289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f5f7b80-449a-491e-a05e-4c9b332e42d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:20.854885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f5f7b80-449a-491e-a05e-4c9b332e42d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:20.861590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f7b80-449a-491e-a05e-4c9b332e42d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.862315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f7b80-449a-491e-a05e-4c9b332e42d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.863002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f7b80-449a-491e-a05e-4c9b332e42d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.863857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f7b80-449a-491e-a05e-4c9b332e42d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.864455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f7b80-449a-491e-a05e-4c9b332e42d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.865090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f7b80-449a-491e-a05e-4c9b332e42d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.899717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f5f7b80-449a-491e-a05e-4c9b332e42d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:57:20.902021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bbc14b62-48ad-42c4-be20-c18bc86dd3ed tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:20.924722 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bbc14b62-48ad-42c4-be20-c18bc86dd3ed tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1289 microversion: 2.1 time: 0.164411 Sep 10 20:57:20.942477 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1257/2435] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:20 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1289 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:20.951633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-06b27650-1d5a-4691-8767-296f60865965 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:20.952622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-06b27650-1d5a-4691-8767-296f60865965 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:20.973200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b27650-1d5a-4691-8767-296f60865965 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.974277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b27650-1d5a-4691-8767-296f60865965 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.974908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b27650-1d5a-4691-8767-296f60865965 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:20.975859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b27650-1d5a-4691-8767-296f60865965 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:20.976608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b27650-1d5a-4691-8767-296f60865965 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:20.977872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b27650-1d5a-4691-8767-296f60865965 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:21.071720 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f5f7b80-449a-491e-a05e-4c9b332e42d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 204 len: 0 microversion: 2.1 time: 0.219994 Sep 10 20:57:21.072383 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1179/2436] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:57:20 2022] DELETE /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:57:21.078288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:21.079009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:21.102529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:21.103033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:21.103478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:21.104200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:21.104962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:21.105072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:21.116716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:21.255629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-06b27650-1d5a-4691-8767-296f60865965 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:21.271635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-06b27650-1d5a-4691-8767-296f60865965 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1471 microversion: 2.1 time: 0.327734 Sep 10 20:57:21.273145 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1258/2437] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:20 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:21.291046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d5380308-a1a1-45d9-a7e4-3bb4fd03081c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:21.291909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d5380308-a1a1-45d9-a7e4-3bb4fd03081c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:21.301487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5380308-a1a1-45d9-a7e4-3bb4fd03081c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:21.302468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5380308-a1a1-45d9-a7e4-3bb4fd03081c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:21.304933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5380308-a1a1-45d9-a7e4-3bb4fd03081c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:21.313520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5380308-a1a1-45d9-a7e4-3bb4fd03081c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:21.321503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5380308-a1a1-45d9-a7e4-3bb4fd03081c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:21.322609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5380308-a1a1-45d9-a7e4-3bb4fd03081c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:21.393185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:21.405685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:21.408437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:21.411672 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab622e3c-eb5f-4ad2-ac0b-08582caa9f38 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.338083 Sep 10 20:57:21.414806 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1180/2438] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:21 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:21.425645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1841719953", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "4f12ae9c-3aad-4e6b-a7d6-742005ff2d43"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:21.519917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] validate_networks() for [('4f12ae9c-3aad-4e6b-a7d6-742005ff2d43', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:57:21.619882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d5380308-a1a1-45d9-a7e4-3bb4fd03081c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:21.630175 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d5380308-a1a1-45d9-a7e4-3bb4fd03081c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.355730 Sep 10 20:57:21.634513 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1259/2439] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:21 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:21.643834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3c99370e-35bc-4fee-b00b-9bbd0452dfc0 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:21.644379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3c99370e-35bc-4fee-b00b-9bbd0452dfc0 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:21.659990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c99370e-35bc-4fee-b00b-9bbd0452dfc0 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:21.660755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c99370e-35bc-4fee-b00b-9bbd0452dfc0 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:21.661444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c99370e-35bc-4fee-b00b-9bbd0452dfc0 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:21.662445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c99370e-35bc-4fee-b00b-9bbd0452dfc0 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:21.663828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c99370e-35bc-4fee-b00b-9bbd0452dfc0 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:21.664656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c99370e-35bc-4fee-b00b-9bbd0452dfc0 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:21.696266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-3c99370e-35bc-4fee-b00b-9bbd0452dfc0 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lazy-loading 'flavor' on Instance uuid a17cecce-d3c1-4b96-9799-1d187c722fc7 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:57:21.859473 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3c99370e-35bc-4fee-b00b-9bbd0452dfc0 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.223243 Sep 10 20:57:21.863400 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1260/2440] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:21 2022] POST /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:57:21.875712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-00d6a7d7-1879-4932-a25e-da2e57531edd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:21.876425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-00d6a7d7-1879-4932-a25e-da2e57531edd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:21.906386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00d6a7d7-1879-4932-a25e-da2e57531edd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:21.906895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00d6a7d7-1879-4932-a25e-da2e57531edd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:21.907354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00d6a7d7-1879-4932-a25e-da2e57531edd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:21.908060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00d6a7d7-1879-4932-a25e-da2e57531edd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:21.908697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00d6a7d7-1879-4932-a25e-da2e57531edd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:21.909286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00d6a7d7-1879-4932-a25e-da2e57531edd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.134937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-00d6a7d7-1879-4932-a25e-da2e57531edd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:22.145881 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-00d6a7d7-1879-4932-a25e-da2e57531edd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.281124 Sep 10 20:57:22.147001 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1261/2441] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:21 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:22.152085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c67659fd-dc0c-491d-87b7-c0fd15859732 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:22.152684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c67659fd-dc0c-491d-87b7-c0fd15859732 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:22.159148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c67659fd-dc0c-491d-87b7-c0fd15859732 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.159565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c67659fd-dc0c-491d-87b7-c0fd15859732 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.160159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c67659fd-dc0c-491d-87b7-c0fd15859732 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.160997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c67659fd-dc0c-491d-87b7-c0fd15859732 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.161595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c67659fd-dc0c-491d-87b7-c0fd15859732 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.162190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c67659fd-dc0c-491d-87b7-c0fd15859732 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.225229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:57:22.226682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:57:22.227389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:57:22.228100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:57:22.228727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:57:22.242548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.243053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.243504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.244413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.244795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.245227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.266811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Getting quotas for project c14add960abe42f580aeeade3e6f27d9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:57:22.272869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Getting quotas for user 4c3e0565f75c4f558a8936f547ae9d76 and project c14add960abe42f580aeeade3e6f27d9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:57:22.286818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:57:22.289278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:57:22.339482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c67659fd-dc0c-491d-87b7-c0fd15859732 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:22.343788 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-50676755-a703-4a34-b88a-bbe7f8dc4ec2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927459 Sep 10 20:57:22.357419 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1181/2442] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:57:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:57:22.357714 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c67659fd-dc0c-491d-87b7-c0fd15859732 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.202283 Sep 10 20:57:22.357714 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1262/2443] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:22 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:22.358440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-79b14771-92f7-4b62-aa1f-7205df5ae827 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:22.359070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-79b14771-92f7-4b62-aa1f-7205df5ae827 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:22.364505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d605f51f-ea2f-4c62-86c7-ebc262ba362f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:22.365357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d605f51f-ea2f-4c62-86c7-ebc262ba362f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:22.365632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79b14771-92f7-4b62-aa1f-7205df5ae827 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.366784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79b14771-92f7-4b62-aa1f-7205df5ae827 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.367445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79b14771-92f7-4b62-aa1f-7205df5ae827 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.368168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79b14771-92f7-4b62-aa1f-7205df5ae827 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.368631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79b14771-92f7-4b62-aa1f-7205df5ae827 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.369095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79b14771-92f7-4b62-aa1f-7205df5ae827 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.377593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d605f51f-ea2f-4c62-86c7-ebc262ba362f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.379037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d605f51f-ea2f-4c62-86c7-ebc262ba362f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.379793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d605f51f-ea2f-4c62-86c7-ebc262ba362f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.380750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d605f51f-ea2f-4c62-86c7-ebc262ba362f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.381405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d605f51f-ea2f-4c62-86c7-ebc262ba362f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.383115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d605f51f-ea2f-4c62-86c7-ebc262ba362f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.612408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d605f51f-ea2f-4c62-86c7-ebc262ba362f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:22.622770 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d605f51f-ea2f-4c62-86c7-ebc262ba362f tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1331 microversion: 2.1 time: 0.262256 Sep 10 20:57:22.630966 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1182/2444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:22 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1331 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:22.696602 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-79b14771-92f7-4b62-aa1f-7205df5ae827 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1630 microversion: 2.1 time: 0.342441 Sep 10 20:57:22.711971 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1263/2445] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:22 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1630 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:22.711971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87078a67-2611-403a-a3ee-84fc155ebee8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:22.711971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87078a67-2611-403a-a3ee-84fc155ebee8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:22.720569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70e43f8e-649c-4e7d-93cd-4ee86159090c tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Action: 'create', calling method: .version_select at 0x7f9944673e50>, body: {"keypair": {"name": "tempest-keypair-467440502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7og/GP/5NcjlZ/ILaDAmEq5bGPAnpwkmM6gOXUYfkX+WITTPfJpdXxy8YjnTQpWX0gn5psWOlg1neTqQcHOexZyvACGbisH2NnJ1jNvdlC4YdW5Jw+gpWJ3dPNr2V2vQ=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:22.741970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-70e43f8e-649c-4e7d-93cd-4ee86159090c tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Getting quotas for project 38b49720bd644bed9a3504ff26f01768. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:57:22.748360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-70e43f8e-649c-4e7d-93cd-4ee86159090c tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Getting quotas for user 91d41f09b29b4f20816318805722b2e4 and project 38b49720bd644bed9a3504ff26f01768. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:57:22.789999 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-70e43f8e-649c-4e7d-93cd-4ee86159090c tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155135 Sep 10 20:57:22.808735 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1183/2446] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:57:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:22.818609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:22.823062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:22.831671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-87078a67-2611-403a-a3ee-84fc155ebee8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:22.835401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.838600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.841779 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-87078a67-2611-403a-a3ee-84fc155ebee8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1218 microversion: 2.1 time: 0.143483 Sep 10 20:57:22.842222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.844400 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1264/2447] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:22 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:22.844956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.846415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.847466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.859144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0006f17b-ff7c-48f4-93f1-0e8e48110c38 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:22.860880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0006f17b-ff7c-48f4-93f1-0e8e48110c38 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:22.878149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0006f17b-ff7c-48f4-93f1-0e8e48110c38 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.879628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0006f17b-ff7c-48f4-93f1-0e8e48110c38 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.879784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0006f17b-ff7c-48f4-93f1-0e8e48110c38 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.884962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0006f17b-ff7c-48f4-93f1-0e8e48110c38 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:22.886099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0006f17b-ff7c-48f4-93f1-0e8e48110c38 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:22.886732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0006f17b-ff7c-48f4-93f1-0e8e48110c38 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:22.992017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:23.004563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:23.005947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:23.007473 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-81807c32-6627-407e-b49e-038d937cbdc0 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.194458 Sep 10 20:57:23.011524 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1184/2448] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:22 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:23.017624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-cf0ffb31-7423-4fa7-a0a6-55a9c500d399 req-7a58d6b1-279f-4d1a-8d0f-b60f244f0680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f096440-3a63-40a0-bd51-42ab451bef64", "name": "network-vif-plugged", "status": "completed", "tag": "6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:23.046898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cf0ffb31-7423-4fa7-a0a6-55a9c500d399 req-7a58d6b1-279f-4d1a-8d0f-b60f244f0680 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:23.047430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cf0ffb31-7423-4fa7-a0a6-55a9c500d399 req-7a58d6b1-279f-4d1a-8d0f-b60f244f0680 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:23.047887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cf0ffb31-7423-4fa7-a0a6-55a9c500d399 req-7a58d6b1-279f-4d1a-8d0f-b60f244f0680 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:23.078668 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cf0ffb31-7423-4fa7-a0a6-55a9c500d399 req-7a58d6b1-279f-4d1a-8d0f-b60f244f0680 service nova] Creating event network-vif-plugged:6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2 for instance 4f096440-3a63-40a0-bd51-42ab451bef64 on nch1-master-1 Sep 10 20:57:23.102633 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-cf0ffb31-7423-4fa7-a0a6-55a9c500d399 req-7a58d6b1-279f-4d1a-8d0f-b60f244f0680 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088191 Sep 10 20:57:23.103559 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1185/2449] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:23.175148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b5cb75c7-192f-4a4e-abf9-b7302ef1f7cf tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:23.176862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b5cb75c7-192f-4a4e-abf9-b7302ef1f7cf tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:23.190104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5cb75c7-192f-4a4e-abf9-b7302ef1f7cf tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:23.190747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5cb75c7-192f-4a4e-abf9-b7302ef1f7cf tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:23.191431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5cb75c7-192f-4a4e-abf9-b7302ef1f7cf tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:23.192410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5cb75c7-192f-4a4e-abf9-b7302ef1f7cf tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:23.193252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5cb75c7-192f-4a4e-abf9-b7302ef1f7cf tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:23.193897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5cb75c7-192f-4a4e-abf9-b7302ef1f7cf tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:23.302474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0006f17b-ff7c-48f4-93f1-0e8e48110c38 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:23.322378 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0006f17b-ff7c-48f4-93f1-0e8e48110c38 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.475989 Sep 10 20:57:23.322985 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1265/2450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:22 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:23.379463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-02c2b037-b9e9-4220-983a-d67cdc8cf33e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:23.380108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-02c2b037-b9e9-4220-983a-d67cdc8cf33e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:23.399692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c2b037-b9e9-4220-983a-d67cdc8cf33e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:23.402481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c2b037-b9e9-4220-983a-d67cdc8cf33e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:23.403787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c2b037-b9e9-4220-983a-d67cdc8cf33e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:23.405876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c2b037-b9e9-4220-983a-d67cdc8cf33e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:23.408203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c2b037-b9e9-4220-983a-d67cdc8cf33e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:23.409052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02c2b037-b9e9-4220-983a-d67cdc8cf33e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:23.817988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-02c2b037-b9e9-4220-983a-d67cdc8cf33e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:23.828087 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-02c2b037-b9e9-4220-983a-d67cdc8cf33e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1308 microversion: 2.1 time: 0.453118 Sep 10 20:57:23.847070 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1266/2451] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:23 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1308 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:23.854453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-626c0e2a-5db1-4e5a-84c2-2b814d4430ec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:23.855554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-626c0e2a-5db1-4e5a-84c2-2b814d4430ec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:23.865326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626c0e2a-5db1-4e5a-84c2-2b814d4430ec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:23.867721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626c0e2a-5db1-4e5a-84c2-2b814d4430ec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:23.868350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626c0e2a-5db1-4e5a-84c2-2b814d4430ec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:23.869801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626c0e2a-5db1-4e5a-84c2-2b814d4430ec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:23.870429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626c0e2a-5db1-4e5a-84c2-2b814d4430ec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:23.871074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-626c0e2a-5db1-4e5a-84c2-2b814d4430ec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:23.946420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b5cb75c7-192f-4a4e-abf9-b7302ef1f7cf tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:23.986298 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b5cb75c7-192f-4a4e-abf9-b7302ef1f7cf tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.815825 Sep 10 20:57:24.004006 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1186/2452] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:23 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:24.010156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3122fd3d-f7d1-4633-b157-7a5aa7f29158 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:24.011007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3122fd3d-f7d1-4633-b157-7a5aa7f29158 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:24.021226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3122fd3d-f7d1-4633-b157-7a5aa7f29158 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.026380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3122fd3d-f7d1-4633-b157-7a5aa7f29158 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.027088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3122fd3d-f7d1-4633-b157-7a5aa7f29158 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.031109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3122fd3d-f7d1-4633-b157-7a5aa7f29158 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.031879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3122fd3d-f7d1-4633-b157-7a5aa7f29158 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.032562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3122fd3d-f7d1-4633-b157-7a5aa7f29158 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.058747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:24.213522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-626c0e2a-5db1-4e5a-84c2-2b814d4430ec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:24.222503 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-626c0e2a-5db1-4e5a-84c2-2b814d4430ec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1331 microversion: 2.1 time: 0.373322 Sep 10 20:57:24.235099 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1267/2453] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:23 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1331 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:24.248276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6adbe989-7429-45e7-bd48-a95b6d75440e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:24.249054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6adbe989-7429-45e7-bd48-a95b6d75440e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:24.255930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6adbe989-7429-45e7-bd48-a95b6d75440e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.257797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6adbe989-7429-45e7-bd48-a95b6d75440e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.258534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6adbe989-7429-45e7-bd48-a95b6d75440e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.259469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6adbe989-7429-45e7-bd48-a95b6d75440e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.260151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6adbe989-7429-45e7-bd48-a95b6d75440e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.260792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6adbe989-7429-45e7-bd48-a95b6d75440e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.265708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:24.350181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6adbe989-7429-45e7-bd48-a95b6d75440e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:24.367585 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6adbe989-7429-45e7-bd48-a95b6d75440e tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1276 microversion: 2.1 time: 0.128910 Sep 10 20:57:24.380948 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1268/2454] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:24 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:24.390815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:24.391772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:24.400540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.401209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.401745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.402898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.403823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.404626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.440067 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3122fd3d-f7d1-4633-b157-7a5aa7f29158 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1613 microversion: 2.1 time: 0.432417 Sep 10 20:57:24.442475 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1187/2455] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:24 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1613 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:24.465975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-88048feb-51e4-4d19-b853-b3fd02a707e7 req-8cc81408-2d15-4649-ab2e-445b6c11978d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2101e27e-ab36-4af3-9f29-3a448a6cfc73", "tag": "97a627ed-c505-4f6c-bbfa-dc20aead138c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:24.481580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-88048feb-51e4-4d19-b853-b3fd02a707e7 req-8cc81408-2d15-4649-ab2e-445b6c11978d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.482319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-88048feb-51e4-4d19-b853-b3fd02a707e7 req-8cc81408-2d15-4649-ab2e-445b6c11978d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.483344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-88048feb-51e4-4d19-b853-b3fd02a707e7 req-8cc81408-2d15-4649-ab2e-445b6c11978d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.504102 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-88048feb-51e4-4d19-b853-b3fd02a707e7 req-8cc81408-2d15-4649-ab2e-445b6c11978d service nova] Creating event network-changed:97a627ed-c505-4f6c-bbfa-dc20aead138c for instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 on nch1-master-1 Sep 10 20:57:24.512877 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-88048feb-51e4-4d19-b853-b3fd02a707e7 req-8cc81408-2d15-4649-ab2e-445b6c11978d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066513 Sep 10 20:57:24.515039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:24.524500 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1188/2456] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:24.529511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:24.531389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:24.535265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-743c54a5-aa30-4670-9d21-491238dc55ea tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:24.535575 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5762e071-1751-418d-9f90-7c646ece0bfc tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.150888 Sep 10 20:57:24.536358 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1269/2457] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:24 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:24.537559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-743c54a5-aa30-4670-9d21-491238dc55ea tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:24.549115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743c54a5-aa30-4670-9d21-491238dc55ea tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.549610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743c54a5-aa30-4670-9d21-491238dc55ea tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.550084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743c54a5-aa30-4670-9d21-491238dc55ea tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.550802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743c54a5-aa30-4670-9d21-491238dc55ea tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.551586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:24.552485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:24.559144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743c54a5-aa30-4670-9d21-491238dc55ea tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.559845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743c54a5-aa30-4670-9d21-491238dc55ea tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.572197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.574708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.575382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.576156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.577310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.577960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.631947 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] HTTP exception thrown: Cannot 'migrate' instance a17cecce-d3c1-4b96-9799-1d187c722fc7 while it is in vm_state suspended Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Request method failure captured: Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7/action HTTP/1.1 Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 15 Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoGXhuFxx_R6LRJzBeoi2UEndRTM1IOhDHqWTbfj77xuMVtMWqgKSYBCdc8_mK9ilvOFT-hJMGI10pBPs1gr4k5fN2fHNNwamuZahnmP-SCQZd4NNiNsFl7ylDgF1VOnY2S2r7ZFUU-IUNQc44_rD41ZjBYSO5E_r7xg1ZiyP8yMio Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 275fe06a58ac4e0994c87079255a7faa Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/275fe06a58ac4e0994c87079255a7faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/275fe06a58ac4e0994c87079255a7faa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_275fe06a58ac4e0994c87079255a7faa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/275fe06a58ac4e0994c87079255a7faa"}]}] Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 275fe06a58ac4e0994c87079255a7faa Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdminNegativeTestJSON-1892842719-project-admin Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 860c77c7bfb14a69a9a1ea46446621c7 Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1892842719-project-admin Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: {"migrate": {}} Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: exception: Cannot 'migrate' instance a17cecce-d3c1-4b96-9799-1d187c722fc7 while it is in vm_state suspended Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a17cecce-d3c1-4b96-9799-1d187c722fc7', 'body': {'migrate': {}}} Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a17cecce-d3c1-4b96-9799-1d187c722fc7 in vm_state suspended. Cannot resize while the instance is in this state. Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:57:24.634289 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance a17cecce-d3c1-4b96-9799-1d187c722fc7 while it is in vm_state suspended Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance a17cecce-d3c1-4b96-9799-1d187c722fc7 while it is in vm_state suspended Sep 10 20:57:24.638634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.646000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Returning 409 to user: Cannot 'migrate' instance a17cecce-d3c1-4b96-9799-1d187c722fc7 while it is in vm_state suspended {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:57:24.646893 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b51d9c21-fe13-4527-a186-8c530ebd2e23 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7/action" status: 409 len: 148 microversion: 2.1 time: 0.109702 Sep 10 20:57:24.647841 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1270/2458] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:24 2022] POST /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7/action => generated 148 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:57:24.671313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8b949b9-0d6e-4bd5-8176-31ce4a055be5 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8b949b9-0d6e-4bd5-8176-31ce4a055be5 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Request method failure captured: Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258/action HTTP/1.1 Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 39 Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoGXhuFxx_R6LRJzBeoi2UEndRTM1IOhDHqWTbfj77xuMVtMWqgKSYBCdc8_mK9ilvOFT-hJMGI10pBPs1gr4k5fN2fHNNwamuZahnmP-SCQZd4NNiNsFl7ylDgF1VOnY2S2r7ZFUU-IUNQc44_rD41ZjBYSO5E_r7xg1ZiyP8yMio Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 275fe06a58ac4e0994c87079255a7faa Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/275fe06a58ac4e0994c87079255a7faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/275fe06a58ac4e0994c87079255a7faa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_275fe06a58ac4e0994c87079255a7faa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/275fe06a58ac4e0994c87079255a7faa"}]}] Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 275fe06a58ac4e0994c87079255a7faa Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdminNegativeTestJSON-1892842719-project-admin Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 860c77c7bfb14a69a9a1ea46446621c7 Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1892842719-project-admin Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: {"os-resetState": {"state": "invalid"}} Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '36b30526-2510-4bcf-a301-5ece42aee258', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:57:24.676133 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 10 20:57:24.680676 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.682036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8b949b9-0d6e-4bd5-8176-31ce4a055be5 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:57:24.683105 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d8b949b9-0d6e-4bd5-8176-31ce4a055be5 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258/action" status: 400 len: 144 microversion: 2.1 time: 0.025874 Sep 10 20:57:24.684193 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1271/2459] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:24 2022] POST /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258/action => generated 144 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:57:24.692950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-61cd8d91-db51-4e6b-91b7-0c848f7c8cf4 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-61cd8d91-db51-4e6b-91b7-0c848f7c8cf4 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Request method failure captured: Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258/action HTTP/1.1 Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 31 Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoGXhuFxx_R6LRJzBeoi2UEndRTM1IOhDHqWTbfj77xuMVtMWqgKSYBCdc8_mK9ilvOFT-hJMGI10pBPs1gr4k5fN2fHNNwamuZahnmP-SCQZd4NNiNsFl7ylDgF1VOnY2S2r7ZFUU-IUNQc44_rD41ZjBYSO5E_r7xg1ZiyP8yMio Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 275fe06a58ac4e0994c87079255a7faa Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/275fe06a58ac4e0994c87079255a7faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/275fe06a58ac4e0994c87079255a7faa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_275fe06a58ac4e0994c87079255a7faa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/275fe06a58ac4e0994c87079255a7faa"}]}] Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 275fe06a58ac4e0994c87079255a7faa Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdminNegativeTestJSON-1892842719-project-admin Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 860c77c7bfb14a69a9a1ea46446621c7 Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1892842719-project-admin Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: {"os-resetState": {"state": 1}} Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '36b30526-2510-4bcf-a301-5ece42aee258', 'body': {'os-resetState': {'state': 1}}} Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 1 Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 10 20:57:24.697519 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-61cd8d91-db51-4e6b-91b7-0c848f7c8cf4 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-61cd8d91-db51-4e6b-91b7-0c848f7c8cf4 tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258/action" status: 400 len: 120 microversion: 2.1 time: 0.009971 Sep 10 20:57:24.701445 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1272/2460] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:24 2022] POST /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 20:57:24.709122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21f447c6-3974-4ff8-94bb-17adad93fbdf tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:24.714115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21f447c6-3974-4ff8-94bb-17adad93fbdf tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Failed to fetch instance by id 999 {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 20:57:24.714726 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-21f447c6-3974-4ff8-94bb-17adad93fbdf tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21f447c6-3974-4ff8-94bb-17adad93fbdf tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Request method failure captured: Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 37 Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoGXhuFxx_R6LRJzBeoi2UEndRTM1IOhDHqWTbfj77xuMVtMWqgKSYBCdc8_mK9ilvOFT-hJMGI10pBPs1gr4k5fN2fHNNwamuZahnmP-SCQZd4NNiNsFl7ylDgF1VOnY2S2r7ZFUU-IUNQc44_rD41ZjBYSO5E_r7xg1ZiyP8yMio Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 275fe06a58ac4e0994c87079255a7faa Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/275fe06a58ac4e0994c87079255a7faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/275fe06a58ac4e0994c87079255a7faa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_275fe06a58ac4e0994c87079255a7faa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/275fe06a58ac4e0994c87079255a7faa"}]}] Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 275fe06a58ac4e0994c87079255a7faa Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1892842719 Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdminNegativeTestJSON-1892842719-project-admin Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 860c77c7bfb14a69a9a1ea46446621c7 Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1892842719-project-admin Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: {"os-resetState": {"state": "error"}} Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 999 could not be found. Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:24.726800 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:57:24.731118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:57:24.731118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 10 20:57:24.731118 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:24.732429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21f447c6-3974-4ff8-94bb-17adad93fbdf tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:57:24.733597 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21f447c6-3974-4ff8-94bb-17adad93fbdf tempest-ServersAdminNegativeTestJSON-1892842719 tempest-ServersAdminNegativeTestJSON-1892842719-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.028968 Sep 10 20:57:24.734733 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1273/2461] 10.222.0.33 () {60 vars in 1179 bytes} [Sat Sep 10 20:57:24 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:57:24.744252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0ebaf92f-1465-43d9-8d09-ca2f31d3d273 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:24.744851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0ebaf92f-1465-43d9-8d09-ca2f31d3d273 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:24.752634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ebaf92f-1465-43d9-8d09-ca2f31d3d273 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.753277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ebaf92f-1465-43d9-8d09-ca2f31d3d273 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.754012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ebaf92f-1465-43d9-8d09-ca2f31d3d273 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.754788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ebaf92f-1465-43d9-8d09-ca2f31d3d273 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.755329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ebaf92f-1465-43d9-8d09-ca2f31d3d273 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.755996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ebaf92f-1465-43d9-8d09-ca2f31d3d273 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.796302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0ebaf92f-1465-43d9-8d09-ca2f31d3d273 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:57:24.959209 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0ebaf92f-1465-43d9-8d09-ca2f31d3d273 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 204 len: 0 microversion: 2.1 time: 0.217378 Sep 10 20:57:24.960459 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1274/2462] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:57:24 2022] DELETE /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 20:57:24.967302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-54967812-7e69-4f70-97f3-0e89ec978c87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:24.968027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-54967812-7e69-4f70-97f3-0e89ec978c87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:24.976390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54967812-7e69-4f70-97f3-0e89ec978c87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.977598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54967812-7e69-4f70-97f3-0e89ec978c87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.978090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54967812-7e69-4f70-97f3-0e89ec978c87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:24.978824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54967812-7e69-4f70-97f3-0e89ec978c87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:24.979286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54967812-7e69-4f70-97f3-0e89ec978c87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:24.979841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54967812-7e69-4f70-97f3-0e89ec978c87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:25.067858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-743c54a5-aa30-4670-9d21-491238dc55ea tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:25.091176 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-743c54a5-aa30-4670-9d21-491238dc55ea tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1317 microversion: 2.1 time: 0.565290 Sep 10 20:57:25.092111 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1189/2463] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:24 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:25.099128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-346f8a92-bc30-4d16-abed-72a7e4cfe3b7 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:25.101170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-346f8a92-bc30-4d16-abed-72a7e4cfe3b7 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:25.121855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-346f8a92-bc30-4d16-abed-72a7e4cfe3b7 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:25.122608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-346f8a92-bc30-4d16-abed-72a7e4cfe3b7 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:25.123802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-346f8a92-bc30-4d16-abed-72a7e4cfe3b7 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:25.124716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-346f8a92-bc30-4d16-abed-72a7e4cfe3b7 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:25.125329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-346f8a92-bc30-4d16-abed-72a7e4cfe3b7 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:25.134118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-346f8a92-bc30-4d16-abed-72a7e4cfe3b7 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:25.539030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-54967812-7e69-4f70-97f3-0e89ec978c87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:25.548962 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-54967812-7e69-4f70-97f3-0e89ec978c87 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1489 microversion: 2.1 time: 0.587130 Sep 10 20:57:25.563051 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1275/2464] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:24 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1489 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:25.577996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ecd999f1-e4ed-4832-af5a-acef6fdb37e2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:25.579039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ecd999f1-e4ed-4832-af5a-acef6fdb37e2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:25.587693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd999f1-e4ed-4832-af5a-acef6fdb37e2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:25.588467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd999f1-e4ed-4832-af5a-acef6fdb37e2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:25.589122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd999f1-e4ed-4832-af5a-acef6fdb37e2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:25.589376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-346f8a92-bc30-4d16-abed-72a7e4cfe3b7 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:25.590317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd999f1-e4ed-4832-af5a-acef6fdb37e2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:25.590939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd999f1-e4ed-4832-af5a-acef6fdb37e2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:25.591569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecd999f1-e4ed-4832-af5a-acef6fdb37e2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:25.601614 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-346f8a92-bc30-4d16-abed-72a7e4cfe3b7 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1468 microversion: 2.1 time: 0.507708 Sep 10 20:57:25.602267 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1190/2465] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:25 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1468 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:25.619872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b636b7dc-23ad-4c1a-b051-efb2aeb0dc60 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:25.620538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b636b7dc-23ad-4c1a-b051-efb2aeb0dc60 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:25.636781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b636b7dc-23ad-4c1a-b051-efb2aeb0dc60 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:25.637395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b636b7dc-23ad-4c1a-b051-efb2aeb0dc60 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:25.638054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b636b7dc-23ad-4c1a-b051-efb2aeb0dc60 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:25.638952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b636b7dc-23ad-4c1a-b051-efb2aeb0dc60 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:25.639479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b636b7dc-23ad-4c1a-b051-efb2aeb0dc60 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:25.639933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b636b7dc-23ad-4c1a-b051-efb2aeb0dc60 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:25.913708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b636b7dc-23ad-4c1a-b051-efb2aeb0dc60 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:25.922666 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b636b7dc-23ad-4c1a-b051-efb2aeb0dc60 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1331 microversion: 2.1 time: 0.319144 Sep 10 20:57:25.923729 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1191/2466] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:25 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1331 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:25.929510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f7ac187b-332d-4e15-bf21-d61f7e7a1db2 req-91910e8c-f6b1-40cf-ba4d-bbfcac612fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e202f7e-4e8a-49a1-a144-5754c6a2c005", "name": "network-vif-deleted", "tag": "f9967362-03f6-4720-8b3e-3443719720ec"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:25.941255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f7ac187b-332d-4e15-bf21-d61f7e7a1db2 req-91910e8c-f6b1-40cf-ba4d-bbfcac612fc0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:25.942238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f7ac187b-332d-4e15-bf21-d61f7e7a1db2 req-91910e8c-f6b1-40cf-ba4d-bbfcac612fc0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:25.943019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f7ac187b-332d-4e15-bf21-d61f7e7a1db2 req-91910e8c-f6b1-40cf-ba4d-bbfcac612fc0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:25.979274 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f7ac187b-332d-4e15-bf21-d61f7e7a1db2 req-91910e8c-f6b1-40cf-ba4d-bbfcac612fc0 service nova] Creating event network-vif-deleted:f9967362-03f6-4720-8b3e-3443719720ec for instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 on nch1-master-1 Sep 10 20:57:25.997738 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f7ac187b-332d-4e15-bf21-d61f7e7a1db2 req-91910e8c-f6b1-40cf-ba4d-bbfcac612fc0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070986 Sep 10 20:57:26.007274 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1192/2467] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:26.025616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e49f4c03-cff9-4132-b1d2-296704d0cbf0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:26.030246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e49f4c03-cff9-4132-b1d2-296704d0cbf0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:26.043846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ecd999f1-e4ed-4832-af5a-acef6fdb37e2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:26.050532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49f4c03-cff9-4132-b1d2-296704d0cbf0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.051895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49f4c03-cff9-4132-b1d2-296704d0cbf0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.052553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49f4c03-cff9-4132-b1d2-296704d0cbf0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.053607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49f4c03-cff9-4132-b1d2-296704d0cbf0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.054518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49f4c03-cff9-4132-b1d2-296704d0cbf0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.055331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49f4c03-cff9-4132-b1d2-296704d0cbf0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.056454 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ecd999f1-e4ed-4832-af5a-acef6fdb37e2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.483812 Sep 10 20:57:26.071613 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1276/2468] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:25 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:26.082260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:26.088984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:26.104964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.114192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.115018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.117512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.118316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.118953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.228547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:26.241370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:26.242883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:26.249528 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-550c35d4-b9de-4bd9-8ed6-da521e773ddb tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.176729 Sep 10 20:57:26.250749 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1277/2469] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:26 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:26.258846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6a210275-dec2-4a00-ab36-9c3625de61bb tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:26.259594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6a210275-dec2-4a00-ab36-9c3625de61bb tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:26.266850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a210275-dec2-4a00-ab36-9c3625de61bb tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.268140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a210275-dec2-4a00-ab36-9c3625de61bb tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.268762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a210275-dec2-4a00-ab36-9c3625de61bb tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.269657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a210275-dec2-4a00-ab36-9c3625de61bb tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.270304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a210275-dec2-4a00-ab36-9c3625de61bb tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.270959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a210275-dec2-4a00-ab36-9c3625de61bb tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.300774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-6a210275-dec2-4a00-ab36-9c3625de61bb tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lazy-loading 'flavor' on Instance uuid f35f1515-600f-4bea-850a-28ce09db77fb {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:57:26.322771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e49f4c03-cff9-4132-b1d2-296704d0cbf0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:26.336218 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e49f4c03-cff9-4132-b1d2-296704d0cbf0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.326420 Sep 10 20:57:26.337650 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1193/2470] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:26 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:26.358361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f65bc5c6-3dd0-4779-8eb9-6f077ec9c1b7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:26.360207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f65bc5c6-3dd0-4779-8eb9-6f077ec9c1b7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:26.368616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f65bc5c6-3dd0-4779-8eb9-6f077ec9c1b7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.370231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f65bc5c6-3dd0-4779-8eb9-6f077ec9c1b7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.372032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f65bc5c6-3dd0-4779-8eb9-6f077ec9c1b7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.373470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f65bc5c6-3dd0-4779-8eb9-6f077ec9c1b7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.374229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f65bc5c6-3dd0-4779-8eb9-6f077ec9c1b7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.374874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f65bc5c6-3dd0-4779-8eb9-6f077ec9c1b7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.449727 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6a210275-dec2-4a00-ab36-9c3625de61bb tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb/action" status: 202 len: 0 microversion: 2.1 time: 0.195503 Sep 10 20:57:26.450713 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1278/2471] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:26 2022] POST /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:57:26.462294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b165808d-f876-4eef-92d1-e5c1cdbacf8e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:26.463459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b165808d-f876-4eef-92d1-e5c1cdbacf8e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:26.471459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b165808d-f876-4eef-92d1-e5c1cdbacf8e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.472620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b165808d-f876-4eef-92d1-e5c1cdbacf8e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.473936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b165808d-f876-4eef-92d1-e5c1cdbacf8e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.475697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b165808d-f876-4eef-92d1-e5c1cdbacf8e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.476365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b165808d-f876-4eef-92d1-e5c1cdbacf8e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.476989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b165808d-f876-4eef-92d1-e5c1cdbacf8e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.717866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b165808d-f876-4eef-92d1-e5c1cdbacf8e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:26.727251 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b165808d-f876-4eef-92d1-e5c1cdbacf8e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1497 microversion: 2.1 time: 0.270804 Sep 10 20:57:26.727835 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1279/2472] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:26 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1497 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:26.732612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-808cfa7a-5aed-4b2b-81fe-16736c19d491 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:26.733410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-808cfa7a-5aed-4b2b-81fe-16736c19d491 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:26.739420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-808cfa7a-5aed-4b2b-81fe-16736c19d491 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.739913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-808cfa7a-5aed-4b2b-81fe-16736c19d491 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.740348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-808cfa7a-5aed-4b2b-81fe-16736c19d491 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.741062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-808cfa7a-5aed-4b2b-81fe-16736c19d491 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.741722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-808cfa7a-5aed-4b2b-81fe-16736c19d491 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.742194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-808cfa7a-5aed-4b2b-81fe-16736c19d491 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.775294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f65bc5c6-3dd0-4779-8eb9-6f077ec9c1b7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:26.784076 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f65bc5c6-3dd0-4779-8eb9-6f077ec9c1b7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1467 microversion: 2.1 time: 0.444855 Sep 10 20:57:26.784771 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1194/2473] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:26 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1467 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:26.790965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1433729824", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8592385a-5036-4a25-a5f8-62606b21cc79"}], "security_groups": [{"name": "tempest-securitygroup--1653582022"}], "key_name": "tempest-keypair-467440502", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:26.895590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-808cfa7a-5aed-4b2b-81fe-16736c19d491 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:26.904290 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-808cfa7a-5aed-4b2b-81fe-16736c19d491 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1468 microversion: 2.1 time: 0.175162 Sep 10 20:57:26.904965 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1280/2474] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:26 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1468 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:26.911090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1468358092", "metadata": {"image_type": "test"}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:26.914269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:26.920651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.921233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.921768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.922562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:26.923116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:26.923620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:26.961083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Getting quotas for project f57a1c44d4684b2fa210973f062adbce. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:57:26.966900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Getting quotas for user bec33de4067d4b1bb6e4ad866ddf2d01 and project f57a1c44d4684b2fa210973f062adbce. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:57:27.029850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] validate_networks() for [('8592385a-5036-4a25-a5f8-62606b21cc79', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:57:27.171018 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cc302fc5-5e92-4fe4-aa35-a95f51c76b19 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "POST /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64/action" status: 202 len: 0 microversion: 2.1 time: 0.264533 Sep 10 20:57:27.177741 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1281/2475] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:26 2022] POST /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 20:57:27.180990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8271dc9-dc7d-43aa-bf48-fed3d21828eb tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:27.181856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8271dc9-dc7d-43aa-bf48-fed3d21828eb tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:27.193509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8271dc9-dc7d-43aa-bf48-fed3d21828eb tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:27.195027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8271dc9-dc7d-43aa-bf48-fed3d21828eb tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:27.195786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8271dc9-dc7d-43aa-bf48-fed3d21828eb tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:27.197945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8271dc9-dc7d-43aa-bf48-fed3d21828eb tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:27.198874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8271dc9-dc7d-43aa-bf48-fed3d21828eb tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:27.199569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8271dc9-dc7d-43aa-bf48-fed3d21828eb tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:27.368394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8271dc9-dc7d-43aa-bf48-fed3d21828eb tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:27.371513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:27.379416 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8271dc9-dc7d-43aa-bf48-fed3d21828eb tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1331 microversion: 2.1 time: 0.203677 Sep 10 20:57:27.380106 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1282/2476] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:27 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1331 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:27.386147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3cb95653-3aaf-44b9-9db0-6d918d752b24 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:27.386949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3cb95653-3aaf-44b9-9db0-6d918d752b24 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:27.394997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cb95653-3aaf-44b9-9db0-6d918d752b24 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:27.395690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cb95653-3aaf-44b9-9db0-6d918d752b24 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:27.396137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cb95653-3aaf-44b9-9db0-6d918d752b24 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:27.396848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cb95653-3aaf-44b9-9db0-6d918d752b24 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:27.397688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cb95653-3aaf-44b9-9db0-6d918d752b24 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:27.398163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cb95653-3aaf-44b9-9db0-6d918d752b24 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:27.555166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3cb95653-3aaf-44b9-9db0-6d918d752b24 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:27.563515 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3cb95653-3aaf-44b9-9db0-6d918d752b24 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.182277 Sep 10 20:57:27.564096 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1283/2477] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:27 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:27.569593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1a4036ea-2a9e-4b47-a541-35c7b51e4be9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f994419b940>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:27.614790 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1a4036ea-2a9e-4b47-a541-35c7b51e4be9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.049393 Sep 10 20:57:27.615386 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1284/2478] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:27 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:27.626325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:27.626940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:27.633373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:27.633893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:27.634512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:27.635223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:27.635681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:27.636115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:27.715328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:27.732977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:27.734932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:27.736812 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5f33b70-8b4a-4a09-a6d4-b17fa55f4278 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.114358 Sep 10 20:57:27.751366 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1285/2479] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:27 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:27.763788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5a2e9c1-d799-4f78-868d-f1bc4f3a9a0b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:27.764841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e5a2e9c1-d799-4f78-868d-f1bc4f3a9a0b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:27.772513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a2e9c1-d799-4f78-868d-f1bc4f3a9a0b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:27.773370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a2e9c1-d799-4f78-868d-f1bc4f3a9a0b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:27.774311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a2e9c1-d799-4f78-868d-f1bc4f3a9a0b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:27.775240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a2e9c1-d799-4f78-868d-f1bc4f3a9a0b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:27.776048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a2e9c1-d799-4f78-868d-f1bc4f3a9a0b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:27.776650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a2e9c1-d799-4f78-868d-f1bc4f3a9a0b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:27.988075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e5a2e9c1-d799-4f78-868d-f1bc4f3a9a0b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:27.997000 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5a2e9c1-d799-4f78-868d-f1bc4f3a9a0b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.238443 Sep 10 20:57:27.997795 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1286/2480] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:27 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:28.002827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56a095ed-7dc8-458c-a2da-87c20c4e4fa9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:28.003431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-56a095ed-7dc8-458c-a2da-87c20c4e4fa9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:28.009707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56a095ed-7dc8-458c-a2da-87c20c4e4fa9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.010425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56a095ed-7dc8-458c-a2da-87c20c4e4fa9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.010754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56a095ed-7dc8-458c-a2da-87c20c4e4fa9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.011460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56a095ed-7dc8-458c-a2da-87c20c4e4fa9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.012075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56a095ed-7dc8-458c-a2da-87c20c4e4fa9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.012356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56a095ed-7dc8-458c-a2da-87c20c4e4fa9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.020988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Getting quotas for project 38b49720bd644bed9a3504ff26f01768. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:57:28.028221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Getting quotas for user 91d41f09b29b4f20816318805722b2e4 and project 38b49720bd644bed9a3504ff26f01768. Resources: dict_keys(['metadata_items']) {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:57:28.043245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:57:28.043679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:57:28.044157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:57:28.044570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:57:28.044987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:57:28.054414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.054900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.055338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.056063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.056517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.056945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.074986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Getting quotas for project 38b49720bd644bed9a3504ff26f01768. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:57:28.080293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Getting quotas for user 91d41f09b29b4f20816318805722b2e4 and project 38b49720bd644bed9a3504ff26f01768. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:57:28.093796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:57:28.096231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:57:28.146292 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f49dd9c1-b8d4-49c6-b430-add0aa30716f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.359972 Sep 10 20:57:28.152450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-56a095ed-7dc8-458c-a2da-87c20c4e4fa9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:28.153435 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1195/2481] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:57:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:57:28.158487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0b81608d-c7ba-4ad5-8d74-e0d3805adda4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:28.159136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0b81608d-c7ba-4ad5-8d74-e0d3805adda4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:28.161913 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-56a095ed-7dc8-458c-a2da-87c20c4e4fa9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1497 microversion: 2.1 time: 0.162545 Sep 10 20:57:28.172696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b81608d-c7ba-4ad5-8d74-e0d3805adda4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.172696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b81608d-c7ba-4ad5-8d74-e0d3805adda4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.172696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b81608d-c7ba-4ad5-8d74-e0d3805adda4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.172696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b81608d-c7ba-4ad5-8d74-e0d3805adda4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.172696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b81608d-c7ba-4ad5-8d74-e0d3805adda4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.172696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b81608d-c7ba-4ad5-8d74-e0d3805adda4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.175441 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1287/2482] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:27 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:28.182003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-36e7835f-ddb9-4b5a-98d3-be09db496762 req-b5c8af91-30a9-4179-8726-f565e26d4efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17cecce-d3c1-4b96-9799-1d187c722fc7", "name": "network-vif-deleted", "tag": "24d42610-30a3-4abb-af96-a3994d86cc82"}, {"name": "network-changed", "server_uuid": "22ea8e27-9137-45f8-98c7-f4b1cc01c9ec", "tag": "81bc7d32-0a6c-474d-8db7-f1b4f6e21cbc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:28.192388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-36e7835f-ddb9-4b5a-98d3-be09db496762 req-b5c8af91-30a9-4179-8726-f565e26d4efd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.193116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-36e7835f-ddb9-4b5a-98d3-be09db496762 req-b5c8af91-30a9-4179-8726-f565e26d4efd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.193561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-36e7835f-ddb9-4b5a-98d3-be09db496762 req-b5c8af91-30a9-4179-8726-f565e26d4efd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.207122 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-36e7835f-ddb9-4b5a-98d3-be09db496762 req-b5c8af91-30a9-4179-8726-f565e26d4efd service nova] Creating event network-vif-deleted:24d42610-30a3-4abb-af96-a3994d86cc82 for instance a17cecce-d3c1-4b96-9799-1d187c722fc7 on nch2-master-1 Sep 10 20:57:28.207628 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-36e7835f-ddb9-4b5a-98d3-be09db496762 req-b5c8af91-30a9-4179-8726-f565e26d4efd service nova] Creating event network-changed:81bc7d32-0a6c-474d-8db7-f1b4f6e21cbc for instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec on nch2-master-1 Sep 10 20:57:28.215169 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-36e7835f-ddb9-4b5a-98d3-be09db496762 req-b5c8af91-30a9-4179-8726-f565e26d4efd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037683 Sep 10 20:57:28.215786 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1288/2483] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:28.220912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c844564-d76f-4382-89c5-5ae68cdc5cdb tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:28.221585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9c844564-d76f-4382-89c5-5ae68cdc5cdb tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:28.250081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0b81608d-c7ba-4ad5-8d74-e0d3805adda4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:28.261710 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0b81608d-c7ba-4ad5-8d74-e0d3805adda4 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1426 microversion: 2.1 time: 0.106953 Sep 10 20:57:28.262563 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1196/2484] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:28 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1426 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:28.283429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c844564-d76f-4382-89c5-5ae68cdc5cdb tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:28.291830 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c844564-d76f-4382-89c5-5ae68cdc5cdb tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1277 microversion: 2.1 time: 0.074852 Sep 10 20:57:28.292672 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1289/2485] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:28 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1277 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:28.406034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e30bb405-d537-41f0-bb90-98367ef7ec92 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:28.406642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e30bb405-d537-41f0-bb90-98367ef7ec92 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:28.409626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:28.413296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e30bb405-d537-41f0-bb90-98367ef7ec92 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.413786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e30bb405-d537-41f0-bb90-98367ef7ec92 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.414251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e30bb405-d537-41f0-bb90-98367ef7ec92 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.415139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e30bb405-d537-41f0-bb90-98367ef7ec92 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.415595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e30bb405-d537-41f0-bb90-98367ef7ec92 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.416050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e30bb405-d537-41f0-bb90-98367ef7ec92 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.557081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e30bb405-d537-41f0-bb90-98367ef7ec92 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:28.565694 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e30bb405-d537-41f0-bb90-98367ef7ec92 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1331 microversion: 2.1 time: 0.163413 Sep 10 20:57:28.587636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56e0455b-b8f0-44bb-b31e-e4ea78962608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:28.588511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-56e0455b-b8f0-44bb-b31e-e4ea78962608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:28.594315 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1197/2486] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:28 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1331 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:28.598047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e0455b-b8f0-44bb-b31e-e4ea78962608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.598736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e0455b-b8f0-44bb-b31e-e4ea78962608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.599557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e0455b-b8f0-44bb-b31e-e4ea78962608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.600626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e0455b-b8f0-44bb-b31e-e4ea78962608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.601296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e0455b-b8f0-44bb-b31e-e4ea78962608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.602026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e0455b-b8f0-44bb-b31e-e4ea78962608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.634901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-927cc145-0110-456a-b934-97c67ce27114 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99494bbc10>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:28.680448 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-927cc145-0110-456a-b934-97c67ce27114 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.053170 Sep 10 20:57:28.681588 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1198/2487] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:28 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:28.770011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:28.770647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:28.777266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.777767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.778357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.779251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:28.779716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:28.780152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:28.833170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-56e0455b-b8f0-44bb-b31e-e4ea78962608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:28.842337 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-56e0455b-b8f0-44bb-b31e-e4ea78962608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.259459 Sep 10 20:57:28.851627 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1290/2488] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:28 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:28.852837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:28.861894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:28.863607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:28.864826 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5120581d-2c72-4f3b-89b4-a1b4022ce732 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1365 microversion: 2.57 time: 0.099697 Sep 10 20:57:28.865395 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1199/2489] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:28 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1365 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:57:29.022382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0de522b0-bf5f-4931-85dd-b072c15a8ce6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:29.023010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0de522b0-bf5f-4931-85dd-b072c15a8ce6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:29.025033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:29.030694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de522b0-bf5f-4931-85dd-b072c15a8ce6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.031256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de522b0-bf5f-4931-85dd-b072c15a8ce6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.031813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de522b0-bf5f-4931-85dd-b072c15a8ce6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.032528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de522b0-bf5f-4931-85dd-b072c15a8ce6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.033022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de522b0-bf5f-4931-85dd-b072c15a8ce6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.033416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de522b0-bf5f-4931-85dd-b072c15a8ce6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.186859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dc994c9c-ca62-40cd-a863-4cb1d9468837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:29.189342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dc994c9c-ca62-40cd-a863-4cb1d9468837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:29.200678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc994c9c-ca62-40cd-a863-4cb1d9468837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.201174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc994c9c-ca62-40cd-a863-4cb1d9468837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.201615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc994c9c-ca62-40cd-a863-4cb1d9468837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.202354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc994c9c-ca62-40cd-a863-4cb1d9468837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.203002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc994c9c-ca62-40cd-a863-4cb1d9468837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.203614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc994c9c-ca62-40cd-a863-4cb1d9468837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.264099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0de522b0-bf5f-4931-85dd-b072c15a8ce6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:29.274710 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0de522b0-bf5f-4931-85dd-b072c15a8ce6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.256081 Sep 10 20:57:29.286530 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1291/2490] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:29 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:29.297406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:29.298279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:29.305960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.306685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.307291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.308196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.308896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.309525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.360781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.361509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.362185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.362801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lazy-loading 'fault' on Instance uuid a17cecce-d3c1-4b96-9799-1d187c722fc7 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:57:29.427743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dc994c9c-ca62-40cd-a863-4cb1d9468837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:29.442208 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dc994c9c-ca62-40cd-a863-4cb1d9468837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1497 microversion: 2.1 time: 0.259366 Sep 10 20:57:29.442405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:29.443160 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1200/2491] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:29 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:29.449409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7fec382e-8bda-44a7-a145-24239188d2f1 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:29.449884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7fec382e-8bda-44a7-a145-24239188d2f1 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:29.457994 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f128467-704f-441b-8f90-807466f48d84 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1311 microversion: 2.1 time: 0.170048 Sep 10 20:57:29.459697 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1292/2492] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:29 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1311 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:29.468022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fec382e-8bda-44a7-a145-24239188d2f1 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.469527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fec382e-8bda-44a7-a145-24239188d2f1 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.471096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fec382e-8bda-44a7-a145-24239188d2f1 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.471981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fec382e-8bda-44a7-a145-24239188d2f1 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.473480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fec382e-8bda-44a7-a145-24239188d2f1 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.474246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fec382e-8bda-44a7-a145-24239188d2f1 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.588362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7fec382e-8bda-44a7-a145-24239188d2f1 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:29.603104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1403d8ab-6c34-4bd6-8206-c6110101cf13 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:29.603711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1403d8ab-6c34-4bd6-8206-c6110101cf13 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:29.605210 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7fec382e-8bda-44a7-a145-24239188d2f1 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1329 microversion: 2.1 time: 0.159306 Sep 10 20:57:29.606866 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1201/2493] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:29 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1329 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:29.611656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1403d8ab-6c34-4bd6-8206-c6110101cf13 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.612204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1403d8ab-6c34-4bd6-8206-c6110101cf13 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.612859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1403d8ab-6c34-4bd6-8206-c6110101cf13 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.613635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1403d8ab-6c34-4bd6-8206-c6110101cf13 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.615437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1403d8ab-6c34-4bd6-8206-c6110101cf13 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.616374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1403d8ab-6c34-4bd6-8206-c6110101cf13 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.696120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-17267465-f841-4491-b23c-d0754b4e6c72 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99494bbaf0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:29.741757 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-17267465-f841-4491-b23c-d0754b4e6c72 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.049649 Sep 10 20:57:29.742437 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1202/2494] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:29 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:29.757512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1403d8ab-6c34-4bd6-8206-c6110101cf13 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:29.765448 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1403d8ab-6c34-4bd6-8206-c6110101cf13 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1331 microversion: 2.1 time: 0.167388 Sep 10 20:57:29.766059 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1293/2495] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:29 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1331 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:29.866015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-61a3efdb-f880-4bfc-acb5-ae4ad9f2a886 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:29.866602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-61a3efdb-f880-4bfc-acb5-ae4ad9f2a886 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:29.872948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61a3efdb-f880-4bfc-acb5-ae4ad9f2a886 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.873440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61a3efdb-f880-4bfc-acb5-ae4ad9f2a886 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.873904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61a3efdb-f880-4bfc-acb5-ae4ad9f2a886 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.874608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61a3efdb-f880-4bfc-acb5-ae4ad9f2a886 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.875070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61a3efdb-f880-4bfc-acb5-ae4ad9f2a886 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.875502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61a3efdb-f880-4bfc-acb5-ae4ad9f2a886 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.880367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:29.895691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:29.896724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:29.903986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.904483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.904921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.905619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:29.906097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:29.906521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:29.981550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:29.990114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:29.991555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:29.992786 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-142d1190-044e-429d-9cdd-19a4f979e000 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1371 microversion: 2.57 time: 0.101036 Sep 10 20:57:29.993344 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1294/2496] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:29 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:57:30.017661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-61a3efdb-f880-4bfc-acb5-ae4ad9f2a886 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:30.027885 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-61a3efdb-f880-4bfc-acb5-ae4ad9f2a886 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.165851 Sep 10 20:57:30.028656 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1203/2497] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:29 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:30.302613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5426e41f-dd89-4edb-ba4a-fc4a82291c1f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:30.303311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5426e41f-dd89-4edb-ba4a-fc4a82291c1f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:30.310680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5426e41f-dd89-4edb-ba4a-fc4a82291c1f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.311273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5426e41f-dd89-4edb-ba4a-fc4a82291c1f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.311809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5426e41f-dd89-4edb-ba4a-fc4a82291c1f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.312966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5426e41f-dd89-4edb-ba4a-fc4a82291c1f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.313509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5426e41f-dd89-4edb-ba4a-fc4a82291c1f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.313978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5426e41f-dd89-4edb-ba4a-fc4a82291c1f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.469339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1d10df56-6801-4ea7-9f37-9d5a2556a773 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:30.470303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1d10df56-6801-4ea7-9f37-9d5a2556a773 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:30.475338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5426e41f-dd89-4edb-ba4a-fc4a82291c1f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:30.481908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d10df56-6801-4ea7-9f37-9d5a2556a773 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.482407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d10df56-6801-4ea7-9f37-9d5a2556a773 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.482847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d10df56-6801-4ea7-9f37-9d5a2556a773 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.483555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d10df56-6801-4ea7-9f37-9d5a2556a773 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.484015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d10df56-6801-4ea7-9f37-9d5a2556a773 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.484428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d10df56-6801-4ea7-9f37-9d5a2556a773 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.493870 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5426e41f-dd89-4edb-ba4a-fc4a82291c1f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.195339 Sep 10 20:57:30.495054 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1295/2498] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:30 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:30.501003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:30.501761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:30.516789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.517489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.519555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.520649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.521673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.522421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.558733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.559314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.559917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.560371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lazy-loading 'fault' on Instance uuid a17cecce-d3c1-4b96-9799-1d187c722fc7 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:57:30.603638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:30.610674 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-77dbbbdd-c0fe-4995-9778-42138d0dbe09 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 200 len: 1311 microversion: 2.1 time: 0.114620 Sep 10 20:57:30.611253 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1296/2499] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:30 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:30.630130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-52b9ae78-ceee-47e6-b2dc-dd7da9c31e5a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:30.630842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-52b9ae78-ceee-47e6-b2dc-dd7da9c31e5a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:30.637372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b9ae78-ceee-47e6-b2dc-dd7da9c31e5a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.637898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b9ae78-ceee-47e6-b2dc-dd7da9c31e5a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.638343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b9ae78-ceee-47e6-b2dc-dd7da9c31e5a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.639047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b9ae78-ceee-47e6-b2dc-dd7da9c31e5a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.639506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b9ae78-ceee-47e6-b2dc-dd7da9c31e5a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.639933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b9ae78-ceee-47e6-b2dc-dd7da9c31e5a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.670150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1d10df56-6801-4ea7-9f37-9d5a2556a773 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:30.678098 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1d10df56-6801-4ea7-9f37-9d5a2556a773 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 200 len: 1480 microversion: 2.1 time: 0.213343 Sep 10 20:57:30.678710 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1204/2500] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:30 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 1480 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:30.701925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66735c17-d14f-41b3-8b4c-34c081ad533e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-278841939"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:30.703889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-52b9ae78-ceee-47e6-b2dc-dd7da9c31e5a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:30.704021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-66735c17-d14f-41b3-8b4c-34c081ad533e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:30.710617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66735c17-d14f-41b3-8b4c-34c081ad533e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.711142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66735c17-d14f-41b3-8b4c-34c081ad533e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.711584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66735c17-d14f-41b3-8b4c-34c081ad533e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.712269 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-52b9ae78-ceee-47e6-b2dc-dd7da9c31e5a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1335 microversion: 2.1 time: 0.086019 Sep 10 20:57:30.712395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66735c17-d14f-41b3-8b4c-34c081ad533e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.712730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66735c17-d14f-41b3-8b4c-34c081ad533e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.712854 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1297/2501] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:30 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1335 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:30.713158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66735c17-d14f-41b3-8b4c-34c081ad533e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.772889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0e403616-88a6-4240-849b-f3c35b39c6ca tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99440f0670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:30.831690 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0e403616-88a6-4240-849b-f3c35b39c6ca tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.076130 Sep 10 20:57:30.832406 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1298/2502] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:30 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:30.837670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa8b28b7-a8d1-462c-a22f-368d72deb3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:30.838504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fa8b28b7-a8d1-462c-a22f-368d72deb3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:30.844987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa8b28b7-a8d1-462c-a22f-368d72deb3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.845610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa8b28b7-a8d1-462c-a22f-368d72deb3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.846180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa8b28b7-a8d1-462c-a22f-368d72deb3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.847409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa8b28b7-a8d1-462c-a22f-368d72deb3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:30.848099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa8b28b7-a8d1-462c-a22f-368d72deb3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:30.848625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa8b28b7-a8d1-462c-a22f-368d72deb3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:30.962859 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-66735c17-d14f-41b3-8b4c-34c081ad533e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb/action" status: 202 len: 0 microversion: 2.1 time: 0.264818 Sep 10 20:57:30.968968 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1205/2503] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:30 2022] POST /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 10 20:57:30.976310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1759dc66-b1e9-45ce-ab52-1aad62416472 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994468b790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:31.032848 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1759dc66-b1e9-45ce-ab52-1aad62416472 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1439 microversion: 2.1 time: 0.061844 Sep 10 20:57:31.033687 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1206/2504] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:30 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:31.038587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:31.039357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:31.046174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.046788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.047115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.047845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.049051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.049358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.094666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fa8b28b7-a8d1-462c-a22f-368d72deb3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:31.106324 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fa8b28b7-a8d1-462c-a22f-368d72deb3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1331 microversion: 2.1 time: 0.272606 Sep 10 20:57:31.115129 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1299/2505] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:30 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1331 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:31.122045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49ed73c6-24fe-4921-8b38-a0ace7766a65 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:31.122955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-49ed73c6-24fe-4921-8b38-a0ace7766a65 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:31.124026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:31.130238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ed73c6-24fe-4921-8b38-a0ace7766a65 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.130720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ed73c6-24fe-4921-8b38-a0ace7766a65 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.131166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ed73c6-24fe-4921-8b38-a0ace7766a65 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.131932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ed73c6-24fe-4921-8b38-a0ace7766a65 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.132390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ed73c6-24fe-4921-8b38-a0ace7766a65 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.133584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49ed73c6-24fe-4921-8b38-a0ace7766a65 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.145307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:31.147011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:31.148264 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b6a426ff-5ab7-4a11-97aa-03b1157af9f5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1371 microversion: 2.57 time: 0.113603 Sep 10 20:57:31.149875 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1207/2506] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:31 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:31.358311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-49ed73c6-24fe-4921-8b38-a0ace7766a65 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:31.366949 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-49ed73c6-24fe-4921-8b38-a0ace7766a65 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.258183 Sep 10 20:57:31.368569 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1300/2507] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:31 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:31.520748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c060a6f0-504f-483e-8c64-6c60f9828a16 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:31.521619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c060a6f0-504f-483e-8c64-6c60f9828a16 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:31.528859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c060a6f0-504f-483e-8c64-6c60f9828a16 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.529497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c060a6f0-504f-483e-8c64-6c60f9828a16 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.533850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c060a6f0-504f-483e-8c64-6c60f9828a16 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.534697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c060a6f0-504f-483e-8c64-6c60f9828a16 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.535181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c060a6f0-504f-483e-8c64-6c60f9828a16 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.535680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c060a6f0-504f-483e-8c64-6c60f9828a16 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.635956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:31.636697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: a17cecce-d3c1-4b96-9799-1d187c722fc7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:31.656264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.657025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.657553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.658403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.659461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.659978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.688346 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] HTTP exception thrown: Instance a17cecce-d3c1-4b96-9799-1d187c722fc7 could not be found. Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Request method failure captured: Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 HTTP/1.1 Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoE_xSIirBkWzdPFxamYaoAdvaA6LabVA68TrAf3TEfKhXJre12GhgtNavDtlfKZfb-fRtPvdD644P7qJKpCToNIOdtWWy2nzq6k5lumm7aws28NvTx5k7O04HzLvUnY759KQwrIl86zRuHoFXMRxo2zwlcWxR_xx53Z2Co0fNrO4U Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a9327061a3ba468f83e978315b6ed753 Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-944168684 Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9327061a3ba468f83e978315b6ed753"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9327061a3ba468f83e978315b6ed753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a9327061a3ba468f83e978315b6ed753", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a9327061a3ba468f83e978315b6ed753"}]}] Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdminNegativeTestJSON-944168684 Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a9327061a3ba468f83e978315b6ed753 Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-944168684 Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdminNegativeTestJSON-944168684-project Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 87df880447e941f0b336470ac8aba19f Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdminNegativeTestJSON-944168684-project Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance a17cecce-d3c1-4b96-9799-1d187c722fc7 could not be found. Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a17cecce-d3c1-4b96-9799-1d187c722fc7'} Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17cecce-d3c1-4b96-9799-1d187c722fc7 could not be found. Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17cecce-d3c1-4b96-9799-1d187c722fc7 could not be found. Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:31.690299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:31.694830 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:31.694830 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:31.694830 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:31.694830 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:31.694830 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:57:31.694830 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:57:31.694830 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17cecce-d3c1-4b96-9799-1d187c722fc7 could not be found. Sep 10 20:57:31.694830 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:31.696462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Returning 404 to user: Instance a17cecce-d3c1-4b96-9799-1d187c722fc7 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:57:31.697499 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a58c0870-55c6-4d93-8a94-0ddc8e1413ee tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7" status: 404 len: 111 microversion: 2.1 time: 0.067615 Sep 10 20:57:31.698655 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1301/2508] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:31 2022] GET /compute/v2.1/servers/a17cecce-d3c1-4b96-9799-1d187c722fc7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:57:31.707017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-06b53666-4281-446e-82cb-fb72ee8cb68b tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:31.707527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-06b53666-4281-446e-82cb-fb72ee8cb68b tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:31.715515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b53666-4281-446e-82cb-fb72ee8cb68b tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.716013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b53666-4281-446e-82cb-fb72ee8cb68b tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.716847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b53666-4281-446e-82cb-fb72ee8cb68b tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.718341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b53666-4281-446e-82cb-fb72ee8cb68b tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.718957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b53666-4281-446e-82cb-fb72ee8cb68b tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.719850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06b53666-4281-446e-82cb-fb72ee8cb68b tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.760326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-06b53666-4281-446e-82cb-fb72ee8cb68b tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:57:31.778524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:31.794125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c060a6f0-504f-483e-8c64-6c60f9828a16 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:31.802919 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c060a6f0-504f-483e-8c64-6c60f9828a16 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.286089 Sep 10 20:57:31.804265 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1208/2509] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:31 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:31.809760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-721b68b1-0d72-41e6-a46f-4590421e4a67 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:31.810731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-721b68b1-0d72-41e6-a46f-4590421e4a67 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:31.817406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-721b68b1-0d72-41e6-a46f-4590421e4a67 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.818277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-721b68b1-0d72-41e6-a46f-4590421e4a67 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.818973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-721b68b1-0d72-41e6-a46f-4590421e4a67 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.819949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-721b68b1-0d72-41e6-a46f-4590421e4a67 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.821123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-721b68b1-0d72-41e6-a46f-4590421e4a67 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.822051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-721b68b1-0d72-41e6-a46f-4590421e4a67 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.862325 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-06b53666-4281-446e-82cb-fb72ee8cb68b tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 204 len: 0 microversion: 2.1 time: 0.159279 Sep 10 20:57:31.863979 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1302/2510] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:57:31 2022] DELETE /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:57:31.872551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4f2dbe81-f0a1-4996-9523-425f1305ba74 req-1c5ade86-64f4-4678-a541-f3acb02969d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2101e27e-ab36-4af3-9f29-3a448a6cfc73", "name": "network-vif-plugged", "status": "completed", "tag": "97a627ed-c505-4f6c-bbfa-dc20aead138c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:31.886997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4f2dbe81-f0a1-4996-9523-425f1305ba74 req-1c5ade86-64f4-4678-a541-f3acb02969d0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:31.887488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4f2dbe81-f0a1-4996-9523-425f1305ba74 req-1c5ade86-64f4-4678-a541-f3acb02969d0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:31.887925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4f2dbe81-f0a1-4996-9523-425f1305ba74 req-1c5ade86-64f4-4678-a541-f3acb02969d0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:31.900870 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4f2dbe81-f0a1-4996-9523-425f1305ba74 req-1c5ade86-64f4-4678-a541-f3acb02969d0 service nova] Creating event network-vif-plugged:97a627ed-c505-4f6c-bbfa-dc20aead138c for instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 on nch1-master-1 Sep 10 20:57:31.906706 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4f2dbe81-f0a1-4996-9523-425f1305ba74 req-1c5ade86-64f4-4678-a541-f3acb02969d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041065 Sep 10 20:57:31.909874 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1303/2511] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:31.918387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-67ab0e31-dd09-4161-a0ab-7714fe965790 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99440f0e50>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:31.991324 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-67ab0e31-dd09-4161-a0ab-7714fe965790 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.079895 Sep 10 20:57:31.991777 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1304/2512] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:31 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:31.996469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a79ea777-5cd3-473f-b654-7a57291d485c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:31.997308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a79ea777-5cd3-473f-b654-7a57291d485c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:32.006076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79ea777-5cd3-473f-b654-7a57291d485c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.006608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-721b68b1-0d72-41e6-a46f-4590421e4a67 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:32.006772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79ea777-5cd3-473f-b654-7a57291d485c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.007273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79ea777-5cd3-473f-b654-7a57291d485c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.008200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79ea777-5cd3-473f-b654-7a57291d485c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.009013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79ea777-5cd3-473f-b654-7a57291d485c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.009350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a79ea777-5cd3-473f-b654-7a57291d485c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.015114 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-721b68b1-0d72-41e6-a46f-4590421e4a67 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1403 microversion: 2.1 time: 0.209633 Sep 10 20:57:32.015682 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1209/2513] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:31 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1403 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:32.049563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98a6e0d6-224f-45ad-be4d-5ae53b0b03af tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994468b8b0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:32.112559 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-98a6e0d6-224f-45ad-be4d-5ae53b0b03af tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1439 microversion: 2.1 time: 0.066829 Sep 10 20:57:32.113406 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1210/2514] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:32 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1439 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:32.130519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-44816ae2-e3f4-49db-8de4-ceb77c879837 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:32.131138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-44816ae2-e3f4-49db-8de4-ceb77c879837 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:32.138331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44816ae2-e3f4-49db-8de4-ceb77c879837 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.138825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44816ae2-e3f4-49db-8de4-ceb77c879837 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.139269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44816ae2-e3f4-49db-8de4-ceb77c879837 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.139983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44816ae2-e3f4-49db-8de4-ceb77c879837 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.140441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44816ae2-e3f4-49db-8de4-ceb77c879837 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.140871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44816ae2-e3f4-49db-8de4-ceb77c879837 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.263071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a79ea777-5cd3-473f-b654-7a57291d485c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:32.271358 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a79ea777-5cd3-473f-b654-7a57291d485c tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1478 microversion: 2.1 time: 0.278527 Sep 10 20:57:32.272251 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1305/2515] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:31 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1478 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:32.291965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:32.292585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:32.301350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.301862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.302303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.303362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.303476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.303869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.334165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-44816ae2-e3f4-49db-8de4-ceb77c879837 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:32.342885 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-44816ae2-e3f4-49db-8de4-ceb77c879837 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1331 microversion: 2.1 time: 0.216469 Sep 10 20:57:32.343474 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1211/2516] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:32 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1331 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:32.383532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:32.391927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2272d9a8-768c-4c59-b2e0-c3d3b32167ad tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:32.392263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:32.392558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2272d9a8-768c-4c59-b2e0-c3d3b32167ad tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:32.393676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:32.394883 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d91fb6fd-c5c3-4a7f-b7bc-9078df24a062 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1371 microversion: 2.57 time: 0.107200 Sep 10 20:57:32.395691 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1306/2517] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:32 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:32.399820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2272d9a8-768c-4c59-b2e0-c3d3b32167ad tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.400324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2272d9a8-768c-4c59-b2e0-c3d3b32167ad tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.400774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2272d9a8-768c-4c59-b2e0-c3d3b32167ad tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.401533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2272d9a8-768c-4c59-b2e0-c3d3b32167ad tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.402048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2272d9a8-768c-4c59-b2e0-c3d3b32167ad tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.402491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2272d9a8-768c-4c59-b2e0-c3d3b32167ad tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.760613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a52d037d-dfd9-4534-bc06-f97e81dc1a63 req-26b6f883-7c9c-4cd3-903d-5e149a3535dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba630e24-db2e-474f-80f7-56ba4cbec4c2", "tag": "5a38418e-5af5-4900-8ec5-7795e632024b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:32.771315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a52d037d-dfd9-4534-bc06-f97e81dc1a63 req-26b6f883-7c9c-4cd3-903d-5e149a3535dd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.771793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a52d037d-dfd9-4534-bc06-f97e81dc1a63 req-26b6f883-7c9c-4cd3-903d-5e149a3535dd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.772222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a52d037d-dfd9-4534-bc06-f97e81dc1a63 req-26b6f883-7c9c-4cd3-903d-5e149a3535dd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.784528 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a52d037d-dfd9-4534-bc06-f97e81dc1a63 req-26b6f883-7c9c-4cd3-903d-5e149a3535dd service nova] Creating event network-changed:5a38418e-5af5-4900-8ec5-7795e632024b for instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 on nch1-master-1 Sep 10 20:57:32.791811 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a52d037d-dfd9-4534-bc06-f97e81dc1a63 req-26b6f883-7c9c-4cd3-903d-5e149a3535dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035089 Sep 10 20:57:32.793087 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1307/2518] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:57:32.829286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d1a50314-1280-4693-85bc-3d20da9934a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:32.830028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d1a50314-1280-4693-85bc-3d20da9934a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:32.831009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2272d9a8-768c-4c59-b2e0-c3d3b32167ad tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:32.837135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a50314-1280-4693-85bc-3d20da9934a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.837629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a50314-1280-4693-85bc-3d20da9934a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.838096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a50314-1280-4693-85bc-3d20da9934a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.838805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a50314-1280-4693-85bc-3d20da9934a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:32.839260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a50314-1280-4693-85bc-3d20da9934a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:32.839695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1a50314-1280-4693-85bc-3d20da9934a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:32.841066 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2272d9a8-768c-4c59-b2e0-c3d3b32167ad tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.452902 Sep 10 20:57:32.841648 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1212/2519] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:32 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:32.973965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d1a50314-1280-4693-85bc-3d20da9934a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:32.982134 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d1a50314-1280-4693-85bc-3d20da9934a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.157648 Sep 10 20:57:32.982711 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1308/2520] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:32 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:33.006315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-361e7d97-0e66-41fb-ba2c-8849e03b7c3e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99444f8e50>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:33.037239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cfcb99f7-1435-4a9a-8b84-af83cfc17935 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:33.037970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cfcb99f7-1435-4a9a-8b84-af83cfc17935 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:33.044612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfcb99f7-1435-4a9a-8b84-af83cfc17935 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.045168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfcb99f7-1435-4a9a-8b84-af83cfc17935 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.045623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfcb99f7-1435-4a9a-8b84-af83cfc17935 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.046354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfcb99f7-1435-4a9a-8b84-af83cfc17935 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.046817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfcb99f7-1435-4a9a-8b84-af83cfc17935 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.047250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfcb99f7-1435-4a9a-8b84-af83cfc17935 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.051671 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-361e7d97-0e66-41fb-ba2c-8849e03b7c3e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.049107 Sep 10 20:57:33.052395 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1213/2521] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:33 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:33.128659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1aa6b2f3-0e9d-4252-bdbf-dfdcc5ecc8dd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994468b0d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:33.175760 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1aa6b2f3-0e9d-4252-bdbf-dfdcc5ecc8dd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1439 microversion: 2.1 time: 0.051060 Sep 10 20:57:33.176335 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1214/2522] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:33 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1439 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:33.182856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cfcb99f7-1435-4a9a-8b84-af83cfc17935 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:33.191160 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cfcb99f7-1435-4a9a-8b84-af83cfc17935 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1403 microversion: 2.1 time: 0.157593 Sep 10 20:57:33.191759 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1309/2523] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:33 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:33.304611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9a911625-7c66-4998-8063-8482f722e67a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:33.305424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9a911625-7c66-4998-8063-8482f722e67a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:33.312965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a911625-7c66-4998-8063-8482f722e67a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.313461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a911625-7c66-4998-8063-8482f722e67a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.313941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a911625-7c66-4998-8063-8482f722e67a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.314670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a911625-7c66-4998-8063-8482f722e67a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.315135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a911625-7c66-4998-8063-8482f722e67a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.315571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a911625-7c66-4998-8063-8482f722e67a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.366161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c9972b07-6a06-4adb-bc95-910ff946bfaf tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:33.367251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c9972b07-6a06-4adb-bc95-910ff946bfaf tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:33.374837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9972b07-6a06-4adb-bc95-910ff946bfaf tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.375460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9972b07-6a06-4adb-bc95-910ff946bfaf tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.375722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9972b07-6a06-4adb-bc95-910ff946bfaf tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.376864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9972b07-6a06-4adb-bc95-910ff946bfaf tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.377358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9972b07-6a06-4adb-bc95-910ff946bfaf tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.377858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9972b07-6a06-4adb-bc95-910ff946bfaf tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.475921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a911625-7c66-4998-8063-8482f722e67a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:33.486776 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9a911625-7c66-4998-8063-8482f722e67a tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1478 microversion: 2.1 time: 0.186578 Sep 10 20:57:33.487649 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1215/2524] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:33 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1478 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:33.493664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:33.494434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:33.501222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.501802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.502333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.503123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.503653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.504161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.602598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:33.615264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:33.617507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:33.619235 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-039a6d24-406e-4a94-a265-0e566b4a937f tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1356 microversion: 2.57 time: 0.130481 Sep 10 20:57:33.621885 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1216/2525] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:33 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1356 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:33.622156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c9972b07-6a06-4adb-bc95-910ff946bfaf tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:33.642247 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c9972b07-6a06-4adb-bc95-910ff946bfaf tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1331 microversion: 2.1 time: 0.279890 Sep 10 20:57:33.654701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19aa8901-cec6-49aa-a0f8-35f5398144ed tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:33.655726 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1310/2526] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:33 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1331 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:33.658401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-19aa8901-cec6-49aa-a0f8-35f5398144ed tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:33.672902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aa8901-cec6-49aa-a0f8-35f5398144ed tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.673763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aa8901-cec6-49aa-a0f8-35f5398144ed tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.674514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aa8901-cec6-49aa-a0f8-35f5398144ed tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.677565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aa8901-cec6-49aa-a0f8-35f5398144ed tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.678535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aa8901-cec6-49aa-a0f8-35f5398144ed tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.681123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19aa8901-cec6-49aa-a0f8-35f5398144ed tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.723021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-19aa8901-cec6-49aa-a0f8-35f5398144ed tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:57:33.832626 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-19aa8901-cec6-49aa-a0f8-35f5398144ed tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 204 len: 0 microversion: 2.57 time: 0.189006 Sep 10 20:57:33.834728 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1217/2527] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:57:33 2022] DELETE /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 20:57:33.844053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:33.844674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:33.854198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.854936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.856349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.856349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.857246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.857810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.865840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-74257b10-c7e9-48bd-8d4c-bf30883c00a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:33.867589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-74257b10-c7e9-48bd-8d4c-bf30883c00a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:33.877461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74257b10-c7e9-48bd-8d4c-bf30883c00a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.878233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74257b10-c7e9-48bd-8d4c-bf30883c00a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.878837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74257b10-c7e9-48bd-8d4c-bf30883c00a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.879719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74257b10-c7e9-48bd-8d4c-bf30883c00a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:33.880501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74257b10-c7e9-48bd-8d4c-bf30883c00a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:33.881101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74257b10-c7e9-48bd-8d4c-bf30883c00a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:33.942582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:33.958171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:33.961445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:33.963546 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d3708862-7530-49ce-804c-88815ff5d5cd tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1362 microversion: 2.57 time: 0.123683 Sep 10 20:57:33.965141 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1311/2528] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:33 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1362 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:57:34.006538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a4dcc98d-b923-43af-b6f6-01cfaf9333ca tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:34.008224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a4dcc98d-b923-43af-b6f6-01cfaf9333ca tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:34.017499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4dcc98d-b923-43af-b6f6-01cfaf9333ca tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:34.018346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4dcc98d-b923-43af-b6f6-01cfaf9333ca tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:34.018791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4dcc98d-b923-43af-b6f6-01cfaf9333ca tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:34.020340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4dcc98d-b923-43af-b6f6-01cfaf9333ca tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:34.020992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4dcc98d-b923-43af-b6f6-01cfaf9333ca tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:34.021632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4dcc98d-b923-43af-b6f6-01cfaf9333ca tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:34.189218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a4dcc98d-b923-43af-b6f6-01cfaf9333ca tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:34.200212 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a4dcc98d-b923-43af-b6f6-01cfaf9333ca tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.198714 Sep 10 20:57:34.201778 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1312/2529] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:33 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:34.206839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cb74096f-2874-4ff5-9450-2a1fb16b27f5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944ac8940>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:34.282953 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cb74096f-2874-4ff5-9450-2a1fb16b27f5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.078224 Sep 10 20:57:34.299816 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1313/2530] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:34 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:34.307557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-06a3363e-f745-4664-bea2-575e63e4317f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99440f05e0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:34.416589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-74257b10-c7e9-48bd-8d4c-bf30883c00a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:34.421279 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-06a3363e-f745-4664-bea2-575e63e4317f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1439 microversion: 2.1 time: 0.120037 Sep 10 20:57:34.426615 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-74257b10-c7e9-48bd-8d4c-bf30883c00a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.565000 Sep 10 20:57:34.428454 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1218/2531] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:33 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:34.443837 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1314/2532] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:34 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1439 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:34.456752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2aeffba-7772-4146-b0f4-20049875ddd8 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:34.457526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c2aeffba-7772-4146-b0f4-20049875ddd8 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:34.464196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2aeffba-7772-4146-b0f4-20049875ddd8 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:34.464841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2aeffba-7772-4146-b0f4-20049875ddd8 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:34.466406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2aeffba-7772-4146-b0f4-20049875ddd8 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:34.466543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2aeffba-7772-4146-b0f4-20049875ddd8 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:34.466991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2aeffba-7772-4146-b0f4-20049875ddd8 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:34.467426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2aeffba-7772-4146-b0f4-20049875ddd8 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:34.516337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3b88d474-cf27-49fe-9a0e-669812860090 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:34.517112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3b88d474-cf27-49fe-9a0e-669812860090 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:34.532537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88d474-cf27-49fe-9a0e-669812860090 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:34.534221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88d474-cf27-49fe-9a0e-669812860090 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:34.536255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88d474-cf27-49fe-9a0e-669812860090 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:34.537157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88d474-cf27-49fe-9a0e-669812860090 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:34.538649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88d474-cf27-49fe-9a0e-669812860090 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:34.539228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b88d474-cf27-49fe-9a0e-669812860090 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:34.655930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3b88d474-cf27-49fe-9a0e-669812860090 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:34.671646 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3b88d474-cf27-49fe-9a0e-669812860090 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1436 microversion: 2.1 time: 0.160337 Sep 10 20:57:34.672809 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1315/2533] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:34 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1436 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:34.681260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1386b8e-684c-49b6-b586-10d9ad48e262 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:34.682222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e1386b8e-684c-49b6-b586-10d9ad48e262 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:34.692025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1386b8e-684c-49b6-b586-10d9ad48e262 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:34.692025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1386b8e-684c-49b6-b586-10d9ad48e262 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:34.692025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1386b8e-684c-49b6-b586-10d9ad48e262 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:34.692559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1386b8e-684c-49b6-b586-10d9ad48e262 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:34.692559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1386b8e-684c-49b6-b586-10d9ad48e262 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:34.693119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1386b8e-684c-49b6-b586-10d9ad48e262 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:34.720276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c2aeffba-7772-4146-b0f4-20049875ddd8 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:34.730036 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c2aeffba-7772-4146-b0f4-20049875ddd8 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1403 microversion: 2.1 time: 0.299342 Sep 10 20:57:34.730631 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1219/2534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:34 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1403 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:34.735760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-9ee5e857-22f7-4b60-8c12-d340218a1957 req-2c0482be-c2e1-4d24-97df-948f3ebf8ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b30526-2510-4bcf-a301-5ece42aee258", "name": "network-vif-deleted", "tag": "c6834fdd-5b6e-4abd-802a-8a87ded92098"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:34.745989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9ee5e857-22f7-4b60-8c12-d340218a1957 req-2c0482be-c2e1-4d24-97df-948f3ebf8ac2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:34.746510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9ee5e857-22f7-4b60-8c12-d340218a1957 req-2c0482be-c2e1-4d24-97df-948f3ebf8ac2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:34.746915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9ee5e857-22f7-4b60-8c12-d340218a1957 req-2c0482be-c2e1-4d24-97df-948f3ebf8ac2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:34.759674 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-9ee5e857-22f7-4b60-8c12-d340218a1957 req-2c0482be-c2e1-4d24-97df-948f3ebf8ac2 service nova] Creating event network-vif-deleted:c6834fdd-5b6e-4abd-802a-8a87ded92098 for instance 36b30526-2510-4bcf-a301-5ece42aee258 on nch2-master-1 Sep 10 20:57:34.764572 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-9ee5e857-22f7-4b60-8c12-d340218a1957 req-2c0482be-c2e1-4d24-97df-948f3ebf8ac2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032840 Sep 10 20:57:34.765179 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1220/2535] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:34.910675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1386b8e-684c-49b6-b586-10d9ad48e262 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:34.918517 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1386b8e-684c-49b6-b586-10d9ad48e262 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1534 microversion: 2.1 time: 0.243308 Sep 10 20:57:34.919102 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1316/2536] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:34 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1534 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:34.942717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e4ea8eb1-43af-4aca-9586-e2799b93123d tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Action: 'create', calling method: .version_select at 0x7f99494bb4c0>, body: {"pool": "8579c075-4b43-4770-8663-784dffc99102"} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:34.995498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:34.996763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:35.005960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.006473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.007326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:35.008966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.009440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.010080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:35.079361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:35.088611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:35.090021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:35.091354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-de8bd65e-74a9-4434-bdc9-475f4b740e10 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1362 microversion: 2.57 time: 0.100732 Sep 10 20:57:35.092129 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1317/2537] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:34 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1362 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:57:35.224862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a63644ad-f94a-422d-8b41-f00cac2c6d94 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:35.225427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a63644ad-f94a-422d-8b41-f00cac2c6d94 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:35.232052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a63644ad-f94a-422d-8b41-f00cac2c6d94 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.232544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a63644ad-f94a-422d-8b41-f00cac2c6d94 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.232984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a63644ad-f94a-422d-8b41-f00cac2c6d94 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:35.233684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a63644ad-f94a-422d-8b41-f00cac2c6d94 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.234171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a63644ad-f94a-422d-8b41-f00cac2c6d94 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.234603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a63644ad-f94a-422d-8b41-f00cac2c6d94 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:35.372828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a63644ad-f94a-422d-8b41-f00cac2c6d94 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:35.380853 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a63644ad-f94a-422d-8b41-f00cac2c6d94 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.160162 Sep 10 20:57:35.381441 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1318/2538] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:35 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:35.387403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-400deac4-f597-413d-b222-c02e027725d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944ac8d30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:35.436469 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-400deac4-f597-413d-b222-c02e027725d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.053779 Sep 10 20:57:35.437520 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1319/2539] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:35 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:35.453695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4eba1c8a-ce88-49e4-ab9b-eac2b5b6e64a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:35.454360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4eba1c8a-ce88-49e4-ab9b-eac2b5b6e64a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:35.461970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eba1c8a-ce88-49e4-ab9b-eac2b5b6e64a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.462472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eba1c8a-ce88-49e4-ab9b-eac2b5b6e64a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.462892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eba1c8a-ce88-49e4-ab9b-eac2b5b6e64a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:35.463592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eba1c8a-ce88-49e4-ab9b-eac2b5b6e64a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.464051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eba1c8a-ce88-49e4-ab9b-eac2b5b6e64a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.464544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eba1c8a-ce88-49e4-ab9b-eac2b5b6e64a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:35.624204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4eba1c8a-ce88-49e4-ab9b-eac2b5b6e64a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:35.635672 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4eba1c8a-ce88-49e4-ab9b-eac2b5b6e64a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.185368 Sep 10 20:57:35.637320 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1320/2540] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:35 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:35.658137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8f787ee3-9526-4a76-bfad-46483ebe85d0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99440a91f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:35.723908 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8f787ee3-9526-4a76-bfad-46483ebe85d0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1439 microversion: 2.1 time: 0.085570 Sep 10 20:57:35.733872 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1321/2541] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:35 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:35.738886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:35.739507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:35.748310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.749069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.749762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:35.751134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.751789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.753013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:35.794612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.795169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.795621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:35.796081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lazy-loading 'fault' on Instance uuid 36b30526-2510-4bcf-a301-5ece42aee258 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:57:35.842349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87df880447e941f0b336470ac8aba19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9327061a3ba468f83e978315b6ed753', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:35.852055 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81cda100-4f27-4a9b-86ee-dcbe27af12a0 tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 200 len: 1312 microversion: 2.1 time: 0.116439 Sep 10 20:57:35.853185 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1322/2542] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:35 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:35.858353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d26ffe64-9ccc-497c-b235-7ed427fc5baa tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:35.859349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d26ffe64-9ccc-497c-b235-7ed427fc5baa tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:35.890017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d26ffe64-9ccc-497c-b235-7ed427fc5baa tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.890545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d26ffe64-9ccc-497c-b235-7ed427fc5baa tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.892132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d26ffe64-9ccc-497c-b235-7ed427fc5baa tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:35.894762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d26ffe64-9ccc-497c-b235-7ed427fc5baa tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:35.896383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d26ffe64-9ccc-497c-b235-7ed427fc5baa tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:35.896383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d26ffe64-9ccc-497c-b235-7ed427fc5baa tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.066278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d26ffe64-9ccc-497c-b235-7ed427fc5baa tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:36.075405 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d26ffe64-9ccc-497c-b235-7ed427fc5baa tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1403 microversion: 2.1 time: 0.220970 Sep 10 20:57:36.086890 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1323/2543] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:35 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1403 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:36.086890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-099c7b23-83b2-4a39-9fc5-3bcb6e04e4b4 req-ded6aa61-c81d-4f56-891f-f8d979e17678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f096440-3a63-40a0-bd51-42ab451bef64", "name": "network-vif-plugged", "status": "completed", "tag": "6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:36.094422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-099c7b23-83b2-4a39-9fc5-3bcb6e04e4b4 req-ded6aa61-c81d-4f56-891f-f8d979e17678 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.095189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-099c7b23-83b2-4a39-9fc5-3bcb6e04e4b4 req-ded6aa61-c81d-4f56-891f-f8d979e17678 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.095812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-099c7b23-83b2-4a39-9fc5-3bcb6e04e4b4 req-ded6aa61-c81d-4f56-891f-f8d979e17678 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.102768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:36.113052 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-099c7b23-83b2-4a39-9fc5-3bcb6e04e4b4 req-ded6aa61-c81d-4f56-891f-f8d979e17678 service nova] Creating event network-vif-plugged:6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2 for instance 4f096440-3a63-40a0-bd51-42ab451bef64 on nch1-master-1 Sep 10 20:57:36.119391 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-099c7b23-83b2-4a39-9fc5-3bcb6e04e4b4 req-ded6aa61-c81d-4f56-891f-f8d979e17678 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041990 Sep 10 20:57:36.120280 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1324/2544] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:36.126780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:36.127543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:36.135297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.136161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.136341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.137147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.137667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.138199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.180303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.181376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.182208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.182847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lazy-loading 'fault' on Instance uuid d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:57:36.240144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:36.248909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:36.251608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0c4e26a7d1d423392c05c3a1b25c8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6f2d4d90d489d88762a6a0a97ed81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:36.252820 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a5a736e-5521-4247-9164-78acd24f37d5 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 200 len: 1367 microversion: 2.57 time: 0.131463 Sep 10 20:57:36.253392 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1325/2545] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:36 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 1367 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:57:36.347918 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e4ea8eb1-43af-4aca-9586-e2799b93123d tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.409538 Sep 10 20:57:36.349286 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1221/2546] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 20:57:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:36.364404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Action: 'action', calling method: .version_select at 0x7f99467f15e0>, body: {"addFloatingIp": {"address": "172.35.7.136"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:36.367805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:36.374753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.375485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.376032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.376863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.377448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.378021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.404839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f1459c9-3111-402d-bfa3-820de0d6e967 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:36.405745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8f1459c9-3111-402d-bfa3-820de0d6e967 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:36.413356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f1459c9-3111-402d-bfa3-820de0d6e967 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.413910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f1459c9-3111-402d-bfa3-820de0d6e967 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.414565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f1459c9-3111-402d-bfa3-820de0d6e967 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.415302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f1459c9-3111-402d-bfa3-820de0d6e967 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.415767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f1459c9-3111-402d-bfa3-820de0d6e967 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.416236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f1459c9-3111-402d-bfa3-820de0d6e967 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.432693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:36.482052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 20:57:36.482613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquired lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 20:57:36.566787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8f1459c9-3111-402d-bfa3-820de0d6e967 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:36.575978 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8f1459c9-3111-402d-bfa3-820de0d6e967 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.175030 Sep 10 20:57:36.576585 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1222/2547] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:36 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:36.581576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-97d06ad2-e807-44eb-83df-2cde62af79c3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9946513f70>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:36.631655 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-97d06ad2-e807-44eb-83df-2cde62af79c3 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.053863 Sep 10 20:57:36.632427 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1223/2548] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:36 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:36.664744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd303013-e3af-40b5-8ade-1340d1f1e213 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:36.665989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd303013-e3af-40b5-8ade-1340d1f1e213 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:36.674896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd303013-e3af-40b5-8ade-1340d1f1e213 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.675385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd303013-e3af-40b5-8ade-1340d1f1e213 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.675820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd303013-e3af-40b5-8ade-1340d1f1e213 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.676554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd303013-e3af-40b5-8ade-1340d1f1e213 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.677011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd303013-e3af-40b5-8ade-1340d1f1e213 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.677436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd303013-e3af-40b5-8ade-1340d1f1e213 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.827918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd303013-e3af-40b5-8ade-1340d1f1e213 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:36.839680 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd303013-e3af-40b5-8ade-1340d1f1e213 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.182783 Sep 10 20:57:36.840712 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1224/2549] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:36 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:36.847523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-faf94b5f-1dbb-4ea0-95fe-8699640dc683 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99494e2820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:36.903983 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-faf94b5f-1dbb-4ea0-95fe-8699640dc683 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1439 microversion: 2.1 time: 0.061440 Sep 10 20:57:36.904572 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1225/2550] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:36 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:36.909334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:36.909971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] [instance: 36b30526-2510-4bcf-a301-5ece42aee258] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:36.917864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.918351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.918787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.919484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:36.919940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:36.920367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:36.935093 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] HTTP exception thrown: Instance 36b30526-2510-4bcf-a301-5ece42aee258 could not be found. Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Request method failure captured: Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 HTTP/1.1 Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoE_xSIirBkWzdPFxamYaoAdvaA6LabVA68TrAf3TEfKhXJre12GhgtNavDtlfKZfb-fRtPvdD644P7qJKpCToNIOdtWWy2nzq6k5lumm7aws28NvTx5k7O04HzLvUnY759KQwrIl86zRuHoFXMRxo2zwlcWxR_xx53Z2Co0fNrO4U Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a9327061a3ba468f83e978315b6ed753 Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-944168684 Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9327061a3ba468f83e978315b6ed753"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9327061a3ba468f83e978315b6ed753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a9327061a3ba468f83e978315b6ed753", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a9327061a3ba468f83e978315b6ed753"}]}] Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersAdminNegativeTestJSON-944168684 Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a9327061a3ba468f83e978315b6ed753 Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-944168684 Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersAdminNegativeTestJSON-944168684-project Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 87df880447e941f0b336470ac8aba19f Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersAdminNegativeTestJSON-944168684-project Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 36b30526-2510-4bcf-a301-5ece42aee258 could not be found. Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '36b30526-2510-4bcf-a301-5ece42aee258'} Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36b30526-2510-4bcf-a301-5ece42aee258 could not be found. Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36b30526-2510-4bcf-a301-5ece42aee258 could not be found. Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:36.936756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36b30526-2510-4bcf-a301-5ece42aee258 could not be found. Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] Returning 404 to user: Instance 36b30526-2510-4bcf-a301-5ece42aee258 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d14714a-5333-4a97-a93c-b505a45b486f tempest-ServersAdminNegativeTestJSON-944168684 tempest-ServersAdminNegativeTestJSON-944168684-project] 10.222.0.33 "GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258" status: 404 len: 111 microversion: 2.1 time: 0.032502 Sep 10 20:57:36.940551 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1226/2551] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:36 2022] GET /compute/v2.1/servers/36b30526-2510-4bcf-a301-5ece42aee258 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:57:37.104169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-99dc982f-b6ca-4906-875f-da84d85fb56a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:37.104779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99dc982f-b6ca-4906-875f-da84d85fb56a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:37.111380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99dc982f-b6ca-4906-875f-da84d85fb56a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:37.112848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99dc982f-b6ca-4906-875f-da84d85fb56a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:37.114186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99dc982f-b6ca-4906-875f-da84d85fb56a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:37.115715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99dc982f-b6ca-4906-875f-da84d85fb56a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:37.116445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99dc982f-b6ca-4906-875f-da84d85fb56a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:37.117313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99dc982f-b6ca-4906-875f-da84d85fb56a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:37.280441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99dc982f-b6ca-4906-875f-da84d85fb56a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:37.289945 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-99dc982f-b6ca-4906-875f-da84d85fb56a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1403 microversion: 2.1 time: 0.190765 Sep 10 20:57:37.291104 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1227/2552] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:37 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1403 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:37.295833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:37.296600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] [instance: d35955de-acb4-4d86-a0f0-c5d80e4ca8a7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:37.303259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:37.303745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:37.304706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:37.305659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:37.306307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:37.306931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:37.324202 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] HTTP exception thrown: Instance d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 could not be found. Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Request method failure captured: Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 HTTP/1.1 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoVRlf1c2UFNXFzht8NTP-av7h15YFWqbMllwPKrqLWqjjmov8ahhheHwV3sLb5JcZYxPeJW4fnvqmSZ1afSf3vPr8A0f2ZGAugRMpibHlfoTwwyUSGFV-JGqYtcG6-4eq3vJiWtL-1IkZwM_mhAk1NMhRcNlQzx2fuX42U4dgos_w Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.57 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c2e6f2d4d90d489d88762a6a0a97ed81 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerShowV257Test-1111484069 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c2e6f2d4d90d489d88762a6a0a97ed81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c2e6f2d4d90d489d88762a6a0a97ed81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c2e6f2d4d90d489d88762a6a0a97ed81", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c2e6f2d4d90d489d88762a6a0a97ed81"}]}] Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerShowV257Test-1111484069 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c2e6f2d4d90d489d88762a6a0a97ed81 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerShowV257Test-1111484069 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerShowV257Test-1111484069-project Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: c0c4e26a7d1d423392c05c3a1b25c8c0 Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerShowV257Test-1111484069-project Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 could not be found. Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'd35955de-acb4-4d86-a0f0-c5d80e4ca8a7'} Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 could not be found. Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 could not be found. Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:37.326047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:37.329682 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:37.329682 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:37.329682 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:37.329682 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:57:37.329682 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:57:37.329682 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 could not be found. Sep 10 20:57:37.329682 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:37.329682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] Returning 404 to user: Instance d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:57:37.329682 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-652ec92d-728d-482a-968e-11baab0c4e50 tempest-ServerShowV257Test-1111484069 tempest-ServerShowV257Test-1111484069-project] 10.222.0.33 "GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7" status: 404 len: 111 microversion: 2.57 time: 0.035548 Sep 10 20:57:37.332968 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1228/2553] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:57:37 2022] GET /compute/v2.1/servers/d35955de-acb4-4d86-a0f0-c5d80e4ca8a7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:57:37.606051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-99b2a548-051d-46b4-b2cf-a34d66a440bd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:37.606781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99b2a548-051d-46b4-b2cf-a34d66a440bd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:37.618770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b2a548-051d-46b4-b2cf-a34d66a440bd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:37.622074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b2a548-051d-46b4-b2cf-a34d66a440bd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:37.623857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b2a548-051d-46b4-b2cf-a34d66a440bd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:37.627752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b2a548-051d-46b4-b2cf-a34d66a440bd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:37.628494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b2a548-051d-46b4-b2cf-a34d66a440bd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:37.629953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b2a548-051d-46b4-b2cf-a34d66a440bd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:37.778499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Building network info cache for instance {{(pid=145772) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 20:57:37.849048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99b2a548-051d-46b4-b2cf-a34d66a440bd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:37.859391 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-99b2a548-051d-46b4-b2cf-a34d66a440bd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.260425 Sep 10 20:57:37.860808 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1229/2554] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:37 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:57:37.870699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3900f4ea-ca47-4509-ae25-a6ca9dcd7982 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f994444fdc0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:37.941541 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3900f4ea-ca47-4509-ae25-a6ca9dcd7982 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.078805 Sep 10 20:57:37.942789 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1230/2555] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:37 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:37.953293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-74dcd850-6fea-4f39-b9c1-03eafad566f2 req-d6aad74e-82d1-4230-80e7-a5db05656386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2101e27e-ab36-4af3-9f29-3a448a6cfc73", "tag": "97a627ed-c505-4f6c-bbfa-dc20aead138c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:37.977472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-74dcd850-6fea-4f39-b9c1-03eafad566f2 req-d6aad74e-82d1-4230-80e7-a5db05656386 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:37.978387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-74dcd850-6fea-4f39-b9c1-03eafad566f2 req-d6aad74e-82d1-4230-80e7-a5db05656386 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:37.979240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-74dcd850-6fea-4f39-b9c1-03eafad566f2 req-d6aad74e-82d1-4230-80e7-a5db05656386 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:38.040761 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-74dcd850-6fea-4f39-b9c1-03eafad566f2 req-d6aad74e-82d1-4230-80e7-a5db05656386 service nova] Creating event network-changed:97a627ed-c505-4f6c-bbfa-dc20aead138c for instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 on nch1-master-1 Sep 10 20:57:38.071688 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-74dcd850-6fea-4f39-b9c1-03eafad566f2 req-d6aad74e-82d1-4230-80e7-a5db05656386 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125318 Sep 10 20:57:38.073030 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1231/2556] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:38.077270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:38.086429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-110e267c-c645-4c7e-bd1c-fd2ac9e85cac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:38.087695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-110e267c-c645-4c7e-bd1c-fd2ac9e85cac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:38.094358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=20 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:38.096929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-110e267c-c645-4c7e-bd1c-fd2ac9e85cac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:38.099634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-110e267c-c645-4c7e-bd1c-fd2ac9e85cac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:38.100312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-110e267c-c645-4c7e-bd1c-fd2ac9e85cac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:38.101739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-110e267c-c645-4c7e-bd1c-fd2ac9e85cac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:38.102527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-110e267c-c645-4c7e-bd1c-fd2ac9e85cac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:38.103132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-110e267c-c645-4c7e-bd1c-fd2ac9e85cac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:38.288515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:38.343064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-110e267c-c645-4c7e-bd1c-fd2ac9e85cac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:38.352406 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-110e267c-c645-4c7e-bd1c-fd2ac9e85cac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.276660 Sep 10 20:57:38.352985 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1232/2557] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:38 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:38.358074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-357cccdf-56c6-48a0-bc0d-63f004ef91a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99446471f0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:38.416814 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-357cccdf-56c6-48a0-bc0d-63f004ef91a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1439 microversion: 2.1 time: 0.061683 Sep 10 20:57:38.417744 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1233/2558] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:38 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1439 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:38.423498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c553d475-09ea-4540-8b30-8989129d3fef req-16b7d63c-17fa-4461-9696-3ad52062dc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ea8e27-9137-45f8-98c7-f4b1cc01c9ec", "name": "network-vif-plugged", "status": "completed", "tag": "81bc7d32-0a6c-474d-8db7-f1b4f6e21cbc"}, {"server_uuid": "f35f1515-600f-4bea-850a-28ce09db77fb", "name": "network-vif-plugged", "status": "completed", "tag": "ac0ed0f0-5842-4c84-a7f5-f1d58d027926"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:38.438286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c553d475-09ea-4540-8b30-8989129d3fef req-16b7d63c-17fa-4461-9696-3ad52062dc2a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:38.439267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c553d475-09ea-4540-8b30-8989129d3fef req-16b7d63c-17fa-4461-9696-3ad52062dc2a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:38.439707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c553d475-09ea-4540-8b30-8989129d3fef req-16b7d63c-17fa-4461-9696-3ad52062dc2a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:38.455275 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c553d475-09ea-4540-8b30-8989129d3fef req-16b7d63c-17fa-4461-9696-3ad52062dc2a service nova] Creating event network-vif-plugged:81bc7d32-0a6c-474d-8db7-f1b4f6e21cbc for instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec on nch2-master-1 Sep 10 20:57:38.455784 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c553d475-09ea-4540-8b30-8989129d3fef req-16b7d63c-17fa-4461-9696-3ad52062dc2a service nova] Creating event network-vif-plugged:ac0ed0f0-5842-4c84-a7f5-f1d58d027926 for instance f35f1515-600f-4bea-850a-28ce09db77fb on nch1-master-1 Sep 10 20:57:38.465005 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c553d475-09ea-4540-8b30-8989129d3fef req-16b7d63c-17fa-4461-9696-3ad52062dc2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045709 Sep 10 20:57:38.469586 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1234/2559] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:38.476355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f40cd380-04e3-4852-9b2a-0c52ca3fdf80 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:38.477283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f40cd380-04e3-4852-9b2a-0c52ca3fdf80 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:38.485700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f40cd380-04e3-4852-9b2a-0c52ca3fdf80 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:38.486580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f40cd380-04e3-4852-9b2a-0c52ca3fdf80 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:38.487173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f40cd380-04e3-4852-9b2a-0c52ca3fdf80 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:38.488034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f40cd380-04e3-4852-9b2a-0c52ca3fdf80 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:38.488640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f40cd380-04e3-4852-9b2a-0c52ca3fdf80 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:38.489243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f40cd380-04e3-4852-9b2a-0c52ca3fdf80 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:38.728590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Updating instance_info_cache with network_info: [{"id": "97a627ed-c505-4f6c-bbfa-dc20aead138c", "address": "fa:16:3e:86:db:3d", "network": {"id": "8ebd484f-aa16-4b34-a7ba-62aa8d6c126a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-817816172-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1f9b47aca3845d6a3fc34662d34ccf1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap97a627ed-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=145772) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 20:57:38.754502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Releasing lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 20:57:38.758296 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b390105a-2c08-423d-9388-d0f138f5fb9a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action" status: 202 len: 0 microversion: 2.1 time: 2.396584 Sep 10 20:57:38.761704 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1326/2560] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:36 2022] POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action => generated 0 bytes in 2404 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 10 20:57:38.773678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0bb62de8-f199-43c8-bd23-cc0b2fbcfea3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Action: 'create', calling method: .version_select at 0x7f99440f0670>, body: {"pool": "8579c075-4b43-4770-8663-784dffc99102"} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:38.799566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f40cd380-04e3-4852-9b2a-0c52ca3fdf80 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:38.817935 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f40cd380-04e3-4852-9b2a-0c52ca3fdf80 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1403 microversion: 2.1 time: 0.346740 Sep 10 20:57:38.823090 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1235/2561] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:38 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1403 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:38.887797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a7b8448e-3ade-45fc-8b58-264db3f478d5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:38.888659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a7b8448e-3ade-45fc-8b58-264db3f478d5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:38.896964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b8448e-3ade-45fc-8b58-264db3f478d5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:38.897755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b8448e-3ade-45fc-8b58-264db3f478d5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:38.898844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b8448e-3ade-45fc-8b58-264db3f478d5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:38.899550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b8448e-3ade-45fc-8b58-264db3f478d5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:38.900305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b8448e-3ade-45fc-8b58-264db3f478d5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:38.900882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b8448e-3ade-45fc-8b58-264db3f478d5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:39.104149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a7b8448e-3ade-45fc-8b58-264db3f478d5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:39.113168 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a7b8448e-3ade-45fc-8b58-264db3f478d5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1318 microversion: 2.1 time: 0.231809 Sep 10 20:57:39.133790 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1236/2562] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:38 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:39.140124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e46042f1-91a1-4a06-b6bf-bf1c248e02f1 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9949678820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:39.201152 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e46042f1-91a1-4a06-b6bf-bf1c248e02f1 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.066056 Sep 10 20:57:39.201750 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1237/2563] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:39 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:39.376765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-56b8f37d-150e-4d57-b2a4-da0b381f4597 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:39.377383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-56b8f37d-150e-4d57-b2a4-da0b381f4597 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:39.385686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56b8f37d-150e-4d57-b2a4-da0b381f4597 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:39.391527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56b8f37d-150e-4d57-b2a4-da0b381f4597 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:39.392201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56b8f37d-150e-4d57-b2a4-da0b381f4597 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:39.393110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56b8f37d-150e-4d57-b2a4-da0b381f4597 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:39.393754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56b8f37d-150e-4d57-b2a4-da0b381f4597 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:39.394614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56b8f37d-150e-4d57-b2a4-da0b381f4597 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:39.594001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-56b8f37d-150e-4d57-b2a4-da0b381f4597 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:39.606798 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-56b8f37d-150e-4d57-b2a4-da0b381f4597 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.233553 Sep 10 20:57:39.607925 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1238/2564] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:39 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:39.615278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9ed05c24-1dae-46cd-b674-bf2f3eec2e27 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9949678ca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:39.696531 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9ed05c24-1dae-46cd-b674-bf2f3eec2e27 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1439 microversion: 2.1 time: 0.086663 Sep 10 20:57:39.705654 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1239/2565] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:39 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:39.847690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23e7fb06-6a61-4b9e-b755-bc9e0ae7b114 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:39.849192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23e7fb06-6a61-4b9e-b755-bc9e0ae7b114 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:39.874743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23e7fb06-6a61-4b9e-b755-bc9e0ae7b114 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:39.878770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23e7fb06-6a61-4b9e-b755-bc9e0ae7b114 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:39.880057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23e7fb06-6a61-4b9e-b755-bc9e0ae7b114 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:39.883608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23e7fb06-6a61-4b9e-b755-bc9e0ae7b114 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:39.885718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23e7fb06-6a61-4b9e-b755-bc9e0ae7b114 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:39.886441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23e7fb06-6a61-4b9e-b755-bc9e0ae7b114 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:40.122270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-23e7fb06-6a61-4b9e-b755-bc9e0ae7b114 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:40.151097 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23e7fb06-6a61-4b9e-b755-bc9e0ae7b114 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1403 microversion: 2.1 time: 0.308356 Sep 10 20:57:40.154713 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1240/2566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:39 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1403 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:40.170626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e7e900bf-a09d-4c2c-8b6c-eea126e92e27 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:40.171618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e7e900bf-a09d-4c2c-8b6c-eea126e92e27 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:40.188210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7e900bf-a09d-4c2c-8b6c-eea126e92e27 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:40.195049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7e900bf-a09d-4c2c-8b6c-eea126e92e27 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:40.195663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7e900bf-a09d-4c2c-8b6c-eea126e92e27 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:40.197091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7e900bf-a09d-4c2c-8b6c-eea126e92e27 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:40.198821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7e900bf-a09d-4c2c-8b6c-eea126e92e27 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:40.199655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7e900bf-a09d-4c2c-8b6c-eea126e92e27 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:40.611888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e7e900bf-a09d-4c2c-8b6c-eea126e92e27 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:40.630002 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e7e900bf-a09d-4c2c-8b6c-eea126e92e27 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1508 microversion: 2.1 time: 0.472044 Sep 10 20:57:40.631792 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1241/2567] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:40 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:40.637764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a2a5ccb-68d6-421f-accd-edb41b5f6c81 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9949678670>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:40.735418 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2a2a5ccb-68d6-421f-accd-edb41b5f6c81 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.102039 Sep 10 20:57:40.744813 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1242/2568] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:40 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:40.750520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab05b240-0dad-41a9-8daa-3e94e484512d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:40.751895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ab05b240-0dad-41a9-8daa-3e94e484512d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:40.761466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab05b240-0dad-41a9-8daa-3e94e484512d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:40.762083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab05b240-0dad-41a9-8daa-3e94e484512d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:40.762844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab05b240-0dad-41a9-8daa-3e94e484512d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:40.763976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab05b240-0dad-41a9-8daa-3e94e484512d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:40.764897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab05b240-0dad-41a9-8daa-3e94e484512d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:40.765865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab05b240-0dad-41a9-8daa-3e94e484512d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:41.044524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab05b240-0dad-41a9-8daa-3e94e484512d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:41.056786 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab05b240-0dad-41a9-8daa-3e94e484512d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1734 microversion: 2.1 time: 0.309556 Sep 10 20:57:41.058347 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1243/2569] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:40 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1734 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:41.075624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d7f28e5b-8bd6-416b-9e06-8d985e010c51 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:41.076743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d7f28e5b-8bd6-416b-9e06-8d985e010c51 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:41.083856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7f28e5b-8bd6-416b-9e06-8d985e010c51 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:41.084769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7f28e5b-8bd6-416b-9e06-8d985e010c51 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:41.085893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7f28e5b-8bd6-416b-9e06-8d985e010c51 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:41.087119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7f28e5b-8bd6-416b-9e06-8d985e010c51 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:41.087634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7f28e5b-8bd6-416b-9e06-8d985e010c51 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:41.088234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7f28e5b-8bd6-416b-9e06-8d985e010c51 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:41.402305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d7f28e5b-8bd6-416b-9e06-8d985e010c51 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:41.413350 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d7f28e5b-8bd6-416b-9e06-8d985e010c51 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1508 microversion: 2.1 time: 0.353710 Sep 10 20:57:41.414022 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1244/2570] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:41 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:41.427664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a80a3ed3-df2b-4750-8947-afc0edd062df tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99454e0ee0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:41.436711 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0bb62de8-f199-43c8-bd23-cc0b2fbcfea3 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.673072 Sep 10 20:57:41.446635 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1327/2571] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 20:57:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:41.505333 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a80a3ed3-df2b-4750-8947-afc0edd062df tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1439 microversion: 2.1 time: 0.089859 Sep 10 20:57:41.506277 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1245/2572] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:41 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:41.512688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5a17208-72b8-40e0-85cc-201e6457ffac tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:41.514018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e5a17208-72b8-40e0-85cc-201e6457ffac tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:41.522681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a17208-72b8-40e0-85cc-201e6457ffac tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:41.524026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a17208-72b8-40e0-85cc-201e6457ffac tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:41.524721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a17208-72b8-40e0-85cc-201e6457ffac tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:41.525865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a17208-72b8-40e0-85cc-201e6457ffac tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:41.526738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a17208-72b8-40e0-85cc-201e6457ffac tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:41.527438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a17208-72b8-40e0-85cc-201e6457ffac tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:41.673482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1104534737", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:41.725489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e5a17208-72b8-40e0-85cc-201e6457ffac tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:41.737309 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5a17208-72b8-40e0-85cc-201e6457ffac tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1403 microversion: 2.1 time: 0.228385 Sep 10 20:57:41.739485 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1246/2573] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:41 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1403 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:41.744965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-26d82c73-9104-4050-a3ad-51d3497b9a66 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:41.746462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:57:41.748962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-26d82c73-9104-4050-a3ad-51d3497b9a66 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:41.765975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26d82c73-9104-4050-a3ad-51d3497b9a66 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:41.767014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26d82c73-9104-4050-a3ad-51d3497b9a66 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:41.767635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26d82c73-9104-4050-a3ad-51d3497b9a66 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:41.768513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26d82c73-9104-4050-a3ad-51d3497b9a66 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:41.769122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26d82c73-9104-4050-a3ad-51d3497b9a66 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:41.769777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26d82c73-9104-4050-a3ad-51d3497b9a66 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:41.948138 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-26d82c73-9104-4050-a3ad-51d3497b9a66 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "PUT /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1080 microversion: 2.1 time: 0.207077 Sep 10 20:57:41.953040 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1247/2574] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Sep 10 20:57:41 2022] PUT /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1080 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:41.992354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Action: 'action', calling method: .version_select at 0x7f99467e5040>, body: {"addFloatingIp": {"address": "172.35.7.102"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:41.996580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:42.012837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:42.015146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:42.015802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:42.016873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:42.018772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:42.019384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:42.121777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:57:42.122768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:57:42.123737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:57:42.124357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:57:42.125005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:57:42.135896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:42.137294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:42.138110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:42.139154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:42.139834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:42.140490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:42.208344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:57:42.223774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:57:42.253340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:57:42.264812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:57:42.285135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 20:57:42.285696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquired lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 20:57:42.400448 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c7b20510-042b-437a-8ce2-aa3bce4615e8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.948657 Sep 10 20:57:42.403208 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1328/2575] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:57:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:57:42.414334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f400da96-b798-4e38-9a6a-7129a3fa3a02 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99440b1940>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:42.671708 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f400da96-b798-4e38-9a6a-7129a3fa3a02 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1424 microversion: 2.1 time: 0.266039 Sep 10 20:57:42.674567 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1329/2576] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:42 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1424 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:42.689316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ee4bfab6-3409-4b64-a7de-ffa60dfee306 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:42.693710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ee4bfab6-3409-4b64-a7de-ffa60dfee306 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:42.717260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bfab6-3409-4b64-a7de-ffa60dfee306 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:42.718197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bfab6-3409-4b64-a7de-ffa60dfee306 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:42.718832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bfab6-3409-4b64-a7de-ffa60dfee306 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:42.720638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bfab6-3409-4b64-a7de-ffa60dfee306 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:42.723519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bfab6-3409-4b64-a7de-ffa60dfee306 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:42.724191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bfab6-3409-4b64-a7de-ffa60dfee306 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:43.569415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ee4bfab6-3409-4b64-a7de-ffa60dfee306 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:43.583777 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ee4bfab6-3409-4b64-a7de-ffa60dfee306 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1506 microversion: 2.1 time: 0.907950 Sep 10 20:57:43.586917 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1330/2577] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:42 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1506 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:43.604377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe8f26e9-fa42-4804-9149-132ebc93d640 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:43.605424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fe8f26e9-fa42-4804-9149-132ebc93d640 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:43.622678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe8f26e9-fa42-4804-9149-132ebc93d640 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:43.623536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe8f26e9-fa42-4804-9149-132ebc93d640 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:43.624220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe8f26e9-fa42-4804-9149-132ebc93d640 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:43.625162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe8f26e9-fa42-4804-9149-132ebc93d640 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:43.625853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe8f26e9-fa42-4804-9149-132ebc93d640 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:43.626547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe8f26e9-fa42-4804-9149-132ebc93d640 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:43.985794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fe8f26e9-fa42-4804-9149-132ebc93d640 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:44.002282 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fe8f26e9-fa42-4804-9149-132ebc93d640 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1714 microversion: 2.1 time: 0.402553 Sep 10 20:57:44.004176 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1331/2578] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:43 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1714 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:44.012675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c0ba612-1b2a-4b01-bcda-5e732d6aeed3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:44.013977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c0ba612-1b2a-4b01-bcda-5e732d6aeed3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:44.049525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c0ba612-1b2a-4b01-bcda-5e732d6aeed3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:44.052246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c0ba612-1b2a-4b01-bcda-5e732d6aeed3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:44.054062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c0ba612-1b2a-4b01-bcda-5e732d6aeed3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:44.055604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c0ba612-1b2a-4b01-bcda-5e732d6aeed3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:44.056623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c0ba612-1b2a-4b01-bcda-5e732d6aeed3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:44.057405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c0ba612-1b2a-4b01-bcda-5e732d6aeed3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:44.234452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c0ba612-1b2a-4b01-bcda-5e732d6aeed3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:44.244747 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c0ba612-1b2a-4b01-bcda-5e732d6aeed3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad" status: 200 len: 1269 microversion: 2.1 time: 0.239302 Sep 10 20:57:44.259393 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1332/2579] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:44 2022] GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad => generated 1269 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:44.269912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5b3e4eb-25e5-4cde-a937-13d8cd10502c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f993ffd54c0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:44.398152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.7.102 (cb2863b9-15b5-45c4-b376-d4dda9c3cbe1) with port 97a627ed-c505-4f6c-bbfa-dc20aead138c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 8579c075-4b43-4770-8663-784dffc99102.", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:57:44.398746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Releasing lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 20:57:44.399482 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] HTTP exception thrown: Cannot associate floating IP 172.35.7.102 (cb2863b9-15b5-45c4-b376-d4dda9c3cbe1) with port 97a627ed-c505-4f6c-bbfa-dc20aead138c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 8579c075-4b43-4770-8663-784dffc99102. Sep 10 20:57:44.399482 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-98bf3419-b762-4f8a-ac69-2404882dbbcc'] Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Request method failure captured: Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action HTTP/1.1 Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 46 Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoo1gUWc-iDOKIefc5rPL-PHi80qcCKSaqkAyOEJdkpDll4rfQAReyPY9j2YxBqIRpz7HvxIhhMFklHnoAeOsEww1dbWfPdd-LIeZHMiUhimDK2JgpUdhct5gfsGfHqyuj-deFDWUKq-dlnxSdGFBXYGjBeMY3X0Gjjo99NjqF-vVk Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f1f9b47aca3845d6a3fc34662d34ccf1 Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1f9b47aca3845d6a3fc34662d34ccf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1f9b47aca3845d6a3fc34662d34ccf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f1f9b47aca3845d6a3fc34662d34ccf1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f1f9b47aca3845d6a3fc34662d34ccf1"}]}] Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f1f9b47aca3845d6a3fc34662d34ccf1 Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 609617a03387478b9b72cbe52d25dbf0 Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: {"addFloatingIp": {"address": "172.35.7.102"}} Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: exception: Cannot associate floating IP 172.35.7.102 (cb2863b9-15b5-45c4-b376-d4dda9c3cbe1) with port 97a627ed-c505-4f6c-bbfa-dc20aead138c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 8579c075-4b43-4770-8663-784dffc99102. Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-98bf3419-b762-4f8a-ac69-2404882dbbcc'] Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2101e27e-ab36-4af3-9f29-3a448a6cfc73', 'body': {'addFloatingIp': {'address': '172.35.7.102'}}} Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:57:44.401894 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.7.102 (cb2863b9-15b5-45c4-b376-d4dda9c3cbe1) with port 97a627ed-c505-4f6c-bbfa-dc20aead138c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 8579c075-4b43-4770-8663-784dffc99102. Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98bf3419-b762-4f8a-ac69-2404882dbbcc'] Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.7.102 (cb2863b9-15b5-45c4-b376-d4dda9c3cbe1) with port 97a627ed-c505-4f6c-bbfa-dc20aead138c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 8579c075-4b43-4770-8663-784dffc99102. Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98bf3419-b762-4f8a-ac69-2404882dbbcc'] Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.7.102 (cb2863b9-15b5-45c4-b376-d4dda9c3cbe1) with port 97a627ed-c505-4f6c-bbfa-dc20aead138c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 8579c075-4b43-4770-8663-784dffc99102. Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98bf3419-b762-4f8a-ac69-2404882dbbcc'] Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.7.102 (cb2863b9-15b5-45c4-b376-d4dda9c3cbe1) with port 97a627ed-c505-4f6c-bbfa-dc20aead138c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 8579c075-4b43-4770-8663-784dffc99102. Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98bf3419-b762-4f8a-ac69-2404882dbbcc'] Sep 10 20:57:44.405356 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:57:44.409797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Returning 400 to user: Cannot associate floating IP 172.35.7.102 (cb2863b9-15b5-45c4-b376-d4dda9c3cbe1) with port 97a627ed-c505-4f6c-bbfa-dc20aead138c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 8579c075-4b43-4770-8663-784dffc99102. Sep 10 20:57:44.409797 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-98bf3419-b762-4f8a-ac69-2404882dbbcc'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:57:44.411007 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be7410ba-c9ef-4755-8e79-4850836d1a69 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action" status: 400 len: 381 microversion: 2.1 time: 2.454061 Sep 10 20:57:44.411784 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1248/2580] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:41 2022] POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action => generated 381 bytes in 2456 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:57:44.427016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7b69a107-b29c-4739-888a-565b032fdaae tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:44.428009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7b69a107-b29c-4739-888a-565b032fdaae tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:44.448105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b69a107-b29c-4739-888a-565b032fdaae tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:44.448903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b69a107-b29c-4739-888a-565b032fdaae tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:44.449548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b69a107-b29c-4739-888a-565b032fdaae tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:44.450526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b69a107-b29c-4739-888a-565b032fdaae tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:44.451563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b69a107-b29c-4739-888a-565b032fdaae tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:44.452186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b69a107-b29c-4739-888a-565b032fdaae tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:44.500664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:44.926148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7b69a107-b29c-4739-888a-565b032fdaae tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:44.935637 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7b69a107-b29c-4739-888a-565b032fdaae tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1403 microversion: 2.1 time: 0.522564 Sep 10 20:57:44.958452 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1249/2581] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:44 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1403 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:44.976833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8bb5a2d8-7c55-4ac5-93f2-b2f0993201c7 req-70949b17-854e-434a-bc4b-93ec249882a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba630e24-db2e-474f-80f7-56ba4cbec4c2", "name": "network-vif-plugged", "status": "completed", "tag": "5a38418e-5af5-4900-8ec5-7795e632024b"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:45.012567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8bb5a2d8-7c55-4ac5-93f2-b2f0993201c7 req-70949b17-854e-434a-bc4b-93ec249882a6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:45.013058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8bb5a2d8-7c55-4ac5-93f2-b2f0993201c7 req-70949b17-854e-434a-bc4b-93ec249882a6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:45.016956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8bb5a2d8-7c55-4ac5-93f2-b2f0993201c7 req-70949b17-854e-434a-bc4b-93ec249882a6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:45.062832 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8bb5a2d8-7c55-4ac5-93f2-b2f0993201c7 req-70949b17-854e-434a-bc4b-93ec249882a6 service nova] Creating event network-vif-plugged:5a38418e-5af5-4900-8ec5-7795e632024b for instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 on nch1-master-1 Sep 10 20:57:45.072015 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8bb5a2d8-7c55-4ac5-93f2-b2f0993201c7 req-70949b17-854e-434a-bc4b-93ec249882a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112106 Sep 10 20:57:45.072712 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1250/2582] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:45.082965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-895864d3-72c6-4a63-9ce1-1ed371dbd033 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:45.083656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-895864d3-72c6-4a63-9ce1-1ed371dbd033 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:45.100162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895864d3-72c6-4a63-9ce1-1ed371dbd033 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:45.101388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895864d3-72c6-4a63-9ce1-1ed371dbd033 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:45.105586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895864d3-72c6-4a63-9ce1-1ed371dbd033 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:45.106401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895864d3-72c6-4a63-9ce1-1ed371dbd033 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:45.106877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895864d3-72c6-4a63-9ce1-1ed371dbd033 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:45.107314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895864d3-72c6-4a63-9ce1-1ed371dbd033 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:45.796999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-895864d3-72c6-4a63-9ce1-1ed371dbd033 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:45.812537 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-895864d3-72c6-4a63-9ce1-1ed371dbd033 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1506 microversion: 2.1 time: 0.738514 Sep 10 20:57:45.813137 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1251/2583] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:45 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1506 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:45.830208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-014fbf4e-85df-4f68-bfe5-91897b670fde tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99445eaa60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:52.169760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:52.246936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:54.050662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:54.244487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=37,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:55.105405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:55.816065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=11 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:57:57.222790 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5b3e4eb-25e5-4cde-a937-13d8cd10502c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1439 microversion: 2.1 time: 12.971814 Sep 10 20:57:57.227347 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-014fbf4e-85df-4f68-bfe5-91897b670fde tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1433 microversion: 2.1 time: 11.412945 Sep 10 20:57:57.228041 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1333/2584] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:44 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1439 bytes in 12978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:57.229453 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1252/2585] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:45 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1433 bytes in 11415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:57.236148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5ea9910-2a34-4b37-a3b9-fcf17a581e8a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '.version_select at 0x7f9944e51d30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:57.243070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:57.243830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:57.264529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:57.265065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:57.265531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:57.266276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:57.266741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:57.267182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:57.379571 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] HTTP exception thrown: Cannot 'detach_volume' instance 37fb692b-5186-4333-ad32-a567de472d62 while it is in vm_state rescued Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Request method failure captured: Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments/584966b6-2b79-498b-a36c-920cb089d0f8 HTTP/1.1 Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPlIfEE6BUsYm6N9cc6J4sKvQx8zkdVi0_eGxve7idCE5St69TEoXloNJQbmDpLOYE4kW76RSsXwzH4ER5m-rWYbak-zkdFvTsFOuE5UWRW73UCQGyOtVDm5s0CSvgZ9e1C_-bLDziBI_eeTxSX1Lq4xDS48kCIhpdBe8v0QA9iMeLw Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4b1732129f3414fbc3f26fff6d039ec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4b1732129f3414fbc3f26fff6d039ec"}]}] Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d8b0a160808f4adda7be57cd535f0631 Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: exception: Cannot 'detach_volume' instance 37fb692b-5186-4333-ad32-a567de472d62 while it is in vm_state rescued Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'server_id': '37fb692b-5186-4333-ad32-a567de472d62', 'id': '584966b6-2b79-498b-a36c-920cb089d0f8'} Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 37fb692b-5186-4333-ad32-a567de472d62 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 37fb692b-5186-4333-ad32-a567de472d62 while it is in vm_state rescued Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:57.382407 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:57:57.386896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:57:57.386896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:57:57.386896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:57:57.386896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:57:57.386896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 37fb692b-5186-4333-ad32-a567de472d62 while it is in vm_state rescued Sep 10 20:57:57.386896 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:57:57.388472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Returning 409 to user: Cannot 'detach_volume' instance 37fb692b-5186-4333-ad32-a567de472d62 while it is in vm_state rescued {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:57:57.389529 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aec1e13c-4007-4a64-a0a3-cf9aa2ca719a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments/584966b6-2b79-498b-a36c-920cb089d0f8" status: 409 len: 152 microversion: 2.1 time: 0.154440 Sep 10 20:57:57.390689 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1334/2586] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 20:57:57 2022] DELETE /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments/584966b6-2b79-498b-a36c-920cb089d0f8 => generated 152 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:57:57.396541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a22bc30-a392-4ac8-a3d9-e77b18e8543c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:57.398521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a22bc30-a392-4ac8-a3d9-e77b18e8543c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:57.408970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a22bc30-a392-4ac8-a3d9-e77b18e8543c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:57.409944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a22bc30-a392-4ac8-a3d9-e77b18e8543c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:57.410975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a22bc30-a392-4ac8-a3d9-e77b18e8543c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:57.412006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a22bc30-a392-4ac8-a3d9-e77b18e8543c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:57.412658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a22bc30-a392-4ac8-a3d9-e77b18e8543c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:57.414899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a22bc30-a392-4ac8-a3d9-e77b18e8543c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:57.618758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7a22bc30-a392-4ac8-a3d9-e77b18e8543c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:57.631163 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a22bc30-a392-4ac8-a3d9-e77b18e8543c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad" status: 200 len: 1317 microversion: 2.1 time: 0.239172 Sep 10 20:57:57.631784 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1335/2587] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:57 2022] GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:57.639475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:57.642587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:57.653069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:57.653909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:57.654355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:57.655587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:57.656339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:57.657139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:57.773358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:57:57.773971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:57:57.774532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:57:57.775232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:57:57.775645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:57:57.900501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:57.926307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:57.928269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:57.929516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:57.933476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:57.934569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:57.939583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:58.055117 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e86b7e00-af7c-4f76-af14-35cefd5978a9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "POST /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec/action" status: 202 len: 1112 microversion: 2.1 time: 0.414215 Sep 10 20:57:58.056354 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1336/2588] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:57 2022] POST /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec/action => generated 1112 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 20:57:58.062373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e30137ee-d92d-416b-894e-434e3c91943a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:58.063039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e30137ee-d92d-416b-894e-434e3c91943a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:58.071784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e30137ee-d92d-416b-894e-434e3c91943a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:58.072281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e30137ee-d92d-416b-894e-434e3c91943a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:58.072718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e30137ee-d92d-416b-894e-434e3c91943a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:58.073419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e30137ee-d92d-416b-894e-434e3c91943a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:58.073890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e30137ee-d92d-416b-894e-434e3c91943a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:58.074323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e30137ee-d92d-416b-894e-434e3c91943a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:58.114658 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5ea9910-2a34-4b37-a3b9-fcf17a581e8a tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/cb2863b9-15b5-45c4-b376-d4dda9c3cbe1" status: 202 len: 0 microversion: 2.1 time: 0.881507 Sep 10 20:57:58.120257 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1253/2589] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:57:57 2022] DELETE /compute/v2.1/os-floating-ips/cb2863b9-15b5-45c4-b376-d4dda9c3cbe1 => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:57:58.125365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-51dd7b8e-61f3-4e48-8276-93cd0e24c866 req-a3fa175b-6b81-4a43-bfcf-e15146244695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830cb245-7e91-4f1a-ae12-8010551e3aad", "tag": "3dedfaed-43ea-42a2-8915-2abec516acbe"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:58.137993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-51dd7b8e-61f3-4e48-8276-93cd0e24c866 req-a3fa175b-6b81-4a43-bfcf-e15146244695 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:58.138741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-51dd7b8e-61f3-4e48-8276-93cd0e24c866 req-a3fa175b-6b81-4a43-bfcf-e15146244695 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:58.139328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-51dd7b8e-61f3-4e48-8276-93cd0e24c866 req-a3fa175b-6b81-4a43-bfcf-e15146244695 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:58.152604 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-51dd7b8e-61f3-4e48-8276-93cd0e24c866 req-a3fa175b-6b81-4a43-bfcf-e15146244695 service nova] Creating event network-changed:3dedfaed-43ea-42a2-8915-2abec516acbe for instance 830cb245-7e91-4f1a-ae12-8010551e3aad on nch2-master-1 Sep 10 20:57:58.158374 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-51dd7b8e-61f3-4e48-8276-93cd0e24c866 req-a3fa175b-6b81-4a43-bfcf-e15146244695 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036543 Sep 10 20:57:58.159557 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1254/2590] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:58.285696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e30137ee-d92d-416b-894e-434e3c91943a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:58.290083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1730930390", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:58.296864 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e30137ee-d92d-416b-894e-434e3c91943a tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1589 microversion: 2.1 time: 0.238575 Sep 10 20:57:58.310594 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1337/2591] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:58 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1589 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:58.322342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-abd68473-5210-4337-8f29-440fac458ec5 req-9a6fae21-2c40-4b9c-acd7-4271145e0853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830cb245-7e91-4f1a-ae12-8010551e3aad", "name": "network-vif-plugged", "status": "completed", "tag": "3dedfaed-43ea-42a2-8915-2abec516acbe"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:58.333205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-abd68473-5210-4337-8f29-440fac458ec5 req-9a6fae21-2c40-4b9c-acd7-4271145e0853 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:58.333685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-abd68473-5210-4337-8f29-440fac458ec5 req-9a6fae21-2c40-4b9c-acd7-4271145e0853 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:58.334151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-abd68473-5210-4337-8f29-440fac458ec5 req-9a6fae21-2c40-4b9c-acd7-4271145e0853 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:58.348699 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-abd68473-5210-4337-8f29-440fac458ec5 req-9a6fae21-2c40-4b9c-acd7-4271145e0853 service nova] Creating event network-vif-plugged:3dedfaed-43ea-42a2-8915-2abec516acbe for instance 830cb245-7e91-4f1a-ae12-8010551e3aad on nch2-master-1 Sep 10 20:57:58.355088 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-abd68473-5210-4337-8f29-440fac458ec5 req-9a6fae21-2c40-4b9c-acd7-4271145e0853 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042942 Sep 10 20:57:58.356293 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1338/2592] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:58.363060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-123260a4-6dbb-4b79-a7ef-f31187835056 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944075940>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:58.400670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] validate_networks() for [('02a59e8f-361e-4af8-bf69-eada4df89fa4', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:57:58.462192 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-123260a4-6dbb-4b79-a7ef-f31187835056 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 200 len: 1433 microversion: 2.1 time: 0.103290 Sep 10 20:57:58.472572 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1339/2593] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:58 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 1433 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:58.478693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0d4a0432-3794-48a4-aa7e-14f0801ae883 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:58.479665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0d4a0432-3794-48a4-aa7e-14f0801ae883 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:58.487424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d4a0432-3794-48a4-aa7e-14f0801ae883 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:58.487919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d4a0432-3794-48a4-aa7e-14f0801ae883 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:58.488676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d4a0432-3794-48a4-aa7e-14f0801ae883 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:58.489567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d4a0432-3794-48a4-aa7e-14f0801ae883 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:58.490055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d4a0432-3794-48a4-aa7e-14f0801ae883 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:58.490660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d4a0432-3794-48a4-aa7e-14f0801ae883 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:58.568626 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0d4a0432-3794-48a4-aa7e-14f0801ae883 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/action" status: 202 len: 0 microversion: 2.1 time: 0.094305 Sep 10 20:57:58.569652 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1340/2594] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:58 2022] POST /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:57:58.578913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-48d76ffe-34fc-47d0-81e8-6f196ce95778 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:58.580052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-48d76ffe-34fc-47d0-81e8-6f196ce95778 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:58.590293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d76ffe-34fc-47d0-81e8-6f196ce95778 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:58.591009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d76ffe-34fc-47d0-81e8-6f196ce95778 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:58.591644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d76ffe-34fc-47d0-81e8-6f196ce95778 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:58.592525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d76ffe-34fc-47d0-81e8-6f196ce95778 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:58.593139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d76ffe-34fc-47d0-81e8-6f196ce95778 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:58.593883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48d76ffe-34fc-47d0-81e8-6f196ce95778 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:58.777798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-48d76ffe-34fc-47d0-81e8-6f196ce95778 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:58.795338 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-48d76ffe-34fc-47d0-81e8-6f196ce95778 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1517 microversion: 2.1 time: 0.220844 Sep 10 20:57:58.801928 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1341/2595] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:58 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:58.801928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Action: 'action', calling method: .version_select at 0x7f99467f1670>, body: {"removeFloatingIp": {"address": "172.35.7.136"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:57:59.193051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:57:59.193580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:57:59.194259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:57:59.194890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:57:59.195306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:57:59.206071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:59.206561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:59.207003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:59.207737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:59.208192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:59.208619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:59.227949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Getting quotas for project d640711fd8c64403adc4d7e7235a8fad. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:57:59.236041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Getting quotas for user 2bed1a15bbff41c6928afd3c057e7dfc and project d640711fd8c64403adc4d7e7235a8fad. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:57:59.249600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:57:59.252055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:57:59.279398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:59.287323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:59.289245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:59.289733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:59.290474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:59.290925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:59.291845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:59.315835 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7a696576-19af-4b6a-8adf-4a8da7e41dda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153604 Sep 10 20:57:59.316516 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1255/2596] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:57:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:57:59.322436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6aae623a-5571-420b-bd33-df805d748d4a tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9949684d30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:59.377695 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6aae623a-5571-420b-bd33-df805d748d4a tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1448 microversion: 2.1 time: 0.060136 Sep 10 20:57:59.378320 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1256/2597] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:57:59 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1448 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:59.383664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19320a98-2dd0-47a4-9b0c-e419561e0f73 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:59.384500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-19320a98-2dd0-47a4-9b0c-e419561e0f73 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:59.392137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19320a98-2dd0-47a4-9b0c-e419561e0f73 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:59.392642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19320a98-2dd0-47a4-9b0c-e419561e0f73 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:59.393587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19320a98-2dd0-47a4-9b0c-e419561e0f73 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:59.394355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19320a98-2dd0-47a4-9b0c-e419561e0f73 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:59.394955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19320a98-2dd0-47a4-9b0c-e419561e0f73 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:59.395399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19320a98-2dd0-47a4-9b0c-e419561e0f73 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:59.537037 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-19320a98-2dd0-47a4-9b0c-e419561e0f73 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157357 Sep 10 20:57:59.545208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1257/2598] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 20:57:59 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:57:59.547308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dfd7a9f9-ce7f-4015-b4ce-1b5293fe3938 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:59.547884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dfd7a9f9-ce7f-4015-b4ce-1b5293fe3938 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:59.554691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfd7a9f9-ce7f-4015-b4ce-1b5293fe3938 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:59.555447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfd7a9f9-ce7f-4015-b4ce-1b5293fe3938 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:59.555881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfd7a9f9-ce7f-4015-b4ce-1b5293fe3938 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:59.556760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfd7a9f9-ce7f-4015-b4ce-1b5293fe3938 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:59.557367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfd7a9f9-ce7f-4015-b4ce-1b5293fe3938 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:59.558021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dfd7a9f9-ce7f-4015-b4ce-1b5293fe3938 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:59.740236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dfd7a9f9-ce7f-4015-b4ce-1b5293fe3938 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:57:59.751505 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dfd7a9f9-ce7f-4015-b4ce-1b5293fe3938 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1467 microversion: 2.1 time: 0.207798 Sep 10 20:57:59.752752 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1258/2599] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:59 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1467 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:57:59.762260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 20:57:59.762260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquired lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 20:57:59.777650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b2bf6ddd-8817-4cd9-87d6-bb72d35cdb41 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:57:59.778988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b2bf6ddd-8817-4cd9-87d6-bb72d35cdb41 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:57:59.785971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bf6ddd-8817-4cd9-87d6-bb72d35cdb41 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:59.786770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bf6ddd-8817-4cd9-87d6-bb72d35cdb41 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:59.787445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bf6ddd-8817-4cd9-87d6-bb72d35cdb41 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:59.788599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bf6ddd-8817-4cd9-87d6-bb72d35cdb41 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:57:59.789623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bf6ddd-8817-4cd9-87d6-bb72d35cdb41 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:57:59.790294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bf6ddd-8817-4cd9-87d6-bb72d35cdb41 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:57:59.996835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b2bf6ddd-8817-4cd9-87d6-bb72d35cdb41 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:00.009752 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b2bf6ddd-8817-4cd9-87d6-bb72d35cdb41 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1722 microversion: 2.1 time: 0.235347 Sep 10 20:58:00.010812 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1259/2600] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:57:59 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:00.016700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8e95cc4-f05f-456e-9ee0-90ac842c93ff tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:00.017706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8e95cc4-f05f-456e-9ee0-90ac842c93ff tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:00.024421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e95cc4-f05f-456e-9ee0-90ac842c93ff tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:00.025712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e95cc4-f05f-456e-9ee0-90ac842c93ff tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:00.026414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e95cc4-f05f-456e-9ee0-90ac842c93ff tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:00.027194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e95cc4-f05f-456e-9ee0-90ac842c93ff tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:00.027846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e95cc4-f05f-456e-9ee0-90ac842c93ff tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:00.028282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8e95cc4-f05f-456e-9ee0-90ac842c93ff tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:00.181105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8e95cc4-f05f-456e-9ee0-90ac842c93ff tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:00.190287 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8e95cc4-f05f-456e-9ee0-90ac842c93ff tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad" status: 200 len: 1466 microversion: 2.1 time: 0.177941 Sep 10 20:58:00.191039 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1260/2601] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:00 2022] GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad => generated 1466 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:00.196160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-01489c66-086f-49a2-b181-1b29f392ff1f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:00.197036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-01489c66-086f-49a2-b181-1b29f392ff1f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:00.203615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01489c66-086f-49a2-b181-1b29f392ff1f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:00.204441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01489c66-086f-49a2-b181-1b29f392ff1f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:00.205206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01489c66-086f-49a2-b181-1b29f392ff1f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:00.206204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01489c66-086f-49a2-b181-1b29f392ff1f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:00.206891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01489c66-086f-49a2-b181-1b29f392ff1f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:00.207871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01489c66-086f-49a2-b181-1b29f392ff1f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:00.283553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-01489c66-086f-49a2-b181-1b29f392ff1f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:00.295027 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-01489c66-086f-49a2-b181-1b29f392ff1f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1269 microversion: 2.1 time: 0.102858 Sep 10 20:58:00.296273 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1261/2602] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:00 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:00.302562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bbfb76ad-00ab-450b-bccf-102d674b95d1 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f994510e280>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:00.357547 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bbfb76ad-00ab-450b-bccf-102d674b95d1 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 200 len: 1448 microversion: 2.1 time: 0.059846 Sep 10 20:58:00.358246 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1262/2603] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:00 2022] GET /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 1448 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:00.363181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-720a15cd-59b3-44a0-89fc-7510bada9c96 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944e5fca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:00.408079 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-720a15cd-59b3-44a0-89fc-7510bada9c96 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/b43a7a8a-2616-430e-9e50-ef93c087ed12" status: 200 len: 784 microversion: 2.1 time: 0.048876 Sep 10 20:58:00.408763 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1263/2604] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:00 2022] GET /compute/v2.1/images/b43a7a8a-2616-430e-9e50-ef93c087ed12 => generated 784 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:00.414069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aa1a45ad-45fc-4bab-849b-e624ae1ad976 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:00.414687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aa1a45ad-45fc-4bab-849b-e624ae1ad976 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:00.422979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa1a45ad-45fc-4bab-849b-e624ae1ad976 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:00.423591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa1a45ad-45fc-4bab-849b-e624ae1ad976 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:00.424179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa1a45ad-45fc-4bab-849b-e624ae1ad976 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:00.424895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa1a45ad-45fc-4bab-849b-e624ae1ad976 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:00.425353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa1a45ad-45fc-4bab-849b-e624ae1ad976 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:00.425785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa1a45ad-45fc-4bab-849b-e624ae1ad976 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:00.562120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aa1a45ad-45fc-4bab-849b-e624ae1ad976 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:00.571274 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aa1a45ad-45fc-4bab-849b-e624ae1ad976 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1517 microversion: 2.1 time: 0.161438 Sep 10 20:58:00.571804 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1264/2605] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:00 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:00.659137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-30c859d4-32b0-44e2-a72c-834062efb7df tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:00.659769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-30c859d4-32b0-44e2-a72c-834062efb7df tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:00.666866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30c859d4-32b0-44e2-a72c-834062efb7df tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:00.667402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30c859d4-32b0-44e2-a72c-834062efb7df tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:00.667982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30c859d4-32b0-44e2-a72c-834062efb7df tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:00.668707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30c859d4-32b0-44e2-a72c-834062efb7df tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:00.669171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30c859d4-32b0-44e2-a72c-834062efb7df tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:00.669604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30c859d4-32b0-44e2-a72c-834062efb7df tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:01.112176 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-30c859d4-32b0-44e2-a72c-834062efb7df tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad" status: 200 len: 1617 microversion: 2.1 time: 0.539300 Sep 10 20:58:01.125171 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1265/2606] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:00 2022] GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad => generated 1617 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:01.125171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-18008286-6cf3-4605-81e0-ee8b723389f9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944c1aaf0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:01.370610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Building network info cache for instance {{(pid=145772) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 20:58:01.786369 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-18008286-6cf3-4605-81e0-ee8b723389f9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 204 len: 0 microversion: 2.1 time: 0.672466 Sep 10 20:58:01.787673 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1266/2607] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:01 2022] DELETE /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:01.793709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-635d7761-8213-498e-b01f-6795a0cf116c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:01.815087 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-635d7761-8213-498e-b01f-6795a0cf116c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026248 Sep 10 20:58:01.816123 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1267/2608] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:58:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:01.828085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3cec9bc0-372c-40f4-96f6-8d6f49182221 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:01.832819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3cec9bc0-372c-40f4-96f6-8d6f49182221 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:01.852837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cec9bc0-372c-40f4-96f6-8d6f49182221 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:01.854555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cec9bc0-372c-40f4-96f6-8d6f49182221 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:01.858331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cec9bc0-372c-40f4-96f6-8d6f49182221 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:01.859251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cec9bc0-372c-40f4-96f6-8d6f49182221 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:01.859970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cec9bc0-372c-40f4-96f6-8d6f49182221 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:01.860519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cec9bc0-372c-40f4-96f6-8d6f49182221 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:02.188092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3cec9bc0-372c-40f4-96f6-8d6f49182221 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:02.201214 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3cec9bc0-372c-40f4-96f6-8d6f49182221 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1722 microversion: 2.1 time: 0.382932 Sep 10 20:58:02.214146 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1268/2609] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:01 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1722 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:02.218303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ad1b4fba-acaa-47d7-befe-93a84957ec74 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Action: 'create', calling method: .version_select at 0x7f9944da6af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-21852399", "policies": ["affinity"]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:02.240145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Updating instance_info_cache with network_info: [{"id": "97a627ed-c505-4f6c-bbfa-dc20aead138c", "address": "fa:16:3e:86:db:3d", "network": {"id": "8ebd484f-aa16-4b34-a7ba-62aa8d6c126a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-817816172-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1f9b47aca3845d6a3fc34662d34ccf1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap97a627ed-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=145772) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 20:58:02.259563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Releasing lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 20:58:02.260586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-ad1b4fba-acaa-47d7-befe-93a84957ec74 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:02.260994 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a2fac13-41a8-4324-aff0-aee932f5396b tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action" status: 202 len: 0 microversion: 2.1 time: 3.463495 Sep 10 20:58:02.261762 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1342/2610] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:57:58 2022] POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action => generated 0 bytes in 3465 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 20:58:02.268609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-73bd6ad2-799f-45c7-8748-968cf79747e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:02.269448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-73bd6ad2-799f-45c7-8748-968cf79747e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:02.279425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73bd6ad2-799f-45c7-8748-968cf79747e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:02.280339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-ad1b4fba-acaa-47d7-befe-93a84957ec74 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:02.280715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73bd6ad2-799f-45c7-8748-968cf79747e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:02.281323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73bd6ad2-799f-45c7-8748-968cf79747e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:02.282622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73bd6ad2-799f-45c7-8748-968cf79747e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:02.283796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73bd6ad2-799f-45c7-8748-968cf79747e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:02.284392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73bd6ad2-799f-45c7-8748-968cf79747e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:02.358465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-ad1b4fba-acaa-47d7-befe-93a84957ec74 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:02.367893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-ad1b4fba-acaa-47d7-befe-93a84957ec74 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_groups'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:02.390059 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ad1b4fba-acaa-47d7-befe-93a84957ec74 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.184360 Sep 10 20:58:02.390959 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1269/2611] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Sep 10 20:58:02 2022] POST /compute/v2.1/os-server-groups => generated 186 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:02.396095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5c470d68-fda7-4177-8d06-948c69434ff2 req-3479737c-86e0-44ac-a58a-b0945ffa8932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2101e27e-ab36-4af3-9f29-3a448a6cfc73", "tag": "97a627ed-c505-4f6c-bbfa-dc20aead138c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:02.410545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5c470d68-fda7-4177-8d06-948c69434ff2 req-3479737c-86e0-44ac-a58a-b0945ffa8932 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:02.411271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5c470d68-fda7-4177-8d06-948c69434ff2 req-3479737c-86e0-44ac-a58a-b0945ffa8932 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:02.412625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5c470d68-fda7-4177-8d06-948c69434ff2 req-3479737c-86e0-44ac-a58a-b0945ffa8932 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:02.431043 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5c470d68-fda7-4177-8d06-948c69434ff2 req-3479737c-86e0-44ac-a58a-b0945ffa8932 service nova] Creating event network-changed:97a627ed-c505-4f6c-bbfa-dc20aead138c for instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 on nch1-master-1 Sep 10 20:58:02.451852 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5c470d68-fda7-4177-8d06-948c69434ff2 req-3479737c-86e0-44ac-a58a-b0945ffa8932 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057448 Sep 10 20:58:02.454730 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1270/2612] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:02.475637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29070d5a-efff-495f-9c90-261d08c85324 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:02.477402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-29070d5a-efff-495f-9c90-261d08c85324 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:02.495447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29070d5a-efff-495f-9c90-261d08c85324 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:02.496375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29070d5a-efff-495f-9c90-261d08c85324 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:02.497158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29070d5a-efff-495f-9c90-261d08c85324 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:02.498449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29070d5a-efff-495f-9c90-261d08c85324 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:02.499151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29070d5a-efff-495f-9c90-261d08c85324 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:02.499727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29070d5a-efff-495f-9c90-261d08c85324 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:02.547681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-73bd6ad2-799f-45c7-8748-968cf79747e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:02.557272 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-73bd6ad2-799f-45c7-8748-968cf79747e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1317 microversion: 2.1 time: 0.294222 Sep 10 20:58:02.557884 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1343/2613] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:02 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:02.563899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d43f3d1-1f82-48f4-beaa-4481ec8ec926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:02.564614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7d43f3d1-1f82-48f4-beaa-4481ec8ec926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:02.572717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43f3d1-1f82-48f4-beaa-4481ec8ec926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:02.573484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43f3d1-1f82-48f4-beaa-4481ec8ec926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:02.574309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43f3d1-1f82-48f4-beaa-4481ec8ec926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:02.575395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43f3d1-1f82-48f4-beaa-4481ec8ec926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:02.575999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43f3d1-1f82-48f4-beaa-4481ec8ec926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:02.578297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d43f3d1-1f82-48f4-beaa-4481ec8ec926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:02.614227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7d43f3d1-1f82-48f4-beaa-4481ec8ec926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:58:02.724753 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7d43f3d1-1f82-48f4-beaa-4481ec8ec926 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 204 len: 0 microversion: 2.1 time: 0.165212 Sep 10 20:58:02.726155 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1344/2614] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:02 2022] DELETE /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:02.736478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-29070d5a-efff-495f-9c90-261d08c85324 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:02.747780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5919c965-ed31-4f98-a0e5-d0ac80192751 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f993ffe45e0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:02.752689 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-29070d5a-efff-495f-9c90-261d08c85324 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1517 microversion: 2.1 time: 0.296470 Sep 10 20:58:02.768483 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1271/2615] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:02 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1517 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:02.773878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9849db45-bf1f-4ffc-a4f9-1cde1a5e5dba tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:02.783601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9849db45-bf1f-4ffc-a4f9-1cde1a5e5dba tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:02.794439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9849db45-bf1f-4ffc-a4f9-1cde1a5e5dba tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:02.795067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9849db45-bf1f-4ffc-a4f9-1cde1a5e5dba tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:02.799605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9849db45-bf1f-4ffc-a4f9-1cde1a5e5dba tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:02.800397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9849db45-bf1f-4ffc-a4f9-1cde1a5e5dba tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:02.800881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9849db45-bf1f-4ffc-a4f9-1cde1a5e5dba tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:02.801324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9849db45-bf1f-4ffc-a4f9-1cde1a5e5dba tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:03.152336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9849db45-bf1f-4ffc-a4f9-1cde1a5e5dba tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:03.161248 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9849db45-bf1f-4ffc-a4f9-1cde1a5e5dba tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1589 microversion: 2.1 time: 0.391590 Sep 10 20:58:03.174253 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1272/2616] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:02 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1589 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:03.194487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-def9b834-ccfc-41e9-bc5e-7ef90d0d8ff5 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '.version_select at 0x7f99494e29d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:03.522965 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5919c965-ed31-4f98-a0e5-d0ac80192751 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "DELETE /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 204 len: 0 microversion: 2.1 time: 0.794223 Sep 10 20:58:03.531406 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1345/2617] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:02 2022] DELETE /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 0 bytes in 797 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:03.538930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1807414454", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "232b9ea3-3351-4a5d-87e3-b7519b40cd27"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:03.617415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:58:03.867787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:58:03.868386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:58:03.869001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:58:03.869568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:58:03.870169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:58:03.885955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:03.886372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:03.886808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:03.887602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:03.887973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:03.888395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:03.911951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:03.920075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:03.938292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Going to run 2 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:58:03.940796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 4f5284d9-8123-4e15-8576-be144c016b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:58:03.989458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=145772) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 10 20:58:04.011095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:04.017187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:04.071566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:04.078814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:04.095225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=4f5284d9-8123-4e15-8576-be144c016b44,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:58:04.149510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:04.155679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:04.192777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:04.198599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:04.201084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:04.237700 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-28f29157-8ed9-4cf0-b79d-03b59754b5c2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.704640 Sep 10 20:58:04.241846 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1346/2618] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:03 2022] POST /compute/v2.1/servers => generated 32 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 10 20:58:04.244696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-665cd334-dd6f-43ad-bc9e-4b8c8baba1b5 req-e3c66dd7-35e2-472f-858f-ea0975518e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35f1515-600f-4bea-850a-28ce09db77fb", "name": "network-vif-unplugged", "status": "completed", "tag": "ac0ed0f0-5842-4c84-a7f5-f1d58d027926"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:04.256284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-665cd334-dd6f-43ad-bc9e-4b8c8baba1b5 req-e3c66dd7-35e2-472f-858f-ea0975518e85 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:04.257864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-665cd334-dd6f-43ad-bc9e-4b8c8baba1b5 req-e3c66dd7-35e2-472f-858f-ea0975518e85 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:04.258497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-665cd334-dd6f-43ad-bc9e-4b8c8baba1b5 req-e3c66dd7-35e2-472f-858f-ea0975518e85 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:04.270020 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-665cd334-dd6f-43ad-bc9e-4b8c8baba1b5 req-e3c66dd7-35e2-472f-858f-ea0975518e85 service nova] Creating event network-vif-unplugged:ac0ed0f0-5842-4c84-a7f5-f1d58d027926 for instance f35f1515-600f-4bea-850a-28ce09db77fb on nch1-master-1 Sep 10 20:58:04.275227 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-665cd334-dd6f-43ad-bc9e-4b8c8baba1b5 req-e3c66dd7-35e2-472f-858f-ea0975518e85 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035513 Sep 10 20:58:04.275986 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1347/2619] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:04.280954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1597419205", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "fb7a08eb-859f-4d5a-a729-24ed5c968d62"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:04.344850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] validate_networks() for [('fb7a08eb-859f-4d5a-a729-24ed5c968d62', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:58:04.662686 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-def9b834-ccfc-41e9-bc5e-7ef90d0d8ff5 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/aaff75f7-6daa-4d3b-a4b5-ec2ecba5ce18" status: 202 len: 0 microversion: 2.1 time: 1.472296 Sep 10 20:58:04.668589 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1273/2620] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:58:03 2022] DELETE /compute/v2.1/os-floating-ips/aaff75f7-6daa-4d3b-a4b5-ec2ecba5ce18 => generated 0 bytes in 1488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:58:04.670376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8dbb156d-bcf2-4621-a594-4a1cc434946d req-28f9cd36-e057-4b4c-83ec-5b2aba713772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfdc13f-9c2e-44ec-8553-3f779ead89af", "tag": "b18a22e2-b050-417e-bebb-2f9e983473cc"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:04.683527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8dbb156d-bcf2-4621-a594-4a1cc434946d req-28f9cd36-e057-4b4c-83ec-5b2aba713772 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:04.684005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8dbb156d-bcf2-4621-a594-4a1cc434946d req-28f9cd36-e057-4b4c-83ec-5b2aba713772 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:04.684614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8dbb156d-bcf2-4621-a594-4a1cc434946d req-28f9cd36-e057-4b4c-83ec-5b2aba713772 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:04.697335 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8dbb156d-bcf2-4621-a594-4a1cc434946d req-28f9cd36-e057-4b4c-83ec-5b2aba713772 service nova] Creating event network-changed:b18a22e2-b050-417e-bebb-2f9e983473cc for instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af on nch2-master-1 Sep 10 20:58:04.704715 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8dbb156d-bcf2-4621-a594-4a1cc434946d req-28f9cd36-e057-4b4c-83ec-5b2aba713772 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039673 Sep 10 20:58:04.706397 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1274/2621] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:04.712564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b5c2100a-099e-44a6-b310-20605d02acb0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:04.713739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b5c2100a-099e-44a6-b310-20605d02acb0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:04.721072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5c2100a-099e-44a6-b310-20605d02acb0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:04.721668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5c2100a-099e-44a6-b310-20605d02acb0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:04.722242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5c2100a-099e-44a6-b310-20605d02acb0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:04.723456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5c2100a-099e-44a6-b310-20605d02acb0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:04.724016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5c2100a-099e-44a6-b310-20605d02acb0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:04.724551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5c2100a-099e-44a6-b310-20605d02acb0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:04.862481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:58:04.863544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:58:04.864204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:58:04.864776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:58:04.865361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:58:04.872704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b5c2100a-099e-44a6-b310-20605d02acb0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:04.878589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:04.879276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:04.879926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:04.880906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:04.882385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:04.883198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:04.883513 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b5c2100a-099e-44a6-b310-20605d02acb0 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1728 microversion: 2.1 time: 0.175615 Sep 10 20:58:04.884151 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1275/2622] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:04 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:04.895650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-74ae835d-4283-4447-b6af-ead7f9cd5dab tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99451c2940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:04.901056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Getting quotas for project e8f7f9f3112545e9b40d88a7cc48e3fe. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:04.907294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Getting quotas for user 687eef270165450a97b4d260b2724b3e and project e8f7f9f3112545e9b40d88a7cc48e3fe. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:04.918812 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-74ae835d-4283-4447-b6af-ead7f9cd5dab tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] HTTP exception thrown: Image not found. Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-74ae835d-4283-4447-b6af-ead7f9cd5dab tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Request method failure captured: Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a HTTP/1.1 Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoaVDQ-b_fnkbnF7M2jkEwVfDjJN_Vn5x7oW3jJI-nVWL2pT82So-Px_Dvw8CAiaBIi7499tWWWYA0nX2gGrY__KCYJwnHBu8jnCpNdnSWXCmcEWV90OT7V9CZDsYXBUFYA0ZpT5YeFeyASDrJ1RSsCzKVxWA--0yuh3AfIgDFuyp4 Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f57a1c44d4684b2fa210973f062adbce Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesOneServerTestJSON-1495268422 Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f57a1c44d4684b2fa210973f062adbce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f57a1c44d4684b2fa210973f062adbce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f57a1c44d4684b2fa210973f062adbce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f57a1c44d4684b2fa210973f062adbce"}]}] Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesOneServerTestJSON-1495268422 Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f57a1c44d4684b2fa210973f062adbce Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1495268422 Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesOneServerTestJSON-1495268422-project Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: bec33de4067d4b1bb6e4ad866ddf2d01 Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesOneServerTestJSON-1495268422-project Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7e8414ee-3c00-47fc-8929-8994dd26c47a'} Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7e8414ee-3c00-47fc-8929-8994dd26c47a Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 20:58:04.920950 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7e8414ee-3c00-47fc-8929-8994dd26c47a could not be found. Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:04.925415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-74ae835d-4283-4447-b6af-ead7f9cd5dab tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:04.936270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:58:04.936404 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-74ae835d-4283-4447-b6af-ead7f9cd5dab tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 404 len: 62 microversion: 2.1 time: 0.037706 Sep 10 20:58:04.936404 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1276/2623] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:04 2022] GET /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:58:04.936624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:58:04.936756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a058c151-fea3-4ade-b6d8-29b726090f72 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:04.936756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a058c151-fea3-4ade-b6d8-29b726090f72 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:04.941744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a058c151-fea3-4ade-b6d8-29b726090f72 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:04.942707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a058c151-fea3-4ade-b6d8-29b726090f72 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:04.942970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a058c151-fea3-4ade-b6d8-29b726090f72 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:04.944751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a058c151-fea3-4ade-b6d8-29b726090f72 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:04.945336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a058c151-fea3-4ade-b6d8-29b726090f72 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:04.945771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a058c151-fea3-4ade-b6d8-29b726090f72 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:04.990839 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4a27c9be-bea7-424d-9343-d10441544b13 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713779 Sep 10 20:58:04.991982 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1348/2624] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:58:04.997794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-955cef08-17c0-49fb-8922-1e0e587177a2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:04.998922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-955cef08-17c0-49fb-8922-1e0e587177a2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:05.007003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-955cef08-17c0-49fb-8922-1e0e587177a2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.007596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-955cef08-17c0-49fb-8922-1e0e587177a2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.008391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-955cef08-17c0-49fb-8922-1e0e587177a2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.009258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-955cef08-17c0-49fb-8922-1e0e587177a2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.009792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-955cef08-17c0-49fb-8922-1e0e587177a2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.010332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-955cef08-17c0-49fb-8922-1e0e587177a2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.150581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a058c151-fea3-4ade-b6d8-29b726090f72 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:05.166064 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a058c151-fea3-4ade-b6d8-29b726090f72 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1317 microversion: 2.1 time: 0.241378 Sep 10 20:58:05.166724 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1277/2625] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:04 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:05.179615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:05.188655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:05.189713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Searching by: {'deleted': False, 'project_id': 'd30ef9b7525e4784be26268f46121e62'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:58:05.200591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.201333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.201995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.203548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.205554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.207038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.276735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-955cef08-17c0-49fb-8922-1e0e587177a2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:05.279135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:05.299094 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-955cef08-17c0-49fb-8922-1e0e587177a2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1517 microversion: 2.1 time: 0.303554 Sep 10 20:58:05.299723 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1349/2626] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:04 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1517 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:05.334461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:58:05.339644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0487c041-38ff-43ed-bf0b-f2332b62dbe9 req-222cc286-6d8b-4e71-b1a0-f9d2d5991e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba630e24-db2e-474f-80f7-56ba4cbec4c2", "tag": "5a38418e-5af5-4900-8ec5-7795e632024b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:05.375840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0487c041-38ff-43ed-bf0b-f2332b62dbe9 req-222cc286-6d8b-4e71-b1a0-f9d2d5991e90 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.384480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0487c041-38ff-43ed-bf0b-f2332b62dbe9 req-222cc286-6d8b-4e71-b1a0-f9d2d5991e90 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.385287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0487c041-38ff-43ed-bf0b-f2332b62dbe9 req-222cc286-6d8b-4e71-b1a0-f9d2d5991e90 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.420530 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0487c041-38ff-43ed-bf0b-f2332b62dbe9 req-222cc286-6d8b-4e71-b1a0-f9d2d5991e90 service nova] Creating event network-changed:5a38418e-5af5-4900-8ec5-7795e632024b for instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 on nch1-master-1 Sep 10 20:58:05.443018 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0487c041-38ff-43ed-bf0b-f2332b62dbe9 req-222cc286-6d8b-4e71-b1a0-f9d2d5991e90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139131 Sep 10 20:58:05.447678 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1350/2627] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:05.457606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4afc3d10-455d-4cc6-96a1-406950b67fec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4afc3d10-455d-4cc6-96a1-406950b67fec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Request method failure captured: Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action HTTP/1.1 Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 34 Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPoo1gUWc-iDOKIefc5rPL-PHi80qcCKSaqkAyOEJdkpDll4rfQAReyPY9j2YxBqIRpz7HvxIhhMFklHnoAeOsEww1dbWfPdd-LIeZHMiUhimDK2JgpUdhct5gfsGfHqyuj-deFDWUKq-dlnxSdGFBXYGjBeMY3X0Gjjo99NjqF-vVk Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f1f9b47aca3845d6a3fc34662d34ccf1 Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1f9b47aca3845d6a3fc34662d34ccf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1f9b47aca3845d6a3fc34662d34ccf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f1f9b47aca3845d6a3fc34662d34ccf1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f1f9b47aca3845d6a3fc34662d34ccf1"}]}] Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f1f9b47aca3845d6a3fc34662d34ccf1 Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 609617a03387478b9b72cbe52d25dbf0 Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: {"addFloatingIp": {"address": ""}} Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2101e27e-ab36-4af3-9f29-3a448a6cfc73', 'body': {'addFloatingIp': {'address': ''}}} Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi '' Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:58:05.462837 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 10 20:58:05.467426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:05.473339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4afc3d10-455d-4cc6-96a1-406950b67fec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:05.474408 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4afc3d10-455d-4cc6-96a1-406950b67fec tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action" status: 400 len: 142 microversion: 2.1 time: 0.025426 Sep 10 20:58:05.480228 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1351/2628] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:58:05 2022] POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action => generated 142 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:58:05.490736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1cb4ce3b-8c12-4019-a7bd-257fa16ee9ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:05.495377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1cb4ce3b-8c12-4019-a7bd-257fa16ee9ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:05.516653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cb4ce3b-8c12-4019-a7bd-257fa16ee9ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.517251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cb4ce3b-8c12-4019-a7bd-257fa16ee9ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.517711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cb4ce3b-8c12-4019-a7bd-257fa16ee9ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.518499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cb4ce3b-8c12-4019-a7bd-257fa16ee9ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.518980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cb4ce3b-8c12-4019-a7bd-257fa16ee9ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.519410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cb4ce3b-8c12-4019-a7bd-257fa16ee9ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.548829 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-75f72fe5-1a3f-4d8a-9202-b8a9979da74c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.378202 Sep 10 20:58:05.549861 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1278/2629] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 20:58:05 2022] GET /compute/v2.1/servers => generated 1004 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:05.555630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-00aa8430-f52e-4007-bf08-6520b98b6090 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2017934244"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:05.563452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-00aa8430-f52e-4007-bf08-6520b98b6090 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:05.594963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00aa8430-f52e-4007-bf08-6520b98b6090 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.595470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00aa8430-f52e-4007-bf08-6520b98b6090 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.595923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00aa8430-f52e-4007-bf08-6520b98b6090 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.596660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00aa8430-f52e-4007-bf08-6520b98b6090 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.597097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00aa8430-f52e-4007-bf08-6520b98b6090 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.597796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00aa8430-f52e-4007-bf08-6520b98b6090 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.730816 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1cb4ce3b-8c12-4019-a7bd-257fa16ee9ce tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.247107 Sep 10 20:58:05.732366 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1352/2630] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 20:58:05 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:05.747221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-760009f7-c7f1-49bf-86da-e9bb463c5c90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:05.750232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-760009f7-c7f1-49bf-86da-e9bb463c5c90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:05.763378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-760009f7-c7f1-49bf-86da-e9bb463c5c90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.764645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-760009f7-c7f1-49bf-86da-e9bb463c5c90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.766603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-760009f7-c7f1-49bf-86da-e9bb463c5c90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.767422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-760009f7-c7f1-49bf-86da-e9bb463c5c90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:05.768540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-760009f7-c7f1-49bf-86da-e9bb463c5c90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:05.769085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-760009f7-c7f1-49bf-86da-e9bb463c5c90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:05.984281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:05.996157 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-00aa8430-f52e-4007-bf08-6520b98b6090 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "POST /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64/action" status: 202 len: 0 microversion: 2.1 time: 0.444958 Sep 10 20:58:05.997184 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1279/2631] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:58:05 2022] POST /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 20:58:06.004454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:06.007995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:06.021417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.023310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.024701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.025687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.030561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.031216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.080487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 20:58:06.081959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquired lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 20:58:06.250642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-760009f7-c7f1-49bf-86da-e9bb463c5c90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:06.261569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Releasing lock "refresh_cache-2101e27e-ab36-4af3-9f29-3a448a6cfc73" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 20:58:06.262525 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] HTTP exception thrown: floating IP not found Sep 10 20:58:06.262773 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-760009f7-c7f1-49bf-86da-e9bb463c5c90 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1212 microversion: 2.1 time: 0.528755 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Request method failure captured: Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action HTTP/1.1 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 41 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoo1gUWc-iDOKIefc5rPL-PHi80qcCKSaqkAyOEJdkpDll4rfQAReyPY9j2YxBqIRpz7HvxIhhMFklHnoAeOsEww1dbWfPdd-LIeZHMiUhimDK2JgpUdhct5gfsGfHqyuj-deFDWUKq-dlnxSdGFBXYGjBeMY3X0Gjjo99NjqF-vVk Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f1f9b47aca3845d6a3fc34662d34ccf1 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1f9b47aca3845d6a3fc34662d34ccf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1f9b47aca3845d6a3fc34662d34ccf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f1f9b47aca3845d6a3fc34662d34ccf1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f1f9b47aca3845d6a3fc34662d34ccf1"}]}] Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f1f9b47aca3845d6a3fc34662d34ccf1 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 609617a03387478b9b72cbe52d25dbf0 Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: exception: floating IP not found Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2101e27e-ab36-4af3-9f29-3a448a6cfc73', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 10 20:58:06.264913 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:06.269785 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:06.269785 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:06.269785 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:06.269785 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:06.269785 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:06.269785 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:06.269785 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:06.269785 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 10 20:58:06.269785 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:06.269785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Returning 404 to user: floating IP not found {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:06.271342 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1353/2632] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:05 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1212 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:06.271568 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1d2e8282-8928-4d46-98c8-8c45274c5a68 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action" status: 404 len: 67 microversion: 2.1 time: 0.271752 Sep 10 20:58:06.273226 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1280/2633] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:58:05 2022] POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action => generated 67 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:58:06.279719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8a3cb020-be2e-4900-b70d-65e1666e426e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:06.280732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8a3cb020-be2e-4900-b70d-65e1666e426e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:06.290902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a3cb020-be2e-4900-b70d-65e1666e426e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.291902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a3cb020-be2e-4900-b70d-65e1666e426e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.292787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a3cb020-be2e-4900-b70d-65e1666e426e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.294657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a3cb020-be2e-4900-b70d-65e1666e426e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.296625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a3cb020-be2e-4900-b70d-65e1666e426e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.297243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a3cb020-be2e-4900-b70d-65e1666e426e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.301151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3949466f-28cd-4045-b908-42aecb41af8b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f993ff82c10>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:06.372886 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3949466f-28cd-4045-b908-42aecb41af8b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.087741 Sep 10 20:58:06.374229 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1354/2634] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:06 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:06.378981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ce2d96a-f49b-4839-b7e7-86dcd11c8c07 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:06.379743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6ce2d96a-f49b-4839-b7e7-86dcd11c8c07 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:06.392071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce2d96a-f49b-4839-b7e7-86dcd11c8c07 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.392745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce2d96a-f49b-4839-b7e7-86dcd11c8c07 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.393374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce2d96a-f49b-4839-b7e7-86dcd11c8c07 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.394365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce2d96a-f49b-4839-b7e7-86dcd11c8c07 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.395263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce2d96a-f49b-4839-b7e7-86dcd11c8c07 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.395923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce2d96a-f49b-4839-b7e7-86dcd11c8c07 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.446218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8a3cb020-be2e-4900-b70d-65e1666e426e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:06.456220 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8a3cb020-be2e-4900-b70d-65e1666e426e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1215 microversion: 2.1 time: 0.181412 Sep 10 20:58:06.457343 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1281/2635] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:06 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:06.479290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f15a859-a7e8-4952-adb8-941e83ea3c55 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Action: 'action', calling method: .version_select at 0x7f99467e50d0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:06.695750 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-3f15a859-a7e8-4952-adb8-941e83ea3c55 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f15a859-a7e8-4952-adb8-941e83ea3c55 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Request method failure captured: Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action HTTP/1.1 Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 44 Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoo1gUWc-iDOKIefc5rPL-PHi80qcCKSaqkAyOEJdkpDll4rfQAReyPY9j2YxBqIRpz7HvxIhhMFklHnoAeOsEww1dbWfPdd-LIeZHMiUhimDK2JgpUdhct5gfsGfHqyuj-deFDWUKq-dlnxSdGFBXYGjBeMY3X0Gjjo99NjqF-vVk Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f1f9b47aca3845d6a3fc34662d34ccf1 Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1f9b47aca3845d6a3fc34662d34ccf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1f9b47aca3845d6a3fc34662d34ccf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f1f9b47aca3845d6a3fc34662d34ccf1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f1f9b47aca3845d6a3fc34662d34ccf1"}]}] Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f1f9b47aca3845d6a3fc34662d34ccf1 Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 609617a03387478b9b72cbe52d25dbf0 Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: exception: Floating IP not found for address 0.0.0.0. Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2101e27e-ab36-4af3-9f29-3a448a6cfc73', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 10 20:58:06.699554 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 10 20:58:06.705788 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:06.711031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f15a859-a7e8-4952-adb8-941e83ea3c55 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:06.715793 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f15a859-a7e8-4952-adb8-941e83ea3c55 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action" status: 404 len: 88 microversion: 2.1 time: 0.239157 Sep 10 20:58:06.718049 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1282/2636] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:58:06 2022] POST /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73/action => generated 88 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:58:06.737000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8300f91d-1905-48bd-94a1-6d74bafa3c1a req-699138e3-f3de-47f7-bfdb-bcd55a023010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f096440-3a63-40a0-bd51-42ab451bef64", "name": "network-vif-unplugged", "status": "completed", "tag": "6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:06.758676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8300f91d-1905-48bd-94a1-6d74bafa3c1a req-699138e3-f3de-47f7-bfdb-bcd55a023010 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.759158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8300f91d-1905-48bd-94a1-6d74bafa3c1a req-699138e3-f3de-47f7-bfdb-bcd55a023010 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.759789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8300f91d-1905-48bd-94a1-6d74bafa3c1a req-699138e3-f3de-47f7-bfdb-bcd55a023010 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.785767 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8300f91d-1905-48bd-94a1-6d74bafa3c1a req-699138e3-f3de-47f7-bfdb-bcd55a023010 service nova] Creating event network-vif-unplugged:6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2 for instance 4f096440-3a63-40a0-bd51-42ab451bef64 on nch1-master-1 Sep 10 20:58:06.796102 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8300f91d-1905-48bd-94a1-6d74bafa3c1a req-699138e3-f3de-47f7-bfdb-bcd55a023010 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075108 Sep 10 20:58:06.796997 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1283/2637] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:06.804326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98190507-1477-4675-a6d3-d7621f428897 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:06.805757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-98190507-1477-4675-a6d3-d7621f428897 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:06.813077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98190507-1477-4675-a6d3-d7621f428897 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.813902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98190507-1477-4675-a6d3-d7621f428897 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.814613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98190507-1477-4675-a6d3-d7621f428897 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.815550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98190507-1477-4675-a6d3-d7621f428897 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.816272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98190507-1477-4675-a6d3-d7621f428897 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.816963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98190507-1477-4675-a6d3-d7621f428897 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.891836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ce2d96a-f49b-4839-b7e7-86dcd11c8c07 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:06.905729 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ce2d96a-f49b-4839-b7e7-86dcd11c8c07 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1317 microversion: 2.1 time: 0.529932 Sep 10 20:58:06.906938 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1355/2638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:06 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:06.912082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-584222e4-ac59-4224-a5b3-42b09b82bf86 req-7eb7de3d-0da1-4c2d-8903-f12e61853b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35f1515-600f-4bea-850a-28ce09db77fb", "name": "network-vif-deleted", "tag": "ac0ed0f0-5842-4c84-a7f5-f1d58d027926"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:06.923500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-584222e4-ac59-4224-a5b3-42b09b82bf86 req-7eb7de3d-0da1-4c2d-8903-f12e61853b44 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.924294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-584222e4-ac59-4224-a5b3-42b09b82bf86 req-7eb7de3d-0da1-4c2d-8903-f12e61853b44 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.925194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-584222e4-ac59-4224-a5b3-42b09b82bf86 req-7eb7de3d-0da1-4c2d-8903-f12e61853b44 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.956761 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-584222e4-ac59-4224-a5b3-42b09b82bf86 req-7eb7de3d-0da1-4c2d-8903-f12e61853b44 service nova] Creating event network-vif-deleted:ac0ed0f0-5842-4c84-a7f5-f1d58d027926 for instance f35f1515-600f-4bea-850a-28ce09db77fb on nch1-master-1 Sep 10 20:58:06.964057 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-584222e4-ac59-4224-a5b3-42b09b82bf86 req-7eb7de3d-0da1-4c2d-8903-f12e61853b44 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055504 Sep 10 20:58:06.965171 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1356/2639] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:06.972840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d440d997-5295-4dc2-bfc3-eeef08573d79 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:06.973878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d440d997-5295-4dc2-bfc3-eeef08573d79 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:06.982097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d440d997-5295-4dc2-bfc3-eeef08573d79 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.982817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d440d997-5295-4dc2-bfc3-eeef08573d79 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.983601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d440d997-5295-4dc2-bfc3-eeef08573d79 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:06.995324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d440d997-5295-4dc2-bfc3-eeef08573d79 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:06.997729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d440d997-5295-4dc2-bfc3-eeef08573d79 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:06.998871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d440d997-5295-4dc2-bfc3-eeef08573d79 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:07.031998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d440d997-5295-4dc2-bfc3-eeef08573d79 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:58:07.122065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-98190507-1477-4675-a6d3-d7621f428897 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:07.138379 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-98190507-1477-4675-a6d3-d7621f428897 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1517 microversion: 2.1 time: 0.338429 Sep 10 20:58:07.139544 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1284/2640] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:06 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:07.193191 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d440d997-5295-4dc2-bfc3-eeef08573d79 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 204 len: 0 microversion: 2.1 time: 0.225292 Sep 10 20:58:07.193792 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1357/2641] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:06 2022] DELETE /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:07.203583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-895b3e0c-3d87-46a4-8170-b4bd16ed5e14 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:07.204357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-895b3e0c-3d87-46a4-8170-b4bd16ed5e14 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:07.212370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895b3e0c-3d87-46a4-8170-b4bd16ed5e14 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:07.213134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895b3e0c-3d87-46a4-8170-b4bd16ed5e14 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:07.213674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895b3e0c-3d87-46a4-8170-b4bd16ed5e14 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:07.214510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895b3e0c-3d87-46a4-8170-b4bd16ed5e14 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:07.215073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895b3e0c-3d87-46a4-8170-b4bd16ed5e14 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:07.216245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-895b3e0c-3d87-46a4-8170-b4bd16ed5e14 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:07.295395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d4b1c221-3b86-4eff-baa0-6dc992b65f8c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:07.296941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d4b1c221-3b86-4eff-baa0-6dc992b65f8c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:07.305640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4b1c221-3b86-4eff-baa0-6dc992b65f8c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:07.306592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4b1c221-3b86-4eff-baa0-6dc992b65f8c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:07.307217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4b1c221-3b86-4eff-baa0-6dc992b65f8c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:07.308766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4b1c221-3b86-4eff-baa0-6dc992b65f8c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:07.310114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4b1c221-3b86-4eff-baa0-6dc992b65f8c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:07.310756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4b1c221-3b86-4eff-baa0-6dc992b65f8c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:07.424475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-895b3e0c-3d87-46a4-8170-b4bd16ed5e14 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:07.433179 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-895b3e0c-3d87-46a4-8170-b4bd16ed5e14 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1540 microversion: 2.1 time: 0.234533 Sep 10 20:58:07.434386 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1285/2642] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:07 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1540 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:07.439281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d46703eb-8c30-4527-839a-8e9ecb870d66 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944ee6c10>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:07.500782 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d46703eb-8c30-4527-839a-8e9ecb870d66 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.065053 Sep 10 20:58:07.501553 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1286/2643] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:07 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:07.507677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eba334f5-aee5-4b45-9436-ace9f79c4906 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:07.508578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eba334f5-aee5-4b45-9436-ace9f79c4906 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:07.516482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eba334f5-aee5-4b45-9436-ace9f79c4906 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:07.517342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eba334f5-aee5-4b45-9436-ace9f79c4906 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:07.518025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eba334f5-aee5-4b45-9436-ace9f79c4906 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:07.519258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eba334f5-aee5-4b45-9436-ace9f79c4906 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:07.519932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eba334f5-aee5-4b45-9436-ace9f79c4906 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:07.520732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eba334f5-aee5-4b45-9436-ace9f79c4906 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:07.522404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d4b1c221-3b86-4eff-baa0-6dc992b65f8c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:07.533271 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d4b1c221-3b86-4eff-baa0-6dc992b65f8c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1204 microversion: 2.1 time: 0.245823 Sep 10 20:58:07.533883 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1358/2644] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:07 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1204 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:07.638962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eba334f5-aee5-4b45-9436-ace9f79c4906 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:07.655902 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eba334f5-aee5-4b45-9436-ace9f79c4906 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1279 microversion: 2.1 time: 0.149952 Sep 10 20:58:07.669853 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1287/2645] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:07 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:07.900122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-98559fe4-9b15-441a-9fb6-ea623d6a2e85 req-8b077f79-7e0f-47d8-b805-e28a535bf77a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37fb692b-5186-4333-ad32-a567de472d62", "tag": "4e3266c3-685c-4364-9c48-5e262bf043c6"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:07.918230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-98559fe4-9b15-441a-9fb6-ea623d6a2e85 req-8b077f79-7e0f-47d8-b805-e28a535bf77a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:07.918922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-98559fe4-9b15-441a-9fb6-ea623d6a2e85 req-8b077f79-7e0f-47d8-b805-e28a535bf77a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:07.919837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-98559fe4-9b15-441a-9fb6-ea623d6a2e85 req-8b077f79-7e0f-47d8-b805-e28a535bf77a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:07.936232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d446c21d-7416-4ae8-a203-b49b2a9c2793 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:07.937111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d446c21d-7416-4ae8-a203-b49b2a9c2793 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:07.949022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d446c21d-7416-4ae8-a203-b49b2a9c2793 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:07.949980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d446c21d-7416-4ae8-a203-b49b2a9c2793 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:07.950572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d446c21d-7416-4ae8-a203-b49b2a9c2793 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:07.954264 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-98559fe4-9b15-441a-9fb6-ea623d6a2e85 req-8b077f79-7e0f-47d8-b805-e28a535bf77a service nova] Creating event network-changed:4e3266c3-685c-4364-9c48-5e262bf043c6 for instance 37fb692b-5186-4333-ad32-a567de472d62 on nch1-master-1 Sep 10 20:58:07.954773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d446c21d-7416-4ae8-a203-b49b2a9c2793 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:07.955418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d446c21d-7416-4ae8-a203-b49b2a9c2793 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:07.956014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d446c21d-7416-4ae8-a203-b49b2a9c2793 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:07.965969 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-98559fe4-9b15-441a-9fb6-ea623d6a2e85 req-8b077f79-7e0f-47d8-b805-e28a535bf77a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070081 Sep 10 20:58:07.967270 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1359/2646] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:08.178747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2d448d89-758c-4c97-bb04-3d71e3ea210c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:08.180446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2d448d89-758c-4c97-bb04-3d71e3ea210c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:08.192425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d448d89-758c-4c97-bb04-3d71e3ea210c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:08.193221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d448d89-758c-4c97-bb04-3d71e3ea210c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:08.194626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d448d89-758c-4c97-bb04-3d71e3ea210c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:08.196453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d448d89-758c-4c97-bb04-3d71e3ea210c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:08.198024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d448d89-758c-4c97-bb04-3d71e3ea210c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:08.198803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d448d89-758c-4c97-bb04-3d71e3ea210c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:08.472543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2d448d89-758c-4c97-bb04-3d71e3ea210c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:08.487024 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2d448d89-758c-4c97-bb04-3d71e3ea210c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1517 microversion: 2.1 time: 0.320766 Sep 10 20:58:08.489958 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1360/2647] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:08 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1517 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:08.496050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b2ef2d3-fb87-407f-89a4-ad1fa8d6db01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:08.496667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b2ef2d3-fb87-407f-89a4-ad1fa8d6db01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:08.513262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2ef2d3-fb87-407f-89a4-ad1fa8d6db01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:08.514080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2ef2d3-fb87-407f-89a4-ad1fa8d6db01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:08.514676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2ef2d3-fb87-407f-89a4-ad1fa8d6db01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:08.515806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2ef2d3-fb87-407f-89a4-ad1fa8d6db01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:08.517014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2ef2d3-fb87-407f-89a4-ad1fa8d6db01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:08.517627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2ef2d3-fb87-407f-89a4-ad1fa8d6db01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:08.681408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b2ef2d3-fb87-407f-89a4-ad1fa8d6db01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:08.690380 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b2ef2d3-fb87-407f-89a4-ad1fa8d6db01 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1540 microversion: 2.1 time: 0.198169 Sep 10 20:58:08.691274 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1361/2648] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:08 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1540 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:08.705397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b4e403c7-30e4-4b87-b8c5-1bb1057f7227 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f993ff58a60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:08.707761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d446c21d-7416-4ae8-a203-b49b2a9c2793 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:08.724259 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d446c21d-7416-4ae8-a203-b49b2a9c2793 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1317 microversion: 2.1 time: 0.793360 Sep 10 20:58:08.733873 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1288/2649] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:07 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1317 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:08.733873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e8f10231-32db-4843-906d-b37192832ac7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:08.733873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e8f10231-32db-4843-906d-b37192832ac7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:08.749014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8f10231-32db-4843-906d-b37192832ac7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:08.749519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8f10231-32db-4843-906d-b37192832ac7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:08.750181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8f10231-32db-4843-906d-b37192832ac7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:08.751090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8f10231-32db-4843-906d-b37192832ac7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:08.751556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8f10231-32db-4843-906d-b37192832ac7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:08.752040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8f10231-32db-4843-906d-b37192832ac7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:08.798440 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b4e403c7-30e4-4b87-b8c5-1bb1057f7227 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.100375 Sep 10 20:58:08.806059 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1362/2650] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:08 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:08.810990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e225c10d-26cf-4bbf-9bb0-6f0bd0cff041 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:08.811600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e225c10d-26cf-4bbf-9bb0-6f0bd0cff041 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:08.830024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e225c10d-26cf-4bbf-9bb0-6f0bd0cff041 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:08.832752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e225c10d-26cf-4bbf-9bb0-6f0bd0cff041 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:08.833428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e225c10d-26cf-4bbf-9bb0-6f0bd0cff041 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:08.835260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e225c10d-26cf-4bbf-9bb0-6f0bd0cff041 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:08.836072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e225c10d-26cf-4bbf-9bb0-6f0bd0cff041 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:08.836745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e225c10d-26cf-4bbf-9bb0-6f0bd0cff041 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:08.881264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e8f10231-32db-4843-906d-b37192832ac7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:08.910024 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e8f10231-32db-4843-906d-b37192832ac7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1266 microversion: 2.1 time: 0.178284 Sep 10 20:58:08.910858 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1289/2651] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:08 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:08.971838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e225c10d-26cf-4bbf-9bb0-6f0bd0cff041 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:08.982490 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e225c10d-26cf-4bbf-9bb0-6f0bd0cff041 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1277 microversion: 2.1 time: 0.175100 Sep 10 20:58:08.983771 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1363/2652] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:08 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:09.515729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fc96fb70-d2eb-414a-9136-6462564369bc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:09.516690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fc96fb70-d2eb-414a-9136-6462564369bc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:09.526173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc96fb70-d2eb-414a-9136-6462564369bc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:09.527137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc96fb70-d2eb-414a-9136-6462564369bc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:09.528025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc96fb70-d2eb-414a-9136-6462564369bc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:09.528970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc96fb70-d2eb-414a-9136-6462564369bc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:09.529670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc96fb70-d2eb-414a-9136-6462564369bc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:09.530312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fc96fb70-d2eb-414a-9136-6462564369bc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:09.726898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a3ec2724-1484-4097-8499-356e3a551cfe tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:09.727719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a3ec2724-1484-4097-8499-356e3a551cfe tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:09.746188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ec2724-1484-4097-8499-356e3a551cfe tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:09.746188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ec2724-1484-4097-8499-356e3a551cfe tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:09.746487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ec2724-1484-4097-8499-356e3a551cfe tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:09.747194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ec2724-1484-4097-8499-356e3a551cfe tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:09.747657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ec2724-1484-4097-8499-356e3a551cfe tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:09.748085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ec2724-1484-4097-8499-356e3a551cfe tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:10.009521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fc96fb70-d2eb-414a-9136-6462564369bc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:10.027147 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fc96fb70-d2eb-414a-9136-6462564369bc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1517 microversion: 2.1 time: 0.514796 Sep 10 20:58:10.028929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a3ec2724-1484-4097-8499-356e3a551cfe tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:10.029814 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1290/2653] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:09 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1517 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:10.059981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80f83a9a-ce99-4858-8a80-aeac53abd961 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:10.060604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-80f83a9a-ce99-4858-8a80-aeac53abd961 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:10.075994 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a3ec2724-1484-4097-8499-356e3a551cfe tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1540 microversion: 2.1 time: 0.363686 Sep 10 20:58:10.082104 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1364/2654] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:09 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1540 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:10.095055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80f83a9a-ce99-4858-8a80-aeac53abd961 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:10.096293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80f83a9a-ce99-4858-8a80-aeac53abd961 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:10.101449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80f83a9a-ce99-4858-8a80-aeac53abd961 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:10.105417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ec985d0-410b-42b7-b265-7d9cde1a2975 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f993ff828b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:10.106651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80f83a9a-ce99-4858-8a80-aeac53abd961 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:10.108575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80f83a9a-ce99-4858-8a80-aeac53abd961 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:10.111871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80f83a9a-ce99-4858-8a80-aeac53abd961 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:10.181365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ec985d0-410b-42b7-b265-7d9cde1a2975 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.093140 Sep 10 20:58:10.182785 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1365/2655] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:10 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:10.189652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f1104b0-7636-4645-bc8c-e3ba67077dd2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:10.190885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5f1104b0-7636-4645-bc8c-e3ba67077dd2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:10.199896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f1104b0-7636-4645-bc8c-e3ba67077dd2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:10.200701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f1104b0-7636-4645-bc8c-e3ba67077dd2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:10.201329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f1104b0-7636-4645-bc8c-e3ba67077dd2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:10.203102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f1104b0-7636-4645-bc8c-e3ba67077dd2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:10.203741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f1104b0-7636-4645-bc8c-e3ba67077dd2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:10.204329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f1104b0-7636-4645-bc8c-e3ba67077dd2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:10.299939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5f1104b0-7636-4645-bc8c-e3ba67077dd2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:10.310670 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f1104b0-7636-4645-bc8c-e3ba67077dd2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1266 microversion: 2.1 time: 0.126466 Sep 10 20:58:10.312008 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1366/2656] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:10 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:10.317167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-809acc96-3ebb-45be-bd75-1f4fdb7d03d1 req-0f4e6fee-1b53-43b0-91c3-ab8dbf69d64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5284d9-8123-4e15-8576-be144c016b44", "tag": "fcae92b2-6a4a-43fe-b894-3e34661b8d2a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:10.328175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-809acc96-3ebb-45be-bd75-1f4fdb7d03d1 req-0f4e6fee-1b53-43b0-91c3-ab8dbf69d64d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:10.328931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-809acc96-3ebb-45be-bd75-1f4fdb7d03d1 req-0f4e6fee-1b53-43b0-91c3-ab8dbf69d64d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:10.329598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-809acc96-3ebb-45be-bd75-1f4fdb7d03d1 req-0f4e6fee-1b53-43b0-91c3-ab8dbf69d64d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:10.343150 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-809acc96-3ebb-45be-bd75-1f4fdb7d03d1 req-0f4e6fee-1b53-43b0-91c3-ab8dbf69d64d service nova] Creating event network-changed:fcae92b2-6a4a-43fe-b894-3e34661b8d2a for instance 4f5284d9-8123-4e15-8576-be144c016b44 on nch2-master-1 Sep 10 20:58:10.349181 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-809acc96-3ebb-45be-bd75-1f4fdb7d03d1 req-0f4e6fee-1b53-43b0-91c3-ab8dbf69d64d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035599 Sep 10 20:58:10.350187 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1367/2657] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:10.356027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-bab9ea3a-31e6-4fbb-b0e9-952da4a821b6 req-984737a8-d283-4c0b-bfed-3b05da4ad1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37fb692b-5186-4333-ad32-a567de472d62", "tag": "4e3266c3-685c-4364-9c48-5e262bf043c6"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:10.366915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bab9ea3a-31e6-4fbb-b0e9-952da4a821b6 req-984737a8-d283-4c0b-bfed-3b05da4ad1d2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:10.367748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bab9ea3a-31e6-4fbb-b0e9-952da4a821b6 req-984737a8-d283-4c0b-bfed-3b05da4ad1d2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:10.368427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bab9ea3a-31e6-4fbb-b0e9-952da4a821b6 req-984737a8-d283-4c0b-bfed-3b05da4ad1d2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:10.392016 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-bab9ea3a-31e6-4fbb-b0e9-952da4a821b6 req-984737a8-d283-4c0b-bfed-3b05da4ad1d2 service nova] Creating event network-changed:4e3266c3-685c-4364-9c48-5e262bf043c6 for instance 37fb692b-5186-4333-ad32-a567de472d62 on nch1-master-1 Sep 10 20:58:10.399339 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-bab9ea3a-31e6-4fbb-b0e9-952da4a821b6 req-984737a8-d283-4c0b-bfed-3b05da4ad1d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047149 Sep 10 20:58:10.401179 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1368/2658] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:10.407223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-499a5f25-cec4-4814-b42d-f677d34545a7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:10.408104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-499a5f25-cec4-4814-b42d-f677d34545a7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:10.415716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-499a5f25-cec4-4814-b42d-f677d34545a7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:10.416204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-499a5f25-cec4-4814-b42d-f677d34545a7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:10.416634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-499a5f25-cec4-4814-b42d-f677d34545a7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:10.417572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-499a5f25-cec4-4814-b42d-f677d34545a7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:10.418145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-499a5f25-cec4-4814-b42d-f677d34545a7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:10.418572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-499a5f25-cec4-4814-b42d-f677d34545a7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:10.815936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-80f83a9a-ce99-4858-8a80-aeac53abd961 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:10.827386 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-80f83a9a-ce99-4858-8a80-aeac53abd961 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1317 microversion: 2.1 time: 0.795890 Sep 10 20:58:10.838058 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1291/2659] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:10 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:10.838058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2d4203f5-03d6-4e2f-b3b1-027ae5d54e99 req-c51f3fac-3437-44c3-a116-268aaac39110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfdc13f-9c2e-44ec-8553-3f779ead89af", "name": "network-vif-plugged", "status": "completed", "tag": "b18a22e2-b050-417e-bebb-2f9e983473cc"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:10.851530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:10.853975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2d4203f5-03d6-4e2f-b3b1-027ae5d54e99 req-c51f3fac-3437-44c3-a116-268aaac39110 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:10.854536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2d4203f5-03d6-4e2f-b3b1-027ae5d54e99 req-c51f3fac-3437-44c3-a116-268aaac39110 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:10.854985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2d4203f5-03d6-4e2f-b3b1-027ae5d54e99 req-c51f3fac-3437-44c3-a116-268aaac39110 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:10.870228 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2d4203f5-03d6-4e2f-b3b1-027ae5d54e99 req-c51f3fac-3437-44c3-a116-268aaac39110 service nova] Creating event network-vif-plugged:b18a22e2-b050-417e-bebb-2f9e983473cc for instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af on nch2-master-1 Sep 10 20:58:10.875149 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2d4203f5-03d6-4e2f-b3b1-027ae5d54e99 req-c51f3fac-3437-44c3-a116-268aaac39110 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045851 Sep 10 20:58:10.876108 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1292/2660] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:11.001500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-499a5f25-cec4-4814-b42d-f677d34545a7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:11.011242 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-499a5f25-cec4-4814-b42d-f677d34545a7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.608663 Sep 10 20:58:11.014412 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1369/2661] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:10 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:11.059929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-caf1bfc0-fb61-421f-bcfc-d8890ae133d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:11.060851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-caf1bfc0-fb61-421f-bcfc-d8890ae133d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:11.067874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-caf1bfc0-fb61-421f-bcfc-d8890ae133d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:11.068043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-caf1bfc0-fb61-421f-bcfc-d8890ae133d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:11.068473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-caf1bfc0-fb61-421f-bcfc-d8890ae133d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:11.070034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-caf1bfc0-fb61-421f-bcfc-d8890ae133d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:11.070741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-caf1bfc0-fb61-421f-bcfc-d8890ae133d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:11.071173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-caf1bfc0-fb61-421f-bcfc-d8890ae133d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:11.109804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-52fb9c55-ad6a-4772-9339-d3b6628bf948 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:11.110433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-52fb9c55-ad6a-4772-9339-d3b6628bf948 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:11.117680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52fb9c55-ad6a-4772-9339-d3b6628bf948 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:11.118287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52fb9c55-ad6a-4772-9339-d3b6628bf948 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:11.118736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52fb9c55-ad6a-4772-9339-d3b6628bf948 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:11.119452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52fb9c55-ad6a-4772-9339-d3b6628bf948 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:11.119905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52fb9c55-ad6a-4772-9339-d3b6628bf948 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:11.120333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52fb9c55-ad6a-4772-9339-d3b6628bf948 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:11.415668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-52fb9c55-ad6a-4772-9339-d3b6628bf948 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:11.427457 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-52fb9c55-ad6a-4772-9339-d3b6628bf948 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1540 microversion: 2.1 time: 0.321491 Sep 10 20:58:11.445274 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1370/2662] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:11 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1540 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:11.450368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-de24e381-f1f2-40aa-99ee-89cdaa2b2ab0 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f993ffb3d30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:11.508534 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-de24e381-f1f2-40aa-99ee-89cdaa2b2ab0 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.061548 Sep 10 20:58:11.509151 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1371/2663] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:11 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:11.514693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bc8d1bda-a880-4540-bfe9-79eff46d62c8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:11.515700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bc8d1bda-a880-4540-bfe9-79eff46d62c8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:11.516404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-caf1bfc0-fb61-421f-bcfc-d8890ae133d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:11.525870 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-caf1bfc0-fb61-421f-bcfc-d8890ae133d0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1523 microversion: 2.1 time: 0.470987 Sep 10 20:58:11.526339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc8d1bda-a880-4540-bfe9-79eff46d62c8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:11.526840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc8d1bda-a880-4540-bfe9-79eff46d62c8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:11.538198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc8d1bda-a880-4540-bfe9-79eff46d62c8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:11.538198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc8d1bda-a880-4540-bfe9-79eff46d62c8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:11.538198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc8d1bda-a880-4540-bfe9-79eff46d62c8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:11.538198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc8d1bda-a880-4540-bfe9-79eff46d62c8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:11.539313 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1293/2664] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:11 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:11.599135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bc8d1bda-a880-4540-bfe9-79eff46d62c8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:11.609470 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bc8d1bda-a880-4540-bfe9-79eff46d62c8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1266 microversion: 2.1 time: 0.098883 Sep 10 20:58:11.610271 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1372/2665] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:11 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:11.852782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8242d18-0ed1-4139-8704-a39d2c4d07e6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:11.853328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8242d18-0ed1-4139-8704-a39d2c4d07e6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:11.859756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8242d18-0ed1-4139-8704-a39d2c4d07e6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:11.860243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8242d18-0ed1-4139-8704-a39d2c4d07e6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:11.860680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8242d18-0ed1-4139-8704-a39d2c4d07e6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:11.861378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8242d18-0ed1-4139-8704-a39d2c4d07e6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:11.861867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8242d18-0ed1-4139-8704-a39d2c4d07e6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:11.862286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8242d18-0ed1-4139-8704-a39d2c4d07e6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.034856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9908e0d3-390e-4ede-9fe8-a718a1c5b32e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:12.035496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9908e0d3-390e-4ede-9fe8-a718a1c5b32e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:12.042570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9908e0d3-390e-4ede-9fe8-a718a1c5b32e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:12.044466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9908e0d3-390e-4ede-9fe8-a718a1c5b32e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:12.045293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9908e0d3-390e-4ede-9fe8-a718a1c5b32e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.046040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9908e0d3-390e-4ede-9fe8-a718a1c5b32e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:12.046497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9908e0d3-390e-4ede-9fe8-a718a1c5b32e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:12.046975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9908e0d3-390e-4ede-9fe8-a718a1c5b32e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.064144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:12.213046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9908e0d3-390e-4ede-9fe8-a718a1c5b32e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:12.223825 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9908e0d3-390e-4ede-9fe8-a718a1c5b32e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.192222 Sep 10 20:58:12.224565 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1373/2666] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:12 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:12.306441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8242d18-0ed1-4139-8704-a39d2c4d07e6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:12.315766 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8242d18-0ed1-4139-8704-a39d2c4d07e6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1317 microversion: 2.1 time: 0.466562 Sep 10 20:58:12.316531 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1294/2667] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:11 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:12.404736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-08e8104d-780c-4db0-9425-14f094d0ebee req-ce2a2a0d-5098-487a-86e4-f74214add3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2101e27e-ab36-4af3-9f29-3a448a6cfc73", "name": "network-vif-deleted", "tag": "97a627ed-c505-4f6c-bbfa-dc20aead138c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:12.415474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-08e8104d-780c-4db0-9425-14f094d0ebee req-ce2a2a0d-5098-487a-86e4-f74214add3fb service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:12.416292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-08e8104d-780c-4db0-9425-14f094d0ebee req-ce2a2a0d-5098-487a-86e4-f74214add3fb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:12.416794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-08e8104d-780c-4db0-9425-14f094d0ebee req-ce2a2a0d-5098-487a-86e4-f74214add3fb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.431522 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-08e8104d-780c-4db0-9425-14f094d0ebee req-ce2a2a0d-5098-487a-86e4-f74214add3fb service nova] Creating event network-vif-deleted:97a627ed-c505-4f6c-bbfa-dc20aead138c for instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 on nch1-master-1 Sep 10 20:58:12.437541 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-08e8104d-780c-4db0-9425-14f094d0ebee req-ce2a2a0d-5098-487a-86e4-f74214add3fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036729 Sep 10 20:58:12.438762 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1374/2668] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:12.451817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:12.452409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:12.455509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=14 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:12.460330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:12.461159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:12.461844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.462630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:12.463153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:12.463937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.502472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:12.503065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:12.503557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.504067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lazy-loading 'fault' on Instance uuid 2101e27e-ab36-4af3-9f29-3a448a6cfc73 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:58:12.535863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6fa31bf6-9249-4809-aa93-6cac67b8c2e2 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f993ff825e0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:12.606982 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6fa31bf6-9249-4809-aa93-6cac67b8c2e2 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.078757 Sep 10 20:58:12.608149 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1375/2669] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:12 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:12.613342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e62f63d-e081-45fc-9a0c-1ea2e55cdfc5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:12.614111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e62f63d-e081-45fc-9a0c-1ea2e55cdfc5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:12.621316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e62f63d-e081-45fc-9a0c-1ea2e55cdfc5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:12.622113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e62f63d-e081-45fc-9a0c-1ea2e55cdfc5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:12.623023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e62f63d-e081-45fc-9a0c-1ea2e55cdfc5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.623943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e62f63d-e081-45fc-9a0c-1ea2e55cdfc5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:12.624654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e62f63d-e081-45fc-9a0c-1ea2e55cdfc5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:12.625159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e62f63d-e081-45fc-9a0c-1ea2e55cdfc5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.728226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609617a03387478b9b72cbe52d25dbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f9b47aca3845d6a3fc34662d34ccf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:12.736767 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9318fa59-232a-48f3-95d1-10fceb09e4d9 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 200 len: 1321 microversion: 2.1 time: 0.288863 Sep 10 20:58:12.737352 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1295/2670] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:12 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:12.750884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5ebd7d29-a044-4961-b7fe-4bad792a3677 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:12.751770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5ebd7d29-a044-4961-b7fe-4bad792a3677 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:12.766262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ebd7d29-a044-4961-b7fe-4bad792a3677 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:12.766988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ebd7d29-a044-4961-b7fe-4bad792a3677 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:12.767425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ebd7d29-a044-4961-b7fe-4bad792a3677 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.768128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ebd7d29-a044-4961-b7fe-4bad792a3677 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:12.768581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ebd7d29-a044-4961-b7fe-4bad792a3677 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:12.769004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ebd7d29-a044-4961-b7fe-4bad792a3677 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:12.809279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6e62f63d-e081-45fc-9a0c-1ea2e55cdfc5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:12.818347 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e62f63d-e081-45fc-9a0c-1ea2e55cdfc5 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1523 microversion: 2.1 time: 0.208973 Sep 10 20:58:12.840512 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1376/2671] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:12 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:12.983876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5ebd7d29-a044-4961-b7fe-4bad792a3677 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:12.992356 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5ebd7d29-a044-4961-b7fe-4bad792a3677 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1308 microversion: 2.1 time: 0.245185 Sep 10 20:58:12.993000 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1296/2672] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:12 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:13.246630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-47d9a96e-3c41-4682-bdca-1bf36d05cb21 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:13.247375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-47d9a96e-3c41-4682-bdca-1bf36d05cb21 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:13.254700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47d9a96e-3c41-4682-bdca-1bf36d05cb21 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:13.255484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47d9a96e-3c41-4682-bdca-1bf36d05cb21 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:13.255922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47d9a96e-3c41-4682-bdca-1bf36d05cb21 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:13.256721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47d9a96e-3c41-4682-bdca-1bf36d05cb21 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:13.257326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47d9a96e-3c41-4682-bdca-1bf36d05cb21 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:13.257992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47d9a96e-3c41-4682-bdca-1bf36d05cb21 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:13.340996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8eac8422-7d52-41f3-86e1-3ed52ca9a3dc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:13.342184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8eac8422-7d52-41f3-86e1-3ed52ca9a3dc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:13.348617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eac8422-7d52-41f3-86e1-3ed52ca9a3dc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:13.349141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eac8422-7d52-41f3-86e1-3ed52ca9a3dc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:13.349581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eac8422-7d52-41f3-86e1-3ed52ca9a3dc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:13.350905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eac8422-7d52-41f3-86e1-3ed52ca9a3dc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:13.351364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eac8422-7d52-41f3-86e1-3ed52ca9a3dc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:13.351787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8eac8422-7d52-41f3-86e1-3ed52ca9a3dc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:13.417331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-47d9a96e-3c41-4682-bdca-1bf36d05cb21 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:13.425206 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-47d9a96e-3c41-4682-bdca-1bf36d05cb21 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.182472 Sep 10 20:58:13.425785 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1377/2673] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:13 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:13.494389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8eac8422-7d52-41f3-86e1-3ed52ca9a3dc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:13.501978 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8eac8422-7d52-41f3-86e1-3ed52ca9a3dc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1317 microversion: 2.1 time: 0.165921 Sep 10 20:58:13.502557 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1297/2674] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:13 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:13.623596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a1052ce4-329d-4d5a-a04b-0561776ed4bf tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99440f01f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:13.672757 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a1052ce4-329d-4d5a-a04b-0561776ed4bf tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.053585 Sep 10 20:58:13.673785 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1378/2675] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:13 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:13.760700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:13.761380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] [instance: 2101e27e-ab36-4af3-9f29-3a448a6cfc73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:13.767800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:13.768284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:13.768723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:13.769424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:13.769978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:13.770412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:13.785005 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] HTTP exception thrown: Instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 could not be found. Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Request method failure captured: Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 HTTP/1.1 Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoo1gUWc-iDOKIefc5rPL-PHi80qcCKSaqkAyOEJdkpDll4rfQAReyPY9j2YxBqIRpz7HvxIhhMFklHnoAeOsEww1dbWfPdd-LIeZHMiUhimDK2JgpUdhct5gfsGfHqyuj-deFDWUKq-dlnxSdGFBXYGjBeMY3X0Gjjo99NjqF-vVk Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f1f9b47aca3845d6a3fc34662d34ccf1 Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1f9b47aca3845d6a3fc34662d34ccf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1f9b47aca3845d6a3fc34662d34ccf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f1f9b47aca3845d6a3fc34662d34ccf1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f1f9b47aca3845d6a3fc34662d34ccf1"}]}] Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f1f9b47aca3845d6a3fc34662d34ccf1 Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 609617a03387478b9b72cbe52d25dbf0 Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 could not be found. Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2101e27e-ab36-4af3-9f29-3a448a6cfc73'} Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 could not be found. Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 could not be found. Sep 10 20:58:13.786678 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 could not be found. Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] Returning 404 to user: Instance 2101e27e-ab36-4af3-9f29-3a448a6cfc73 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:13.791825 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8d4cebc5-9c2b-4b72-84eb-e85480ed5760 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429 tempest-FloatingIPsAssociationNegativeTestJSON-1324515429-project] 10.222.0.33 "GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73" status: 404 len: 111 microversion: 2.1 time: 0.032036 Sep 10 20:58:13.792903 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1298/2676] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:13 2022] GET /compute/v2.1/servers/2101e27e-ab36-4af3-9f29-3a448a6cfc73 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:13.841959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a65d06e2-9207-4433-ac6c-f2b0ce40a2a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:13.842619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a65d06e2-9207-4433-ac6c-f2b0ce40a2a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:13.849748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a65d06e2-9207-4433-ac6c-f2b0ce40a2a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:13.850872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a65d06e2-9207-4433-ac6c-f2b0ce40a2a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:13.851319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a65d06e2-9207-4433-ac6c-f2b0ce40a2a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:13.852048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a65d06e2-9207-4433-ac6c-f2b0ce40a2a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:13.852510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a65d06e2-9207-4433-ac6c-f2b0ce40a2a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:13.852949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a65d06e2-9207-4433-ac6c-f2b0ce40a2a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:14.018962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7b9c2993-9c6b-490c-95bc-33777a5d2799 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:14.019826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7b9c2993-9c6b-490c-95bc-33777a5d2799 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:14.028028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b9c2993-9c6b-490c-95bc-33777a5d2799 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:14.028664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b9c2993-9c6b-490c-95bc-33777a5d2799 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:14.029445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b9c2993-9c6b-490c-95bc-33777a5d2799 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:14.030287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b9c2993-9c6b-490c-95bc-33777a5d2799 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:14.030925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b9c2993-9c6b-490c-95bc-33777a5d2799 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:14.031465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b9c2993-9c6b-490c-95bc-33777a5d2799 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:14.091848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a65d06e2-9207-4433-ac6c-f2b0ce40a2a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:14.102129 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a65d06e2-9207-4433-ac6c-f2b0ce40a2a7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1523 microversion: 2.1 time: 0.263994 Sep 10 20:58:14.111286 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1379/2677] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:13 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:14.279440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-daa7745d-95be-4d03-86fa-673cebab619f req-dd5cc1b4-7daf-4366-b389-b26aee4aef7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ea8e27-9137-45f8-98c7-f4b1cc01c9ec", "name": "network-vif-unplugged", "status": "completed", "tag": "81bc7d32-0a6c-474d-8db7-f1b4f6e21cbc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:14.295159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-daa7745d-95be-4d03-86fa-673cebab619f req-dd5cc1b4-7daf-4366-b389-b26aee4aef7b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:14.296203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-daa7745d-95be-4d03-86fa-673cebab619f req-dd5cc1b4-7daf-4366-b389-b26aee4aef7b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:14.296923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-daa7745d-95be-4d03-86fa-673cebab619f req-dd5cc1b4-7daf-4366-b389-b26aee4aef7b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:14.314682 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-daa7745d-95be-4d03-86fa-673cebab619f req-dd5cc1b4-7daf-4366-b389-b26aee4aef7b service nova] Creating event network-vif-unplugged:81bc7d32-0a6c-474d-8db7-f1b4f6e21cbc for instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec on nch2-master-1 Sep 10 20:58:14.320410 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-daa7745d-95be-4d03-86fa-673cebab619f req-dd5cc1b4-7daf-4366-b389-b26aee4aef7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044544 Sep 10 20:58:14.321726 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1380/2678] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:58:14.450122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e9df100-dc89-4a7c-92e2-8e7f97cf67a1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:14.450836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e9df100-dc89-4a7c-92e2-8e7f97cf67a1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:14.467634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9df100-dc89-4a7c-92e2-8e7f97cf67a1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:14.468488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9df100-dc89-4a7c-92e2-8e7f97cf67a1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:14.469086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9df100-dc89-4a7c-92e2-8e7f97cf67a1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:14.470298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9df100-dc89-4a7c-92e2-8e7f97cf67a1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:14.471154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9df100-dc89-4a7c-92e2-8e7f97cf67a1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:14.471434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9df100-dc89-4a7c-92e2-8e7f97cf67a1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:14.739497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7b9c2993-9c6b-490c-95bc-33777a5d2799 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:14.750639 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7b9c2993-9c6b-490c-95bc-33777a5d2799 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1308 microversion: 2.1 time: 0.737128 Sep 10 20:58:14.753985 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1299/2679] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:14 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1308 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:14.759929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-69a0dd2d-af1e-49f7-b58a-3b24ef40598a req-b529d74f-2e84-4901-8ddd-22f201d0a3ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9857472b-f236-4d85-b592-68d9cd4cfdf7", "tag": "e1b862e2-4037-4e26-9cba-7a0cab43d786"}, {"name": "network-changed", "server_uuid": "a30a9756-704a-4774-b74c-c0085e7528ca", "tag": "7b663272-fba8-4770-a6df-21af15d41f96"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:14.777583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-69a0dd2d-af1e-49f7-b58a-3b24ef40598a req-b529d74f-2e84-4901-8ddd-22f201d0a3ae service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:14.778720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-69a0dd2d-af1e-49f7-b58a-3b24ef40598a req-b529d74f-2e84-4901-8ddd-22f201d0a3ae service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:14.778970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1e9df100-dc89-4a7c-92e2-8e7f97cf67a1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:14.779611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-69a0dd2d-af1e-49f7-b58a-3b24ef40598a req-b529d74f-2e84-4901-8ddd-22f201d0a3ae service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:14.789258 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e9df100-dc89-4a7c-92e2-8e7f97cf67a1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.344003 Sep 10 20:58:14.805226 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1381/2680] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:14 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:14.805226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-37f74a1d-46a4-4c45-8b9d-6af793919345 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:14.805226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-37f74a1d-46a4-4c45-8b9d-6af793919345 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:14.815689 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-69a0dd2d-af1e-49f7-b58a-3b24ef40598a req-b529d74f-2e84-4901-8ddd-22f201d0a3ae service nova] Creating event network-changed:e1b862e2-4037-4e26-9cba-7a0cab43d786 for instance 9857472b-f236-4d85-b592-68d9cd4cfdf7 on nch2-master-1 Sep 10 20:58:14.817984 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-69a0dd2d-af1e-49f7-b58a-3b24ef40598a req-b529d74f-2e84-4901-8ddd-22f201d0a3ae service nova] Creating event network-changed:7b663272-fba8-4770-a6df-21af15d41f96 for instance a30a9756-704a-4774-b74c-c0085e7528ca on nch2-master-1 Sep 10 20:58:14.821985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37f74a1d-46a4-4c45-8b9d-6af793919345 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:14.821985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37f74a1d-46a4-4c45-8b9d-6af793919345 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:14.822288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37f74a1d-46a4-4c45-8b9d-6af793919345 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:14.823089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37f74a1d-46a4-4c45-8b9d-6af793919345 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:14.823626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37f74a1d-46a4-4c45-8b9d-6af793919345 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:14.829605 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-69a0dd2d-af1e-49f7-b58a-3b24ef40598a req-b529d74f-2e84-4901-8ddd-22f201d0a3ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076066 Sep 10 20:58:14.830292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37f74a1d-46a4-4c45-8b9d-6af793919345 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:14.830960 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1300/2681] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:14.838719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1916e0b1-8641-4eff-94e2-2d65f4e9ea57 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944d739d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:14.891250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:14.913690 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1916e0b1-8641-4eff-94e2-2d65f4e9ea57 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.081207 Sep 10 20:58:14.914329 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1301/2682] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:14 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:14.922471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=28 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:15.095293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-37f74a1d-46a4-4c45-8b9d-6af793919345 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:15.122238 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-37f74a1d-46a4-4c45-8b9d-6af793919345 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.326667 Sep 10 20:58:15.125906 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1382/2683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:14 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:15.127722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bdf7370b-5976-4371-a881-61a18dd979fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:15.128453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bdf7370b-5976-4371-a881-61a18dd979fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:15.141590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7370b-5976-4371-a881-61a18dd979fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:15.142651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7370b-5976-4371-a881-61a18dd979fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:15.145866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7370b-5976-4371-a881-61a18dd979fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:15.154185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7370b-5976-4371-a881-61a18dd979fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:15.154745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7370b-5976-4371-a881-61a18dd979fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:15.155229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdf7370b-5976-4371-a881-61a18dd979fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:15.161536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:15.213920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1054199", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:15.258882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:15.309443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] validate_networks() for [('02a59e8f-361e-4af8-bf69-eada4df89fa4', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:58:15.583893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bdf7370b-5976-4371-a881-61a18dd979fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:15.593270 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bdf7370b-5976-4371-a881-61a18dd979fd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1523 microversion: 2.1 time: 0.470273 Sep 10 20:58:15.595879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1302/2684] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:15 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:15.778490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6ef02d53-8d85-415b-ba1e-9daa69100766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:15.779150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6ef02d53-8d85-415b-ba1e-9daa69100766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:15.786457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef02d53-8d85-415b-ba1e-9daa69100766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:15.787226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef02d53-8d85-415b-ba1e-9daa69100766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:15.787875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef02d53-8d85-415b-ba1e-9daa69100766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:15.788785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef02d53-8d85-415b-ba1e-9daa69100766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:15.789609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef02d53-8d85-415b-ba1e-9daa69100766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:15.790307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef02d53-8d85-415b-ba1e-9daa69100766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:15.977540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6ef02d53-8d85-415b-ba1e-9daa69100766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:15.988978 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6ef02d53-8d85-415b-ba1e-9daa69100766 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1308 microversion: 2.1 time: 0.214121 Sep 10 20:58:16.002387 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1303/2685] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:15 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:16.022597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6f2fcf3d-cc11-40b8-8da8-2378effebb49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:16.023654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6f2fcf3d-cc11-40b8-8da8-2378effebb49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:16.032081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f2fcf3d-cc11-40b8-8da8-2378effebb49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:16.032806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f2fcf3d-cc11-40b8-8da8-2378effebb49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:16.033428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f2fcf3d-cc11-40b8-8da8-2378effebb49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:16.034328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f2fcf3d-cc11-40b8-8da8-2378effebb49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:16.034945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f2fcf3d-cc11-40b8-8da8-2378effebb49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:16.035495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f2fcf3d-cc11-40b8-8da8-2378effebb49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:16.290848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6f2fcf3d-cc11-40b8-8da8-2378effebb49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:16.310441 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6f2fcf3d-cc11-40b8-8da8-2378effebb49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.306512 Sep 10 20:58:16.311299 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1304/2686] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:16 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:16.315965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4d5aed58-237f-4ec9-bb9f-119107de4416 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944bde940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:16.360799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:58:16.361368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:58:16.361701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:58:16.362207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:58:16.362624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:58:16.380676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:16.381735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:16.388817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:16.389655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:16.390194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:16.394550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:16.418703 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4d5aed58-237f-4ec9-bb9f-119107de4416 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.106189 Sep 10 20:58:16.430347 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1305/2687] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:16 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:16.443390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f03a4b24-fc91-47c2-9ad5-4eaed1b447ec req-9a142526-a564-4fe4-bfb2-26537a501642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f096440-3a63-40a0-bd51-42ab451bef64", "name": "network-vif-plugged", "status": "completed", "tag": "6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:16.457962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f03a4b24-fc91-47c2-9ad5-4eaed1b447ec req-9a142526-a564-4fe4-bfb2-26537a501642 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:16.463353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f03a4b24-fc91-47c2-9ad5-4eaed1b447ec req-9a142526-a564-4fe4-bfb2-26537a501642 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:16.465542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Getting quotas for project d640711fd8c64403adc4d7e7235a8fad. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:16.466185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f03a4b24-fc91-47c2-9ad5-4eaed1b447ec req-9a142526-a564-4fe4-bfb2-26537a501642 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:16.485658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Getting quotas for user 2bed1a15bbff41c6928afd3c057e7dfc and project d640711fd8c64403adc4d7e7235a8fad. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:16.495862 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f03a4b24-fc91-47c2-9ad5-4eaed1b447ec req-9a142526-a564-4fe4-bfb2-26537a501642 service nova] Creating event network-vif-plugged:6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2 for instance 4f096440-3a63-40a0-bd51-42ab451bef64 on nch1-master-1 Sep 10 20:58:16.503322 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f03a4b24-fc91-47c2-9ad5-4eaed1b447ec req-9a142526-a564-4fe4-bfb2-26537a501642 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071612 Sep 10 20:58:16.504291 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1306/2688] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:16.514356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:58:16.516613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:58:16.621291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-59b2bab0-9b0e-47a8-8351-65759daf6dbd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:16.622183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-59b2bab0-9b0e-47a8-8351-65759daf6dbd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:16.628522 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4e798b51-6077-4a4f-9992-425e86fb7e78 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420112 Sep 10 20:58:16.635007 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1383/2689] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 20:58:16.640816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-688bde1e-e124-4759-b712-8b425d5db1ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:16.645977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-688bde1e-e124-4759-b712-8b425d5db1ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:16.646147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59b2bab0-9b0e-47a8-8351-65759daf6dbd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:16.647114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59b2bab0-9b0e-47a8-8351-65759daf6dbd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:16.647630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59b2bab0-9b0e-47a8-8351-65759daf6dbd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:16.648741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59b2bab0-9b0e-47a8-8351-65759daf6dbd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:16.649218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59b2bab0-9b0e-47a8-8351-65759daf6dbd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:16.649654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59b2bab0-9b0e-47a8-8351-65759daf6dbd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:16.664086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:16.782453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-688bde1e-e124-4759-b712-8b425d5db1ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:16.800576 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-688bde1e-e124-4759-b712-8b425d5db1ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1214 microversion: 2.1 time: 0.163969 Sep 10 20:58:16.804614 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1384/2690] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:16 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:16.924663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-59b2bab0-9b0e-47a8-8351-65759daf6dbd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:16.934458 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-59b2bab0-9b0e-47a8-8351-65759daf6dbd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1523 microversion: 2.1 time: 0.318537 Sep 10 20:58:16.937474 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1307/2691] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:16 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1523 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:17.026621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3df4ef8d-d306-4e84-9c7a-d5ee60bcd662 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:17.027477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3df4ef8d-d306-4e84-9c7a-d5ee60bcd662 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:17.039034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df4ef8d-d306-4e84-9c7a-d5ee60bcd662 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:17.043611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df4ef8d-d306-4e84-9c7a-d5ee60bcd662 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:17.044107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df4ef8d-d306-4e84-9c7a-d5ee60bcd662 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:17.045095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df4ef8d-d306-4e84-9c7a-d5ee60bcd662 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:17.046917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df4ef8d-d306-4e84-9c7a-d5ee60bcd662 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:17.047623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df4ef8d-d306-4e84-9c7a-d5ee60bcd662 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:17.339161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6ca5e7e6-c4eb-4b6c-968a-049cdbb7fe48 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:17.339983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6ca5e7e6-c4eb-4b6c-968a-049cdbb7fe48 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:17.352458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ca5e7e6-c4eb-4b6c-968a-049cdbb7fe48 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:17.358751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ca5e7e6-c4eb-4b6c-968a-049cdbb7fe48 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:17.359300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ca5e7e6-c4eb-4b6c-968a-049cdbb7fe48 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:17.360110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ca5e7e6-c4eb-4b6c-968a-049cdbb7fe48 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:17.360618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ca5e7e6-c4eb-4b6c-968a-049cdbb7fe48 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:17.361113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ca5e7e6-c4eb-4b6c-968a-049cdbb7fe48 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:17.387633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3df4ef8d-d306-4e84-9c7a-d5ee60bcd662 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:17.405283 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3df4ef8d-d306-4e84-9c7a-d5ee60bcd662 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1308 microversion: 2.1 time: 0.384158 Sep 10 20:58:17.406463 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1385/2692] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:17 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:17.438527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e2d90679-f1e9-4c2f-98e5-204057948ee5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99440a9a60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:17.506365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e2d90679-f1e9-4c2f-98e5-204057948ee5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.074921 Sep 10 20:58:17.507310 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1386/2693] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:17 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:17.827725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b01262ee-b2c1-46ef-ae11-e3c2560959e7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:17.828332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b01262ee-b2c1-46ef-ae11-e3c2560959e7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:17.834704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b01262ee-b2c1-46ef-ae11-e3c2560959e7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:17.835243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b01262ee-b2c1-46ef-ae11-e3c2560959e7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:17.835957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b01262ee-b2c1-46ef-ae11-e3c2560959e7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:17.836738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b01262ee-b2c1-46ef-ae11-e3c2560959e7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:17.837288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b01262ee-b2c1-46ef-ae11-e3c2560959e7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:17.837957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b01262ee-b2c1-46ef-ae11-e3c2560959e7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:17.874532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6ca5e7e6-c4eb-4b6c-968a-049cdbb7fe48 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:17.882383 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6ca5e7e6-c4eb-4b6c-968a-049cdbb7fe48 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.548226 Sep 10 20:58:17.886277 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1308/2694] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:17 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:17.958849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b01262ee-b2c1-46ef-ae11-e3c2560959e7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:17.962233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c76caba5-f640-49ae-bd88-9a89088184df tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:17.962856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c76caba5-f640-49ae-bd88-9a89088184df tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:17.970269 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b01262ee-b2c1-46ef-ae11-e3c2560959e7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1218 microversion: 2.1 time: 0.146516 Sep 10 20:58:17.973976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c76caba5-f640-49ae-bd88-9a89088184df tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:17.974471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c76caba5-f640-49ae-bd88-9a89088184df tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:17.975044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c76caba5-f640-49ae-bd88-9a89088184df tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:17.978570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c76caba5-f640-49ae-bd88-9a89088184df tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:17.979183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c76caba5-f640-49ae-bd88-9a89088184df tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:17.979755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c76caba5-f640-49ae-bd88-9a89088184df tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:17.990481 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1387/2695] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:17 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:18.432099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2a17a25a-c962-43d3-a57e-a786e1e621d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:18.433061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2a17a25a-c962-43d3-a57e-a786e1e621d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:18.448203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a17a25a-c962-43d3-a57e-a786e1e621d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:18.458403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a17a25a-c962-43d3-a57e-a786e1e621d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:18.460256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a17a25a-c962-43d3-a57e-a786e1e621d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:18.465134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a17a25a-c962-43d3-a57e-a786e1e621d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:18.469101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a17a25a-c962-43d3-a57e-a786e1e621d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:18.470922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a17a25a-c962-43d3-a57e-a786e1e621d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:18.726137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2a17a25a-c962-43d3-a57e-a786e1e621d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:18.735707 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2a17a25a-c962-43d3-a57e-a786e1e621d3 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1308 microversion: 2.1 time: 0.310093 Sep 10 20:58:18.736312 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1388/2696] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:18 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1308 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:18.741857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7dc10a3-297b-47da-995d-e311f5e4ff8a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99440a94c0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:18.790085 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f7dc10a3-297b-47da-995d-e311f5e4ff8a tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.052510 Sep 10 20:58:18.790675 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1389/2697] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:18 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:18.795482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3e2b9be4-01ec-4cd7-94a7-abcf5db2dafe req-54bb9524-fb65-47e6-af26-e3b900da8a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ea8e27-9137-45f8-98c7-f4b1cc01c9ec", "name": "network-vif-plugged", "status": "completed", "tag": "81bc7d32-0a6c-474d-8db7-f1b4f6e21cbc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:18.802823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c76caba5-f640-49ae-bd88-9a89088184df tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:18.806802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3e2b9be4-01ec-4cd7-94a7-abcf5db2dafe req-54bb9524-fb65-47e6-af26-e3b900da8a95 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:18.807825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3e2b9be4-01ec-4cd7-94a7-abcf5db2dafe req-54bb9524-fb65-47e6-af26-e3b900da8a95 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:18.808268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3e2b9be4-01ec-4cd7-94a7-abcf5db2dafe req-54bb9524-fb65-47e6-af26-e3b900da8a95 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:18.820560 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c76caba5-f640-49ae-bd88-9a89088184df tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1523 microversion: 2.1 time: 0.863187 Sep 10 20:58:18.822043 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1309/2698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:17 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1523 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:18.826897 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3e2b9be4-01ec-4cd7-94a7-abcf5db2dafe req-54bb9524-fb65-47e6-af26-e3b900da8a95 service nova] Creating event network-vif-plugged:81bc7d32-0a6c-474d-8db7-f1b4f6e21cbc for instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec on nch2-master-1 Sep 10 20:58:18.841733 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3e2b9be4-01ec-4cd7-94a7-abcf5db2dafe req-54bb9524-fb65-47e6-af26-e3b900da8a95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047145 Sep 10 20:58:18.841733 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1390/2699] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:18.916973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7731cb7f-2aed-44fd-99b8-e51f01bccfc9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:18.917532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7731cb7f-2aed-44fd-99b8-e51f01bccfc9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:18.924335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7731cb7f-2aed-44fd-99b8-e51f01bccfc9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:18.925149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7731cb7f-2aed-44fd-99b8-e51f01bccfc9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:18.925773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7731cb7f-2aed-44fd-99b8-e51f01bccfc9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:18.926689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7731cb7f-2aed-44fd-99b8-e51f01bccfc9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:18.927329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7731cb7f-2aed-44fd-99b8-e51f01bccfc9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:18.928949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7731cb7f-2aed-44fd-99b8-e51f01bccfc9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:18.999079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1788b875-54d3-4455-b2ce-681997be3b6d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:19.000492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1788b875-54d3-4455-b2ce-681997be3b6d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:19.023686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1788b875-54d3-4455-b2ce-681997be3b6d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:19.024488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1788b875-54d3-4455-b2ce-681997be3b6d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:19.025136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1788b875-54d3-4455-b2ce-681997be3b6d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:19.025960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1788b875-54d3-4455-b2ce-681997be3b6d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:19.027162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1788b875-54d3-4455-b2ce-681997be3b6d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:19.027723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1788b875-54d3-4455-b2ce-681997be3b6d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:19.154940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1788b875-54d3-4455-b2ce-681997be3b6d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:19.165138 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1788b875-54d3-4455-b2ce-681997be3b6d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1274 microversion: 2.1 time: 0.171264 Sep 10 20:58:19.186470 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1391/2700] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:18 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:19.579502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7731cb7f-2aed-44fd-99b8-e51f01bccfc9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:19.589030 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7731cb7f-2aed-44fd-99b8-e51f01bccfc9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.678909 Sep 10 20:58:19.589637 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1310/2701] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:18 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:19.764520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c1b427a8-d02b-4067-bf65-b56042a53ae9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:19.765973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c1b427a8-d02b-4067-bf65-b56042a53ae9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:19.775579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1b427a8-d02b-4067-bf65-b56042a53ae9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:19.776369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1b427a8-d02b-4067-bf65-b56042a53ae9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:19.777009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1b427a8-d02b-4067-bf65-b56042a53ae9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:19.778308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1b427a8-d02b-4067-bf65-b56042a53ae9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:19.779107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1b427a8-d02b-4067-bf65-b56042a53ae9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:19.779738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1b427a8-d02b-4067-bf65-b56042a53ae9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:19.818014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e408383-2b9d-406f-88d5-59eddcd53faa tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99451c21f0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:19.910995 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e408383-2b9d-406f-88d5-59eddcd53faa tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.107135 Sep 10 20:58:19.911742 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1311/2702] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:19 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:19.927266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62b1c638-f9ab-4cb9-b241-e461fedbbbb7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:19.928897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62b1c638-f9ab-4cb9-b241-e461fedbbbb7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:19.938138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62b1c638-f9ab-4cb9-b241-e461fedbbbb7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:19.938966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62b1c638-f9ab-4cb9-b241-e461fedbbbb7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:19.939685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62b1c638-f9ab-4cb9-b241-e461fedbbbb7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:19.940974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62b1c638-f9ab-4cb9-b241-e461fedbbbb7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:19.941915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62b1c638-f9ab-4cb9-b241-e461fedbbbb7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:19.942827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62b1c638-f9ab-4cb9-b241-e461fedbbbb7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:20.160673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c1b427a8-d02b-4067-bf65-b56042a53ae9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:20.174460 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c1b427a8-d02b-4067-bf65-b56042a53ae9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1308 microversion: 2.1 time: 0.414809 Sep 10 20:58:20.191777 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1392/2703] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:19 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1308 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:20.208390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-19574612-50e9-41c3-b3d0-30534e5435eb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:20.218932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-19574612-50e9-41c3-b3d0-30534e5435eb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:20.229330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19574612-50e9-41c3-b3d0-30534e5435eb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:20.234454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19574612-50e9-41c3-b3d0-30534e5435eb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:20.235091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19574612-50e9-41c3-b3d0-30534e5435eb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:20.235971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19574612-50e9-41c3-b3d0-30534e5435eb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:20.236600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19574612-50e9-41c3-b3d0-30534e5435eb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:20.237137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19574612-50e9-41c3-b3d0-30534e5435eb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:20.388272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-19574612-50e9-41c3-b3d0-30534e5435eb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:20.396396 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-19574612-50e9-41c3-b3d0-30534e5435eb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1272 microversion: 2.1 time: 0.203272 Sep 10 20:58:20.397076 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1393/2704] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:20 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:20.488945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-62b1c638-f9ab-4cb9-b241-e461fedbbbb7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:20.497431 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62b1c638-f9ab-4cb9-b241-e461fedbbbb7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1523 microversion: 2.1 time: 0.580086 Sep 10 20:58:20.501870 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1312/2705] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:19 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1523 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:20.617048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86b52f70-c825-43bf-86c9-589bc7e617b4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:20.617656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-86b52f70-c825-43bf-86c9-589bc7e617b4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:20.624514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86b52f70-c825-43bf-86c9-589bc7e617b4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:20.625242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86b52f70-c825-43bf-86c9-589bc7e617b4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:20.625893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86b52f70-c825-43bf-86c9-589bc7e617b4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:20.626782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86b52f70-c825-43bf-86c9-589bc7e617b4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:20.627398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86b52f70-c825-43bf-86c9-589bc7e617b4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:20.628011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86b52f70-c825-43bf-86c9-589bc7e617b4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:20.863584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e61caaa2-55f1-4448-b216-d5991e124690 req-0c0d2af0-aa86-48f4-8ae6-02821eb1a638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5284d9-8123-4e15-8576-be144c016b44", "name": "network-vif-plugged", "status": "completed", "tag": "fcae92b2-6a4a-43fe-b894-3e34661b8d2a"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:20.884624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e61caaa2-55f1-4448-b216-d5991e124690 req-0c0d2af0-aa86-48f4-8ae6-02821eb1a638 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:20.887945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e61caaa2-55f1-4448-b216-d5991e124690 req-0c0d2af0-aa86-48f4-8ae6-02821eb1a638 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:20.888606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e61caaa2-55f1-4448-b216-d5991e124690 req-0c0d2af0-aa86-48f4-8ae6-02821eb1a638 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:20.913504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-86b52f70-c825-43bf-86c9-589bc7e617b4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:20.914329 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e61caaa2-55f1-4448-b216-d5991e124690 req-0c0d2af0-aa86-48f4-8ae6-02821eb1a638 service nova] Creating event network-vif-plugged:fcae92b2-6a4a-43fe-b894-3e34661b8d2a for instance 4f5284d9-8123-4e15-8576-be144c016b44 on nch2-master-1 Sep 10 20:58:20.920739 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e61caaa2-55f1-4448-b216-d5991e124690 req-0c0d2af0-aa86-48f4-8ae6-02821eb1a638 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062933 Sep 10 20:58:20.922022 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1313/2706] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:58:20.938982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-af6f8ac1-ff54-4ec7-a709-0ab6b22ae346 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944de7940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:20.952652 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-86b52f70-c825-43bf-86c9-589bc7e617b4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.338076 Sep 10 20:58:20.953289 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1394/2707] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:20 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:21.009318 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-af6f8ac1-ff54-4ec7-a709-0ab6b22ae346 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.081026 Sep 10 20:58:21.017325 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1314/2708] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:20 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:21.206810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ef266841-f962-4587-8109-8a1f76e88eff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:21.207438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ef266841-f962-4587-8109-8a1f76e88eff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:21.224256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef266841-f962-4587-8109-8a1f76e88eff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:21.225741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef266841-f962-4587-8109-8a1f76e88eff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:21.226565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef266841-f962-4587-8109-8a1f76e88eff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:21.227517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef266841-f962-4587-8109-8a1f76e88eff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:21.228375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef266841-f962-4587-8109-8a1f76e88eff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:21.229151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef266841-f962-4587-8109-8a1f76e88eff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:21.424213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-996102be-8b34-40bd-a219-d74ae7b2f764 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:21.433551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-996102be-8b34-40bd-a219-d74ae7b2f764 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:21.447288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-996102be-8b34-40bd-a219-d74ae7b2f764 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:21.447943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-996102be-8b34-40bd-a219-d74ae7b2f764 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:21.448631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-996102be-8b34-40bd-a219-d74ae7b2f764 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:21.449621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-996102be-8b34-40bd-a219-d74ae7b2f764 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:21.450379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-996102be-8b34-40bd-a219-d74ae7b2f764 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:21.451051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-996102be-8b34-40bd-a219-d74ae7b2f764 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:21.579707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ef266841-f962-4587-8109-8a1f76e88eff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:21.594939 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ef266841-f962-4587-8109-8a1f76e88eff tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1308 microversion: 2.1 time: 0.392051 Sep 10 20:58:21.595829 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1395/2709] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:21 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:21.605183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-47ffbc65-9f83-440e-b703-b8268075dc5b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:21.612074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-47ffbc65-9f83-440e-b703-b8268075dc5b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:21.637924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47ffbc65-9f83-440e-b703-b8268075dc5b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:21.638906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47ffbc65-9f83-440e-b703-b8268075dc5b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:21.639582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47ffbc65-9f83-440e-b703-b8268075dc5b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:21.640611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47ffbc65-9f83-440e-b703-b8268075dc5b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:21.642111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47ffbc65-9f83-440e-b703-b8268075dc5b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:21.642802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47ffbc65-9f83-440e-b703-b8268075dc5b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:22.050136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-47ffbc65-9f83-440e-b703-b8268075dc5b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:22.066331 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-47ffbc65-9f83-440e-b703-b8268075dc5b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1508 microversion: 2.1 time: 0.468531 Sep 10 20:58:22.072325 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1396/2710] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:21 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:22.079811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2aebb368-c3a4-45b9-86ce-cb2788062ad4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:22.082212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2aebb368-c3a4-45b9-86ce-cb2788062ad4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:22.085693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-996102be-8b34-40bd-a219-d74ae7b2f764 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:22.097990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2aebb368-c3a4-45b9-86ce-cb2788062ad4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:22.100150 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-996102be-8b34-40bd-a219-d74ae7b2f764 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.683194 Sep 10 20:58:22.100873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2aebb368-c3a4-45b9-86ce-cb2788062ad4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:22.101865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2aebb368-c3a4-45b9-86ce-cb2788062ad4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:22.113852 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1315/2711] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:21 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:22.116009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2aebb368-c3a4-45b9-86ce-cb2788062ad4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:22.117298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-054f69ad-a3f3-4014-ae73-703c8478eb9f tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944c28f70>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:22.125764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2aebb368-c3a4-45b9-86ce-cb2788062ad4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:22.126619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2aebb368-c3a4-45b9-86ce-cb2788062ad4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:22.208081 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-054f69ad-a3f3-4014-ae73-703c8478eb9f tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.104355 Sep 10 20:58:22.209108 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1316/2712] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:22 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:22.225441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3086e2ac-c5c6-468b-bdf6-7f356ae515f8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:22.227771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3086e2ac-c5c6-468b-bdf6-7f356ae515f8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:22.242502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3086e2ac-c5c6-468b-bdf6-7f356ae515f8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:22.245135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3086e2ac-c5c6-468b-bdf6-7f356ae515f8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:22.247132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3086e2ac-c5c6-468b-bdf6-7f356ae515f8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:22.249504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3086e2ac-c5c6-468b-bdf6-7f356ae515f8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:22.250291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3086e2ac-c5c6-468b-bdf6-7f356ae515f8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:22.252209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3086e2ac-c5c6-468b-bdf6-7f356ae515f8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:22.451636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2aebb368-c3a4-45b9-86ce-cb2788062ad4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:22.460034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:22.464888 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2aebb368-c3a4-45b9-86ce-cb2788062ad4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.391187 Sep 10 20:58:22.467425 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1397/2713] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:22 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:22.584228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3086e2ac-c5c6-468b-bdf6-7f356ae515f8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:22.592833 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3086e2ac-c5c6-468b-bdf6-7f356ae515f8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 200 len: 1508 microversion: 2.1 time: 0.382506 Sep 10 20:58:22.604233 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1317/2714] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:22 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 1508 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:22.627856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a3ce3c08-718e-4d52-a918-e460de2d5df7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:22.629070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a3ce3c08-718e-4d52-a918-e460de2d5df7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:22.639036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-804836b5-34ed-4735-8adf-ad9f787f59ae tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:22.639570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-804836b5-34ed-4735-8adf-ad9f787f59ae tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:22.646849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ce3c08-718e-4d52-a918-e460de2d5df7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:22.647920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ce3c08-718e-4d52-a918-e460de2d5df7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:22.649625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ce3c08-718e-4d52-a918-e460de2d5df7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:22.652434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-804836b5-34ed-4735-8adf-ad9f787f59ae tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:22.653741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ce3c08-718e-4d52-a918-e460de2d5df7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:22.655160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ce3c08-718e-4d52-a918-e460de2d5df7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:22.657418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3ce3c08-718e-4d52-a918-e460de2d5df7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:22.661331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-804836b5-34ed-4735-8adf-ad9f787f59ae tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:22.661893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-804836b5-34ed-4735-8adf-ad9f787f59ae tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:22.666420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-804836b5-34ed-4735-8adf-ad9f787f59ae tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:22.666941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-804836b5-34ed-4735-8adf-ad9f787f59ae tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:22.667395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-804836b5-34ed-4735-8adf-ad9f787f59ae tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:22.739840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-804836b5-34ed-4735-8adf-ad9f787f59ae tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:58:22.924109 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-804836b5-34ed-4735-8adf-ad9f787f59ae tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 204 len: 0 microversion: 2.1 time: 0.293894 Sep 10 20:58:22.925741 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1318/2715] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:22 2022] DELETE /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:23.076435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a3ce3c08-718e-4d52-a918-e460de2d5df7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:23.086964 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a3ce3c08-718e-4d52-a918-e460de2d5df7 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1308 microversion: 2.1 time: 0.463695 Sep 10 20:58:23.088023 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1398/2716] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:22 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:23.135325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a27bc87-c111-4ba4-af76-b4f9728cff2e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:23.135986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2a27bc87-c111-4ba4-af76-b4f9728cff2e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:23.147899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a27bc87-c111-4ba4-af76-b4f9728cff2e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:23.151031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a27bc87-c111-4ba4-af76-b4f9728cff2e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:23.152791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a27bc87-c111-4ba4-af76-b4f9728cff2e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:23.156685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a27bc87-c111-4ba4-af76-b4f9728cff2e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:23.157387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a27bc87-c111-4ba4-af76-b4f9728cff2e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:23.158057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a27bc87-c111-4ba4-af76-b4f9728cff2e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:23.226426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7384895-f68e-49c2-a112-db539e6d0f1e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f993ff0ec10>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:23.301578 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b7384895-f68e-49c2-a112-db539e6d0f1e tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.080943 Sep 10 20:58:23.302447 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1399/2717] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:23 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:23.308293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1614106794", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "4f12ae9c-3aad-4e6b-a7d6-742005ff2d43"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:23.370905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] validate_networks() for [('4f12ae9c-3aad-4e6b-a7d6-742005ff2d43', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:58:23.756144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2a27bc87-c111-4ba4-af76-b4f9728cff2e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:23.771210 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2a27bc87-c111-4ba4-af76-b4f9728cff2e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.641967 Sep 10 20:58:23.772447 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1319/2718] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:23 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:23.782333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23fcdbd7-dac4-4921-89e7-49482612861e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:23.783532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23fcdbd7-dac4-4921-89e7-49482612861e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:23.797044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcdbd7-dac4-4921-89e7-49482612861e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:23.798656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcdbd7-dac4-4921-89e7-49482612861e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:23.799631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcdbd7-dac4-4921-89e7-49482612861e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:23.801079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcdbd7-dac4-4921-89e7-49482612861e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:23.801708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcdbd7-dac4-4921-89e7-49482612861e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:23.802309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23fcdbd7-dac4-4921-89e7-49482612861e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:23.991050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:58:23.993974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:58:23.994740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:58:23.995164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:58:23.995591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:58:24.007891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:24.008764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:24.009438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:24.010554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:24.011369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:24.012091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:24.065943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Getting quotas for project c14add960abe42f580aeeade3e6f27d9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:24.074890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Getting quotas for user 4c3e0565f75c4f558a8936f547ae9d76 and project c14add960abe42f580aeeade3e6f27d9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:24.094015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:58:24.097971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:58:24.157850 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-17e03e2c-24f5-4eca-aae0-680ee5fac261 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853363 Sep 10 20:58:24.160382 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1400/2719] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:58:24.166320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-69566f8d-a8b5-431e-a15b-4996d940ffcd req-927801b6-592f-479f-b16b-c96a70f0fb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f1f769d-7314-4652-8dff-f06c1b403046", "tag": "7553bf76-9c9b-498a-870a-5ca0699d24c1"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:24.178197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-69566f8d-a8b5-431e-a15b-4996d940ffcd req-927801b6-592f-479f-b16b-c96a70f0fb78 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:24.179545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-69566f8d-a8b5-431e-a15b-4996d940ffcd req-927801b6-592f-479f-b16b-c96a70f0fb78 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:24.180157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-69566f8d-a8b5-431e-a15b-4996d940ffcd req-927801b6-592f-479f-b16b-c96a70f0fb78 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:24.194372 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-69566f8d-a8b5-431e-a15b-4996d940ffcd req-927801b6-592f-479f-b16b-c96a70f0fb78 service nova] Creating event network-changed:7553bf76-9c9b-498a-870a-5ca0699d24c1 for instance 5f1f769d-7314-4652-8dff-f06c1b403046 on nch1-master-1 Sep 10 20:58:24.241657 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-69566f8d-a8b5-431e-a15b-4996d940ffcd req-927801b6-592f-479f-b16b-c96a70f0fb78 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074015 Sep 10 20:58:24.250038 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1401/2720] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:24.290238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-126ccba0-d346-482b-92b9-e5b6fdcb7f78 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:24.292024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-126ccba0-d346-482b-92b9-e5b6fdcb7f78 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:24.328261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-126ccba0-d346-482b-92b9-e5b6fdcb7f78 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:24.328792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-126ccba0-d346-482b-92b9-e5b6fdcb7f78 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:24.329237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-126ccba0-d346-482b-92b9-e5b6fdcb7f78 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:24.329993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-126ccba0-d346-482b-92b9-e5b6fdcb7f78 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:24.330456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-126ccba0-d346-482b-92b9-e5b6fdcb7f78 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:24.330870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-126ccba0-d346-482b-92b9-e5b6fdcb7f78 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:24.345429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-23fcdbd7-dac4-4921-89e7-49482612861e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:24.374706 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23fcdbd7-dac4-4921-89e7-49482612861e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.599596 Sep 10 20:58:24.388735 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1320/2721] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:23 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:24.400871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5b0b972-6c65-401f-b9ae-91ad7680adb2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:24.422163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e5b0b972-6c65-401f-b9ae-91ad7680adb2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:24.664763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e5b0b972-6c65-401f-b9ae-91ad7680adb2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:24.671799 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5b0b972-6c65-401f-b9ae-91ad7680adb2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1218 microversion: 2.1 time: 0.280354 Sep 10 20:58:24.681385 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1321/2722] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:24 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1218 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:24.686614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1e17aafc-db07-402e-bfbe-a76c89f745e8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99495f1670>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:24.712235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-126ccba0-d346-482b-92b9-e5b6fdcb7f78 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:24.723390 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-126ccba0-d346-482b-92b9-e5b6fdcb7f78 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1308 microversion: 2.1 time: 0.472008 Sep 10 20:58:24.725984 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1402/2723] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:24 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:24.765482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8f7f43f9-5451-4b43-85bb-41ee14a568ee req-4c629ea9-64fd-4387-a149-cd28b149abad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30a9756-704a-4774-b74c-c0085e7528ca", "name": "network-vif-plugged", "status": "completed", "tag": "7b663272-fba8-4770-a6df-21af15d41f96"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:24.805444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8f7f43f9-5451-4b43-85bb-41ee14a568ee req-4c629ea9-64fd-4387-a149-cd28b149abad service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:24.805868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8f7f43f9-5451-4b43-85bb-41ee14a568ee req-4c629ea9-64fd-4387-a149-cd28b149abad service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:24.807377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8f7f43f9-5451-4b43-85bb-41ee14a568ee req-4c629ea9-64fd-4387-a149-cd28b149abad service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:24.822678 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8f7f43f9-5451-4b43-85bb-41ee14a568ee req-4c629ea9-64fd-4387-a149-cd28b149abad service nova] Creating event network-vif-plugged:7b663272-fba8-4770-a6df-21af15d41f96 for instance a30a9756-704a-4774-b74c-c0085e7528ca on nch2-master-1 Sep 10 20:58:24.826719 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1e17aafc-db07-402e-bfbe-a76c89f745e8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.144118 Sep 10 20:58:24.828804 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1322/2724] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:24 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:24.833597 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8f7f43f9-5451-4b43-85bb-41ee14a568ee req-4c629ea9-64fd-4387-a149-cd28b149abad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077801 Sep 10 20:58:24.837572 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1403/2725] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:24.842170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9159a96e-96ff-42af-a306-14a76edf57d3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:24.843037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9159a96e-96ff-42af-a306-14a76edf57d3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:24.859210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9159a96e-96ff-42af-a306-14a76edf57d3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:24.883081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9159a96e-96ff-42af-a306-14a76edf57d3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:24.885265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9159a96e-96ff-42af-a306-14a76edf57d3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:24.887945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9159a96e-96ff-42af-a306-14a76edf57d3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:24.896092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9159a96e-96ff-42af-a306-14a76edf57d3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:24.897418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9159a96e-96ff-42af-a306-14a76edf57d3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:25.401476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea2cb670-eb0f-48da-b0ba-24ad0e1446d4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:25.402200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ea2cb670-eb0f-48da-b0ba-24ad0e1446d4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:25.415263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea2cb670-eb0f-48da-b0ba-24ad0e1446d4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:25.416051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea2cb670-eb0f-48da-b0ba-24ad0e1446d4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:25.416682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea2cb670-eb0f-48da-b0ba-24ad0e1446d4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:25.419651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea2cb670-eb0f-48da-b0ba-24ad0e1446d4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:25.420459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea2cb670-eb0f-48da-b0ba-24ad0e1446d4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:25.420905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea2cb670-eb0f-48da-b0ba-24ad0e1446d4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:25.551902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9159a96e-96ff-42af-a306-14a76edf57d3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:25.565447 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9159a96e-96ff-42af-a306-14a76edf57d3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.733572 Sep 10 20:58:25.566877 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1323/2726] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:24 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:25.683474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ea2cb670-eb0f-48da-b0ba-24ad0e1446d4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:25.691718 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea2cb670-eb0f-48da-b0ba-24ad0e1446d4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.294688 Sep 10 20:58:25.697779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0dede5d4-8e17-427f-a95d-c155cf8880b1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:25.698981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0dede5d4-8e17-427f-a95d-c155cf8880b1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:25.706558 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1404/2727] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:25 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:25.711632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dede5d4-8e17-427f-a95d-c155cf8880b1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:25.713958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dede5d4-8e17-427f-a95d-c155cf8880b1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:25.714571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dede5d4-8e17-427f-a95d-c155cf8880b1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:25.719786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dede5d4-8e17-427f-a95d-c155cf8880b1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:25.720528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dede5d4-8e17-427f-a95d-c155cf8880b1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:25.721121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dede5d4-8e17-427f-a95d-c155cf8880b1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:25.750254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9b7a09a1-c44c-411b-9867-76955f1b95fd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:25.751150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9b7a09a1-c44c-411b-9867-76955f1b95fd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:25.765529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b7a09a1-c44c-411b-9867-76955f1b95fd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:25.767802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b7a09a1-c44c-411b-9867-76955f1b95fd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:25.774519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b7a09a1-c44c-411b-9867-76955f1b95fd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:25.775539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b7a09a1-c44c-411b-9867-76955f1b95fd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:25.776365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b7a09a1-c44c-411b-9867-76955f1b95fd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:25.777735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b7a09a1-c44c-411b-9867-76955f1b95fd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:25.788335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:25.904512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0dede5d4-8e17-427f-a95d-c155cf8880b1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:25.914937 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0dede5d4-8e17-427f-a95d-c155cf8880b1 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1270 microversion: 2.1 time: 0.221452 Sep 10 20:58:25.930565 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1324/2728] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:25 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:25.937633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-47f098df-2a6e-40a6-bdb3-7705c111d3a5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99450e7940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:25.988405 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-47f098df-2a6e-40a6-bdb3-7705c111d3a5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.056409 Sep 10 20:58:25.989438 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1325/2729] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:25 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:26.083875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9b7a09a1-c44c-411b-9867-76955f1b95fd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:26.099275 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9b7a09a1-c44c-411b-9867-76955f1b95fd tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1308 microversion: 2.1 time: 0.348011 Sep 10 20:58:26.102511 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1405/2730] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:25 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1308 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:26.262921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-05cbf80d-93eb-4d9f-a701-a1efcdfa979f req-f9b8593f-3d7a-49b9-998c-7d64aa1c8800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ea8e27-9137-45f8-98c7-f4b1cc01c9ec", "name": "network-vif-deleted", "tag": "81bc7d32-0a6c-474d-8db7-f1b4f6e21cbc"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:26.287929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-05cbf80d-93eb-4d9f-a701-a1efcdfa979f req-f9b8593f-3d7a-49b9-998c-7d64aa1c8800 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:26.288644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-05cbf80d-93eb-4d9f-a701-a1efcdfa979f req-f9b8593f-3d7a-49b9-998c-7d64aa1c8800 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:26.289063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-05cbf80d-93eb-4d9f-a701-a1efcdfa979f req-f9b8593f-3d7a-49b9-998c-7d64aa1c8800 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:26.320759 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-05cbf80d-93eb-4d9f-a701-a1efcdfa979f req-f9b8593f-3d7a-49b9-998c-7d64aa1c8800 service nova] Creating event network-vif-deleted:81bc7d32-0a6c-474d-8db7-f1b4f6e21cbc for instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec on nch2-master-1 Sep 10 20:58:26.336253 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-05cbf80d-93eb-4d9f-a701-a1efcdfa979f req-f9b8593f-3d7a-49b9-998c-7d64aa1c8800 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076970 Sep 10 20:58:26.337426 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1326/2731] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:26.594668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85f289a1-bcb5-44c7-adb8-b7b380e294c4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:26.595358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-85f289a1-bcb5-44c7-adb8-b7b380e294c4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:26.607144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85f289a1-bcb5-44c7-adb8-b7b380e294c4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:26.607636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85f289a1-bcb5-44c7-adb8-b7b380e294c4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:26.608083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85f289a1-bcb5-44c7-adb8-b7b380e294c4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:26.608806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85f289a1-bcb5-44c7-adb8-b7b380e294c4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:26.609259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85f289a1-bcb5-44c7-adb8-b7b380e294c4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:26.609695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85f289a1-bcb5-44c7-adb8-b7b380e294c4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:26.719090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-758933cd-7e2d-47f4-9033-a2f9174df6f1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:26.720360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-758933cd-7e2d-47f4-9033-a2f9174df6f1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:26.731565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758933cd-7e2d-47f4-9033-a2f9174df6f1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:26.735157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758933cd-7e2d-47f4-9033-a2f9174df6f1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:26.738730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758933cd-7e2d-47f4-9033-a2f9174df6f1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:26.745156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758933cd-7e2d-47f4-9033-a2f9174df6f1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:26.745862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758933cd-7e2d-47f4-9033-a2f9174df6f1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:26.748383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-758933cd-7e2d-47f4-9033-a2f9174df6f1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:26.777739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-85f289a1-bcb5-44c7-adb8-b7b380e294c4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:26.791180 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-85f289a1-bcb5-44c7-adb8-b7b380e294c4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.200567 Sep 10 20:58:26.792282 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1406/2732] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:26 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:26.867003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e0e00e92-4ce2-495a-983a-f48642fadde5 req-3e41f512-f721-40cd-a4b3-a5a7b16ad987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9857472b-f236-4d85-b592-68d9cd4cfdf7", "name": "network-vif-plugged", "status": "completed", "tag": "e1b862e2-4037-4e26-9cba-7a0cab43d786"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:26.891577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e0e00e92-4ce2-495a-983a-f48642fadde5 req-3e41f512-f721-40cd-a4b3-a5a7b16ad987 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:26.893786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e0e00e92-4ce2-495a-983a-f48642fadde5 req-3e41f512-f721-40cd-a4b3-a5a7b16ad987 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:26.894352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e0e00e92-4ce2-495a-983a-f48642fadde5 req-3e41f512-f721-40cd-a4b3-a5a7b16ad987 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:26.915999 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e0e00e92-4ce2-495a-983a-f48642fadde5 req-3e41f512-f721-40cd-a4b3-a5a7b16ad987 service nova] Creating event network-vif-plugged:e1b862e2-4037-4e26-9cba-7a0cab43d786 for instance 9857472b-f236-4d85-b592-68d9cd4cfdf7 on nch2-master-1 Sep 10 20:58:26.921701 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e0e00e92-4ce2-495a-983a-f48642fadde5 req-3e41f512-f721-40cd-a4b3-a5a7b16ad987 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059482 Sep 10 20:58:26.923137 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1407/2733] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:26.946115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b1e5cc57-2235-4499-80e1-6d99e21f6a13 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:26.947124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b1e5cc57-2235-4499-80e1-6d99e21f6a13 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:26.960164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc57-2235-4499-80e1-6d99e21f6a13 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:26.960989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc57-2235-4499-80e1-6d99e21f6a13 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:26.961674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc57-2235-4499-80e1-6d99e21f6a13 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:26.962853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc57-2235-4499-80e1-6d99e21f6a13 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:26.963846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc57-2235-4499-80e1-6d99e21f6a13 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:26.964493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1e5cc57-2235-4499-80e1-6d99e21f6a13 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:27.073109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1e5cc57-2235-4499-80e1-6d99e21f6a13 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:27.088170 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b1e5cc57-2235-4499-80e1-6d99e21f6a13 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1270 microversion: 2.1 time: 0.148088 Sep 10 20:58:27.090225 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1408/2734] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:26 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:27.096179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8fc6e1a-cb9e-4282-9ddb-f3aa06b64a76 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f993ff0c700>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:27.144834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-758933cd-7e2d-47f4-9033-a2f9174df6f1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:27.160195 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-758933cd-7e2d-47f4-9033-a2f9174df6f1 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.446818 Sep 10 20:58:27.162949 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1327/2735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:26 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:27.168590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ade13f9f-56dc-4c0c-9f81-13fa5980ab61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:27.169199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ade13f9f-56dc-4c0c-9f81-13fa5980ab61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:27.177162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ade13f9f-56dc-4c0c-9f81-13fa5980ab61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:27.178060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ade13f9f-56dc-4c0c-9f81-13fa5980ab61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:27.178937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ade13f9f-56dc-4c0c-9f81-13fa5980ab61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:27.180047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ade13f9f-56dc-4c0c-9f81-13fa5980ab61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:27.180697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ade13f9f-56dc-4c0c-9f81-13fa5980ab61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:27.181344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ade13f9f-56dc-4c0c-9f81-13fa5980ab61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:27.214084 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d8fc6e1a-cb9e-4282-9ddb-f3aa06b64a76 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.119356 Sep 10 20:58:27.219248 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1409/2736] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:27 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:27.485775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ade13f9f-56dc-4c0c-9f81-13fa5980ab61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:27.501712 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ade13f9f-56dc-4c0c-9f81-13fa5980ab61 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1488 microversion: 2.1 time: 0.337367 Sep 10 20:58:27.528492 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1328/2737] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:27 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1488 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:27.530637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-06c29073-9322-4153-8a8e-93279c3a5310 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-383317077"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:27.532970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-06c29073-9322-4153-8a8e-93279c3a5310 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:27.550135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06c29073-9322-4153-8a8e-93279c3a5310 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:27.550953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06c29073-9322-4153-8a8e-93279c3a5310 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:27.551590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06c29073-9322-4153-8a8e-93279c3a5310 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:27.552521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06c29073-9322-4153-8a8e-93279c3a5310 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:27.553742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06c29073-9322-4153-8a8e-93279c3a5310 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:27.554412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-06c29073-9322-4153-8a8e-93279c3a5310 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:27.822181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3507089e-ba40-4001-8455-d2f084067b2b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:27.824702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3507089e-ba40-4001-8455-d2f084067b2b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:27.838520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3507089e-ba40-4001-8455-d2f084067b2b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:27.843094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3507089e-ba40-4001-8455-d2f084067b2b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:27.843776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3507089e-ba40-4001-8455-d2f084067b2b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:27.846527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3507089e-ba40-4001-8455-d2f084067b2b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:27.847127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3507089e-ba40-4001-8455-d2f084067b2b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:27.847799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3507089e-ba40-4001-8455-d2f084067b2b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:27.881717 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-06c29073-9322-4153-8a8e-93279c3a5310 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "POST /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca/action" status: 202 len: 0 microversion: 2.1 time: 0.353131 Sep 10 20:58:27.882503 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1410/2738] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:58:27 2022] POST /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 10 20:58:27.905002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f4659486-8c37-48d2-9b17-69e025e6787f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f993ff0c790>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:28.033148 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f4659486-8c37-48d2-9b17-69e025e6787f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a" status: 200 len: 1413 microversion: 2.1 time: 0.138966 Sep 10 20:58:28.033797 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1411/2739] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:27 2022] GET /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a => generated 1413 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:28.064247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d79d936-5876-4d2b-8a73-0a6ef145954b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f993ff45820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:28.154671 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d79d936-5876-4d2b-8a73-0a6ef145954b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a" status: 200 len: 1413 microversion: 2.1 time: 0.109366 Sep 10 20:58:28.156009 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1412/2740] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:28 2022] GET /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:28.156393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3507089e-ba40-4001-8455-d2f084067b2b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:28.168818 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3507089e-ba40-4001-8455-d2f084067b2b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.352567 Sep 10 20:58:28.169478 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1329/2741] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:27 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:28.169745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8041e08f-072e-480a-b6b8-24971e45dddd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:28.172100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8041e08f-072e-480a-b6b8-24971e45dddd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:28.175174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f3cb1a9-6032-4546-be5d-10ba61ad98b2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99495b3b80>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:28.187711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8041e08f-072e-480a-b6b8-24971e45dddd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:28.188905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8041e08f-072e-480a-b6b8-24971e45dddd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:28.190444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8041e08f-072e-480a-b6b8-24971e45dddd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:28.191260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8041e08f-072e-480a-b6b8-24971e45dddd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:28.192690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8041e08f-072e-480a-b6b8-24971e45dddd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:28.196307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8041e08f-072e-480a-b6b8-24971e45dddd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:28.346326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8041e08f-072e-480a-b6b8-24971e45dddd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:28.357960 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8041e08f-072e-480a-b6b8-24971e45dddd tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1270 microversion: 2.1 time: 0.200361 Sep 10 20:58:28.363340 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1413/2742] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:28 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:28.371785 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f3cb1a9-6032-4546-be5d-10ba61ad98b2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a" status: 204 len: 0 microversion: 2.1 time: 0.200865 Sep 10 20:58:28.372361 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1330/2743] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:28 2022] DELETE /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:28.378038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-becc9f82-fe90-44ac-ae03-0c3133afa6fb tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99495b3790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:28.383082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-781753a0-1ae9-408d-8349-f3bf8b9e9cb8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:28.383848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-781753a0-1ae9-408d-8349-f3bf8b9e9cb8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:28.410699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-781753a0-1ae9-408d-8349-f3bf8b9e9cb8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:28.410699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-781753a0-1ae9-408d-8349-f3bf8b9e9cb8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:28.411058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-781753a0-1ae9-408d-8349-f3bf8b9e9cb8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:28.419527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-781753a0-1ae9-408d-8349-f3bf8b9e9cb8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:28.422612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-781753a0-1ae9-408d-8349-f3bf8b9e9cb8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:28.426714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-781753a0-1ae9-408d-8349-f3bf8b9e9cb8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:28.468238 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-becc9f82-fe90-44ac-ae03-0c3133afa6fb tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.094599 Sep 10 20:58:28.469146 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1331/2744] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:28 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:28.477746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-637efcb9-bfde-44e5-b545-9ef2177286e0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f99496873a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:28.504104 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-637efcb9-bfde-44e5-b545-9ef2177286e0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Image not found. Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-637efcb9-bfde-44e5-b545-9ef2177286e0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a HTTP/1.1 Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'c7d21c6c-865d-4c31-a8e8-f081a43da29a'} Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c7d21c6c-865d-4c31-a8e8-f081a43da29a Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 20:58:28.506292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c7d21c6c-865d-4c31-a8e8-f081a43da29a could not be found. Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:28.511047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-637efcb9-bfde-44e5-b545-9ef2177286e0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:28.517025 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-637efcb9-bfde-44e5-b545-9ef2177286e0 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a" status: 404 len: 62 microversion: 2.1 time: 0.046672 Sep 10 20:58:28.520973 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1332/2745] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:28 2022] GET /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:58:28.543332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f205ffbf-1cc7-4cb0-8973-bbfa2387f29b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:28.543966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f205ffbf-1cc7-4cb0-8973-bbfa2387f29b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:28.551105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f205ffbf-1cc7-4cb0-8973-bbfa2387f29b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:28.551608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f205ffbf-1cc7-4cb0-8973-bbfa2387f29b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:28.569395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f205ffbf-1cc7-4cb0-8973-bbfa2387f29b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:28.573943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f205ffbf-1cc7-4cb0-8973-bbfa2387f29b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:28.574553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f205ffbf-1cc7-4cb0-8973-bbfa2387f29b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:28.575019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f205ffbf-1cc7-4cb0-8973-bbfa2387f29b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:28.732856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-781753a0-1ae9-408d-8349-f3bf8b9e9cb8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:28.745375 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-781753a0-1ae9-408d-8349-f3bf8b9e9cb8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1319 microversion: 2.1 time: 0.377245 Sep 10 20:58:28.746063 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1414/2746] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:28 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:28.878925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f205ffbf-1cc7-4cb0-8973-bbfa2387f29b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:28.906192 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f205ffbf-1cc7-4cb0-8973-bbfa2387f29b tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1500 microversion: 2.1 time: 0.379021 Sep 10 20:58:28.907155 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1333/2747] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:28 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1500 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:29.192303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b573086d-e47e-42a0-af00-f384a00e7035 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:29.194400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b573086d-e47e-42a0-af00-f384a00e7035 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:29.210495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b573086d-e47e-42a0-af00-f384a00e7035 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:29.213986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b573086d-e47e-42a0-af00-f384a00e7035 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:29.218555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b573086d-e47e-42a0-af00-f384a00e7035 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:29.219316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b573086d-e47e-42a0-af00-f384a00e7035 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:29.219789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b573086d-e47e-42a0-af00-f384a00e7035 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:29.220224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b573086d-e47e-42a0-af00-f384a00e7035 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:29.389359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e1f2393e-da21-4952-9dc4-2507d27822d9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:29.390213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e1f2393e-da21-4952-9dc4-2507d27822d9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:29.401968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1f2393e-da21-4952-9dc4-2507d27822d9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:29.402739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1f2393e-da21-4952-9dc4-2507d27822d9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:29.403330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1f2393e-da21-4952-9dc4-2507d27822d9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:29.404213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1f2393e-da21-4952-9dc4-2507d27822d9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:29.408453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1f2393e-da21-4952-9dc4-2507d27822d9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:29.409088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1f2393e-da21-4952-9dc4-2507d27822d9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:29.591206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e1f2393e-da21-4952-9dc4-2507d27822d9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:29.613487 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e1f2393e-da21-4952-9dc4-2507d27822d9 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1276 microversion: 2.1 time: 0.228418 Sep 10 20:58:29.631479 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1334/2748] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:29 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:29.643487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f368ead-53a9-4a57-914f-3b02ccf6315f tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944d73dc0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:29.722837 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f368ead-53a9-4a57-914f-3b02ccf6315f tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.089571 Sep 10 20:58:29.732129 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1335/2749] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:29 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:29.768185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-46d0e7af-c072-43c8-8761-7a72c7aeeb53 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:29.769031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-46d0e7af-c072-43c8-8761-7a72c7aeeb53 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:29.782154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46d0e7af-c072-43c8-8761-7a72c7aeeb53 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:29.782932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46d0e7af-c072-43c8-8761-7a72c7aeeb53 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:29.784625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46d0e7af-c072-43c8-8761-7a72c7aeeb53 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:29.787971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46d0e7af-c072-43c8-8761-7a72c7aeeb53 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:29.789108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46d0e7af-c072-43c8-8761-7a72c7aeeb53 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:29.789709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46d0e7af-c072-43c8-8761-7a72c7aeeb53 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:29.827667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b573086d-e47e-42a0-af00-f384a00e7035 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:29.845612 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b573086d-e47e-42a0-af00-f384a00e7035 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.655528 Sep 10 20:58:29.862327 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1415/2750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:29 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:29.940623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2554062b-d8a2-475b-a840-2a64bb04fa0d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:29.941568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2554062b-d8a2-475b-a840-2a64bb04fa0d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:29.958433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2554062b-d8a2-475b-a840-2a64bb04fa0d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:29.961463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2554062b-d8a2-475b-a840-2a64bb04fa0d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:29.962376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2554062b-d8a2-475b-a840-2a64bb04fa0d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:29.963699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2554062b-d8a2-475b-a840-2a64bb04fa0d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:29.965226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2554062b-d8a2-475b-a840-2a64bb04fa0d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:29.965964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2554062b-d8a2-475b-a840-2a64bb04fa0d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:30.180418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-46d0e7af-c072-43c8-8761-7a72c7aeeb53 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:30.196413 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-46d0e7af-c072-43c8-8761-7a72c7aeeb53 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1469 microversion: 2.1 time: 0.426375 Sep 10 20:58:30.214940 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1336/2751] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:29 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1469 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:30.226699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2554062b-d8a2-475b-a840-2a64bb04fa0d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:30.235149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9f680c5c-89ce-48fa-985d-8942e8e34d38 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:30.235772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9f680c5c-89ce-48fa-985d-8942e8e34d38 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 4f5284d9-8123-4e15-8576-be144c016b44] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:30.243016 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2554062b-d8a2-475b-a840-2a64bb04fa0d tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1506 microversion: 2.1 time: 0.312217 Sep 10 20:58:30.246246 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1416/2752] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:29 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:30.260221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f680c5c-89ce-48fa-985d-8942e8e34d38 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:30.263967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f680c5c-89ce-48fa-985d-8942e8e34d38 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:30.264764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f680c5c-89ce-48fa-985d-8942e8e34d38 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:30.265729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f680c5c-89ce-48fa-985d-8942e8e34d38 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:30.266492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f680c5c-89ce-48fa-985d-8942e8e34d38 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:30.267110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f680c5c-89ce-48fa-985d-8942e8e34d38 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:30.642385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c79d9ccd-9e99-4b19-b5a0-12c10fec9454 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:30.643007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c79d9ccd-9e99-4b19-b5a0-12c10fec9454 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:30.661275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c79d9ccd-9e99-4b19-b5a0-12c10fec9454 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:30.667091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c79d9ccd-9e99-4b19-b5a0-12c10fec9454 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:30.669924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c79d9ccd-9e99-4b19-b5a0-12c10fec9454 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:30.672150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c79d9ccd-9e99-4b19-b5a0-12c10fec9454 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:30.674427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c79d9ccd-9e99-4b19-b5a0-12c10fec9454 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:30.675158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c79d9ccd-9e99-4b19-b5a0-12c10fec9454 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:30.955697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c79d9ccd-9e99-4b19-b5a0-12c10fec9454 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:30.965206 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c79d9ccd-9e99-4b19-b5a0-12c10fec9454 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1318 microversion: 2.1 time: 0.326888 Sep 10 20:58:30.971345 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1417/2753] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:30 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:30.998240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b5d5e126-c129-4de1-915c-89e0e73ee5c8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f993ffb38b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:31.112930 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b5d5e126-c129-4de1-915c-89e0e73ee5c8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.129448 Sep 10 20:58:31.113171 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1418/2754] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:30 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:31.136219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7215a777-d218-491c-9ba2-490e2387c86f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:31.137051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7215a777-d218-491c-9ba2-490e2387c86f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:31.143335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215a777-d218-491c-9ba2-490e2387c86f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:31.144047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215a777-d218-491c-9ba2-490e2387c86f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:31.144816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215a777-d218-491c-9ba2-490e2387c86f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:31.145686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215a777-d218-491c-9ba2-490e2387c86f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:31.147277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215a777-d218-491c-9ba2-490e2387c86f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:31.148027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215a777-d218-491c-9ba2-490e2387c86f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:31.304932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9f680c5c-89ce-48fa-985d-8942e8e34d38 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:31.314818 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9f680c5c-89ce-48fa-985d-8942e8e34d38 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44" status: 200 len: 1468 microversion: 2.1 time: 1.083615 Sep 10 20:58:31.318699 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1337/2755] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:30 2022] GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44 => generated 1468 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:31.326018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-24db4236-b7f7-4fe7-99ef-2eec154f23a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:31.326776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-24db4236-b7f7-4fe7-99ef-2eec154f23a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:31.340269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24db4236-b7f7-4fe7-99ef-2eec154f23a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:31.346238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24db4236-b7f7-4fe7-99ef-2eec154f23a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:31.349332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24db4236-b7f7-4fe7-99ef-2eec154f23a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:31.350512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24db4236-b7f7-4fe7-99ef-2eec154f23a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:31.352679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24db4236-b7f7-4fe7-99ef-2eec154f23a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:31.353510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24db4236-b7f7-4fe7-99ef-2eec154f23a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:31.714192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-24db4236-b7f7-4fe7-99ef-2eec154f23a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:31.723241 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-24db4236-b7f7-4fe7-99ef-2eec154f23a8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1506 microversion: 2.1 time: 0.401124 Sep 10 20:58:31.727471 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1338/2756] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:31 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:31.732830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:31.745355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:31.751433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Searching by: {'reservation_id': 'r-99xgomzf', 'deleted': False, 'project_id': 'd30ef9b7525e4784be26268f46121e62'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:58:31.758075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:31.758834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:31.759511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:31.760476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:31.761158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:31.762298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:31.907382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7215a777-d218-491c-9ba2-490e2387c86f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:31.919629 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7215a777-d218-491c-9ba2-490e2387c86f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.800986 Sep 10 20:58:31.924626 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1419/2757] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:31 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:31.998990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86284112-353c-4bce-a02a-a5b596d47390 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:31.999884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-86284112-353c-4bce-a02a-a5b596d47390 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:32.012077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86284112-353c-4bce-a02a-a5b596d47390 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:32.012778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86284112-353c-4bce-a02a-a5b596d47390 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:32.014346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86284112-353c-4bce-a02a-a5b596d47390 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:32.020391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86284112-353c-4bce-a02a-a5b596d47390 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:32.022143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86284112-353c-4bce-a02a-a5b596d47390 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:32.022939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86284112-353c-4bce-a02a-a5b596d47390 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:32.050164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:58:32.165581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:32.176357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:32.181543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:32.182080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:32.460936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-86284112-353c-4bce-a02a-a5b596d47390 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:32.464622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:32.477601 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-86284112-353c-4bce-a02a-a5b596d47390 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1318 microversion: 2.1 time: 0.482556 Sep 10 20:58:32.478269 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1420/2758] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:31 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:32.505771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f349179-c001-45de-9099-085e46377dc7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f993ff63b80>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:32.613165 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f349179-c001-45de-9099-085e46377dc7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.123887 Sep 10 20:58:32.616063 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1421/2759] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:32 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:32.791011 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-360957d0-cc50-4b40-bdc9-c1909a8f4332 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-99xgomzf" status: 200 len: 2930 microversion: 2.1 time: 1.062250 Sep 10 20:58:32.792513 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1339/2760] 10.222.0.33 () {58 vars in 1197 bytes} [Sat Sep 10 20:58:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-99xgomzf => generated 2930 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:32.797514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2dd4fa91-3c0f-4249-9482-89921aff541f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:32.798422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2dd4fa91-3c0f-4249-9482-89921aff541f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:32.808279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dd4fa91-3c0f-4249-9482-89921aff541f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:32.811353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dd4fa91-3c0f-4249-9482-89921aff541f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:32.812052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dd4fa91-3c0f-4249-9482-89921aff541f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:32.813772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dd4fa91-3c0f-4249-9482-89921aff541f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:32.814771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dd4fa91-3c0f-4249-9482-89921aff541f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:32.815407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dd4fa91-3c0f-4249-9482-89921aff541f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:32.889020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-37413619-aacf-4ec4-8a6d-efaffb32376f req-0500ae7f-aa0c-4bb8-bb9a-9242cb205bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f348be-b60c-442d-9352-4030c286cb0d", "tag": "f3219068-e534-4daa-bfa3-338154c8be13"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:32.911731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-37413619-aacf-4ec4-8a6d-efaffb32376f req-0500ae7f-aa0c-4bb8-bb9a-9242cb205bd4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:32.913073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-37413619-aacf-4ec4-8a6d-efaffb32376f req-0500ae7f-aa0c-4bb8-bb9a-9242cb205bd4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:32.913605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-37413619-aacf-4ec4-8a6d-efaffb32376f req-0500ae7f-aa0c-4bb8-bb9a-9242cb205bd4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:32.941433 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-37413619-aacf-4ec4-8a6d-efaffb32376f req-0500ae7f-aa0c-4bb8-bb9a-9242cb205bd4 service nova] Creating event network-changed:f3219068-e534-4daa-bfa3-338154c8be13 for instance 81f348be-b60c-442d-9352-4030c286cb0d on nch1-master-1 Sep 10 20:58:32.953961 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-37413619-aacf-4ec4-8a6d-efaffb32376f req-0500ae7f-aa0c-4bb8-bb9a-9242cb205bd4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336468 Sep 10 20:58:32.954866 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1422/2761] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:32.964142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0466609d-7048-48ad-b6c2-431eb2ebe009 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:33.004121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.compute.server_groups [None req-0466609d-7048-48ad-b6c2-431eb2ebe009 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Querying cell 2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) for 2 instances {{(pid=145772) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 20:58:33.005251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0466609d-7048-48ad-b6c2-431eb2ebe009 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.006659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0466609d-7048-48ad-b6c2-431eb2ebe009 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.007364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0466609d-7048-48ad-b6c2-431eb2ebe009 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.066564 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0466609d-7048-48ad-b6c2-431eb2ebe009 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/232b9ea3-3351-4a5d-87e3-b7519b40cd27" status: 200 len: 264 microversion: 2.1 time: 0.110267 Sep 10 20:58:33.074155 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1423/2762] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:58:32 2022] GET /compute/v2.1/os-server-groups/232b9ea3-3351-4a5d-87e3-b7519b40cd27 => generated 264 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:33.098759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ee90af2b-1ba0-4770-afb1-40873f306456 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:33.106871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ee90af2b-1ba0-4770-afb1-40873f306456 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:33.142028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee90af2b-1ba0-4770-afb1-40873f306456 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.145963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee90af2b-1ba0-4770-afb1-40873f306456 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.151244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee90af2b-1ba0-4770-afb1-40873f306456 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.152481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee90af2b-1ba0-4770-afb1-40873f306456 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.156754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee90af2b-1ba0-4770-afb1-40873f306456 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.165757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee90af2b-1ba0-4770-afb1-40873f306456 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.175725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2dd4fa91-3c0f-4249-9482-89921aff541f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:33.184750 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2dd4fa91-3c0f-4249-9482-89921aff541f tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1488 microversion: 2.1 time: 0.390951 Sep 10 20:58:33.207502 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1340/2763] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:32 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1488 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:33.213221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85373b96-6eab-45b8-990d-89bf5b652872 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:33.213856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-85373b96-6eab-45b8-990d-89bf5b652872 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:33.238673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85373b96-6eab-45b8-990d-89bf5b652872 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.239209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85373b96-6eab-45b8-990d-89bf5b652872 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.242380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85373b96-6eab-45b8-990d-89bf5b652872 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.244724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85373b96-6eab-45b8-990d-89bf5b652872 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.246962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85373b96-6eab-45b8-990d-89bf5b652872 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.247551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85373b96-6eab-45b8-990d-89bf5b652872 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.435715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ee90af2b-1ba0-4770-afb1-40873f306456 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:33.444747 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ee90af2b-1ba0-4770-afb1-40873f306456 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.365474 Sep 10 20:58:33.447117 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1424/2764] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:33 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:33.454589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b65b0890-dc7f-47e2-aab4-9b9d449de3df req-cfaee680-03ee-4f15-b51d-e96279d8b322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1f769d-7314-4652-8dff-f06c1b403046", "name": "network-vif-plugged", "status": "completed", "tag": "7553bf76-9c9b-498a-870a-5ca0699d24c1"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:33.479184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b65b0890-dc7f-47e2-aab4-9b9d449de3df req-cfaee680-03ee-4f15-b51d-e96279d8b322 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.481347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b65b0890-dc7f-47e2-aab4-9b9d449de3df req-cfaee680-03ee-4f15-b51d-e96279d8b322 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.484713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b65b0890-dc7f-47e2-aab4-9b9d449de3df req-cfaee680-03ee-4f15-b51d-e96279d8b322 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.511220 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b65b0890-dc7f-47e2-aab4-9b9d449de3df req-cfaee680-03ee-4f15-b51d-e96279d8b322 service nova] Creating event network-vif-plugged:7553bf76-9c9b-498a-870a-5ca0699d24c1 for instance 5f1f769d-7314-4652-8dff-f06c1b403046 on nch1-master-1 Sep 10 20:58:33.521755 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b65b0890-dc7f-47e2-aab4-9b9d449de3df req-cfaee680-03ee-4f15-b51d-e96279d8b322 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070016 Sep 10 20:58:33.528829 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1425/2765] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:33.535684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5a9d1e3-8ebe-4f57-aa92-b3f1401acfbc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:33.538687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e5a9d1e3-8ebe-4f57-aa92-b3f1401acfbc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:33.551326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a9d1e3-8ebe-4f57-aa92-b3f1401acfbc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.555073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a9d1e3-8ebe-4f57-aa92-b3f1401acfbc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.555795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a9d1e3-8ebe-4f57-aa92-b3f1401acfbc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.556749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a9d1e3-8ebe-4f57-aa92-b3f1401acfbc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.557403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a9d1e3-8ebe-4f57-aa92-b3f1401acfbc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.560159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5a9d1e3-8ebe-4f57-aa92-b3f1401acfbc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.596632 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-85373b96-6eab-45b8-990d-89bf5b652872 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1620 microversion: 2.1 time: 0.387984 Sep 10 20:58:33.598182 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1341/2766] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:33 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1620 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:33.607313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3306ce71-9314-498a-b3f2-54990e102a0a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:33.612134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3306ce71-9314-498a-b3f2-54990e102a0a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:33.625215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3306ce71-9314-498a-b3f2-54990e102a0a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.625983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3306ce71-9314-498a-b3f2-54990e102a0a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.626672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3306ce71-9314-498a-b3f2-54990e102a0a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.627622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3306ce71-9314-498a-b3f2-54990e102a0a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.627856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e5a9d1e3-8ebe-4f57-aa92-b3f1401acfbc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:58:33.628510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3306ce71-9314-498a-b3f2-54990e102a0a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.629105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3306ce71-9314-498a-b3f2-54990e102a0a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.790494 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5a9d1e3-8ebe-4f57-aa92-b3f1401acfbc tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 204 len: 0 microversion: 2.1 time: 0.259879 Sep 10 20:58:33.794639 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1426/2767] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:33 2022] DELETE /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:33.806696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-50735613-da6a-4e84-b2ec-ad9752262671 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:33.807429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-50735613-da6a-4e84-b2ec-ad9752262671 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] [instance: 4f5284d9-8123-4e15-8576-be144c016b44] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:33.825624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50735613-da6a-4e84-b2ec-ad9752262671 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.826165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50735613-da6a-4e84-b2ec-ad9752262671 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.826624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50735613-da6a-4e84-b2ec-ad9752262671 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.827358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50735613-da6a-4e84-b2ec-ad9752262671 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:33.827823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50735613-da6a-4e84-b2ec-ad9752262671 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:33.828261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50735613-da6a-4e84-b2ec-ad9752262671 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:33.887858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3306ce71-9314-498a-b3f2-54990e102a0a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:33.923211 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3306ce71-9314-498a-b3f2-54990e102a0a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1318 microversion: 2.1 time: 0.322417 Sep 10 20:58:33.924654 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1342/2768] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:33 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:33.936011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-81a3d281-0e22-421b-b7eb-fd06e1d91bec tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944e4c4c0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:34.009934 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-81a3d281-0e22-421b-b7eb-fd06e1d91bec tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1429 microversion: 2.1 time: 0.084987 Sep 10 20:58:34.019080 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1343/2769] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:33 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:34.022569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:34.038688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-467bad31-c854-422f-abe5-2673eb1f7313 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9949689280>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:34.084005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=14 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:34.088348 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-467bad31-c854-422f-abe5-2673eb1f7313 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Image not found. Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-467bad31-c854-422f-abe5-2673eb1f7313 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a HTTP/1.1 Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'c7d21c6c-865d-4c31-a8e8-f081a43da29a'} Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c7d21c6c-865d-4c31-a8e8-f081a43da29a to delete Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c7d21c6c-865d-4c31-a8e8-f081a43da29a could not be found. Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:34.095610 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-467bad31-c854-422f-abe5-2673eb1f7313 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-467bad31-c854-422f-abe5-2673eb1f7313 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a" status: 404 len: 62 microversion: 2.1 time: 0.084543 Sep 10 20:58:34.101904 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1344/2770] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:34 2022] DELETE /compute/v2.1/images/c7d21c6c-865d-4c31-a8e8-f081a43da29a => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:58:34.108157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:34.108668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:34.133725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:34.134189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:34.134641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:34.135365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:34.135841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:34.136273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:34.178228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:58:34.181802 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-50735613-da6a-4e84-b2ec-ad9752262671 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44" status: 200 len: 1619 microversion: 2.1 time: 0.385701 Sep 10 20:58:34.202618 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1427/2771] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:33 2022] GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44 => generated 1619 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:34.233204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-97358422-a3ed-486c-867d-0aba906462e4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Action: 'create', calling method: .version_select at 0x7f993ff28790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1932290286", "policies": ["anti-affinity"]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:34.245455 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.compute.api [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Instance is already in deleting state, ignoring this request Sep 10 20:58:34.246397 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aac92c8c-76c0-4b51-ab9b-17b4a058cd4e tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 204 len: 0 microversion: 2.1 time: 0.143071 Sep 10 20:58:34.253590 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1345/2772] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:34 2022] DELETE /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:34.262407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0048a633-ddff-4fca-8b95-0a79de761faa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:34.263151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0048a633-ddff-4fca-8b95-0a79de761faa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:34.279200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0048a633-ddff-4fca-8b95-0a79de761faa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:34.280097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0048a633-ddff-4fca-8b95-0a79de761faa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:34.283816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0048a633-ddff-4fca-8b95-0a79de761faa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:34.284388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0048a633-ddff-4fca-8b95-0a79de761faa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:34.288106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0048a633-ddff-4fca-8b95-0a79de761faa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:34.288106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0048a633-ddff-4fca-8b95-0a79de761faa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:34.292055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-97358422-a3ed-486c-867d-0aba906462e4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:34.304459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-97358422-a3ed-486c-867d-0aba906462e4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:34.313114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:34.435859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-97358422-a3ed-486c-867d-0aba906462e4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:34.447208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-97358422-a3ed-486c-867d-0aba906462e4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:34.495326 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-97358422-a3ed-486c-867d-0aba906462e4 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.266040 Sep 10 20:58:34.514400 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1428/2773] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Sep 10 20:58:34 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:58:34.525295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c5cebe21-9521-4d27-aa13-b92e3a1c58f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:34.529906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c5cebe21-9521-4d27-aa13-b92e3a1c58f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:34.544280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5cebe21-9521-4d27-aa13-b92e3a1c58f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:34.549060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5cebe21-9521-4d27-aa13-b92e3a1c58f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:34.549663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5cebe21-9521-4d27-aa13-b92e3a1c58f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:34.550534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5cebe21-9521-4d27-aa13-b92e3a1c58f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:34.554455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5cebe21-9521-4d27-aa13-b92e3a1c58f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:34.560084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5cebe21-9521-4d27-aa13-b92e3a1c58f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:34.811451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c5cebe21-9521-4d27-aa13-b92e3a1c58f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:34.820469 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c5cebe21-9521-4d27-aa13-b92e3a1c58f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.304808 Sep 10 20:58:34.821409 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1429/2774] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:34 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:34.826388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1435188097", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "242ea9e9-4cd4-4f66-85d6-2ff28dd2d775"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:34.936664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:58:35.094515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0048a633-ddff-4fca-8b95-0a79de761faa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:35.100901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:35.110875 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0048a633-ddff-4fca-8b95-0a79de761faa tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1494 microversion: 2.1 time: 0.852601 Sep 10 20:58:35.111839 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1346/2775] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:34 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1494 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:35.124138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c655e227-2ea6-400d-92eb-43cb2e7fd10b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:35.125259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c655e227-2ea6-400d-92eb-43cb2e7fd10b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:35.135939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c655e227-2ea6-400d-92eb-43cb2e7fd10b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:35.136453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c655e227-2ea6-400d-92eb-43cb2e7fd10b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:35.136982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c655e227-2ea6-400d-92eb-43cb2e7fd10b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:35.137704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c655e227-2ea6-400d-92eb-43cb2e7fd10b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:35.138191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c655e227-2ea6-400d-92eb-43cb2e7fd10b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:35.138623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c655e227-2ea6-400d-92eb-43cb2e7fd10b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:35.365353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:58:35.366111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:58:35.366643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:58:35.367017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:58:35.367436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:58:35.393283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:35.394096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:35.394698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:35.395622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:35.396317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:35.397120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:35.442167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:35.455154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:35.482121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Going to run 2 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:58:35.487384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:58:35.492347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c655e227-2ea6-400d-92eb-43cb2e7fd10b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:35.502790 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c655e227-2ea6-400d-92eb-43cb2e7fd10b tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1318 microversion: 2.1 time: 0.387668 Sep 10 20:58:35.506615 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1347/2776] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:35 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:35.529169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-56fddb6a-d7b8-4511-862b-86351e13e3dd tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99495fc9d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:35.592147 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-56fddb6a-d7b8-4511-862b-86351e13e3dd tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1438 microversion: 2.1 time: 0.066979 Sep 10 20:58:35.594373 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1348/2777] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:35 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:35.596117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:35.607226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:35.608236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a825e036-1434-4625-a40e-ddfd08686c9d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9949687a60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:35.663929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:35.674393 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a825e036-1434-4625-a40e-ddfd08686c9d tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 200 len: 1438 microversion: 2.1 time: 0.070077 Sep 10 20:58:35.675399 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1349/2778] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:35 2022] GET /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 1438 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:35.679498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:35.698347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=5295c29d-1e1a-4858-81b2-80ff782a328f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:58:35.701284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-90fe44d1-b6a5-46ac-baf3-0a95b8719db5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:35.703143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-90fe44d1-b6a5-46ac-baf3-0a95b8719db5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:35.725134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90fe44d1-b6a5-46ac-baf3-0a95b8719db5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:35.730727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90fe44d1-b6a5-46ac-baf3-0a95b8719db5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:35.732060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90fe44d1-b6a5-46ac-baf3-0a95b8719db5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:35.734094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90fe44d1-b6a5-46ac-baf3-0a95b8719db5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:35.736016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90fe44d1-b6a5-46ac-baf3-0a95b8719db5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:35.736635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90fe44d1-b6a5-46ac-baf3-0a95b8719db5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:35.762400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:35.768260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:35.811503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:35.819023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'server_group_members'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:35.865213 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-de2b6253-5d70-4869-aafb-befea5e526d0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.042298 Sep 10 20:58:35.870183 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1430/2779] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:34 2022] POST /compute/v2.1/servers => generated 32 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 10 20:58:35.874789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-48aef254-850b-44fc-9db8-fdafc2a9a24f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:35.875750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-48aef254-850b-44fc-9db8-fdafc2a9a24f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:35.885678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aef254-850b-44fc-9db8-fdafc2a9a24f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:35.886934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aef254-850b-44fc-9db8-fdafc2a9a24f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:35.888972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aef254-850b-44fc-9db8-fdafc2a9a24f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:35.891507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aef254-850b-44fc-9db8-fdafc2a9a24f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:35.894867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aef254-850b-44fc-9db8-fdafc2a9a24f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:35.897971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aef254-850b-44fc-9db8-fdafc2a9a24f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:36.045059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-90fe44d1-b6a5-46ac-baf3-0a95b8719db5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:36.054395 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-90fe44d1-b6a5-46ac-baf3-0a95b8719db5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1480 microversion: 2.1 time: 0.366686 Sep 10 20:58:36.055384 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1350/2780] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:35 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1480 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:36.060717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:36.066251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:36.067514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Searching by: {'deleted': False, 'project_id': 'd30ef9b7525e4784be26268f46121e62'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:58:36.073809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:36.080026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-48aef254-850b-44fc-9db8-fdafc2a9a24f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:36.086847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:36.087343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:36.087954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:36.088861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:36.089725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:36.090072 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-48aef254-850b-44fc-9db8-fdafc2a9a24f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.218796 Sep 10 20:58:36.090871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:36.091655 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1431/2781] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:35 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:36.147118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:58:36.167242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f7e4950-17c3-4da4-87b7-cb2794d9ef07 tempest-FloatingIPDetailsNegativeTestJSON-1276022088 tempest-FloatingIPDetailsNegativeTestJSON-1276022088-project] Calling method '.version_select at 0x7f993ff0e280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:36.190313 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0758898b-b46f-4642-8549-847e7eac3e72 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.133549 Sep 10 20:58:36.191308 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1351/2782] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 20:58:36 2022] GET /compute/v2.1/servers => generated 1666 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:36.197955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-57345b00-a735-45f0-80b9-9b6ffd85db25 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:36.198938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-57345b00-a735-45f0-80b9-9b6ffd85db25 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:36.205576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57345b00-a735-45f0-80b9-9b6ffd85db25 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:36.206359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57345b00-a735-45f0-80b9-9b6ffd85db25 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:36.207115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57345b00-a735-45f0-80b9-9b6ffd85db25 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:36.208016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57345b00-a735-45f0-80b9-9b6ffd85db25 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:36.209051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57345b00-a735-45f0-80b9-9b6ffd85db25 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:36.209688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57345b00-a735-45f0-80b9-9b6ffd85db25 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:36.248434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-2f7e4950-17c3-4da4-87b7-cb2794d9ef07 tempest-FloatingIPDetailsNegativeTestJSON-1276022088 tempest-FloatingIPDetailsNegativeTestJSON-1276022088-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e0280dcb-63bf-44a8-b33f-3d0f767e5af5 could not be found", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:58:36.249126 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-2f7e4950-17c3-4da4-87b7-cb2794d9ef07 tempest-FloatingIPDetailsNegativeTestJSON-1276022088 tempest-FloatingIPDetailsNegativeTestJSON-1276022088-project] HTTP exception thrown: Floating IP not found for ID e0280dcb-63bf-44a8-b33f-3d0f767e5af5 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f7e4950-17c3-4da4-87b7-cb2794d9ef07 tempest-FloatingIPDetailsNegativeTestJSON-1276022088 tempest-FloatingIPDetailsNegativeTestJSON-1276022088-project] Request method failure captured: Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-floating-ips/e0280dcb-63bf-44a8-b33f-3d0f767e5af5 HTTP/1.1 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPp7m-3viHOrGa-b3EWGyhLMlKo9pIaJmm3LSxErLbuQtx4OsW26eu5tunJv6Zq_RAzgr0NMcC4kE9cA4cLng0nbkJYMmCdk5e5FUVmLuB5tsycwMut6OK67cO0hoeZS44qAC9UHPggI0IioqvAOPN1Ci57on4X34_bn45x-cNd9ayo Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cd4fdf2f6f994535805d6f8110234477 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1276022088 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd4fdf2f6f994535805d6f8110234477"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd4fdf2f6f994535805d6f8110234477"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cd4fdf2f6f994535805d6f8110234477", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cd4fdf2f6f994535805d6f8110234477"}]}] Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1276022088 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cd4fdf2f6f994535805d6f8110234477 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1276022088 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1276022088-project Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 3b5b2397579544ab98e4e871a52cf114 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1276022088-project Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: exception: Floating IP not found for ID e0280dcb-63bf-44a8-b33f-3d0f767e5af5 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e0280dcb-63bf-44a8-b33f-3d0f767e5af5'} Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:58:36.252564 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e0280dcb-63bf-44a8-b33f-3d0f767e5af5 could not be found Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6806e773-82fd-4467-9e53-206305d36d82'] Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e0280dcb-63bf-44a8-b33f-3d0f767e5af5. Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e0280dcb-63bf-44a8-b33f-3d0f767e5af5 Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e0280dcb-63bf-44a8-b33f-3d0f767e5af5 Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f7e4950-17c3-4da4-87b7-cb2794d9ef07 tempest-FloatingIPDetailsNegativeTestJSON-1276022088 tempest-FloatingIPDetailsNegativeTestJSON-1276022088-project] Returning 404 to user: Floating IP not found for ID e0280dcb-63bf-44a8-b33f-3d0f767e5af5 {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:36.256514 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f7e4950-17c3-4da4-87b7-cb2794d9ef07 tempest-FloatingIPDetailsNegativeTestJSON-1276022088 tempest-FloatingIPDetailsNegativeTestJSON-1276022088-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/e0280dcb-63bf-44a8-b33f-3d0f767e5af5" status: 404 len: 111 microversion: 2.1 time: 0.161521 Sep 10 20:58:36.261149 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1432/2783] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:58:36 2022] GET /compute/v2.1/os-floating-ips/e0280dcb-63bf-44a8-b33f-3d0f767e5af5 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:36.266148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5cc20dce-9140-43a9-8aa4-b59252e3a12a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:36.269273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5cc20dce-9140-43a9-8aa4-b59252e3a12a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:36.430052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5cc20dce-9140-43a9-8aa4-b59252e3a12a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:36.446519 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5cc20dce-9140-43a9-8aa4-b59252e3a12a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1219 microversion: 2.1 time: 0.188096 Sep 10 20:58:36.477919 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1433/2784] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:36 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1219 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:36.533769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c50fd89c-537a-4102-82cd-c683bd72b92a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:36.534751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c50fd89c-537a-4102-82cd-c683bd72b92a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:36.548178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c50fd89c-537a-4102-82cd-c683bd72b92a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:36.548862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c50fd89c-537a-4102-82cd-c683bd72b92a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:36.549532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c50fd89c-537a-4102-82cd-c683bd72b92a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:36.550569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c50fd89c-537a-4102-82cd-c683bd72b92a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:36.553989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c50fd89c-537a-4102-82cd-c683bd72b92a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:36.554771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c50fd89c-537a-4102-82cd-c683bd72b92a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:36.651302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-57345b00-a735-45f0-80b9-9b6ffd85db25 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687eef270165450a97b4d260b2724b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7f9f3112545e9b40d88a7cc48e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:36.660447 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-57345b00-a735-45f0-80b9-9b6ffd85db25 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 200 len: 1494 microversion: 2.1 time: 0.467926 Sep 10 20:58:36.682152 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1352/2785] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:36 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 1494 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:36.695244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b62b101d-181d-4f71-8ae4-5f2c79d91f76 req-f95db417-1aaf-4dc3-8690-f9a45f7d176e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30a9756-704a-4774-b74c-c0085e7528ca", "name": "network-vif-deleted", "tag": "7b663272-fba8-4770-a6df-21af15d41f96"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:36.718932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b62b101d-181d-4f71-8ae4-5f2c79d91f76 req-f95db417-1aaf-4dc3-8690-f9a45f7d176e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:36.719506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b62b101d-181d-4f71-8ae4-5f2c79d91f76 req-f95db417-1aaf-4dc3-8690-f9a45f7d176e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:36.720037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b62b101d-181d-4f71-8ae4-5f2c79d91f76 req-f95db417-1aaf-4dc3-8690-f9a45f7d176e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:36.742560 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b62b101d-181d-4f71-8ae4-5f2c79d91f76 req-f95db417-1aaf-4dc3-8690-f9a45f7d176e service nova] Creating event network-vif-deleted:7b663272-fba8-4770-a6df-21af15d41f96 for instance a30a9756-704a-4774-b74c-c0085e7528ca on nch2-master-1 Sep 10 20:58:36.753618 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b62b101d-181d-4f71-8ae4-5f2c79d91f76 req-f95db417-1aaf-4dc3-8690-f9a45f7d176e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069811 Sep 10 20:58:36.754541 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1353/2786] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:36.907444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c50fd89c-537a-4102-82cd-c683bd72b92a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:36.919375 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c50fd89c-537a-4102-82cd-c683bd72b92a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1318 microversion: 2.1 time: 0.389411 Sep 10 20:58:36.919958 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1434/2787] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:36 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:37.082169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4136b3c9-ba27-448e-ae8d-2bba76b34cf7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:37.083051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4136b3c9-ba27-448e-ae8d-2bba76b34cf7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:37.093549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4136b3c9-ba27-448e-ae8d-2bba76b34cf7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:37.094452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4136b3c9-ba27-448e-ae8d-2bba76b34cf7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:37.095104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4136b3c9-ba27-448e-ae8d-2bba76b34cf7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:37.096022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4136b3c9-ba27-448e-ae8d-2bba76b34cf7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:37.096689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4136b3c9-ba27-448e-ae8d-2bba76b34cf7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:37.097381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4136b3c9-ba27-448e-ae8d-2bba76b34cf7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:37.119757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7820d743-ffd3-4065-8154-60d06e53f25d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:37.120387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7820d743-ffd3-4065-8154-60d06e53f25d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:37.125016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:37.137250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7820d743-ffd3-4065-8154-60d06e53f25d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:37.138187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7820d743-ffd3-4065-8154-60d06e53f25d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:37.138887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7820d743-ffd3-4065-8154-60d06e53f25d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:37.139616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7820d743-ffd3-4065-8154-60d06e53f25d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:37.140093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7820d743-ffd3-4065-8154-60d06e53f25d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:37.141097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7820d743-ffd3-4065-8154-60d06e53f25d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:37.302012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4136b3c9-ba27-448e-ae8d-2bba76b34cf7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:37.311400 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4136b3c9-ba27-448e-ae8d-2bba76b34cf7 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1467 microversion: 2.1 time: 0.236252 Sep 10 20:58:37.311981 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1354/2788] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:37 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1467 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:37.336644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-78404a02-57d3-4009-aa00-3bf1094f3fbe tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f99444873a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:37.385532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7820d743-ffd3-4065-8154-60d06e53f25d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:37.395634 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7820d743-ffd3-4065-8154-60d06e53f25d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1314 microversion: 2.1 time: 0.283367 Sep 10 20:58:37.414767 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1435/2789] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:37 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:37.490527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-75d79feb-0839-4f22-a268-be94b44b97bb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:37.491161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-75d79feb-0839-4f22-a268-be94b44b97bb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:37.503430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75d79feb-0839-4f22-a268-be94b44b97bb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:37.506816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75d79feb-0839-4f22-a268-be94b44b97bb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:37.507897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75d79feb-0839-4f22-a268-be94b44b97bb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:37.509589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75d79feb-0839-4f22-a268-be94b44b97bb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:37.511152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75d79feb-0839-4f22-a268-be94b44b97bb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:37.513276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75d79feb-0839-4f22-a268-be94b44b97bb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:37.851177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-75d79feb-0839-4f22-a268-be94b44b97bb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:37.861979 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-75d79feb-0839-4f22-a268-be94b44b97bb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1271 microversion: 2.1 time: 0.375947 Sep 10 20:58:37.862776 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1436/2790] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:37 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1271 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:37.868061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:37.868895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: a30a9756-704a-4774-b74c-c0085e7528ca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:37.902494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:37.902986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:37.903431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:37.904145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:37.911031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:37.911679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:37.949783 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Instance a30a9756-704a-4774-b74c-c0085e7528ca could not be found. Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca HTTP/1.1 Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance a30a9756-704a-4774-b74c-c0085e7528ca could not be found. Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a30a9756-704a-4774-b74c-c0085e7528ca'} Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30a9756-704a-4774-b74c-c0085e7528ca could not be found. Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30a9756-704a-4774-b74c-c0085e7528ca could not be found. Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:37.951629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:37.956225 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:37.956225 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:37.956225 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:37.956225 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:37.956225 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30a9756-704a-4774-b74c-c0085e7528ca could not be found. Sep 10 20:58:37.956225 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:37.957504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Instance a30a9756-704a-4774-b74c-c0085e7528ca could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:37.959156 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-285eda9d-5e76-4078-84e9-c80e89c01a17 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca" status: 404 len: 111 microversion: 2.1 time: 0.094696 Sep 10 20:58:37.964559 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1437/2791] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:37 2022] GET /compute/v2.1/servers/a30a9756-704a-4774-b74c-c0085e7528ca => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:37.971876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8016229a-74db-4459-a7f3-56887b12940f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:37.973215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8016229a-74db-4459-a7f3-56887b12940f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:37.983086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8016229a-74db-4459-a7f3-56887b12940f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:37.983881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8016229a-74db-4459-a7f3-56887b12940f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:37.984813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8016229a-74db-4459-a7f3-56887b12940f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:37.985928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8016229a-74db-4459-a7f3-56887b12940f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:37.986775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8016229a-74db-4459-a7f3-56887b12940f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:37.987397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8016229a-74db-4459-a7f3-56887b12940f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.287749 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-78404a02-57d3-4009-aa00-3bf1094f3fbe tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "DELETE /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c" status: 204 len: 0 microversion: 2.1 time: 0.954846 Sep 10 20:58:38.289128 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1355/2792] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:37 2022] DELETE /compute/v2.1/images/f4ee3b17-2b9e-4e84-b8ed-9a747826853c => generated 0 bytes in 957 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 20:58:38.295101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-08fc9661-b5ae-4528-a248-11c1397e2476 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f9944d35a60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:38.330646 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-08fc9661-b5ae-4528-a248-11c1397e2476 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Image not found. Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-08fc9661-b5ae-4528-a248-11c1397e2476 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f HTTP/1.1 Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'a9f323a0-5f8c-46d2-a67c-9d862ded7f8f'} Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a9f323a0-5f8c-46d2-a67c-9d862ded7f8f to delete Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9f323a0-5f8c-46d2-a67c-9d862ded7f8f could not be found. Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.332552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-08fc9661-b5ae-4528-a248-11c1397e2476 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-08fc9661-b5ae-4528-a248-11c1397e2476 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f" status: 404 len: 62 microversion: 2.1 time: 0.044353 Sep 10 20:58:38.338478 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1356/2793] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:38 2022] DELETE /compute/v2.1/images/a9f323a0-5f8c-46d2-a67c-9d862ded7f8f => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:58:38.353340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b060b042-efbd-4cda-9d6c-8c0f0f328ee9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '.version_select at 0x7f9944e0f4c0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:38.388406 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-b060b042-efbd-4cda-9d6c-8c0f0f328ee9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] HTTP exception thrown: Image not found. Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b060b042-efbd-4cda-9d6c-8c0f0f328ee9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Request method failure captured: Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a HTTP/1.1 Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoaVDQ-b_fnkbnF7M2jkEwVfDjJN_Vn5x7oW3jJI-nVWL2pT82So-Px_Dvw8CAiaBIi7499tWWWYA0nX2gGrY__KCYJwnHBu8jnCpNdnSWXCmcEWV90OT7V9CZDsYXBUFYA0ZpT5YeFeyASDrJ1RSsCzKVxWA--0yuh3AfIgDFuyp4 Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f57a1c44d4684b2fa210973f062adbce Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesOneServerTestJSON-1495268422 Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f57a1c44d4684b2fa210973f062adbce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f57a1c44d4684b2fa210973f062adbce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f57a1c44d4684b2fa210973f062adbce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f57a1c44d4684b2fa210973f062adbce"}]}] Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesOneServerTestJSON-1495268422 Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f57a1c44d4684b2fa210973f062adbce Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1495268422 Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesOneServerTestJSON-1495268422-project Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: bec33de4067d4b1bb6e4ad866ddf2d01 Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesOneServerTestJSON-1495268422-project Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7e8414ee-3c00-47fc-8929-8994dd26c47a'} Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7e8414ee-3c00-47fc-8929-8994dd26c47a to delete Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7e8414ee-3c00-47fc-8929-8994dd26c47a could not be found. Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.390266 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b060b042-efbd-4cda-9d6c-8c0f0f328ee9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b060b042-efbd-4cda-9d6c-8c0f0f328ee9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "DELETE /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a" status: 404 len: 62 microversion: 2.1 time: 0.052052 Sep 10 20:58:38.395507 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1357/2794] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:38 2022] DELETE /compute/v2.1/images/7e8414ee-3c00-47fc-8929-8994dd26c47a => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:58:38.397865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:38.397865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:38.404222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.404885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.405141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.405869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.406540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.407160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.425568 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb HTTP/1.1 Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'f35f1515-600f-4bea-850a-28ce09db77fb'} Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:38.427763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. Sep 10 20:58:38.431533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.431533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.431533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.431533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.431533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:38.431533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:38.431533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:38.431533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:38.431533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. Sep 10 20:58:38.431533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.433384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:38.434374 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5450b86c-9d42-445a-abc6-34c0d4f9e4f8 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 404 len: 111 microversion: 2.1 time: 0.041155 Sep 10 20:58:38.434952 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1358/2795] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:38 2022] DELETE /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:38.440112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9c151bf2-b41b-4f5c-8bb3-1b92647d06d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:38.440887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9c151bf2-b41b-4f5c-8bb3-1b92647d06d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:38.447807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c151bf2-b41b-4f5c-8bb3-1b92647d06d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.448393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c151bf2-b41b-4f5c-8bb3-1b92647d06d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.448909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c151bf2-b41b-4f5c-8bb3-1b92647d06d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.449721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c151bf2-b41b-4f5c-8bb3-1b92647d06d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.450280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c151bf2-b41b-4f5c-8bb3-1b92647d06d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.450783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c151bf2-b41b-4f5c-8bb3-1b92647d06d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.455313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8016229a-74db-4459-a7f3-56887b12940f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:38.466045 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8016229a-74db-4459-a7f3-56887b12940f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1318 microversion: 2.1 time: 0.499466 Sep 10 20:58:38.468176 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1438/2796] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:37 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:38.493100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-71e6e6e9-f30a-49ba-a4d9-fc3aaa242aaa tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:38.496637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-71e6e6e9-f30a-49ba-a4d9-fc3aaa242aaa tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:38.511634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71e6e6e9-f30a-49ba-a4d9-fc3aaa242aaa tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.514437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71e6e6e9-f30a-49ba-a4d9-fc3aaa242aaa tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.514714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9c151bf2-b41b-4f5c-8bb3-1b92647d06d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:58:38.518267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71e6e6e9-f30a-49ba-a4d9-fc3aaa242aaa tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.519327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71e6e6e9-f30a-49ba-a4d9-fc3aaa242aaa tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.519944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71e6e6e9-f30a-49ba-a4d9-fc3aaa242aaa tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.520713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71e6e6e9-f30a-49ba-a4d9-fc3aaa242aaa tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.638632 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9c151bf2-b41b-4f5c-8bb3-1b92647d06d5 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 204 len: 0 microversion: 2.1 time: 0.201019 Sep 10 20:58:38.641395 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1359/2797] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:38 2022] DELETE /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:38.650191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:38.651442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: f35f1515-600f-4bea-850a-28ce09db77fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:38.658306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.659071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.659661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.663188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.663795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.664523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.697076 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb HTTP/1.1 Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'f35f1515-600f-4bea-850a-28ce09db77fb'} Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.699292 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.703264 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:38.703264 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:38.703264 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:38.703264 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:38.703264 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. Sep 10 20:58:38.703264 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.703264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Instance f35f1515-600f-4bea-850a-28ce09db77fb could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:38.703264 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-802035c3-17c6-474e-85c9-43defc038e16 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb" status: 404 len: 111 microversion: 2.1 time: 0.057926 Sep 10 20:58:38.706230 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1360/2798] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:38 2022] GET /compute/v2.1/servers/f35f1515-600f-4bea-850a-28ce09db77fb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:38.714650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-067653f9-157c-487e-a311-3e1624344f9b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:38.716217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-067653f9-157c-487e-a311-3e1624344f9b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:38.727684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-067653f9-157c-487e-a311-3e1624344f9b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.728429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-067653f9-157c-487e-a311-3e1624344f9b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.728876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-067653f9-157c-487e-a311-3e1624344f9b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.729745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-067653f9-157c-487e-a311-3e1624344f9b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.730362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-067653f9-157c-487e-a311-3e1624344f9b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.730803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-067653f9-157c-487e-a311-3e1624344f9b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.819279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-71e6e6e9-f30a-49ba-a4d9-fc3aaa242aaa tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:38.829257 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-71e6e6e9-f30a-49ba-a4d9-fc3aaa242aaa tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1502 microversion: 2.1 time: 0.359529 Sep 10 20:58:38.830537 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1439/2799] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:38 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1502 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:38.836691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-618d136a-714a-49bd-bcf5-ec9a720e4c1c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f993ff283a0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:38.866145 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-618d136a-714a-49bd-bcf5-ec9a720e4c1c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Image not found. Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-618d136a-714a-49bd-bcf5-ec9a720e4c1c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 HTTP/1.1 Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: exception: Image not found. Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '61819294-9dd5-4566-b3ab-11f3f0b945c3'} Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 61819294-9dd5-4566-b3ab-11f3f0b945c3 to delete Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 61819294-9dd5-4566-b3ab-11f3f0b945c3 could not be found. Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.868890 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:58:38.872812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:38.876585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-618d136a-714a-49bd-bcf5-ec9a720e4c1c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Image not found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:38.877663 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-618d136a-714a-49bd-bcf5-ec9a720e4c1c tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3" status: 404 len: 62 microversion: 2.1 time: 0.045915 Sep 10 20:58:38.878673 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1440/2800] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:38 2022] DELETE /compute/v2.1/images/61819294-9dd5-4566-b3ab-11f3f0b945c3 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:58:38.884141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7dbfbcb4-e4fb-4de8-84c0-619a742d9a6a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:38.884998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7dbfbcb4-e4fb-4de8-84c0-619a742d9a6a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:38.893705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dbfbcb4-e4fb-4de8-84c0-619a742d9a6a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.896810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dbfbcb4-e4fb-4de8-84c0-619a742d9a6a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.897563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dbfbcb4-e4fb-4de8-84c0-619a742d9a6a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.898909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dbfbcb4-e4fb-4de8-84c0-619a742d9a6a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:38.899976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dbfbcb4-e4fb-4de8-84c0-619a742d9a6a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:38.900676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7dbfbcb4-e4fb-4de8-84c0-619a742d9a6a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:38.932209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7dbfbcb4-e4fb-4de8-84c0-619a742d9a6a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:58:39.017288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-067653f9-157c-487e-a311-3e1624344f9b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:39.030768 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-067653f9-157c-487e-a311-3e1624344f9b tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1473 microversion: 2.1 time: 0.321965 Sep 10 20:58:39.033691 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1361/2801] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:38 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1473 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:39.050487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:39.051289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:39.063079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.063849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.064290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.064997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.065448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.068496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.076375 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7dbfbcb4-e4fb-4de8-84c0-619a742d9a6a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 204 len: 0 microversion: 2.1 time: 0.195444 Sep 10 20:58:39.077244 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1441/2802] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:38 2022] DELETE /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:39.090077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0c2d8bc-9f59-4f23-8c4d-b13072bdabf0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:39.091132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0c2d8bc-9f59-4f23-8c4d-b13072bdabf0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:39.102696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0c2d8bc-9f59-4f23-8c4d-b13072bdabf0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.103718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0c2d8bc-9f59-4f23-8c4d-b13072bdabf0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.105246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0c2d8bc-9f59-4f23-8c4d-b13072bdabf0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.105857 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. Sep 10 20:58:39.106496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0c2d8bc-9f59-4f23-8c4d-b13072bdabf0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.107387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0c2d8bc-9f59-4f23-8c4d-b13072bdabf0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.108156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0c2d8bc-9f59-4f23-8c4d-b13072bdabf0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 HTTP/1.1 Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '4e7f8366-d0bc-4854-b822-a6775d0dc931'} Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:39.111605 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:39.115478 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6b3b5ae6-e015-47ad-8e49-6551d5655ac9 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 404 len: 111 microversion: 2.1 time: 0.077603 Sep 10 20:58:39.123627 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1362/2803] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:39 2022] DELETE /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:39.132534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8221a784-5e1f-457c-b733-b466105b8b70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:39.133165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8221a784-5e1f-457c-b733-b466105b8b70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:39.144324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:39.149363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8221a784-5e1f-457c-b733-b466105b8b70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.149926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8221a784-5e1f-457c-b733-b466105b8b70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.150389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8221a784-5e1f-457c-b733-b466105b8b70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.151294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8221a784-5e1f-457c-b733-b466105b8b70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.152137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8221a784-5e1f-457c-b733-b466105b8b70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.152637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8221a784-5e1f-457c-b733-b466105b8b70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.218815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0c2d8bc-9f59-4f23-8c4d-b13072bdabf0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:39.232280 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0c2d8bc-9f59-4f23-8c4d-b13072bdabf0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1277 microversion: 2.1 time: 0.147554 Sep 10 20:58:39.234470 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1442/2804] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:39 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:39.238175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:39.238852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 4e7f8366-d0bc-4854-b822-a6775d0dc931] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:39.245164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.246009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.247258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.248289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.249221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.249350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.265959 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 HTTP/1.1 Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '4e7f8366-d0bc-4854-b822-a6775d0dc931'} Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.267883 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.273111 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:39.273111 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:39.273111 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:39.273111 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:39.273111 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. Sep 10 20:58:39.273111 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.273111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Instance 4e7f8366-d0bc-4854-b822-a6775d0dc931 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:39.273111 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d4bc80ce-b0a5-4670-a5d8-ea1c82ad3d85 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931" status: 404 len: 111 microversion: 2.1 time: 0.035217 Sep 10 20:58:39.274847 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1443/2805] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:39 2022] GET /compute/v2.1/servers/4e7f8366-d0bc-4854-b822-a6775d0dc931 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:39.278664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08f3b04a-6f1e-4f5f-8ccd-9d80d38bf2b2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '.version_select at 0x7f993ff28d30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:39.310785 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-08f3b04a-6f1e-4f5f-8ccd-9d80d38bf2b2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Image not found. Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08f3b04a-6f1e-4f5f-8ccd-9d80d38bf2b2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a HTTP/1.1 Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: exception: Image not found. Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '53dfa844-f5f2-4e51-9e93-65792794d44a'} Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 53dfa844-f5f2-4e51-9e93-65792794d44a to delete Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 53dfa844-f5f2-4e51-9e93-65792794d44a could not be found. Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.312675 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.317191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08f3b04a-6f1e-4f5f-8ccd-9d80d38bf2b2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Image not found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:39.321175 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-08f3b04a-6f1e-4f5f-8ccd-9d80d38bf2b2 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a" status: 404 len: 62 microversion: 2.1 time: 0.043220 Sep 10 20:58:39.322889 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1444/2806] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:39 2022] DELETE /compute/v2.1/images/53dfa844-f5f2-4e51-9e93-65792794d44a => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:58:39.328999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:39.329500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:39.338142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.338991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.339434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.340421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.340839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.341317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.366354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e HTTP/1.1 Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '372f952b-42c2-45e6-bb5c-5a2c37a2879e'} Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:39.368835 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. Sep 10 20:58:39.372588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.372588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.372588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.372588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.372588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:39.372588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:39.372588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:39.372588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:39.372588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. Sep 10 20:58:39.372588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.374646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:39.375626 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f4b487ac-08ff-48e0-b580-04d9df96f837 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "DELETE /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 404 len: 111 microversion: 2.1 time: 0.051781 Sep 10 20:58:39.376687 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1445/2807] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:39 2022] DELETE /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:39.384496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:39.385416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] [instance: 372f952b-42c2-45e6-bb5c-5a2c37a2879e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:39.391853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.392344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.392839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.393507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.393963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.394402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.411214 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] HTTP exception thrown: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Request method failure captured: Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e HTTP/1.1 Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPmOK50TON5C4yK9WpfAzNi38XEe-xTKiwyaTpOBFFSZw2RXutiXC3BuqutfIvNH9z9rKrABnvv2v_4xBzQOUg3tdp-G9dIdizIElcrtsZW0OZ1bwKxE5qGrsPxvW3OkKdw2RnbIrKgoUK5tNZYb4ZKULWvz5fDHWc3R7gkc889hOSo Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8f7f9f3112545e9b40d88a7cc48e3fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8f7f9f3112545e9b40d88a7cc48e3fe"}]}] Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e8f7f9f3112545e9b40d88a7cc48e3fe Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesTestJSON-1364298681 Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 687eef270165450a97b4d260b2724b3e Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesTestJSON-1364298681-project Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '372f952b-42c2-45e6-bb5c-5a2c37a2879e'} Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.413733 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:39.421508 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:39.421508 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:39.421508 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:39.421508 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:39.421508 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. Sep 10 20:58:39.421508 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:39.421508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] Returning 404 to user: Instance 372f952b-42c2-45e6-bb5c-5a2c37a2879e could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:39.421508 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ae5af655-4e0a-4cbf-8b80-e6d608101467 tempest-ImagesTestJSON-1364298681 tempest-ImagesTestJSON-1364298681-project] 10.222.0.33 "GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e" status: 404 len: 111 microversion: 2.1 time: 0.034693 Sep 10 20:58:39.421508 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1446/2808] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:39 2022] GET /compute/v2.1/servers/372f952b-42c2-45e6-bb5c-5a2c37a2879e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:58:39.483174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8221a784-5e1f-457c-b733-b466105b8b70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:39.494578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c845102a-aa72-46a3-8d2c-685bf0c5209a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:39.495139 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8221a784-5e1f-457c-b733-b466105b8b70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1508 microversion: 2.1 time: 0.369825 Sep 10 20:58:39.495229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c845102a-aa72-46a3-8d2c-685bf0c5209a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:39.495328 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1363/2809] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:39 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1508 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:39.517405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c845102a-aa72-46a3-8d2c-685bf0c5209a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.518534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c845102a-aa72-46a3-8d2c-685bf0c5209a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.519211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c845102a-aa72-46a3-8d2c-685bf0c5209a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.520170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c845102a-aa72-46a3-8d2c-685bf0c5209a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:39.520855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c845102a-aa72-46a3-8d2c-685bf0c5209a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:39.521626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c845102a-aa72-46a3-8d2c-685bf0c5209a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:39.770894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c845102a-aa72-46a3-8d2c-685bf0c5209a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:39.780690 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c845102a-aa72-46a3-8d2c-685bf0c5209a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1318 microversion: 2.1 time: 0.291308 Sep 10 20:58:39.781993 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1447/2810] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:39 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:40.058674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f150ce9-1268-4e6c-9c2f-9b24b20d42c6 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:40.059303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8f150ce9-1268-4e6c-9c2f-9b24b20d42c6 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:40.069204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f150ce9-1268-4e6c-9c2f-9b24b20d42c6 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:40.071793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f150ce9-1268-4e6c-9c2f-9b24b20d42c6 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:40.072271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f150ce9-1268-4e6c-9c2f-9b24b20d42c6 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:40.073040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f150ce9-1268-4e6c-9c2f-9b24b20d42c6 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:40.074446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f150ce9-1268-4e6c-9c2f-9b24b20d42c6 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:40.075268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f150ce9-1268-4e6c-9c2f-9b24b20d42c6 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:40.258450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-746cf9e5-ab62-4fc0-a976-e5f491e23d28 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:40.259873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-746cf9e5-ab62-4fc0-a976-e5f491e23d28 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:40.268905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-746cf9e5-ab62-4fc0-a976-e5f491e23d28 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:40.269085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-746cf9e5-ab62-4fc0-a976-e5f491e23d28 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:40.269757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-746cf9e5-ab62-4fc0-a976-e5f491e23d28 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:40.270717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-746cf9e5-ab62-4fc0-a976-e5f491e23d28 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:40.271939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-746cf9e5-ab62-4fc0-a976-e5f491e23d28 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:40.272586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-746cf9e5-ab62-4fc0-a976-e5f491e23d28 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:40.488794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8f150ce9-1268-4e6c-9c2f-9b24b20d42c6 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:40.500005 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8f150ce9-1268-4e6c-9c2f-9b24b20d42c6 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1473 microversion: 2.1 time: 0.446056 Sep 10 20:58:40.501711 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1364/2811] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:40 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1473 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:40.522280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-273ef318-711e-4646-8294-515cde87982a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:40.523285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-273ef318-711e-4646-8294-515cde87982a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:40.540936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273ef318-711e-4646-8294-515cde87982a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:40.542104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273ef318-711e-4646-8294-515cde87982a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:40.542980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273ef318-711e-4646-8294-515cde87982a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:40.544177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273ef318-711e-4646-8294-515cde87982a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:40.545019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273ef318-711e-4646-8294-515cde87982a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:40.545703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273ef318-711e-4646-8294-515cde87982a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:40.747198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-746cf9e5-ab62-4fc0-a976-e5f491e23d28 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:40.755371 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-746cf9e5-ab62-4fc0-a976-e5f491e23d28 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1319 microversion: 2.1 time: 0.500729 Sep 10 20:58:40.755988 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1448/2812] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:40 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:40.805138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-14037f44-7f4d-462b-ade8-2d7af21638dc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:40.806570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-14037f44-7f4d-462b-ade8-2d7af21638dc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:40.815493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14037f44-7f4d-462b-ade8-2d7af21638dc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:40.822703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14037f44-7f4d-462b-ade8-2d7af21638dc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:40.824822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14037f44-7f4d-462b-ade8-2d7af21638dc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:40.825855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14037f44-7f4d-462b-ade8-2d7af21638dc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:40.826916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14037f44-7f4d-462b-ade8-2d7af21638dc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:40.827584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14037f44-7f4d-462b-ade8-2d7af21638dc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:41.019412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-273ef318-711e-4646-8294-515cde87982a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:41.031671 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-273ef318-711e-4646-8294-515cde87982a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1508 microversion: 2.1 time: 0.513572 Sep 10 20:58:41.033235 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1365/2813] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:40 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1508 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:41.070833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-14037f44-7f4d-462b-ade8-2d7af21638dc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:41.082273 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-14037f44-7f4d-462b-ade8-2d7af21638dc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1318 microversion: 2.1 time: 0.281676 Sep 10 20:58:41.083466 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1449/2814] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:40 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:41.516228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-7ef4a3d9-848f-4950-be33-ce7a4cea253c req-f06a37a0-a6ef-414f-a1eb-2e5489661fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f348be-b60c-442d-9352-4030c286cb0d", "name": "network-vif-plugged", "status": "completed", "tag": "f3219068-e534-4daa-bfa3-338154c8be13"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:41.524404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9097b74d-661d-4314-9524-36952052f40c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:41.525338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9097b74d-661d-4314-9524-36952052f40c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:41.539560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7ef4a3d9-848f-4950-be33-ce7a4cea253c req-f06a37a0-a6ef-414f-a1eb-2e5489661fb2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:41.539957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7ef4a3d9-848f-4950-be33-ce7a4cea253c req-f06a37a0-a6ef-414f-a1eb-2e5489661fb2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:41.540404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7ef4a3d9-848f-4950-be33-ce7a4cea253c req-f06a37a0-a6ef-414f-a1eb-2e5489661fb2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:41.548783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9097b74d-661d-4314-9524-36952052f40c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:41.569701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9097b74d-661d-4314-9524-36952052f40c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:41.570807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9097b74d-661d-4314-9524-36952052f40c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:41.571809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9097b74d-661d-4314-9524-36952052f40c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:41.572490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9097b74d-661d-4314-9524-36952052f40c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:41.572838 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7ef4a3d9-848f-4950-be33-ce7a4cea253c req-f06a37a0-a6ef-414f-a1eb-2e5489661fb2 service nova] Creating event network-vif-plugged:f3219068-e534-4daa-bfa3-338154c8be13 for instance 81f348be-b60c-442d-9352-4030c286cb0d on nch1-master-1 Sep 10 20:58:41.573262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9097b74d-661d-4314-9524-36952052f40c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:41.587960 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-7ef4a3d9-848f-4950-be33-ce7a4cea253c req-f06a37a0-a6ef-414f-a1eb-2e5489661fb2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224959 Sep 10 20:58:41.592652 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1366/2815] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:41.782203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f78a5c0b-b367-4bdb-af79-f52a36c64c5d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:41.782910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f78a5c0b-b367-4bdb-af79-f52a36c64c5d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:41.804054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f78a5c0b-b367-4bdb-af79-f52a36c64c5d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:41.804760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f78a5c0b-b367-4bdb-af79-f52a36c64c5d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:41.805218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f78a5c0b-b367-4bdb-af79-f52a36c64c5d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:41.807925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f78a5c0b-b367-4bdb-af79-f52a36c64c5d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:41.808578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f78a5c0b-b367-4bdb-af79-f52a36c64c5d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:41.809032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f78a5c0b-b367-4bdb-af79-f52a36c64c5d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:42.077411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f78a5c0b-b367-4bdb-af79-f52a36c64c5d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:42.086616 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f78a5c0b-b367-4bdb-af79-f52a36c64c5d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1319 microversion: 2.1 time: 0.308611 Sep 10 20:58:42.095814 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1367/2816] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:41 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:42.109241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d37a5b9-8c87-4b55-9db3-c5d8e8026253 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:42.118098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d37a5b9-8c87-4b55-9db3-c5d8e8026253 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:42.124727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d37a5b9-8c87-4b55-9db3-c5d8e8026253 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:42.125278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d37a5b9-8c87-4b55-9db3-c5d8e8026253 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:42.125708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d37a5b9-8c87-4b55-9db3-c5d8e8026253 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:42.126742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d37a5b9-8c87-4b55-9db3-c5d8e8026253 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:42.127568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d37a5b9-8c87-4b55-9db3-c5d8e8026253 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:42.128201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d37a5b9-8c87-4b55-9db3-c5d8e8026253 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:42.163818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:42.174398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9097b74d-661d-4314-9524-36952052f40c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:42.186771 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9097b74d-661d-4314-9524-36952052f40c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1473 microversion: 2.1 time: 0.666589 Sep 10 20:58:42.187458 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1450/2817] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:41 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1473 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:42.193045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0195e30a-f2af-40b0-9e3d-28e267fee1fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:42.193958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0195e30a-f2af-40b0-9e3d-28e267fee1fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:42.207185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0195e30a-f2af-40b0-9e3d-28e267fee1fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:42.207874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0195e30a-f2af-40b0-9e3d-28e267fee1fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:42.209080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0195e30a-f2af-40b0-9e3d-28e267fee1fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:42.210082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0195e30a-f2af-40b0-9e3d-28e267fee1fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:42.210768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0195e30a-f2af-40b0-9e3d-28e267fee1fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:42.211413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0195e30a-f2af-40b0-9e3d-28e267fee1fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:42.491629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3d37a5b9-8c87-4b55-9db3-c5d8e8026253 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:42.509046 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d37a5b9-8c87-4b55-9db3-c5d8e8026253 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1508 microversion: 2.1 time: 0.411204 Sep 10 20:58:42.510548 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1368/2818] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:42 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1508 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:42.529817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0f44e342-64ca-4a1e-b491-86ce2ff990a8 req-15a03adb-d0a4-4c19-8533-4f9486a7a3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af65c85f-8f25-4d07-bc16-637834210814", "tag": "9a0c1860-2a38-4b12-bd81-ee22500329c0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:42.544670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0f44e342-64ca-4a1e-b491-86ce2ff990a8 req-15a03adb-d0a4-4c19-8533-4f9486a7a3d7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:42.545295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0f44e342-64ca-4a1e-b491-86ce2ff990a8 req-15a03adb-d0a4-4c19-8533-4f9486a7a3d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:42.545736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0f44e342-64ca-4a1e-b491-86ce2ff990a8 req-15a03adb-d0a4-4c19-8533-4f9486a7a3d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:42.583941 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0f44e342-64ca-4a1e-b491-86ce2ff990a8 req-15a03adb-d0a4-4c19-8533-4f9486a7a3d7 service nova] Creating event network-changed:9a0c1860-2a38-4b12-bd81-ee22500329c0 for instance af65c85f-8f25-4d07-bc16-637834210814 on nch2-master-1 Sep 10 20:58:42.596915 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0f44e342-64ca-4a1e-b491-86ce2ff990a8 req-15a03adb-d0a4-4c19-8533-4f9486a7a3d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083818 Sep 10 20:58:42.598932 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1369/2819] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:42.632503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0195e30a-f2af-40b0-9e3d-28e267fee1fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:42.643742 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0195e30a-f2af-40b0-9e3d-28e267fee1fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1318 microversion: 2.1 time: 0.454862 Sep 10 20:58:42.644513 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1451/2820] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:42 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:43.125075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-263bbe31-fce0-475f-b614-5a6c90922240 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:43.127760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-263bbe31-fce0-475f-b614-5a6c90922240 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:43.138660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-263bbe31-fce0-475f-b614-5a6c90922240 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:43.140851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-263bbe31-fce0-475f-b614-5a6c90922240 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:43.145205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-263bbe31-fce0-475f-b614-5a6c90922240 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:43.150125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-263bbe31-fce0-475f-b614-5a6c90922240 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:43.152764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-263bbe31-fce0-475f-b614-5a6c90922240 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:43.153634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-263bbe31-fce0-475f-b614-5a6c90922240 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:43.205009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:43.216358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b4356952-2f31-4b7b-947f-292be86032a8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:43.217616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b4356952-2f31-4b7b-947f-292be86032a8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:43.229110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4356952-2f31-4b7b-947f-292be86032a8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:43.229610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4356952-2f31-4b7b-947f-292be86032a8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:43.232311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4356952-2f31-4b7b-947f-292be86032a8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:43.233068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4356952-2f31-4b7b-947f-292be86032a8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:43.233537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4356952-2f31-4b7b-947f-292be86032a8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:43.234002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4356952-2f31-4b7b-947f-292be86032a8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:43.545703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-263bbe31-fce0-475f-b614-5a6c90922240 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:43.558025 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-263bbe31-fce0-475f-b614-5a6c90922240 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1319 microversion: 2.1 time: 0.448123 Sep 10 20:58:43.568275 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1370/2821] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:43 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:43.578672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a7a35fb-9e52-4019-bc8f-40d91569b9cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:43.579308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7a7a35fb-9e52-4019-bc8f-40d91569b9cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:43.585732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7a35fb-9e52-4019-bc8f-40d91569b9cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:43.587038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7a35fb-9e52-4019-bc8f-40d91569b9cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:43.587492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7a35fb-9e52-4019-bc8f-40d91569b9cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:43.588394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7a35fb-9e52-4019-bc8f-40d91569b9cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:43.588849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7a35fb-9e52-4019-bc8f-40d91569b9cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:43.589465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7a35fb-9e52-4019-bc8f-40d91569b9cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:43.834367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b4356952-2f31-4b7b-947f-292be86032a8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:43.861062 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b4356952-2f31-4b7b-947f-292be86032a8 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1473 microversion: 2.1 time: 0.654694 Sep 10 20:58:43.862010 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1452/2822] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:43 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1473 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:43.877077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b0e1593a-485b-4c59-92d9-595b2d8ef78d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:43.878055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b0e1593a-485b-4c59-92d9-595b2d8ef78d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:43.899257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e1593a-485b-4c59-92d9-595b2d8ef78d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:43.900066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e1593a-485b-4c59-92d9-595b2d8ef78d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:43.901389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e1593a-485b-4c59-92d9-595b2d8ef78d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:43.903099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e1593a-485b-4c59-92d9-595b2d8ef78d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:43.903933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e1593a-485b-4c59-92d9-595b2d8ef78d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:43.904574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e1593a-485b-4c59-92d9-595b2d8ef78d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:43.924343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7a7a35fb-9e52-4019-bc8f-40d91569b9cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:43.949544 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7a7a35fb-9e52-4019-bc8f-40d91569b9cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1508 microversion: 2.1 time: 0.379450 Sep 10 20:58:43.951843 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1371/2823] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:43 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:43.970732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a2a6a888-df34-4617-8f0a-c55e16357fcc req-c4c0af22-36db-4a9d-ad5e-4cdd0d7f0a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f096440-3a63-40a0-bd51-42ab451bef64", "name": "network-vif-unplugged", "status": "completed", "tag": "6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:43.990465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a2a6a888-df34-4617-8f0a-c55e16357fcc req-c4c0af22-36db-4a9d-ad5e-4cdd0d7f0a51 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:43.991289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a2a6a888-df34-4617-8f0a-c55e16357fcc req-c4c0af22-36db-4a9d-ad5e-4cdd0d7f0a51 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:43.991922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a2a6a888-df34-4617-8f0a-c55e16357fcc req-c4c0af22-36db-4a9d-ad5e-4cdd0d7f0a51 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:44.016802 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a2a6a888-df34-4617-8f0a-c55e16357fcc req-c4c0af22-36db-4a9d-ad5e-4cdd0d7f0a51 service nova] Creating event network-vif-unplugged:6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2 for instance 4f096440-3a63-40a0-bd51-42ab451bef64 on nch1-master-1 Sep 10 20:58:44.030955 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a2a6a888-df34-4617-8f0a-c55e16357fcc req-c4c0af22-36db-4a9d-ad5e-4cdd0d7f0a51 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077454 Sep 10 20:58:44.035432 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1372/2824] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:44.585647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c8eec3a-ef61-4ea5-a317-9b4c82022d14 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:44.587294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c8eec3a-ef61-4ea5-a317-9b4c82022d14 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:44.624039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c8eec3a-ef61-4ea5-a317-9b4c82022d14 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:44.624766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c8eec3a-ef61-4ea5-a317-9b4c82022d14 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:44.627985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c8eec3a-ef61-4ea5-a317-9b4c82022d14 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:44.628848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c8eec3a-ef61-4ea5-a317-9b4c82022d14 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:44.630163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c8eec3a-ef61-4ea5-a317-9b4c82022d14 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:44.631307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c8eec3a-ef61-4ea5-a317-9b4c82022d14 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:44.889317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6c8eec3a-ef61-4ea5-a317-9b4c82022d14 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:44.902148 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c8eec3a-ef61-4ea5-a317-9b4c82022d14 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1319 microversion: 2.1 time: 0.322236 Sep 10 20:58:44.903078 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1373/2825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:44 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:44.923289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-75f07236-8b68-4da2-a5da-f84177ba74ac req-366cda10-2089-4c9f-9f70-667c148ca922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f096440-3a63-40a0-bd51-42ab451bef64", "name": "network-vif-deleted", "tag": "6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2"}, {"server_uuid": "5f1f769d-7314-4652-8dff-f06c1b403046", "name": "network-vif-deleted", "tag": "7553bf76-9c9b-498a-870a-5ca0699d24c1"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:44.939103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-75f07236-8b68-4da2-a5da-f84177ba74ac req-366cda10-2089-4c9f-9f70-667c148ca922 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:44.939500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-75f07236-8b68-4da2-a5da-f84177ba74ac req-366cda10-2089-4c9f-9f70-667c148ca922 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:44.939933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-75f07236-8b68-4da2-a5da-f84177ba74ac req-366cda10-2089-4c9f-9f70-667c148ca922 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:44.956293 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-75f07236-8b68-4da2-a5da-f84177ba74ac req-366cda10-2089-4c9f-9f70-667c148ca922 service nova] Creating event network-vif-deleted:6ff674b7-27b3-4e82-9e49-fa2a75dd4ce2 for instance 4f096440-3a63-40a0-bd51-42ab451bef64 on nch1-master-1 Sep 10 20:58:44.956818 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-75f07236-8b68-4da2-a5da-f84177ba74ac req-366cda10-2089-4c9f-9f70-667c148ca922 service nova] Creating event network-vif-deleted:7553bf76-9c9b-498a-870a-5ca0699d24c1 for instance 5f1f769d-7314-4652-8dff-f06c1b403046 on nch1-master-1 Sep 10 20:58:44.963824 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-75f07236-8b68-4da2-a5da-f84177ba74ac req-366cda10-2089-4c9f-9f70-667c148ca922 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048104 Sep 10 20:58:44.964749 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1374/2826] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:44.969996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:44.970915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:44.981052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:44.982074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:44.982696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:44.984245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:44.984886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:44.985376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:45.026253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:45.026752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:45.027193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:45.027832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lazy-loading 'fault' on Instance uuid 4f096440-3a63-40a0-bd51-42ab451bef64 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:58:45.123232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33de4067d4b1bb6e4ad866ddf2d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57a1c44d4684b2fa210973f062adbce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:45.134121 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-597abee1-891f-43ba-b138-c0a1ffc22ed9 tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 200 len: 1307 microversion: 2.1 time: 0.168117 Sep 10 20:58:45.135902 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1375/2827] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:44 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 1307 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:45.140734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:45.141590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:45.148586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:45.149306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:45.150086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:45.151048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:45.151744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:45.152390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:45.180694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b0e1593a-485b-4c59-92d9-595b2d8ef78d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:45.212700 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b0e1593a-485b-4c59-92d9-595b2d8ef78d tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1318 microversion: 2.1 time: 1.345137 Sep 10 20:58:45.216871 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1453/2828] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:43 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1318 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:45.268856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:45.269571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:45.270336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:45.271539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lazy-loading 'fault' on Instance uuid 5f1f769d-7314-4652-8dff-f06c1b403046 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:58:45.340582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:45.351052 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aa90f72a-1cf8-4d19-b150-4a08cf9cbdff tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 200 len: 1304 microversion: 2.1 time: 0.213765 Sep 10 20:58:45.351634 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1376/2829] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:45 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:45.933935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4eaeafeb-2158-43c6-8dbd-41afc092d3cc tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:45.935067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4eaeafeb-2158-43c6-8dbd-41afc092d3cc tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:45.952314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:45.958929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eaeafeb-2158-43c6-8dbd-41afc092d3cc tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:45.979398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eaeafeb-2158-43c6-8dbd-41afc092d3cc tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:45.986462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eaeafeb-2158-43c6-8dbd-41afc092d3cc tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:45.987369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eaeafeb-2158-43c6-8dbd-41afc092d3cc tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:45.987872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eaeafeb-2158-43c6-8dbd-41afc092d3cc tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:45.988318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eaeafeb-2158-43c6-8dbd-41afc092d3cc tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.158325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:46.159614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] [instance: 4f096440-3a63-40a0-bd51-42ab451bef64] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:46.164874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:46.173987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:46.174688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:46.175291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.176161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:46.176776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:46.177972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.195948 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] HTTP exception thrown: Instance 4f096440-3a63-40a0-bd51-42ab451bef64 could not be found. Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Request method failure captured: Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 HTTP/1.1 Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPoaVDQ-b_fnkbnF7M2jkEwVfDjJN_Vn5x7oW3jJI-nVWL2pT82So-Px_Dvw8CAiaBIi7499tWWWYA0nX2gGrY__KCYJwnHBu8jnCpNdnSWXCmcEWV90OT7V9CZDsYXBUFYA0ZpT5YeFeyASDrJ1RSsCzKVxWA--0yuh3AfIgDFuyp4 Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f57a1c44d4684b2fa210973f062adbce Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesOneServerTestJSON-1495268422 Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f57a1c44d4684b2fa210973f062adbce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f57a1c44d4684b2fa210973f062adbce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f57a1c44d4684b2fa210973f062adbce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f57a1c44d4684b2fa210973f062adbce"}]}] Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesOneServerTestJSON-1495268422 Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f57a1c44d4684b2fa210973f062adbce Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1495268422 Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesOneServerTestJSON-1495268422-project Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: bec33de4067d4b1bb6e4ad866ddf2d01 Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesOneServerTestJSON-1495268422-project Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 4f096440-3a63-40a0-bd51-42ab451bef64 could not be found. Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '4f096440-3a63-40a0-bd51-42ab451bef64'} Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f096440-3a63-40a0-bd51-42ab451bef64 could not be found. Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f096440-3a63-40a0-bd51-42ab451bef64 could not be found. Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:46.197969 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:46.202520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:46.202520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:46.202520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:46.202520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:46.202520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:46.202520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f096440-3a63-40a0-bd51-42ab451bef64 could not be found. Sep 10 20:58:46.202520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:46.204144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] Returning 404 to user: Instance 4f096440-3a63-40a0-bd51-42ab451bef64 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:46.205426 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dbc5e6b2-6e42-4da8-9e6a-6c24b60e434c tempest-ImagesOneServerTestJSON-1495268422 tempest-ImagesOneServerTestJSON-1495268422-project] 10.222.0.33 "GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64" status: 404 len: 111 microversion: 2.1 time: 0.050750 Sep 10 20:58:46.206560 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1377/2830] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:46 2022] GET /compute/v2.1/servers/4f096440-3a63-40a0-bd51-42ab451bef64 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:58:46.247270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3802418a-fa4d-4656-8cbe-50f45a43566a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:46.248071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3802418a-fa4d-4656-8cbe-50f45a43566a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:46.258898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3802418a-fa4d-4656-8cbe-50f45a43566a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:46.259393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3802418a-fa4d-4656-8cbe-50f45a43566a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:46.259836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3802418a-fa4d-4656-8cbe-50f45a43566a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.264958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3802418a-fa4d-4656-8cbe-50f45a43566a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:46.265379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3802418a-fa4d-4656-8cbe-50f45a43566a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:46.268649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3802418a-fa4d-4656-8cbe-50f45a43566a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.405985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4eaeafeb-2158-43c6-8dbd-41afc092d3cc tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:46.419751 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4eaeafeb-2158-43c6-8dbd-41afc092d3cc tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1319 microversion: 2.1 time: 0.492504 Sep 10 20:58:46.421422 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1454/2831] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:45 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:46.427486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:46.428612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:46.437913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:46.439993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:46.441204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.442337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:46.443586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:46.444394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.445340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=32 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:46.489900 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 HTTP/1.1 Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5f1f769d-7314-4652-8dff-f06c1b403046'} Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:46.491834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:46.496153 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:46.496153 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:46.496153 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:46.496153 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:46.496153 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:46.496153 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:58:46.496153 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:46.497625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:46.501144 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7669e1c9-7b6d-4a44-a950-783eadf8c22d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 404 len: 111 microversion: 2.1 time: 0.077229 Sep 10 20:58:46.502161 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1455/2832] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:46 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:46.521053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-687b55a2-2fcc-4a5a-a3e9-c855e8364bb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:46.524240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-687b55a2-2fcc-4a5a-a3e9-c855e8364bb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:46.541224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-687b55a2-2fcc-4a5a-a3e9-c855e8364bb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:46.542107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-687b55a2-2fcc-4a5a-a3e9-c855e8364bb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:46.542730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-687b55a2-2fcc-4a5a-a3e9-c855e8364bb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.545812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-687b55a2-2fcc-4a5a-a3e9-c855e8364bb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:46.546517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-687b55a2-2fcc-4a5a-a3e9-c855e8364bb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:46.548225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-687b55a2-2fcc-4a5a-a3e9-c855e8364bb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.811130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3802418a-fa4d-4656-8cbe-50f45a43566a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:46.823195 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3802418a-fa4d-4656-8cbe-50f45a43566a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1507 microversion: 2.1 time: 0.581791 Sep 10 20:58:46.824151 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1378/2833] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:46 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1507 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:46.854112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e4d8b66c-3e7f-4de0-9a26-24fbd282b43a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:46.855612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e4d8b66c-3e7f-4de0-9a26-24fbd282b43a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:46.863626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d8b66c-3e7f-4de0-9a26-24fbd282b43a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:46.865459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d8b66c-3e7f-4de0-9a26-24fbd282b43a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:46.866219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d8b66c-3e7f-4de0-9a26-24fbd282b43a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.867382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d8b66c-3e7f-4de0-9a26-24fbd282b43a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:46.867999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d8b66c-3e7f-4de0-9a26-24fbd282b43a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:46.869320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4d8b66c-3e7f-4de0-9a26-24fbd282b43a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:46.952856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-687b55a2-2fcc-4a5a-a3e9-c855e8364bb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:46.968380 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-687b55a2-2fcc-4a5a-a3e9-c855e8364bb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.458311 Sep 10 20:58:46.968968 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1456/2834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:46 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:47.171470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e4d8b66c-3e7f-4de0-9a26-24fbd282b43a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:47.180981 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e4d8b66c-3e7f-4de0-9a26-24fbd282b43a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1507 microversion: 2.1 time: 0.332129 Sep 10 20:58:47.182236 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1379/2835] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:46 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:47.212812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bc122c7e-d4bf-4b5b-88fb-4ef78aa86388 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:47.219963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bc122c7e-d4bf-4b5b-88fb-4ef78aa86388 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:47.230065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d887cc0-1e3f-4b73-b589-6a60175740fb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d887cc0-1e3f-4b73-b589-6a60175740fb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 163 Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": 12345, "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 12345 Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:58:47.242176 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 10 20:58:47.247011 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:47.252376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc122c7e-d4bf-4b5b-88fb-4ef78aa86388 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.253750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d887cc0-1e3f-4b73-b589-6a60175740fb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:47.255658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc122c7e-d4bf-4b5b-88fb-4ef78aa86388 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.256504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc122c7e-d4bf-4b5b-88fb-4ef78aa86388 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:47.257036 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d887cc0-1e3f-4b73-b589-6a60175740fb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.040678 Sep 10 20:58:47.258256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc122c7e-d4bf-4b5b-88fb-4ef78aa86388 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.258740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc122c7e-d4bf-4b5b-88fb-4ef78aa86388 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.259342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc122c7e-d4bf-4b5b-88fb-4ef78aa86388 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:47.259496 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1380/2836] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:47 2022] POST /compute/v2.1/servers => generated 127 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:58:47.272506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-712a8123-4e32-4444-84f3-e50d72aa6f98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:47.273392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-712a8123-4e32-4444-84f3-e50d72aa6f98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:47.282075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-712a8123-4e32-4444-84f3-e50d72aa6f98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.282784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-712a8123-4e32-4444-84f3-e50d72aa6f98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.283386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-712a8123-4e32-4444-84f3-e50d72aa6f98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:47.284389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-712a8123-4e32-4444-84f3-e50d72aa6f98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.284997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-712a8123-4e32-4444-84f3-e50d72aa6f98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.285571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-712a8123-4e32-4444-84f3-e50d72aa6f98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:47.431868 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bc122c7e-d4bf-4b5b-88fb-4ef78aa86388 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "PUT /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1079 microversion: 2.1 time: 0.227954 Sep 10 20:58:47.434326 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1457/2837] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Sep 10 20:58:47 2022] PUT /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1079 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:47.442792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3f9f50d9-2db3-4f84-b4a1-d4f180fc9655 req-1ea61313-922b-4942-8088-f5ab1a35f769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5295c29d-1e1a-4858-81b2-80ff782a328f", "tag": "cf4611af-9b8c-480b-b7fa-343204618b45"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:47.469714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f9f50d9-2db3-4f84-b4a1-d4f180fc9655 req-1ea61313-922b-4942-8088-f5ab1a35f769 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.470554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f9f50d9-2db3-4f84-b4a1-d4f180fc9655 req-1ea61313-922b-4942-8088-f5ab1a35f769 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.475812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f9f50d9-2db3-4f84-b4a1-d4f180fc9655 req-1ea61313-922b-4942-8088-f5ab1a35f769 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:47.503239 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3f9f50d9-2db3-4f84-b4a1-d4f180fc9655 req-1ea61313-922b-4942-8088-f5ab1a35f769 service nova] Creating event network-changed:cf4611af-9b8c-480b-b7fa-343204618b45 for instance 5295c29d-1e1a-4858-81b2-80ff782a328f on nch1-master-1 Sep 10 20:58:47.511718 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3f9f50d9-2db3-4f84-b4a1-d4f180fc9655 req-1ea61313-922b-4942-8088-f5ab1a35f769 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075290 Sep 10 20:58:47.513032 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1458/2838] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:47.519543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0b73e433-060d-4ee3-9b8f-39dbf580419f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:47.522170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0b73e433-060d-4ee3-9b8f-39dbf580419f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:47.530573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b73e433-060d-4ee3-9b8f-39dbf580419f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.531972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b73e433-060d-4ee3-9b8f-39dbf580419f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.532587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b73e433-060d-4ee3-9b8f-39dbf580419f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:47.533402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b73e433-060d-4ee3-9b8f-39dbf580419f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.534009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b73e433-060d-4ee3-9b8f-39dbf580419f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.536968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b73e433-060d-4ee3-9b8f-39dbf580419f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:47.666384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-712a8123-4e32-4444-84f3-e50d72aa6f98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:47.680646 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-712a8123-4e32-4444-84f3-e50d72aa6f98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.417274 Sep 10 20:58:47.691436 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1381/2839] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:47 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:47.705460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-275ce7d0-c4b1-47b9-abb6-0df01757023a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:47.706132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-275ce7d0-c4b1-47b9-abb6-0df01757023a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:47.714634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275ce7d0-c4b1-47b9-abb6-0df01757023a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.715610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275ce7d0-c4b1-47b9-abb6-0df01757023a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.716259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275ce7d0-c4b1-47b9-abb6-0df01757023a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:47.717068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275ce7d0-c4b1-47b9-abb6-0df01757023a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.718768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275ce7d0-c4b1-47b9-abb6-0df01757023a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.719422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-275ce7d0-c4b1-47b9-abb6-0df01757023a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:47.795628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0b73e433-060d-4ee3-9b8f-39dbf580419f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:47.816230 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0b73e433-060d-4ee3-9b8f-39dbf580419f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1319 microversion: 2.1 time: 0.301683 Sep 10 20:58:47.816750 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1459/2840] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:47 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:47.823558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ea5e93a-bd65-4ded-a9f3-38e6ceb6adad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:47.824763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2ea5e93a-bd65-4ded-a9f3-38e6ceb6adad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:47.833004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ea5e93a-bd65-4ded-a9f3-38e6ceb6adad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.834268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ea5e93a-bd65-4ded-a9f3-38e6ceb6adad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.835939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ea5e93a-bd65-4ded-a9f3-38e6ceb6adad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:47.837751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ea5e93a-bd65-4ded-a9f3-38e6ceb6adad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:47.838927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ea5e93a-bd65-4ded-a9f3-38e6ceb6adad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:47.839592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ea5e93a-bd65-4ded-a9f3-38e6ceb6adad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:48.018770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-275ce7d0-c4b1-47b9-abb6-0df01757023a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:48.027537 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-275ce7d0-c4b1-47b9-abb6-0df01757023a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1505 microversion: 2.1 time: 0.334813 Sep 10 20:58:48.028120 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1382/2841] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:47 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:48.053251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-383092dd-67ea-4753-8419-7abbbc87e32a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:48.053909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-383092dd-67ea-4753-8419-7abbbc87e32a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:48.062546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383092dd-67ea-4753-8419-7abbbc87e32a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:48.063039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383092dd-67ea-4753-8419-7abbbc87e32a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:48.063473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383092dd-67ea-4753-8419-7abbbc87e32a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:48.064162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383092dd-67ea-4753-8419-7abbbc87e32a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:48.064612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383092dd-67ea-4753-8419-7abbbc87e32a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:48.065243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383092dd-67ea-4753-8419-7abbbc87e32a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:48.120581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ea5e93a-bd65-4ded-a9f3-38e6ceb6adad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:48.134619 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ea5e93a-bd65-4ded-a9f3-38e6ceb6adad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.314887 Sep 10 20:58:48.135206 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1460/2842] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:47 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:48.277913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-383092dd-67ea-4753-8419-7abbbc87e32a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:48.289441 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-383092dd-67ea-4753-8419-7abbbc87e32a tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1505 microversion: 2.1 time: 0.240209 Sep 10 20:58:48.291202 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1383/2843] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:48 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:48.315455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9a363fcd-9c50-413c-9d6f-7f0a15684ae4 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:48.318666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9a363fcd-9c50-413c-9d6f-7f0a15684ae4 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:48.328659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a363fcd-9c50-413c-9d6f-7f0a15684ae4 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:48.330563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a363fcd-9c50-413c-9d6f-7f0a15684ae4 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:48.331033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a363fcd-9c50-413c-9d6f-7f0a15684ae4 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:48.331825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a363fcd-9c50-413c-9d6f-7f0a15684ae4 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:48.333108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a363fcd-9c50-413c-9d6f-7f0a15684ae4 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:48.334307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a363fcd-9c50-413c-9d6f-7f0a15684ae4 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:48.406098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:48.446312 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9a363fcd-9c50-413c-9d6f-7f0a15684ae4 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "PUT /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1081 microversion: 2.1 time: 0.136587 Sep 10 20:58:48.447039 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1461/2844] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Sep 10 20:58:48 2022] PUT /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1081 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:48.468833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23c1ad4d-e423-48c5-b1fc-6cc33e31c928 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:48.469469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23c1ad4d-e423-48c5-b1fc-6cc33e31c928 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:48.494733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23c1ad4d-e423-48c5-b1fc-6cc33e31c928 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:48.498413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23c1ad4d-e423-48c5-b1fc-6cc33e31c928 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:48.499092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23c1ad4d-e423-48c5-b1fc-6cc33e31c928 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:48.501098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23c1ad4d-e423-48c5-b1fc-6cc33e31c928 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:48.502664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23c1ad4d-e423-48c5-b1fc-6cc33e31c928 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:48.505775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23c1ad4d-e423-48c5-b1fc-6cc33e31c928 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:48.791147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-23c1ad4d-e423-48c5-b1fc-6cc33e31c928 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:48.802765 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23c1ad4d-e423-48c5-b1fc-6cc33e31c928 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1507 microversion: 2.1 time: 0.339040 Sep 10 20:58:48.820276 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1384/2845] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:48 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:48.828302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e44f5d9a-4d34-4353-a434-966d544dc1b8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:48.829241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e44f5d9a-4d34-4353-a434-966d544dc1b8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:48.839758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44f5d9a-4d34-4353-a434-966d544dc1b8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:48.840603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44f5d9a-4d34-4353-a434-966d544dc1b8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:48.840747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-69f470d0-85e6-445d-9548-fb85c75c5057 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:48.841440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-69f470d0-85e6-445d-9548-fb85c75c5057 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:48.841941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44f5d9a-4d34-4353-a434-966d544dc1b8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:48.842858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44f5d9a-4d34-4353-a434-966d544dc1b8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:48.844296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44f5d9a-4d34-4353-a434-966d544dc1b8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:48.845017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44f5d9a-4d34-4353-a434-966d544dc1b8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:48.854461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69f470d0-85e6-445d-9548-fb85c75c5057 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:48.856386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69f470d0-85e6-445d-9548-fb85c75c5057 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:48.857818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69f470d0-85e6-445d-9548-fb85c75c5057 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:48.859109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69f470d0-85e6-445d-9548-fb85c75c5057 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:48.861050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69f470d0-85e6-445d-9548-fb85c75c5057 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:48.863647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69f470d0-85e6-445d-9548-fb85c75c5057 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:49.067631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-69f470d0-85e6-445d-9548-fb85c75c5057 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:49.091975 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-69f470d0-85e6-445d-9548-fb85c75c5057 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1319 microversion: 2.1 time: 0.255761 Sep 10 20:58:49.093334 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1385/2846] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:48 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:49.104744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-58e1faeb-63ec-4df7-a461-25d096723d26 req-e21dc574-b14d-431d-a97f-64950b4b5305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af65c85f-8f25-4d07-bc16-637834210814", "name": "network-vif-plugged", "status": "completed", "tag": "9a0c1860-2a38-4b12-bd81-ee22500329c0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:49.121083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-58e1faeb-63ec-4df7-a461-25d096723d26 req-e21dc574-b14d-431d-a97f-64950b4b5305 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:49.122177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-58e1faeb-63ec-4df7-a461-25d096723d26 req-e21dc574-b14d-431d-a97f-64950b4b5305 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:49.127291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e44f5d9a-4d34-4353-a434-966d544dc1b8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:49.137548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-58e1faeb-63ec-4df7-a461-25d096723d26 req-e21dc574-b14d-431d-a97f-64950b4b5305 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:49.142779 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e44f5d9a-4d34-4353-a434-966d544dc1b8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1507 microversion: 2.1 time: 0.319586 Sep 10 20:58:49.147304 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1462/2847] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:48 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:49.175118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b10d670a-bc10-4f6f-b7fe-6eb3185943d6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:49.175640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b10d670a-bc10-4f6f-b7fe-6eb3185943d6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:49.182369 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-58e1faeb-63ec-4df7-a461-25d096723d26 req-e21dc574-b14d-431d-a97f-64950b4b5305 service nova] Creating event network-vif-plugged:9a0c1860-2a38-4b12-bd81-ee22500329c0 for instance af65c85f-8f25-4d07-bc16-637834210814 on nch2-master-1 Sep 10 20:58:49.188652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b10d670a-bc10-4f6f-b7fe-6eb3185943d6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:49.189157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b10d670a-bc10-4f6f-b7fe-6eb3185943d6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:49.192607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b10d670a-bc10-4f6f-b7fe-6eb3185943d6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:49.196211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b10d670a-bc10-4f6f-b7fe-6eb3185943d6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:49.197232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b10d670a-bc10-4f6f-b7fe-6eb3185943d6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:49.197767 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-58e1faeb-63ec-4df7-a461-25d096723d26 req-e21dc574-b14d-431d-a97f-64950b4b5305 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100444 Sep 10 20:58:49.198682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b10d670a-bc10-4f6f-b7fe-6eb3185943d6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:49.201680 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1386/2848] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:49.238975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b10d670a-bc10-4f6f-b7fe-6eb3185943d6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:58:49.352631 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b10d670a-bc10-4f6f-b7fe-6eb3185943d6 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "DELETE /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 204 len: 0 microversion: 2.1 time: 0.183170 Sep 10 20:58:49.353382 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1463/2849] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:49 2022] DELETE /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:49.368583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:49.369236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:49.377283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:49.377745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:49.379525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:49.381192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:49.381908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:49.382970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:49.419481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:58:49.483996 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.compute.api [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Instance is already in deleting state, ignoring this request Sep 10 20:58:49.484858 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3879091b-8b7f-4600-af60-39e47cd460fc tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "DELETE /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 204 len: 0 microversion: 2.1 time: 0.122065 Sep 10 20:58:49.485703 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1387/2850] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:49 2022] DELETE /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:49.504919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a148e24-bcca-40f3-9795-f70d7262687f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:49.505920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3a148e24-bcca-40f3-9795-f70d7262687f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:49.514495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a148e24-bcca-40f3-9795-f70d7262687f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:49.515089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a148e24-bcca-40f3-9795-f70d7262687f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:49.515589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a148e24-bcca-40f3-9795-f70d7262687f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:49.516358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a148e24-bcca-40f3-9795-f70d7262687f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:49.516989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a148e24-bcca-40f3-9795-f70d7262687f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:49.517578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a148e24-bcca-40f3-9795-f70d7262687f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:49.682437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a148e24-bcca-40f3-9795-f70d7262687f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:49.686146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:49.691676 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3a148e24-bcca-40f3-9795-f70d7262687f tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1513 microversion: 2.1 time: 0.202003 Sep 10 20:58:49.692262 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1388/2851] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:49 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:49.714513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7ca7cbc-ddbb-4916-8391-3a2a67fcbfbe tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Action: 'create', calling method: .version_select at 0x7f9944095820>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVz6TPNKP95QzEigGOYo2FaPBXspAPPFyoOyDsyaMJw7+MupjM+Dd3s0lYDHVyXzRkDyS0mPd7UFm0u4jW/eHJeVw/11PYmegP5JuGhctC5HWxZRcUtiEQmd+4DeMt0qQ=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:49.715067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a404fdb-4867-4ac2-a2f5-34e06afc036c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944453790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7ca7cbc-ddbb-4916-8391-3a2a67fcbfbe tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Request method failure captured: Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 257 Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqJ6vOX9U_gELVpfWS0lj3rj8zO9D4GMFSIEpaUuAprsogQx3jbdZFvS4UHimHg07re4sGUJy4ZeHrOEkoda_nEtXCCsuhqvVWC-6VyhXa63cHbEtPkxXVck0k_asbB28DR99HMgaXAxN-C_E2aY-51455VlDAFBg5ZtsCgQI2cULY Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9168d775bc9e4e3590b90d4625983a2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9168d775bc9e4e3590b90d4625983a2f"}]}] Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVz6TPNKP95QzEigGOYo2FaPBXspAPPFyoOyDsyaMJw7+MupjM+Dd3s0lYDHVyXzRkDyS0mPd7UFm0u4jW/eHJeVw/11PYmegP5JuGhctC5HWxZRcUtiEQmd+4DeMt0qQ=="}} Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVz6TPNKP95QzEigGOYo2FaPBXspAPPFyoOyDsyaMJw7+MupjM+Dd3s0lYDHVyXzRkDyS0mPd7UFm0u4jW/eHJeVw/11PYmegP5JuGhctC5HWxZRcUtiEQmd+4DeMt0qQ=='}}} Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 10 20:58:49.718139 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7ca7cbc-ddbb-4916-8391-3a2a67fcbfbe tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:49.721782 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f7ca7cbc-ddbb-4916-8391-3a2a67fcbfbe tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.356890 Sep 10 20:58:49.724739 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1464/2852] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:58:49 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 360 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:58:49.732872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fb3f0129-a4e4-41ad-8cc9-bf97cc2195b6 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Action: 'create', calling method: .version_select at 0x7f993fff34c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1924652976", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:49.751464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-fb3f0129-a4e4-41ad-8cc9-bf97cc2195b6 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Getting quotas for project 9168d775bc9e4e3590b90d4625983a2f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:49.758017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-fb3f0129-a4e4-41ad-8cc9-bf97cc2195b6 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Getting quotas for user a7df05f8c4f449b3b634b6bb2181e9ed and project 9168d775bc9e4e3590b90d4625983a2f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:49.774346 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3a404fdb-4867-4ac2-a2f5-34e06afc036c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/eb7fa6c6-3c93-43ba-97c1-1cfcdfd1b99e" status: 200 len: 661 microversion: 2.1 time: 0.067101 Sep 10 20:58:49.784618 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-fb3f0129-a4e4-41ad-8cc9-bf97cc2195b6 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:49.784804 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1389/2853] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:49 2022] GET /compute/v2.1/images/eb7fa6c6-3c93-43ba-97c1-1cfcdfd1b99e => generated 661 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:49.790863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-44c10822-4841-4103-8dff-93033f0aa8cb tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f994425f9d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fb3f0129-a4e4-41ad-8cc9-bf97cc2195b6 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Request method failure captured: Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 2167 Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqJ6vOX9U_gELVpfWS0lj3rj8zO9D4GMFSIEpaUuAprsogQx3jbdZFvS4UHimHg07re4sGUJy4ZeHrOEkoda_nEtXCCsuhqvVWC-6VyhXa63cHbEtPkxXVck0k_asbB28DR99HMgaXAxN-C_E2aY-51455VlDAFBg5ZtsCgQI2cULY Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9168d775bc9e4e3590b90d4625983a2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9168d775bc9e4e3590b90d4625983a2f"}]}] Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1924652976", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:58:49.809734 ncdv-master-1 devstack@n-api.service[145772]: exception: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1924652976', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:49.812055 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fb3f0129-a4e4-41ad-8cc9-bf97cc2195b6 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fb3f0129-a4e4-41ad-8cc9-bf97cc2195b6 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.084446 Sep 10 20:58:49.821805 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1465/2854] 10.222.0.33 () {60 vars in 1160 bytes} [Sat Sep 10 20:58:49 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:58:49.828818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b6049348-e86b-4ba2-8942-60831cee5427 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Action: 'create', calling method: .version_select at 0x7f99440d6e50>, body: {"keypair": {"name": "tempest-keypair-2120137262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOkEpgb7ukKM5mrvvaZgwvzznd1JZpOkYLovibKHIb9Ldve1FPtRF4zgsWcYRcXubACi08HxUP5+xiOnvz+wJbu9kiKOrXdiJdklCEtWQLpSJ0tCrbPsaSJzkPRpYi0bA=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:49.852682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-b6049348-e86b-4ba2-8942-60831cee5427 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Getting quotas for project 9168d775bc9e4e3590b90d4625983a2f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:49.857939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-b6049348-e86b-4ba2-8942-60831cee5427 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Getting quotas for user a7df05f8c4f449b3b634b6bb2181e9ed and project 9168d775bc9e4e3590b90d4625983a2f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:49.859329 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-44c10822-4841-4103-8dff-93033f0aa8cb tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/eb7fa6c6-3c93-43ba-97c1-1cfcdfd1b99e" status: 200 len: 661 microversion: 2.1 time: 0.073210 Sep 10 20:58:49.884995 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1390/2855] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:49 2022] GET /compute/v2.1/images/eb7fa6c6-3c93-43ba-97c1-1cfcdfd1b99e => generated 661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:49.888527 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b6049348-e86b-4ba2-8942-60831cee5427 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066494 Sep 10 20:58:49.898830 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1466/2856] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:58:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:49.905669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c7e26ac-9e64-4fc8-b45b-6e548222dc47 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Action: 'create', calling method: .version_select at 0x7f994425f3a0>, body: {"keypair": {"name": "tempest-keypair-2120137262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnAkayH/Syp2GSQ5HZ7YAaxdIPRGZRj0BfUDJSgfUhdQGdmdshTIOXvU3xaZeTo+VrxbxFA6p/R/ujzkHQBp9YNdn8d5L6tUZUz8RFQdxMYIQ2AN1U+9L81zgSw2bjvNQ=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:49.923776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-4c7e26ac-9e64-4fc8-b45b-6e548222dc47 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Getting quotas for project 9168d775bc9e4e3590b90d4625983a2f. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:49.929568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-4c7e26ac-9e64-4fc8-b45b-6e548222dc47 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Getting quotas for user a7df05f8c4f449b3b634b6bb2181e9ed and project 9168d775bc9e4e3590b90d4625983a2f. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:49.967833 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-4c7e26ac-9e64-4fc8-b45b-6e548222dc47 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] HTTP exception thrown: Key pair 'tempest-keypair-2120137262' already exists. Sep 10 20:58:49.970849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ff855e4-4a3e-469d-a719-5249729925bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1689029055", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f49a292f-21c3-46bd-bef6-846f5d81fae2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c7e26ac-9e64-4fc8-b45b-6e548222dc47 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Request method failure captured: Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 273 Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqJ6vOX9U_gELVpfWS0lj3rj8zO9D4GMFSIEpaUuAprsogQx3jbdZFvS4UHimHg07re4sGUJy4ZeHrOEkoda_nEtXCCsuhqvVWC-6VyhXa63cHbEtPkxXVck0k_asbB28DR99HMgaXAxN-C_E2aY-51455VlDAFBg5ZtsCgQI2cULY Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9168d775bc9e4e3590b90d4625983a2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9168d775bc9e4e3590b90d4625983a2f"}]}] Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: {"keypair": {"name": "tempest-keypair-2120137262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnAkayH/Syp2GSQ5HZ7YAaxdIPRGZRj0BfUDJSgfUhdQGdmdshTIOXvU3xaZeTo+VrxbxFA6p/R/ujzkHQBp9YNdn8d5L6tUZUz8RFQdxMYIQ2AN1U+9L81zgSw2bjvNQ=="}} Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: exception: Key pair 'tempest-keypair-2120137262' already exists. Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-2120137262', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnAkayH/Syp2GSQ5HZ7YAaxdIPRGZRj0BfUDJSgfUhdQGdmdshTIOXvU3xaZeTo+VrxbxFA6p/R/ujzkHQBp9YNdn8d5L6tUZUz8RFQdxMYIQ2AN1U+9L81zgSw2bjvNQ=='}}} Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result.read() Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'a7df05f8c4f449b3b634b6bb2181e9ed-tempest-keypair-2120137262' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 10 20:58:49.978871 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi session.flush() Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result.read() Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 20:58:49.983167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'a7df05f8c4f449b3b634b6bb2181e9ed-tempest-keypair-2120137262' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 10, 20, 58, 49, 947619), 'updated_at': None, 'name': 'tempest-keypair-2120137262', 'user_id': 'a7df05f8c4f449b3b634b6bb2181e9ed', 'fingerprint': 'cd:62:ad:e7:65:66:8c:93:6a:77:fc:66:c3:24:e4:30', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnAkayH/Syp2GSQ5HZ7YAaxdIPRGZRj0BfUDJSgfUhdQGdmdshTIOXvU3xaZeTo+VrxbxFA6p/R/ujzkHQBp9YNdn8d5L6tUZUz8RFQdxMYIQ2AN1U+9L81zgSw2bjvNQ==', 'type': 'ssh'}] Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi keypair.create() Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._create() Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-2120137262' already exists. Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 10 20:58:49.988406 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-2120137262' already exists. Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-2120137262' already exists. Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c7e26ac-9e64-4fc8-b45b-6e548222dc47 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Returning 409 to user: Key pair 'tempest-keypair-2120137262' already exists. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c7e26ac-9e64-4fc8-b45b-6e548222dc47 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.086983 Sep 10 20:58:49.995805 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1391/2857] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:58:49 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 20:58:49.997586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e04ea495-9917-4455-bc68-2ab9682bcb5d tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Calling method '.version_select at 0x7f994425faf0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:50.020214 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e04ea495-9917-4455-bc68-2ab9682bcb5d tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2120137262" status: 202 len: 0 microversion: 2.1 time: 0.026648 Sep 10 20:58:50.026038 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1392/2858] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 20:58:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2120137262 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 20:58:50.033549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6fd4b30b-618c-4db6-b176-0f5d1a755943 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Action: 'create', calling method: .version_select at 0x7f9944487af0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMEIvFUdVuXiuApgDNxEB8jH8Crydj1Vb+yu2IgVs5MOV4IFKKQwln96f5oxhX+yBO8vg7yjsA/Ba8j18Dpn+GkRJeZ5/3ys6Ho6NgChM9GNlTOFRM5MocQeGM6+7viXg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6fd4b30b-618c-4db6-b176-0f5d1a755943 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Request method failure captured: Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 247 Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqJ6vOX9U_gELVpfWS0lj3rj8zO9D4GMFSIEpaUuAprsogQx3jbdZFvS4UHimHg07re4sGUJy4ZeHrOEkoda_nEtXCCsuhqvVWC-6VyhXa63cHbEtPkxXVck0k_asbB28DR99HMgaXAxN-C_E2aY-51455VlDAFBg5ZtsCgQI2cULY Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9168d775bc9e4e3590b90d4625983a2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9168d775bc9e4e3590b90d4625983a2f"}]}] Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMEIvFUdVuXiuApgDNxEB8jH8Crydj1Vb+yu2IgVs5MOV4IFKKQwln96f5oxhX+yBO8vg7yjsA/Ba8j18Dpn+GkRJeZ5/3ys6Ho6NgChM9GNlTOFRM5MocQeGM6+7viXg=="}} Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMEIvFUdVuXiuApgDNxEB8jH8Crydj1Vb+yu2IgVs5MOV4IFKKQwln96f5oxhX+yBO8vg7yjsA/Ba8j18Dpn+GkRJeZ5/3ys6Ho6NgChM9GNlTOFRM5MocQeGM6+7viXg=='}}} Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi '' Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:58:50.037947 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6fd4b30b-618c-4db6-b176-0f5d1a755943 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6fd4b30b-618c-4db6-b176-0f5d1a755943 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010053 Sep 10 20:58:50.041708 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1393/2859] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:58:50 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 20:58:50.050160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-093197a8-e1bf-4d04-9fd0-9763b167e244 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Action: 'create', calling method: .version_select at 0x7f9949687ee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-122760956", "public_key": " "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:50.058012 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-6ff855e4-4a3e-469d-a719-5249729925bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Block Device f49a292f-21c3-46bd-bef6-846f5d81fae2 is not bootable. Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ff855e4-4a3e-469d-a719-5249729925bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 358 Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1689029055", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f49a292f-21c3-46bd-bef6-846f5d81fae2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: exception: Block Device f49a292f-21c3-46bd-bef6-846f5d81fae2 is not bootable. Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1689029055', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f49a292f-21c3-46bd-bef6-846f5d81fae2'}], 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f49a292f-21c3-46bd-bef6-846f5d81fae2 is not bootable. Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:50.066327 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f49a292f-21c3-46bd-bef6-846f5d81fae2 is not bootable. Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f49a292f-21c3-46bd-bef6-846f5d81fae2 is not bootable. Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.070860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ff855e4-4a3e-469d-a719-5249729925bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Block Device f49a292f-21c3-46bd-bef6-846f5d81fae2 is not bootable. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:50.074878 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ff855e4-4a3e-469d-a719-5249729925bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.113540 Sep 10 20:58:50.075166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-093197a8-e1bf-4d04-9fd0-9763b167e244 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Getting quotas for project 9168d775bc9e4e3590b90d4625983a2f. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:50.075487 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1467/2860] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:49 2022] POST /compute/v2.1/servers => generated 110 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:58:50.080763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-093197a8-e1bf-4d04-9fd0-9763b167e244 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Getting quotas for user a7df05f8c4f449b3b634b6bb2181e9ed and project 9168d775bc9e4e3590b90d4625983a2f. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:50.083169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:50.083599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3e6717d-29bb-4253-9297-11d0060aee93 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:50.084453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3e6717d-29bb-4253-9297-11d0060aee93 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:50.092311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3e6717d-29bb-4253-9297-11d0060aee93 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:50.092610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3e6717d-29bb-4253-9297-11d0060aee93 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:50.092782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3e6717d-29bb-4253-9297-11d0060aee93 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:50.093483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3e6717d-29bb-4253-9297-11d0060aee93 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:50.094144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3e6717d-29bb-4253-9297-11d0060aee93 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:50.094841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3e6717d-29bb-4253-9297-11d0060aee93 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:50.103631 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-093197a8-e1bf-4d04-9fd0-9763b167e244 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-093197a8-e1bf-4d04-9fd0-9763b167e244 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Request method failure captured: Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 94 Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqJ6vOX9U_gELVpfWS0lj3rj8zO9D4GMFSIEpaUuAprsogQx3jbdZFvS4UHimHg07re4sGUJy4ZeHrOEkoda_nEtXCCsuhqvVWC-6VyhXa63cHbEtPkxXVck0k_asbB28DR99HMgaXAxN-C_E2aY-51455VlDAFBg5ZtsCgQI2cULY Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9168d775bc9e4e3590b90d4625983a2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9168d775bc9e4e3590b90d4625983a2f"}]}] Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-122760956", "public_key": " "}} Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: exception: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-122760956', 'public_key': ' '}}} Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.107489 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-093197a8-e1bf-4d04-9fd0-9763b167e244 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-093197a8-e1bf-4d04-9fd0-9763b167e244 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.064116 Sep 10 20:58:50.120883 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1394/2861] 10.222.0.33 () {60 vars in 1158 bytes} [Sat Sep 10 20:58:50 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:58:50.125660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2031598b-3ff1-4936-8a6b-f92beb257106 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:50.125660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2031598b-3ff1-4936-8a6b-f92beb257106 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:50.129386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2031598b-3ff1-4936-8a6b-f92beb257106 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:50.130754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2031598b-3ff1-4936-8a6b-f92beb257106 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:50.131299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2031598b-3ff1-4936-8a6b-f92beb257106 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:50.132998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2031598b-3ff1-4936-8a6b-f92beb257106 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:50.134036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2031598b-3ff1-4936-8a6b-f92beb257106 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:50.134482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2031598b-3ff1-4936-8a6b-f92beb257106 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:50.240544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f3e6717d-29bb-4253-9297-11d0060aee93 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:50.248692 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3e6717d-29bb-4253-9297-11d0060aee93 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.168866 Sep 10 20:58:50.249613 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1468/2862] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:50 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:50.254351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-730d7499-2551-4773-942f-15250550d598 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Action: 'create', calling method: .version_select at 0x7f99440d6b80>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIex+KzI8VvywLip/gwziIRDTs+GDr7auQUcXayn6djUV1UziqyGgBRmITC70eMgMWx3xn3UFoJQgoOszTOFpbzZ16/1nvCncmktaFKXv/nzETMNH7o5clE2qnzD9Uezkw=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-730d7499-2551-4773-942f-15250550d598 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Request method failure captured: Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 507 Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqJ6vOX9U_gELVpfWS0lj3rj8zO9D4GMFSIEpaUuAprsogQx3jbdZFvS4UHimHg07re4sGUJy4ZeHrOEkoda_nEtXCCsuhqvVWC-6VyhXa63cHbEtPkxXVck0k_asbB28DR99HMgaXAxN-C_E2aY-51455VlDAFBg5ZtsCgQI2cULY Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9168d775bc9e4e3590b90d4625983a2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9168d775bc9e4e3590b90d4625983a2f"}]}] Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIex+KzI8VvywLip/gwziIRDTs+GDr7auQUcXayn6djUV1UziqyGgBRmITC70eMgMWx3xn3UFoJQgoOszTOFpbzZ16/1nvCncmktaFKXv/nzETMNH7o5clE2qnzD9Uezkw=="}} Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIex+KzI8VvywLip/gwziIRDTs+GDr7auQUcXayn6djUV1UziqyGgBRmITC70eMgMWx3xn3UFoJQgoOszTOFpbzZ16/1nvCncmktaFKXv/nzETMNH7o5clE2qnzD9Uezkw=='}}} Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 10 20:58:50.258759 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-730d7499-2551-4773-942f-15250550d598 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-730d7499-2551-4773-942f-15250550d598 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009488 Sep 10 20:58:50.261790 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1469/2863] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:58:50 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:58:50.273574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e419541-cb9a-470d-9d18-805a2f5d5142 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Action: 'create', calling method: .version_select at 0x7f993ff3f3a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1538627995", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:50.292295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3e419541-cb9a-470d-9d18-805a2f5d5142 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Getting quotas for project 9168d775bc9e4e3590b90d4625983a2f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:50.297538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3e419541-cb9a-470d-9d18-805a2f5d5142 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Getting quotas for user a7df05f8c4f449b3b634b6bb2181e9ed and project 9168d775bc9e4e3590b90d4625983a2f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:50.307817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:50.316067 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-3e419541-cb9a-470d-9d18-805a2f5d5142 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e419541-cb9a-470d-9d18-805a2f5d5142 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Request method failure captured: Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 118 Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqJ6vOX9U_gELVpfWS0lj3rj8zO9D4GMFSIEpaUuAprsogQx3jbdZFvS4UHimHg07re4sGUJy4ZeHrOEkoda_nEtXCCsuhqvVWC-6VyhXa63cHbEtPkxXVck0k_asbB28DR99HMgaXAxN-C_E2aY-51455VlDAFBg5ZtsCgQI2cULY Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9168d775bc9e4e3590b90d4625983a2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9168d775bc9e4e3590b90d4625983a2f"}]}] Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1538627995", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: exception: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1538627995', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 10 20:58:50.318703 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e419541-cb9a-470d-9d18-805a2f5d5142 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3e419541-cb9a-470d-9d18-805a2f5d5142 tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.052434 Sep 10 20:58:50.322634 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1470/2864] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 20:58:50 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 10 20:58:50.325938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f07ff482-b22c-4707-a183-da7a6744a760 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:50.326555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f07ff482-b22c-4707-a183-da7a6744a760 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:50.333596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f07ff482-b22c-4707-a183-da7a6744a760 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:50.334432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f07ff482-b22c-4707-a183-da7a6744a760 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:50.334876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f07ff482-b22c-4707-a183-da7a6744a760 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:50.335603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f07ff482-b22c-4707-a183-da7a6744a760 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:50.336228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f07ff482-b22c-4707-a183-da7a6744a760 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:50.336658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f07ff482-b22c-4707-a183-da7a6744a760 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:50.359878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2031598b-3ff1-4936-8a6b-f92beb257106 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:50.369546 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2031598b-3ff1-4936-8a6b-f92beb257106 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1319 microversion: 2.1 time: 0.256118 Sep 10 20:58:50.370053 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1395/2865] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:50 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:50.386433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-15158241-9892-46f3-82d6-93475695af1b tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Calling method '.version_select at 0x7f994425f3a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:50.399423 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-15158241-9892-46f3-82d6-93475695af1b tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1752013867 not found for user a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-15158241-9892-46f3-82d6-93475695af1b tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Request method failure captured: Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1752013867 HTTP/1.1 Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqJ6vOX9U_gELVpfWS0lj3rj8zO9D4GMFSIEpaUuAprsogQx3jbdZFvS4UHimHg07re4sGUJy4ZeHrOEkoda_nEtXCCsuhqvVWC-6VyhXa63cHbEtPkxXVck0k_asbB28DR99HMgaXAxN-C_E2aY-51455VlDAFBg5ZtsCgQI2cULY Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9168d775bc9e4e3590b90d4625983a2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9168d775bc9e4e3590b90d4625983a2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9168d775bc9e4e3590b90d4625983a2f"}]}] Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9168d775bc9e4e3590b90d4625983a2f Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1654130441 Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1654130441-project Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: exception: Keypair tempest-keypair-non-existent-1752013867 not found for user a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'tempest-keypair-non-existent-1752013867'} Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1752013867 not found for user a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.401297 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1752013867 not found for user a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1752013867 not found for user a7df05f8c4f449b3b634b6bb2181e9ed Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-15158241-9892-46f3-82d6-93475695af1b tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1752013867 not found for user a7df05f8c4f449b3b634b6bb2181e9ed {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-15158241-9892-46f3-82d6-93475695af1b tempest-KeyPairsNegativeTestJSON-1654130441 tempest-KeyPairsNegativeTestJSON-1654130441-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1752013867" status: 404 len: 145 microversion: 2.1 time: 0.031629 Sep 10 20:58:50.407552 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1396/2866] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 20:58:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1752013867 => generated 145 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:50.490206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f07ff482-b22c-4707-a183-da7a6744a760 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:50.500792 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f07ff482-b22c-4707-a183-da7a6744a760 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.178443 Sep 10 20:58:50.501573 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1471/2867] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:50 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:50.719317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-945ec8f1-5579-4afa-a3b7-9813fbe7ea22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:50.720516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-945ec8f1-5579-4afa-a3b7-9813fbe7ea22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:50.734582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-945ec8f1-5579-4afa-a3b7-9813fbe7ea22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:50.736397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-945ec8f1-5579-4afa-a3b7-9813fbe7ea22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:50.738459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-945ec8f1-5579-4afa-a3b7-9813fbe7ea22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:50.741109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-945ec8f1-5579-4afa-a3b7-9813fbe7ea22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:50.741854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-945ec8f1-5579-4afa-a3b7-9813fbe7ea22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:50.742658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-945ec8f1-5579-4afa-a3b7-9813fbe7ea22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:51.016279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-945ec8f1-5579-4afa-a3b7-9813fbe7ea22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:51.036982 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-945ec8f1-5579-4afa-a3b7-9813fbe7ea22 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1513 microversion: 2.1 time: 0.321295 Sep 10 20:58:51.040374 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1397/2868] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:50 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:51.392845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-130f6189-6c1a-4ed3-8a09-33f6ad3ef391 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:51.395297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-130f6189-6c1a-4ed3-8a09-33f6ad3ef391 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:51.406940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130f6189-6c1a-4ed3-8a09-33f6ad3ef391 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:51.412933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130f6189-6c1a-4ed3-8a09-33f6ad3ef391 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:51.413563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130f6189-6c1a-4ed3-8a09-33f6ad3ef391 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:51.418097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130f6189-6c1a-4ed3-8a09-33f6ad3ef391 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:51.419033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130f6189-6c1a-4ed3-8a09-33f6ad3ef391 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:51.419708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130f6189-6c1a-4ed3-8a09-33f6ad3ef391 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:51.592372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f37bb860-f81a-435b-8f88-4c71d9c7923f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944259790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:51.642968 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f37bb860-f81a-435b-8f88-4c71d9c7923f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/55bb66da-3ea7-4612-ab6c-31e0edffad2e" status: 200 len: 662 microversion: 2.1 time: 0.054348 Sep 10 20:58:51.644153 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1398/2869] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:51 2022] GET /compute/v2.1/images/55bb66da-3ea7-4612-ab6c-31e0edffad2e => generated 662 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:51.658562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-24972f4a-b3de-41ce-b2f4-17b66d4538d9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99441ece50>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:51.718592 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-24972f4a-b3de-41ce-b2f4-17b66d4538d9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/55bb66da-3ea7-4612-ab6c-31e0edffad2e" status: 200 len: 662 microversion: 2.1 time: 0.063875 Sep 10 20:58:51.720089 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1399/2870] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:51 2022] GET /compute/v2.1/images/55bb66da-3ea7-4612-ab6c-31e0edffad2e => generated 662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:58:51.730662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-130f6189-6c1a-4ed3-8a09-33f6ad3ef391 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:51.742111 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-130f6189-6c1a-4ed3-8a09-33f6ad3ef391 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1469 microversion: 2.1 time: 0.353269 Sep 10 20:58:51.742602 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1472/2871] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:51 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:51.766675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6a5374ca-8304-4cd5-837f-129f15f753d3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:51.767286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6a5374ca-8304-4cd5-837f-129f15f753d3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:51.777508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a5374ca-8304-4cd5-837f-129f15f753d3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:51.778850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a5374ca-8304-4cd5-837f-129f15f753d3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:51.779759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a5374ca-8304-4cd5-837f-129f15f753d3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:51.780941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a5374ca-8304-4cd5-837f-129f15f753d3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:51.781713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a5374ca-8304-4cd5-837f-129f15f753d3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:51.782349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a5374ca-8304-4cd5-837f-129f15f753d3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:51.997713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6a5374ca-8304-4cd5-837f-129f15f753d3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:52.009161 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6a5374ca-8304-4cd5-837f-129f15f753d3 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1319 microversion: 2.1 time: 0.248063 Sep 10 20:58:52.010160 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1400/2872] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:51 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:52.066213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-03023f76-abe8-4774-a31e-28bee57778d2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:52.066213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-03023f76-abe8-4774-a31e-28bee57778d2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:52.073102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03023f76-abe8-4774-a31e-28bee57778d2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:52.073640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03023f76-abe8-4774-a31e-28bee57778d2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:52.074230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03023f76-abe8-4774-a31e-28bee57778d2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:52.074939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03023f76-abe8-4774-a31e-28bee57778d2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:52.075398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03023f76-abe8-4774-a31e-28bee57778d2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:52.075825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03023f76-abe8-4774-a31e-28bee57778d2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:52.238440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-96b861f9-90f0-4868-9405-265b8dabcf97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-29110220", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "destination_type": "local"}, {"source_type": "volume", "uuid": "ed2d1a5d-a2d5-4b7d-af1d-9c4ff1baedfb", "destination_type": "invalid"}], "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-96b861f9-90f0-4868-9405-265b8dabcf97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 493 Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-29110220", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "destination_type": "local"}, {"source_type": "volume", "uuid": "ed2d1a5d-a2d5-4b7d-af1d-9c4ff1baedfb", "destination_type": "invalid"}], "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-29110220', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'ed2d1a5d-a2d5-4b7d-af1d-9c4ff1baedfb', 'destination_type': 'invalid'}], 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:52.245141 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 10 20:58:52.250791 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:52.255397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-96b861f9-90f0-4868-9405-265b8dabcf97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:52.256579 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-96b861f9-90f0-4868-9405-265b8dabcf97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.023778 Sep 10 20:58:52.257708 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1401/2873] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:52 2022] POST /compute/v2.1/servers => generated 155 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 20:58:52.270032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2154e527-ef14-4102-b769-cf3406fc8f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:52.271272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2154e527-ef14-4102-b769-cf3406fc8f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:52.286796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2154e527-ef14-4102-b769-cf3406fc8f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:52.286796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2154e527-ef14-4102-b769-cf3406fc8f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:52.286796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2154e527-ef14-4102-b769-cf3406fc8f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:52.287506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2154e527-ef14-4102-b769-cf3406fc8f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:52.288140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2154e527-ef14-4102-b769-cf3406fc8f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:52.288581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2154e527-ef14-4102-b769-cf3406fc8f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:52.498230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-03023f76-abe8-4774-a31e-28bee57778d2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:52.514740 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-03023f76-abe8-4774-a31e-28bee57778d2 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1513 microversion: 2.1 time: 0.454508 Sep 10 20:58:52.524964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2154e527-ef14-4102-b769-cf3406fc8f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:52.531922 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1473/2874] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:52 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1513 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:52.534595 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2154e527-ef14-4102-b769-cf3406fc8f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.272579 Sep 10 20:58:52.535809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1402/2875] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:52 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:52.562865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e4824c9b-20f6-4f6b-a6e4-81359c11df73 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:52.563473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e4824c9b-20f6-4f6b-a6e4-81359c11df73 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:52.581102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4824c9b-20f6-4f6b-a6e4-81359c11df73 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:52.583055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4824c9b-20f6-4f6b-a6e4-81359c11df73 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:52.585856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4824c9b-20f6-4f6b-a6e4-81359c11df73 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:52.586956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4824c9b-20f6-4f6b-a6e4-81359c11df73 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:52.589864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4824c9b-20f6-4f6b-a6e4-81359c11df73 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:52.591380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4824c9b-20f6-4f6b-a6e4-81359c11df73 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:52.719019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea045546-8595-4756-902d-9fc2259effda tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Action: 'create', calling method: .version_select at 0x7f993ff2bb80>, body: {"keypair": {"name": "tempest-keypair-1687821479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEgXim0MWNnlXVQ7Zyfypi/8YXMIvvkOZG5Q4epLuAyxSbhjs9L9J4bGyvnSTPpzzf8P6bXAE7zMR+g8nuVKaSjlssaYf9K/P6qz9sodM4ZknpRi+4HA4xk7zUPpIUM8w=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:52.736365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-ea045546-8595-4756-902d-9fc2259effda tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:52.743295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-ea045546-8595-4756-902d-9fc2259effda tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for user 438a1255ba0946edb1c3140b1fdcf913 and project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:52.773440 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea045546-8595-4756-902d-9fc2259effda tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.240111 Sep 10 20:58:52.774246 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1474/2876] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Sep 10 20:58:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 242 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 20:58:52.785527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1bc714f9-6cda-4fc5-a056-b22807d545f6 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f993ff1a550>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:52.796453 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1bc714f9-6cda-4fc5-a056-b22807d545f6 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1687821479" status: 200 len: 513 microversion: 2.2 time: 0.014714 Sep 10 20:58:52.797212 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1475/2877] 10.222.0.33 () {60 vars in 1258 bytes} [Sat Sep 10 20:58:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1687821479 => generated 513 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 20:58:52.809820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da225b33-2ba4-4987-b39b-dfc6e221865f tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f993ff82af0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:52.836506 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da225b33-2ba4-4987-b39b-dfc6e221865f tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687821479" status: 204 len: 0 microversion: 2.2 time: 0.030341 Sep 10 20:58:52.837256 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1476/2878] 10.222.0.33 () {60 vars in 1261 bytes} [Sat Sep 10 20:58:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687821479 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 20:58:52.850618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7c754a00-1cdc-4b89-a6fc-9f2c115b7cc3 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Action: 'create', calling method: .version_select at 0x7f993ff1ab80>, body: {"keypair": {"name": "tempest-keypair-1722926160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1x6KPNTNhYW40wNQ2M11EBmUbU6aDbwASOPaj/8VvvZxrRyxab3+VBHeHcp/d2Vr+L0lx0TCjUeVAMLW0eOa5ZP3WmAGL4Q7j13sFbhVAcaYS9ttrOXDNWvSFMwc3qoA=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:52.873462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e4824c9b-20f6-4f6b-a6e4-81359c11df73 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:52.891056 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e4824c9b-20f6-4f6b-a6e4-81359c11df73 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.331326 Sep 10 20:58:52.892835 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1403/2879] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:52 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:52.915270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-7c754a00-1cdc-4b89-a6fc-9f2c115b7cc3 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:52.933862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-7c754a00-1cdc-4b89-a6fc-9f2c115b7cc3 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for user 438a1255ba0946edb1c3140b1fdcf913 and project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:52.993023 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7c754a00-1cdc-4b89-a6fc-9f2c115b7cc3 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.146973 Sep 10 20:58:52.993961 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1477/2880] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Sep 10 20:58:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 10 20:58:53.008311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29592735-0e9e-42f0-bb2d-ca935219eaec tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f994425ff70>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:53.034266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-61e91b20-3f45-4534-9e39-10b930a7fed2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:53.035264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-61e91b20-3f45-4534-9e39-10b930a7fed2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:53.043641 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-29592735-0e9e-42f0-bb2d-ca935219eaec tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722926160" status: 204 len: 0 microversion: 2.2 time: 0.040104 Sep 10 20:58:53.049413 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1404/2881] 10.222.0.33 () {60 vars in 1261 bytes} [Sat Sep 10 20:58:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722926160 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:53.053428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e91b20-3f45-4534-9e39-10b930a7fed2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:53.055298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e91b20-3f45-4534-9e39-10b930a7fed2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:53.055755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e91b20-3f45-4534-9e39-10b930a7fed2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:53.056441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dad2a25d-507a-46f4-b606-841385176a15 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Action: 'create', calling method: .version_select at 0x7f99442208b0>, body: {"keypair": {"name": "tempest-keypair-1314542814", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:53.060616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e91b20-3f45-4534-9e39-10b930a7fed2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:53.061378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e91b20-3f45-4534-9e39-10b930a7fed2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:53.062193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61e91b20-3f45-4534-9e39-10b930a7fed2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:53.119348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-dad2a25d-507a-46f4-b606-841385176a15 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:53.142043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-dad2a25d-507a-46f4-b606-841385176a15 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for user 438a1255ba0946edb1c3140b1fdcf913 and project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:53.216601 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dad2a25d-507a-46f4-b606-841385176a15 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.164473 Sep 10 20:58:53.223621 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1405/2882] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Sep 10 20:58:53 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 20:58:53.234146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c20ef3d8-ce1f-44ca-a1c8-531aa9fe2f5f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2062755304", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c20ef3d8-ce1f-44ca-a1c8-531aa9fe2f5f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 492 Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2062755304", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2062755304', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:53.249345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 20:58:53.253003 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:53.255878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c20ef3d8-ce1f-44ca-a1c8-531aa9fe2f5f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:53.255878 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c20ef3d8-ce1f-44ca-a1c8-531aa9fe2f5f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.034513 Sep 10 20:58:53.266226 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1406/2883] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:53 2022] POST /compute/v2.1/servers => generated 624 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:58:53.281663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a0e7a847-d571-4a0d-b753-1536d0ca5876 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f9944259af0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:53.370551 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a0e7a847-d571-4a0d-b753-1536d0ca5876 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314542814" status: 204 len: 0 microversion: 2.2 time: 0.103132 Sep 10 20:58:53.378296 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1407/2884] 10.222.0.33 () {60 vars in 1261 bytes} [Sat Sep 10 20:58:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314542814 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:53.383794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c4d4044f-8cf8-4931-9fe4-a41251a04714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:53.384012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c4d4044f-8cf8-4931-9fe4-a41251a04714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:53.407797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4d4044f-8cf8-4931-9fe4-a41251a04714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:53.408971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4d4044f-8cf8-4931-9fe4-a41251a04714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:53.410346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4d4044f-8cf8-4931-9fe4-a41251a04714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:53.412011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4d4044f-8cf8-4931-9fe4-a41251a04714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:53.412683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4d4044f-8cf8-4931-9fe4-a41251a04714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:53.413721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4d4044f-8cf8-4931-9fe4-a41251a04714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:53.557269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-61e91b20-3f45-4534-9e39-10b930a7fed2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:53.574355 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-61e91b20-3f45-4534-9e39-10b930a7fed2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1319 microversion: 2.1 time: 0.546335 Sep 10 20:58:53.577416 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1478/2885] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:53 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:53.582307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4ccd4a0a-24f1-4264-abd6-c92435aab229 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Action: 'create', calling method: .version_select at 0x7f9944086280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-721971973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXjoPaB+q397WQ33FLPue6wlq5ioVpGDHZI+3nqkOFrv0tm1zZ/SQ2UdROCX1frT3WsHuZj60Tw051GWjVRQrbS0STKwpN9pyq1bIoliQMpYTma9GxAwasRVok7Q8nAbQ=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:53.658397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4ccd4a0a-24f1-4264-abd6-c92435aab229 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:53.675704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4ccd4a0a-24f1-4264-abd6-c92435aab229 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for user 438a1255ba0946edb1c3140b1fdcf913 and project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:53.713465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c4d4044f-8cf8-4931-9fe4-a41251a04714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:53.727808 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c4d4044f-8cf8-4931-9fe4-a41251a04714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.348227 Sep 10 20:58:53.728775 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1408/2886] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:53 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:53.759314 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4ccd4a0a-24f1-4264-abd6-c92435aab229 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.180679 Sep 10 20:58:53.766006 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1479/2887] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Sep 10 20:58:53 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 20:58:53.773228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:53.774072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:53.787142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:53.788741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:53.789198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:53.790146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:53.790833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:53.791615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:53.833005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:53.833734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:53.836065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:53.836630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lazy-loading 'fault' on Instance uuid 81f348be-b60c-442d-9352-4030c286cb0d {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:58:53.902722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a49b8dca-3bce-40a9-918c-3a706af96ca3 req-d1cce1fe-5f9b-47cb-b3ad-914c6a538492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f348be-b60c-442d-9352-4030c286cb0d", "name": "network-vif-deleted", "tag": "f3219068-e534-4daa-bfa3-338154c8be13"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:53.915050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a49b8dca-3bce-40a9-918c-3a706af96ca3 req-d1cce1fe-5f9b-47cb-b3ad-914c6a538492 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:53.927810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a49b8dca-3bce-40a9-918c-3a706af96ca3 req-d1cce1fe-5f9b-47cb-b3ad-914c6a538492 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:53.928319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a49b8dca-3bce-40a9-918c-3a706af96ca3 req-d1cce1fe-5f9b-47cb-b3ad-914c6a538492 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:53.938057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e0565f75c4f558a8936f547ae9d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14add960abe42f580aeeade3e6f27d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:53.951863 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a49b8dca-3bce-40a9-918c-3a706af96ca3 req-d1cce1fe-5f9b-47cb-b3ad-914c6a538492 service nova] Creating event network-vif-deleted:f3219068-e534-4daa-bfa3-338154c8be13 for instance 81f348be-b60c-442d-9352-4030c286cb0d on nch1-master-1 Sep 10 20:58:53.952048 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e7d3f593-eea1-46ef-bfc3-60f119f80cc8 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 200 len: 1308 microversion: 2.1 time: 0.184544 Sep 10 20:58:53.957358 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a49b8dca-3bce-40a9-918c-3a706af96ca3 req-d1cce1fe-5f9b-47cb-b3ad-914c6a538492 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227016 Sep 10 20:58:53.962638 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1409/2888] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:53.969447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-264d6ac9-cf89-4fd2-aef5-5037ef40a24d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:53.970219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-264d6ac9-cf89-4fd2-aef5-5037ef40a24d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:53.974166 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1480/2889] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:53 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:53.977918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-264d6ac9-cf89-4fd2-aef5-5037ef40a24d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:53.978668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-264d6ac9-cf89-4fd2-aef5-5037ef40a24d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:53.979323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-264d6ac9-cf89-4fd2-aef5-5037ef40a24d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:53.980850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-264d6ac9-cf89-4fd2-aef5-5037ef40a24d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:53.981514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-264d6ac9-cf89-4fd2-aef5-5037ef40a24d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:53.982201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-264d6ac9-cf89-4fd2-aef5-5037ef40a24d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:53.989024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-71e0a01a-86d6-4b77-aecf-60722524efa3 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Action: 'create', calling method: .version_select at 0x7f993ff82280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1460049079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKq6urPFvtx37r+EGlxSIfaf9zUXdMgQeR+QfaG5UQ/e8qAmmrYS5dHxzImEosRYrfsDeaN0INqckFctClXQfjc/sYVG1J/jXKZ/RdKica//VU2V1/uPKLBuPT2HEh5ekw=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:54.017197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-71e0a01a-86d6-4b77-aecf-60722524efa3 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:54.023342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-71e0a01a-86d6-4b77-aecf-60722524efa3 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for user 438a1255ba0946edb1c3140b1fdcf913 and project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:54.053171 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-71e0a01a-86d6-4b77-aecf-60722524efa3 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.076514 Sep 10 20:58:54.057992 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1481/2890] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Sep 10 20:58:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 20:58:54.069550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ee4d1c05-4803-41dd-822c-5ea5a2f1dbe9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440b1dc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:54.139319 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ee4d1c05-4803-41dd-822c-5ea5a2f1dbe9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/b24e3cc0-e842-4c7a-b844-dc5628012687" status: 200 len: 661 microversion: 2.1 time: 0.079401 Sep 10 20:58:54.151232 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1482/2891] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:54 2022] GET /compute/v2.1/images/b24e3cc0-e842-4c7a-b844-dc5628012687 => generated 661 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:54.157685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-032cd997-617b-4705-b103-7811fbde8172 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Action: 'create', calling method: .version_select at 0x7f993ff1ab80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1084959667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZJx02WDjDeu7qoGQ58yjnmA5Sbtba6OHcW6/Or/wkGHjplklZ3Wcn2d5m1PbUZHr6MX0RuK5rNSSpd/E4WEV09MrPF6u+H7gYS6oWddE70kx74nFnvfUjyfmHLSeEGJQ=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:54.187099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-032cd997-617b-4705-b103-7811fbde8172 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:54.197862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-032cd997-617b-4705-b103-7811fbde8172 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for user 438a1255ba0946edb1c3140b1fdcf913 and project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:54.211162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-264d6ac9-cf89-4fd2-aef5-5037ef40a24d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:54.222808 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-264d6ac9-cf89-4fd2-aef5-5037ef40a24d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.258127 Sep 10 20:58:54.224592 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1410/2892] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:53 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:54.243158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bb5973fc-3012-41e7-b90a-12ed84094e60 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99441a7af0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:54.258306 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-032cd997-617b-4705-b103-7811fbde8172 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.105093 Sep 10 20:58:54.259375 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1483/2893] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Sep 10 20:58:54 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 20:58:54.319656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d0ed3e0e-a585-49b6-b260-365297d01218 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f993ff82820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:54.341994 ncdv-master-1 devstack@n-api.service[145772]: WARNING oslo_db.sqlalchemy.utils [None req-d0ed3e0e-a585-49b6-b260-365297d01218 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 20:58:54.350320 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d0ed3e0e-a585-49b6-b260-365297d01218 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.069225 Sep 10 20:58:54.359737 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1484/2894] 10.222.0.33 () {60 vars in 1177 bytes} [Sat Sep 10 20:58:54 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:54.374345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-429aee68-f09e-4f9b-bd5c-c6c8f69b491f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:54.377512 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bb5973fc-3012-41e7-b90a-12ed84094e60 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/b24e3cc0-e842-4c7a-b844-dc5628012687" status: 200 len: 661 microversion: 2.1 time: 0.151434 Sep 10 20:58:54.378143 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1411/2895] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:58:54 2022] GET /compute/v2.1/images/b24e3cc0-e842-4c7a-b844-dc5628012687 => generated 661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:54.385802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27e97836-82f5-4c67-b7b2-c3e820cdfb35 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f99495b3430>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-429aee68-f09e-4f9b-bd5c-c6c8f69b491f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 416 Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:54.394353 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:58:54.398693 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:54.406445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-429aee68-f09e-4f9b-bd5c-c6c8f69b491f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:54.407759 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-429aee68-f09e-4f9b-bd5c-c6c8f69b491f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.037640 Sep 10 20:58:54.408388 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1485/2896] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:54 2022] POST /compute/v2.1/servers => generated 619 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:58:54.420209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-17e9fa1d-9ab3-4b27-a83e-b447b98f4879 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:54.420947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-17e9fa1d-9ab3-4b27-a83e-b447b98f4879 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:54.436491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e9fa1d-9ab3-4b27-a83e-b447b98f4879 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:54.437298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e9fa1d-9ab3-4b27-a83e-b447b98f4879 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:54.437818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e9fa1d-9ab3-4b27-a83e-b447b98f4879 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:54.438842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e9fa1d-9ab3-4b27-a83e-b447b98f4879 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:54.439505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e9fa1d-9ab3-4b27-a83e-b447b98f4879 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:54.440108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17e9fa1d-9ab3-4b27-a83e-b447b98f4879 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:54.444422 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27e97836-82f5-4c67-b7b2-c3e820cdfb35 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1084959667" status: 204 len: 0 microversion: 2.2 time: 0.061236 Sep 10 20:58:54.445059 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1412/2897] 10.222.0.33 () {60 vars in 1321 bytes} [Sat Sep 10 20:58:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1084959667 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:54.460928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bca43f09-9f6d-4f6f-9124-f7c0d79b4bea tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f99441ec670>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:54.529170 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bca43f09-9f6d-4f6f-9124-f7c0d79b4bea tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1460049079" status: 204 len: 0 microversion: 2.2 time: 0.078531 Sep 10 20:58:54.535313 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1413/2898] 10.222.0.33 () {60 vars in 1321 bytes} [Sat Sep 10 20:58:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1460049079 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:54.543661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ed9ae39-0f92-41a8-9029-c38e40b34bca tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f994425f040>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:54.603900 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ed9ae39-0f92-41a8-9029-c38e40b34bca tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-721971973" status: 204 len: 0 microversion: 2.2 time: 0.064747 Sep 10 20:58:54.604973 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1414/2899] 10.222.0.33 () {60 vars in 1318 bytes} [Sat Sep 10 20:58:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-721971973 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:54.612249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-78d7d892-5544-48e8-84ac-0e0a7f34b888 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:54.613564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-78d7d892-5544-48e8-84ac-0e0a7f34b888 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:54.627246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d7d892-5544-48e8-84ac-0e0a7f34b888 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:54.628071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d7d892-5544-48e8-84ac-0e0a7f34b888 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:54.628786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d7d892-5544-48e8-84ac-0e0a7f34b888 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:54.629612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d7d892-5544-48e8-84ac-0e0a7f34b888 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:54.630714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d7d892-5544-48e8-84ac-0e0a7f34b888 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:54.631319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78d7d892-5544-48e8-84ac-0e0a7f34b888 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:54.756867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-17e9fa1d-9ab3-4b27-a83e-b447b98f4879 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:54.773907 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-17e9fa1d-9ab3-4b27-a83e-b447b98f4879 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.359357 Sep 10 20:58:54.775495 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1486/2900] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:54 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:54.780350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-78d7d892-5544-48e8-84ac-0e0a7f34b888 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:54.781134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-060b9e28-ff35-484b-b9e8-926a1c842660 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Action: 'create', calling method: .version_select at 0x7f993ff82c10>, body: {"keypair": {"name": "tempest-keypair-1957727463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrVBuvDJg6USH2mfZ5ackQacrQLeASGAAMqpFuwsPqgbB/hUBjlEgxKGkm4NrYDDhnzZdswq/cPfJhldTyXpBBkQuKs7KdLP+63AdrK0rLmCw6O4NMtfI5PbVWIdPyMEA=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:54.790172 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-78d7d892-5544-48e8-84ac-0e0a7f34b888 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1319 microversion: 2.1 time: 0.183573 Sep 10 20:58:54.791259 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1415/2901] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:54 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:54.801424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1348749620", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:54.809247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-060b9e28-ff35-484b-b9e8-926a1c842660 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:54.821801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-060b9e28-ff35-484b-b9e8-926a1c842660 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for user 438a1255ba0946edb1c3140b1fdcf913 and project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:54.874727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:58:54.875948 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-060b9e28-ff35-484b-b9e8-926a1c842660 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.099164 Sep 10 20:58:54.876904 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1487/2902] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Sep 10 20:58:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 20:58:54.890183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7b4ae74f-3535-4415-9173-a64b628695fc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:54.890949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7b4ae74f-3535-4415-9173-a64b628695fc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:54.899490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4ae74f-3535-4415-9173-a64b628695fc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:54.900072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4ae74f-3535-4415-9173-a64b628695fc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:54.900576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4ae74f-3535-4415-9173-a64b628695fc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:54.901359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4ae74f-3535-4415-9173-a64b628695fc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:54.901915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4ae74f-3535-4415-9173-a64b628695fc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:54.902414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4ae74f-3535-4415-9173-a64b628695fc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:55.140627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:58:55.142984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:58:55.143670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:58:55.144315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:58:55.146674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:58:55.157138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:55.158139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:55.158747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:55.159725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:55.160524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:55.162090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:55.176720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7b4ae74f-3535-4415-9173-a64b628695fc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:55.182963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Getting quotas for project 9c091a483f8b466f89ea487d13fe422b. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:55.187736 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7b4ae74f-3535-4415-9173-a64b628695fc tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.301620 Sep 10 20:58:55.188576 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1488/2903] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:54 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:55.201987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Getting quotas for user 81ee4fa83ef649d0bdc273243cd717c4 and project 9c091a483f8b466f89ea487d13fe422b. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:55.222046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d19bf8e8-eaf0-4007-a6be-a5233f45d466 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f993ff1ab80>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:55.224786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:58:55.231392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:58:55.249610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d19bf8e8-eaf0-4007-a6be-a5233f45d466 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1957727463" status: 200 len: 513 microversion: 2.2 time: 0.044165 Sep 10 20:58:55.250251 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1489/2904] 10.222.0.33 () {60 vars in 1258 bytes} [Sat Sep 10 20:58:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1957727463 => generated 513 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:55.260563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:55.261200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 81f348be-b60c-442d-9352-4030c286cb0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:55.267919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:55.273547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:55.276761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:55.277268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:55.280322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:55.280690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:55.281192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:55.312035 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] HTTP exception thrown: Instance 81f348be-b60c-442d-9352-4030c286cb0d could not be found. Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Request method failure captured: Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d HTTP/1.1 Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPny4qLx0DmXxrq6x8weUTq8Lz3GKSP10Zdi9eCkj-RgqyHCLToOiPwrsfuNle1Sxgjdhtm8bt1GMw-4WAsErf-ghxmuixAceD0ADq-yeM_9CD0YtlBvKxLWWxYZgHCp31Suj1rcDPry4XWEsJJoCmY26xmrEHVamVH9SEgZ1lPD71s Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c14add960abe42f580aeeade3e6f27d9 Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c14add960abe42f580aeeade3e6f27d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c14add960abe42f580aeeade3e6f27d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c14add960abe42f580aeeade3e6f27d9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c14add960abe42f580aeeade3e6f27d9"}]}] Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c14add960abe42f580aeeade3e6f27d9 Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerDiskConfigTestJSON-1581581232-project Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4c3e0565f75c4f558a8936f547ae9d76 Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerDiskConfigTestJSON-1581581232-project Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 81f348be-b60c-442d-9352-4030c286cb0d could not be found. Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '81f348be-b60c-442d-9352-4030c286cb0d'} Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f348be-b60c-442d-9352-4030c286cb0d could not be found. Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f348be-b60c-442d-9352-4030c286cb0d could not be found. Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:55.314235 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.320034 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:55.320034 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:55.320034 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:55.320034 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:55.320034 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:55.320034 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f348be-b60c-442d-9352-4030c286cb0d could not be found. Sep 10 20:58:55.320034 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.320546 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-24df03ed-d820-4ddb-93c6-ddfbb6ac8f81 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524497 Sep 10 20:58:55.320546 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1416/2905] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:58:55.322858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Returning 404 to user: Instance 81f348be-b60c-442d-9352-4030c286cb0d could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:55.323421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5d7749d2-08ed-4c52-929b-19e90a758e1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-961611153", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": -1, "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:55.324197 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c2f3d2a9-5784-44e1-9f31-3ce11b3c08f7 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d" status: 404 len: 111 microversion: 2.1 time: 0.073021 Sep 10 20:58:55.328137 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1490/2906] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:55 2022] GET /compute/v2.1/servers/81f348be-b60c-442d-9352-4030c286cb0d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:55.336662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0548ee9a-af09-48ad-b5da-fd4314848a62 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f99440b1ee0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:55.345570 ncdv-master-1 devstack@n-api.service[145772]: WARNING oslo_db.sqlalchemy.utils [None req-0548ee9a-af09-48ad-b5da-fd4314848a62 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 20:58:55.373002 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0548ee9a-af09-48ad-b5da-fd4314848a62 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.043484 Sep 10 20:58:55.375474 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5d7749d2-08ed-4c52-929b-19e90a758e1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Flavor -1 could not be found. Sep 10 20:58:55.379635 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1491/2907] 10.222.0.33 () {60 vars in 1177 bytes} [Sat Sep 10 20:58:55 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5d7749d2-08ed-4c52-929b-19e90a758e1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 205 Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-961611153", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": -1, "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: exception: Flavor -1 could not be found. Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-961611153', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': -1, 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:55.382738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 10 20:58:55.387257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.388601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5d7749d2-08ed-4c52-929b-19e90a758e1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:55.388601 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5d7749d2-08ed-4c52-929b-19e90a758e1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.068993 Sep 10 20:58:55.389740 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1417/2908] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:55 2022] POST /compute/v2.1/servers => generated 73 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:58:55.396925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f47bcbbd-a1bd-40c8-9508-609007995f3f tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f99441ec5e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:55.401313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:55.403060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:55.422236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:55.425858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:55.428354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:55.431083 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f47bcbbd-a1bd-40c8-9508-609007995f3f tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1957727463" status: 204 len: 0 microversion: 2.2 time: 0.040270 Sep 10 20:58:55.431357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:55.431868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:55.432321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:55.433110 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1418/2909] 10.222.0.33 () {60 vars in 1261 bytes} [Sat Sep 10 20:58:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1957727463 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:55.439030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dc02afe2-9d8f-467f-90e3-3385bafae897 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:55.440061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dc02afe2-9d8f-467f-90e3-3385bafae897 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:55.449605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc02afe2-9d8f-467f-90e3-3385bafae897 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:55.450504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc02afe2-9d8f-467f-90e3-3385bafae897 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:55.451161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc02afe2-9d8f-467f-90e3-3385bafae897 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:55.452117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc02afe2-9d8f-467f-90e3-3385bafae897 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:55.452793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc02afe2-9d8f-467f-90e3-3385bafae897 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:55.453723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc02afe2-9d8f-467f-90e3-3385bafae897 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:55.488933 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] HTTP exception thrown: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Request method failure captured: Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec HTTP/1.1 Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPny4qLx0DmXxrq6x8weUTq8Lz3GKSP10Zdi9eCkj-RgqyHCLToOiPwrsfuNle1Sxgjdhtm8bt1GMw-4WAsErf-ghxmuixAceD0ADq-yeM_9CD0YtlBvKxLWWxYZgHCp31Suj1rcDPry4XWEsJJoCmY26xmrEHVamVH9SEgZ1lPD71s Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c14add960abe42f580aeeade3e6f27d9 Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c14add960abe42f580aeeade3e6f27d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c14add960abe42f580aeeade3e6f27d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c14add960abe42f580aeeade3e6f27d9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c14add960abe42f580aeeade3e6f27d9"}]}] Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c14add960abe42f580aeeade3e6f27d9 Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerDiskConfigTestJSON-1581581232-project Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4c3e0565f75c4f558a8936f547ae9d76 Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerDiskConfigTestJSON-1581581232-project Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '22ea8e27-9137-45f8-98c7-f4b1cc01c9ec'} Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:55.492796 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Returning 404 to user: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:55.497695 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8cc3b629-1813-4721-8e17-dea36bbe87b0 tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 404 len: 111 microversion: 2.1 time: 0.109175 Sep 10 20:58:55.502997 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1492/2910] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:55 2022] DELETE /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:55.523750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-934958590", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:55.675859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:58:55.742034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dc02afe2-9d8f-467f-90e3-3385bafae897 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:55.754491 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dc02afe2-9d8f-467f-90e3-3385bafae897 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.319875 Sep 10 20:58:55.757341 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1419/2911] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:55 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:55.769302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9cd8948a-1988-4f8b-a1f9-a9b3953e97d7 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Action: 'create', calling method: .version_select at 0x7f994425f160>, body: {"keypair": {"name": "tempest-keypair-355449719", "type": "x509"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:55.793542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-9cd8948a-1988-4f8b-a1f9-a9b3953e97d7 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:55.814563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-9cd8948a-1988-4f8b-a1f9-a9b3953e97d7 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for user 438a1255ba0946edb1c3140b1fdcf913 and project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:55.865558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.processutils [None req-9cd8948a-1988-4f8b-a1f9-a9b3953e97d7 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpmrpw1grq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmrpw1grq/temp.key -subj /CN=438a1255ba0946edb1c3140b1fdcf913 -extensions v3_req_client {{(pid=145771) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 10 20:58:56.257964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:58:56.258464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:58:56.258886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:58:56.259308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:58:56.259733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:58:56.272106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.276848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.278252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.280499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.280982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.281435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.292080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.processutils [None req-9cd8948a-1988-4f8b-a1f9-a9b3953e97d7 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpmrpw1grq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmrpw1grq/temp.key -subj /CN=438a1255ba0946edb1c3140b1fdcf913 -extensions v3_req_client" returned: 0 in 0.428s {{(pid=145771) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 10 20:58:56.294458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.processutils [None req-9cd8948a-1988-4f8b-a1f9-a9b3953e97d7 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpmrpw1grq/temp.key -password pass: {{(pid=145771) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 10 20:58:56.330988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Getting quotas for project 9c091a483f8b466f89ea487d13fe422b. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:56.339323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Getting quotas for user 81ee4fa83ef649d0bdc273243cd717c4 and project 9c091a483f8b466f89ea487d13fe422b. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:56.365378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.processutils [None req-9cd8948a-1988-4f8b-a1f9-a9b3953e97d7 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpmrpw1grq/temp.key -password pass:" returned: 0 in 0.070s {{(pid=145771) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 10 20:58:56.378852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:58:56.384127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:58:56.448557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-9cd8948a-1988-4f8b-a1f9-a9b3953e97d7 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:58:56.456054 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-87961e88-107e-4542-a642-0f7ce62f993f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946285 Sep 10 20:58:56.457294 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1493/2912] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:58:56.470566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:56.472360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:56.493382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.494439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.495098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.496183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.496860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.497508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.509372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-9cd8948a-1988-4f8b-a1f9-a9b3953e97d7 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Getting quotas for user 438a1255ba0946edb1c3140b1fdcf913 and project 69499769ca8d4da0aa350ce7e7735842. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:58:56.531192 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] HTTP exception thrown: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Request method failure captured: Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec HTTP/1.1 Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPny4qLx0DmXxrq6x8weUTq8Lz3GKSP10Zdi9eCkj-RgqyHCLToOiPwrsfuNle1Sxgjdhtm8bt1GMw-4WAsErf-ghxmuixAceD0ADq-yeM_9CD0YtlBvKxLWWxYZgHCp31Suj1rcDPry4XWEsJJoCmY26xmrEHVamVH9SEgZ1lPD71s Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c14add960abe42f580aeeade3e6f27d9 Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c14add960abe42f580aeeade3e6f27d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c14add960abe42f580aeeade3e6f27d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c14add960abe42f580aeeade3e6f27d9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c14add960abe42f580aeeade3e6f27d9"}]}] Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c14add960abe42f580aeeade3e6f27d9 Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerDiskConfigTestJSON-1581581232-project Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4c3e0565f75c4f558a8936f547ae9d76 Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerDiskConfigTestJSON-1581581232-project Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '22ea8e27-9137-45f8-98c7-f4b1cc01c9ec'} Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:56.537052 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:56.541197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:56.541197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:56.541197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:56.541197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:56.541197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:56.541197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. Sep 10 20:58:56.541197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:56.542587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:56.544295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Returning 404 to user: Instance 22ea8e27-9137-45f8-98c7-f4b1cc01c9ec could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:56.546107 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-30e5993a-e846-4698-8e98-7ecc32cb303c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec" status: 404 len: 111 microversion: 2.1 time: 0.082728 Sep 10 20:58:56.549949 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1494/2913] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:56 2022] GET /compute/v2.1/servers/22ea8e27-9137-45f8-98c7-f4b1cc01c9ec => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:56.565005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cc0a35e5-defb-4415-9e33-53d48d2146a3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:56.565939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cc0a35e5-defb-4415-9e33-53d48d2146a3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:56.571727 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9cd8948a-1988-4f8b-a1f9-a9b3953e97d7 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.809427 Sep 10 20:58:56.576597 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1420/2914] 10.222.0.33 () {62 vars in 1198 bytes} [Sat Sep 10 20:58:55 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 817 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:56.578525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc0a35e5-defb-4415-9e33-53d48d2146a3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.582363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc0a35e5-defb-4415-9e33-53d48d2146a3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.583158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc0a35e5-defb-4415-9e33-53d48d2146a3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.585648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc0a35e5-defb-4415-9e33-53d48d2146a3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.586429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc0a35e5-defb-4415-9e33-53d48d2146a3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.587192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc0a35e5-defb-4415-9e33-53d48d2146a3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.593598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-417dd5f1-1c09-4734-9242-020601a15f2f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:56.596433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-417dd5f1-1c09-4734-9242-020601a15f2f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:56.618331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-417dd5f1-1c09-4734-9242-020601a15f2f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.623692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-417dd5f1-1c09-4734-9242-020601a15f2f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.624275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-417dd5f1-1c09-4734-9242-020601a15f2f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.625478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-417dd5f1-1c09-4734-9242-020601a15f2f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.626609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-417dd5f1-1c09-4734-9242-020601a15f2f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.627075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-417dd5f1-1c09-4734-9242-020601a15f2f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.849405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-417dd5f1-1c09-4734-9242-020601a15f2f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:56.864955 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-417dd5f1-1c09-4734-9242-020601a15f2f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1319 microversion: 2.1 time: 0.284832 Sep 10 20:58:56.867318 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1421/2915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:56 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:56.867318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-4736c448-b0bf-4e2a-93b3-0618b55cdc06 req-fe23ec27-e567-4958-b517-31eeee5f36d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5295c29d-1e1a-4858-81b2-80ff782a328f", "name": "network-vif-plugged", "status": "completed", "tag": "cf4611af-9b8c-480b-b7fa-343204618b45"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:56.895354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4736c448-b0bf-4e2a-93b3-0618b55cdc06 req-fe23ec27-e567-4958-b517-31eeee5f36d3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.896552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4736c448-b0bf-4e2a-93b3-0618b55cdc06 req-fe23ec27-e567-4958-b517-31eeee5f36d3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.897007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4736c448-b0bf-4e2a-93b3-0618b55cdc06 req-fe23ec27-e567-4958-b517-31eeee5f36d3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.905799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cc0a35e5-defb-4415-9e33-53d48d2146a3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:56.916843 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-4736c448-b0bf-4e2a-93b3-0618b55cdc06 req-fe23ec27-e567-4958-b517-31eeee5f36d3 service nova] Creating event network-vif-plugged:cf4611af-9b8c-480b-b7fa-343204618b45 for instance 5295c29d-1e1a-4858-81b2-80ff782a328f on nch1-master-1 Sep 10 20:58:56.920430 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cc0a35e5-defb-4415-9e33-53d48d2146a3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.368425 Sep 10 20:58:56.921024 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1495/2916] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:56 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:56.922238 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-4736c448-b0bf-4e2a-93b3-0618b55cdc06 req-fe23ec27-e567-4958-b517-31eeee5f36d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053419 Sep 10 20:58:56.923141 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1422/2917] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:58:56.925912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-feaae213-2519-4c69-ac8a-bacd5beacb10 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:56.926521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-feaae213-2519-4c69-ac8a-bacd5beacb10 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:56.929333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:56.930502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:56.938427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.939181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.939844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.953092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:56.956647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:56.957404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:56.994479 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] HTTP exception thrown: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Request method failure captured: Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 HTTP/1.1 Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPny4qLx0DmXxrq6x8weUTq8Lz3GKSP10Zdi9eCkj-RgqyHCLToOiPwrsfuNle1Sxgjdhtm8bt1GMw-4WAsErf-ghxmuixAceD0ADq-yeM_9CD0YtlBvKxLWWxYZgHCp31Suj1rcDPry4XWEsJJoCmY26xmrEHVamVH9SEgZ1lPD71s Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c14add960abe42f580aeeade3e6f27d9 Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c14add960abe42f580aeeade3e6f27d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c14add960abe42f580aeeade3e6f27d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c14add960abe42f580aeeade3e6f27d9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c14add960abe42f580aeeade3e6f27d9"}]}] Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c14add960abe42f580aeeade3e6f27d9 Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerDiskConfigTestJSON-1581581232-project Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4c3e0565f75c4f558a8936f547ae9d76 Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerDiskConfigTestJSON-1581581232-project Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '6e202f7e-4e8a-49a1-a144-5754c6a2c005'} Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:56.997488 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. Sep 10 20:58:57.002104 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.005658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Returning 404 to user: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:57.007287 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-54665ad9-e1e4-4e10-92a2-48e17525212c tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 404 len: 111 microversion: 2.1 time: 0.082821 Sep 10 20:58:57.008433 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1423/2918] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:58:56 2022] DELETE /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:57.016371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c58ae39-8d5e-4652-a480-7d7a24974997 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f99495fc700>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:57.038836 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c58ae39-8d5e-4652-a480-7d7a24974997 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-355449719" status: 200 len: 1533 microversion: 2.2 time: 0.028583 Sep 10 20:58:57.049281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-feaae213-2519-4c69-ac8a-bacd5beacb10 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:57.050342 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1424/2919] 10.222.0.33 () {60 vars in 1255 bytes} [Sat Sep 10 20:58:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-355449719 => generated 1533 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:57.057693 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-feaae213-2519-4c69-ac8a-bacd5beacb10 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1217 microversion: 2.1 time: 0.135423 Sep 10 20:58:57.058141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:57.058322 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1496/2920] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:56 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:57.059414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] [instance: 6e202f7e-4e8a-49a1-a144-5754c6a2c005] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:57.063364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bec563b9-1bd3-4c71-a610-575f2f015c70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1879967350", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:57.067169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:57.068527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bec563b9-1bd3-4c71-a610-575f2f015c70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 173 Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1879967350", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1879967350', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi -1 Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:58:57.068908 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 10 20:58:57.072715 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.073591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:57.073591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:57.073591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:57.073591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:57.075619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bec563b9-1bd3-4c71-a610-575f2f015c70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:57.076712 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bec563b9-1bd3-4c71-a610-575f2f015c70 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.017271 Sep 10 20:58:57.077543 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1497/2921] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:57 2022] POST /compute/v2.1/servers => generated 145 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:58:57.082424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6b52677b-a385-436b-95a6-809acc11a442 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f993ff3f1f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:57.088479 ncdv-master-1 devstack@n-api.service[145772]: WARNING oslo_db.sqlalchemy.utils [None req-6b52677b-a385-436b-95a6-809acc11a442 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 20:58:57.094470 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6b52677b-a385-436b-95a6-809acc11a442 tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.015465 Sep 10 20:58:57.095619 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1498/2922] 10.222.0.33 () {60 vars in 1177 bytes} [Sat Sep 10 20:58:57 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:57.101099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ced8e555-31ee-4c55-bd2f-4b1aeb2f216a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:57.102089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ced8e555-31ee-4c55-bd2f-4b1aeb2f216a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:57.109037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced8e555-31ee-4c55-bd2f-4b1aeb2f216a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:57.109236 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] HTTP exception thrown: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. Sep 10 20:58:57.109908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced8e555-31ee-4c55-bd2f-4b1aeb2f216a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:57.110435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced8e555-31ee-4c55-bd2f-4b1aeb2f216a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Request method failure captured: Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 HTTP/1.1 Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPny4qLx0DmXxrq6x8weUTq8Lz3GKSP10Zdi9eCkj-RgqyHCLToOiPwrsfuNle1Sxgjdhtm8bt1GMw-4WAsErf-ghxmuixAceD0ADq-yeM_9CD0YtlBvKxLWWxYZgHCp31Suj1rcDPry4XWEsJJoCmY26xmrEHVamVH9SEgZ1lPD71s Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c14add960abe42f580aeeade3e6f27d9 Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c14add960abe42f580aeeade3e6f27d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c14add960abe42f580aeeade3e6f27d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c14add960abe42f580aeeade3e6f27d9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c14add960abe42f580aeeade3e6f27d9"}]}] Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c14add960abe42f580aeeade3e6f27d9 Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1581581232 Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerDiskConfigTestJSON-1581581232-project Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4c3e0565f75c4f558a8936f547ae9d76 Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerDiskConfigTestJSON-1581581232-project Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '6e202f7e-4e8a-49a1-a144-5754c6a2c005'} Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:57.110726 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.114995 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:57.114995 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:57.114995 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:57.114995 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:57.114995 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:57.114995 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. Sep 10 20:58:57.114995 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:57.114995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] Returning 404 to user: Instance 6e202f7e-4e8a-49a1-a144-5754c6a2c005 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:57.116485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced8e555-31ee-4c55-bd2f-4b1aeb2f216a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:57.116485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced8e555-31ee-4c55-bd2f-4b1aeb2f216a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:57.116777 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d93277f2-6255-49fa-aeb3-fc1e9c4528eb tempest-ServerDiskConfigTestJSON-1581581232 tempest-ServerDiskConfigTestJSON-1581581232-project] 10.222.0.33 "GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005" status: 404 len: 111 microversion: 2.1 time: 0.060315 Sep 10 20:58:57.116914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced8e555-31ee-4c55-bd2f-4b1aeb2f216a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:57.117051 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1425/2923] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:57 2022] GET /compute/v2.1/servers/6e202f7e-4e8a-49a1-a144-5754c6a2c005 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:58:57.118086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c77403b1-552d-4c8e-85f4-ae4a61abe2de tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] Calling method '.version_select at 0x7f994963ad30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:57.143990 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c77403b1-552d-4c8e-85f4-ae4a61abe2de tempest-KeyPairsV22TestJSON-630770537 tempest-KeyPairsV22TestJSON-630770537-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-355449719" status: 204 len: 0 microversion: 2.2 time: 0.030266 Sep 10 20:58:57.145213 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1426/2924] 10.222.0.33 () {60 vars in 1258 bytes} [Sat Sep 10 20:58:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-355449719 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:58:57.875393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ced8e555-31ee-4c55-bd2f-4b1aeb2f216a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:57.891293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-76144d4d-c402-42f5-9a32-ff6c6868a58c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:57.892643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-76144d4d-c402-42f5-9a32-ff6c6868a58c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:57.896929 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ced8e555-31ee-4c55-bd2f-4b1aeb2f216a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.792057 Sep 10 20:58:57.897546 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1499/2925] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:57 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:57.912873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76144d4d-c402-42f5-9a32-ff6c6868a58c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:57.916708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76144d4d-c402-42f5-9a32-ff6c6868a58c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:57.917483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76144d4d-c402-42f5-9a32-ff6c6868a58c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:57.920659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76144d4d-c402-42f5-9a32-ff6c6868a58c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:57.924940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76144d4d-c402-42f5-9a32-ff6c6868a58c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:57.925111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9bc764a9-f07b-4a2e-8ebe-fa6e8562a766 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:57.925655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9bc764a9-f07b-4a2e-8ebe-fa6e8562a766 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:57.926314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-76144d4d-c402-42f5-9a32-ff6c6868a58c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:57.938574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc764a9-f07b-4a2e-8ebe-fa6e8562a766 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:57.947018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc764a9-f07b-4a2e-8ebe-fa6e8562a766 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:57.947780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc764a9-f07b-4a2e-8ebe-fa6e8562a766 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:57.950661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc764a9-f07b-4a2e-8ebe-fa6e8562a766 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:57.952940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc764a9-f07b-4a2e-8ebe-fa6e8562a766 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:57.953638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bc764a9-f07b-4a2e-8ebe-fa6e8562a766 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:58.276635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-76144d4d-c402-42f5-9a32-ff6c6868a58c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:58.286414 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-76144d4d-c402-42f5-9a32-ff6c6868a58c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1319 microversion: 2.1 time: 0.399491 Sep 10 20:58:58.290655 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1427/2926] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:57 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:58.310930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-835d4fdc-b0d6-4b49-b5ed-7e01029ece1b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:58.318238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-835d4fdc-b0d6-4b49-b5ed-7e01029ece1b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:58.327104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-835d4fdc-b0d6-4b49-b5ed-7e01029ece1b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:58.327900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-835d4fdc-b0d6-4b49-b5ed-7e01029ece1b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:58.328712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-835d4fdc-b0d6-4b49-b5ed-7e01029ece1b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:58.329643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-835d4fdc-b0d6-4b49-b5ed-7e01029ece1b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:58.330404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-835d4fdc-b0d6-4b49-b5ed-7e01029ece1b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:58.331073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-835d4fdc-b0d6-4b49-b5ed-7e01029ece1b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:58.452418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-835d4fdc-b0d6-4b49-b5ed-7e01029ece1b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:58.461898 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-835d4fdc-b0d6-4b49-b5ed-7e01029ece1b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1269 microversion: 2.1 time: 0.154812 Sep 10 20:58:58.462761 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1428/2927] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:58 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:58.463823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9bc764a9-f07b-4a2e-8ebe-fa6e8562a766 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:58.479172 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9bc764a9-f07b-4a2e-8ebe-fa6e8562a766 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.556791 Sep 10 20:58:58.480947 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1500/2928] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:57 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:58.611699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e0f69367-6870-4a01-ab18-8661c8000d42 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1946902010", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:58.617638 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-e0f69367-6870-4a01-ab18-8661c8000d42 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e0f69367-6870-4a01-ab18-8661c8000d42 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 216 Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1946902010", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1946902010', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:58.619869 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:58:58.624006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:58.624006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:58:58.624006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:58:58.624006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:58:58.624006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:58:58.624006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:58:58.624006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 20:58:58.624006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:58:58.625806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e0f69367-6870-4a01-ab18-8661c8000d42 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:58:58.626965 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e0f69367-6870-4a01-ab18-8661c8000d42 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.019420 Sep 10 20:58:58.631433 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1429/2929] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:58 2022] POST /compute/v2.1/servers => generated 123 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:58:58.636996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-48781131-47ca-40fa-8af7-e2676a8494de tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:58.637730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-48781131-47ca-40fa-8af7-e2676a8494de tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:58.650741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48781131-47ca-40fa-8af7-e2676a8494de tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:58.651530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48781131-47ca-40fa-8af7-e2676a8494de tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:58.652331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48781131-47ca-40fa-8af7-e2676a8494de tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:58.653697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48781131-47ca-40fa-8af7-e2676a8494de tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:58.654383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48781131-47ca-40fa-8af7-e2676a8494de tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:58.655028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48781131-47ca-40fa-8af7-e2676a8494de tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:58.677461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:58:59.058821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-48781131-47ca-40fa-8af7-e2676a8494de tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:59.073457 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-48781131-47ca-40fa-8af7-e2676a8494de tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.440794 Sep 10 20:58:59.077405 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1501/2930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:58 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:58:59.101553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e4d790c-0ff6-4eab-b628-71151a58d50a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:59.104102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e4d790c-0ff6-4eab-b628-71151a58d50a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:59.110967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e4d790c-0ff6-4eab-b628-71151a58d50a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:59.111774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e4d790c-0ff6-4eab-b628-71151a58d50a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:59.112318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e4d790c-0ff6-4eab-b628-71151a58d50a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:59.113421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e4d790c-0ff6-4eab-b628-71151a58d50a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:59.113986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e4d790c-0ff6-4eab-b628-71151a58d50a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:59.114551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e4d790c-0ff6-4eab-b628-71151a58d50a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:59.314015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92b17688-fda2-477a-99c1-7177753abdea tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:59.314633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-92b17688-fda2-477a-99c1-7177753abdea tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:59.324191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92b17688-fda2-477a-99c1-7177753abdea tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:59.326463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92b17688-fda2-477a-99c1-7177753abdea tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:59.326977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92b17688-fda2-477a-99c1-7177753abdea tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:59.327699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92b17688-fda2-477a-99c1-7177753abdea tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:59.328153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92b17688-fda2-477a-99c1-7177753abdea tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:59.335362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92b17688-fda2-477a-99c1-7177753abdea tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:59.530576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e4d790c-0ff6-4eab-b628-71151a58d50a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:59.545024 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e4d790c-0ff6-4eab-b628-71151a58d50a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.447017 Sep 10 20:58:59.549287 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1430/2931] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:59 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:59.575295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f6192e5a-5678-4a99-a6f6-0e17ba8a6fed tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:59.579261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f6192e5a-5678-4a99-a6f6-0e17ba8a6fed tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:58:59.613267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6192e5a-5678-4a99-a6f6-0e17ba8a6fed tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:59.621019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6192e5a-5678-4a99-a6f6-0e17ba8a6fed tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:59.622441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6192e5a-5678-4a99-a6f6-0e17ba8a6fed tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:59.623742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6192e5a-5678-4a99-a6f6-0e17ba8a6fed tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:59.625786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6192e5a-5678-4a99-a6f6-0e17ba8a6fed tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:59.627938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6192e5a-5678-4a99-a6f6-0e17ba8a6fed tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:59.861471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f6192e5a-5678-4a99-a6f6-0e17ba8a6fed tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:59.874288 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f6192e5a-5678-4a99-a6f6-0e17ba8a6fed tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1275 microversion: 2.1 time: 0.321418 Sep 10 20:58:59.876122 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1431/2932] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:59 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:59.887081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0820d260-10ce-4332-bbac-b5c661dd600a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-485131531", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "key_name": "tempest-key-800373504", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:58:59.909567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-92b17688-fda2-477a-99c1-7177753abdea tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:59.927467 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-92b17688-fda2-477a-99c1-7177753abdea tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1468 microversion: 2.1 time: 0.615993 Sep 10 20:58:59.929970 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1502/2933] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:58:59 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1468 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:58:59.961496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:58:59.968389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:58:59.969894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Searching by: {'reservation_id': 'r-ausi9afv', 'deleted': False, 'project_id': 'd30ef9b7525e4784be26268f46121e62'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:58:59.981902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:59.982592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:59.983136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:58:59.984000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:58:59.984633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:58:59.985178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:00.017570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-0820d260-10ce-4332-bbac-b5c661dd600a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] validate_networks() for [('02a59e8f-361e-4af8-bf69-eada4df89fa4', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:59:00.131741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:59:00.230874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:00.240667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:00.241167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:00.241679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:00.838803 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e06e93a-f976-4037-ad36-7f1675601e23 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-ausi9afv" status: 200 len: 2930 microversion: 2.1 time: 0.885861 Sep 10 20:59:00.840089 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1503/2934] 10.222.0.33 () {58 vars in 1197 bytes} [Sat Sep 10 20:58:59 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ausi9afv => generated 2930 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:01.183747 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-0820d260-10ce-4332-bbac-b5c661dd600a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Invalid key_name provided. Sep 10 20:59:01.184264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1248718077", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "1cd195d4-857f-42a6-b181-30998baed10d"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0820d260-10ce-4332-bbac-b5c661dd600a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 245 Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-485131531", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "key_name": "tempest-key-800373504", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid key_name provided. Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-485131531', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'key_name': 'tempest-key-800373504', 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-800373504 not found for user 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:01.185629 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0820d260-10ce-4332-bbac-b5c661dd600a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid key_name provided. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0820d260-10ce-4332-bbac-b5c661dd600a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.307158 Sep 10 20:59:01.189850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1432/2935] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:58:59 2022] POST /compute/v2.1/servers => generated 70 bytes in 1311 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 20:59:01.198365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fec6c9ec-763f-4163-8953-6a88ac4d2302 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:01.236735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.compute.server_groups [None req-fec6c9ec-763f-4163-8953-6a88ac4d2302 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Querying cell 2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) for 2 instances {{(pid=145771) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 20:59:01.237472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fec6c9ec-763f-4163-8953-6a88ac4d2302 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:01.240688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fec6c9ec-763f-4163-8953-6a88ac4d2302 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:01.243141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fec6c9ec-763f-4163-8953-6a88ac4d2302 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:01.293107 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fec6c9ec-763f-4163-8953-6a88ac4d2302 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/242ea9e9-4cd4-4f66-85d6-2ff28dd2d775" status: 200 len: 271 microversion: 2.1 time: 0.104434 Sep 10 20:59:01.294002 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1433/2936] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 20:59:01 2022] GET /compute/v2.1/os-server-groups/242ea9e9-4cd4-4f66-85d6-2ff28dd2d775 => generated 271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:01.300625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a59f5d6d-781e-462c-ab98-61df9114809f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:01.305427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a59f5d6d-781e-462c-ab98-61df9114809f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:01.315892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] validate_networks() for [('1cd195d4-857f-42a6-b181-30998baed10d', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:59:01.322237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59f5d6d-781e-462c-ab98-61df9114809f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:01.322748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59f5d6d-781e-462c-ab98-61df9114809f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:01.323192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59f5d6d-781e-462c-ab98-61df9114809f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:01.323906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59f5d6d-781e-462c-ab98-61df9114809f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:01.324361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59f5d6d-781e-462c-ab98-61df9114809f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:01.324787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59f5d6d-781e-462c-ab98-61df9114809f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:01.329444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:01.433679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a59f5d6d-781e-462c-ab98-61df9114809f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:01.452310 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a59f5d6d-781e-462c-ab98-61df9114809f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1275 microversion: 2.1 time: 0.157069 Sep 10 20:59:01.452927 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1434/2937] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:01 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:01.461099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-292015cb-ff7f-4d59-af00-cd4a907d8658 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:01.462018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-292015cb-ff7f-4d59-af00-cd4a907d8658 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:01.474478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292015cb-ff7f-4d59-af00-cd4a907d8658 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:01.475117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292015cb-ff7f-4d59-af00-cd4a907d8658 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:01.475559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292015cb-ff7f-4d59-af00-cd4a907d8658 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:01.476493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292015cb-ff7f-4d59-af00-cd4a907d8658 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:01.477707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292015cb-ff7f-4d59-af00-cd4a907d8658 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:01.478808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292015cb-ff7f-4d59-af00-cd4a907d8658 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:02.119371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-292015cb-ff7f-4d59-af00-cd4a907d8658 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:02.134408 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-292015cb-ff7f-4d59-af00-cd4a907d8658 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.680022 Sep 10 20:59:02.170619 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1435/2938] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:01 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:02.181338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cb38004b-c1a4-4ba0-8688-194f2799cc6d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:02.182047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cb38004b-c1a4-4ba0-8688-194f2799cc6d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:02.197310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb38004b-c1a4-4ba0-8688-194f2799cc6d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:02.197977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb38004b-c1a4-4ba0-8688-194f2799cc6d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:02.199932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb38004b-c1a4-4ba0-8688-194f2799cc6d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:02.200689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb38004b-c1a4-4ba0-8688-194f2799cc6d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:02.203363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb38004b-c1a4-4ba0-8688-194f2799cc6d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:02.204710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb38004b-c1a4-4ba0-8688-194f2799cc6d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:02.648163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:59:02.648754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:59:02.649964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:59:02.650503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:59:02.651039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:59:02.670354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:02.671262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:02.672602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:02.674638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:02.675581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:02.676960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:02.703250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Getting quotas for project cebec33205424ecf92b54428bdf5eb61. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:59:02.710136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Getting quotas for user ae0c7612d933424597e1f176be189a0b and project cebec33205424ecf92b54428bdf5eb61. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:59:02.732236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:59:02.735973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:59:02.827869 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e88cdeae-4e59-4262-9edb-fcdad19e5f7e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.986298 Sep 10 20:59:02.830547 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1504/2939] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:59:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:59:02.842739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7c072075-5903-4dd3-985d-ba30de4addf0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:02.843402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7c072075-5903-4dd3-985d-ba30de4addf0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:02.855027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c072075-5903-4dd3-985d-ba30de4addf0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:02.855686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c072075-5903-4dd3-985d-ba30de4addf0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:02.857091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c072075-5903-4dd3-985d-ba30de4addf0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:02.857968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c072075-5903-4dd3-985d-ba30de4addf0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:02.858452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c072075-5903-4dd3-985d-ba30de4addf0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:02.858898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c072075-5903-4dd3-985d-ba30de4addf0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:03.133079 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cb38004b-c1a4-4ba0-8688-194f2799cc6d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1619 microversion: 2.1 time: 0.960892 Sep 10 20:59:03.137290 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1436/2940] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:02 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1619 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:03.149317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-22fde66e-e811-40c0-a974-b6ea7fc72df9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:03.153819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-22fde66e-e811-40c0-a974-b6ea7fc72df9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:03.177306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22fde66e-e811-40c0-a974-b6ea7fc72df9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:03.178080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22fde66e-e811-40c0-a974-b6ea7fc72df9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:03.178643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22fde66e-e811-40c0-a974-b6ea7fc72df9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:03.182880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22fde66e-e811-40c0-a974-b6ea7fc72df9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:03.185105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22fde66e-e811-40c0-a974-b6ea7fc72df9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:03.185497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22fde66e-e811-40c0-a974-b6ea7fc72df9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:03.759737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7c072075-5903-4dd3-985d-ba30de4addf0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:03.770037 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7c072075-5903-4dd3-985d-ba30de4addf0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.938362 Sep 10 20:59:03.797762 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1505/2941] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:02 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:03.838527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-80f8109e-9118-420d-b6fa-d52917fa984e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:03.842400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-80f8109e-9118-420d-b6fa-d52917fa984e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:04.048832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-80f8109e-9118-420d-b6fa-d52917fa984e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:04.065632 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-80f8109e-9118-420d-b6fa-d52917fa984e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1225 microversion: 2.1 time: 0.261743 Sep 10 20:59:04.066334 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1506/2942] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:03 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1225 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:04.087937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-58687ff0-6fba-4d1c-84b3-f636ec2cfc2b tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:04.088608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-58687ff0-6fba-4d1c-84b3-f636ec2cfc2b tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:04.102310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58687ff0-6fba-4d1c-84b3-f636ec2cfc2b tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:04.102965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58687ff0-6fba-4d1c-84b3-f636ec2cfc2b tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:04.103722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58687ff0-6fba-4d1c-84b3-f636ec2cfc2b tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:04.104926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58687ff0-6fba-4d1c-84b3-f636ec2cfc2b tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:04.105798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58687ff0-6fba-4d1c-84b3-f636ec2cfc2b tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:04.113714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58687ff0-6fba-4d1c-84b3-f636ec2cfc2b tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:04.269740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-22fde66e-e811-40c0-a974-b6ea7fc72df9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:04.283741 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-22fde66e-e811-40c0-a974-b6ea7fc72df9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1317 microversion: 2.1 time: 1.144902 Sep 10 20:59:04.291612 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1437/2943] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:03 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1317 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:04.309551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7476d0af-2f7b-48a1-9b50-38475b9f3723 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:04.311932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7476d0af-2f7b-48a1-9b50-38475b9f3723 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:04.329197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7476d0af-2f7b-48a1-9b50-38475b9f3723 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:04.334301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7476d0af-2f7b-48a1-9b50-38475b9f3723 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:04.338192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7476d0af-2f7b-48a1-9b50-38475b9f3723 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:04.339239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7476d0af-2f7b-48a1-9b50-38475b9f3723 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:04.339918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7476d0af-2f7b-48a1-9b50-38475b9f3723 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:04.340554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7476d0af-2f7b-48a1-9b50-38475b9f3723 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:04.583956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-7476d0af-2f7b-48a1-9b50-38475b9f3723 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lazy-loading 'services' on Instance uuid 37fb692b-5186-4333-ad32-a567de472d62 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:59:04.715139 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7476d0af-2f7b-48a1-9b50-38475b9f3723 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments/584966b6-2b79-498b-a36c-920cb089d0f8" status: 202 len: 0 microversion: 2.1 time: 0.421734 Sep 10 20:59:04.715774 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1438/2944] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 20:59:04 2022] DELETE /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments/584966b6-2b79-498b-a36c-920cb089d0f8 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:59:04.725967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5ddb9eb7-781d-4345-be68-83b42ab11e02 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1884118328", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:04.762824 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-58687ff0-6fba-4d1c-84b3-f636ec2cfc2b tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 200 len: 1620 microversion: 2.1 time: 0.691259 Sep 10 20:59:04.772908 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1507/2945] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:04 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 1620 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:04.787405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-585d2ef0-3518-4ae5-aa81-27c7d8b76f19 req-0463f1b0-3b9c-4775-9ebd-6736721c7acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e7d1492-dc6d-4ddc-ada0-4d492a0916d6", "tag": "3e890f01-2c63-4ec8-9b80-da70352321e9"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:04.830372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-585d2ef0-3518-4ae5-aa81-27c7d8b76f19 req-0463f1b0-3b9c-4775-9ebd-6736721c7acf service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:04.831928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-585d2ef0-3518-4ae5-aa81-27c7d8b76f19 req-0463f1b0-3b9c-4775-9ebd-6736721c7acf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:04.834430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-585d2ef0-3518-4ae5-aa81-27c7d8b76f19 req-0463f1b0-3b9c-4775-9ebd-6736721c7acf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:04.884937 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-585d2ef0-3518-4ae5-aa81-27c7d8b76f19 req-0463f1b0-3b9c-4775-9ebd-6736721c7acf service nova] Creating event network-changed:3e890f01-2c63-4ec8-9b80-da70352321e9 for instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 on nch2-master-1 Sep 10 20:59:04.902022 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-585d2ef0-3518-4ae5-aa81-27c7d8b76f19 req-0463f1b0-3b9c-4775-9ebd-6736721c7acf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128114 Sep 10 20:59:04.903089 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1508/2946] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:04.914904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a9986c17-b845-49c8-b2f3-345b9b58357b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:04.929317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9986c17-b845-49c8-b2f3-345b9b58357b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:04.952306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9986c17-b845-49c8-b2f3-345b9b58357b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:04.952829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9986c17-b845-49c8-b2f3-345b9b58357b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:04.953755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9986c17-b845-49c8-b2f3-345b9b58357b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:04.954571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9986c17-b845-49c8-b2f3-345b9b58357b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:04.955224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9986c17-b845-49c8-b2f3-345b9b58357b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:04.955954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9986c17-b845-49c8-b2f3-345b9b58357b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:05.025854 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a9986c17-b845-49c8-b2f3-345b9b58357b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115721 Sep 10 20:59:05.030776 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1509/2947] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 20:59:04 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:05.038495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-341226839", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "830cb245-7e91-4f1a-ae12-8010551e3aad"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:05.089616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.security_group_api [None req-5ddb9eb7-781d-4345-be68-83b42ab11e02 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Neutron security group does_not_exist not found {{(pid=145771) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 10 20:59:05.090619 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5ddb9eb7-781d-4345-be68-83b42ab11e02 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5ddb9eb7-781d-4345-be68-83b42ab11e02 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 258 Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1884118328", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1884118328', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 10 20:59:05.107712 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:05.111718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5ddb9eb7-781d-4345-be68-83b42ab11e02 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:05.122819 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5ddb9eb7-781d-4345-be68-83b42ab11e02 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.389184 Sep 10 20:59:05.122819 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1439/2948] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:59:04 2022] POST /compute/v2.1/servers => generated 106 bytes in 401 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:59:05.124086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-81e9d9ce-45fc-49ed-800f-3af9b5fc769c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:05.124824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-81e9d9ce-45fc-49ed-800f-3af9b5fc769c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:05.133164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81e9d9ce-45fc-49ed-800f-3af9b5fc769c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:05.133658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81e9d9ce-45fc-49ed-800f-3af9b5fc769c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:05.134135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81e9d9ce-45fc-49ed-800f-3af9b5fc769c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:05.134842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81e9d9ce-45fc-49ed-800f-3af9b5fc769c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:05.135291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81e9d9ce-45fc-49ed-800f-3af9b5fc769c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:05.136156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81e9d9ce-45fc-49ed-800f-3af9b5fc769c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:05.165921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:59:05.199628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:05.310539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-81e9d9ce-45fc-49ed-800f-3af9b5fc769c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:05.322310 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-81e9d9ce-45fc-49ed-800f-3af9b5fc769c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1277 microversion: 2.1 time: 0.202967 Sep 10 20:59:05.323604 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1440/2949] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:05 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:05.329744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c7a84953-39f3-4bf0-bc31-fa4ed6079644 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:05.331149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c7a84953-39f3-4bf0-bc31-fa4ed6079644 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:05.339444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7a84953-39f3-4bf0-bc31-fa4ed6079644 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:05.340671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7a84953-39f3-4bf0-bc31-fa4ed6079644 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:05.341324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7a84953-39f3-4bf0-bc31-fa4ed6079644 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:05.342289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7a84953-39f3-4bf0-bc31-fa4ed6079644 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:05.342980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7a84953-39f3-4bf0-bc31-fa4ed6079644 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:05.343773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7a84953-39f3-4bf0-bc31-fa4ed6079644 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:05.713120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c7a84953-39f3-4bf0-bc31-fa4ed6079644 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:05.722338 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c7a84953-39f3-4bf0-bc31-fa4ed6079644 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.396974 Sep 10 20:59:05.739502 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1441/2950] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:05 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:05.777628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1e36789d-3b4f-4ae5-b65b-1b668247cf9e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:05.778431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e36789d-3b4f-4ae5-b65b-1b668247cf9e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:05.790166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e36789d-3b4f-4ae5-b65b-1b668247cf9e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:05.794678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e36789d-3b4f-4ae5-b65b-1b668247cf9e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:05.795451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e36789d-3b4f-4ae5-b65b-1b668247cf9e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:05.797402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e36789d-3b4f-4ae5-b65b-1b668247cf9e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:05.800524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e36789d-3b4f-4ae5-b65b-1b668247cf9e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:05.801983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e36789d-3b4f-4ae5-b65b-1b668247cf9e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:06.057848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:59:06.059003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:59:06.060061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:59:06.060682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:59:06.061299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:59:06.082547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:06.083534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:06.091173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:06.094139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:06.094665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:06.095115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:06.143517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:59:06.150840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:59:06.180643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:59:06.185350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:59:06.249217 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be9dd59d-bbdf-4b30-a5f3-c465e556017c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220946 Sep 10 20:59:06.251027 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1510/2951] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:59:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:59:06.262356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b7dd489-0441-448d-95d8-48a447ffd06d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:06.262985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b7dd489-0441-448d-95d8-48a447ffd06d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:06.286009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7dd489-0441-448d-95d8-48a447ffd06d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:06.286727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7dd489-0441-448d-95d8-48a447ffd06d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:06.287184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7dd489-0441-448d-95d8-48a447ffd06d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:06.287904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7dd489-0441-448d-95d8-48a447ffd06d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:06.288927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7dd489-0441-448d-95d8-48a447ffd06d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:06.289381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7dd489-0441-448d-95d8-48a447ffd06d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:06.536463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=26 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:06.703125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1e36789d-3b4f-4ae5-b65b-1b668247cf9e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:06.715955 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1e36789d-3b4f-4ae5-b65b-1b668247cf9e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1317 microversion: 2.1 time: 0.946380 Sep 10 20:59:06.717880 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1442/2952] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:05 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1317 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:06.734641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7529a4e5-b803-411b-af2d-92aaafef4f3b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:06.738974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7529a4e5-b803-411b-af2d-92aaafef4f3b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:06.753778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7529a4e5-b803-411b-af2d-92aaafef4f3b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:06.755512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7529a4e5-b803-411b-af2d-92aaafef4f3b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:06.758758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7529a4e5-b803-411b-af2d-92aaafef4f3b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:06.762262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7529a4e5-b803-411b-af2d-92aaafef4f3b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:06.762801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7529a4e5-b803-411b-af2d-92aaafef4f3b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:06.763250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7529a4e5-b803-411b-af2d-92aaafef4f3b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:06.842736 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7529a4e5-b803-411b-af2d-92aaafef4f3b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123512 Sep 10 20:59:06.843595 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1443/2953] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 20:59:06 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 20:59:06.855841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d9d3693c-07a4-47d5-9ce2-2be96defcc49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:06.856458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d9d3693c-07a4-47d5-9ce2-2be96defcc49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:06.949171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b7dd489-0441-448d-95d8-48a447ffd06d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:06.972236 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b7dd489-0441-448d-95d8-48a447ffd06d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.711066 Sep 10 20:59:06.974816 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1511/2954] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:06 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:06.981367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8430661b-622f-44a6-a3ba-a1d933d126d3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:06.982346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8430661b-622f-44a6-a3ba-a1d933d126d3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:06.996490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8430661b-622f-44a6-a3ba-a1d933d126d3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:06.999819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8430661b-622f-44a6-a3ba-a1d933d126d3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.002357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8430661b-622f-44a6-a3ba-a1d933d126d3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.003285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8430661b-622f-44a6-a3ba-a1d933d126d3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.004030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8430661b-622f-44a6-a3ba-a1d933d126d3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.006528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8430661b-622f-44a6-a3ba-a1d933d126d3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.012627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d9d3693c-07a4-47d5-9ce2-2be96defcc49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:07.025468 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d9d3693c-07a4-47d5-9ce2-2be96defcc49 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1216 microversion: 2.1 time: 0.180441 Sep 10 20:59:07.026871 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1444/2955] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:06 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:07.049210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:07.063505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:07.165335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.169105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.169636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.170421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.175209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.175703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.177493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8430661b-622f-44a6-a3ba-a1d933d126d3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:07.186475 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8430661b-622f-44a6-a3ba-a1d933d126d3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1283 microversion: 2.1 time: 0.210258 Sep 10 20:59:07.191409 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1512/2956] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:06 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1283 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:07.196644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-13f28e02-1792-42a8-a76b-f82acaa3042d req-986e487e-4deb-4cbb-a598-ac4e8392774e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377f56f0-3163-4417-8d6b-ca4be8de2828", "tag": "7af13252-9cfc-4a98-a5da-d4f6e455291b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:07.220247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-13f28e02-1792-42a8-a76b-f82acaa3042d req-986e487e-4deb-4cbb-a598-ac4e8392774e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.221044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-13f28e02-1792-42a8-a76b-f82acaa3042d req-986e487e-4deb-4cbb-a598-ac4e8392774e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.222166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-13f28e02-1792-42a8-a76b-f82acaa3042d req-986e487e-4deb-4cbb-a598-ac4e8392774e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.240755 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-13f28e02-1792-42a8-a76b-f82acaa3042d req-986e487e-4deb-4cbb-a598-ac4e8392774e service nova] Creating event network-changed:7af13252-9cfc-4a98-a5da-d4f6e455291b for instance 377f56f0-3163-4417-8d6b-ca4be8de2828 on nch2-master-1 Sep 10 20:59:07.252803 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-13f28e02-1792-42a8-a76b-f82acaa3042d req-986e487e-4deb-4cbb-a598-ac4e8392774e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059639 Sep 10 20:59:07.258098 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1513/2957] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:07.273611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ffe37751-833a-4987-8b98-967081b99dc5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:07.275539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ffe37751-833a-4987-8b98-967081b99dc5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 9930b044-8e02-4d63-bfd8-00e7f3011814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:07.292008 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ffe37751-833a-4987-8b98-967081b99dc5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 9930b044-8e02-4d63-bfd8-00e7f3011814 could not be found. Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ffe37751-833a-4987-8b98-967081b99dc5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/9930b044-8e02-4d63-bfd8-00e7f3011814 HTTP/1.1 Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 9930b044-8e02-4d63-bfd8-00e7f3011814 could not be found. Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '9930b044-8e02-4d63-bfd8-00e7f3011814'} Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9930b044-8e02-4d63-bfd8-00e7f3011814 could not be found. Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9930b044-8e02-4d63-bfd8-00e7f3011814 could not be found. Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.294709 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9930b044-8e02-4d63-bfd8-00e7f3011814 could not be found. Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ffe37751-833a-4987-8b98-967081b99dc5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 9930b044-8e02-4d63-bfd8-00e7f3011814 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ffe37751-833a-4987-8b98-967081b99dc5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9930b044-8e02-4d63-bfd8-00e7f3011814" status: 404 len: 111 microversion: 2.1 time: 0.036348 Sep 10 20:59:07.300391 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1514/2958] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:59:07 2022] DELETE /compute/v2.1/servers/9930b044-8e02-4d63-bfd8-00e7f3011814 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:07.305979 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] HTTP exception thrown: Cannot 'reboot' instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 while it is in vm_state rescued Sep 10 20:59:07.307315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3a0e252a-382b-4236-9ca8-cbc4232f0e98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:07.307922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3a0e252a-382b-4236-9ca8-cbc4232f0e98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Request method failure captured: Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7/action HTTP/1.1 Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 28 Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPlIfEE6BUsYm6N9cc6J4sKvQx8zkdVi0_eGxve7idCE5St69TEoXloNJQbmDpLOYE4kW76RSsXwzH4ER5m-rWYbak-zkdFvTsFOuE5UWRW73UCQGyOtVDm5s0CSvgZ9e1C_-bLDziBI_eeTxSX1Lq4xDS48kCIhpdBe8v0QA9iMeLw Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4b1732129f3414fbc3f26fff6d039ec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4b1732129f3414fbc3f26fff6d039ec"}]}] Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d8b0a160808f4adda7be57cd535f0631 Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: {"reboot": {"type": "HARD"}} Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: exception: Cannot 'reboot' instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 while it is in vm_state rescued Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '31e18c6b-6c06-42cf-8651-53cdb6c30ff7', 'body': {'reboot': {'type': 'HARD'}}} Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:59:07.310717 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 while it is in vm_state rescued Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 while it is in vm_state rescued Sep 10 20:59:07.315794 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.318073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Returning 409 to user: Cannot 'reboot' instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 while it is in vm_state rescued {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:07.320539 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b43a141c-5ddf-4bb2-9b08-d1b53408440d tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7/action" status: 409 len: 145 microversion: 2.1 time: 0.291048 Sep 10 20:59:07.323391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a0e252a-382b-4236-9ca8-cbc4232f0e98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.325339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a0e252a-382b-4236-9ca8-cbc4232f0e98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.326037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a0e252a-382b-4236-9ca8-cbc4232f0e98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.327071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a0e252a-382b-4236-9ca8-cbc4232f0e98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.327764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a0e252a-382b-4236-9ca8-cbc4232f0e98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.328158 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1445/2959] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:07 2022] POST /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7/action => generated 145 bytes in 300 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:59:07.328635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a0e252a-382b-4236-9ca8-cbc4232f0e98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.340495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:07.347005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:07.364543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.366446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.367103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.373457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.374343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.375011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.427199 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] HTTP exception thrown: Cannot 'rebuild' instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 while it is in vm_state rescued Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Request method failure captured: Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7/action HTTP/1.1 Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 65 Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPlIfEE6BUsYm6N9cc6J4sKvQx8zkdVi0_eGxve7idCE5St69TEoXloNJQbmDpLOYE4kW76RSsXwzH4ER5m-rWYbak-zkdFvTsFOuE5UWRW73UCQGyOtVDm5s0CSvgZ9e1C_-bLDziBI_eeTxSX1Lq4xDS48kCIhpdBe8v0QA9iMeLw Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4b1732129f3414fbc3f26fff6d039ec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4b1732129f3414fbc3f26fff6d039ec"}]}] Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d8b0a160808f4adda7be57cd535f0631 Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: exception: Cannot 'rebuild' instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 while it is in vm_state rescued Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '31e18c6b-6c06-42cf-8651-53cdb6c30ff7', 'body': {'rebuild': {'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12'}}} Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:07.429408 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 while it is in vm_state rescued Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 while it is in vm_state rescued Sep 10 20:59:07.434665 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:07.437736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Returning 409 to user: Cannot 'rebuild' instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 while it is in vm_state rescued {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:07.438839 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-693cb86f-f5d3-48b2-b685-77b1aba18fc5 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "POST /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7/action" status: 409 len: 146 microversion: 2.1 time: 0.108870 Sep 10 20:59:07.439618 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1446/2960] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:07 2022] POST /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7/action => generated 146 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:59:07.451912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-99c881fe-e6cb-495d-afc9-0639e81f7a82 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:07.452609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99c881fe-e6cb-495d-afc9-0639e81f7a82 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:07.460803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99c881fe-e6cb-495d-afc9-0639e81f7a82 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.461509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99c881fe-e6cb-495d-afc9-0639e81f7a82 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.462156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99c881fe-e6cb-495d-afc9-0639e81f7a82 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.463105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99c881fe-e6cb-495d-afc9-0639e81f7a82 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.463736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99c881fe-e6cb-495d-afc9-0639e81f7a82 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.464326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99c881fe-e6cb-495d-afc9-0639e81f7a82 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.520778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99c881fe-e6cb-495d-afc9-0639e81f7a82 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:59:07.688120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a0e252a-382b-4236-9ca8-cbc4232f0e98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:07.699642 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3a0e252a-382b-4236-9ca8-cbc4232f0e98 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.398051 Sep 10 20:59:07.702253 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1515/2961] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:07 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:07.729300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3bea83e9-106d-4d22-85ae-60bf05e6db92 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:07.730232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3bea83e9-106d-4d22-85ae-60bf05e6db92 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:07.747319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bea83e9-106d-4d22-85ae-60bf05e6db92 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.749391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bea83e9-106d-4d22-85ae-60bf05e6db92 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.752153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bea83e9-106d-4d22-85ae-60bf05e6db92 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.754226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bea83e9-106d-4d22-85ae-60bf05e6db92 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.755233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bea83e9-106d-4d22-85ae-60bf05e6db92 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.757741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3bea83e9-106d-4d22-85ae-60bf05e6db92 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.773210 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-99c881fe-e6cb-495d-afc9-0639e81f7a82 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 204 len: 0 microversion: 2.1 time: 0.325241 Sep 10 20:59:07.774473 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1447/2962] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:59:07 2022] DELETE /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:59:07.781627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dbd681a5-6fcc-4668-8cb2-2b8822f1287f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:07.782570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dbd681a5-6fcc-4668-8cb2-2b8822f1287f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:07.790096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbd681a5-6fcc-4668-8cb2-2b8822f1287f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.790856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbd681a5-6fcc-4668-8cb2-2b8822f1287f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.791449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbd681a5-6fcc-4668-8cb2-2b8822f1287f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:07.792383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbd681a5-6fcc-4668-8cb2-2b8822f1287f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:07.793055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbd681a5-6fcc-4668-8cb2-2b8822f1287f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:07.793696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbd681a5-6fcc-4668-8cb2-2b8822f1287f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:08.162833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3bea83e9-106d-4d22-85ae-60bf05e6db92 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:08.173572 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3bea83e9-106d-4d22-85ae-60bf05e6db92 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.449026 Sep 10 20:59:08.174209 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1516/2963] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:07 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:08.179206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e063c7c2-af4f-40bf-b0ec-ac1e39f60f6f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:08.179828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e063c7c2-af4f-40bf-b0ec-ac1e39f60f6f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:08.182525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:08.187548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e063c7c2-af4f-40bf-b0ec-ac1e39f60f6f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:08.188033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e063c7c2-af4f-40bf-b0ec-ac1e39f60f6f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:08.188483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e063c7c2-af4f-40bf-b0ec-ac1e39f60f6f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:08.189378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e063c7c2-af4f-40bf-b0ec-ac1e39f60f6f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:08.190034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e063c7c2-af4f-40bf-b0ec-ac1e39f60f6f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:08.190634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e063c7c2-af4f-40bf-b0ec-ac1e39f60f6f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:08.514101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dbd681a5-6fcc-4668-8cb2-2b8822f1287f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:08.525443 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dbd681a5-6fcc-4668-8cb2-2b8822f1287f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1317 microversion: 2.1 time: 0.749572 Sep 10 20:59:08.530368 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1448/2964] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:07 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1317 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:08.538597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80bef8b4-42e4-42c3-a569-d0980388d4b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:08.542584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-80bef8b4-42e4-42c3-a569-d0980388d4b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:08.559408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80bef8b4-42e4-42c3-a569-d0980388d4b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:08.561891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e063c7c2-af4f-40bf-b0ec-ac1e39f60f6f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:08.562613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80bef8b4-42e4-42c3-a569-d0980388d4b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:08.563236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80bef8b4-42e4-42c3-a569-d0980388d4b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:08.563981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80bef8b4-42e4-42c3-a569-d0980388d4b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:08.567760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80bef8b4-42e4-42c3-a569-d0980388d4b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:08.569899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80bef8b4-42e4-42c3-a569-d0980388d4b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:08.577393 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e063c7c2-af4f-40bf-b0ec-ac1e39f60f6f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1688 microversion: 2.1 time: 0.401543 Sep 10 20:59:08.579865 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1517/2965] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:08 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1688 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:08.613406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-32fc6680-96f0-41c8-8c58-d30f499439f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:08.615630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-32fc6680-96f0-41c8-8c58-d30f499439f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Failed to fetch instance by id 9223372036854775808 {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 20:59:08.617715 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-32fc6680-96f0-41c8-8c58-d30f499439f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-32fc6680-96f0-41c8-8c58-d30f499439f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 9223372036854775808 could not be found. Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '9223372036854775808'} Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:08.623912 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:08.630414 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:08.630414 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:08.630414 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:08.630414 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 10 20:59:08.630414 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:08.635008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-32fc6680-96f0-41c8-8c58-d30f499439f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:08.636175 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-32fc6680-96f0-41c8-8c58-d30f499439f8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.035468 Sep 10 20:59:08.639476 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1518/2966] 10.222.0.33 () {58 vars in 1188 bytes} [Sat Sep 10 20:59:08 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:59:08.655137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ba32eb61-8a7b-4cfa-86cc-f8e1dc9b11ab tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:08.656187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ba32eb61-8a7b-4cfa-86cc-f8e1dc9b11ab tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:08.675743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba32eb61-8a7b-4cfa-86cc-f8e1dc9b11ab tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:08.677553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba32eb61-8a7b-4cfa-86cc-f8e1dc9b11ab tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:08.679648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba32eb61-8a7b-4cfa-86cc-f8e1dc9b11ab tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:08.680861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba32eb61-8a7b-4cfa-86cc-f8e1dc9b11ab tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:08.686703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba32eb61-8a7b-4cfa-86cc-f8e1dc9b11ab tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:08.688766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba32eb61-8a7b-4cfa-86cc-f8e1dc9b11ab tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:08.728289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-80bef8b4-42e4-42c3-a569-d0980388d4b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:08.743366 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-80bef8b4-42e4-42c3-a569-d0980388d4b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1268 microversion: 2.1 time: 0.211051 Sep 10 20:59:08.744208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1449/2967] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:08 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1268 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:08.750729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a26afaf7-8307-4833-ad4a-7e22546e5e3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:08.752659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a26afaf7-8307-4833-ad4a-7e22546e5e3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:08.769782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a26afaf7-8307-4833-ad4a-7e22546e5e3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:08.772574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a26afaf7-8307-4833-ad4a-7e22546e5e3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:08.773233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a26afaf7-8307-4833-ad4a-7e22546e5e3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:08.774152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a26afaf7-8307-4833-ad4a-7e22546e5e3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:08.778690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a26afaf7-8307-4833-ad4a-7e22546e5e3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:08.779827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a26afaf7-8307-4833-ad4a-7e22546e5e3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:08.983742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ba32eb61-8a7b-4cfa-86cc-f8e1dc9b11ab tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:08.994066 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ba32eb61-8a7b-4cfa-86cc-f8e1dc9b11ab tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.353196 Sep 10 20:59:09.007406 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1519/2968] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:08 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:09.142031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a26afaf7-8307-4833-ad4a-7e22546e5e3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:09.151445 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a26afaf7-8307-4833-ad4a-7e22546e5e3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.405277 Sep 10 20:59:09.152257 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1450/2969] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:08 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:09.179123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7b97b2ae-5e25-4526-8726-c162b59d4dd5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:09.180493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7b97b2ae-5e25-4526-8726-c162b59d4dd5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:09.190680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b97b2ae-5e25-4526-8726-c162b59d4dd5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:09.191187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b97b2ae-5e25-4526-8726-c162b59d4dd5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:09.191557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b97b2ae-5e25-4526-8726-c162b59d4dd5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:09.193225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b97b2ae-5e25-4526-8726-c162b59d4dd5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:09.194026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b97b2ae-5e25-4526-8726-c162b59d4dd5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:09.194456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b97b2ae-5e25-4526-8726-c162b59d4dd5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:09.377019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7b97b2ae-5e25-4526-8726-c162b59d4dd5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:09.388156 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7b97b2ae-5e25-4526-8726-c162b59d4dd5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.214371 Sep 10 20:59:09.390245 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1520/2970] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:09 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:09.413713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e4a7d16e-e39d-42a4-916d-44af20a8272a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:09.414563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e4a7d16e-e39d-42a4-916d-44af20a8272a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Failed to fetch instance by id -1 {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 20:59:09.415347 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-e4a7d16e-e39d-42a4-916d-44af20a8272a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance -1 could not be found. Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e4a7d16e-e39d-42a4-916d-44af20a8272a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance -1 could not be found. Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '-1'} Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:09.417144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:09.421230 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:09.421230 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:09.421230 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 10 20:59:09.421230 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:09.422860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e4a7d16e-e39d-42a4-916d-44af20a8272a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance -1 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:09.423930 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e4a7d16e-e39d-42a4-916d-44af20a8272a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.015969 Sep 10 20:59:09.428566 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1451/2971] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:59:09 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:59:09.433222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e92ea14e-2f7c-4de0-a34a-f4a383d50c37 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:09.434148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e92ea14e-2f7c-4de0-a34a-f4a383d50c37 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:09.440763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92ea14e-2f7c-4de0-a34a-f4a383d50c37 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:09.441481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92ea14e-2f7c-4de0-a34a-f4a383d50c37 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:09.442202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92ea14e-2f7c-4de0-a34a-f4a383d50c37 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:09.443186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92ea14e-2f7c-4de0-a34a-f4a383d50c37 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:09.443811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92ea14e-2f7c-4de0-a34a-f4a383d50c37 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:09.444407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e92ea14e-2f7c-4de0-a34a-f4a383d50c37 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:09.556581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-551ef32b-9146-4c80-9ce8-c3642b1be18d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:09.557621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-551ef32b-9146-4c80-9ce8-c3642b1be18d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:09.565921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-551ef32b-9146-4c80-9ce8-c3642b1be18d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:09.566643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-551ef32b-9146-4c80-9ce8-c3642b1be18d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:09.567828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-551ef32b-9146-4c80-9ce8-c3642b1be18d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:09.568707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-551ef32b-9146-4c80-9ce8-c3642b1be18d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:09.569324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-551ef32b-9146-4c80-9ce8-c3642b1be18d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:09.569936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-551ef32b-9146-4c80-9ce8-c3642b1be18d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:09.574600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:09.701761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e92ea14e-2f7c-4de0-a34a-f4a383d50c37 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:09.719647 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e92ea14e-2f7c-4de0-a34a-f4a383d50c37 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.289564 Sep 10 20:59:09.721036 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1521/2972] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:09 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:09.748063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-97c7cc70-5066-4817-b378-dbd7caee7102 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:09.749117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-97c7cc70-5066-4817-b378-dbd7caee7102 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:09.759649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c7cc70-5066-4817-b378-dbd7caee7102 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:09.761691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c7cc70-5066-4817-b378-dbd7caee7102 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:09.764601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c7cc70-5066-4817-b378-dbd7caee7102 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:09.765989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c7cc70-5066-4817-b378-dbd7caee7102 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:09.766748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c7cc70-5066-4817-b378-dbd7caee7102 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:09.767895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c7cc70-5066-4817-b378-dbd7caee7102 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:09.860747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-551ef32b-9146-4c80-9ce8-c3642b1be18d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:09.879442 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-551ef32b-9146-4c80-9ce8-c3642b1be18d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1317 microversion: 2.1 time: 0.326654 Sep 10 20:59:09.882289 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1452/2973] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:09 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:09.896165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2488415d-5532-42b7-9a73-28e540145410 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:09.898927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2488415d-5532-42b7-9a73-28e540145410 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:09.918383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2488415d-5532-42b7-9a73-28e540145410 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:09.919780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2488415d-5532-42b7-9a73-28e540145410 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:09.921295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2488415d-5532-42b7-9a73-28e540145410 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:09.933477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2488415d-5532-42b7-9a73-28e540145410 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:09.934361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2488415d-5532-42b7-9a73-28e540145410 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:09.935059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2488415d-5532-42b7-9a73-28e540145410 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:10.008780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-97c7cc70-5066-4817-b378-dbd7caee7102 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:10.011381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:10.020822 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-97c7cc70-5066-4817-b378-dbd7caee7102 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1688 microversion: 2.1 time: 0.296861 Sep 10 20:59:10.021427 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1522/2974] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:09 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1688 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:10.028979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe54a318-fc15-419e-8678-68ffc74dc0cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:10.036829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fe54a318-fc15-419e-8678-68ffc74dc0cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:10.046475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe54a318-fc15-419e-8678-68ffc74dc0cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:10.046984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe54a318-fc15-419e-8678-68ffc74dc0cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:10.047461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe54a318-fc15-419e-8678-68ffc74dc0cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:10.048160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe54a318-fc15-419e-8678-68ffc74dc0cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:10.048625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe54a318-fc15-419e-8678-68ffc74dc0cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:10.049866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe54a318-fc15-419e-8678-68ffc74dc0cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:10.146917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fe54a318-fc15-419e-8678-68ffc74dc0cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:10.161716 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fe54a318-fc15-419e-8678-68ffc74dc0cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1268 microversion: 2.1 time: 0.138704 Sep 10 20:59:10.173138 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1523/2975] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:10 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:10.186709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-183196f0-bba2-487a-8d2b-c3a7c1567bf1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:10.187421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-183196f0-bba2-487a-8d2b-c3a7c1567bf1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:10.197161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-183196f0-bba2-487a-8d2b-c3a7c1567bf1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:10.197713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-183196f0-bba2-487a-8d2b-c3a7c1567bf1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:10.198246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-183196f0-bba2-487a-8d2b-c3a7c1567bf1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:10.198977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-183196f0-bba2-487a-8d2b-c3a7c1567bf1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:10.199444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-183196f0-bba2-487a-8d2b-c3a7c1567bf1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:10.200241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-183196f0-bba2-487a-8d2b-c3a7c1567bf1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:10.384784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2488415d-5532-42b7-9a73-28e540145410 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:10.394759 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2488415d-5532-42b7-9a73-28e540145410 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.511126 Sep 10 20:59:10.396193 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1453/2976] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:09 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:10.418873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b567c6d9-d778-4d45-a636-34971ea1f12f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:10.419740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b567c6d9-d778-4d45-a636-34971ea1f12f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: a8856151-9305-411a-8b78-7629015d9616] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:10.425738 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-b567c6d9-d778-4d45-a636-34971ea1f12f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance a8856151-9305-411a-8b78-7629015d9616 could not be found. Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b567c6d9-d778-4d45-a636-34971ea1f12f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/a8856151-9305-411a-8b78-7629015d9616/action HTTP/1.1 Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 19 Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: {"forceDelete": {}} Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance a8856151-9305-411a-8b78-7629015d9616 could not be found. Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'a8856151-9305-411a-8b78-7629015d9616', 'body': {'forceDelete': {}}} Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8856151-9305-411a-8b78-7629015d9616 could not be found. Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8856151-9305-411a-8b78-7629015d9616 could not be found. Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:10.432253 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:10.442760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:10.442760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:10.442760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8856151-9305-411a-8b78-7629015d9616 could not be found. Sep 10 20:59:10.442760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:10.442760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b567c6d9-d778-4d45-a636-34971ea1f12f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance a8856151-9305-411a-8b78-7629015d9616 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:10.442760 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b567c6d9-d778-4d45-a636-34971ea1f12f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/a8856151-9305-411a-8b78-7629015d9616/action" status: 404 len: 111 microversion: 2.1 time: 0.019018 Sep 10 20:59:10.442760 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1454/2977] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:10 2022] POST /compute/v2.1/servers/a8856151-9305-411a-8b78-7629015d9616/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:59:10.450751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-42d471e0-a5be-4d78-8ce2-af919dc9a5e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:10.451348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-42d471e0-a5be-4d78-8ce2-af919dc9a5e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:10.460552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d471e0-a5be-4d78-8ce2-af919dc9a5e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:10.461063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d471e0-a5be-4d78-8ce2-af919dc9a5e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:10.461500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d471e0-a5be-4d78-8ce2-af919dc9a5e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:10.462254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d471e0-a5be-4d78-8ce2-af919dc9a5e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:10.462759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d471e0-a5be-4d78-8ce2-af919dc9a5e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:10.463404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-42d471e0-a5be-4d78-8ce2-af919dc9a5e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:10.549366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-183196f0-bba2-487a-8d2b-c3a7c1567bf1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:10.563754 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-183196f0-bba2-487a-8d2b-c3a7c1567bf1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.389143 Sep 10 20:59:10.565349 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1524/2978] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:10 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:10.830493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-42d471e0-a5be-4d78-8ce2-af919dc9a5e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:10.839811 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-42d471e0-a5be-4d78-8ce2-af919dc9a5e9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.399473 Sep 10 20:59:10.861612 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1455/2979] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:10 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:10.869763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f776ac71-a060-46b6-b9ed-4a71c3bb1398 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:10.870692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f776ac71-a060-46b6-b9ed-4a71c3bb1398 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:10.878330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f776ac71-a060-46b6-b9ed-4a71c3bb1398 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:10.878868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f776ac71-a060-46b6-b9ed-4a71c3bb1398 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:10.879345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f776ac71-a060-46b6-b9ed-4a71c3bb1398 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:10.880671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f776ac71-a060-46b6-b9ed-4a71c3bb1398 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:10.881347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f776ac71-a060-46b6-b9ed-4a71c3bb1398 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:10.882011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f776ac71-a060-46b6-b9ed-4a71c3bb1398 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:10.905165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-afdc470d-e5f5-4168-af03-6d61df661b61 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:10.905877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-afdc470d-e5f5-4168-af03-6d61df661b61 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:10.915261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afdc470d-e5f5-4168-af03-6d61df661b61 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:10.917406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afdc470d-e5f5-4168-af03-6d61df661b61 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:10.918047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afdc470d-e5f5-4168-af03-6d61df661b61 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:10.920440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afdc470d-e5f5-4168-af03-6d61df661b61 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:10.921153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afdc470d-e5f5-4168-af03-6d61df661b61 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:10.922380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afdc470d-e5f5-4168-af03-6d61df661b61 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:11.135499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f776ac71-a060-46b6-b9ed-4a71c3bb1398 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:11.148388 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f776ac71-a060-46b6-b9ed-4a71c3bb1398 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.283057 Sep 10 20:59:11.150252 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1525/2980] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:10 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:11.155742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-89a3c8dd-dab2-4f4f-9cf4-17619d5f5924 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:11.156695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-89a3c8dd-dab2-4f4f-9cf4-17619d5f5924 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:11.165263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89a3c8dd-dab2-4f4f-9cf4-17619d5f5924 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:11.167701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89a3c8dd-dab2-4f4f-9cf4-17619d5f5924 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:11.168524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89a3c8dd-dab2-4f4f-9cf4-17619d5f5924 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:11.170936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89a3c8dd-dab2-4f4f-9cf4-17619d5f5924 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:11.171683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89a3c8dd-dab2-4f4f-9cf4-17619d5f5924 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:11.172944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89a3c8dd-dab2-4f4f-9cf4-17619d5f5924 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:11.418380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-89a3c8dd-dab2-4f4f-9cf4-17619d5f5924 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:11.430222 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-89a3c8dd-dab2-4f4f-9cf4-17619d5f5924 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1688 microversion: 2.1 time: 0.277897 Sep 10 20:59:11.431219 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1526/2981] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:11 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1688 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:11.437949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5501dd6a-ca10-4311-b7e7-c0ee8e541df6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:11.442023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5501dd6a-ca10-4311-b7e7-c0ee8e541df6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: e9aeadf1-7df0-4291-891d-310fb2ec822c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:11.451963 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-5501dd6a-ca10-4311-b7e7-c0ee8e541df6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance e9aeadf1-7df0-4291-891d-310fb2ec822c could not be found. Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5501dd6a-ca10-4311-b7e7-c0ee8e541df6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/e9aeadf1-7df0-4291-891d-310fb2ec822c/action HTTP/1.1 Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 39 Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: {"os-getConsoleOutput": {"length": 10}} Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance e9aeadf1-7df0-4291-891d-310fb2ec822c could not be found. Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e9aeadf1-7df0-4291-891d-310fb2ec822c', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9aeadf1-7df0-4291-891d-310fb2ec822c could not be found. Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9aeadf1-7df0-4291-891d-310fb2ec822c could not be found. Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:11.460803 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:11.466730 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:11.466730 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:11.466730 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:11.466730 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:11.466730 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9aeadf1-7df0-4291-891d-310fb2ec822c could not be found. Sep 10 20:59:11.466730 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:11.471676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5501dd6a-ca10-4311-b7e7-c0ee8e541df6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance e9aeadf1-7df0-4291-891d-310fb2ec822c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:11.475155 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5501dd6a-ca10-4311-b7e7-c0ee8e541df6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/e9aeadf1-7df0-4291-891d-310fb2ec822c/action" status: 404 len: 111 microversion: 2.1 time: 0.042040 Sep 10 20:59:11.476540 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1527/2982] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:11 2022] POST /compute/v2.1/servers/e9aeadf1-7df0-4291-891d-310fb2ec822c/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:11.509091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e97df12-5c71-460b-a422-ab7aae2414b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:11.510737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e97df12-5c71-460b-a422-ab7aae2414b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:11.530394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e97df12-5c71-460b-a422-ab7aae2414b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:11.531616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e97df12-5c71-460b-a422-ab7aae2414b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:11.532178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e97df12-5c71-460b-a422-ab7aae2414b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:11.534158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e97df12-5c71-460b-a422-ab7aae2414b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:11.534859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e97df12-5c71-460b-a422-ab7aae2414b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:11.535477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e97df12-5c71-460b-a422-ab7aae2414b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:11.900931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-afdc470d-e5f5-4168-af03-6d61df661b61 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:11.918866 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-afdc470d-e5f5-4168-af03-6d61df661b61 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1317 microversion: 2.1 time: 1.016850 Sep 10 20:59:11.923617 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1456/2983] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:10 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1317 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:11.938687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-13733dc9-50cb-427f-ab64-6f7037693d22 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:11.946277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-13733dc9-50cb-427f-ab64-6f7037693d22 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:11.962217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13733dc9-50cb-427f-ab64-6f7037693d22 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:11.963065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13733dc9-50cb-427f-ab64-6f7037693d22 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:11.965084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13733dc9-50cb-427f-ab64-6f7037693d22 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:11.968625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13733dc9-50cb-427f-ab64-6f7037693d22 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:11.969868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13733dc9-50cb-427f-ab64-6f7037693d22 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:11.970594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13733dc9-50cb-427f-ab64-6f7037693d22 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:12.028237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e97df12-5c71-460b-a422-ab7aae2414b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:12.039581 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e97df12-5c71-460b-a422-ab7aae2414b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1268 microversion: 2.1 time: 0.561519 Sep 10 20:59:12.046272 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1528/2984] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:11 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1268 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:12.072347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87848fc9-b9e4-4e63-90fe-e4cb31eb95e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:12.074073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87848fc9-b9e4-4e63-90fe-e4cb31eb95e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:12.091828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87848fc9-b9e4-4e63-90fe-e4cb31eb95e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:12.092706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87848fc9-b9e4-4e63-90fe-e4cb31eb95e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:12.093725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87848fc9-b9e4-4e63-90fe-e4cb31eb95e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:12.094712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87848fc9-b9e4-4e63-90fe-e4cb31eb95e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:12.095398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87848fc9-b9e4-4e63-90fe-e4cb31eb95e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:12.096055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87848fc9-b9e4-4e63-90fe-e4cb31eb95e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:12.593864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-87848fc9-b9e4-4e63-90fe-e4cb31eb95e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:12.621544 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-87848fc9-b9e4-4e63-90fe-e4cb31eb95e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.570344 Sep 10 20:59:12.625019 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1529/2985] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:12 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:12.635085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ed0db37b-f1d0-4ab9-9856-ddb3df72878f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:12.636545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ed0db37b-f1d0-4ab9-9856-ddb3df72878f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:12.679238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0db37b-f1d0-4ab9-9856-ddb3df72878f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:12.680086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0db37b-f1d0-4ab9-9856-ddb3df72878f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:12.680770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0db37b-f1d0-4ab9-9856-ddb3df72878f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:12.681750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0db37b-f1d0-4ab9-9856-ddb3df72878f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:12.682554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0db37b-f1d0-4ab9-9856-ddb3df72878f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:12.683211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0db37b-f1d0-4ab9-9856-ddb3df72878f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:12.765620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-13733dc9-50cb-427f-ab64-6f7037693d22 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:12.779944 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-13733dc9-50cb-427f-ab64-6f7037693d22 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.853955 Sep 10 20:59:12.782639 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1457/2986] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:11 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:12.808557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-71630be2-9ae8-47ce-8401-a49a77b4de64 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:12.809434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-71630be2-9ae8-47ce-8401-a49a77b4de64 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:12.815708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71630be2-9ae8-47ce-8401-a49a77b4de64 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:12.816200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71630be2-9ae8-47ce-8401-a49a77b4de64 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:12.816632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71630be2-9ae8-47ce-8401-a49a77b4de64 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:12.817756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71630be2-9ae8-47ce-8401-a49a77b4de64 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:12.818278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71630be2-9ae8-47ce-8401-a49a77b4de64 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:12.819024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71630be2-9ae8-47ce-8401-a49a77b4de64 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:13.164378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ed0db37b-f1d0-4ab9-9856-ddb3df72878f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:13.182774 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ed0db37b-f1d0-4ab9-9856-ddb3df72878f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1688 microversion: 2.1 time: 0.556416 Sep 10 20:59:13.187781 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1530/2987] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:12 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1688 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:13.204978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b63678d-4416-4a3d-bcf4-54f8c1ddfcb6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:13.206118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b63678d-4416-4a3d-bcf4-54f8c1ddfcb6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:13.224063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b63678d-4416-4a3d-bcf4-54f8c1ddfcb6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:13.224578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b63678d-4416-4a3d-bcf4-54f8c1ddfcb6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:13.225037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b63678d-4416-4a3d-bcf4-54f8c1ddfcb6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:13.225771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b63678d-4416-4a3d-bcf4-54f8c1ddfcb6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:13.226272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b63678d-4416-4a3d-bcf4-54f8c1ddfcb6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:13.226712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b63678d-4416-4a3d-bcf4-54f8c1ddfcb6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:13.586399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-71630be2-9ae8-47ce-8401-a49a77b4de64 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:13.602630 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-71630be2-9ae8-47ce-8401-a49a77b4de64 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.790846 Sep 10 20:59:13.604040 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1458/2988] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:12 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:13.609115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-391d18a7-3709-4511-b2de-13e94e602c5e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:13.615041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-391d18a7-3709-4511-b2de-13e94e602c5e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:13.626462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-391d18a7-3709-4511-b2de-13e94e602c5e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:13.627944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-391d18a7-3709-4511-b2de-13e94e602c5e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:13.630454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-391d18a7-3709-4511-b2de-13e94e602c5e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:13.632673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-391d18a7-3709-4511-b2de-13e94e602c5e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:13.633536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-391d18a7-3709-4511-b2de-13e94e602c5e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:13.637383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-391d18a7-3709-4511-b2de-13e94e602c5e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:13.771406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b63678d-4416-4a3d-bcf4-54f8c1ddfcb6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:13.779562 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b63678d-4416-4a3d-bcf4-54f8c1ddfcb6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1317 microversion: 2.1 time: 0.590273 Sep 10 20:59:13.783723 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1531/2989] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:13 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1317 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:13.792622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe9a1530-eeef-4f5f-ad55-f94490265a9f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:13.797124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fe9a1530-eeef-4f5f-ad55-f94490265a9f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: d0525e2e-44d6-45eb-8809-5fbb0b1ebc91] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:13.808333 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-fe9a1530-eeef-4f5f-ad55-f94490265a9f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance d0525e2e-44d6-45eb-8809-5fbb0b1ebc91 could not be found. Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe9a1530-eeef-4f5f-ad55-f94490265a9f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/d0525e2e-44d6-45eb-8809-5fbb0b1ebc91 HTTP/1.1 Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance d0525e2e-44d6-45eb-8809-5fbb0b1ebc91 could not be found. Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'd0525e2e-44d6-45eb-8809-5fbb0b1ebc91'} Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0525e2e-44d6-45eb-8809-5fbb0b1ebc91 could not be found. Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0525e2e-44d6-45eb-8809-5fbb0b1ebc91 could not be found. Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:13.820004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:13.830983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:13.830983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:13.830983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:13.830983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0525e2e-44d6-45eb-8809-5fbb0b1ebc91 could not be found. Sep 10 20:59:13.830983 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:13.830983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe9a1530-eeef-4f5f-ad55-f94490265a9f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance d0525e2e-44d6-45eb-8809-5fbb0b1ebc91 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:13.830983 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fe9a1530-eeef-4f5f-ad55-f94490265a9f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/d0525e2e-44d6-45eb-8809-5fbb0b1ebc91" status: 404 len: 111 microversion: 2.1 time: 0.036406 Sep 10 20:59:13.830983 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1532/2990] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:13 2022] GET /compute/v2.1/servers/d0525e2e-44d6-45eb-8809-5fbb0b1ebc91 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:13.830983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5eb23d23-5cee-4e68-a463-ce276852bcbd tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:13.830983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5eb23d23-5cee-4e68-a463-ce276852bcbd tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:13.848267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb23d23-5cee-4e68-a463-ce276852bcbd tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:13.848653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb23d23-5cee-4e68-a463-ce276852bcbd tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:13.849102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb23d23-5cee-4e68-a463-ce276852bcbd tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:13.849887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb23d23-5cee-4e68-a463-ce276852bcbd tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:13.858673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb23d23-5cee-4e68-a463-ce276852bcbd tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:13.859140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5eb23d23-5cee-4e68-a463-ce276852bcbd tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:13.875498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-391d18a7-3709-4511-b2de-13e94e602c5e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:13.892693 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-391d18a7-3709-4511-b2de-13e94e602c5e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1274 microversion: 2.1 time: 0.284795 Sep 10 20:59:13.894072 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1459/2991] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:13 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1274 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:13.906375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a9b7b2b1-5885-4214-959d-012fab98ee27 req-42ba64ce-5c6d-4321-9642-b5d46c933365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7d1492-dc6d-4ddc-ada0-4d492a0916d6", "name": "network-vif-plugged", "status": "completed", "tag": "3e890f01-2c63-4ec8-9b80-da70352321e9"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:13.925334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a9b7b2b1-5885-4214-959d-012fab98ee27 req-42ba64ce-5c6d-4321-9642-b5d46c933365 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:13.927722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a9b7b2b1-5885-4214-959d-012fab98ee27 req-42ba64ce-5c6d-4321-9642-b5d46c933365 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:13.930145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a9b7b2b1-5885-4214-959d-012fab98ee27 req-42ba64ce-5c6d-4321-9642-b5d46c933365 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:13.997860 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a9b7b2b1-5885-4214-959d-012fab98ee27 req-42ba64ce-5c6d-4321-9642-b5d46c933365 service nova] Creating event network-vif-plugged:3e890f01-2c63-4ec8-9b80-da70352321e9 for instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 on nch2-master-1 Sep 10 20:59:14.015822 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a9b7b2b1-5885-4214-959d-012fab98ee27 req-42ba64ce-5c6d-4321-9642-b5d46c933365 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119663 Sep 10 20:59:14.021189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1460/2992] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:14.034631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7c622398-4cf3-4349-b598-0f2f1e4a2d99 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:14.043969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7c622398-4cf3-4349-b598-0f2f1e4a2d99 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:14.070389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c622398-4cf3-4349-b598-0f2f1e4a2d99 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:14.070897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c622398-4cf3-4349-b598-0f2f1e4a2d99 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:14.078773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c622398-4cf3-4349-b598-0f2f1e4a2d99 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:14.079573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c622398-4cf3-4349-b598-0f2f1e4a2d99 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:14.080070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c622398-4cf3-4349-b598-0f2f1e4a2d99 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:14.080510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c622398-4cf3-4349-b598-0f2f1e4a2d99 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:14.360342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5eb23d23-5cee-4e68-a463-ce276852bcbd tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:14.378210 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5eb23d23-5cee-4e68-a463-ce276852bcbd tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.551574 Sep 10 20:59:14.379861 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1533/2993] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:13 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:14.392988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a679f315-be9b-403a-9fba-cd8e44ccabfd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:14.394618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a679f315-be9b-403a-9fba-cd8e44ccabfd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:14.410209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a679f315-be9b-403a-9fba-cd8e44ccabfd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:14.411510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a679f315-be9b-403a-9fba-cd8e44ccabfd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:14.412226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a679f315-be9b-403a-9fba-cd8e44ccabfd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:14.413356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a679f315-be9b-403a-9fba-cd8e44ccabfd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:14.414087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a679f315-be9b-403a-9fba-cd8e44ccabfd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:14.414958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a679f315-be9b-403a-9fba-cd8e44ccabfd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:14.453470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7c622398-4cf3-4349-b598-0f2f1e4a2d99 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:14.463166 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7c622398-4cf3-4349-b598-0f2f1e4a2d99 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.440107 Sep 10 20:59:14.470146 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1461/2994] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:14 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:14.501262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a3ed555a-1f11-4e3a-be04-a30e7f74f443 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:14.502291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a3ed555a-1f11-4e3a-be04-a30e7f74f443 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:14.511628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3ed555a-1f11-4e3a-be04-a30e7f74f443 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:14.512325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3ed555a-1f11-4e3a-be04-a30e7f74f443 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:14.512942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3ed555a-1f11-4e3a-be04-a30e7f74f443 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:14.513852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3ed555a-1f11-4e3a-be04-a30e7f74f443 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:14.514473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3ed555a-1f11-4e3a-be04-a30e7f74f443 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:14.515107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3ed555a-1f11-4e3a-be04-a30e7f74f443 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:15.106790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a679f315-be9b-403a-9fba-cd8e44ccabfd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:15.130684 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a679f315-be9b-403a-9fba-cd8e44ccabfd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1621 microversion: 2.1 time: 0.733294 Sep 10 20:59:15.131903 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1534/2995] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:14 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1621 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:15.140004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f0f8dd3b-8003-450a-8a03-52fe449d2f4f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:15.143655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f0f8dd3b-8003-450a-8a03-52fe449d2f4f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:15.162647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0f8dd3b-8003-450a-8a03-52fe449d2f4f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:15.182661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0f8dd3b-8003-450a-8a03-52fe449d2f4f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:15.183313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0f8dd3b-8003-450a-8a03-52fe449d2f4f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:15.184180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0f8dd3b-8003-450a-8a03-52fe449d2f4f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:15.184787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0f8dd3b-8003-450a-8a03-52fe449d2f4f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:15.185339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0f8dd3b-8003-450a-8a03-52fe449d2f4f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:15.542496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3ed555a-1f11-4e3a-be04-a30e7f74f443 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:15.555238 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a3ed555a-1f11-4e3a-be04-a30e7f74f443 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 1.058517 Sep 10 20:59:15.555839 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1462/2996] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:14 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:15.559511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f0f8dd3b-8003-450a-8a03-52fe449d2f4f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:15.574270 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f0f8dd3b-8003-450a-8a03-52fe449d2f4f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1317 microversion: 2.1 time: 0.440998 Sep 10 20:59:15.586659 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1535/2997] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:15 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:15.596451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0d12618-53cc-4564-b61f-a2698c65073e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:15.597350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0d12618-53cc-4564-b61f-a2698c65073e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:15.600028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4e62fdc-c6e3-4fff-8dfe-bfe8962a4e4b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:15.607253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e4e62fdc-c6e3-4fff-8dfe-bfe8962a4e4b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:15.617754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d12618-53cc-4564-b61f-a2698c65073e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:15.618520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d12618-53cc-4564-b61f-a2698c65073e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:15.619422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d12618-53cc-4564-b61f-a2698c65073e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:15.620588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e62fdc-c6e3-4fff-8dfe-bfe8962a4e4b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:15.622494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e62fdc-c6e3-4fff-8dfe-bfe8962a4e4b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:15.623063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d12618-53cc-4564-b61f-a2698c65073e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:15.623656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e62fdc-c6e3-4fff-8dfe-bfe8962a4e4b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:15.623863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d12618-53cc-4564-b61f-a2698c65073e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:15.624475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d12618-53cc-4564-b61f-a2698c65073e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:15.625340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e62fdc-c6e3-4fff-8dfe-bfe8962a4e4b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:15.626330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e62fdc-c6e3-4fff-8dfe-bfe8962a4e4b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:15.627992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e62fdc-c6e3-4fff-8dfe-bfe8962a4e4b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.120165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:16.173506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=60 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:16.182915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4e62fdc-c6e3-4fff-8dfe-bfe8962a4e4b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:16.203587 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e4e62fdc-c6e3-4fff-8dfe-bfe8962a4e4b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.615411 Sep 10 20:59:16.204968 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1536/2998] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:15 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:16.214983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:16.227204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:16.234518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Searching by: {'deleted': False, 'project_id': '38b49720bd644bed9a3504ff26f01768'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:59:16.253309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.254182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.254796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.255792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.256440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.257035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.318529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:59:16.327964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c0d12618-53cc-4564-b61f-a2698c65073e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:16.340712 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0d12618-53cc-4564-b61f-a2698c65073e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.777706 Sep 10 20:59:16.354975 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1463/2999] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:15 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:16.360164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5617687b-afba-4127-9067-ef7a0735fc34 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1221841625", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5617687b-afba-4127-9067-ef7a0735fc34 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 238 Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1221841625", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1221841625', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:16.374458 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 10 20:59:16.378517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:16.384678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5617687b-afba-4127-9067-ef7a0735fc34 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:16.385798 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5617687b-afba-4127-9067-ef7a0735fc34 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029477 Sep 10 20:59:16.387069 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1464/3000] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:59:16 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:59:16.391987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8f3d6cbf-5743-4a2c-b2e0-a14c564d0a57 req-49f160d1-ae5d-438f-9ff1-2bf07c5bfca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fb692b-5186-4333-ad32-a567de472d62", "name": "network-vif-deleted", "tag": "4e3266c3-685c-4364-9c48-5e262bf043c6"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:16.403649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8f3d6cbf-5743-4a2c-b2e0-a14c564d0a57 req-49f160d1-ae5d-438f-9ff1-2bf07c5bfca0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.404539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8f3d6cbf-5743-4a2c-b2e0-a14c564d0a57 req-49f160d1-ae5d-438f-9ff1-2bf07c5bfca0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.405427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8f3d6cbf-5743-4a2c-b2e0-a14c564d0a57 req-49f160d1-ae5d-438f-9ff1-2bf07c5bfca0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.414736 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1cfc3714-5e24-46f2-a82b-e490bbdcdd10 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.208394 Sep 10 20:59:16.418357 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8f3d6cbf-5743-4a2c-b2e0-a14c564d0a57 req-49f160d1-ae5d-438f-9ff1-2bf07c5bfca0 service nova] Creating event network-vif-deleted:4e3266c3-685c-4364-9c48-5e262bf043c6 for instance 37fb692b-5186-4333-ad32-a567de472d62 on nch1-master-1 Sep 10 20:59:16.423970 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8f3d6cbf-5743-4a2c-b2e0-a14c564d0a57 req-49f160d1-ae5d-438f-9ff1-2bf07c5bfca0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 Sep 10 20:59:16.426307 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1465/3001] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:16.432389 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1537/3002] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 20:59:16 2022] GET /compute/v2.1/servers => generated 340 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:16.433240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d907b1a9-0a78-492a-90e7-ce1d5ad683a1 req-7a9701d7-25ab-47cd-83a7-62df9ad269a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a009fbee-aff7-41a2-be0f-785d15e2e42a", "tag": "8bc3db35-62d4-4858-9844-3ba3bf0422c2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:16.437342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:16.446156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:16.447047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:16.449770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d907b1a9-0a78-492a-90e7-ce1d5ad683a1 req-7a9701d7-25ab-47cd-83a7-62df9ad269a9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.450410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d907b1a9-0a78-492a-90e7-ce1d5ad683a1 req-7a9701d7-25ab-47cd-83a7-62df9ad269a9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.451093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d907b1a9-0a78-492a-90e7-ce1d5ad683a1 req-7a9701d7-25ab-47cd-83a7-62df9ad269a9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.454496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.455347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.456776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.460063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.460569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.461021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.469240 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d907b1a9-0a78-492a-90e7-ce1d5ad683a1 req-7a9701d7-25ab-47cd-83a7-62df9ad269a9 service nova] Creating event network-changed:8bc3db35-62d4-4858-9844-3ba3bf0422c2 for instance a009fbee-aff7-41a2-be0f-785d15e2e42a on nch1-master-1 Sep 10 20:59:16.477040 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d907b1a9-0a78-492a-90e7-ce1d5ad683a1 req-7a9701d7-25ab-47cd-83a7-62df9ad269a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048790 Sep 10 20:59:16.477916 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1466/3003] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:16.484928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-77d14d7f-db94-44b5-88d3-a723d3f2bbda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:16.486236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-77d14d7f-db94-44b5-88d3-a723d3f2bbda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:16.496664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77d14d7f-db94-44b5-88d3-a723d3f2bbda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.497276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77d14d7f-db94-44b5-88d3-a723d3f2bbda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.497968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77d14d7f-db94-44b5-88d3-a723d3f2bbda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.498911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77d14d7f-db94-44b5-88d3-a723d3f2bbda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.499488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77d14d7f-db94-44b5-88d3-a723d3f2bbda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.500028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77d14d7f-db94-44b5-88d3-a723d3f2bbda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.514244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.514648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.515100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.515568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lazy-loading 'fault' on Instance uuid 37fb692b-5186-4333-ad32-a567de472d62 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:59:16.575906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:16.585297 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40963654-3c85-4d18-9ea0-8990baa1603b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 200 len: 1335 microversion: 2.1 time: 0.151762 Sep 10 20:59:16.591876 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1538/3004] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:16 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 1335 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:16.599800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:16.605087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:16.605986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Searching by: {'deleted': False, 'project_id': '38b49720bd644bed9a3504ff26f01768'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 20:59:16.620846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.621458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.622547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.624819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.625472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.627925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:16.688099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 20:59:16.776757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:16.783471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:16.784256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:16.784853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:17.017555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:17.018130 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40527e9d-d88a-4208-bfc4-1e25f1ad3c6e tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.424078 Sep 10 20:59:17.033867 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1539/3005] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 20:59:16 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:17.033867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-97f8c568-4419-40a4-b4b0-a871adb28267 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:17.033867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-97f8c568-4419-40a4-b4b0-a871adb28267 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:17.047469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8c568-4419-40a4-b4b0-a871adb28267 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:17.048610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8c568-4419-40a4-b4b0-a871adb28267 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:17.050321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8c568-4419-40a4-b4b0-a871adb28267 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:17.054132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8c568-4419-40a4-b4b0-a871adb28267 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:17.054772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8c568-4419-40a4-b4b0-a871adb28267 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:17.055332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8c568-4419-40a4-b4b0-a871adb28267 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:17.064487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:17.488456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-97f8c568-4419-40a4-b4b0-a871adb28267 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:17.498249 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-97f8c568-4419-40a4-b4b0-a871adb28267 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1317 microversion: 2.1 time: 0.476556 Sep 10 20:59:17.501594 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1540/3006] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:17 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:17.508573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dd995d74-ddbb-41f8-8065-194de76e54c6 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:17.563424 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dd995d74-ddbb-41f8-8065-194de76e54c6 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.059685 Sep 10 20:59:17.565452 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1541/3007] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 20:59:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:17.584371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7338a74c-aa6e-4b85-9ebb-15f0d63d569b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:17.585593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7338a74c-aa6e-4b85-9ebb-15f0d63d569b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:17.594117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7338a74c-aa6e-4b85-9ebb-15f0d63d569b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:17.595132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7338a74c-aa6e-4b85-9ebb-15f0d63d569b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:17.596167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7338a74c-aa6e-4b85-9ebb-15f0d63d569b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:17.597120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7338a74c-aa6e-4b85-9ebb-15f0d63d569b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:17.598864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7338a74c-aa6e-4b85-9ebb-15f0d63d569b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:17.599384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7338a74c-aa6e-4b85-9ebb-15f0d63d569b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:17.966638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7338a74c-aa6e-4b85-9ebb-15f0d63d569b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:17.980828 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7338a74c-aa6e-4b85-9ebb-15f0d63d569b tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.413385 Sep 10 20:59:18.002695 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1542/3008] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:17 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:18.008544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0dec610c-71bf-4c3a-bbf3-f0bddddb873f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:18.009327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0dec610c-71bf-4c3a-bbf3-f0bddddb873f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:18.037123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dec610c-71bf-4c3a-bbf3-f0bddddb873f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.037635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dec610c-71bf-4c3a-bbf3-f0bddddb873f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.038162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dec610c-71bf-4c3a-bbf3-f0bddddb873f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.039063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dec610c-71bf-4c3a-bbf3-f0bddddb873f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.039681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dec610c-71bf-4c3a-bbf3-f0bddddb873f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.040264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dec610c-71bf-4c3a-bbf3-f0bddddb873f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.100557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-77d14d7f-db94-44b5-88d3-a723d3f2bbda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:18.116693 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-77d14d7f-db94-44b5-88d3-a723d3f2bbda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 1.637223 Sep 10 20:59:18.131205 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1467/3009] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:16 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:18.144765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:18.145840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 37fb692b-5186-4333-ad32-a567de472d62] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:18.153762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.154654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.155325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.156351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.157026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.157677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.180621 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] HTTP exception thrown: Instance 37fb692b-5186-4333-ad32-a567de472d62 could not be found. Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Request method failure captured: Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 HTTP/1.1 Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPlIfEE6BUsYm6N9cc6J4sKvQx8zkdVi0_eGxve7idCE5St69TEoXloNJQbmDpLOYE4kW76RSsXwzH4ER5m-rWYbak-zkdFvTsFOuE5UWRW73UCQGyOtVDm5s0CSvgZ9e1C_-bLDziBI_eeTxSX1Lq4xDS48kCIhpdBe8v0QA9iMeLw Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4b1732129f3414fbc3f26fff6d039ec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4b1732129f3414fbc3f26fff6d039ec"}]}] Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d8b0a160808f4adda7be57cd535f0631 Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 37fb692b-5186-4333-ad32-a567de472d62 could not be found. Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '37fb692b-5186-4333-ad32-a567de472d62'} Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37fb692b-5186-4333-ad32-a567de472d62 could not be found. Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37fb692b-5186-4333-ad32-a567de472d62 could not be found. Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:18.183568 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:18.187499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:18.187499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:18.187499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:18.187499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:18.187499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:18.187499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:18.187499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37fb692b-5186-4333-ad32-a567de472d62 could not be found. Sep 10 20:59:18.187499 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:18.190012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Returning 404 to user: Instance 37fb692b-5186-4333-ad32-a567de472d62 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:18.191303 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d6e5a79e-56ae-437c-a1ba-093b42dd484e tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62" status: 404 len: 111 microversion: 2.1 time: 0.058666 Sep 10 20:59:18.192996 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1468/3010] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:18 2022] GET /compute/v2.1/servers/37fb692b-5186-4333-ad32-a567de472d62 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:18.198130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-206b6d49-f40d-4f5e-a536-54894e65914f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:18.198961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-206b6d49-f40d-4f5e-a536-54894e65914f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:18.208159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-206b6d49-f40d-4f5e-a536-54894e65914f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.209084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-206b6d49-f40d-4f5e-a536-54894e65914f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.209777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-206b6d49-f40d-4f5e-a536-54894e65914f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.210882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-206b6d49-f40d-4f5e-a536-54894e65914f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.211746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-206b6d49-f40d-4f5e-a536-54894e65914f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.212428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-206b6d49-f40d-4f5e-a536-54894e65914f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.249154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-206b6d49-f40d-4f5e-a536-54894e65914f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:59:18.432525 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-206b6d49-f40d-4f5e-a536-54894e65914f tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 204 len: 0 microversion: 2.1 time: 0.235476 Sep 10 20:59:18.446640 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1469/3011] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:59:18 2022] DELETE /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:59:18.470970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0dec610c-71bf-4c3a-bbf3-f0bddddb873f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:18.477368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bc581c4f-f6b9-4731-9c18-d2faed72ac2f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:18.479195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bc581c4f-f6b9-4731-9c18-d2faed72ac2f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:18.484269 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0dec610c-71bf-4c3a-bbf3-f0bddddb873f tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.478508 Sep 10 20:59:18.497914 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1543/3012] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:18 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:18.498964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc581c4f-f6b9-4731-9c18-d2faed72ac2f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.498964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc581c4f-f6b9-4731-9c18-d2faed72ac2f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.498964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc581c4f-f6b9-4731-9c18-d2faed72ac2f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.498964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc581c4f-f6b9-4731-9c18-d2faed72ac2f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.498964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc581c4f-f6b9-4731-9c18-d2faed72ac2f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.499320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d54d8524-50cf-4dfa-a081-632788acc9e7 req-87920986-355c-4ecc-bb05-f225a4d7582d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377f56f0-3163-4417-8d6b-ca4be8de2828", "name": "network-vif-plugged", "status": "completed", "tag": "7af13252-9cfc-4a98-a5da-d4f6e455291b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:18.499411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc581c4f-f6b9-4731-9c18-d2faed72ac2f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.538276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d54d8524-50cf-4dfa-a081-632788acc9e7 req-87920986-355c-4ecc-bb05-f225a4d7582d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.538785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d54d8524-50cf-4dfa-a081-632788acc9e7 req-87920986-355c-4ecc-bb05-f225a4d7582d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.539226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d54d8524-50cf-4dfa-a081-632788acc9e7 req-87920986-355c-4ecc-bb05-f225a4d7582d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.587454 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d54d8524-50cf-4dfa-a081-632788acc9e7 req-87920986-355c-4ecc-bb05-f225a4d7582d service nova] Creating event network-vif-plugged:7af13252-9cfc-4a98-a5da-d4f6e455291b for instance 377f56f0-3163-4417-8d6b-ca4be8de2828 on nch2-master-1 Sep 10 20:59:18.595593 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d54d8524-50cf-4dfa-a081-632788acc9e7 req-87920986-355c-4ecc-bb05-f225a4d7582d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108584 Sep 10 20:59:18.596583 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1544/3013] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:18.609388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9fd29df3-c329-43da-84ab-19eb9884e2ff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '.version_select at 0x7f993ff820d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:18.652763 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9fd29df3-c329-43da-84ab-19eb9884e2ff tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-623379754" status: 202 len: 0 microversion: 2.1 time: 0.054260 Sep 10 20:59:18.657031 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1545/3014] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 20:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-623379754 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:59:18.669328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cf23d5a2-7bce-4517-af58-1b57c61f4aec tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:18.670139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cf23d5a2-7bce-4517-af58-1b57c61f4aec tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:18.680642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf23d5a2-7bce-4517-af58-1b57c61f4aec tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.681198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf23d5a2-7bce-4517-af58-1b57c61f4aec tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.681657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf23d5a2-7bce-4517-af58-1b57c61f4aec tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.682652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf23d5a2-7bce-4517-af58-1b57c61f4aec tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.683926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf23d5a2-7bce-4517-af58-1b57c61f4aec tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.684376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf23d5a2-7bce-4517-af58-1b57c61f4aec tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.876334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf23d5a2-7bce-4517-af58-1b57c61f4aec tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:18.892690 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cf23d5a2-7bce-4517-af58-1b57c61f4aec tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1714 microversion: 2.1 time: 0.234214 Sep 10 20:59:18.893903 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1546/3015] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:18 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1714 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:18.899493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4b323062-a0cd-40be-9b9a-540b2f197e5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:18.905539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4b323062-a0cd-40be-9b9a-540b2f197e5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:18.920155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b323062-a0cd-40be-9b9a-540b2f197e5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.922469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b323062-a0cd-40be-9b9a-540b2f197e5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.923806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b323062-a0cd-40be-9b9a-540b2f197e5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:18.923806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b323062-a0cd-40be-9b9a-540b2f197e5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:18.928470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b323062-a0cd-40be-9b9a-540b2f197e5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:18.929441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b323062-a0cd-40be-9b9a-540b2f197e5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:19.103005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc581c4f-f6b9-4731-9c18-d2faed72ac2f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:19.122574 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bc581c4f-f6b9-4731-9c18-d2faed72ac2f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.672616 Sep 10 20:59:19.125792 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1470/3016] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:18 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:19.437911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2de4249e-9b3f-42e8-91fc-1ae7df71fce6 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: .version_select at 0x7f99441e0700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-439009977", "description": "tempest-description-1422824050"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:19.466726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b323062-a0cd-40be-9b9a-540b2f197e5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:19.506817 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4b323062-a0cd-40be-9b9a-540b2f197e5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1317 microversion: 2.1 time: 0.606647 Sep 10 20:59:19.510366 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1547/3017] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:18 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:19.527671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-407164b6-2dfe-4d01-9122-e538b7e7aaea tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:19.530284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-407164b6-2dfe-4d01-9122-e538b7e7aaea tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:19.551153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407164b6-2dfe-4d01-9122-e538b7e7aaea tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:19.553459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407164b6-2dfe-4d01-9122-e538b7e7aaea tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:19.554343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407164b6-2dfe-4d01-9122-e538b7e7aaea tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:19.557779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407164b6-2dfe-4d01-9122-e538b7e7aaea tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:19.558647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407164b6-2dfe-4d01-9122-e538b7e7aaea tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:19.561261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407164b6-2dfe-4d01-9122-e538b7e7aaea tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:19.997280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-407164b6-2dfe-4d01-9122-e538b7e7aaea tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:20.009109 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-407164b6-2dfe-4d01-9122-e538b7e7aaea tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.497399 Sep 10 20:59:20.023144 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1548/3018] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:19 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:20.029305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-47c0062f-6b93-418e-976e-b59a5c290d05 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1448878812", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-47c0062f-6b93-418e-976e-b59a5c290d05 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 235 Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1448878812", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1448878812', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:20.036569 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-47c0062f-6b93-418e-976e-b59a5c290d05 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:20.041106 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-47c0062f-6b93-418e-976e-b59a5c290d05 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.014390 Sep 10 20:59:20.043100 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1549/3019] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:59:20 2022] POST /compute/v2.1/servers => generated 133 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:59:20.048622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f022413e-b36d-439a-a07d-e72b77d5c4f8 req-f68ac24e-9a4b-48fe-b682-010778001a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18936341-5f68-4676-abb6-eb63c45da66e", "tag": "5c189b4d-3548-4392-b69f-af791fa93755"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:20.061886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f022413e-b36d-439a-a07d-e72b77d5c4f8 req-f68ac24e-9a4b-48fe-b682-010778001a5a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:20.061886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f022413e-b36d-439a-a07d-e72b77d5c4f8 req-f68ac24e-9a4b-48fe-b682-010778001a5a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:20.062729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f022413e-b36d-439a-a07d-e72b77d5c4f8 req-f68ac24e-9a4b-48fe-b682-010778001a5a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:20.083212 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f022413e-b36d-439a-a07d-e72b77d5c4f8 req-f68ac24e-9a4b-48fe-b682-010778001a5a service nova] Creating event network-changed:5c189b4d-3548-4392-b69f-af791fa93755 for instance 18936341-5f68-4676-abb6-eb63c45da66e on nch1-master-1 Sep 10 20:59:20.092528 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f022413e-b36d-439a-a07d-e72b77d5c4f8 req-f68ac24e-9a4b-48fe-b682-010778001a5a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048342 Sep 10 20:59:20.094296 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1550/3020] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:20.096289 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2de4249e-9b3f-42e8-91fc-1ae7df71fce6 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.969125 Sep 10 20:59:20.104149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e8f9ca5d-92b1-4310-9a37-98a8374ddc22 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:20.106026 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1471/3021] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:59:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:20.108089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e8f9ca5d-92b1-4310-9a37-98a8374ddc22 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:20.110818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d867ec4-ffb0-4c47-bbc4-e639ba1d2957 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:20.111455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d867ec4-ffb0-4c47-bbc4-e639ba1d2957 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:20.119099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8f9ca5d-92b1-4310-9a37-98a8374ddc22 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:20.119839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8f9ca5d-92b1-4310-9a37-98a8374ddc22 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:20.120601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8f9ca5d-92b1-4310-9a37-98a8374ddc22 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:20.121727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8f9ca5d-92b1-4310-9a37-98a8374ddc22 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:20.122406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8f9ca5d-92b1-4310-9a37-98a8374ddc22 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:20.123004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8f9ca5d-92b1-4310-9a37-98a8374ddc22 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:20.129514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d867ec4-ffb0-4c47-bbc4-e639ba1d2957 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:20.130081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d867ec4-ffb0-4c47-bbc4-e639ba1d2957 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:20.130589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d867ec4-ffb0-4c47-bbc4-e639ba1d2957 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:20.132481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d867ec4-ffb0-4c47-bbc4-e639ba1d2957 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:20.133294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d867ec4-ffb0-4c47-bbc4-e639ba1d2957 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:20.133918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d867ec4-ffb0-4c47-bbc4-e639ba1d2957 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:20.352273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e8f9ca5d-92b1-4310-9a37-98a8374ddc22 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:20.362830 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e8f9ca5d-92b1-4310-9a37-98a8374ddc22 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.266922 Sep 10 20:59:20.373867 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1551/3022] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:20 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:20.386935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0f7acf70-02e4-41c8-96a6-f69e94ad0c3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:20.387819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0f7acf70-02e4-41c8-96a6-f69e94ad0c3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:20.396490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f7acf70-02e4-41c8-96a6-f69e94ad0c3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:20.397912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f7acf70-02e4-41c8-96a6-f69e94ad0c3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:20.398569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f7acf70-02e4-41c8-96a6-f69e94ad0c3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:20.400238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f7acf70-02e4-41c8-96a6-f69e94ad0c3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:20.400912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f7acf70-02e4-41c8-96a6-f69e94ad0c3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:20.401723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f7acf70-02e4-41c8-96a6-f69e94ad0c3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:20.430469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3d867ec4-ffb0-4c47-bbc4-e639ba1d2957 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:20.435410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:20.447019 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d867ec4-ffb0-4c47-bbc4-e639ba1d2957 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1714 microversion: 2.1 time: 0.339791 Sep 10 20:59:20.450855 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1472/3023] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:20 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1714 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:20.458911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d5bb75cd-57b8-450e-8a59-8940155347b6 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: .version_select at 0x7f99441d6280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-42349494", "description": "tempest-description-1399926552"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:20.606906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f7acf70-02e4-41c8-96a6-f69e94ad0c3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:20.618863 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0f7acf70-02e4-41c8-96a6-f69e94ad0c3c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.252562 Sep 10 20:59:20.634721 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1552/3024] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:20 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:20.733198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1838247442", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "86ee85c4-0cd6-405b-9585-2767fd1d9f6d"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:20.762116 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d5bb75cd-57b8-450e-8a59-8940155347b6 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.309918 Sep 10 20:59:20.763350 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1473/3025] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:59:20 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:20.788830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-96f09f48-c4de-4c45-aebf-f94f29a7c3ad tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:20.789533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-96f09f48-c4de-4c45-aebf-f94f29a7c3ad tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:20.796294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96f09f48-c4de-4c45-aebf-f94f29a7c3ad tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:20.797504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96f09f48-c4de-4c45-aebf-f94f29a7c3ad tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:20.797991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96f09f48-c4de-4c45-aebf-f94f29a7c3ad tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:20.798778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96f09f48-c4de-4c45-aebf-f94f29a7c3ad tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:20.799314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96f09f48-c4de-4c45-aebf-f94f29a7c3ad tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:20.811945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96f09f48-c4de-4c45-aebf-f94f29a7c3ad tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:20.820186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] validate_networks() for [('86ee85c4-0cd6-405b-9585-2767fd1d9f6d', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:59:21.039243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-96f09f48-c4de-4c45-aebf-f94f29a7c3ad tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:21.053221 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-96f09f48-c4de-4c45-aebf-f94f29a7c3ad tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1467 microversion: 2.1 time: 0.288561 Sep 10 20:59:21.058782 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1474/3026] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:20 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1467 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:21.078302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98944f5f-446d-4903-a927-e46e635fceb1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:21.079318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-98944f5f-446d-4903-a927-e46e635fceb1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:21.087801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98944f5f-446d-4903-a927-e46e635fceb1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:21.088826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98944f5f-446d-4903-a927-e46e635fceb1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:21.089812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98944f5f-446d-4903-a927-e46e635fceb1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:21.090908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98944f5f-446d-4903-a927-e46e635fceb1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:21.091542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98944f5f-446d-4903-a927-e46e635fceb1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:21.092251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98944f5f-446d-4903-a927-e46e635fceb1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:21.353871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-98944f5f-446d-4903-a927-e46e635fceb1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:21.363309 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-98944f5f-446d-4903-a927-e46e635fceb1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.303265 Sep 10 20:59:21.365235 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1475/3027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:21 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:21.373736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1014448241", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "0e6ac760-d4f3-4594-843f-5abf4ec869f0"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:21.494427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] validate_networks() for [('0e6ac760-d4f3-4594-843f-5abf4ec869f0', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:59:21.793820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:59:21.795093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:59:21.795797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:59:21.796588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:59:21.797225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:59:21.817598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:21.820577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:21.821737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:21.823539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:21.824331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:21.825121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:21.850068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Getting quotas for project 329b758edee649078291d9cb0eda3feb. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:59:21.858761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Getting quotas for user fd0c6e0e7b1a44c69ec9f4685ee39398 and project 329b758edee649078291d9cb0eda3feb. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:59:21.879896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:59:21.883675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:59:21.996552 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e23edd49-1c15-4afc-ac09-ec8f20ac86c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.360185 Sep 10 20:59:22.005363 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1553/3028] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 20:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 20:59:22.017613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5601648c-327d-4615-ad05-6f628c9821c8 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:22.019397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5601648c-327d-4615-ad05-6f628c9821c8 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:22.034615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5601648c-327d-4615-ad05-6f628c9821c8 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:22.036543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5601648c-327d-4615-ad05-6f628c9821c8 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:22.039691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5601648c-327d-4615-ad05-6f628c9821c8 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:22.041488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5601648c-327d-4615-ad05-6f628c9821c8 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:22.042246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5601648c-327d-4615-ad05-6f628c9821c8 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:22.044480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5601648c-327d-4615-ad05-6f628c9821c8 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:22.310560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:59:22.311633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:59:22.312337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:59:22.313238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:59:22.314361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:59:22.326155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:22.327049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:22.328014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:22.329099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:22.329790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:22.330494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:22.367874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Getting quotas for project 7289ce4dcfe9474ea286bcbe7ef179a1. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:59:22.384838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Getting quotas for user 1b5bc12930c946ccaffcc524795ad965 and project 7289ce4dcfe9474ea286bcbe7ef179a1. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:59:22.385508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5601648c-327d-4615-ad05-6f628c9821c8 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:22.397727 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5601648c-327d-4615-ad05-6f628c9821c8 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.389803 Sep 10 20:59:22.399448 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1554/3029] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:22 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:22.405008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:59:22.408688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:59:22.422282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7c2111e2-20b1-4e3a-bde5-0495a8760c44 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:22.422962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7c2111e2-20b1-4e3a-bde5-0495a8760c44 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:22.435418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c2111e2-20b1-4e3a-bde5-0495a8760c44 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:22.435930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c2111e2-20b1-4e3a-bde5-0495a8760c44 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:22.436501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c2111e2-20b1-4e3a-bde5-0495a8760c44 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:22.437214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c2111e2-20b1-4e3a-bde5-0495a8760c44 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:22.437745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c2111e2-20b1-4e3a-bde5-0495a8760c44 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:22.438295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c2111e2-20b1-4e3a-bde5-0495a8760c44 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:22.490481 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5d444587-1502-44fc-836e-e9d09bc633ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123847 Sep 10 20:59:22.498132 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1476/3030] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:59:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:59:22.503379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3db4ec2b-1a1b-4a06-b930-26af911b592e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:22.504688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3db4ec2b-1a1b-4a06-b930-26af911b592e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:22.513400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3db4ec2b-1a1b-4a06-b930-26af911b592e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:22.515395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3db4ec2b-1a1b-4a06-b930-26af911b592e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:22.516249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3db4ec2b-1a1b-4a06-b930-26af911b592e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:22.517576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3db4ec2b-1a1b-4a06-b930-26af911b592e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:22.518473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3db4ec2b-1a1b-4a06-b930-26af911b592e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:22.519498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3db4ec2b-1a1b-4a06-b930-26af911b592e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:23.016015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7c2111e2-20b1-4e3a-bde5-0495a8760c44 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:23.027872 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7c2111e2-20b1-4e3a-bde5-0495a8760c44 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 200 len: 1468 microversion: 2.1 time: 0.617178 Sep 10 20:59:23.028620 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1555/3031] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:22 2022] GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 1468 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:23.042093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e07effee-5ce1-4e78-a42e-1fe0eb6f507e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:23.045544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e07effee-5ce1-4e78-a42e-1fe0eb6f507e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: e66b697a-fcfa-4ab9-9c18-88f14a33a7af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:23.066654 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e07effee-5ce1-4e78-a42e-1fe0eb6f507e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance e66b697a-fcfa-4ab9-9c18-88f14a33a7af could not be found. Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e07effee-5ce1-4e78-a42e-1fe0eb6f507e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/e66b697a-fcfa-4ab9-9c18-88f14a33a7af/action HTTP/1.1 Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 13 Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: {"pause": {}} Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance e66b697a-fcfa-4ab9-9c18-88f14a33a7af could not be found. Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e66b697a-fcfa-4ab9-9c18-88f14a33a7af', 'body': {'pause': {}}} Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e66b697a-fcfa-4ab9-9c18-88f14a33a7af could not be found. Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e66b697a-fcfa-4ab9-9c18-88f14a33a7af could not be found. Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:23.078940 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:23.084483 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:23.084483 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:23.084483 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e66b697a-fcfa-4ab9-9c18-88f14a33a7af could not be found. Sep 10 20:59:23.084483 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:23.084483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e07effee-5ce1-4e78-a42e-1fe0eb6f507e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance e66b697a-fcfa-4ab9-9c18-88f14a33a7af could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:23.085601 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e07effee-5ce1-4e78-a42e-1fe0eb6f507e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/e66b697a-fcfa-4ab9-9c18-88f14a33a7af/action" status: 404 len: 111 microversion: 2.1 time: 0.054867 Sep 10 20:59:23.087113 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1556/3032] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:23 2022] POST /compute/v2.1/servers/e66b697a-fcfa-4ab9-9c18-88f14a33a7af/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:23.099938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9b5de32e-b61b-4ae0-bbba-1ca26fcb6be5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:23.100798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9b5de32e-b61b-4ae0-bbba-1ca26fcb6be5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:23.150189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3db4ec2b-1a1b-4a06-b930-26af911b592e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:23.151240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5de32e-b61b-4ae0-bbba-1ca26fcb6be5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:23.151750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5de32e-b61b-4ae0-bbba-1ca26fcb6be5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:23.152200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5de32e-b61b-4ae0-bbba-1ca26fcb6be5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:23.152930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5de32e-b61b-4ae0-bbba-1ca26fcb6be5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:23.158261 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3db4ec2b-1a1b-4a06-b930-26af911b592e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.658936 Sep 10 20:59:23.158695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5de32e-b61b-4ae0-bbba-1ca26fcb6be5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:23.159334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b5de32e-b61b-4ae0-bbba-1ca26fcb6be5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:23.180992 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1477/3033] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:22 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:23.196148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:23.196943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:23.207322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:23.222586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:23.224132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:23.225326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:23.225981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:23.226619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:23.377856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:23.396388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:23.403224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:23.404480 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d6dfcd2d-7972-4a48-bf82-88132d4c59c7 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1263 microversion: 2.21 time: 0.222385 Sep 10 20:59:23.410973 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1478/3034] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:23 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1263 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:23.416076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d5d047c3-cecb-493b-8c8a-fd6bea9bbbb9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:23.416779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d5d047c3-cecb-493b-8c8a-fd6bea9bbbb9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:23.559768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d5d047c3-cecb-493b-8c8a-fd6bea9bbbb9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:23.569968 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d5d047c3-cecb-493b-8c8a-fd6bea9bbbb9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1216 microversion: 2.1 time: 0.156718 Sep 10 20:59:23.570605 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1479/3035] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:23 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:23.583940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0d36018c-2995-417b-9c7c-4cf168d12450 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-902898239"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:23.591616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0d36018c-2995-417b-9c7c-4cf168d12450 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:23.593079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9b5de32e-b61b-4ae0-bbba-1ca26fcb6be5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:23.604275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d36018c-2995-417b-9c7c-4cf168d12450 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:23.604592 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9b5de32e-b61b-4ae0-bbba-1ca26fcb6be5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1714 microversion: 2.1 time: 0.514892 Sep 10 20:59:23.607195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d36018c-2995-417b-9c7c-4cf168d12450 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:23.607941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d36018c-2995-417b-9c7c-4cf168d12450 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:23.609487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d36018c-2995-417b-9c7c-4cf168d12450 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:23.611174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d36018c-2995-417b-9c7c-4cf168d12450 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:23.613932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d36018c-2995-417b-9c7c-4cf168d12450 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:23.621085 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1557/3036] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:23 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1714 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:23.628121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c143ecb8-5ea2-4112-8c1b-6505c1bd1452 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:23.629193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c143ecb8-5ea2-4112-8c1b-6505c1bd1452 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:23.636929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c143ecb8-5ea2-4112-8c1b-6505c1bd1452 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:23.637661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c143ecb8-5ea2-4112-8c1b-6505c1bd1452 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:23.638759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c143ecb8-5ea2-4112-8c1b-6505c1bd1452 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:23.639690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c143ecb8-5ea2-4112-8c1b-6505c1bd1452 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:23.640356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c143ecb8-5ea2-4112-8c1b-6505c1bd1452 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:23.641039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c143ecb8-5ea2-4112-8c1b-6505c1bd1452 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:23.951321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c143ecb8-5ea2-4112-8c1b-6505c1bd1452 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:23.963672 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c143ecb8-5ea2-4112-8c1b-6505c1bd1452 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.340637 Sep 10 20:59:23.964856 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1558/3037] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:23 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:23.972954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92c89f6f-b3cf-4cda-98d8-d9a6b449d2c4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:23.977767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-92c89f6f-b3cf-4cda-98d8-d9a6b449d2c4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:23.982076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:24.003017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92c89f6f-b3cf-4cda-98d8-d9a6b449d2c4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.004470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92c89f6f-b3cf-4cda-98d8-d9a6b449d2c4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.005310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92c89f6f-b3cf-4cda-98d8-d9a6b449d2c4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.006315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92c89f6f-b3cf-4cda-98d8-d9a6b449d2c4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.007013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92c89f6f-b3cf-4cda-98d8-d9a6b449d2c4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.007717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92c89f6f-b3cf-4cda-98d8-d9a6b449d2c4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.020814 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0d36018c-2995-417b-9c7c-4cf168d12450 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "POST /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6/action" status: 202 len: 0 microversion: 2.1 time: 0.447711 Sep 10 20:59:24.022941 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1480/3038] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:23 2022] POST /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 20:59:24.030186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fe2ceba7-12e1-42b0-be89-d74577bc1f14 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:24.031261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fe2ceba7-12e1-42b0-be89-d74577bc1f14 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:24.038935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe2ceba7-12e1-42b0-be89-d74577bc1f14 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.040440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe2ceba7-12e1-42b0-be89-d74577bc1f14 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.041105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe2ceba7-12e1-42b0-be89-d74577bc1f14 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.042580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe2ceba7-12e1-42b0-be89-d74577bc1f14 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.043237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe2ceba7-12e1-42b0-be89-d74577bc1f14 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.043898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe2ceba7-12e1-42b0-be89-d74577bc1f14 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.089804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-92c89f6f-b3cf-4cda-98d8-d9a6b449d2c4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:59:24.272648 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-92c89f6f-b3cf-4cda-98d8-d9a6b449d2c4 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 204 len: 0 microversion: 2.1 time: 0.306217 Sep 10 20:59:24.273260 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1559/3039] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:59:23 2022] DELETE /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:59:24.283513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a7f923af-f67b-4ecd-b8d9-ca92bcdc6349 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:24.284253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a7f923af-f67b-4ecd-b8d9-ca92bcdc6349 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:24.310372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7f923af-f67b-4ecd-b8d9-ca92bcdc6349 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.310991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7f923af-f67b-4ecd-b8d9-ca92bcdc6349 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.311652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7f923af-f67b-4ecd-b8d9-ca92bcdc6349 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.312581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7f923af-f67b-4ecd-b8d9-ca92bcdc6349 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.313244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7f923af-f67b-4ecd-b8d9-ca92bcdc6349 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.313891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7f923af-f67b-4ecd-b8d9-ca92bcdc6349 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.348705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fe2ceba7-12e1-42b0-be89-d74577bc1f14 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:24.367377 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fe2ceba7-12e1-42b0-be89-d74577bc1f14 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.338817 Sep 10 20:59:24.369703 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1481/3040] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:24 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:24.381052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91bb2344-0bcd-41dc-b178-b7aafeb550e0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99441e0b80>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:24.501775 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91bb2344-0bcd-41dc-b178-b7aafeb550e0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.130512 Sep 10 20:59:24.502806 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1482/3041] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:24 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:24.514145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cbfc5b5d-5b1e-43fe-b087-87dcdbd8e25a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:24.515145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cbfc5b5d-5b1e-43fe-b087-87dcdbd8e25a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:24.526169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbfc5b5d-5b1e-43fe-b087-87dcdbd8e25a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.528567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbfc5b5d-5b1e-43fe-b087-87dcdbd8e25a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.530331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbfc5b5d-5b1e-43fe-b087-87dcdbd8e25a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.531546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbfc5b5d-5b1e-43fe-b087-87dcdbd8e25a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.543045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbfc5b5d-5b1e-43fe-b087-87dcdbd8e25a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.547936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbfc5b5d-5b1e-43fe-b087-87dcdbd8e25a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.639566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a7f923af-f67b-4ecd-b8d9-ca92bcdc6349 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:24.649772 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a7f923af-f67b-4ecd-b8d9-ca92bcdc6349 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.375047 Sep 10 20:59:24.662480 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1560/3042] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:24 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:24.662480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c06629b0-76da-40f1-a686-a57a07eff22f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:24.662682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c06629b0-76da-40f1-a686-a57a07eff22f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:24.677730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c06629b0-76da-40f1-a686-a57a07eff22f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.678609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c06629b0-76da-40f1-a686-a57a07eff22f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.679273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c06629b0-76da-40f1-a686-a57a07eff22f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.680216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c06629b0-76da-40f1-a686-a57a07eff22f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.680958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c06629b0-76da-40f1-a686-a57a07eff22f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.682178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c06629b0-76da-40f1-a686-a57a07eff22f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.703257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:24.866117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c06629b0-76da-40f1-a686-a57a07eff22f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:24.875121 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c06629b0-76da-40f1-a686-a57a07eff22f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1508 microversion: 2.1 time: 0.219296 Sep 10 20:59:24.887192 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1561/3043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:24 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:24.899565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:24.900483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:24.907326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.908097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.908709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:24.909589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:24.910354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:24.911095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.005399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:25.014061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:25.015588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:25.017097 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e21e6325-1d80-47ff-bf8c-393cb924645b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1319 microversion: 2.21 time: 0.122326 Sep 10 20:59:25.018057 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1562/3044] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:24 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1319 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:25.023847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-392e81eb-b8d2-48f3-9d91-fd393383fed8 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:25.024482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-392e81eb-b8d2-48f3-9d91-fd393383fed8 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:25.031560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-392e81eb-b8d2-48f3-9d91-fd393383fed8 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.032308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-392e81eb-b8d2-48f3-9d91-fd393383fed8 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.033003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-392e81eb-b8d2-48f3-9d91-fd393383fed8 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.033904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-392e81eb-b8d2-48f3-9d91-fd393383fed8 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.034535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-392e81eb-b8d2-48f3-9d91-fd393383fed8 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.034967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-392e81eb-b8d2-48f3-9d91-fd393383fed8 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.108233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-392e81eb-b8d2-48f3-9d91-fd393383fed8 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:25.119921 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-392e81eb-b8d2-48f3-9d91-fd393383fed8 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1268 microversion: 2.1 time: 0.100581 Sep 10 20:59:25.121187 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1563/3045] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:25 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1268 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:25.126815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-01a2612d-7f4c-4d5c-b047-9339308406d5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:25.128237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-01a2612d-7f4c-4d5c-b047-9339308406d5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:25.135970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a2612d-7f4c-4d5c-b047-9339308406d5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.136780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a2612d-7f4c-4d5c-b047-9339308406d5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.137511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a2612d-7f4c-4d5c-b047-9339308406d5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.139207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a2612d-7f4c-4d5c-b047-9339308406d5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.139910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a2612d-7f4c-4d5c-b047-9339308406d5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.140624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a2612d-7f4c-4d5c-b047-9339308406d5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.229180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cbfc5b5d-5b1e-43fe-b087-87dcdbd8e25a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:25.237884 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cbfc5b5d-5b1e-43fe-b087-87dcdbd8e25a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.733763 Sep 10 20:59:25.240578 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1483/3046] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:24 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:25.246361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-81604366-03f0-4544-80f4-c4f0b55dfec3 req-68e77f64-c0f6-401d-8f86-107bb08bf782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba630e24-db2e-474f-80f7-56ba4cbec4c2", "name": "network-vif-unplugged", "status": "completed", "tag": "5a38418e-5af5-4900-8ec5-7795e632024b"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:25.262849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-81604366-03f0-4544-80f4-c4f0b55dfec3 req-68e77f64-c0f6-401d-8f86-107bb08bf782 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.263516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-81604366-03f0-4544-80f4-c4f0b55dfec3 req-68e77f64-c0f6-401d-8f86-107bb08bf782 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.264069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-81604366-03f0-4544-80f4-c4f0b55dfec3 req-68e77f64-c0f6-401d-8f86-107bb08bf782 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.280223 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-81604366-03f0-4544-80f4-c4f0b55dfec3 req-68e77f64-c0f6-401d-8f86-107bb08bf782 service nova] Creating event network-vif-unplugged:5a38418e-5af5-4900-8ec5-7795e632024b for instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 on nch1-master-1 Sep 10 20:59:25.287126 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-81604366-03f0-4544-80f4-c4f0b55dfec3 req-68e77f64-c0f6-401d-8f86-107bb08bf782 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044829 Sep 10 20:59:25.288485 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1484/3047] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:25.303280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fa3a48ca-08d3-4b89-8019-42fc8958f6c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:25.304208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fa3a48ca-08d3-4b89-8019-42fc8958f6c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:25.312887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa3a48ca-08d3-4b89-8019-42fc8958f6c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.314057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa3a48ca-08d3-4b89-8019-42fc8958f6c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.314630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa3a48ca-08d3-4b89-8019-42fc8958f6c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.315399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa3a48ca-08d3-4b89-8019-42fc8958f6c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.316060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa3a48ca-08d3-4b89-8019-42fc8958f6c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.317342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa3a48ca-08d3-4b89-8019-42fc8958f6c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.372276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-01a2612d-7f4c-4d5c-b047-9339308406d5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:25.383546 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-01a2612d-7f4c-4d5c-b047-9339308406d5 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1714 microversion: 2.1 time: 0.260920 Sep 10 20:59:25.402539 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1564/3048] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:25 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1714 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:25.421738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-47e62a67-2565-452a-804e-5445e24238e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:25.422512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-47e62a67-2565-452a-804e-5445e24238e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:25.435284 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fa3a48ca-08d3-4b89-8019-42fc8958f6c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 202 len: 0 microversion: 2.1 time: 0.142434 Sep 10 20:59:25.435773 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1485/3049] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:25 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:59:25.446569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47e62a67-2565-452a-804e-5445e24238e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.447080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47e62a67-2565-452a-804e-5445e24238e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.447526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47e62a67-2565-452a-804e-5445e24238e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.448240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47e62a67-2565-452a-804e-5445e24238e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.448697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47e62a67-2565-452a-804e-5445e24238e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.449134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-47e62a67-2565-452a-804e-5445e24238e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.450147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b617f449-ff15-42a6-ae17-ca0122e582d1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:25.451186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b617f449-ff15-42a6-ae17-ca0122e582d1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:25.462872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b617f449-ff15-42a6-ae17-ca0122e582d1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.463506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b617f449-ff15-42a6-ae17-ca0122e582d1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.464116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b617f449-ff15-42a6-ae17-ca0122e582d1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.465347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b617f449-ff15-42a6-ae17-ca0122e582d1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.478085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b617f449-ff15-42a6-ae17-ca0122e582d1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.480089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b617f449-ff15-42a6-ae17-ca0122e582d1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.672783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-47e62a67-2565-452a-804e-5445e24238e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:25.686247 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-47e62a67-2565-452a-804e-5445e24238e2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.282071 Sep 10 20:59:25.687228 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1565/3050] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:25 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:25.694312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-efbac9aa-63d0-4dbc-abdb-a380fcb890df tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944178280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:25.755573 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-efbac9aa-63d0-4dbc-abdb-a380fcb890df tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.066794 Sep 10 20:59:25.756797 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1566/3051] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:25 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:25.843007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b617f449-ff15-42a6-ae17-ca0122e582d1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:25.846746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-21e73cff-8200-4f20-98c8-d585a4b14d91 req-1aee6a94-270c-488f-8ce2-2e698baaa83b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba630e24-db2e-474f-80f7-56ba4cbec4c2", "name": "network-vif-deleted", "tag": "5a38418e-5af5-4900-8ec5-7795e632024b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:25.853356 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b617f449-ff15-42a6-ae17-ca0122e582d1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1509 microversion: 2.1 time: 0.412751 Sep 10 20:59:25.858016 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1486/3052] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:25 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:25.858913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-21e73cff-8200-4f20-98c8-d585a4b14d91 req-1aee6a94-270c-488f-8ce2-2e698baaa83b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.859411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-21e73cff-8200-4f20-98c8-d585a4b14d91 req-1aee6a94-270c-488f-8ce2-2e698baaa83b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.859851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-21e73cff-8200-4f20-98c8-d585a4b14d91 req-1aee6a94-270c-488f-8ce2-2e698baaa83b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.872271 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-21e73cff-8200-4f20-98c8-d585a4b14d91 req-1aee6a94-270c-488f-8ce2-2e698baaa83b service nova] Creating event network-vif-deleted:5a38418e-5af5-4900-8ec5-7795e632024b for instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 on nch1-master-1 Sep 10 20:59:25.878477 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-21e73cff-8200-4f20-98c8-d585a4b14d91 req-1aee6a94-270c-488f-8ce2-2e698baaa83b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035536 Sep 10 20:59:25.879738 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1567/3053] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:25.905704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7485cdb5-a5b7-4249-b286-7f453fe42c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:25.907313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7485cdb5-a5b7-4249-b286-7f453fe42c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:25.914347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7485cdb5-a5b7-4249-b286-7f453fe42c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.914992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7485cdb5-a5b7-4249-b286-7f453fe42c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.915444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7485cdb5-a5b7-4249-b286-7f453fe42c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:25.916382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7485cdb5-a5b7-4249-b286-7f453fe42c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:25.917301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7485cdb5-a5b7-4249-b286-7f453fe42c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:25.917982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7485cdb5-a5b7-4249-b286-7f453fe42c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.042825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:26.043541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:26.051363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.051886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.052712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.055906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7485cdb5-a5b7-4249-b286-7f453fe42c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:26.059964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.060465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.060913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.069782 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7485cdb5-a5b7-4249-b286-7f453fe42c83 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1508 microversion: 2.1 time: 0.167930 Sep 10 20:59:26.070690 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1487/3054] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:25 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:26.125784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:26.134276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:26.135750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:26.136874 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e682f372-d50b-4f5f-a44f-83e3546472f9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1319 microversion: 2.21 time: 0.098493 Sep 10 20:59:26.137449 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1568/3055] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:26 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:59:26.155480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d5106be1-4f21-4f09-95a9-de740bf4c734 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:26.156118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d5106be1-4f21-4f09-95a9-de740bf4c734 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:26.163078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5106be1-4f21-4f09-95a9-de740bf4c734 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.163569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5106be1-4f21-4f09-95a9-de740bf4c734 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.164209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5106be1-4f21-4f09-95a9-de740bf4c734 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.164898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5106be1-4f21-4f09-95a9-de740bf4c734 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.165359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5106be1-4f21-4f09-95a9-de740bf4c734 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.166007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5106be1-4f21-4f09-95a9-de740bf4c734 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.228170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d5106be1-4f21-4f09-95a9-de740bf4c734 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:26.235992 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d5106be1-4f21-4f09-95a9-de740bf4c734 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1268 microversion: 2.1 time: 0.084764 Sep 10 20:59:26.236584 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1488/3056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:26 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1268 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:26.261529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f35b607f-f29b-4fcf-9bc8-61ac3661c872 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:26.262163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f35b607f-f29b-4fcf-9bc8-61ac3661c872 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:26.268225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f35b607f-f29b-4fcf-9bc8-61ac3661c872 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.268712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f35b607f-f29b-4fcf-9bc8-61ac3661c872 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.269149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f35b607f-f29b-4fcf-9bc8-61ac3661c872 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.270169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f35b607f-f29b-4fcf-9bc8-61ac3661c872 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.270830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f35b607f-f29b-4fcf-9bc8-61ac3661c872 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.271263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f35b607f-f29b-4fcf-9bc8-61ac3661c872 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.403504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f35b607f-f29b-4fcf-9bc8-61ac3661c872 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:26.410972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f77024f5-12d7-483c-b3b1-23e5de3b2616 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:26.411594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f77024f5-12d7-483c-b3b1-23e5de3b2616 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:26.412426 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f35b607f-f29b-4fcf-9bc8-61ac3661c872 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.154662 Sep 10 20:59:26.413177 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1569/3057] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:26 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:26.417702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77024f5-12d7-483c-b3b1-23e5de3b2616 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.418235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77024f5-12d7-483c-b3b1-23e5de3b2616 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.418674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77024f5-12d7-483c-b3b1-23e5de3b2616 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.419378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77024f5-12d7-483c-b3b1-23e5de3b2616 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.419834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77024f5-12d7-483c-b3b1-23e5de3b2616 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.420444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77024f5-12d7-483c-b3b1-23e5de3b2616 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.487566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f77024f5-12d7-483c-b3b1-23e5de3b2616 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:26.495447 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f77024f5-12d7-483c-b3b1-23e5de3b2616 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1646 microversion: 2.1 time: 0.088855 Sep 10 20:59:26.496029 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1489/3058] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:26 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1646 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:26.714687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3df6dc41-08f8-4c2a-8c46-0830c8d24e2e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:26.715308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3df6dc41-08f8-4c2a-8c46-0830c8d24e2e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:26.722428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df6dc41-08f8-4c2a-8c46-0830c8d24e2e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.723860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df6dc41-08f8-4c2a-8c46-0830c8d24e2e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.724270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df6dc41-08f8-4c2a-8c46-0830c8d24e2e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.724992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df6dc41-08f8-4c2a-8c46-0830c8d24e2e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.725446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df6dc41-08f8-4c2a-8c46-0830c8d24e2e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.725894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3df6dc41-08f8-4c2a-8c46-0830c8d24e2e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.778106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-32bad337-495d-4e3f-8c92-5202c90f4f6d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f994963ad30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:26.845318 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-32bad337-495d-4e3f-8c92-5202c90f4f6d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.077258 Sep 10 20:59:26.846540 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1490/3059] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:26 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:26.885321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f771d5a4-ca8b-4789-90f6-64fa81bd63b6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:26.886518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f771d5a4-ca8b-4789-90f6-64fa81bd63b6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:26.893753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3df6dc41-08f8-4c2a-8c46-0830c8d24e2e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:26.895400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f771d5a4-ca8b-4789-90f6-64fa81bd63b6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.895886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f771d5a4-ca8b-4789-90f6-64fa81bd63b6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.896488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f771d5a4-ca8b-4789-90f6-64fa81bd63b6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.897192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f771d5a4-ca8b-4789-90f6-64fa81bd63b6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:26.897810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f771d5a4-ca8b-4789-90f6-64fa81bd63b6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:26.898254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f771d5a4-ca8b-4789-90f6-64fa81bd63b6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:26.902761 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3df6dc41-08f8-4c2a-8c46-0830c8d24e2e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.191942 Sep 10 20:59:26.903356 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1570/3060] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:26 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:27.045528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f771d5a4-ca8b-4789-90f6-64fa81bd63b6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:27.054308 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f771d5a4-ca8b-4789-90f6-64fa81bd63b6 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1489 microversion: 2.1 time: 0.173655 Sep 10 20:59:27.054884 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1491/3061] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:26 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1489 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:27.077460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:27.078016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:27.084433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.084922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.085363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.086134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.086589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.087011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.092410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-727937cf-9979-4b48-86d0-79a616874ecd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:27.093032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-727937cf-9979-4b48-86d0-79a616874ecd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:27.099631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727937cf-9979-4b48-86d0-79a616874ecd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.100099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727937cf-9979-4b48-86d0-79a616874ecd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.100540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727937cf-9979-4b48-86d0-79a616874ecd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.101239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727937cf-9979-4b48-86d0-79a616874ecd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.101696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727937cf-9979-4b48-86d0-79a616874ecd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.102177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727937cf-9979-4b48-86d0-79a616874ecd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.111732 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Cannot 'pause' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state paused Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action HTTP/1.1 Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 13 Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: {"pause": {}} Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: exception: Cannot 'pause' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state paused Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2bfdc13f-9c2e-44ec-8553-3f779ead89af', 'body': {'pause': {}}} Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af in vm_state paused. Cannot pause while the instance is in this state. Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state paused Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:27.112609 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:27.117846 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:27.117846 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:27.117846 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:27.117846 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state paused Sep 10 20:59:27.117846 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:27.117846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 409 to user: Cannot 'pause' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state paused {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:27.117846 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e4de4cdd-80b0-4250-aaad-37142f43f2af tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 409 len: 143 microversion: 2.1 time: 0.041336 Sep 10 20:59:27.118632 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1571/3062] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:27 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 143 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:59:27.122785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:27.123196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e9eeaa6-0cc8-47cf-9165-f7392254b189 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:27.123770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e9eeaa6-0cc8-47cf-9165-f7392254b189 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:27.130201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e9eeaa6-0cc8-47cf-9165-f7392254b189 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.130779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e9eeaa6-0cc8-47cf-9165-f7392254b189 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.131102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e9eeaa6-0cc8-47cf-9165-f7392254b189 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.131803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e9eeaa6-0cc8-47cf-9165-f7392254b189 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.132255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e9eeaa6-0cc8-47cf-9165-f7392254b189 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.132680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e9eeaa6-0cc8-47cf-9165-f7392254b189 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.204304 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e9eeaa6-0cc8-47cf-9165-f7392254b189 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 202 len: 0 microversion: 2.1 time: 0.084519 Sep 10 20:59:27.205105 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1572/3063] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:27 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:59:27.211331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:27.212185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:27.218466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.218961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.219539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.220124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.221092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.221092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.250859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-727937cf-9979-4b48-86d0-79a616874ecd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:27.260505 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-727937cf-9979-4b48-86d0-79a616874ecd tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1508 microversion: 2.1 time: 0.171784 Sep 10 20:59:27.261503 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1492/3064] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:27 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:27.266237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-04935e70-66c7-48e5-99b9-864b62b97a41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:27.266837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-04935e70-66c7-48e5-99b9-864b62b97a41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:27.274334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04935e70-66c7-48e5-99b9-864b62b97a41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.275240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04935e70-66c7-48e5-99b9-864b62b97a41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.275974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04935e70-66c7-48e5-99b9-864b62b97a41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.277095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04935e70-66c7-48e5-99b9-864b62b97a41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.277709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04935e70-66c7-48e5-99b9-864b62b97a41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.278225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04935e70-66c7-48e5-99b9-864b62b97a41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.310578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:27.319753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:27.321245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:27.322455 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-65bbc8b8-554c-46a1-8c87-9394c6ed9524 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1319 microversion: 2.21 time: 0.116161 Sep 10 20:59:27.323054 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1573/3065] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:27 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1319 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:27.328026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5653f354-dd6b-4076-bbb5-605f25e8f390 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:27.328593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5653f354-dd6b-4076-bbb5-605f25e8f390 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:27.335651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5653f354-dd6b-4076-bbb5-605f25e8f390 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.336295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5653f354-dd6b-4076-bbb5-605f25e8f390 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.336753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5653f354-dd6b-4076-bbb5-605f25e8f390 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.337443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5653f354-dd6b-4076-bbb5-605f25e8f390 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.337925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5653f354-dd6b-4076-bbb5-605f25e8f390 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.338360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5653f354-dd6b-4076-bbb5-605f25e8f390 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.401894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5653f354-dd6b-4076-bbb5-605f25e8f390 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:27.410707 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5653f354-dd6b-4076-bbb5-605f25e8f390 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1268 microversion: 2.1 time: 0.085756 Sep 10 20:59:27.411527 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1574/3066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:27 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1268 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:27.417175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4246e491-1ace-479a-8c1a-1b16dd8155e4 req-0100b70e-d836-4b77-b5bc-1665fb2c81a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a009fbee-aff7-41a2-be0f-785d15e2e42a", "name": "network-vif-plugged", "status": "completed", "tag": "8bc3db35-62d4-4858-9844-3ba3bf0422c2"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:27.428622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-04935e70-66c7-48e5-99b9-864b62b97a41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:27.429805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4246e491-1ace-479a-8c1a-1b16dd8155e4 req-0100b70e-d836-4b77-b5bc-1665fb2c81a5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.430307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4246e491-1ace-479a-8c1a-1b16dd8155e4 req-0100b70e-d836-4b77-b5bc-1665fb2c81a5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.430757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4246e491-1ace-479a-8c1a-1b16dd8155e4 req-0100b70e-d836-4b77-b5bc-1665fb2c81a5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.444603 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4246e491-1ace-479a-8c1a-1b16dd8155e4 req-0100b70e-d836-4b77-b5bc-1665fb2c81a5 service nova] Creating event network-vif-plugged:8bc3db35-62d4-4858-9844-3ba3bf0422c2 for instance a009fbee-aff7-41a2-be0f-785d15e2e42a on nch1-master-1 Sep 10 20:59:27.447579 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-04935e70-66c7-48e5-99b9-864b62b97a41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1496 microversion: 2.1 time: 0.184719 Sep 10 20:59:27.448293 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1493/3067] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:27 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1496 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:27.452350 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4246e491-1ace-479a-8c1a-1b16dd8155e4 req-0100b70e-d836-4b77-b5bc-1665fb2c81a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037589 Sep 10 20:59:27.463046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38720889-db2c-4935-a865-d44df094b218 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:27.463847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38720889-db2c-4935-a865-d44df094b218 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:27.464506 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1575/3068] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:27.485356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38720889-db2c-4935-a865-d44df094b218 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.485973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38720889-db2c-4935-a865-d44df094b218 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.486637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38720889-db2c-4935-a865-d44df094b218 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.488074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38720889-db2c-4935-a865-d44df094b218 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.488941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38720889-db2c-4935-a865-d44df094b218 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.489124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38720889-db2c-4935-a865-d44df094b218 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.520573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-19337190-2c42-4540-8dda-a45cc9065ad2 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:27.521428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-19337190-2c42-4540-8dda-a45cc9065ad2 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:27.531676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19337190-2c42-4540-8dda-a45cc9065ad2 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.531676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19337190-2c42-4540-8dda-a45cc9065ad2 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.532101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19337190-2c42-4540-8dda-a45cc9065ad2 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.532820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19337190-2c42-4540-8dda-a45cc9065ad2 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.533288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19337190-2c42-4540-8dda-a45cc9065ad2 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.533726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19337190-2c42-4540-8dda-a45cc9065ad2 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.623371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-19337190-2c42-4540-8dda-a45cc9065ad2 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:27.638519 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-19337190-2c42-4540-8dda-a45cc9065ad2 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1362 microversion: 2.1 time: 0.122067 Sep 10 20:59:27.640065 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1576/3069] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:27 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1362 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:27.839843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38720889-db2c-4935-a865-d44df094b218 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:27.849482 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38720889-db2c-4935-a865-d44df094b218 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.397153 Sep 10 20:59:27.862387 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1494/3070] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:27 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:27.866352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3c77a244-540f-4ee7-bc39-3ace2be3584a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440a93a0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:27.928212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0cf7690c-e9f5-4662-8d7d-1ce72831d439 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:27.929309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0cf7690c-e9f5-4662-8d7d-1ce72831d439 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:27.937301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf7690c-e9f5-4662-8d7d-1ce72831d439 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.937967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf7690c-e9f5-4662-8d7d-1ce72831d439 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.938883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf7690c-e9f5-4662-8d7d-1ce72831d439 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.939690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf7690c-e9f5-4662-8d7d-1ce72831d439 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:27.940079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf7690c-e9f5-4662-8d7d-1ce72831d439 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:27.940539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cf7690c-e9f5-4662-8d7d-1ce72831d439 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:27.944159 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3c77a244-540f-4ee7-bc39-3ace2be3584a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.076439 Sep 10 20:59:27.945642 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1577/3071] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:27 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:28.209345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0cf7690c-e9f5-4662-8d7d-1ce72831d439 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:28.221869 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0cf7690c-e9f5-4662-8d7d-1ce72831d439 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.298638 Sep 10 20:59:28.222572 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1495/3072] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:27 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:28.286267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bef54fdc-e256-4976-9ccf-c5ebd4f564a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:28.286887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bef54fdc-e256-4976-9ccf-c5ebd4f564a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:28.294058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bef54fdc-e256-4976-9ccf-c5ebd4f564a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.294550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bef54fdc-e256-4976-9ccf-c5ebd4f564a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.295331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bef54fdc-e256-4976-9ccf-c5ebd4f564a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.296044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bef54fdc-e256-4976-9ccf-c5ebd4f564a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.296503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bef54fdc-e256-4976-9ccf-c5ebd4f564a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.297001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bef54fdc-e256-4976-9ccf-c5ebd4f564a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.352887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:28.353528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:28.367204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.367612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.368048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.368751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.369207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.369626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.449968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:28.460787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:28.462317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:28.463638 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09086801-0011-4666-9ba8-fa3c296c0dc9 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1317 microversion: 2.21 time: 0.119128 Sep 10 20:59:28.502968 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1496/3073] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:28 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:28.529068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38578ac4-1a4c-4e7c-8ffe-944f2cc0b564 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:28.531863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38578ac4-1a4c-4e7c-8ffe-944f2cc0b564 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:28.537990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bef54fdc-e256-4976-9ccf-c5ebd4f564a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:28.546163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38578ac4-1a4c-4e7c-8ffe-944f2cc0b564 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.548170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38578ac4-1a4c-4e7c-8ffe-944f2cc0b564 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.548973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38578ac4-1a4c-4e7c-8ffe-944f2cc0b564 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.550528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38578ac4-1a4c-4e7c-8ffe-944f2cc0b564 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.551454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38578ac4-1a4c-4e7c-8ffe-944f2cc0b564 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.552125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38578ac4-1a4c-4e7c-8ffe-944f2cc0b564 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.554945 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bef54fdc-e256-4976-9ccf-c5ebd4f564a2 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1508 microversion: 2.1 time: 0.273978 Sep 10 20:59:28.555827 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1578/3074] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:28 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:28.573124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-69a38a57-3ac0-492f-b721-e593ad8dbba0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:28.573983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-69a38a57-3ac0-492f-b721-e593ad8dbba0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:28.580334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a38a57-3ac0-492f-b721-e593ad8dbba0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.582539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a38a57-3ac0-492f-b721-e593ad8dbba0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.593223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a38a57-3ac0-492f-b721-e593ad8dbba0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.594039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a38a57-3ac0-492f-b721-e593ad8dbba0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.594534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a38a57-3ac0-492f-b721-e593ad8dbba0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.594977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a38a57-3ac0-492f-b721-e593ad8dbba0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.660669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38578ac4-1a4c-4e7c-8ffe-944f2cc0b564 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:28.677022 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38578ac4-1a4c-4e7c-8ffe-944f2cc0b564 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1268 microversion: 2.1 time: 0.167066 Sep 10 20:59:28.678153 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1497/3075] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:28 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:28.684097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:28.685193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:28.692688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.693448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.694125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.695196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.695892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.696578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.748659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.749158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.749602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.750090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lazy-loading 'fault' on Instance uuid ba630e24-db2e-474f-80f7-56ba4cbec4c2 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:59:28.814367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:28.823420 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2bb02fba-177a-4dce-82a7-3fe97c344763 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1367 microversion: 2.1 time: 0.143843 Sep 10 20:59:28.825584 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1498/3076] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:28 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:28.874531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5ad15965-f17b-4cb8-8365-83ab8024589a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:28.875439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5ad15965-f17b-4cb8-8365-83ab8024589a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:28.885668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ad15965-f17b-4cb8-8365-83ab8024589a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.886615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ad15965-f17b-4cb8-8365-83ab8024589a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.887236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ad15965-f17b-4cb8-8365-83ab8024589a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:28.888122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ad15965-f17b-4cb8-8365-83ab8024589a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:28.888749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ad15965-f17b-4cb8-8365-83ab8024589a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:28.889341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5ad15965-f17b-4cb8-8365-83ab8024589a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:29.072631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5ad15965-f17b-4cb8-8365-83ab8024589a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:29.083397 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5ad15965-f17b-4cb8-8365-83ab8024589a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.214270 Sep 10 20:59:29.084213 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1499/3077] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:28 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:29.090433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85d00095-b77c-4aad-af9e-b179af98f029 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944259280>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:29.206667 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-85d00095-b77c-4aad-af9e-b179af98f029 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.121045 Sep 10 20:59:29.207879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1500/3078] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:29 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:29.245306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-69a38a57-3ac0-492f-b721-e593ad8dbba0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:29.247335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7b177bbb-89be-4dbb-8343-a73ca642a4fc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:29.249309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7b177bbb-89be-4dbb-8343-a73ca642a4fc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:29.260595 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-69a38a57-3ac0-492f-b721-e593ad8dbba0 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.701847 Sep 10 20:59:29.261790 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1579/3079] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:28 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:29.271632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b177bbb-89be-4dbb-8343-a73ca642a4fc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:29.282601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b177bbb-89be-4dbb-8343-a73ca642a4fc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:29.284636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b177bbb-89be-4dbb-8343-a73ca642a4fc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:29.287934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b177bbb-89be-4dbb-8343-a73ca642a4fc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:29.288731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b177bbb-89be-4dbb-8343-a73ca642a4fc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:29.289344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7b177bbb-89be-4dbb-8343-a73ca642a4fc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:29.290306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-29bcd56e-e68c-40a5-bb00-962c02758d8f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:29.290935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-29bcd56e-e68c-40a5-bb00-962c02758d8f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:29.297409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29bcd56e-e68c-40a5-bb00-962c02758d8f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:29.297953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29bcd56e-e68c-40a5-bb00-962c02758d8f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:29.298399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29bcd56e-e68c-40a5-bb00-962c02758d8f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:29.299123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29bcd56e-e68c-40a5-bb00-962c02758d8f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:29.299588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29bcd56e-e68c-40a5-bb00-962c02758d8f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:29.300026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29bcd56e-e68c-40a5-bb00-962c02758d8f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:29.352909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:29.503714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7b177bbb-89be-4dbb-8343-a73ca642a4fc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:29.521964 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7b177bbb-89be-4dbb-8343-a73ca642a4fc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1325 microversion: 2.1 time: 0.278594 Sep 10 20:59:29.522908 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1501/3080] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:29 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1325 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:29.546025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:29.552108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:29.570622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:29.571400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:29.572036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:29.572946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:29.573574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:29.574202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:29.809282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-29bcd56e-e68c-40a5-bb00-962c02758d8f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:29.822498 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-29bcd56e-e68c-40a5-bb00-962c02758d8f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.537128 Sep 10 20:59:29.823101 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1580/3081] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:29 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:29.829034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34ad3be5-bcba-4b11-adc4-b9b45e0b981a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:29.835190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-34ad3be5-bcba-4b11-adc4-b9b45e0b981a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:29.871565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34ad3be5-bcba-4b11-adc4-b9b45e0b981a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:29.872865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34ad3be5-bcba-4b11-adc4-b9b45e0b981a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:29.875570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34ad3be5-bcba-4b11-adc4-b9b45e0b981a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:29.878094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34ad3be5-bcba-4b11-adc4-b9b45e0b981a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:29.880796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34ad3be5-bcba-4b11-adc4-b9b45e0b981a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:29.881477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34ad3be5-bcba-4b11-adc4-b9b45e0b981a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.025256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:30.048003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:30.049783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:30.058374 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8424e72d-33f1-4c94-a61f-bcc12934c86b tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1359 microversion: 2.21 time: 0.534262 Sep 10 20:59:30.067459 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1502/3082] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:29 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1359 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:30.083751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1cce7322-deb3-40f8-8e8f-2fdb49703eee tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:30.084666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1cce7322-deb3-40f8-8e8f-2fdb49703eee tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:30.103472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cce7322-deb3-40f8-8e8f-2fdb49703eee tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.106070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cce7322-deb3-40f8-8e8f-2fdb49703eee tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.110292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cce7322-deb3-40f8-8e8f-2fdb49703eee tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.111382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cce7322-deb3-40f8-8e8f-2fdb49703eee tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.114371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cce7322-deb3-40f8-8e8f-2fdb49703eee tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.115108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cce7322-deb3-40f8-8e8f-2fdb49703eee tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.245026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-34ad3be5-bcba-4b11-adc4-b9b45e0b981a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:30.272240 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-34ad3be5-bcba-4b11-adc4-b9b45e0b981a tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1293 microversion: 2.1 time: 0.447282 Sep 10 20:59:30.283528 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1581/3083] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:29 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1293 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:30.327954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1cce7322-deb3-40f8-8e8f-2fdb49703eee tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:30.328189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e7b83c8d-3fd9-4039-9ddc-2db3ad5af5c8 req-9854b8eb-2e36-43be-a458-a9527251b30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e18c6b-6c06-42cf-8651-53cdb6c30ff7", "name": "network-vif-deleted", "tag": "59ec7720-9ed7-4a7c-8d8c-cb6a33ecbc8d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:30.338964 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1cce7322-deb3-40f8-8e8f-2fdb49703eee tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1286 microversion: 2.1 time: 0.270044 Sep 10 20:59:30.342609 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1503/3084] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:30 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1286 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:30.356376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:30.357207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:30.371366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.372068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.372682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.373573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.374657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.375281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.394637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e7b83c8d-3fd9-4039-9ddc-2db3ad5af5c8 req-9854b8eb-2e36-43be-a458-a9527251b30c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.418520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e7b83c8d-3fd9-4039-9ddc-2db3ad5af5c8 req-9854b8eb-2e36-43be-a458-a9527251b30c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.419638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e7b83c8d-3fd9-4039-9ddc-2db3ad5af5c8 req-9854b8eb-2e36-43be-a458-a9527251b30c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.448422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.448924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.449372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.449858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lazy-loading 'fault' on Instance uuid ba630e24-db2e-474f-80f7-56ba4cbec4c2 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:59:30.455226 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e7b83c8d-3fd9-4039-9ddc-2db3ad5af5c8 req-9854b8eb-2e36-43be-a458-a9527251b30c service nova] Creating event network-vif-deleted:59ec7720-9ed7-4a7c-8d8c-cb6a33ecbc8d for instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 on nch1-master-1 Sep 10 20:59:30.466179 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e7b83c8d-3fd9-4039-9ddc-2db3ad5af5c8 req-9854b8eb-2e36-43be-a458-a9527251b30c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181200 Sep 10 20:59:30.468329 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1582/3085] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:30.482043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:30.485523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:30.517441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.519252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d41f09b29b4f20816318805722b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b49720bd644bed9a3504ff26f01768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:30.525045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.525171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.525889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.530722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.531249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.533322 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0926649a-a4c1-4197-a3da-7aa2780c799d tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 200 len: 1367 microversion: 2.1 time: 0.189316 Sep 10 20:59:30.549059 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1504/3086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:30 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:30.557564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b69d874-c96c-4dab-9144-6c04c3fcbb3e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:30.561640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5b69d874-c96c-4dab-9144-6c04c3fcbb3e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:30.568899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b69d874-c96c-4dab-9144-6c04c3fcbb3e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.569635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b69d874-c96c-4dab-9144-6c04c3fcbb3e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.570287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b69d874-c96c-4dab-9144-6c04c3fcbb3e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.571156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b69d874-c96c-4dab-9144-6c04c3fcbb3e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.572515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b69d874-c96c-4dab-9144-6c04c3fcbb3e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.573094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b69d874-c96c-4dab-9144-6c04c3fcbb3e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.580052 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046/action HTTP/1.1 Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 28 Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: {"reboot": {"type": "SOFT"}} Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5f1f769d-7314-4652-8dff-f06c1b403046', 'body': {'reboot': {'type': 'SOFT'}}} Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:30.581976 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-381a552c-b78f-43d4-bc99-96243aaad820 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046/action" status: 404 len: 111 microversion: 2.1 time: 0.113967 Sep 10 20:59:30.586459 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1583/3087] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:30 2022] POST /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046/action => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:30.589610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-821a7602-f0bd-4b65-9e14-47d8ef7a8d5a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440a9280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:30.664121 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-821a7602-f0bd-4b65-9e14-47d8ef7a8d5a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.079027 Sep 10 20:59:30.664949 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1584/3088] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:30 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:30.677286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-041dc079-4738-4016-a5a4-05f7b01f79d0 req-cf46923b-9eb3-470b-9e80-6d1c95f7b422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7d1492-dc6d-4ddc-ada0-4d492a0916d6", "name": "network-vif-plugged", "status": "completed", "tag": "3e890f01-2c63-4ec8-9b80-da70352321e9"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:30.704640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-041dc079-4738-4016-a5a4-05f7b01f79d0 req-cf46923b-9eb3-470b-9e80-6d1c95f7b422 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.705275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-041dc079-4738-4016-a5a4-05f7b01f79d0 req-cf46923b-9eb3-470b-9e80-6d1c95f7b422 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.706682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-041dc079-4738-4016-a5a4-05f7b01f79d0 req-cf46923b-9eb3-470b-9e80-6d1c95f7b422 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.718645 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-041dc079-4738-4016-a5a4-05f7b01f79d0 req-cf46923b-9eb3-470b-9e80-6d1c95f7b422 service nova] Creating event network-vif-plugged:3e890f01-2c63-4ec8-9b80-da70352321e9 for instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 on nch2-master-1 Sep 10 20:59:30.725471 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-041dc079-4738-4016-a5a4-05f7b01f79d0 req-cf46923b-9eb3-470b-9e80-6d1c95f7b422 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059030 Sep 10 20:59:30.726323 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1585/3089] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:30.735595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-98e0138d-2e99-49bc-b842-b5d62f113f39 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:30.736912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-98e0138d-2e99-49bc-b842-b5d62f113f39 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:30.743564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98e0138d-2e99-49bc-b842-b5d62f113f39 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.744062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98e0138d-2e99-49bc-b842-b5d62f113f39 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.744506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98e0138d-2e99-49bc-b842-b5d62f113f39 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.746459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98e0138d-2e99-49bc-b842-b5d62f113f39 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.747111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98e0138d-2e99-49bc-b842-b5d62f113f39 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.747553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98e0138d-2e99-49bc-b842-b5d62f113f39 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.806346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5b69d874-c96c-4dab-9144-6c04c3fcbb3e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:30.820262 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5b69d874-c96c-4dab-9144-6c04c3fcbb3e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.269750 Sep 10 20:59:30.821349 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1505/3090] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:30 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:30.826254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3ff6673b-2f78-4e1a-ab32-a158fd03439f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:30.827608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3ff6673b-2f78-4e1a-ab32-a158fd03439f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:30.838023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ff6673b-2f78-4e1a-ab32-a158fd03439f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.838894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ff6673b-2f78-4e1a-ab32-a158fd03439f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.839439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ff6673b-2f78-4e1a-ab32-a158fd03439f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:30.840484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ff6673b-2f78-4e1a-ab32-a158fd03439f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:30.841338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ff6673b-2f78-4e1a-ab32-a158fd03439f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:30.842084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ff6673b-2f78-4e1a-ab32-a158fd03439f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.036429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-98e0138d-2e99-49bc-b842-b5d62f113f39 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:31.045980 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-98e0138d-2e99-49bc-b842-b5d62f113f39 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1521 microversion: 2.1 time: 0.314763 Sep 10 20:59:31.068566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3ff6673b-2f78-4e1a-ab32-a158fd03439f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:31.070378 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1586/3091] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:30 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:31.082775 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3ff6673b-2f78-4e1a-ab32-a158fd03439f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.259504 Sep 10 20:59:31.084644 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1506/3092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:30 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:31.095866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e1cb5b4-c090-46eb-bc82-0a41abcad07a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:31.098327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e1cb5b4-c090-46eb-bc82-0a41abcad07a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:31.106445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:31.107299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:31.126731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.128230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.133234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.134592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1cb5b4-c090-46eb-bc82-0a41abcad07a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.135494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.136230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1cb5b4-c090-46eb-bc82-0a41abcad07a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.136549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.137174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.137812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1cb5b4-c090-46eb-bc82-0a41abcad07a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.139058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1cb5b4-c090-46eb-bc82-0a41abcad07a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.141931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1cb5b4-c090-46eb-bc82-0a41abcad07a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.142899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1cb5b4-c090-46eb-bc82-0a41abcad07a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.424721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:31.435504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:31.437366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:31.438816 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-89b4b5a7-66a5-4269-9b65-e08e0aa06435 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1359 microversion: 2.21 time: 0.338530 Sep 10 20:59:31.440021 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1507/3093] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:31 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:31.449017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d3cbe723-5187-4b59-8fed-3042ba367714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:31.449955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d3cbe723-5187-4b59-8fed-3042ba367714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:31.456101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:31.458813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3cbe723-5187-4b59-8fed-3042ba367714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.459513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3cbe723-5187-4b59-8fed-3042ba367714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.460351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3cbe723-5187-4b59-8fed-3042ba367714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.461595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3cbe723-5187-4b59-8fed-3042ba367714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.462455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3cbe723-5187-4b59-8fed-3042ba367714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.463080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3cbe723-5187-4b59-8fed-3042ba367714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.682038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d3cbe723-5187-4b59-8fed-3042ba367714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:31.709499 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d3cbe723-5187-4b59-8fed-3042ba367714 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.267373 Sep 10 20:59:31.710512 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1508/3094] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:31 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:31.716167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:31.717819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:31.728785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.729478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.730217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.731085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.731824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.732556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.771759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:31.792967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.793610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.794188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.794837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lazy-loading 'fault' on Instance uuid 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:59:31.840098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:31.848682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1e1cb5b4-c090-46eb-bc82-0a41abcad07a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:31.864544 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e1cb5b4-c090-46eb-bc82-0a41abcad07a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1521 microversion: 2.1 time: 0.773472 Sep 10 20:59:31.869816 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1587/3095] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:31 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1521 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:31.871474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:31.881288 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9fd27f19-85cf-4052-acd8-17f083bb3fac tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 200 len: 1312 microversion: 2.1 time: 0.169540 Sep 10 20:59:31.882602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ba75359-585c-4484-9982-643bfb5fb2f5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:31.883254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6ba75359-585c-4484-9982-643bfb5fb2f5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:31.890831 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1509/3096] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:31 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:31.907450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:31.908357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] [instance: ba630e24-db2e-474f-80f7-56ba4cbec4c2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:31.914719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:31.919090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba75359-585c-4484-9982-643bfb5fb2f5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.920042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba75359-585c-4484-9982-643bfb5fb2f5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.920551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba75359-585c-4484-9982-643bfb5fb2f5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.921384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba75359-585c-4484-9982-643bfb5fb2f5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.922123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba75359-585c-4484-9982-643bfb5fb2f5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.923099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba75359-585c-4484-9982-643bfb5fb2f5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.942143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.944099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.944630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.945523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:31.946084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:31.946594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:31.981021 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] HTTP exception thrown: Instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 could not be found. Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Request method failure captured: Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 HTTP/1.1 Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPox99faeKceih7CjQ-Tfi5-B1J5Gb16L6pZL4xpHLTUB5fEcK8GuL6J_sPACCEdG5J-KYiXNWgcgNmdQU34nuKLnBS-xf_rbQXcGEgNeVy8xphVzxnFn8h7TwPLqlA6eI6kjgsaPjvohb_D-KQGnEBj74kTifQN4gVJcLlwBqXUn5o Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 38b49720bd644bed9a3504ff26f01768 Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestManualDisk-2063184006 Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38b49720bd644bed9a3504ff26f01768"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38b49720bd644bed9a3504ff26f01768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38b49720bd644bed9a3504ff26f01768", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38b49720bd644bed9a3504ff26f01768"}]}] Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestManualDisk-2063184006 Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 38b49720bd644bed9a3504ff26f01768 Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestManualDisk-2063184006 Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestManualDisk-2063184006-project Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 91d41f09b29b4f20816318805722b2e4 Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestManualDisk-2063184006-project Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 could not be found. Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'ba630e24-db2e-474f-80f7-56ba4cbec4c2'} Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 could not be found. Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 could not be found. Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:31.988687 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:31.993118 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:31.993118 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:31.993118 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:31.993118 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:31.993118 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:31.993118 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 could not be found. Sep 10 20:59:31.993118 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:31.993118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Returning 404 to user: Instance ba630e24-db2e-474f-80f7-56ba4cbec4c2 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:31.993118 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-79061b11-93c8-438c-adeb-45b699b3f093 tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2" status: 404 len: 111 microversion: 2.1 time: 0.098132 Sep 10 20:59:31.993118 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1510/3097] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:31 2022] GET /compute/v2.1/servers/ba630e24-db2e-474f-80f7-56ba4cbec4c2 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:31.998241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0cc8722e-7c01-4af1-946a-80c870a12362 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944259700>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:32.046709 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0cc8722e-7c01-4af1-946a-80c870a12362 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.052420 Sep 10 20:59:32.056178 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1511/3098] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:31 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:32.061228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-40734c0c-4606-42b9-a26c-875c49d85f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:32.063681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-40734c0c-4606-42b9-a26c-875c49d85f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: b0eab661-3b28-4972-88a9-a04b78af42a4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:32.071907 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-40734c0c-4606-42b9-a26c-875c49d85f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance b0eab661-3b28-4972-88a9-a04b78af42a4 could not be found. Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-40734c0c-4606-42b9-a26c-875c49d85f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/b0eab661-3b28-4972-88a9-a04b78af42a4/action HTTP/1.1 Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 28 Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: {"reboot": {"type": "SOFT"}} Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b0eab661-3b28-4972-88a9-a04b78af42a4 could not be found. Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b0eab661-3b28-4972-88a9-a04b78af42a4', 'body': {'reboot': {'type': 'SOFT'}}} Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0eab661-3b28-4972-88a9-a04b78af42a4 could not be found. Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0eab661-3b28-4972-88a9-a04b78af42a4 could not be found. Sep 10 20:59:32.074743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0eab661-3b28-4972-88a9-a04b78af42a4 could not be found. Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-40734c0c-4606-42b9-a26c-875c49d85f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance b0eab661-3b28-4972-88a9-a04b78af42a4 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-40734c0c-4606-42b9-a26c-875c49d85f31 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/b0eab661-3b28-4972-88a9-a04b78af42a4/action" status: 404 len: 111 microversion: 2.1 time: 0.018891 Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1512/3099] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:32 2022] POST /compute/v2.1/servers/b0eab661-3b28-4972-88a9-a04b78af42a4/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:32.084170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a6a47b12-5797-4d68-8f66-4f20615ea74e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:32.085061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a6a47b12-5797-4d68-8f66-4f20615ea74e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:32.111379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6a47b12-5797-4d68-8f66-4f20615ea74e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:32.112322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6a47b12-5797-4d68-8f66-4f20615ea74e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:32.112936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6a47b12-5797-4d68-8f66-4f20615ea74e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:32.114823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6a47b12-5797-4d68-8f66-4f20615ea74e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:32.115542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6a47b12-5797-4d68-8f66-4f20615ea74e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:32.116147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6a47b12-5797-4d68-8f66-4f20615ea74e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:32.266498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ba75359-585c-4484-9982-643bfb5fb2f5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:32.280579 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ba75359-585c-4484-9982-643bfb5fb2f5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1274 microversion: 2.1 time: 0.409009 Sep 10 20:59:32.287545 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1588/3100] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:31 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1274 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:32.292916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f093ed4-f1cc-4d4c-9257-77360f701289 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-910593244", "metadata": {"": ""}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f093ed4-f1cc-4d4c-9257-77360f701289 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action HTTP/1.1 Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 106 Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-910593244", "metadata": {"": ""}}} Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a009fbee-aff7-41a2-be0f-785d15e2e42a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-910593244', 'metadata': {'': ''}}}} Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'': ''} Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:32.306454 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f093ed4-f1cc-4d4c-9257-77360f701289 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:32.311847 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f093ed4-f1cc-4d4c-9257-77360f701289 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action" status: 400 len: 170 microversion: 2.1 time: 0.019238 Sep 10 20:59:32.314572 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1589/3101] 10.222.0.33 () {60 vars in 1279 bytes} [Sat Sep 10 20:59:32 2022] POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action => generated 170 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:59:32.320172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ce5d878d-3d44-490e-8804-331969bea8fe tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] Calling method '.version_select at 0x7f99496740d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:32.344833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:32.362582 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ce5d878d-3d44-490e-8804-331969bea8fe tempest-ServersTestManualDisk-2063184006 tempest-ServersTestManualDisk-2063184006-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467440502" status: 202 len: 0 microversion: 2.1 time: 0.046791 Sep 10 20:59:32.363631 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1590/3102] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 20:59:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467440502 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:59:32.371049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ed96eaf-437f-421b-8eb9-db1ef5d6d5f3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:32.372105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6ed96eaf-437f-421b-8eb9-db1ef5d6d5f3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:32.392307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ed96eaf-437f-421b-8eb9-db1ef5d6d5f3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:32.392815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ed96eaf-437f-421b-8eb9-db1ef5d6d5f3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:32.393259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ed96eaf-437f-421b-8eb9-db1ef5d6d5f3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:32.394009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ed96eaf-437f-421b-8eb9-db1ef5d6d5f3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:32.395028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ed96eaf-437f-421b-8eb9-db1ef5d6d5f3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:32.395487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ed96eaf-437f-421b-8eb9-db1ef5d6d5f3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:32.459777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a6a47b12-5797-4d68-8f66-4f20615ea74e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:32.478344 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a6a47b12-5797-4d68-8f66-4f20615ea74e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.400254 Sep 10 20:59:32.481561 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1513/3103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:32 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:32.486559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd924f0e-fca1-47df-8be0-98425d3d6b59 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:32.487371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd924f0e-fca1-47df-8be0-98425d3d6b59 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:32.506250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd924f0e-fca1-47df-8be0-98425d3d6b59 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:32.514731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd924f0e-fca1-47df-8be0-98425d3d6b59 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:32.515924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd924f0e-fca1-47df-8be0-98425d3d6b59 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:32.517126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd924f0e-fca1-47df-8be0-98425d3d6b59 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:32.522595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd924f0e-fca1-47df-8be0-98425d3d6b59 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:32.523324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd924f0e-fca1-47df-8be0-98425d3d6b59 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:32.787568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd924f0e-fca1-47df-8be0-98425d3d6b59 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:32.801010 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd924f0e-fca1-47df-8be0-98425d3d6b59 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1521 microversion: 2.1 time: 0.317592 Sep 10 20:59:32.805934 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1514/3104] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:32 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:32.818742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:32.819592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:32.837437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:32.850349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:32.855909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:32.857503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:32.858363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:32.867261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:33.161849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ed96eaf-437f-421b-8eb9-db1ef5d6d5f3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:33.170339 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ed96eaf-437f-421b-8eb9-db1ef5d6d5f3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.805127 Sep 10 20:59:33.174192 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1591/3105] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:32 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:33.187228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-896a0e30-1e9b-43d5-a860-3b5e274fd669 req-18acd921-77cd-4537-a422-4efacb2b018f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18936341-5f68-4676-abb6-eb63c45da66e", "name": "network-vif-plugged", "status": "completed", "tag": "5c189b4d-3548-4392-b69f-af791fa93755"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:33.205315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-896a0e30-1e9b-43d5-a860-3b5e274fd669 req-18acd921-77cd-4537-a422-4efacb2b018f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:33.205808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-896a0e30-1e9b-43d5-a860-3b5e274fd669 req-18acd921-77cd-4537-a422-4efacb2b018f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:33.206270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-896a0e30-1e9b-43d5-a860-3b5e274fd669 req-18acd921-77cd-4537-a422-4efacb2b018f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:33.223443 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-896a0e30-1e9b-43d5-a860-3b5e274fd669 req-18acd921-77cd-4537-a422-4efacb2b018f service nova] Creating event network-vif-plugged:5c189b4d-3548-4392-b69f-af791fa93755 for instance 18936341-5f68-4676-abb6-eb63c45da66e on nch1-master-1 Sep 10 20:59:33.230495 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-896a0e30-1e9b-43d5-a860-3b5e274fd669 req-18acd921-77cd-4537-a422-4efacb2b018f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054712 Sep 10 20:59:33.231429 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1592/3106] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:33.237777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5fd4f31-89e7-4afb-a501-a66ffe6c9106 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:33.239912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5fd4f31-89e7-4afb-a501-a66ffe6c9106 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:33.247445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5fd4f31-89e7-4afb-a501-a66ffe6c9106 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:33.247937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5fd4f31-89e7-4afb-a501-a66ffe6c9106 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:33.248377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5fd4f31-89e7-4afb-a501-a66ffe6c9106 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:33.249094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5fd4f31-89e7-4afb-a501-a66ffe6c9106 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:33.249551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5fd4f31-89e7-4afb-a501-a66ffe6c9106 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:33.250013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5fd4f31-89e7-4afb-a501-a66ffe6c9106 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:33.567450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:33.579936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:33.595554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:33.602040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:33.604106 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5762d5bd-5fc6-439d-99c9-8a7853b17728 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1359 microversion: 2.21 time: 0.796739 Sep 10 20:59:33.607685 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1515/3107] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:32 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1359 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:33.612958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:33.618661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 31e18c6b-6c06-42cf-8651-53cdb6c30ff7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:33.632967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:33.635190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:33.636090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:33.637066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:33.642531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:33.643322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:33.677405 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] HTTP exception thrown: Instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 could not be found. Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Request method failure captured: Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 HTTP/1.1 Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPlIfEE6BUsYm6N9cc6J4sKvQx8zkdVi0_eGxve7idCE5St69TEoXloNJQbmDpLOYE4kW76RSsXwzH4ER5m-rWYbak-zkdFvTsFOuE5UWRW73UCQGyOtVDm5s0CSvgZ9e1C_-bLDziBI_eeTxSX1Lq4xDS48kCIhpdBe8v0QA9iMeLw Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4b1732129f3414fbc3f26fff6d039ec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4b1732129f3414fbc3f26fff6d039ec"}]}] Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d8b0a160808f4adda7be57cd535f0631 Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 could not be found. Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '31e18c6b-6c06-42cf-8651-53cdb6c30ff7'} Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 could not be found. Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 could not be found. Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:33.680083 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:33.684002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:33.684002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:33.684002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:33.684002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:33.684002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:33.684002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:33.684002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 could not be found. Sep 10 20:59:33.684002 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:33.697204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Returning 404 to user: Instance 31e18c6b-6c06-42cf-8651-53cdb6c30ff7 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:33.698810 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-542093b7-15f9-4c1b-9dc9-0c499c398608 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7" status: 404 len: 111 microversion: 2.1 time: 0.089424 Sep 10 20:59:33.703334 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1516/3108] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:33 2022] GET /compute/v2.1/servers/31e18c6b-6c06-42cf-8651-53cdb6c30ff7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:33.709344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e9b26887-7baa-4c21-a8ef-5150a13c1fb5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944c45700>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:33.781758 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e9b26887-7baa-4c21-a8ef-5150a13c1fb5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.077029 Sep 10 20:59:33.791463 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1517/3109] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:33 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:33.794642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a5fd4f31-89e7-4afb-a501-a66ffe6c9106 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:33.797257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f2994c9-ee24-4025-b1e1-ef5d6cef6088 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:33.798118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f2994c9-ee24-4025-b1e1-ef5d6cef6088 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:33.806942 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5fd4f31-89e7-4afb-a501-a66ffe6c9106 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1521 microversion: 2.1 time: 0.574226 Sep 10 20:59:33.809069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f2994c9-ee24-4025-b1e1-ef5d6cef6088 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:33.809856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f2994c9-ee24-4025-b1e1-ef5d6cef6088 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:33.810566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f2994c9-ee24-4025-b1e1-ef5d6cef6088 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:33.811871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f2994c9-ee24-4025-b1e1-ef5d6cef6088 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:33.812619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f2994c9-ee24-4025-b1e1-ef5d6cef6088 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:33.813296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f2994c9-ee24-4025-b1e1-ef5d6cef6088 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:33.822222 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1593/3110] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:33 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1521 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:33.839010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d555c82-107f-4512-a131-647c2b4e2097 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:33.839543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8d555c82-107f-4512-a131-647c2b4e2097 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:33.852256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d555c82-107f-4512-a131-647c2b4e2097 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:33.852747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d555c82-107f-4512-a131-647c2b4e2097 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:33.855843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d555c82-107f-4512-a131-647c2b4e2097 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:33.856831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d555c82-107f-4512-a131-647c2b4e2097 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:33.859476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d555c82-107f-4512-a131-647c2b4e2097 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:33.860488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d555c82-107f-4512-a131-647c2b4e2097 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.131815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3f2994c9-ee24-4025-b1e1-ef5d6cef6088 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:34.139837 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f2994c9-ee24-4025-b1e1-ef5d6cef6088 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.346463 Sep 10 20:59:34.151666 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1518/3111] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:33 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:34.167148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-70046ed0-5e17-4288-9c86-df3efe1e62a6 req-3bb1fadc-a5e6-45a4-8842-ffd5569427e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0496a52e-07cc-49bb-bdd1-e9f2833b5023", "tag": "09b57074-b9c1-4237-a396-c6f0dde74892"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:34.180579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-70046ed0-5e17-4288-9c86-df3efe1e62a6 req-3bb1fadc-a5e6-45a4-8842-ffd5569427e1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.181471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-70046ed0-5e17-4288-9c86-df3efe1e62a6 req-3bb1fadc-a5e6-45a4-8842-ffd5569427e1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.182129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-70046ed0-5e17-4288-9c86-df3efe1e62a6 req-3bb1fadc-a5e6-45a4-8842-ffd5569427e1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.195977 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-70046ed0-5e17-4288-9c86-df3efe1e62a6 req-3bb1fadc-a5e6-45a4-8842-ffd5569427e1 service nova] Creating event network-changed:09b57074-b9c1-4237-a396-c6f0dde74892 for instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 on nch1-master-1 Sep 10 20:59:34.203497 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-70046ed0-5e17-4288-9c86-df3efe1e62a6 req-3bb1fadc-a5e6-45a4-8842-ffd5569427e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039321 Sep 10 20:59:34.205225 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1519/3112] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:34.214532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eb99a710-25f3-42ea-b2d2-0f00c49e6fe2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:34.216958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eb99a710-25f3-42ea-b2d2-0f00c49e6fe2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:34.226513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb99a710-25f3-42ea-b2d2-0f00c49e6fe2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.227244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb99a710-25f3-42ea-b2d2-0f00c49e6fe2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.228410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb99a710-25f3-42ea-b2d2-0f00c49e6fe2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.229370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb99a710-25f3-42ea-b2d2-0f00c49e6fe2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.230363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb99a710-25f3-42ea-b2d2-0f00c49e6fe2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.230795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb99a710-25f3-42ea-b2d2-0f00c49e6fe2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.308314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8d555c82-107f-4512-a131-647c2b4e2097 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:34.319696 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8d555c82-107f-4512-a131-647c2b4e2097 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 0.495937 Sep 10 20:59:34.321531 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1594/3113] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:33 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:34.336720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-660eade3-086b-483b-815b-a36430af98f7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:34.337636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-660eade3-086b-483b-815b-a36430af98f7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:34.347261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660eade3-086b-483b-815b-a36430af98f7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.350536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660eade3-086b-483b-815b-a36430af98f7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.351010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660eade3-086b-483b-815b-a36430af98f7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.351738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660eade3-086b-483b-815b-a36430af98f7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.352198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660eade3-086b-483b-815b-a36430af98f7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.352624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660eade3-086b-483b-815b-a36430af98f7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.422441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-660eade3-086b-483b-815b-a36430af98f7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:59:34.502061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eb99a710-25f3-42ea-b2d2-0f00c49e6fe2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:34.512123 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eb99a710-25f3-42ea-b2d2-0f00c49e6fe2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1316 microversion: 2.1 time: 0.304980 Sep 10 20:59:34.515131 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1520/3114] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:34 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:34.522320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a4a4ef9-f6ad-45a0-bd1b-e3c63597cc54 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-213217075", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a4a4ef9-f6ad-45a0-bd1b-e3c63597cc54 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action HTTP/1.1 Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 618 Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-213217075", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'a009fbee-aff7-41a2-be0f-785d15e2e42a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-213217075', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:59:34.528475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 20:59:34.531402 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.539389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a4a4ef9-f6ad-45a0-bd1b-e3c63597cc54 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:34.540517 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7a4a4ef9-f6ad-45a0-bd1b-e3c63597cc54 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action" status: 400 len: 938 microversion: 2.1 time: 0.024172 Sep 10 20:59:34.545648 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1521/3115] 10.222.0.33 () {60 vars in 1279 bytes} [Sat Sep 10 20:59:34 2022] POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action => generated 938 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:59:34.551769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:34.556349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:34.567602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.568369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.569009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.570007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.570703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.571324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.592341 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046/action HTTP/1.1 Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 65 Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5f1f769d-7314-4652-8dff-f06c1b403046', 'body': {'rebuild': {'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12'}}} Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 10 20:59:34.595782 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 20:59:34.601123 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:34.603892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:34.606719 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f7b1dab8-020d-4e22-a2b0-518b43adabb7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046/action" status: 404 len: 111 microversion: 2.1 time: 0.059083 Sep 10 20:59:34.607537 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1522/3116] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:34 2022] POST /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:34.613967 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-660eade3-086b-483b-815b-a36430af98f7 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 204 len: 0 microversion: 2.1 time: 0.290763 Sep 10 20:59:34.615262 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1595/3117] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:59:34 2022] DELETE /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:59:34.619502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fdf7c220-5bd3-4cb1-a0d2-0a7fc7ca6bbb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:34.622640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b80b78f8-1c98-426f-8a57-2717fa1b249f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:34.623661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fdf7c220-5bd3-4cb1-a0d2-0a7fc7ca6bbb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:34.627629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b80b78f8-1c98-426f-8a57-2717fa1b249f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:34.636342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdf7c220-5bd3-4cb1-a0d2-0a7fc7ca6bbb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.636842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdf7c220-5bd3-4cb1-a0d2-0a7fc7ca6bbb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.639357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdf7c220-5bd3-4cb1-a0d2-0a7fc7ca6bbb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.640325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdf7c220-5bd3-4cb1-a0d2-0a7fc7ca6bbb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.641303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdf7c220-5bd3-4cb1-a0d2-0a7fc7ca6bbb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.643280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdf7c220-5bd3-4cb1-a0d2-0a7fc7ca6bbb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.645048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b80b78f8-1c98-426f-8a57-2717fa1b249f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.648181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b80b78f8-1c98-426f-8a57-2717fa1b249f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.648839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b80b78f8-1c98-426f-8a57-2717fa1b249f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.649769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b80b78f8-1c98-426f-8a57-2717fa1b249f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.653374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b80b78f8-1c98-426f-8a57-2717fa1b249f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.654068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b80b78f8-1c98-426f-8a57-2717fa1b249f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.938265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fdf7c220-5bd3-4cb1-a0d2-0a7fc7ca6bbb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:34.946872 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fdf7c220-5bd3-4cb1-a0d2-0a7fc7ca6bbb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1521 microversion: 2.1 time: 0.338129 Sep 10 20:59:34.950310 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1523/3118] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:34 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:34.981926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4992db39-7d7c-4e7b-9344-b1d77d552623 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:34.983668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4992db39-7d7c-4e7b-9344-b1d77d552623 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:34.993185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4992db39-7d7c-4e7b-9344-b1d77d552623 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.994141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4992db39-7d7c-4e7b-9344-b1d77d552623 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.994782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4992db39-7d7c-4e7b-9344-b1d77d552623 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:34.995842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4992db39-7d7c-4e7b-9344-b1d77d552623 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:34.996466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4992db39-7d7c-4e7b-9344-b1d77d552623 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:34.997060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4992db39-7d7c-4e7b-9344-b1d77d552623 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.005291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b80b78f8-1c98-426f-8a57-2717fa1b249f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:35.018238 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b80b78f8-1c98-426f-8a57-2717fa1b249f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.397376 Sep 10 20:59:35.019000 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1596/3119] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:34 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:35.047541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:35.048450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:35.055742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.056577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.057210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.058139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.058775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.059364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.285914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4992db39-7d7c-4e7b-9344-b1d77d552623 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:35.294809 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4992db39-7d7c-4e7b-9344-b1d77d552623 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.317346 Sep 10 20:59:35.298436 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1524/3120] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:34 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:35.303221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54af1658-d14f-4b32-b984-c75f6fcb6020 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944d73dc0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:35.381504 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-54af1658-d14f-4b32-b984-c75f6fcb6020 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.081884 Sep 10 20:59:35.388786 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1525/3121] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:35 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:35.397680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a3f05e4c-410e-42f9-b0ee-0b3f41d9f927 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:35.399273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a3f05e4c-410e-42f9-b0ee-0b3f41d9f927 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:35.408006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3f05e4c-410e-42f9-b0ee-0b3f41d9f927 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.409456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3f05e4c-410e-42f9-b0ee-0b3f41d9f927 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.410758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3f05e4c-410e-42f9-b0ee-0b3f41d9f927 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.411727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3f05e4c-410e-42f9-b0ee-0b3f41d9f927 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.412419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3f05e4c-410e-42f9-b0ee-0b3f41d9f927 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.413072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3f05e4c-410e-42f9-b0ee-0b3f41d9f927 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.468709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:35.478027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:35.480401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:35.481862 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d8b0c1e6-7d0a-49b4-a193-5a0aff3311f5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1359 microversion: 2.21 time: 0.452675 Sep 10 20:59:35.486344 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1597/3122] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:35 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1359 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:35.492203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6b17331c-c950-4d7b-9bdc-d24c6634304a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:35.493138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6b17331c-c950-4d7b-9bdc-d24c6634304a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:35.500054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b17331c-c950-4d7b-9bdc-d24c6634304a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.500970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b17331c-c950-4d7b-9bdc-d24c6634304a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.501654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b17331c-c950-4d7b-9bdc-d24c6634304a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.502646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b17331c-c950-4d7b-9bdc-d24c6634304a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.503432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b17331c-c950-4d7b-9bdc-d24c6634304a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.504423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b17331c-c950-4d7b-9bdc-d24c6634304a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.693520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6b17331c-c950-4d7b-9bdc-d24c6634304a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:35.704711 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6b17331c-c950-4d7b-9bdc-d24c6634304a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.216656 Sep 10 20:59:35.717850 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1598/3123] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:35 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:35.718202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3f05e4c-410e-42f9-b0ee-0b3f41d9f927 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:35.718317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3a2ef9b-7b6f-4d8b-9962-27fbc18021ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:35.718317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3a2ef9b-7b6f-4d8b-9962-27fbc18021ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:35.718478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a2ef9b-7b6f-4d8b-9962-27fbc18021ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.719018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a2ef9b-7b6f-4d8b-9962-27fbc18021ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.719328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a2ef9b-7b6f-4d8b-9962-27fbc18021ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.720192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a2ef9b-7b6f-4d8b-9962-27fbc18021ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.726912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a2ef9b-7b6f-4d8b-9962-27fbc18021ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.726912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a2ef9b-7b6f-4d8b-9962-27fbc18021ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.731418 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a3f05e4c-410e-42f9-b0ee-0b3f41d9f927 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1521 microversion: 2.1 time: 0.340659 Sep 10 20:59:35.733592 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1526/3124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:35 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:35.738554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-028143e2-4bb1-4acd-90fc-0abaa7b6b3cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:35.739396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-028143e2-4bb1-4acd-90fc-0abaa7b6b3cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:35.750262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-028143e2-4bb1-4acd-90fc-0abaa7b6b3cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.750673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-028143e2-4bb1-4acd-90fc-0abaa7b6b3cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.751107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-028143e2-4bb1-4acd-90fc-0abaa7b6b3cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.751822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-028143e2-4bb1-4acd-90fc-0abaa7b6b3cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.760066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-028143e2-4bb1-4acd-90fc-0abaa7b6b3cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.760625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-028143e2-4bb1-4acd-90fc-0abaa7b6b3cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.920086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f3a2ef9b-7b6f-4d8b-9962-27fbc18021ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:35.931249 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3a2ef9b-7b6f-4d8b-9962-27fbc18021ec tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 0.224404 Sep 10 20:59:35.932458 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1599/3125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:35 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:35.937133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f5959d3-e041-455d-80d8-05c3e041f146 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:35.940130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5f5959d3-e041-455d-80d8-05c3e041f146 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5bb4c36f-783c-4b6d-a576-25c6d630fdf3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:35.946550 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-5f5959d3-e041-455d-80d8-05c3e041f146 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 5bb4c36f-783c-4b6d-a576-25c6d630fdf3 could not be found. Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f5959d3-e041-455d-80d8-05c3e041f146 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/5bb4c36f-783c-4b6d-a576-25c6d630fdf3/action HTTP/1.1 Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 65 Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5bb4c36f-783c-4b6d-a576-25c6d630fdf3 could not be found. Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5bb4c36f-783c-4b6d-a576-25c6d630fdf3', 'body': {'rebuild': {'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12'}}} Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb4c36f-783c-4b6d-a576-25c6d630fdf3 could not be found. Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 20:59:35.948330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb4c36f-783c-4b6d-a576-25c6d630fdf3 could not be found. Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb4c36f-783c-4b6d-a576-25c6d630fdf3 could not be found. Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f5959d3-e041-455d-80d8-05c3e041f146 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 5bb4c36f-783c-4b6d-a576-25c6d630fdf3 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f5959d3-e041-455d-80d8-05c3e041f146 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/5bb4c36f-783c-4b6d-a576-25c6d630fdf3/action" status: 404 len: 111 microversion: 2.1 time: 0.016307 Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1600/3126] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:35 2022] POST /compute/v2.1/servers/5bb4c36f-783c-4b6d-a576-25c6d630fdf3/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:35.956299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-04889b00-a8e3-4777-90ba-d5625ab9cd64 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-04889b00-a8e3-4777-90ba-d5625ab9cd64 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action HTTP/1.1 Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 285 Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a009fbee-aff7-41a2-be0f-785d15e2e42a', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:35.960902 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 20:59:35.964018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:35.968108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-04889b00-a8e3-4777-90ba-d5625ab9cd64 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:35.968993 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-04889b00-a8e3-4777-90ba-d5625ab9cd64 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action" status: 400 len: 619 microversion: 2.1 time: 0.017395 Sep 10 20:59:35.969579 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1601/3127] 10.222.0.33 () {60 vars in 1279 bytes} [Sat Sep 10 20:59:35 2022] POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:59:35.980206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59a267fe-79c7-4162-891e-2f97c8a248ad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:35.980836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59a267fe-79c7-4162-891e-2f97c8a248ad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:35.987309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59a267fe-79c7-4162-891e-2f97c8a248ad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.987801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59a267fe-79c7-4162-891e-2f97c8a248ad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.988848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59a267fe-79c7-4162-891e-2f97c8a248ad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:35.989587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59a267fe-79c7-4162-891e-2f97c8a248ad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:35.990306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59a267fe-79c7-4162-891e-2f97c8a248ad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:35.990767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59a267fe-79c7-4162-891e-2f97c8a248ad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.121796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-028143e2-4bb1-4acd-90fc-0abaa7b6b3cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:36.131796 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-028143e2-4bb1-4acd-90fc-0abaa7b6b3cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1466 microversion: 2.1 time: 0.397060 Sep 10 20:59:36.135929 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1527/3128] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:35 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1466 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:36.142575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-abf39e59-1711-4d21-8e68-d1e721465837 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:36.146727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-abf39e59-1711-4d21-8e68-d1e721465837 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:36.153538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf39e59-1711-4d21-8e68-d1e721465837 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.154393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf39e59-1711-4d21-8e68-d1e721465837 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.155186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf39e59-1711-4d21-8e68-d1e721465837 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.164791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf39e59-1711-4d21-8e68-d1e721465837 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.169105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf39e59-1711-4d21-8e68-d1e721465837 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.169685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf39e59-1711-4d21-8e68-d1e721465837 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.196344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-59a267fe-79c7-4162-891e-2f97c8a248ad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:36.204285 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59a267fe-79c7-4162-891e-2f97c8a248ad tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.233623 Sep 10 20:59:36.204869 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1602/3129] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:35 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:36.209967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d1ef72d7-e21c-4493-9c57-f86f3fef5b82 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:36.210576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d1ef72d7-e21c-4493-9c57-f86f3fef5b82 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:36.216583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1ef72d7-e21c-4493-9c57-f86f3fef5b82 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.217078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1ef72d7-e21c-4493-9c57-f86f3fef5b82 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.217523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1ef72d7-e21c-4493-9c57-f86f3fef5b82 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.218403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1ef72d7-e21c-4493-9c57-f86f3fef5b82 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.218868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1ef72d7-e21c-4493-9c57-f86f3fef5b82 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.219305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1ef72d7-e21c-4493-9c57-f86f3fef5b82 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.222128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:36.386838 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d1ef72d7-e21c-4493-9c57-f86f3fef5b82 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1617 microversion: 2.1 time: 0.177742 Sep 10 20:59:36.402654 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1603/3130] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:36 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1617 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:36.423660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-419f3b02-4704-4808-a67d-39b5448b5d6c req-2005abd5-bce4-4da6-a460-332804ddea1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2246b83-c09c-4d0e-8744-421b2eec5985", "tag": "5d34ee03-4994-483a-aaf3-880e271e480d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:36.435461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-419f3b02-4704-4808-a67d-39b5448b5d6c req-2005abd5-bce4-4da6-a460-332804ddea1f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.435954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-419f3b02-4704-4808-a67d-39b5448b5d6c req-2005abd5-bce4-4da6-a460-332804ddea1f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.436394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-419f3b02-4704-4808-a67d-39b5448b5d6c req-2005abd5-bce4-4da6-a460-332804ddea1f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.441134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-abf39e59-1711-4d21-8e68-d1e721465837 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:36.450895 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-419f3b02-4704-4808-a67d-39b5448b5d6c req-2005abd5-bce4-4da6-a460-332804ddea1f service nova] Creating event network-changed:5d34ee03-4994-483a-aaf3-880e271e480d for instance e2246b83-c09c-4d0e-8744-421b2eec5985 on nch1-master-1 Sep 10 20:59:36.457677 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-419f3b02-4704-4808-a67d-39b5448b5d6c req-2005abd5-bce4-4da6-a460-332804ddea1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052265 Sep 10 20:59:36.458824 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1604/3131] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:36.463508 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-abf39e59-1711-4d21-8e68-d1e721465837 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1521 microversion: 2.1 time: 0.326187 Sep 10 20:59:36.469865 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1528/3132] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:36 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:36.478354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d2321b6-a01d-4cc3-870e-7e41d484ac81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:36.479150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d2321b6-a01d-4cc3-870e-7e41d484ac81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:36.493037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4cb37d91-f044-4801-bf67-47b681c2485b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:36.493512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2321b6-a01d-4cc3-870e-7e41d484ac81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.494367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2321b6-a01d-4cc3-870e-7e41d484ac81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.494977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2321b6-a01d-4cc3-870e-7e41d484ac81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.495956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2321b6-a01d-4cc3-870e-7e41d484ac81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.496583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2321b6-a01d-4cc3-870e-7e41d484ac81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.497178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d2321b6-a01d-4cc3-870e-7e41d484ac81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.501520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4cb37d91-f044-4801-bf67-47b681c2485b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:36.525135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb37d91-f044-4801-bf67-47b681c2485b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.526711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb37d91-f044-4801-bf67-47b681c2485b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.527757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb37d91-f044-4801-bf67-47b681c2485b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.528674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb37d91-f044-4801-bf67-47b681c2485b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.529140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb37d91-f044-4801-bf67-47b681c2485b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.529914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb37d91-f044-4801-bf67-47b681c2485b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.738367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d2321b6-a01d-4cc3-870e-7e41d484ac81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:36.753244 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d2321b6-a01d-4cc3-870e-7e41d484ac81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.288775 Sep 10 20:59:36.770048 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1605/3133] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:36 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:36.774677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-14833c56-dc5d-468f-8bce-8d3fb989a3ec tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944aee310>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:36.827991 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-14833c56-dc5d-468f-8bce-8d3fb989a3ec tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.062656 Sep 10 20:59:36.829289 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1606/3134] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:36 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:36.836366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4cb37d91-f044-4801-bf67-47b681c2485b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:36.844514 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4cb37d91-f044-4801-bf67-47b681c2485b tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.374546 Sep 10 20:59:36.847683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07071744-ff0b-4d7e-9938-ab692cf6d219 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:36.849291 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1529/3135] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:36 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:36.851558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-07071744-ff0b-4d7e-9938-ab692cf6d219 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:36.855332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:36.862187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:36.866476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07071744-ff0b-4d7e-9938-ab692cf6d219 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.866988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07071744-ff0b-4d7e-9938-ab692cf6d219 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.867446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07071744-ff0b-4d7e-9938-ab692cf6d219 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.868178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07071744-ff0b-4d7e-9938-ab692cf6d219 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.868645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07071744-ff0b-4d7e-9938-ab692cf6d219 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.869081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07071744-ff0b-4d7e-9938-ab692cf6d219 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.878424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.879753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.880210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:36.880944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:36.881409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:36.881890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:37.120801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-07071744-ff0b-4d7e-9938-ab692cf6d219 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:37.132932 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-07071744-ff0b-4d7e-9938-ab692cf6d219 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1521 microversion: 2.1 time: 0.302264 Sep 10 20:59:37.134397 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1607/3136] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:36 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:37.140923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1737281641", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["830cb245-7e91-4f1a-ae12-8010551e3aad"]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:37.164355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:37.209042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 20:59:37.565532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:37.586064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:37.589486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:37.592207 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-51fe208f-6272-4da9-8e52-89f8b0e3f12e tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1359 microversion: 2.21 time: 0.741591 Sep 10 20:59:37.594081 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1530/3137] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:36 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1359 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:37.604513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25e0e67a-8e69-4e70-881d-2381d3914a3d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:37.609696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-25e0e67a-8e69-4e70-881d-2381d3914a3d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 133b8ea6-15af-4ef0-addb-b2eeb6d082c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:37.621850 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-25e0e67a-8e69-4e70-881d-2381d3914a3d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 133b8ea6-15af-4ef0-addb-b2eeb6d082c4 could not be found. Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25e0e67a-8e69-4e70-881d-2381d3914a3d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/133b8ea6-15af-4ef0-addb-b2eeb6d082c4/action HTTP/1.1 Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 15 Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: {"restore": {}} Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 133b8ea6-15af-4ef0-addb-b2eeb6d082c4 could not be found. Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '133b8ea6-15af-4ef0-addb-b2eeb6d082c4', 'body': {'restore': {}}} Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133b8ea6-15af-4ef0-addb-b2eeb6d082c4 could not be found. Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133b8ea6-15af-4ef0-addb-b2eeb6d082c4 could not be found. Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:37.625940 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:37.630932 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:37.630932 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:37.630932 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133b8ea6-15af-4ef0-addb-b2eeb6d082c4 could not be found. Sep 10 20:59:37.630932 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:37.632580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25e0e67a-8e69-4e70-881d-2381d3914a3d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 133b8ea6-15af-4ef0-addb-b2eeb6d082c4 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:37.633846 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-25e0e67a-8e69-4e70-881d-2381d3914a3d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/133b8ea6-15af-4ef0-addb-b2eeb6d082c4/action" status: 404 len: 111 microversion: 2.1 time: 0.036291 Sep 10 20:59:37.638104 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1531/3138] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:37 2022] POST /compute/v2.1/servers/133b8ea6-15af-4ef0-addb-b2eeb6d082c4/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:37.643430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6fec92a1-d07a-43c9-a3ff-098148ed1b7a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:37.644420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6fec92a1-d07a-43c9-a3ff-098148ed1b7a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:37.654620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fec92a1-d07a-43c9-a3ff-098148ed1b7a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:37.655381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fec92a1-d07a-43c9-a3ff-098148ed1b7a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:37.655736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 20:59:37.656205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 20:59:37.656688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 20:59:37.657109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 20:59:37.657531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 20:59:37.658219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fec92a1-d07a-43c9-a3ff-098148ed1b7a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:37.662559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fec92a1-d07a-43c9-a3ff-098148ed1b7a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:37.663042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fec92a1-d07a-43c9-a3ff-098148ed1b7a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:37.663485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fec92a1-d07a-43c9-a3ff-098148ed1b7a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:37.681264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:37.681764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:37.682245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:37.685990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:37.686484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:37.689968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:37.747459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 20:59:37.758269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 20:59:37.798885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 20:59:37.809896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 20:59:37.910532 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-753b4c5d-31a8-4d39-a99b-26c613324540 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774396 Sep 10 20:59:37.911960 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1608/3139] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:59:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 20:59:37.918880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-135747bb-ca54-40ba-9ad7-56e0f50c13ca tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1712238012"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:37.923923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-135747bb-ca54-40ba-9ad7-56e0f50c13ca tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:37.947168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135747bb-ca54-40ba-9ad7-56e0f50c13ca tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:37.947702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135747bb-ca54-40ba-9ad7-56e0f50c13ca tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:37.948165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135747bb-ca54-40ba-9ad7-56e0f50c13ca tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:37.948917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135747bb-ca54-40ba-9ad7-56e0f50c13ca tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:37.949389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135747bb-ca54-40ba-9ad7-56e0f50c13ca tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:37.949845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135747bb-ca54-40ba-9ad7-56e0f50c13ca tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:38.079254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6fec92a1-d07a-43c9-a3ff-098148ed1b7a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:38.090507 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6fec92a1-d07a-43c9-a3ff-098148ed1b7a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 0.450838 Sep 10 20:59:38.095605 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1532/3140] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:37 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:38.128452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3b0e8a21-f623-4f3b-8109-8c3753807576 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:38.138448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3b0e8a21-f623-4f3b-8109-8c3753807576 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:38.150422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b0e8a21-f623-4f3b-8109-8c3753807576 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:38.150918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b0e8a21-f623-4f3b-8109-8c3753807576 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:38.151362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b0e8a21-f623-4f3b-8109-8c3753807576 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:38.152069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b0e8a21-f623-4f3b-8109-8c3753807576 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:38.152526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b0e8a21-f623-4f3b-8109-8c3753807576 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:38.152947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b0e8a21-f623-4f3b-8109-8c3753807576 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:38.375123 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-135747bb-ca54-40ba-9ad7-56e0f50c13ca tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action" status: 202 len: 0 microversion: 2.1 time: 0.460448 Sep 10 20:59:38.378072 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1609/3141] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:37 2022] POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 20:59:38.398302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9244d83f-f959-4603-bfe6-5bbf65006f89 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99450df3a0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:38.612542 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9244d83f-f959-4603-bfe6-5bbf65006f89 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.231602 Sep 10 20:59:38.627953 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1610/3142] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:38 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:38.653196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3db79ad7-e774-4eb8-8970-be8bc2756abb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:38.658751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3db79ad7-e774-4eb8-8970-be8bc2756abb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:38.673500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db79ad7-e774-4eb8-8970-be8bc2756abb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:38.674052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db79ad7-e774-4eb8-8970-be8bc2756abb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:38.675061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db79ad7-e774-4eb8-8970-be8bc2756abb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:38.677203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db79ad7-e774-4eb8-8970-be8bc2756abb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:38.677818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db79ad7-e774-4eb8-8970-be8bc2756abb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:38.678307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db79ad7-e774-4eb8-8970-be8bc2756abb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:38.724344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3b0e8a21-f623-4f3b-8109-8c3753807576 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:38.734664 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3b0e8a21-f623-4f3b-8109-8c3753807576 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.637892 Sep 10 20:59:38.738024 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1533/3143] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:38 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:38.751347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54b0a141-a168-423c-8ab4-89a3addb3987 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:38.754594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-54b0a141-a168-423c-8ab4-89a3addb3987 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:38.895275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-54b0a141-a168-423c-8ab4-89a3addb3987 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:38.904821 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-54b0a141-a168-423c-8ab4-89a3addb3987 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1217 microversion: 2.1 time: 0.165329 Sep 10 20:59:38.920443 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1534/3144] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:38 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:38.920680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3db79ad7-e774-4eb8-8970-be8bc2756abb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:38.923626 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3db79ad7-e774-4eb8-8970-be8bc2756abb tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1522 microversion: 2.1 time: 0.292574 Sep 10 20:59:38.925484 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1611/3145] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:38 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:38.929699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1401497197"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:38.930912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:38.931536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:38.933213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:38.938743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:38.940057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:38.940057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:38.941471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:38.942203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:38.942801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:38.948965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:38.949612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:38.950194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:38.951021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:38.951589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:38.952272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:38.982781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:38.998435 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Cannot 'createImage' instance a009fbee-aff7-41a2-be0f-785d15e2e42a while it is in task_state image_snapshot Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action HTTP/1.1 Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 85 Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1401497197"}} Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: exception: Cannot 'createImage' instance a009fbee-aff7-41a2-be0f-785d15e2e42a while it is in task_state image_snapshot Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'a009fbee-aff7-41a2-be0f-785d15e2e42a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1401497197'}}} Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a in task_state image_snapshot. Cannot snapshot while the instance is in this state. Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:59:39.000160 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance a009fbee-aff7-41a2-be0f-785d15e2e42a while it is in task_state image_snapshot Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance a009fbee-aff7-41a2-be0f-785d15e2e42a while it is in task_state image_snapshot Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:39.006032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 409 to user: Cannot 'createImage' instance a009fbee-aff7-41a2-be0f-785d15e2e42a while it is in task_state image_snapshot {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:39.009978 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-61c9e713-80b6-4db2-8a2e-9a2d3aba6499 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action" status: 409 len: 159 microversion: 2.1 time: 0.093596 Sep 10 20:59:39.014859 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1535/3146] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:38 2022] POST /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a/action => generated 159 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:59:39.021802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-664ec04d-323a-4fa7-8fdc-a0c3b666923f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:39.023026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-664ec04d-323a-4fa7-8fdc-a0c3b666923f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:39.033332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-664ec04d-323a-4fa7-8fdc-a0c3b666923f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:39.035026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-664ec04d-323a-4fa7-8fdc-a0c3b666923f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:39.035852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-664ec04d-323a-4fa7-8fdc-a0c3b666923f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:39.036814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-664ec04d-323a-4fa7-8fdc-a0c3b666923f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:39.038256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-664ec04d-323a-4fa7-8fdc-a0c3b666923f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:39.038914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-664ec04d-323a-4fa7-8fdc-a0c3b666923f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:39.127231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:39.137201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:39.138696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:39.139863 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bcec0705-d715-4563-ad3a-10d87789f910 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1359 microversion: 2.21 time: 0.212929 Sep 10 20:59:39.140752 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1612/3147] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:38 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:39.146350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d851bc75-0a20-4418-84b6-e8e5dd6daf10 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '.version_select at 0x7f9944adb280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:39.390042 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d851bc75-0a20-4418-84b6-e8e5dd6daf10 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "DELETE /compute/v2.1/images/5571b19b-b116-497d-b7db-b2031038ae70" status: 204 len: 0 microversion: 2.1 time: 0.247899 Sep 10 20:59:39.390695 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1613/3148] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:39 2022] DELETE /compute/v2.1/images/5571b19b-b116-497d-b7db-b2031038ae70 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:59:39.392309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-664ec04d-323a-4fa7-8fdc-a0c3b666923f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:39.397771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-63445350-86f0-432d-b250-9b6d958bfa21 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:39.398579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-63445350-86f0-432d-b250-9b6d958bfa21 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:39.402353 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-664ec04d-323a-4fa7-8fdc-a0c3b666923f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.385952 Sep 10 20:59:39.403491 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1536/3149] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:39 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:39.411515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-86468f68-8994-45cb-93a4-7826285ad367 req-5ca38675-782a-4e74-a538-e18ba3db2b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be", "name": "network-vif-deleted", "tag": "a7339d4b-d64a-4271-90e0-2f1b782cc9fb"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:39.423006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63445350-86f0-432d-b250-9b6d958bfa21 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:39.433997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63445350-86f0-432d-b250-9b6d958bfa21 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:39.434538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63445350-86f0-432d-b250-9b6d958bfa21 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:39.437912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63445350-86f0-432d-b250-9b6d958bfa21 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:39.438516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63445350-86f0-432d-b250-9b6d958bfa21 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:39.440381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63445350-86f0-432d-b250-9b6d958bfa21 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:39.454552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-86468f68-8994-45cb-93a4-7826285ad367 req-5ca38675-782a-4e74-a538-e18ba3db2b3d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:39.460781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-86468f68-8994-45cb-93a4-7826285ad367 req-5ca38675-782a-4e74-a538-e18ba3db2b3d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:39.467307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-86468f68-8994-45cb-93a4-7826285ad367 req-5ca38675-782a-4e74-a538-e18ba3db2b3d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:39.500225 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-86468f68-8994-45cb-93a4-7826285ad367 req-5ca38675-782a-4e74-a538-e18ba3db2b3d service nova] Creating event network-vif-deleted:a7339d4b-d64a-4271-90e0-2f1b782cc9fb for instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be on nch2-master-1 Sep 10 20:59:39.513169 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-86468f68-8994-45cb-93a4-7826285ad367 req-5ca38675-782a-4e74-a538-e18ba3db2b3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108136 Sep 10 20:59:39.521519 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1537/3150] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:39.529919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80647082-5226-4d01-91a2-d5ea50a1a8b4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:39.545489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-80647082-5226-4d01-91a2-d5ea50a1a8b4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:39.598798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80647082-5226-4d01-91a2-d5ea50a1a8b4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:39.617019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80647082-5226-4d01-91a2-d5ea50a1a8b4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:39.617648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80647082-5226-4d01-91a2-d5ea50a1a8b4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:39.618468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80647082-5226-4d01-91a2-d5ea50a1a8b4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:39.618956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80647082-5226-4d01-91a2-d5ea50a1a8b4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:39.619403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80647082-5226-4d01-91a2-d5ea50a1a8b4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:39.832975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-63445350-86f0-432d-b250-9b6d958bfa21 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:39.850079 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-63445350-86f0-432d-b250-9b6d958bfa21 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 0.458200 Sep 10 20:59:39.850710 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1614/3151] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:39 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:39.875223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:39.876076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:39.906912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:39.908815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:39.911016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:39.912277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:39.913133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:39.913758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:39.996843 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Cannot 'restore' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action HTTP/1.1 Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 15 Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: {"restore": {}} Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: exception: Cannot 'restore' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2bfdc13f-9c2e-44ec-8553-3f779ead89af', 'body': {'restore': {}}} Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af in vm_state active. Cannot restore while the instance is in this state. Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:39.999897 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:40.004763 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:40.004763 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:40.004763 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:40.004763 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 20:59:40.004763 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:40.005322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 409 to user: Cannot 'restore' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:40.006129 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-31c2fe41-c3dd-47ef-9830-792cede4b9cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 409 len: 145 microversion: 2.1 time: 0.142983 Sep 10 20:59:40.006871 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1615/3152] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:39 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 145 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:59:40.019883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0bab40cc-891f-4fe2-8702-14ec7a6f8ce1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99441929d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:40.075784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-80647082-5226-4d01-91a2-d5ea50a1a8b4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:40.085333 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0bab40cc-891f-4fe2-8702-14ec7a6f8ce1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.077550 Sep 10 20:59:40.087138 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1616/3153] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:40 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:40.090542 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-80647082-5226-4d01-91a2-d5ea50a1a8b4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1533 microversion: 2.1 time: 0.567287 Sep 10 20:59:40.093122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f300f5a4-03e0-42d5-9fbf-66a8a5578f7b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:40.094020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f300f5a4-03e0-42d5-9fbf-66a8a5578f7b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:40.096350 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1538/3154] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:39 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1533 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:40.108683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f300f5a4-03e0-42d5-9fbf-66a8a5578f7b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.109557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f300f5a4-03e0-42d5-9fbf-66a8a5578f7b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.112044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f300f5a4-03e0-42d5-9fbf-66a8a5578f7b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.113558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f300f5a4-03e0-42d5-9fbf-66a8a5578f7b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.115806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f300f5a4-03e0-42d5-9fbf-66a8a5578f7b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.117391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f300f5a4-03e0-42d5-9fbf-66a8a5578f7b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.117937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:40.121720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:40.139422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.140493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.141168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.142029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.142562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.143230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.213799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.214966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.216419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.217109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lazy-loading 'fault' on Instance uuid 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:59:40.244675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f300f5a4-03e0-42d5-9fbf-66a8a5578f7b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:40.253264 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f300f5a4-03e0-42d5-9fbf-66a8a5578f7b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1221 microversion: 2.1 time: 0.164756 Sep 10 20:59:40.254579 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1617/3155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:40 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1221 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:40.259487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c6d5cd27-00cc-4d42-a532-39ec80b6c415 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:40.260364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c6d5cd27-00cc-4d42-a532-39ec80b6c415 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:40.279371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6d5cd27-00cc-4d42-a532-39ec80b6c415 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.281022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6d5cd27-00cc-4d42-a532-39ec80b6c415 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.281787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6d5cd27-00cc-4d42-a532-39ec80b6c415 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.283286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6d5cd27-00cc-4d42-a532-39ec80b6c415 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.283926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6d5cd27-00cc-4d42-a532-39ec80b6c415 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.284528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6d5cd27-00cc-4d42-a532-39ec80b6c415 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.289089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b0a160808f4adda7be57cd535f0631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b1732129f3414fbc3f26fff6d039ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:40.299625 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0bb2e12f-6275-48fc-830d-dd9087e50a96 tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 200 len: 1312 microversion: 2.1 time: 0.197737 Sep 10 20:59:40.302632 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1539/3156] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:40 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:40.319236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:40.320771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:40.344511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.348349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.349161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.350145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.350903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.352299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.652565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:40.655202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c6d5cd27-00cc-4d42-a532-39ec80b6c415 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:40.670164 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c6d5cd27-00cc-4d42-a532-39ec80b6c415 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.414133 Sep 10 20:59:40.677402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:40.681101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:40.682494 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1618/3157] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:40 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:40.686348 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6b54af5d-d505-49f3-b7a5-52c9ce532074 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1359 microversion: 2.21 time: 0.379316 Sep 10 20:59:40.687229 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1540/3158] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:40 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1359 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:40.697888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6a656d0c-8865-4107-b9ad-c100838dfc1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:40.698532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6a656d0c-8865-4107-b9ad-c100838dfc1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:40.720120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a656d0c-8865-4107-b9ad-c100838dfc1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.721330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a656d0c-8865-4107-b9ad-c100838dfc1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.721797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a656d0c-8865-4107-b9ad-c100838dfc1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.722634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a656d0c-8865-4107-b9ad-c100838dfc1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.723575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a656d0c-8865-4107-b9ad-c100838dfc1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.724218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a656d0c-8865-4107-b9ad-c100838dfc1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.881237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c52b47a1-e7b1-48c0-b55a-f838ea28e9f4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:40.882278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c52b47a1-e7b1-48c0-b55a-f838ea28e9f4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:40.891966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52b47a1-e7b1-48c0-b55a-f838ea28e9f4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.893551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52b47a1-e7b1-48c0-b55a-f838ea28e9f4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.895069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52b47a1-e7b1-48c0-b55a-f838ea28e9f4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:40.896045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52b47a1-e7b1-48c0-b55a-f838ea28e9f4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:40.897946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52b47a1-e7b1-48c0-b55a-f838ea28e9f4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:40.898606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c52b47a1-e7b1-48c0-b55a-f838ea28e9f4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.021398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6a656d0c-8865-4107-b9ad-c100838dfc1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:41.033558 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6a656d0c-8865-4107-b9ad-c100838dfc1a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.340019 Sep 10 20:59:41.046245 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1619/3159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:40 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:41.063686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c4bfe0bd-6136-48c6-8319-0fb27bff7738 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:41.066503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c4bfe0bd-6136-48c6-8319-0fb27bff7738 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 21623c0b-491b-4ec2-89d7-8ad7fc7175bd] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:41.086809 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-c4bfe0bd-6136-48c6-8319-0fb27bff7738 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 21623c0b-491b-4ec2-89d7-8ad7fc7175bd could not be found. Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c4bfe0bd-6136-48c6-8319-0fb27bff7738 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/21623c0b-491b-4ec2-89d7-8ad7fc7175bd/action HTTP/1.1 Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 14 Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: {"resume": {}} Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 21623c0b-491b-4ec2-89d7-8ad7fc7175bd could not be found. Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '21623c0b-491b-4ec2-89d7-8ad7fc7175bd', 'body': {'resume': {}}} Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21623c0b-491b-4ec2-89d7-8ad7fc7175bd could not be found. Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21623c0b-491b-4ec2-89d7-8ad7fc7175bd could not be found. Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:41.090382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:41.095980 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:41.095980 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:41.095980 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21623c0b-491b-4ec2-89d7-8ad7fc7175bd could not be found. Sep 10 20:59:41.095980 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:41.098164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c4bfe0bd-6136-48c6-8319-0fb27bff7738 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 21623c0b-491b-4ec2-89d7-8ad7fc7175bd could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:41.099364 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c4bfe0bd-6136-48c6-8319-0fb27bff7738 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/21623c0b-491b-4ec2-89d7-8ad7fc7175bd/action" status: 404 len: 111 microversion: 2.1 time: 0.039751 Sep 10 20:59:41.100246 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1620/3160] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:41 2022] POST /compute/v2.1/servers/21623c0b-491b-4ec2-89d7-8ad7fc7175bd/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:41.116765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-13193dd7-0115-4e8f-a937-53acd37fd19e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99450dff70>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:41.136127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c52b47a1-e7b1-48c0-b55a-f838ea28e9f4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:41.147894 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c52b47a1-e7b1-48c0-b55a-f838ea28e9f4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 0.271070 Sep 10 20:59:41.148682 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1541/3161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:40 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:41.153731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-769da63a-f198-45d7-8f9b-a86a64e8d3df tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:41.154446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-769da63a-f198-45d7-8f9b-a86a64e8d3df tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:41.164338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-769da63a-f198-45d7-8f9b-a86a64e8d3df tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.164918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-769da63a-f198-45d7-8f9b-a86a64e8d3df tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.165448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-769da63a-f198-45d7-8f9b-a86a64e8d3df tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.166277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-769da63a-f198-45d7-8f9b-a86a64e8d3df tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.166807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-769da63a-f198-45d7-8f9b-a86a64e8d3df tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.168439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-769da63a-f198-45d7-8f9b-a86a64e8d3df tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.215156 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-13193dd7-0115-4e8f-a937-53acd37fd19e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.102664 Sep 10 20:59:41.216227 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1621/3162] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:41 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:41.227104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a4148f8-7a6d-4ab3-9ba3-075fbf1201a9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:41.228033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a4148f8-7a6d-4ab3-9ba3-075fbf1201a9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:41.243072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a4148f8-7a6d-4ab3-9ba3-075fbf1201a9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.250125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a4148f8-7a6d-4ab3-9ba3-075fbf1201a9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.251019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a4148f8-7a6d-4ab3-9ba3-075fbf1201a9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.251919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a4148f8-7a6d-4ab3-9ba3-075fbf1201a9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.254882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a4148f8-7a6d-4ab3-9ba3-075fbf1201a9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.255597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a4148f8-7a6d-4ab3-9ba3-075fbf1201a9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.477448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-769da63a-f198-45d7-8f9b-a86a64e8d3df tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:41.487431 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-769da63a-f198-45d7-8f9b-a86a64e8d3df tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.337634 Sep 10 20:59:41.489469 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1542/3163] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:41 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:41.496757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f9163e7e-97bc-4a50-a090-726dec73af75 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:41.497659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f9163e7e-97bc-4a50-a090-726dec73af75 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:41.508000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9163e7e-97bc-4a50-a090-726dec73af75 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.509185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9163e7e-97bc-4a50-a090-726dec73af75 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.509998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9163e7e-97bc-4a50-a090-726dec73af75 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.511094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9163e7e-97bc-4a50-a090-726dec73af75 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.511767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9163e7e-97bc-4a50-a090-726dec73af75 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.512478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9163e7e-97bc-4a50-a090-726dec73af75 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.639306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7a4148f8-7a6d-4ab3-9ba3-075fbf1201a9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:41.654946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f9163e7e-97bc-4a50-a090-726dec73af75 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:41.655451 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a4148f8-7a6d-4ab3-9ba3-075fbf1201a9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1533 microversion: 2.1 time: 0.436730 Sep 10 20:59:41.669848 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f9163e7e-97bc-4a50-a090-726dec73af75 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1213 microversion: 2.1 time: 0.176475 Sep 10 20:59:41.679276 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1622/3164] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:41 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1533 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:41.687490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:41.688349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] [instance: 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:41.691657 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1543/3165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:41 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1213 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:41.696991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9c8fa987-af0c-44ca-93f6-6319f665ff26 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:41.697566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.697709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9c8fa987-af0c-44ca-93f6-6319f665ff26 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:41.698527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.699255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.700150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.700784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.701385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.705844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c8fa987-af0c-44ca-93f6-6319f665ff26 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.706341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c8fa987-af0c-44ca-93f6-6319f665ff26 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.706817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c8fa987-af0c-44ca-93f6-6319f665ff26 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.707764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c8fa987-af0c-44ca-93f6-6319f665ff26 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.708224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c8fa987-af0c-44ca-93f6-6319f665ff26 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.708665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c8fa987-af0c-44ca-93f6-6319f665ff26 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.723731 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] HTTP exception thrown: Instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be could not be found. Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Request method failure captured: Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be HTTP/1.1 Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPlIfEE6BUsYm6N9cc6J4sKvQx8zkdVi0_eGxve7idCE5St69TEoXloNJQbmDpLOYE4kW76RSsXwzH4ER5m-rWYbak-zkdFvTsFOuE5UWRW73UCQGyOtVDm5s0CSvgZ9e1C_-bLDziBI_eeTxSX1Lq4xDS48kCIhpdBe8v0QA9iMeLw Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4b1732129f3414fbc3f26fff6d039ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4b1732129f3414fbc3f26fff6d039ec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4b1732129f3414fbc3f26fff6d039ec"}]}] Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f4b1732129f3414fbc3f26fff6d039ec Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788747657 Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d8b0a160808f4adda7be57cd535f0631 Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788747657-project Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be could not be found. Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be'} Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be could not be found. Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be could not be found. Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:41.726979 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:41.734731 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:41.734731 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:41.734731 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:41.734731 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:41.734731 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:41.734731 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:41.734731 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be could not be found. Sep 10 20:59:41.734731 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:41.747011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] Returning 404 to user: Instance 5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:41.750583 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c28f87e3-086b-4979-bdef-b98877d4633f tempest-ServerRescueNegativeTestJSON-788747657 tempest-ServerRescueNegativeTestJSON-788747657-project] 10.222.0.33 "GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be" status: 404 len: 111 microversion: 2.1 time: 0.068955 Sep 10 20:59:41.755344 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1623/3166] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:41 2022] GET /compute/v2.1/servers/5d3f4eb8-4348-4cdd-98fa-0b84aef4f3be => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:41.769298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:41.770237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:41.783202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.784097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.788946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:41.789734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:41.790250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:41.790698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:42.196978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9c8fa987-af0c-44ca-93f6-6319f665ff26 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:42.206018 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9c8fa987-af0c-44ca-93f6-6319f665ff26 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.513141 Sep 10 20:59:42.207265 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1544/3167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:41 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:42.216735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fbdc247b-198d-4177-be6f-6e6c664b5745 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:42.223344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fbdc247b-198d-4177-be6f-6e6c664b5745 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:42.235340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbdc247b-198d-4177-be6f-6e6c664b5745 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:42.236132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbdc247b-198d-4177-be6f-6e6c664b5745 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:42.236748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbdc247b-198d-4177-be6f-6e6c664b5745 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:42.237622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbdc247b-198d-4177-be6f-6e6c664b5745 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:42.238827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbdc247b-198d-4177-be6f-6e6c664b5745 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:42.239430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbdc247b-198d-4177-be6f-6e6c664b5745 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:42.512666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fbdc247b-198d-4177-be6f-6e6c664b5745 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:42.529507 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fbdc247b-198d-4177-be6f-6e6c664b5745 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 0.321232 Sep 10 20:59:42.555589 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1545/3168] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:42 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:42.569439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3defa0f9-aded-4a77-8ce6-84ed5991139c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944259940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:42.647287 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3defa0f9-aded-4a77-8ce6-84ed5991139c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.087727 Sep 10 20:59:42.647870 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1546/3169] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:42 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:42.664730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:42.666696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:42.677319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:42.684931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:42.685612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:42.688364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:42.689013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:42.689605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:42.740651 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Cannot 'resume' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action HTTP/1.1 Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 14 Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: {"resume": {}} Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: exception: Cannot 'resume' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2bfdc13f-9c2e-44ec-8553-3f779ead89af', 'body': {'resume': {}}} Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af in vm_state active. Cannot resume while the instance is in this state. Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:42.742380 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:42.746793 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:42.746793 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:42.746793 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:42.746793 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:42.746793 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:42.746793 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 20:59:42.746793 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:42.746793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 409 to user: Cannot 'resume' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:42.746793 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-db3b2d85-b673-4a24-9b34-b2f1814805d7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 409 len: 144 microversion: 2.1 time: 0.085896 Sep 10 20:59:42.746793 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1547/3170] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:42 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 144 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 20:59:42.756562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-81b6069f-fe0b-4573-adbf-30d284a77603 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:42.757565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-81b6069f-fe0b-4573-adbf-30d284a77603 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:42.767642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81b6069f-fe0b-4573-adbf-30d284a77603 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:42.768417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81b6069f-fe0b-4573-adbf-30d284a77603 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:42.769068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81b6069f-fe0b-4573-adbf-30d284a77603 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:42.770007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81b6069f-fe0b-4573-adbf-30d284a77603 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:42.770855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81b6069f-fe0b-4573-adbf-30d284a77603 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:42.772833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81b6069f-fe0b-4573-adbf-30d284a77603 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:42.786622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:42.803368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:42.804997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:42.810034 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-df377f20-9553-4148-b704-3225e45ae955 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1359 microversion: 2.21 time: 1.052014 Sep 10 20:59:42.814307 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1624/3171] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:41 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1359 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:42.827547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6df5fdd7-ce2b-43f7-a313-66852175c628 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:42.830471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6df5fdd7-ce2b-43f7-a313-66852175c628 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:42.840765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6df5fdd7-ce2b-43f7-a313-66852175c628 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:42.841244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6df5fdd7-ce2b-43f7-a313-66852175c628 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:42.841731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6df5fdd7-ce2b-43f7-a313-66852175c628 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:42.842654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6df5fdd7-ce2b-43f7-a313-66852175c628 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:42.843467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6df5fdd7-ce2b-43f7-a313-66852175c628 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:42.844068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6df5fdd7-ce2b-43f7-a313-66852175c628 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:42.945117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6df5fdd7-ce2b-43f7-a313-66852175c628 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:42.955710 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6df5fdd7-ce2b-43f7-a313-66852175c628 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1287 microversion: 2.1 time: 0.139497 Sep 10 20:59:42.957229 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1625/3172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:42 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1287 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:42.962679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe124dfa-a4eb-4c15-84ea-00271a8d6d23 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:42.963538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fe124dfa-a4eb-4c15-84ea-00271a8d6d23 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:42.970442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe124dfa-a4eb-4c15-84ea-00271a8d6d23 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:42.971165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe124dfa-a4eb-4c15-84ea-00271a8d6d23 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:42.971823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe124dfa-a4eb-4c15-84ea-00271a8d6d23 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:42.973563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe124dfa-a4eb-4c15-84ea-00271a8d6d23 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:42.974289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe124dfa-a4eb-4c15-84ea-00271a8d6d23 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:42.975555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe124dfa-a4eb-4c15-84ea-00271a8d6d23 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:43.182255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-81b6069f-fe0b-4573-adbf-30d284a77603 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:43.212647 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-81b6069f-fe0b-4573-adbf-30d284a77603 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1533 microversion: 2.1 time: 0.463955 Sep 10 20:59:43.213535 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1548/3173] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:42 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1533 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:43.297031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fe124dfa-a4eb-4c15-84ea-00271a8d6d23 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:43.308256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:43.310504 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fe124dfa-a4eb-4c15-84ea-00271a8d6d23 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.351585 Sep 10 20:59:43.322622 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1626/3174] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:42 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:43.361295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e359a2c-ede9-4839-a5c4-292df71ebda4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:43.362303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e359a2c-ede9-4839-a5c4-292df71ebda4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:43.380872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e359a2c-ede9-4839-a5c4-292df71ebda4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:43.384787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e359a2c-ede9-4839-a5c4-292df71ebda4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:43.387439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e359a2c-ede9-4839-a5c4-292df71ebda4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:43.394003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e359a2c-ede9-4839-a5c4-292df71ebda4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:43.396510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e359a2c-ede9-4839-a5c4-292df71ebda4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:43.397255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e359a2c-ede9-4839-a5c4-292df71ebda4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:43.559950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae31157a-2103-4369-ba34-e01ce12046ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:43.560587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ae31157a-2103-4369-ba34-e01ce12046ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:43.579234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae31157a-2103-4369-ba34-e01ce12046ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:43.579729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae31157a-2103-4369-ba34-e01ce12046ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:43.580171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae31157a-2103-4369-ba34-e01ce12046ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:43.583390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae31157a-2103-4369-ba34-e01ce12046ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:43.583876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae31157a-2103-4369-ba34-e01ce12046ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:43.585111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae31157a-2103-4369-ba34-e01ce12046ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:43.750362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e359a2c-ede9-4839-a5c4-292df71ebda4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:43.766462 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e359a2c-ede9-4839-a5c4-292df71ebda4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.419730 Sep 10 20:59:43.771009 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1549/3175] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:43 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:43.783559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-006517f4-9aca-4869-9650-c53d53304ea0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f994415ad30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:43.882701 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-006517f4-9aca-4869-9650-c53d53304ea0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.110278 Sep 10 20:59:43.883479 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1550/3176] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:43 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:43.894935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:43.898872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:43.906528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:43.907003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:43.907451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:43.908170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:43.909413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:43.910754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:44.040807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ae31157a-2103-4369-ba34-e01ce12046ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:44.052807 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ae31157a-2103-4369-ba34-e01ce12046ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 0.497231 Sep 10 20:59:44.052807 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1627/3177] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:43 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:44.064173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0980760e-95cb-40d4-b14d-431d896bdb90 req-835b644b-5d1b-46f2-96c7-6e879fa82285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0496a52e-07cc-49bb-bdd1-e9f2833b5023", "name": "network-vif-plugged", "status": "completed", "tag": "09b57074-b9c1-4237-a396-c6f0dde74892"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:44.090278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0980760e-95cb-40d4-b14d-431d896bdb90 req-835b644b-5d1b-46f2-96c7-6e879fa82285 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:44.090766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0980760e-95cb-40d4-b14d-431d896bdb90 req-835b644b-5d1b-46f2-96c7-6e879fa82285 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:44.098245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0980760e-95cb-40d4-b14d-431d896bdb90 req-835b644b-5d1b-46f2-96c7-6e879fa82285 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:44.120004 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0980760e-95cb-40d4-b14d-431d896bdb90 req-835b644b-5d1b-46f2-96c7-6e879fa82285 service nova] Creating event network-vif-plugged:09b57074-b9c1-4237-a396-c6f0dde74892 for instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 on nch1-master-1 Sep 10 20:59:44.125369 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0980760e-95cb-40d4-b14d-431d896bdb90 req-835b644b-5d1b-46f2-96c7-6e879fa82285 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073203 Sep 10 20:59:44.126684 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1628/3178] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:44.135331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5a62316d-26ca-4965-998a-dbb76b6ec855 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:44.136425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a62316d-26ca-4965-998a-dbb76b6ec855 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:44.152410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a62316d-26ca-4965-998a-dbb76b6ec855 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:44.153455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a62316d-26ca-4965-998a-dbb76b6ec855 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:44.155921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a62316d-26ca-4965-998a-dbb76b6ec855 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:44.156681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a62316d-26ca-4965-998a-dbb76b6ec855 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:44.157149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a62316d-26ca-4965-998a-dbb76b6ec855 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:44.157580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a62316d-26ca-4965-998a-dbb76b6ec855 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:44.256515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5a62316d-26ca-4965-998a-dbb76b6ec855 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:44.267981 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5a62316d-26ca-4965-998a-dbb76b6ec855 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1275 microversion: 2.1 time: 0.139918 Sep 10 20:59:44.273734 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1629/3179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:44 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:44.283915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fee3ed0f-3c20-4435-a217-62a42e7cf4b3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fee3ed0f-3c20-4435-a217-62a42e7cf4b3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 160 Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "02a59e8f-361e-4af8-bf69-eada4df89fa4"}]}} Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'networks': [{'uuid': '02a59e8f-361e-4af8-bf69-eada4df89fa4'}]}}} Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi '' Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 20:59:44.288282 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 20:59:44.292663 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:44.295364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fee3ed0f-3c20-4435-a217-62a42e7cf4b3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:44.296242 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fee3ed0f-3c20-4435-a217-62a42e7cf4b3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021295 Sep 10 20:59:44.300573 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1630/3180] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 20:59:44 2022] POST /compute/v2.1/servers => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:59:44.306673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-738ad0c5-db09-4b07-8bb4-c600141c83f2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:44.307338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-738ad0c5-db09-4b07-8bb4-c600141c83f2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:44.319427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-738ad0c5-db09-4b07-8bb4-c600141c83f2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:44.320174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-738ad0c5-db09-4b07-8bb4-c600141c83f2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:44.320788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-738ad0c5-db09-4b07-8bb4-c600141c83f2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:44.322014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-738ad0c5-db09-4b07-8bb4-c600141c83f2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:44.322638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-738ad0c5-db09-4b07-8bb4-c600141c83f2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:44.323228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-738ad0c5-db09-4b07-8bb4-c600141c83f2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:44.569393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-738ad0c5-db09-4b07-8bb4-c600141c83f2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:44.581073 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-738ad0c5-db09-4b07-8bb4-c600141c83f2 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1539 microversion: 2.1 time: 0.279279 Sep 10 20:59:44.583638 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1631/3181] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:44 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1539 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:44.589044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3cbb2c0-189e-49cb-b1b0-13054b1f078f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:44.589889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3cbb2c0-189e-49cb-b1b0-13054b1f078f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:44.599293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3cbb2c0-189e-49cb-b1b0-13054b1f078f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:44.600234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3cbb2c0-189e-49cb-b1b0-13054b1f078f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:44.601195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3cbb2c0-189e-49cb-b1b0-13054b1f078f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:44.602848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3cbb2c0-189e-49cb-b1b0-13054b1f078f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:44.605213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3cbb2c0-189e-49cb-b1b0-13054b1f078f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:44.605854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3cbb2c0-189e-49cb-b1b0-13054b1f078f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:44.714654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:44.723594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:44.725174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:44.739228 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-186146e2-8854-4274-ad98-9a04922b6315 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1359 microversion: 2.21 time: 0.854312 Sep 10 20:59:44.739913 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1551/3182] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:43 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1359 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:44.864284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f3cbb2c0-189e-49cb-b1b0-13054b1f078f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:44.882586 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3cbb2c0-189e-49cb-b1b0-13054b1f078f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.297632 Sep 10 20:59:44.898506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2b6b09f-0c22-4b87-aaf0-d9d728209c5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99441131f0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:44.899178 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1632/3183] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:44 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:44.911695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9ba9071b-9738-446e-8149-c7522d9a8d06 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:44.912305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9ba9071b-9738-446e-8149-c7522d9a8d06 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:44.919120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ba9071b-9738-446e-8149-c7522d9a8d06 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:44.920042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ba9071b-9738-446e-8149-c7522d9a8d06 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:44.920720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ba9071b-9738-446e-8149-c7522d9a8d06 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:44.921617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ba9071b-9738-446e-8149-c7522d9a8d06 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:44.923049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ba9071b-9738-446e-8149-c7522d9a8d06 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:44.923661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ba9071b-9738-446e-8149-c7522d9a8d06 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:45.000173 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c2b6b09f-0c22-4b87-aaf0-d9d728209c5d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.106371 Sep 10 20:59:45.000779 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1552/3184] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:44 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:45.073777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3300b0bf-1674-44c6-b839-0ee4943209f1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:45.074423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3300b0bf-1674-44c6-b839-0ee4943209f1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:45.087992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3300b0bf-1674-44c6-b839-0ee4943209f1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:45.088507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3300b0bf-1674-44c6-b839-0ee4943209f1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:45.088949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3300b0bf-1674-44c6-b839-0ee4943209f1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:45.089893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3300b0bf-1674-44c6-b839-0ee4943209f1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:45.090693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3300b0bf-1674-44c6-b839-0ee4943209f1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:45.091279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3300b0bf-1674-44c6-b839-0ee4943209f1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:45.118191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9ba9071b-9738-446e-8149-c7522d9a8d06 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:45.130447 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9ba9071b-9738-446e-8149-c7522d9a8d06 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.223256 Sep 10 20:59:45.143457 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1633/3185] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:44 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:45.158377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ab68885-efe7-4701-a7a7-34a6ff4c4c61 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:45.159200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ab68885-efe7-4701-a7a7-34a6ff4c4c61 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 3c82b617-7dd2-41b8-b5ee-28301d9f9c07] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:45.165939 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-5ab68885-efe7-4701-a7a7-34a6ff4c4c61 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 3c82b617-7dd2-41b8-b5ee-28301d9f9c07 could not be found. Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ab68885-efe7-4701-a7a7-34a6ff4c4c61 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/3c82b617-7dd2-41b8-b5ee-28301d9f9c07/action HTTP/1.1 Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 14 Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: {"shelve": {}} Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 3c82b617-7dd2-41b8-b5ee-28301d9f9c07 could not be found. Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '3c82b617-7dd2-41b8-b5ee-28301d9f9c07', 'body': {'shelve': {}}} Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c82b617-7dd2-41b8-b5ee-28301d9f9c07 could not be found. Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c82b617-7dd2-41b8-b5ee-28301d9f9c07 could not be found. Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:45.170404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:45.180505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:45.180505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:45.180505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c82b617-7dd2-41b8-b5ee-28301d9f9c07 could not be found. Sep 10 20:59:45.180505 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:45.182125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ab68885-efe7-4701-a7a7-34a6ff4c4c61 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 3c82b617-7dd2-41b8-b5ee-28301d9f9c07 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:45.183562 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ab68885-efe7-4701-a7a7-34a6ff4c4c61 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/3c82b617-7dd2-41b8-b5ee-28301d9f9c07/action" status: 404 len: 111 microversion: 2.1 time: 0.029308 Sep 10 20:59:45.188123 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1634/3186] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:45 2022] POST /compute/v2.1/servers/3c82b617-7dd2-41b8-b5ee-28301d9f9c07/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 20:59:45.193953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4eb19cb0-ba5f-4918-b137-9cf5e82cf6ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:45.194917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4eb19cb0-ba5f-4918-b137-9cf5e82cf6ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:45.203276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eb19cb0-ba5f-4918-b137-9cf5e82cf6ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:45.204091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eb19cb0-ba5f-4918-b137-9cf5e82cf6ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:45.204731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eb19cb0-ba5f-4918-b137-9cf5e82cf6ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:45.205788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eb19cb0-ba5f-4918-b137-9cf5e82cf6ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:45.207297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eb19cb0-ba5f-4918-b137-9cf5e82cf6ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:45.208042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4eb19cb0-ba5f-4918-b137-9cf5e82cf6ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:45.617714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3300b0bf-1674-44c6-b839-0ee4943209f1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:45.619853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4eb19cb0-ba5f-4918-b137-9cf5e82cf6ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:45.628485 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3300b0bf-1674-44c6-b839-0ee4943209f1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 0.558601 Sep 10 20:59:45.630594 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4eb19cb0-ba5f-4918-b137-9cf5e82cf6ac tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.439445 Sep 10 20:59:45.631255 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1635/3187] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:45 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:45.642114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d0113c21-137a-4b13-86d6-3161ed4532cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:45.642114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d0113c21-137a-4b13-86d6-3161ed4532cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:45.642360 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1553/3188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:45 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:45.653012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0f3bd2bd-ff88-463e-861d-545fd89bf06a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:45.654074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0f3bd2bd-ff88-463e-861d-545fd89bf06a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:45.655800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0113c21-137a-4b13-86d6-3161ed4532cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:45.656307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0113c21-137a-4b13-86d6-3161ed4532cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:45.656928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0113c21-137a-4b13-86d6-3161ed4532cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:45.657891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0113c21-137a-4b13-86d6-3161ed4532cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:45.658346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0113c21-137a-4b13-86d6-3161ed4532cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:45.662444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f3bd2bd-ff88-463e-861d-545fd89bf06a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:45.663340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f3bd2bd-ff88-463e-861d-545fd89bf06a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:45.664023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f3bd2bd-ff88-463e-861d-545fd89bf06a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:45.665051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f3bd2bd-ff88-463e-861d-545fd89bf06a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:45.665768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f3bd2bd-ff88-463e-861d-545fd89bf06a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:45.666487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f3bd2bd-ff88-463e-861d-545fd89bf06a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:45.667593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0113c21-137a-4b13-86d6-3161ed4532cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:45.777570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d0113c21-137a-4b13-86d6-3161ed4532cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:45.789420 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d0113c21-137a-4b13-86d6-3161ed4532cb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1275 microversion: 2.1 time: 0.157017 Sep 10 20:59:45.800274 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1636/3189] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:45 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:45.800274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a025ee6d-4dc5-49c9-a1ce-8d884ef742da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:45.800274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a025ee6d-4dc5-49c9-a1ce-8d884ef742da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:45.805651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a025ee6d-4dc5-49c9-a1ce-8d884ef742da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:45.806507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a025ee6d-4dc5-49c9-a1ce-8d884ef742da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:45.806706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a025ee6d-4dc5-49c9-a1ce-8d884ef742da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:45.807348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a025ee6d-4dc5-49c9-a1ce-8d884ef742da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:45.807836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a025ee6d-4dc5-49c9-a1ce-8d884ef742da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:45.808333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a025ee6d-4dc5-49c9-a1ce-8d884ef742da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:46.077954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0f3bd2bd-ff88-463e-861d-545fd89bf06a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:46.088248 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0f3bd2bd-ff88-463e-861d-545fd89bf06a tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1539 microversion: 2.1 time: 0.444821 Sep 10 20:59:46.091111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a025ee6d-4dc5-49c9-a1ce-8d884ef742da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:46.091930 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1554/3190] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:45 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1539 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:46.102183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:46.103239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:46.104726 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a025ee6d-4dc5-49c9-a1ce-8d884ef742da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.312337 Sep 10 20:59:46.117878 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1637/3191] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:45 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:46.117878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-95057d57-9ba8-4e01-82d1-3ab5cbeb4265 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944075a60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:46.131189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:46.134210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:46.135153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:46.136062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:46.136676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:46.137897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:46.205086 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-95057d57-9ba8-4e01-82d1-3ab5cbeb4265 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1454 microversion: 2.1 time: 0.098269 Sep 10 20:59:46.206064 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1638/3192] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:46 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:46.216104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-58fd50af-ee1c-40d4-b21f-683ded816ea5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:46.216639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-58fd50af-ee1c-40d4-b21f-683ded816ea5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:46.236297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58fd50af-ee1c-40d4-b21f-683ded816ea5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:46.236872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58fd50af-ee1c-40d4-b21f-683ded816ea5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:46.237243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58fd50af-ee1c-40d4-b21f-683ded816ea5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:46.238115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58fd50af-ee1c-40d4-b21f-683ded816ea5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:46.239215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58fd50af-ee1c-40d4-b21f-683ded816ea5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:46.239673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58fd50af-ee1c-40d4-b21f-683ded816ea5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:46.310174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-58fd50af-ee1c-40d4-b21f-683ded816ea5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lazy-loading 'flavor' on Instance uuid 2bfdc13f-9c2e-44ec-8553-3f779ead89af {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 20:59:46.629180 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-58fd50af-ee1c-40d4-b21f-683ded816ea5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 202 len: 0 microversion: 2.1 time: 0.420466 Sep 10 20:59:46.634920 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1639/3193] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:46 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:59:46.649180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bbcd0ec6-2780-44d6-b7c8-94db13e9f237 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:46.652458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bbcd0ec6-2780-44d6-b7c8-94db13e9f237 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:46.668654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbcd0ec6-2780-44d6-b7c8-94db13e9f237 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:46.671392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbcd0ec6-2780-44d6-b7c8-94db13e9f237 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:46.675662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbcd0ec6-2780-44d6-b7c8-94db13e9f237 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:46.677137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbcd0ec6-2780-44d6-b7c8-94db13e9f237 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:46.677643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbcd0ec6-2780-44d6-b7c8-94db13e9f237 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:46.687056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbcd0ec6-2780-44d6-b7c8-94db13e9f237 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:46.761710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:46.767697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:46.783163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:46.786964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:46.791037 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-67c16fea-1318-4928-bc86-f651114b3681 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1359 microversion: 2.21 time: 0.696676 Sep 10 20:59:46.792836 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1555/3194] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:46 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1359 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:46.802943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ff40e501-01ed-4b90-8ead-012678ecc3ca tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:46.803917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ff40e501-01ed-4b90-8ead-012678ecc3ca tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:46.820057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff40e501-01ed-4b90-8ead-012678ecc3ca tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:46.820615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff40e501-01ed-4b90-8ead-012678ecc3ca tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:46.821118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff40e501-01ed-4b90-8ead-012678ecc3ca tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:46.822071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff40e501-01ed-4b90-8ead-012678ecc3ca tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:46.824719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff40e501-01ed-4b90-8ead-012678ecc3ca tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:46.826509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff40e501-01ed-4b90-8ead-012678ecc3ca tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:46.928625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bbcd0ec6-2780-44d6-b7c8-94db13e9f237 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:46.938474 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bbcd0ec6-2780-44d6-b7c8-94db13e9f237 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.301949 Sep 10 20:59:46.949868 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1640/3195] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:46 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:46.949868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-982b2678-31e3-454f-b7d5-968bac98c7aa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:46.949868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-982b2678-31e3-454f-b7d5-968bac98c7aa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:46.962023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-982b2678-31e3-454f-b7d5-968bac98c7aa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:46.962023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-982b2678-31e3-454f-b7d5-968bac98c7aa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:46.962023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-982b2678-31e3-454f-b7d5-968bac98c7aa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:46.962023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-982b2678-31e3-454f-b7d5-968bac98c7aa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:46.962023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-982b2678-31e3-454f-b7d5-968bac98c7aa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:46.969864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-982b2678-31e3-454f-b7d5-968bac98c7aa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:47.708944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:47.778550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:47.832427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-982b2678-31e3-454f-b7d5-968bac98c7aa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:47.846548 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-982b2678-31e3-454f-b7d5-968bac98c7aa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 0.905307 Sep 10 20:59:47.867505 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1641/3196] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:46 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:47.867505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-45c921ff-f1ac-435b-b569-0f5e0a2e737c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:47.867505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-45c921ff-f1ac-435b-b569-0f5e0a2e737c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:47.867505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c921ff-f1ac-435b-b569-0f5e0a2e737c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:47.867505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c921ff-f1ac-435b-b569-0f5e0a2e737c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:47.867505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c921ff-f1ac-435b-b569-0f5e0a2e737c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:47.867505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c921ff-f1ac-435b-b569-0f5e0a2e737c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:47.867505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c921ff-f1ac-435b-b569-0f5e0a2e737c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:47.867505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c921ff-f1ac-435b-b569-0f5e0a2e737c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:47.979967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ff40e501-01ed-4b90-8ead-012678ecc3ca tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:47.999843 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ff40e501-01ed-4b90-8ead-012678ecc3ca tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 1.205662 Sep 10 20:59:48.001989 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1556/3197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:46 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:48.009779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c21d9d2-81c5-4af0-ab12-f30600444998 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440a63a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:48.077284 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c21d9d2-81c5-4af0-ab12-f30600444998 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1463 microversion: 2.1 time: 0.073952 Sep 10 20:59:48.093923 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1557/3198] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:48 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1463 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:48.105279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-027b49c0-01cb-4878-b19a-e5d3edc40143 req-7d1940f5-290c-46bc-ba28-990e14bfc92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2246b83-c09c-4d0e-8744-421b2eec5985", "name": "network-vif-plugged", "status": "completed", "tag": "5d34ee03-4994-483a-aaf3-880e271e480d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:48.121061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-027b49c0-01cb-4878-b19a-e5d3edc40143 req-7d1940f5-290c-46bc-ba28-990e14bfc92d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:48.122028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-027b49c0-01cb-4878-b19a-e5d3edc40143 req-7d1940f5-290c-46bc-ba28-990e14bfc92d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:48.122655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-027b49c0-01cb-4878-b19a-e5d3edc40143 req-7d1940f5-290c-46bc-ba28-990e14bfc92d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:48.137473 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-027b49c0-01cb-4878-b19a-e5d3edc40143 req-7d1940f5-290c-46bc-ba28-990e14bfc92d service nova] Creating event network-vif-plugged:5d34ee03-4994-483a-aaf3-880e271e480d for instance e2246b83-c09c-4d0e-8744-421b2eec5985 on nch1-master-1 Sep 10 20:59:48.147472 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-027b49c0-01cb-4878-b19a-e5d3edc40143 req-7d1940f5-290c-46bc-ba28-990e14bfc92d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051750 Sep 10 20:59:48.148733 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1558/3199] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:48.154695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:48.156075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:48.164859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:48.165806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:48.166611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:48.167497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:48.168150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:48.168747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:48.396044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-45c921ff-f1ac-435b-b569-0f5e0a2e737c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:48.405734 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-45c921ff-f1ac-435b-b569-0f5e0a2e737c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1539 microversion: 2.1 time: 0.553107 Sep 10 20:59:48.406685 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1642/3200] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:47 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1539 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:48.413734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f2a64930-9340-4959-a9b1-0172c4429564 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:48.414678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f2a64930-9340-4959-a9b1-0172c4429564 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:48.421584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f2a64930-9340-4959-a9b1-0172c4429564 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:48.422478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f2a64930-9340-4959-a9b1-0172c4429564 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:48.423112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f2a64930-9340-4959-a9b1-0172c4429564 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:48.424204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f2a64930-9340-4959-a9b1-0172c4429564 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:48.424931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f2a64930-9340-4959-a9b1-0172c4429564 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:48.426578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f2a64930-9340-4959-a9b1-0172c4429564 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:48.679608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:48.696469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:48.698833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:48.700352 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-860c16f2-12e4-480f-885f-46bdebf9802c tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1552 microversion: 2.21 time: 0.549986 Sep 10 20:59:48.709651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f2a64930-9340-4959-a9b1-0172c4429564 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:48.715019 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1559/3201] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:48 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1552 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:48.725029 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f2a64930-9340-4959-a9b1-0172c4429564 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.316721 Sep 10 20:59:48.726331 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1643/3202] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:48 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:48.738897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-fe38b3d7-99da-4ca6-b6e9-7d9b8822f44b req-2fa38030-f75f-47b9-bd32-f2d018192fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7301410e-1f12-405a-b630-377c08092f7e", "tag": "d7969a7f-0a1d-440b-a38c-b5027a4863c6"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:48.741766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-36a38d36-53a2-4428-99fb-27b57d999692 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440ed8b0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:48.766621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-fe38b3d7-99da-4ca6-b6e9-7d9b8822f44b req-2fa38030-f75f-47b9-bd32-f2d018192fcc service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:48.767109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-fe38b3d7-99da-4ca6-b6e9-7d9b8822f44b req-2fa38030-f75f-47b9-bd32-f2d018192fcc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:48.767543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-fe38b3d7-99da-4ca6-b6e9-7d9b8822f44b req-2fa38030-f75f-47b9-bd32-f2d018192fcc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:48.789446 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-fe38b3d7-99da-4ca6-b6e9-7d9b8822f44b req-2fa38030-f75f-47b9-bd32-f2d018192fcc service nova] Creating event network-changed:d7969a7f-0a1d-440b-a38c-b5027a4863c6 for instance 7301410e-1f12-405a-b630-377c08092f7e on nch1-master-1 Sep 10 20:59:48.794897 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-fe38b3d7-99da-4ca6-b6e9-7d9b8822f44b req-2fa38030-f75f-47b9-bd32-f2d018192fcc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067132 Sep 10 20:59:48.795819 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1644/3203] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:48.821321 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-36a38d36-53a2-4428-99fb-27b57d999692 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 200 len: 1463 microversion: 2.1 time: 0.105227 Sep 10 20:59:48.833294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-588bcc85-7742-4a2b-803c-2146c7adb885 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:48.833944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-588bcc85-7742-4a2b-803c-2146c7adb885 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:48.835665 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1560/3204] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:48 2022] GET /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 1463 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:48.843943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7aebf120-ee63-40d5-85d4-6e428bfa8262 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:48.844614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7aebf120-ee63-40d5-85d4-6e428bfa8262 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:48.853127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-588bcc85-7742-4a2b-803c-2146c7adb885 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:48.853609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-588bcc85-7742-4a2b-803c-2146c7adb885 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:48.854354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-588bcc85-7742-4a2b-803c-2146c7adb885 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:48.854802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-588bcc85-7742-4a2b-803c-2146c7adb885 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:48.855269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-588bcc85-7742-4a2b-803c-2146c7adb885 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:48.855702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-588bcc85-7742-4a2b-803c-2146c7adb885 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:48.864011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7aebf120-ee63-40d5-85d4-6e428bfa8262 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:48.864519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7aebf120-ee63-40d5-85d4-6e428bfa8262 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:48.864964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7aebf120-ee63-40d5-85d4-6e428bfa8262 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:48.865693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7aebf120-ee63-40d5-85d4-6e428bfa8262 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:48.868213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7aebf120-ee63-40d5-85d4-6e428bfa8262 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:48.868705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7aebf120-ee63-40d5-85d4-6e428bfa8262 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:48.907447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:48.920701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-588bcc85-7742-4a2b-803c-2146c7adb885 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:59:48.924409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:49.104095 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-588bcc85-7742-4a2b-803c-2146c7adb885 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 204 len: 0 microversion: 2.21 time: 0.302294 Sep 10 20:59:49.105381 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1645/3205] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:59:48 2022] DELETE /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 20:59:49.117291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-16c985d9-fec3-4d8d-ac13-72613cadc1ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:49.122315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-16c985d9-fec3-4d8d-ac13-72613cadc1ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:49.135255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16c985d9-fec3-4d8d-ac13-72613cadc1ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:49.136304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16c985d9-fec3-4d8d-ac13-72613cadc1ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:49.144578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16c985d9-fec3-4d8d-ac13-72613cadc1ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:49.145475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16c985d9-fec3-4d8d-ac13-72613cadc1ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:49.146326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16c985d9-fec3-4d8d-ac13-72613cadc1ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:49.146860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16c985d9-fec3-4d8d-ac13-72613cadc1ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:49.185698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7aebf120-ee63-40d5-85d4-6e428bfa8262 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:49.213710 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7aebf120-ee63-40d5-85d4-6e428bfa8262 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 200 len: 1468 microversion: 2.1 time: 0.376420 Sep 10 20:59:49.214406 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1561/3206] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:48 2022] GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 1468 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:49.219208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e2f59ce7-772f-4f31-b338-0eddee081456 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:49.219828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e2f59ce7-772f-4f31-b338-0eddee081456 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:49.228078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2f59ce7-772f-4f31-b338-0eddee081456 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:49.228785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2f59ce7-772f-4f31-b338-0eddee081456 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:49.230140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2f59ce7-772f-4f31-b338-0eddee081456 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:49.230320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2f59ce7-772f-4f31-b338-0eddee081456 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:49.231056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2f59ce7-772f-4f31-b338-0eddee081456 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:49.231748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2f59ce7-772f-4f31-b338-0eddee081456 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:49.544730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e2f59ce7-772f-4f31-b338-0eddee081456 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:49.553778 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e2f59ce7-772f-4f31-b338-0eddee081456 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 0.338250 Sep 10 20:59:49.555018 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1562/3207] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:49 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:49.563412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:49.564261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:49.572193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:49.572686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:49.573129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:49.573863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:49.574328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:49.574753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:49.708283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-16c985d9-fec3-4d8d-ac13-72613cadc1ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:49.721251 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-16c985d9-fec3-4d8d-ac13-72613cadc1ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 0.614310 Sep 10 20:59:49.726785 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1646/3208] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:49 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:49.760086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a9ff4980-452f-4294-8c56-d27ed097abd0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-613218219"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:49.766916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9ff4980-452f-4294-8c56-d27ed097abd0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:49.788454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9ff4980-452f-4294-8c56-d27ed097abd0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:49.789429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9ff4980-452f-4294-8c56-d27ed097abd0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:49.790730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9ff4980-452f-4294-8c56-d27ed097abd0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:49.800680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9ff4980-452f-4294-8c56-d27ed097abd0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:49.802491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9ff4980-452f-4294-8c56-d27ed097abd0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:49.802491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9ff4980-452f-4294-8c56-d27ed097abd0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:49.962387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:49.992804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:49.994916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:49.995853 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-726e7519-418d-4e7b-bbfa-b63867eaf9e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1558 microversion: 2.21 time: 0.439570 Sep 10 20:59:49.997023 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1563/3209] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:49 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1558 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:50.034083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-00bd35d0-ae47-42bc-b061-8c53a5732050 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:50.035489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-00bd35d0-ae47-42bc-b061-8c53a5732050 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:50.048808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:50.052069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00bd35d0-ae47-42bc-b061-8c53a5732050 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:50.053935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00bd35d0-ae47-42bc-b061-8c53a5732050 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:50.054563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00bd35d0-ae47-42bc-b061-8c53a5732050 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:50.062353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00bd35d0-ae47-42bc-b061-8c53a5732050 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:50.063084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00bd35d0-ae47-42bc-b061-8c53a5732050 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:50.063649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00bd35d0-ae47-42bc-b061-8c53a5732050 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:50.198518 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a9ff4980-452f-4294-8c56-d27ed097abd0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "POST /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828/action" status: 202 len: 0 microversion: 2.1 time: 0.457710 Sep 10 20:59:50.199202 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1647/3210] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:49 2022] POST /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 20:59:50.210764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87a2d85c-5825-4b2c-943a-9f8d6769e0ee tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:50.214742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87a2d85c-5825-4b2c-943a-9f8d6769e0ee tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:50.230793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a2d85c-5825-4b2c-943a-9f8d6769e0ee tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:50.231433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a2d85c-5825-4b2c-943a-9f8d6769e0ee tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:50.231728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a2d85c-5825-4b2c-943a-9f8d6769e0ee tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:50.232452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a2d85c-5825-4b2c-943a-9f8d6769e0ee tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:50.232919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a2d85c-5825-4b2c-943a-9f8d6769e0ee tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:50.238352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a2d85c-5825-4b2c-943a-9f8d6769e0ee tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:50.515884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-87a2d85c-5825-4b2c-943a-9f8d6769e0ee tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:50.525899 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-87a2d85c-5825-4b2c-943a-9f8d6769e0ee tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.323580 Sep 10 20:59:50.542646 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1648/3211] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:50 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:50.548595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8a0d00b-4171-47a2-a1a0-e8cd3045fb60 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944142ca0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:50.616228 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d8a0d00b-4171-47a2-a1a0-e8cd3045fb60 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.072355 Sep 10 20:59:50.616823 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1649/3212] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:50 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:50.621595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-19f16e14-46df-41f9-bbc3-28d49f958a9d req-1008db7f-b99e-49e4-9050-894d1b335b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a009fbee-aff7-41a2-be0f-785d15e2e42a", "name": "network-vif-plugged", "status": "completed", "tag": "8bc3db35-62d4-4858-9844-3ba3bf0422c2"}, {"server_uuid": "9e7d1492-dc6d-4ddc-ada0-4d492a0916d6", "name": "network-vif-unplugged", "status": "completed", "tag": "3e890f01-2c63-4ec8-9b80-da70352321e9"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:50.634715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-19f16e14-46df-41f9-bbc3-28d49f958a9d req-1008db7f-b99e-49e4-9050-894d1b335b80 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:50.635460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-19f16e14-46df-41f9-bbc3-28d49f958a9d req-1008db7f-b99e-49e4-9050-894d1b335b80 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:50.636076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-19f16e14-46df-41f9-bbc3-28d49f958a9d req-1008db7f-b99e-49e4-9050-894d1b335b80 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:50.651645 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-19f16e14-46df-41f9-bbc3-28d49f958a9d req-1008db7f-b99e-49e4-9050-894d1b335b80 service nova] Creating event network-vif-plugged:8bc3db35-62d4-4858-9844-3ba3bf0422c2 for instance a009fbee-aff7-41a2-be0f-785d15e2e42a on nch1-master-1 Sep 10 20:59:50.652952 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-19f16e14-46df-41f9-bbc3-28d49f958a9d req-1008db7f-b99e-49e4-9050-894d1b335b80 service nova] Creating event network-vif-unplugged:3e890f01-2c63-4ec8-9b80-da70352321e9 for instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 on nch2-master-1 Sep 10 20:59:50.663009 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-19f16e14-46df-41f9-bbc3-28d49f958a9d req-1008db7f-b99e-49e4-9050-894d1b335b80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.044804 Sep 10 20:59:50.665342 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1650/3213] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:50.671517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0f1ac38d-04a1-4535-846f-4dd1b09388fb tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:50.672898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0f1ac38d-04a1-4535-846f-4dd1b09388fb tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:50.687177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f1ac38d-04a1-4535-846f-4dd1b09388fb tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:50.687443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f1ac38d-04a1-4535-846f-4dd1b09388fb tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:50.688093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f1ac38d-04a1-4535-846f-4dd1b09388fb tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:50.688653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f1ac38d-04a1-4535-846f-4dd1b09388fb tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:50.689143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f1ac38d-04a1-4535-846f-4dd1b09388fb tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:50.689550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f1ac38d-04a1-4535-846f-4dd1b09388fb tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:50.839230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-00bd35d0-ae47-42bc-b061-8c53a5732050 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:50.859078 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-00bd35d0-ae47-42bc-b061-8c53a5732050 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1534 microversion: 2.1 time: 0.859512 Sep 10 20:59:50.861083 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1564/3214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:49 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1534 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:50.868491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-719afc29-88d9-4ebc-8579-275a30aad933 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:50.869359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-719afc29-88d9-4ebc-8579-275a30aad933 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:50.876125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719afc29-88d9-4ebc-8579-275a30aad933 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:50.876692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719afc29-88d9-4ebc-8579-275a30aad933 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:50.879363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719afc29-88d9-4ebc-8579-275a30aad933 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:50.882145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719afc29-88d9-4ebc-8579-275a30aad933 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:50.882796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719afc29-88d9-4ebc-8579-275a30aad933 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:50.883853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719afc29-88d9-4ebc-8579-275a30aad933 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:50.912092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f1ac38d-04a1-4535-846f-4dd1b09388fb tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:50.924015 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0f1ac38d-04a1-4535-846f-4dd1b09388fb tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1316 microversion: 2.1 time: 0.256662 Sep 10 20:59:50.942929 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1651/3215] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:50 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:51.023779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:51.024438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:51.031506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:51.032148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:51.035544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:51.035544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:51.035544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:51.036997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:51.186219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-719afc29-88d9-4ebc-8579-275a30aad933 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:51.195597 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-719afc29-88d9-4ebc-8579-275a30aad933 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 0.333282 Sep 10 20:59:51.196426 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1565/3216] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:50 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:51.275871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:51.286938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:51.288888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:51.290727 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3e3389ad-6df7-4c9e-9048-6d4cace579b1 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1558 microversion: 2.21 time: 0.271504 Sep 10 20:59:51.291477 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1652/3217] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:51 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1558 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 20:59:51.554002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ecb293ec-bb61-4314-a15d-0b22eb7e2c82 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:51.554923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ecb293ec-bb61-4314-a15d-0b22eb7e2c82 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:51.562245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecb293ec-bb61-4314-a15d-0b22eb7e2c82 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:51.567693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecb293ec-bb61-4314-a15d-0b22eb7e2c82 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:51.568352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecb293ec-bb61-4314-a15d-0b22eb7e2c82 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:51.572358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecb293ec-bb61-4314-a15d-0b22eb7e2c82 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:51.573616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecb293ec-bb61-4314-a15d-0b22eb7e2c82 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:51.574283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecb293ec-bb61-4314-a15d-0b22eb7e2c82 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:51.631810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f754fb3-f84e-43d9-85ea-129ac337a883 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99495715e0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:51.754545 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f754fb3-f84e-43d9-85ea-129ac337a883 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.126553 Sep 10 20:59:51.761940 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1653/3218] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:51 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:51.880921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ecb293ec-bb61-4314-a15d-0b22eb7e2c82 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:51.883645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2394d722-cfdf-44b8-8f57-86709ce95d50 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:51.884265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2394d722-cfdf-44b8-8f57-86709ce95d50 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:51.894965 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ecb293ec-bb61-4314-a15d-0b22eb7e2c82 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.345583 Sep 10 20:59:51.897405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2394d722-cfdf-44b8-8f57-86709ce95d50 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:51.897930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2394d722-cfdf-44b8-8f57-86709ce95d50 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:51.898367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2394d722-cfdf-44b8-8f57-86709ce95d50 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:51.899473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2394d722-cfdf-44b8-8f57-86709ce95d50 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:51.900230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2394d722-cfdf-44b8-8f57-86709ce95d50 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:51.900821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2394d722-cfdf-44b8-8f57-86709ce95d50 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:51.902186 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1566/3219] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:51 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:51.950367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c625afdc-e9ed-4d15-abce-ccd4ea59f01a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:51.951193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c625afdc-e9ed-4d15-abce-ccd4ea59f01a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:51.961154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c625afdc-e9ed-4d15-abce-ccd4ea59f01a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:51.962035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c625afdc-e9ed-4d15-abce-ccd4ea59f01a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:51.962784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c625afdc-e9ed-4d15-abce-ccd4ea59f01a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:51.963680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c625afdc-e9ed-4d15-abce-ccd4ea59f01a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:51.964906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c625afdc-e9ed-4d15-abce-ccd4ea59f01a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:51.966057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c625afdc-e9ed-4d15-abce-ccd4ea59f01a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:52.202734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c625afdc-e9ed-4d15-abce-ccd4ea59f01a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:52.214915 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c625afdc-e9ed-4d15-abce-ccd4ea59f01a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1504 microversion: 2.1 time: 0.269653 Sep 10 20:59:52.241408 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1567/3220] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:51 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:52.245853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2394d722-cfdf-44b8-8f57-86709ce95d50 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:52.246348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b44409a3-a559-45a8-97f7-e1dbd0a8d924 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:52.246480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b44409a3-a559-45a8-97f7-e1dbd0a8d924 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:52.257689 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2394d722-cfdf-44b8-8f57-86709ce95d50 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1521 microversion: 2.1 time: 0.377680 Sep 10 20:59:52.275271 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1654/3221] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:51 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:52.275384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44409a3-a559-45a8-97f7-e1dbd0a8d924 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:52.275384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44409a3-a559-45a8-97f7-e1dbd0a8d924 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:52.275384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44409a3-a559-45a8-97f7-e1dbd0a8d924 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:52.275672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b77a3b7b-0704-4332-b839-d4234c76dc69 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-439009977"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:52.275773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44409a3-a559-45a8-97f7-e1dbd0a8d924 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:52.275873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b77a3b7b-0704-4332-b839-d4234c76dc69 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:52.275963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44409a3-a559-45a8-97f7-e1dbd0a8d924 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:52.275963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44409a3-a559-45a8-97f7-e1dbd0a8d924 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:52.285088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a3b7b-0704-4332-b839-d4234c76dc69 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:52.285621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a3b7b-0704-4332-b839-d4234c76dc69 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:52.289349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a3b7b-0704-4332-b839-d4234c76dc69 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:52.291914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a3b7b-0704-4332-b839-d4234c76dc69 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:52.292581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a3b7b-0704-4332-b839-d4234c76dc69 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:52.293186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a3b7b-0704-4332-b839-d4234c76dc69 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:52.681040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b44409a3-a559-45a8-97f7-e1dbd0a8d924 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:52.694182 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.network.security_group_api [None req-b77a3b7b-0704-4332-b839-d4234c76dc69 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Adding security group f08fbb92-71d0-43aa-8229-1a318a3a7601 to port 5d34ee03-4994-483a-aaf3-880e271e480d Sep 10 20:59:52.695229 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b44409a3-a559-45a8-97f7-e1dbd0a8d924 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 0.453085 Sep 10 20:59:52.697676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1568/3222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:52 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:52.706601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7690ee12-b3ec-4dc2-8be9-ca89e9470e29 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:52.712655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7690ee12-b3ec-4dc2-8be9-ca89e9470e29 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:52.720444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7690ee12-b3ec-4dc2-8be9-ca89e9470e29 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:52.721235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7690ee12-b3ec-4dc2-8be9-ca89e9470e29 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:52.721980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7690ee12-b3ec-4dc2-8be9-ca89e9470e29 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:52.723385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7690ee12-b3ec-4dc2-8be9-ca89e9470e29 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:52.723992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7690ee12-b3ec-4dc2-8be9-ca89e9470e29 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:52.724562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7690ee12-b3ec-4dc2-8be9-ca89e9470e29 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:52.755342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7690ee12-b3ec-4dc2-8be9-ca89e9470e29 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 20:59:52.880968 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7690ee12-b3ec-4dc2-8be9-ca89e9470e29 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 204 len: 0 microversion: 2.1 time: 0.181375 Sep 10 20:59:52.882679 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1569/3223] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 20:59:52 2022] DELETE /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 20:59:52.898683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:52.899766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:52.912436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:52.913157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:52.913820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:52.915277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:52.915966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:52.916594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:53.217232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:53.231251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:53.233006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:53.234668 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4bb9e53e-4d1a-4053-bab3-f96420116bad tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1558 microversion: 2.21 time: 0.350555 Sep 10 20:59:53.255189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1570/3224] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:52 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1558 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:53.263769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e517989-aad2-4296-bd64-3f6b29a5b177 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440edd30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:53.321739 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5e517989-aad2-4296-bd64-3f6b29a5b177 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.065056 Sep 10 20:59:53.330433 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1571/3225] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:53 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:53.335918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c593b10b-04db-4e62-9590-fa64fcca7466 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:53.336766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c593b10b-04db-4e62-9590-fa64fcca7466 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:53.343487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c593b10b-04db-4e62-9590-fa64fcca7466 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:53.344184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c593b10b-04db-4e62-9590-fa64fcca7466 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:53.344818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c593b10b-04db-4e62-9590-fa64fcca7466 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:53.345721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c593b10b-04db-4e62-9590-fa64fcca7466 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:53.346508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c593b10b-04db-4e62-9590-fa64fcca7466 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:53.347653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c593b10b-04db-4e62-9590-fa64fcca7466 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:53.428223 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b77a3b7b-0704-4332-b839-d4234c76dc69 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985/action" status: 202 len: 0 microversion: 2.1 time: 1.164236 Sep 10 20:59:53.429657 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1655/3226] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:52 2022] POST /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985/action => generated 0 bytes in 1168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:59:53.434555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d84e5d66-078c-4f2e-be13-9e22fc5ff970 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:53.435169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d84e5d66-078c-4f2e-be13-9e22fc5ff970 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:53.437416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:53.450364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d84e5d66-078c-4f2e-be13-9e22fc5ff970 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:53.451099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d84e5d66-078c-4f2e-be13-9e22fc5ff970 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:53.451737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d84e5d66-078c-4f2e-be13-9e22fc5ff970 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:53.452780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d84e5d66-078c-4f2e-be13-9e22fc5ff970 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:53.453536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d84e5d66-078c-4f2e-be13-9e22fc5ff970 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:53.455730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d84e5d66-078c-4f2e-be13-9e22fc5ff970 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:53.718842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c593b10b-04db-4e62-9590-fa64fcca7466 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:53.734322 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c593b10b-04db-4e62-9590-fa64fcca7466 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1527 microversion: 2.1 time: 0.401368 Sep 10 20:59:53.735200 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1572/3227] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:53 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1527 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:53.741860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f2045617-a859-4c5d-9424-4edbbb7ffcd0 req-54a54990-9016-4a24-bb02-9d015dde06d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a009fbee-aff7-41a2-be0f-785d15e2e42a", "name": "network-vif-unplugged", "status": "completed", "tag": "8bc3db35-62d4-4858-9844-3ba3bf0422c2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:53.759078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f2045617-a859-4c5d-9424-4edbbb7ffcd0 req-54a54990-9016-4a24-bb02-9d015dde06d4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:53.759883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f2045617-a859-4c5d-9424-4edbbb7ffcd0 req-54a54990-9016-4a24-bb02-9d015dde06d4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:53.760482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f2045617-a859-4c5d-9424-4edbbb7ffcd0 req-54a54990-9016-4a24-bb02-9d015dde06d4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:53.781615 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f2045617-a859-4c5d-9424-4edbbb7ffcd0 req-54a54990-9016-4a24-bb02-9d015dde06d4 service nova] Creating event network-vif-unplugged:8bc3db35-62d4-4858-9844-3ba3bf0422c2 for instance a009fbee-aff7-41a2-be0f-785d15e2e42a on nch1-master-1 Sep 10 20:59:53.789673 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f2045617-a859-4c5d-9424-4edbbb7ffcd0 req-54a54990-9016-4a24-bb02-9d015dde06d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050403 Sep 10 20:59:53.792741 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1573/3228] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:53.799227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca63012e-87fb-4764-b494-fc2535f81c00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-42349494"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:53.801787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ca63012e-87fb-4764-b494-fc2535f81c00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:53.810169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca63012e-87fb-4764-b494-fc2535f81c00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:53.811016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca63012e-87fb-4764-b494-fc2535f81c00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:53.811958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca63012e-87fb-4764-b494-fc2535f81c00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:53.813736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca63012e-87fb-4764-b494-fc2535f81c00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:53.814858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca63012e-87fb-4764-b494-fc2535f81c00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:53.815922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca63012e-87fb-4764-b494-fc2535f81c00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:53.936020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d84e5d66-078c-4f2e-be13-9e22fc5ff970 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:53.951331 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d84e5d66-078c-4f2e-be13-9e22fc5ff970 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.520364 Sep 10 20:59:53.952502 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1656/3229] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:53 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:53.982956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-964957cd-5a4a-4d45-808a-6789da9e5784 req-56a41e55-26e2-46a1-97b4-92abf15ac9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2246b83-c09c-4d0e-8744-421b2eec5985", "tag": "5d34ee03-4994-483a-aaf3-880e271e480d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:53.995636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-964957cd-5a4a-4d45-808a-6789da9e5784 req-56a41e55-26e2-46a1-97b4-92abf15ac9d0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:53.997937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-964957cd-5a4a-4d45-808a-6789da9e5784 req-56a41e55-26e2-46a1-97b4-92abf15ac9d0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:54.001359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-964957cd-5a4a-4d45-808a-6789da9e5784 req-56a41e55-26e2-46a1-97b4-92abf15ac9d0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:54.023898 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.network.security_group_api [None req-ca63012e-87fb-4764-b494-fc2535f81c00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Adding security group 73241f18-28a8-4540-bf68-00dc117db51b to port 5d34ee03-4994-483a-aaf3-880e271e480d Sep 10 20:59:54.026497 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-964957cd-5a4a-4d45-808a-6789da9e5784 req-56a41e55-26e2-46a1-97b4-92abf15ac9d0 service nova] Creating event network-changed:5d34ee03-4994-483a-aaf3-880e271e480d for instance e2246b83-c09c-4d0e-8744-421b2eec5985 on nch1-master-1 Sep 10 20:59:54.032425 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-964957cd-5a4a-4d45-808a-6789da9e5784 req-56a41e55-26e2-46a1-97b4-92abf15ac9d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078490 Sep 10 20:59:54.033607 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1657/3230] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:54.039116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b7a10bbf-b9ad-4eef-9cda-51f101f8aceb req-807ef10b-c3c8-4f97-929f-299eefed6120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0496a52e-07cc-49bb-bdd1-e9f2833b5023", "name": "network-vif-deleted", "tag": "09b57074-b9c1-4237-a396-c6f0dde74892"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:54.049094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b7a10bbf-b9ad-4eef-9cda-51f101f8aceb req-807ef10b-c3c8-4f97-929f-299eefed6120 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:54.049981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b7a10bbf-b9ad-4eef-9cda-51f101f8aceb req-807ef10b-c3c8-4f97-929f-299eefed6120 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:54.050627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b7a10bbf-b9ad-4eef-9cda-51f101f8aceb req-807ef10b-c3c8-4f97-929f-299eefed6120 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:54.062731 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b7a10bbf-b9ad-4eef-9cda-51f101f8aceb req-807ef10b-c3c8-4f97-929f-299eefed6120 service nova] Creating event network-vif-deleted:09b57074-b9c1-4237-a396-c6f0dde74892 for instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 on nch1-master-1 Sep 10 20:59:54.069197 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b7a10bbf-b9ad-4eef-9cda-51f101f8aceb req-807ef10b-c3c8-4f97-929f-299eefed6120 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033827 Sep 10 20:59:54.070639 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1658/3231] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:54.077252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-79226f5b-b286-4dff-a3d9-f048c1f115e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:54.079340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-79226f5b-b286-4dff-a3d9-f048c1f115e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:54.087173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79226f5b-b286-4dff-a3d9-f048c1f115e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:54.087965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79226f5b-b286-4dff-a3d9-f048c1f115e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:54.088701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79226f5b-b286-4dff-a3d9-f048c1f115e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:54.089628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79226f5b-b286-4dff-a3d9-f048c1f115e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:54.090338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79226f5b-b286-4dff-a3d9-f048c1f115e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:54.090871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79226f5b-b286-4dff-a3d9-f048c1f115e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:54.519000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-79226f5b-b286-4dff-a3d9-f048c1f115e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:54.535950 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-79226f5b-b286-4dff-a3d9-f048c1f115e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 0.463697 Sep 10 20:59:54.537031 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1659/3232] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:54 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:54.552750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:54.554035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:54.566480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:54.567223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:54.567834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:54.568845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:54.569785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:54.570398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:54.631258 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ca63012e-87fb-4764-b494-fc2535f81c00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985/action" status: 202 len: 0 microversion: 2.1 time: 0.836586 Sep 10 20:59:54.632315 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1574/3233] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 20:59:53 2022] POST /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985/action => generated 0 bytes in 839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:59:54.640103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8998ac6a-9062-4c2c-8fc4-c69b48ef7d4a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440ed0d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:54.736645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:54.739978 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8998ac6a-9062-4c2c-8fc4-c69b48ef7d4a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.104819 Sep 10 20:59:54.741961 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1575/3234] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:54 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:54.747157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ad6542d0-b3ca-4061-8277-46a11bd8802c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:54.748065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ad6542d0-b3ca-4061-8277-46a11bd8802c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:54.751260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:54.758868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad6542d0-b3ca-4061-8277-46a11bd8802c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:54.760150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad6542d0-b3ca-4061-8277-46a11bd8802c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:54.760346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:54.760941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad6542d0-b3ca-4061-8277-46a11bd8802c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:54.761792 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-df695823-6cf7-4a94-93ff-875344560943 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1344 microversion: 2.21 time: 0.223531 Sep 10 20:59:54.762198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad6542d0-b3ca-4061-8277-46a11bd8802c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:54.763264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad6542d0-b3ca-4061-8277-46a11bd8802c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:54.764717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad6542d0-b3ca-4061-8277-46a11bd8802c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:54.767201 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1660/3235] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:54 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1344 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:54.782805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b2f66c4d-0021-4a2a-9ac7-6f24622794ed tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:54.787875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b2f66c4d-0021-4a2a-9ac7-6f24622794ed tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:54.798438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 20:59:54.808623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2f66c4d-0021-4a2a-9ac7-6f24622794ed tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:54.809017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2f66c4d-0021-4a2a-9ac7-6f24622794ed tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:54.809463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2f66c4d-0021-4a2a-9ac7-6f24622794ed tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:54.810234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2f66c4d-0021-4a2a-9ac7-6f24622794ed tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:54.810698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2f66c4d-0021-4a2a-9ac7-6f24622794ed tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:54.811125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b2f66c4d-0021-4a2a-9ac7-6f24622794ed tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:55.041412 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ad6542d0-b3ca-4061-8277-46a11bd8802c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.298035 Sep 10 20:59:55.042787 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1576/3236] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Sep 10 20:59:54 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985/os-security-groups => generated 1156 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:55.061506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-37cd794b-b715-4413-9408-67cbb2a5a2cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:55.064619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-37cd794b-b715-4413-9408-67cbb2a5a2cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:55.077127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37cd794b-b715-4413-9408-67cbb2a5a2cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:55.079890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37cd794b-b715-4413-9408-67cbb2a5a2cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:55.080601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37cd794b-b715-4413-9408-67cbb2a5a2cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:55.082009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37cd794b-b715-4413-9408-67cbb2a5a2cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:55.082651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37cd794b-b715-4413-9408-67cbb2a5a2cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:55.083347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37cd794b-b715-4413-9408-67cbb2a5a2cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:55.209273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b2f66c4d-0021-4a2a-9ac7-6f24622794ed tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:55.223459 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b2f66c4d-0021-4a2a-9ac7-6f24622794ed tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1527 microversion: 2.1 time: 0.454781 Sep 10 20:59:55.226462 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1661/3237] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:54 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1527 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:55.232390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-45efe3fb-1873-4b29-bafe-3fa556340fcf tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: .version_select at 0x7f9945014550>, body: {"security_group": {"name": " tempest-securitygroup -1692608792 ", "description": "tempest-description-721955170"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:55.324972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-37cd794b-b715-4413-9408-67cbb2a5a2cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:55.336401 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-37cd794b-b715-4413-9408-67cbb2a5a2cd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.279738 Sep 10 20:59:55.337007 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1577/3238] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:55 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:55.568243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-277abb38-4024-4c34-96b3-c931a3f68418 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:55.571966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-277abb38-4024-4c34-96b3-c931a3f68418 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:55.585019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-277abb38-4024-4c34-96b3-c931a3f68418 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:55.586359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-277abb38-4024-4c34-96b3-c931a3f68418 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:55.587393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-277abb38-4024-4c34-96b3-c931a3f68418 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:55.588605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-277abb38-4024-4c34-96b3-c931a3f68418 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:55.590323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-277abb38-4024-4c34-96b3-c931a3f68418 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:55.590956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-277abb38-4024-4c34-96b3-c931a3f68418 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:55.878577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-277abb38-4024-4c34-96b3-c931a3f68418 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:55.888218 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-277abb38-4024-4c34-96b3-c931a3f68418 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 0.328969 Sep 10 20:59:55.903809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1578/3239] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:55 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:55.913051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4fd70721-9b84-444a-a5c4-72e6707da9b6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440edc10>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:55.968056 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4fd70721-9b84-444a-a5c4-72e6707da9b6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.062368 Sep 10 20:59:55.968981 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1579/3240] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:55 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:56.014314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:56.014314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:56.025303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:56.026221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:56.026872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:56.027609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:56.028081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:56.028576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:56.173401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:56.191946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:56.193632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:56.194988 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-34dca95e-d9d3-4a46-b30d-9f3e4db57cc2 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1344 microversion: 2.21 time: 0.225042 Sep 10 20:59:56.211269 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1580/3241] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:55 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1344 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:56.223868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-9fb5a9c4-f24b-419c-8020-c051aebc64de req-cdfe8e07-ef1a-4737-934b-3bddc101495b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2246b83-c09c-4d0e-8744-421b2eec5985", "tag": "5d34ee03-4994-483a-aaf3-880e271e480d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:56.265949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9fb5a9c4-f24b-419c-8020-c051aebc64de req-cdfe8e07-ef1a-4737-934b-3bddc101495b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:56.268002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9fb5a9c4-f24b-419c-8020-c051aebc64de req-cdfe8e07-ef1a-4737-934b-3bddc101495b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:56.268606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9fb5a9c4-f24b-419c-8020-c051aebc64de req-cdfe8e07-ef1a-4737-934b-3bddc101495b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:56.298335 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-9fb5a9c4-f24b-419c-8020-c051aebc64de req-cdfe8e07-ef1a-4737-934b-3bddc101495b service nova] Creating event network-changed:5d34ee03-4994-483a-aaf3-880e271e480d for instance e2246b83-c09c-4d0e-8744-421b2eec5985 on nch1-master-1 Sep 10 20:59:56.313724 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-9fb5a9c4-f24b-419c-8020-c051aebc64de req-cdfe8e07-ef1a-4737-934b-3bddc101495b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101293 Sep 10 20:59:56.314694 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1581/3242] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:56.328145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25e5ed97-df09-4da9-a610-cd147a1d7b15 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:56.330663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-25e5ed97-df09-4da9-a610-cd147a1d7b15 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:56.351358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25e5ed97-df09-4da9-a610-cd147a1d7b15 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:56.352126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25e5ed97-df09-4da9-a610-cd147a1d7b15 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:56.352702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25e5ed97-df09-4da9-a610-cd147a1d7b15 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:56.353574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25e5ed97-df09-4da9-a610-cd147a1d7b15 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:56.354190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25e5ed97-df09-4da9-a610-cd147a1d7b15 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:56.354789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25e5ed97-df09-4da9-a610-cd147a1d7b15 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:56.665572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-25e5ed97-df09-4da9-a610-cd147a1d7b15 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:56.680337 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-25e5ed97-df09-4da9-a610-cd147a1d7b15 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1527 microversion: 2.1 time: 0.362280 Sep 10 20:59:56.694418 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1582/3243] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:56 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1527 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:56.703035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-08a152c5-cdca-43f9-921f-af22f622beda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:56.703662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-08a152c5-cdca-43f9-921f-af22f622beda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:56.707234 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-45efe3fb-1873-4b29-bafe-3fa556340fcf tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.479001 Sep 10 20:59:56.707818 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1662/3244] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:59:55 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:56.716656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08a152c5-cdca-43f9-921f-af22f622beda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:56.719711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08a152c5-cdca-43f9-921f-af22f622beda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:56.720317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08a152c5-cdca-43f9-921f-af22f622beda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:56.721678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b23bdffa-a42a-4f6a-b145-aaceb509a6d1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f9944bab820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:56.722451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08a152c5-cdca-43f9-921f-af22f622beda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:56.723991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08a152c5-cdca-43f9-921f-af22f622beda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:56.724537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08a152c5-cdca-43f9-921f-af22f622beda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:56.992705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-08a152c5-cdca-43f9-921f-af22f622beda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:57.010758 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-08a152c5-cdca-43f9-921f-af22f622beda tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.314614 Sep 10 20:59:57.011382 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1583/3245] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:56 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:57.016292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-03fd21e7-16c7-40ed-a981-57bcd2ad812e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:57.016909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-03fd21e7-16c7-40ed-a981-57bcd2ad812e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:57.038980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03fd21e7-16c7-40ed-a981-57bcd2ad812e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:57.039643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03fd21e7-16c7-40ed-a981-57bcd2ad812e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:57.040261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03fd21e7-16c7-40ed-a981-57bcd2ad812e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:57.041327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03fd21e7-16c7-40ed-a981-57bcd2ad812e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:57.041896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03fd21e7-16c7-40ed-a981-57bcd2ad812e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:57.051914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03fd21e7-16c7-40ed-a981-57bcd2ad812e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:57.148753 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b23bdffa-a42a-4f6a-b145-aaceb509a6d1 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9" status: 200 len: 223 microversion: 2.1 time: 0.431552 Sep 10 20:59:57.150068 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1663/3246] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 20:59:56 2022] GET /compute/v2.1/os-security-groups/b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 => generated 223 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:57.156713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-893c1448-68c2-4a8d-a8aa-bb66fe4517a0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99448afaf0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:57.324967 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-893c1448-68c2-4a8d-a8aa-bb66fe4517a0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.173225 Sep 10 20:59:57.333891 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1664/3247] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:57 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:57.336288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a715f72-48d3-44cf-9e70-d86ce1453474 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f9944935280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:57.402165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-03fd21e7-16c7-40ed-a981-57bcd2ad812e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:57.417307 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-03fd21e7-16c7-40ed-a981-57bcd2ad812e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 0.404559 Sep 10 20:59:57.419118 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1584/3248] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:57 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:57.428453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:57.429485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:57.446418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:57.446932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:57.447387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:57.448118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:57.448583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:57.455269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:57.643121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:57.653411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:57.667257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd0c6e0e7b1a44c69ec9f4685ee39398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329b758edee649078291d9cb0eda3feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:57.670693 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27fd40c1-e5b2-4293-98cd-57afc61c67e0 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 200 len: 1344 microversion: 2.21 time: 0.249910 Sep 10 20:59:57.671946 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1585/3249] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:57 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 1344 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 20:59:57.708044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-94f368f2-7b9c-4e76-a6b2-063c7a8196ff tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:57.708933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-94f368f2-7b9c-4e76-a6b2-063c7a8196ff tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:57.723284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94f368f2-7b9c-4e76-a6b2-063c7a8196ff tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:57.729528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94f368f2-7b9c-4e76-a6b2-063c7a8196ff tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:57.732151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94f368f2-7b9c-4e76-a6b2-063c7a8196ff tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:57.734183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94f368f2-7b9c-4e76-a6b2-063c7a8196ff tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:57.734875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94f368f2-7b9c-4e76-a6b2-063c7a8196ff tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:57.735485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94f368f2-7b9c-4e76-a6b2-063c7a8196ff tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:58.051920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-94f368f2-7b9c-4e76-a6b2-063c7a8196ff tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:58.067736 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-94f368f2-7b9c-4e76-a6b2-063c7a8196ff tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1527 microversion: 2.1 time: 0.364986 Sep 10 20:59:58.072228 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1586/3250] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:57 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1527 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 20:59:58.082700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-fd473387-004a-4958-b965-b0d5207bb70d req-3a59cec5-1df3-4d60-826d-a26e1f6c2c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377f56f0-3163-4417-8d6b-ca4be8de2828", "name": "network-vif-plugged", "status": "completed", "tag": "7af13252-9cfc-4a98-a5da-d4f6e455291b"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:58.105117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fd473387-004a-4958-b965-b0d5207bb70d req-3a59cec5-1df3-4d60-826d-a26e1f6c2c17 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:58.105968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fd473387-004a-4958-b965-b0d5207bb70d req-3a59cec5-1df3-4d60-826d-a26e1f6c2c17 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:58.107139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fd473387-004a-4958-b965-b0d5207bb70d req-3a59cec5-1df3-4d60-826d-a26e1f6c2c17 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:58.139690 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-fd473387-004a-4958-b965-b0d5207bb70d req-3a59cec5-1df3-4d60-826d-a26e1f6c2c17 service nova] Creating event network-vif-plugged:7af13252-9cfc-4a98-a5da-d4f6e455291b for instance 377f56f0-3163-4417-8d6b-ca4be8de2828 on nch2-master-1 Sep 10 20:59:58.148780 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-fd473387-004a-4958-b965-b0d5207bb70d req-3a59cec5-1df3-4d60-826d-a26e1f6c2c17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075077 Sep 10 20:59:58.151408 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1587/3251] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 20:59:58.163360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dc119e10-af5e-41eb-bbf1-e879eee95d97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:58.164658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dc119e10-af5e-41eb-bbf1-e879eee95d97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:58.173689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc119e10-af5e-41eb-bbf1-e879eee95d97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:58.174528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc119e10-af5e-41eb-bbf1-e879eee95d97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:58.176087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc119e10-af5e-41eb-bbf1-e879eee95d97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:58.177470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc119e10-af5e-41eb-bbf1-e879eee95d97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:58.178127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc119e10-af5e-41eb-bbf1-e879eee95d97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:58.178712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc119e10-af5e-41eb-bbf1-e879eee95d97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:58.857442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dc119e10-af5e-41eb-bbf1-e879eee95d97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:58.861728 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4a715f72-48d3-44cf-9e70-d86ce1453474 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9" status: 202 len: 0 microversion: 2.1 time: 1.532817 Sep 10 20:59:58.863613 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1665/3252] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 20:59:57 2022] DELETE /compute/v2.1/os-security-groups/b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 => generated 0 bytes in 1537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 20:59:58.874796 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dc119e10-af5e-41eb-bbf1-e879eee95d97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.722284 Sep 10 20:59:58.889959 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1588/3253] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:58 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:58.890359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9561207-8ce5-44d5-af58-f84bf22b9358 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944ad8ee0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:58.890471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-53080844-9cf3-450e-8c27-d345936f7bab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:58.890471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-53080844-9cf3-450e-8c27-d345936f7bab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:58.899281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53080844-9cf3-450e-8c27-d345936f7bab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:58.901767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53080844-9cf3-450e-8c27-d345936f7bab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:58.902261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53080844-9cf3-450e-8c27-d345936f7bab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:58.903004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53080844-9cf3-450e-8c27-d345936f7bab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:58.903502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53080844-9cf3-450e-8c27-d345936f7bab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:58.903895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53080844-9cf3-450e-8c27-d345936f7bab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.042160 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f9561207-8ce5-44d5-af58-f84bf22b9358 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.177289 Sep 10 20:59:59.050914 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1666/3254] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 20:59:58 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:59.057114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:59.057746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:59.088898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.090158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.090842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.092560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.094917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.098479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.139510 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] HTTP exception thrown: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Request method failure captured: Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 HTTP/1.1 Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqo-BYgATsdHXs1nczx9tV_6VOTa1LjAZP8YIiW1psX1vAieb1SZqML6aD12ZFxRwaDZibCH5J2ItyFtsxbu2oxbIx6QD1AUvAb5IMtyyq8uWZ4vVr3_wduFK3XkB6VfqGvI8WrnP8skMN5JoRtf6udQmdEixNw3aKBLruBMHD97g0 Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.21 Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 329b758edee649078291d9cb0eda3feb Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1984973399 Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/329b758edee649078291d9cb0eda3feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/329b758edee649078291d9cb0eda3feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_329b758edee649078291d9cb0eda3feb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/329b758edee649078291d9cb0eda3feb"}]}] Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-InstanceActionsV221TestJSON-1984973399 Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 329b758edee649078291d9cb0eda3feb Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1984973399 Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-InstanceActionsV221TestJSON-1984973399-project Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: fd0c6e0e7b1a44c69ec9f4685ee39398 Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-InstanceActionsV221TestJSON-1984973399-project Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '0496a52e-07cc-49bb-bdd1-e9f2833b5023'} Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.141790 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:59.147485 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.147485 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.147485 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:59.147485 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:59.147485 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:59.147485 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:59.147485 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.147485 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.151125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Returning 404 to user: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:59.157215 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-82a8c2ac-ccd4-41d0-b56e-a14af6b2b07a tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 404 len: 111 microversion: 2.21 time: 0.105242 Sep 10 20:59:59.164698 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1667/3255] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:59 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:59:59.170071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56e1a370-a91a-4a04-a287-f334e5648673 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f9944935310>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:59.304660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-53080844-9cf3-450e-8c27-d345936f7bab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:59.333103 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-53080844-9cf3-450e-8c27-d345936f7bab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 0.451125 Sep 10 20:59:59.335442 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1589/3256] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:58 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:59.353718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-299e6c7e-a808-4752-9753-52aa1139bc46 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:59.354732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-299e6c7e-a808-4752-9753-52aa1139bc46 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:59.365262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-299e6c7e-a808-4752-9753-52aa1139bc46 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.367198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-299e6c7e-a808-4752-9753-52aa1139bc46 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.368394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-299e6c7e-a808-4752-9753-52aa1139bc46 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.368948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-56e1a370-a91a-4a04-a287-f334e5648673 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 20:59:59.369601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-299e6c7e-a808-4752-9753-52aa1139bc46 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.369727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.security_group_api [None req-56e1a370-a91a-4a04-a287-f334e5648673 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Neutron security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 not found {{(pid=145772) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 20:59:59.370343 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-56e1a370-a91a-4a04-a287-f334e5648673 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 20:59:59.370343 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-b550b498-a45b-43ab-9e4c-741f6b95bb8d'] Sep 10 20:59:59.371166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-299e6c7e-a808-4752-9753-52aa1139bc46 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.371966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-299e6c7e-a808-4752-9753-52aa1139bc46 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56e1a370-a91a-4a04-a287-f334e5648673 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-security-groups/b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 HTTP/1.1 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: exception: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-b550b498-a45b-43ab-9e4c-741f6b95bb8d'] Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9'} Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 20:59:59.372610 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b550b498-a45b-43ab-9e4c-741f6b95bb8d'] Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b550b498-a45b-43ab-9e4c-741f6b95bb8d'] Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b550b498-a45b-43ab-9e4c-741f6b95bb8d'] Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b550b498-a45b-43ab-9e4c-741f6b95bb8d'] Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56e1a370-a91a-4a04-a287-f334e5648673 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-b550b498-a45b-43ab-9e4c-741f6b95bb8d'] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:59.378577 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-56e1a370-a91a-4a04-a287-f334e5648673 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9" status: 404 len: 194 microversion: 2.1 time: 0.207814 Sep 10 20:59:59.382950 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1668/3257] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 20:59:59 2022] GET /compute/v2.1/os-security-groups/b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 => generated 194 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 20:59:59.385138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-57cad980-0f4b-4ff4-9e9d-ff8a1aaccbf5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '.version_select at 0x7f99496c8040>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:59.385725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-57cad980-0f4b-4ff4-9e9d-ff8a1aaccbf5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:59.425793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57cad980-0f4b-4ff4-9e9d-ff8a1aaccbf5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.432733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57cad980-0f4b-4ff4-9e9d-ff8a1aaccbf5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.435163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57cad980-0f4b-4ff4-9e9d-ff8a1aaccbf5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.435954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57cad980-0f4b-4ff4-9e9d-ff8a1aaccbf5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.436433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57cad980-0f4b-4ff4-9e9d-ff8a1aaccbf5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.436875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57cad980-0f4b-4ff4-9e9d-ff8a1aaccbf5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.656272 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-57cad980-0f4b-4ff4-9e9d-ff8a1aaccbf5 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.275120 Sep 10 20:59:59.658693 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1669/3258] 10.222.0.33 () {60 vars in 1337 bytes} [Sat Sep 10 20:59:59 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023/os-instance-actions => generated 611 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 20:59:59.658823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-299e6c7e-a808-4752-9753-52aa1139bc46 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 20:59:59.669338 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-299e6c7e-a808-4752-9753-52aa1139bc46 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1527 microversion: 2.1 time: 0.331217 Sep 10 20:59:59.674184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9f14775c-148f-42e4-af07-6319f3549c49 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: .version_select at 0x7f994519c820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-701542239", "description": "tempest-description-271312620"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 20:59:59.679419 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1590/3259] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:59 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1527 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 20:59:59.694178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:59.694957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:59.704595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.705360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.706583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.707522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.708264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.708882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.732141 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] HTTP exception thrown: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Request method failure captured: Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 HTTP/1.1 Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqo-BYgATsdHXs1nczx9tV_6VOTa1LjAZP8YIiW1psX1vAieb1SZqML6aD12ZFxRwaDZibCH5J2ItyFtsxbu2oxbIx6QD1AUvAb5IMtyyq8uWZ4vVr3_wduFK3XkB6VfqGvI8WrnP8skMN5JoRtf6udQmdEixNw3aKBLruBMHD97g0 Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.21 Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 329b758edee649078291d9cb0eda3feb Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1984973399 Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/329b758edee649078291d9cb0eda3feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/329b758edee649078291d9cb0eda3feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_329b758edee649078291d9cb0eda3feb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/329b758edee649078291d9cb0eda3feb"}]}] Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-InstanceActionsV221TestJSON-1984973399 Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 329b758edee649078291d9cb0eda3feb Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1984973399 Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-InstanceActionsV221TestJSON-1984973399-project Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: fd0c6e0e7b1a44c69ec9f4685ee39398 Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-InstanceActionsV221TestJSON-1984973399-project Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '0496a52e-07cc-49bb-bdd1-e9f2833b5023'} Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:59.735142 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.739159 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.746720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Returning 404 to user: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:59.748010 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-52bfbb2b-8c17-42e9-aa75-bbea6768e4ee tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 404 len: 111 microversion: 2.21 time: 0.067409 Sep 10 20:59:59.749199 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1591/3260] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 20:59:59 2022] DELETE /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:59:59.765742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:59.770404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] [instance: 0496a52e-07cc-49bb-bdd1-e9f2833b5023] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:59.786213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.786786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.787249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.787985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.793064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.793752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.828748 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] HTTP exception thrown: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Request method failure captured: Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 HTTP/1.1 Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqo-BYgATsdHXs1nczx9tV_6VOTa1LjAZP8YIiW1psX1vAieb1SZqML6aD12ZFxRwaDZibCH5J2ItyFtsxbu2oxbIx6QD1AUvAb5IMtyyq8uWZ4vVr3_wduFK3XkB6VfqGvI8WrnP8skMN5JoRtf6udQmdEixNw3aKBLruBMHD97g0 Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.21 Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 329b758edee649078291d9cb0eda3feb Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1984973399 Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/329b758edee649078291d9cb0eda3feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/329b758edee649078291d9cb0eda3feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_329b758edee649078291d9cb0eda3feb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/329b758edee649078291d9cb0eda3feb"}]}] Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-InstanceActionsV221TestJSON-1984973399 Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 329b758edee649078291d9cb0eda3feb Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1984973399 Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-InstanceActionsV221TestJSON-1984973399-project Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: fd0c6e0e7b1a44c69ec9f4685ee39398 Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-InstanceActionsV221TestJSON-1984973399-project Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '0496a52e-07cc-49bb-bdd1-e9f2833b5023'} Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.835376 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 20:59:59.840058 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.840058 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 20:59:59.840058 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 20:59:59.840058 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 20:59:59.840058 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 20:59:59.840058 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 20:59:59.840058 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. Sep 10 20:59:59.840058 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 20:59:59.844169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] Returning 404 to user: Instance 0496a52e-07cc-49bb-bdd1-e9f2833b5023 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 20:59:59.845508 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-751c4ea4-9ebb-4511-8a98-67d312a20c92 tempest-InstanceActionsV221TestJSON-1984973399 tempest-InstanceActionsV221TestJSON-1984973399-project] 10.222.0.33 "GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023" status: 404 len: 111 microversion: 2.21 time: 0.091836 Sep 10 20:59:59.850843 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1592/3261] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 20:59:59 2022] GET /compute/v2.1/servers/0496a52e-07cc-49bb-bdd1-e9f2833b5023 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 20:59:59.905372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-32c6ed14-401d-46c9-96ff-4de2b70634e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 20:59:59.906808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-32c6ed14-401d-46c9-96ff-4de2b70634e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 20:59:59.921415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32c6ed14-401d-46c9-96ff-4de2b70634e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.922084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32c6ed14-401d-46c9-96ff-4de2b70634e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.922607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32c6ed14-401d-46c9-96ff-4de2b70634e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 20:59:59.923904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32c6ed14-401d-46c9-96ff-4de2b70634e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 20:59:59.926318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32c6ed14-401d-46c9-96ff-4de2b70634e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 20:59:59.928787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32c6ed14-401d-46c9-96ff-4de2b70634e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:00.642848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-32c6ed14-401d-46c9-96ff-4de2b70634e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:00.653732 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-32c6ed14-401d-46c9-96ff-4de2b70634e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.752903 Sep 10 21:00:00.671961 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1593/3262] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 20:59:59 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:00.684934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c1de705b-4811-4626-94db-a0ca6b0d1e4a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440b1ca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:00.795281 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c1de705b-4811-4626-94db-a0ca6b0d1e4a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.121878 Sep 10 21:00:00.796033 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1594/3263] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:00 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:00.806370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ab3cb1a-e800-4e5c-bea4-4ae80ee62d81 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:00.809494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0ab3cb1a-e800-4e5c-bea4-4ae80ee62d81 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:00.826187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ab3cb1a-e800-4e5c-bea4-4ae80ee62d81 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:00.828221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ab3cb1a-e800-4e5c-bea4-4ae80ee62d81 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:00.830201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ab3cb1a-e800-4e5c-bea4-4ae80ee62d81 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:00.832748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ab3cb1a-e800-4e5c-bea4-4ae80ee62d81 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:00.833805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ab3cb1a-e800-4e5c-bea4-4ae80ee62d81 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:00.836824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ab3cb1a-e800-4e5c-bea4-4ae80ee62d81 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:01.613906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0ab3cb1a-e800-4e5c-bea4-4ae80ee62d81 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:01.648089 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0ab3cb1a-e800-4e5c-bea4-4ae80ee62d81 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 0.850720 Sep 10 21:00:01.651271 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1595/3264] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:00 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:01.656149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:01.666799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:01.676025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:01.685135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:01.686218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:01.687170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:01.687836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:01.688543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:01.763763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:01.774803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:01.775296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:01.775785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lazy-loading 'fault' on Instance uuid a009fbee-aff7-41a2-be0f-785d15e2e42a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:00:01.898909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:01.910973 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f27cf88-5c3b-41a1-be89-7e22daf96996 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 200 len: 1315 microversion: 2.1 time: 0.258326 Sep 10 21:00:01.914472 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1596/3265] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:01 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:01.937844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f43555b6-7501-4e72-a180-bd5654febcb3 req-6d4d14d2-7421-4a31-8a56-20227ddad60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a009fbee-aff7-41a2-be0f-785d15e2e42a", "name": "network-vif-deleted", "tag": "8bc3db35-62d4-4858-9844-3ba3bf0422c2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:01.998372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f43555b6-7501-4e72-a180-bd5654febcb3 req-6d4d14d2-7421-4a31-8a56-20227ddad60e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:01.999953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f43555b6-7501-4e72-a180-bd5654febcb3 req-6d4d14d2-7421-4a31-8a56-20227ddad60e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:02.000598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f43555b6-7501-4e72-a180-bd5654febcb3 req-6d4d14d2-7421-4a31-8a56-20227ddad60e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:02.015991 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f43555b6-7501-4e72-a180-bd5654febcb3 req-6d4d14d2-7421-4a31-8a56-20227ddad60e service nova] Creating event network-vif-deleted:8bc3db35-62d4-4858-9844-3ba3bf0422c2 for instance a009fbee-aff7-41a2-be0f-785d15e2e42a on nch1-master-1 Sep 10 21:00:02.025677 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f43555b6-7501-4e72-a180-bd5654febcb3 req-6d4d14d2-7421-4a31-8a56-20227ddad60e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107992 Sep 10 21:00:02.027535 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1597/3266] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:02.034201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3865ccc3-6fde-447d-9e85-72b32393a967 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:02.035199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3865ccc3-6fde-447d-9e85-72b32393a967 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:02.042837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3865ccc3-6fde-447d-9e85-72b32393a967 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:02.043526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3865ccc3-6fde-447d-9e85-72b32393a967 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:02.044072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3865ccc3-6fde-447d-9e85-72b32393a967 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:02.044810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3865ccc3-6fde-447d-9e85-72b32393a967 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:02.045331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3865ccc3-6fde-447d-9e85-72b32393a967 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:02.045778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3865ccc3-6fde-447d-9e85-72b32393a967 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:02.077613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:02.217616 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9f14775c-148f-42e4-af07-6319f3549c49 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 2.555848 Sep 10 21:00:02.223426 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1670/3267] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 20:59:59 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 2559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:02.237199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b8150c96-9211-44de-a5f5-af89fb2683dd tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944142a60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:02.351512 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b8150c96-9211-44de-a5f5-af89fb2683dd tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.123834 Sep 10 21:00:02.352332 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1671/3268] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:02 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:02.364637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a217953-15e3-4e8d-a0da-93fcb248eb35 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: .version_select at 0x7f99458c6c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1719438588", "description": "tempest-description-319200285"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:03.104210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3865ccc3-6fde-447d-9e85-72b32393a967 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:03.121391 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3865ccc3-6fde-447d-9e85-72b32393a967 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 1.092284 Sep 10 21:00:03.122256 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1598/3269] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:02 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:03.132757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c9039ab-a8d4-4fa7-9a3e-3a937977dac5 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:03.133670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4c9039ab-a8d4-4fa7-9a3e-3a937977dac5 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:03.151643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c9039ab-a8d4-4fa7-9a3e-3a937977dac5 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:03.152398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c9039ab-a8d4-4fa7-9a3e-3a937977dac5 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:03.154162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c9039ab-a8d4-4fa7-9a3e-3a937977dac5 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:03.155116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c9039ab-a8d4-4fa7-9a3e-3a937977dac5 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:03.158029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c9039ab-a8d4-4fa7-9a3e-3a937977dac5 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:03.162154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c9039ab-a8d4-4fa7-9a3e-3a937977dac5 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:03.797845 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4a217953-15e3-4e8d-a0da-93fcb248eb35 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.443346 Sep 10 21:00:03.798663 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1672/3270] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 21:00:02 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:03.803901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:03.807007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:03.823100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:03.823514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:03.823963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:03.824685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:03.831429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:03.832327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:03.879599 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a HTTP/1.1 Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a009fbee-aff7-41a2-be0f-785d15e2e42a'} Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:03.885543 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:03.890687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:03.890687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:03.890687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:03.890687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:03.890687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:00:03.890687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:00:03.890687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:00:03.890687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:03.894983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 404 to user: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:00:03.897276 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c8e0faef-c37a-4bbd-bdc2-bad66dd484fb tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 404 len: 111 microversion: 2.1 time: 0.097581 Sep 10 21:00:03.908323 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1673/3271] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:03 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:00:03.922041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-16825d4f-b68c-4a11-b69a-a5293f6d517e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944d0ed30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:04.016818 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-16825d4f-b68c-4a11-b69a-a5293f6d517e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.106230 Sep 10 21:00:04.022460 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1674/3272] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:03 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:04.028767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-97bd4a53-369f-4e3f-891d-c511cca51c52 req-ef021295-98bd-43b2-92cc-7758a5d6fcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7301410e-1f12-405a-b630-377c08092f7e", "name": "network-vif-plugged", "status": "completed", "tag": "d7969a7f-0a1d-440b-a38c-b5027a4863c6"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:04.046528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-97bd4a53-369f-4e3f-891d-c511cca51c52 req-ef021295-98bd-43b2-92cc-7758a5d6fcb1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:04.047022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-97bd4a53-369f-4e3f-891d-c511cca51c52 req-ef021295-98bd-43b2-92cc-7758a5d6fcb1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:04.047456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-97bd4a53-369f-4e3f-891d-c511cca51c52 req-ef021295-98bd-43b2-92cc-7758a5d6fcb1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:04.060687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:04.065012 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-97bd4a53-369f-4e3f-891d-c511cca51c52 req-ef021295-98bd-43b2-92cc-7758a5d6fcb1 service nova] Creating event network-vif-plugged:d7969a7f-0a1d-440b-a38c-b5027a4863c6 for instance 7301410e-1f12-405a-b630-377c08092f7e on nch1-master-1 Sep 10 21:00:04.084002 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-97bd4a53-369f-4e3f-891d-c511cca51c52 req-ef021295-98bd-43b2-92cc-7758a5d6fcb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058715 Sep 10 21:00:04.089287 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1675/3273] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:04.095638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1902770f-80d4-4609-8b34-a74c5b306173 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: .version_select at 0x7f9944be0ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1792415038", "description": "tempest-description-231273270"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:04.548954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4c9039ab-a8d4-4fa7-9a3e-3a937977dac5 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:04.559851 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c9039ab-a8d4-4fa7-9a3e-3a937977dac5 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 1.435620 Sep 10 21:00:04.565758 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1599/3274] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:03 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:04.579998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2e745aca-1e49-4df1-a96c-402106ea0212 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Action: 'create', calling method: .version_select at 0x7f994425f040>, body: {"keypair": {"name": "tempest-keypair-1295182887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaE7mUl1WqTx2oHEMwDawqldOxjtVqPAVake87HYU75IL5g/r/JrN2ns4penl/HQ4K5njOiVqzOlOctavC/EUa6elH1hdIY9UwkOprSWqseAiF0lXWYAZZuZtFPLvCypA=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:04.628609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-2e745aca-1e49-4df1-a96c-402106ea0212 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Getting quotas for project cebec33205424ecf92b54428bdf5eb61. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:00:04.643055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-2e745aca-1e49-4df1-a96c-402106ea0212 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Getting quotas for user ae0c7612d933424597e1f176be189a0b and project cebec33205424ecf92b54428bdf5eb61. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:00:04.707489 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2e745aca-1e49-4df1-a96c-402106ea0212 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140145 Sep 10 21:00:04.708151 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1902770f-80d4-4609-8b34-a74c5b306173 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.617154 Sep 10 21:00:04.717399 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1600/3275] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:00:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:04.717664 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1676/3276] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 21:00:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:04.724003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cebef3f7-b19c-4c12-ba75-d51ed467c3bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:04.728150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6382851b-4f4e-4358-9561-34b79fd2223a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f99440b13a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:04.731014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cebef3f7-b19c-4c12-ba75-d51ed467c3bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:04.747583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cebef3f7-b19c-4c12-ba75-d51ed467c3bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:04.748164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cebef3f7-b19c-4c12-ba75-d51ed467c3bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:04.748667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cebef3f7-b19c-4c12-ba75-d51ed467c3bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:04.749711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cebef3f7-b19c-4c12-ba75-d51ed467c3bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:04.754770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cebef3f7-b19c-4c12-ba75-d51ed467c3bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:04.755452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cebef3f7-b19c-4c12-ba75-d51ed467c3bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:05.223279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cebef3f7-b19c-4c12-ba75-d51ed467c3bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:05.233786 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cebef3f7-b19c-4c12-ba75-d51ed467c3bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.514957 Sep 10 21:00:05.239309 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1677/3277] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:04 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:05.255721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e686e8ed-3e11-41de-b0ea-73099df1f8c4 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944ab2700>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:05.357923 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e686e8ed-3e11-41de-b0ea-73099df1f8c4 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.116437 Sep 10 21:00:05.361020 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1678/3278] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:05 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:05.594514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4fab4afb-8d47-40de-8293-7a76f5fa1692 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:05.595572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4fab4afb-8d47-40de-8293-7a76f5fa1692 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:05.608657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fab4afb-8d47-40de-8293-7a76f5fa1692 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:05.609565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fab4afb-8d47-40de-8293-7a76f5fa1692 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:05.611010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fab4afb-8d47-40de-8293-7a76f5fa1692 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:05.613515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fab4afb-8d47-40de-8293-7a76f5fa1692 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:05.614296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fab4afb-8d47-40de-8293-7a76f5fa1692 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:05.615153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fab4afb-8d47-40de-8293-7a76f5fa1692 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:06.159402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4fab4afb-8d47-40de-8293-7a76f5fa1692 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:06.175619 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4fab4afb-8d47-40de-8293-7a76f5fa1692 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1317 microversion: 2.1 time: 0.586839 Sep 10 21:00:06.180731 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1679/3279] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:05 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:00:06.250143 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6382851b-4f4e-4358-9561-34b79fd2223a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 1.530514 Sep 10 21:00:06.267346 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1601/3280] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 21:00:04 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:06.273526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e5f9c72-4973-402e-9172-b527abebf3e8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:06.275091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e5f9c72-4973-402e-9172-b527abebf3e8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:06.280321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-11f0b459-5f26-40d7-96da-7fdd70f5fed0 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f9944d35550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:06.306268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e5f9c72-4973-402e-9172-b527abebf3e8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:06.307061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e5f9c72-4973-402e-9172-b527abebf3e8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:06.310181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e5f9c72-4973-402e-9172-b527abebf3e8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:06.313258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e5f9c72-4973-402e-9172-b527abebf3e8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:06.316737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e5f9c72-4973-402e-9172-b527abebf3e8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:06.317458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e5f9c72-4973-402e-9172-b527abebf3e8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:06.665856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e5f9c72-4973-402e-9172-b527abebf3e8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:06.683059 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e5f9c72-4973-402e-9172-b527abebf3e8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.421757 Sep 10 21:00:06.686623 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1680/3281] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:06 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:06.703482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0fb8f1ad-e56b-470c-9537-66e5d0022d8f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99494fba60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:06.795360 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0fb8f1ad-e56b-470c-9537-66e5d0022d8f tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.107194 Sep 10 21:00:06.796107 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1681/3282] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:06 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:07.213453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e280d2c9-43b0-4bbe-9ab2-bad5acf0192e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:07.214313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e280d2c9-43b0-4bbe-9ab2-bad5acf0192e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:07.229691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e280d2c9-43b0-4bbe-9ab2-bad5acf0192e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:07.231946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e280d2c9-43b0-4bbe-9ab2-bad5acf0192e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:07.232923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e280d2c9-43b0-4bbe-9ab2-bad5acf0192e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:07.239893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e280d2c9-43b0-4bbe-9ab2-bad5acf0192e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:07.240819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e280d2c9-43b0-4bbe-9ab2-bad5acf0192e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:07.242123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e280d2c9-43b0-4bbe-9ab2-bad5acf0192e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:07.413389 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-11f0b459-5f26-40d7-96da-7fdd70f5fed0 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/acc7ee41-d785-428f-8576-ebc6a929b9cc" status: 202 len: 0 microversion: 2.1 time: 1.144343 Sep 10 21:00:07.418187 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1602/3283] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:00:06 2022] DELETE /compute/v2.1/os-security-groups/acc7ee41-d785-428f-8576-ebc6a929b9cc => generated 0 bytes in 1150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:00:07.426456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-523bb205-1ac9-4204-8320-83aaff8ddf17 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f99440edca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:07.675934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-523bb205-1ac9-4204-8320-83aaff8ddf17 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:00:07.678934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.security_group_api [None req-523bb205-1ac9-4204-8320-83aaff8ddf17 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Neutron security group acc7ee41-d785-428f-8576-ebc6a929b9cc not found {{(pid=145771) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 21:00:07.680718 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-523bb205-1ac9-4204-8320-83aaff8ddf17 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:00:07.680718 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-939e44d7-1051-46cb-bac4-818e8b4f350f'] Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-523bb205-1ac9-4204-8320-83aaff8ddf17 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-security-groups/acc7ee41-d785-428f-8576-ebc6a929b9cc HTTP/1.1 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: exception: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-939e44d7-1051-46cb-bac4-818e8b4f350f'] Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'acc7ee41-d785-428f-8576-ebc6a929b9cc'} Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:00:07.684167 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-939e44d7-1051-46cb-bac4-818e8b4f350f'] Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-939e44d7-1051-46cb-bac4-818e8b4f350f'] Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-939e44d7-1051-46cb-bac4-818e8b4f350f'] Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-939e44d7-1051-46cb-bac4-818e8b4f350f'] Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-523bb205-1ac9-4204-8320-83aaff8ddf17 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:00:07.689655 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-939e44d7-1051-46cb-bac4-818e8b4f350f'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:00:07.699235 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-523bb205-1ac9-4204-8320-83aaff8ddf17 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/acc7ee41-d785-428f-8576-ebc6a929b9cc" status: 404 len: 194 microversion: 2.1 time: 0.279753 Sep 10 21:00:07.699905 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1603/3284] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 21:00:07 2022] GET /compute/v2.1/os-security-groups/acc7ee41-d785-428f-8576-ebc6a929b9cc => generated 194 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:00:07.718105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab04faff-fb6a-4fe4-937a-594e58bd9dbe tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f994425fa60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:08.242131 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab04faff-fb6a-4fe4-937a-594e58bd9dbe tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4c2593f8-ed2a-4b8b-87ef-3e77141a83a6" status: 202 len: 0 microversion: 2.1 time: 0.536797 Sep 10 21:00:08.247879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1604/3285] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:00:07 2022] DELETE /compute/v2.1/os-security-groups/4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:00:08.255128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6d986fdb-9b60-464d-bcaf-cf15a7be0dd7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:08.256076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6d986fdb-9b60-464d-bcaf-cf15a7be0dd7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:08.264705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d986fdb-9b60-464d-bcaf-cf15a7be0dd7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:08.265446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d986fdb-9b60-464d-bcaf-cf15a7be0dd7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:08.266152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d986fdb-9b60-464d-bcaf-cf15a7be0dd7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:08.267677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d986fdb-9b60-464d-bcaf-cf15a7be0dd7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:08.268478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d986fdb-9b60-464d-bcaf-cf15a7be0dd7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:08.269301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d986fdb-9b60-464d-bcaf-cf15a7be0dd7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:08.732894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6d986fdb-9b60-464d-bcaf-cf15a7be0dd7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:08.743034 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6d986fdb-9b60-464d-bcaf-cf15a7be0dd7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.493100 Sep 10 21:00:08.743555 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1605/3286] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:08 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:08.764684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4060f508-f4db-4484-990f-8a020ed0bf22 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f994963a820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:08.873015 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4060f508-f4db-4484-990f-8a020ed0bf22 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.128369 Sep 10 21:00:08.873621 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1606/3287] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:08 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:08.889335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5f583cf-f327-4d30-b081-de65245de52c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f99440edc10>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:08.898800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e280d2c9-43b0-4bbe-9ab2-bad5acf0192e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:08.940882 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e280d2c9-43b0-4bbe-9ab2-bad5acf0192e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1466 microversion: 2.1 time: 1.728354 Sep 10 21:00:08.982663 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1682/3288] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:07 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1466 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:08.991590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-e5f583cf-f327-4d30-b081-de65245de52c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:00:08.992399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.security_group_api [None req-e5f583cf-f327-4d30-b081-de65245de52c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Neutron security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 not found {{(pid=145771) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 21:00:08.993276 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-e5f583cf-f327-4d30-b081-de65245de52c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:00:08.993276 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-bb899145-c095-405f-aba4-3d98ad9fe44f'] Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5f583cf-f327-4d30-b081-de65245de52c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-security-groups/4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 HTTP/1.1 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: exception: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-bb899145-c095-405f-aba4-3d98ad9fe44f'] Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '4c2593f8-ed2a-4b8b-87ef-3e77141a83a6'} Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:00:08.995701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb899145-c095-405f-aba4-3d98ad9fe44f'] Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb899145-c095-405f-aba4-3d98ad9fe44f'] Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb899145-c095-405f-aba4-3d98ad9fe44f'] Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb899145-c095-405f-aba4-3d98ad9fe44f'] Sep 10 21:00:08.999631 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:09.003221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a58e86c7-7c5e-4be5-b6db-0a31889aa23d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:09.003523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a58e86c7-7c5e-4be5-b6db-0a31889aa23d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:09.004609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5f583cf-f327-4d30-b081-de65245de52c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:00:09.004609 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-bb899145-c095-405f-aba4-3d98ad9fe44f'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:00:09.005603 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5f583cf-f327-4d30-b081-de65245de52c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/4c2593f8-ed2a-4b8b-87ef-3e77141a83a6" status: 404 len: 194 microversion: 2.1 time: 0.124370 Sep 10 21:00:09.006671 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1607/3289] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 21:00:08 2022] GET /compute/v2.1/os-security-groups/4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:00:09.018760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-446f8142-fa8f-4c8f-baf7-45bb1dcd6eb4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f994425f040>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:09.026668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58e86c7-7c5e-4be5-b6db-0a31889aa23d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:09.029322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58e86c7-7c5e-4be5-b6db-0a31889aa23d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:09.030105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58e86c7-7c5e-4be5-b6db-0a31889aa23d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:09.032420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58e86c7-7c5e-4be5-b6db-0a31889aa23d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:09.034884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58e86c7-7c5e-4be5-b6db-0a31889aa23d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:09.037223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a58e86c7-7c5e-4be5-b6db-0a31889aa23d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:09.461441 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a58e86c7-7c5e-4be5-b6db-0a31889aa23d tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1617 microversion: 2.1 time: 0.474675 Sep 10 21:00:09.487631 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1683/3290] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:08 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1617 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:09.695054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1035517297", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "830cb245-7e91-4f1a-ae12-8010551e3aad"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:09.728127 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-446f8142-fa8f-4c8f-baf7-45bb1dcd6eb4 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e8aad778-afd1-420f-a28b-2290dab387a9" status: 202 len: 0 microversion: 2.1 time: 0.713026 Sep 10 21:00:09.729503 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1608/3291] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:00:09 2022] DELETE /compute/v2.1/os-security-groups/e8aad778-afd1-420f-a28b-2290dab387a9 => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:00:09.757660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29bc49c2-f2fe-42f8-aa4f-261ad6319d99 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f9944487550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:09.828053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:00:09.843217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-29bc49c2-f2fe-42f8-aa4f-261ad6319d99 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:00:09.845050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.security_group_api [None req-29bc49c2-f2fe-42f8-aa4f-261ad6319d99 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Neutron security group e8aad778-afd1-420f-a28b-2290dab387a9 not found {{(pid=145771) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 21:00:09.845892 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-29bc49c2-f2fe-42f8-aa4f-261ad6319d99 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:00:09.845892 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-9d89d761-cb79-4161-b34d-18f578dda424'] Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29bc49c2-f2fe-42f8-aa4f-261ad6319d99 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-security-groups/e8aad778-afd1-420f-a28b-2290dab387a9 HTTP/1.1 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: exception: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-9d89d761-cb79-4161-b34d-18f578dda424'] Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'e8aad778-afd1-420f-a28b-2290dab387a9'} Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:00:09.850371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d89d761-cb79-4161-b34d-18f578dda424'] Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d89d761-cb79-4161-b34d-18f578dda424'] Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d89d761-cb79-4161-b34d-18f578dda424'] Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d89d761-cb79-4161-b34d-18f578dda424'] Sep 10 21:00:09.857534 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:09.864144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29bc49c2-f2fe-42f8-aa4f-261ad6319d99 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:00:09.864144 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-9d89d761-cb79-4161-b34d-18f578dda424'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:00:09.865477 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-29bc49c2-f2fe-42f8-aa4f-261ad6319d99 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/e8aad778-afd1-420f-a28b-2290dab387a9" status: 404 len: 194 microversion: 2.1 time: 0.131650 Sep 10 21:00:09.866637 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1609/3292] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 21:00:09 2022] GET /compute/v2.1/os-security-groups/e8aad778-afd1-420f-a28b-2290dab387a9 => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:00:09.874541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6456e225-60b1-4703-af96-792c1a498da1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:09.876061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6456e225-60b1-4703-af96-792c1a498da1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:09.886128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6456e225-60b1-4703-af96-792c1a498da1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:09.886914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6456e225-60b1-4703-af96-792c1a498da1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:09.887705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6456e225-60b1-4703-af96-792c1a498da1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:09.888667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6456e225-60b1-4703-af96-792c1a498da1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:09.889367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6456e225-60b1-4703-af96-792c1a498da1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:09.890096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6456e225-60b1-4703-af96-792c1a498da1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:10.284599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6456e225-60b1-4703-af96-792c1a498da1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:10.313591 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6456e225-60b1-4703-af96-792c1a498da1 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.445540 Sep 10 21:00:10.321040 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1610/3293] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:09 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:10.336271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29372f24-c902-4501-8680-5a2cc9a3d872 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f9944487af0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:11.407097 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-29372f24-c902-4501-8680-5a2cc9a3d872 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.082208 Sep 10 21:00:11.418764 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1611/3294] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 21:00:10 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:11.424829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7354af9e-2079-4be2-8cfd-d20235aac9d1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9949689700>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:11.508194 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7354af9e-2079-4be2-8cfd-d20235aac9d1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.087892 Sep 10 21:00:11.509396 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1612/3295] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:11 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:11.517942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb79dd94-a7b7-4936-a127-1a04e47dbc48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:11.523150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fb79dd94-a7b7-4936-a127-1a04e47dbc48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:11.533745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb79dd94-a7b7-4936-a127-1a04e47dbc48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:11.535868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb79dd94-a7b7-4936-a127-1a04e47dbc48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:11.536537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb79dd94-a7b7-4936-a127-1a04e47dbc48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:11.537508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb79dd94-a7b7-4936-a127-1a04e47dbc48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:11.538263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb79dd94-a7b7-4936-a127-1a04e47dbc48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:11.539638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb79dd94-a7b7-4936-a127-1a04e47dbc48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:11.855809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:00:11.857217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:00:11.858000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:00:11.858814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:00:11.859465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:00:11.880982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:11.883424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:11.884062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:11.885347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fb79dd94-a7b7-4936-a127-1a04e47dbc48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:11.887263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:11.887779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:11.889311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:11.899584 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fb79dd94-a7b7-4936-a127-1a04e47dbc48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.386089 Sep 10 21:00:11.927414 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1613/3296] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:11 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:11.937299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eab681b5-9a22-41c2-8cb2-c73e97154b63 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: .version_select at 0x7f99450e7e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1624682868", "description": "tempest-description-1285792338"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:11.941935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:00:11.958752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Getting quotas for user f38321284ec449e599d645625ed11139 and project d30ef9b7525e4784be26268f46121e62. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:00:12.009810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:00:12.017559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:00:12.229162 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c85ba69-c178-4b60-913d-beee68da419c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.537861 Sep 10 21:00:12.233710 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1684/3297] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:00:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:00:12.256420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9f153c6f-79a2-43be-aeda-20806aab387b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:12.258439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9f153c6f-79a2-43be-aeda-20806aab387b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:12.442473 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eab681b5-9a22-41c2-8cb2-c73e97154b63 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.513445 Sep 10 21:00:12.444114 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1614/3298] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 21:00:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:12.453465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1193458040", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:12.509280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9f153c6f-79a2-43be-aeda-20806aab387b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:12.520687 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9f153c6f-79a2-43be-aeda-20806aab387b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1217 microversion: 2.1 time: 0.276870 Sep 10 21:00:12.526171 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1685/3299] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:12 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1217 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:12.542442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1aa7814-7877-443a-9c9a-5e22a64f3f4a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: .version_select at 0x7f9944d0edc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2129623339", "description": "tempest-description-1335988110"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:12.646189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] validate_networks() for [('1cd195d4-857f-42a6-b181-30998baed10d', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:00:13.681528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:00:13.682737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:00:13.686606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:00:13.687263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:00:13.687856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:00:13.706101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:13.706101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:13.708970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:13.714611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:13.715389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:13.716044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:13.763142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Getting quotas for project cebec33205424ecf92b54428bdf5eb61. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:00:13.779982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Getting quotas for user ae0c7612d933424597e1f176be189a0b and project cebec33205424ecf92b54428bdf5eb61. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:00:13.813701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:13.835277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:00:13.845799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:00:14.021136 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5010966-0b5b-4399-bfd2-efa09a56f4be tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.574387 Sep 10 21:00:14.033231 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1615/3300] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:00:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:00:14.044596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70bec48a-28fe-4447-b797-c0cf80dc65d2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944487550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:14.210945 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-70bec48a-28fe-4447-b797-c0cf80dc65d2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.175605 Sep 10 21:00:14.224519 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1616/3301] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:14 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:14.226772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6334c1fa-5f48-4684-af67-f95742dc3b89 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:14.228202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6334c1fa-5f48-4684-af67-f95742dc3b89 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:14.251390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6334c1fa-5f48-4684-af67-f95742dc3b89 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:14.253322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6334c1fa-5f48-4684-af67-f95742dc3b89 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:14.253796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6334c1fa-5f48-4684-af67-f95742dc3b89 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:14.254571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6334c1fa-5f48-4684-af67-f95742dc3b89 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:14.261573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6334c1fa-5f48-4684-af67-f95742dc3b89 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:14.267714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6334c1fa-5f48-4684-af67-f95742dc3b89 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:14.689515 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1aa7814-7877-443a-9c9a-5e22a64f3f4a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 2.161204 Sep 10 21:00:14.726575 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1686/3302] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 21:00:12 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 2199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:14.734396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-713b36a1-acfa-48a1-a536-7586c2bb80c0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:14.744547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-713b36a1-acfa-48a1-a536-7586c2bb80c0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:14.765159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-713b36a1-acfa-48a1-a536-7586c2bb80c0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:14.766370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-713b36a1-acfa-48a1-a536-7586c2bb80c0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:14.769711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-713b36a1-acfa-48a1-a536-7586c2bb80c0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:14.771232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-713b36a1-acfa-48a1-a536-7586c2bb80c0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:14.782828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-713b36a1-acfa-48a1-a536-7586c2bb80c0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:14.783928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-713b36a1-acfa-48a1-a536-7586c2bb80c0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:14.816981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6334c1fa-5f48-4684-af67-f95742dc3b89 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:14.834728 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6334c1fa-5f48-4684-af67-f95742dc3b89 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1531 microversion: 2.1 time: 0.621792 Sep 10 21:00:14.839902 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1617/3303] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:14 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1531 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:14.855722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c820a6a5-1916-4d1a-84f0-fb59e4583692 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:14.858871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c820a6a5-1916-4d1a-84f0-fb59e4583692 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:15.501625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c820a6a5-1916-4d1a-84f0-fb59e4583692 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:15.513335 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c820a6a5-1916-4d1a-84f0-fb59e4583692 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1225 microversion: 2.1 time: 0.672009 Sep 10 21:00:15.525187 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1618/3304] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:14 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1225 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:15.600517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cb418c32-c410-4d42-b26e-4afa8fd7e6e5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f994963a820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:15.814277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-713b36a1-acfa-48a1-a536-7586c2bb80c0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:15.838348 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-713b36a1-acfa-48a1-a536-7586c2bb80c0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1269 microversion: 2.1 time: 1.108304 Sep 10 21:00:15.843985 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1687/3305] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:14 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1269 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:15.853385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-106215180", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "0e6ac760-d4f3-4594-843f-5abf4ec869f0"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:16.001683 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cb418c32-c410-4d42-b26e-4afa8fd7e6e5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1454 microversion: 2.1 time: 0.455362 Sep 10 21:00:16.006866 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1619/3306] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:15 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1454 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:16.014557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cb418c32-c410-4d42-b26e-4afa8fd7e6e5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:16.016082 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cb418c32-c410-4d42-b26e-4afa8fd7e6e5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007431 Sep 10 21:00:16.019648 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1620/3307] 10.222.0.33 () {56 vars in 886 bytes} [Sat Sep 10 21:00:16 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 21:00:16.075024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c873378a-184d-4a65-b9f9-2f1e132ca7e5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:16.076133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c873378a-184d-4a65-b9f9-2f1e132ca7e5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:16.113104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c873378a-184d-4a65-b9f9-2f1e132ca7e5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:16.113614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c873378a-184d-4a65-b9f9-2f1e132ca7e5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:16.114095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c873378a-184d-4a65-b9f9-2f1e132ca7e5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:16.114826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c873378a-184d-4a65-b9f9-2f1e132ca7e5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:16.129358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c873378a-184d-4a65-b9f9-2f1e132ca7e5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:16.129867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c873378a-184d-4a65-b9f9-2f1e132ca7e5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:17.142470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c873378a-184d-4a65-b9f9-2f1e132ca7e5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:17.161708 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c873378a-184d-4a65-b9f9-2f1e132ca7e5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1526 microversion: 2.1 time: 1.126451 Sep 10 21:00:17.173996 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1621/3308] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:16 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1526 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:17.215329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8ceaecd-855f-48c0-8278-47eb154c6222 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:17.218070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8ceaecd-855f-48c0-8278-47eb154c6222 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:17.239113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ceaecd-855f-48c0-8278-47eb154c6222 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:17.239624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ceaecd-855f-48c0-8278-47eb154c6222 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:17.241034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ceaecd-855f-48c0-8278-47eb154c6222 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:17.245241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ceaecd-855f-48c0-8278-47eb154c6222 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:17.245765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ceaecd-855f-48c0-8278-47eb154c6222 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:17.250543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ceaecd-855f-48c0-8278-47eb154c6222 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:17.532041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8ceaecd-855f-48c0-8278-47eb154c6222 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:17.565863 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8ceaecd-855f-48c0-8278-47eb154c6222 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1277 microversion: 2.1 time: 0.371617 Sep 10 21:00:17.569467 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1622/3309] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:17 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1277 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:17.582334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6cae8b4e-85c2-4668-94ec-0754d5049635 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:17.586250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6cae8b4e-85c2-4668-94ec-0754d5049635 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:17.649167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cae8b4e-85c2-4668-94ec-0754d5049635 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:17.656912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cae8b4e-85c2-4668-94ec-0754d5049635 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:17.657684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cae8b4e-85c2-4668-94ec-0754d5049635 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:17.665611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cae8b4e-85c2-4668-94ec-0754d5049635 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:17.676514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cae8b4e-85c2-4668-94ec-0754d5049635 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:17.678942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cae8b4e-85c2-4668-94ec-0754d5049635 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:19.009937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6cae8b4e-85c2-4668-94ec-0754d5049635 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:19.019533 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6cae8b4e-85c2-4668-94ec-0754d5049635 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1275 microversion: 2.1 time: 1.448851 Sep 10 21:00:19.020129 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1623/3310] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:17 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1275 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:19.042353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-545be1ba-5633-4c20-8dbc-d25afa3f7953 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440edb80>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:21.911585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:22.535782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:23.735161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:24.358693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] validate_networks() for [('0e6ac760-d4f3-4594-843f-5abf4ec869f0', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:00:24.585659 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-545be1ba-5633-4c20-8dbc-d25afa3f7953 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1463 microversion: 2.1 time: 5.555686 Sep 10 21:00:24.588444 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1624/3311] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:19 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1463 bytes in 5559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:24.597739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-416771d2-bc90-4acf-8db5-0d378a2c488d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:24.605115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-416771d2-bc90-4acf-8db5-0d378a2c488d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:24.620908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416771d2-bc90-4acf-8db5-0d378a2c488d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:24.621994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416771d2-bc90-4acf-8db5-0d378a2c488d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:24.622623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416771d2-bc90-4acf-8db5-0d378a2c488d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:24.623508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416771d2-bc90-4acf-8db5-0d378a2c488d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:24.624119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416771d2-bc90-4acf-8db5-0d378a2c488d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:24.624823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416771d2-bc90-4acf-8db5-0d378a2c488d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:25.405505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:00:25.406527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:00:25.407176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:00:25.407759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:00:25.408397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:00:25.410619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:25.440289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:25.450637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:25.454038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:25.456793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:25.460884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:25.461164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:25.500731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Getting quotas for project 7289ce4dcfe9474ea286bcbe7ef179a1. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:00:25.506908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=12 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:25.519701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Getting quotas for user 1b5bc12930c946ccaffcc524795ad965 and project 7289ce4dcfe9474ea286bcbe7ef179a1. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:00:25.540202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:00:25.554069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:00:25.699223 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b111a33-9236-4893-bd7f-d04726abab20 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.853466 Sep 10 21:00:25.705744 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1688/3312] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:00:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 9855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:00:25.710603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0af097b2-7713-440a-abde-2dfcb29cda79 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:25.711500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0af097b2-7713-440a-abde-2dfcb29cda79 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:25.724474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0af097b2-7713-440a-abde-2dfcb29cda79 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:25.730691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0af097b2-7713-440a-abde-2dfcb29cda79 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:25.731444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0af097b2-7713-440a-abde-2dfcb29cda79 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:25.732457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0af097b2-7713-440a-abde-2dfcb29cda79 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:25.733140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0af097b2-7713-440a-abde-2dfcb29cda79 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:25.733801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0af097b2-7713-440a-abde-2dfcb29cda79 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:25.919117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-416771d2-bc90-4acf-8db5-0d378a2c488d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:25.940734 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-416771d2-bc90-4acf-8db5-0d378a2c488d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1526 microversion: 2.1 time: 1.350945 Sep 10 21:00:25.945853 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1625/3313] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:24 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1526 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:25.963080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a7704eab-2a4e-46ec-b7b0-99d4d846835b req-0f0cc2c7-8099-470f-8684-7db6d30aa6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfdc13f-9c2e-44ec-8553-3f779ead89af", "name": "network-vif-plugged", "status": "completed", "tag": "b18a22e2-b050-417e-bebb-2f9e983473cc"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:25.976849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a7704eab-2a4e-46ec-b7b0-99d4d846835b req-0f0cc2c7-8099-470f-8684-7db6d30aa6ad service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:25.978031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a7704eab-2a4e-46ec-b7b0-99d4d846835b req-0f0cc2c7-8099-470f-8684-7db6d30aa6ad service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:25.980733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a7704eab-2a4e-46ec-b7b0-99d4d846835b req-0f0cc2c7-8099-470f-8684-7db6d30aa6ad service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:26.016490 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a7704eab-2a4e-46ec-b7b0-99d4d846835b req-0f0cc2c7-8099-470f-8684-7db6d30aa6ad service nova] Creating event network-vif-plugged:b18a22e2-b050-417e-bebb-2f9e983473cc for instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af on nch2-master-1 Sep 10 21:00:26.025098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0af097b2-7713-440a-abde-2dfcb29cda79 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:26.032664 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a7704eab-2a4e-46ec-b7b0-99d4d846835b req-0f0cc2c7-8099-470f-8684-7db6d30aa6ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085484 Sep 10 21:00:26.034827 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0af097b2-7713-440a-abde-2dfcb29cda79 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1325 microversion: 2.1 time: 0.333294 Sep 10 21:00:26.036135 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1689/3314] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:25 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1325 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:26.041171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-72c482bd-4da2-43e0-af1e-9eb371dea3da tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:26.042034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-72c482bd-4da2-43e0-af1e-9eb371dea3da tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:26.051939 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1626/3315] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:26.053965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72c482bd-4da2-43e0-af1e-9eb371dea3da tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:26.055276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72c482bd-4da2-43e0-af1e-9eb371dea3da tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:26.055944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72c482bd-4da2-43e0-af1e-9eb371dea3da tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:26.057473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72c482bd-4da2-43e0-af1e-9eb371dea3da tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:26.058190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72c482bd-4da2-43e0-af1e-9eb371dea3da tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:26.058801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72c482bd-4da2-43e0-af1e-9eb371dea3da tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:26.224677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1047077967", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "76c0a3d0-4c37-49ac-a364-0756f5d952f3"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:26.387819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] validate_networks() for [('76c0a3d0-4c37-49ac-a364-0756f5d952f3', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:00:26.505762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-72c482bd-4da2-43e0-af1e-9eb371dea3da tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:26.530243 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-72c482bd-4da2-43e0-af1e-9eb371dea3da tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1317 microversion: 2.1 time: 0.492541 Sep 10 21:00:26.532721 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1690/3316] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:26 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:26.551862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6aa9f99d-daf8-488b-8443-f25e24f55673 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944935670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:26.627948 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6aa9f99d-daf8-488b-8443-f25e24f55673 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 200 len: 1463 microversion: 2.1 time: 0.091012 Sep 10 21:00:26.628993 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1691/3317] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:26 2022] GET /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 1463 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:26.635363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9bcdf764-7567-457d-9802-5e7965a962a5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:26.636235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9bcdf764-7567-457d-9802-5e7965a962a5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:26.732912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9bcdf764-7567-457d-9802-5e7965a962a5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:26.741864 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9bcdf764-7567-457d-9802-5e7965a962a5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1215 microversion: 2.1 time: 0.111519 Sep 10 21:00:26.755039 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1692/3318] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:26 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:26.764173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a8e07275-bc46-4887-bbd4-345528592311 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:26.765046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a8e07275-bc46-4887-bbd4-345528592311 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:26.772915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8e07275-bc46-4887-bbd4-345528592311 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:26.773711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8e07275-bc46-4887-bbd4-345528592311 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:26.774349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8e07275-bc46-4887-bbd4-345528592311 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:26.775245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8e07275-bc46-4887-bbd4-345528592311 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:26.775877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8e07275-bc46-4887-bbd4-345528592311 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:26.776483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8e07275-bc46-4887-bbd4-345528592311 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:26.979078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a8e07275-bc46-4887-bbd4-345528592311 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:26.999536 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a8e07275-bc46-4887-bbd4-345528592311 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1467 microversion: 2.1 time: 0.241215 Sep 10 21:00:27.014008 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1693/3319] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:26 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1467 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:27.025152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a8dbbc74-84c1-42c4-b918-286d9b28c8b8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:27.026174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a8dbbc74-84c1-42c4-b918-286d9b28c8b8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:27.032553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8dbbc74-84c1-42c4-b918-286d9b28c8b8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:27.034163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8dbbc74-84c1-42c4-b918-286d9b28c8b8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:27.034892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8dbbc74-84c1-42c4-b918-286d9b28c8b8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:27.035874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8dbbc74-84c1-42c4-b918-286d9b28c8b8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:27.036592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8dbbc74-84c1-42c4-b918-286d9b28c8b8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:27.037250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8dbbc74-84c1-42c4-b918-286d9b28c8b8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:27.214875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a8dbbc74-84c1-42c4-b918-286d9b28c8b8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:27.242855 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a8dbbc74-84c1-42c4-b918-286d9b28c8b8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1526 microversion: 2.1 time: 0.227613 Sep 10 21:00:27.244578 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1694/3320] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:27 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1526 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:27.249070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8eca7fd-77d7-48ca-98a5-e82d161220c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2090220970"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:27.252085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d8eca7fd-77d7-48ca-98a5-e82d161220c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:27.276597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8eca7fd-77d7-48ca-98a5-e82d161220c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:27.277689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8eca7fd-77d7-48ca-98a5-e82d161220c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:27.278197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8eca7fd-77d7-48ca-98a5-e82d161220c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:27.279586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8eca7fd-77d7-48ca-98a5-e82d161220c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:27.280134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8eca7fd-77d7-48ca-98a5-e82d161220c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:27.280720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8eca7fd-77d7-48ca-98a5-e82d161220c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:27.796133 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d8eca7fd-77d7-48ca-98a5-e82d161220c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "POST /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6/action" status: 202 len: 0 microversion: 2.1 time: 0.550495 Sep 10 21:00:27.798446 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1695/3321] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:00:27 2022] POST /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 21:00:27.838911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e4d0201-c7f9-4415-a0c7-93cbd032b976 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:27.842597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e4d0201-c7f9-4415-a0c7-93cbd032b976 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:27.882849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e4d0201-c7f9-4415-a0c7-93cbd032b976 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:27.883352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e4d0201-c7f9-4415-a0c7-93cbd032b976 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:27.883796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e4d0201-c7f9-4415-a0c7-93cbd032b976 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:27.893893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e4d0201-c7f9-4415-a0c7-93cbd032b976 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:27.895136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e4d0201-c7f9-4415-a0c7-93cbd032b976 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:27.898481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e4d0201-c7f9-4415-a0c7-93cbd032b976 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:28.934490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6e4d0201-c7f9-4415-a0c7-93cbd032b976 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:28.969360 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e4d0201-c7f9-4415-a0c7-93cbd032b976 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1325 microversion: 2.1 time: 1.165606 Sep 10 21:00:28.971797 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1696/3322] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:27 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1325 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:28.989542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5ff904e-d3af-47ee-aced-7273c47fcfe8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:28.999615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5ff904e-d3af-47ee-aced-7273c47fcfe8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:29.026390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5ff904e-d3af-47ee-aced-7273c47fcfe8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:29.029349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5ff904e-d3af-47ee-aced-7273c47fcfe8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:29.031394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5ff904e-d3af-47ee-aced-7273c47fcfe8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:29.032170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5ff904e-d3af-47ee-aced-7273c47fcfe8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:29.038917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5ff904e-d3af-47ee-aced-7273c47fcfe8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:29.039387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5ff904e-d3af-47ee-aced-7273c47fcfe8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:29.045089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:00:29.045573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:00:29.046199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:00:29.046760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:00:29.047286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:00:29.081943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:29.083282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:29.087260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:29.089711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:29.094229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:29.102322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:29.151845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Getting quotas for project 243cfbc91bb24e7ca96f348cd21f1adb. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:00:29.163135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Getting quotas for user 9b9b59fb1a184b958ea619062412cf2d and project 243cfbc91bb24e7ca96f348cd21f1adb. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:00:29.199848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:00:29.209638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:00:29.356567 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1fe56c10-5f2d-4a8c-ad15-4c55fd742bbc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.301879 Sep 10 21:00:29.388168 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1627/3323] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:00:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:00:29.420838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c38d6bef-f881-4786-bf08-34765996c06e req-38ffc51e-11a7-4baa-a7fc-c9b9f30db8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de099be-4894-4f7a-86ac-d56cc4018723", "tag": "8cb2bc39-2ddf-4e76-b183-0949c1d2e00e"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:29.451307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c38d6bef-f881-4786-bf08-34765996c06e req-38ffc51e-11a7-4baa-a7fc-c9b9f30db8db service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:29.453484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c38d6bef-f881-4786-bf08-34765996c06e req-38ffc51e-11a7-4baa-a7fc-c9b9f30db8db service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:29.456679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c38d6bef-f881-4786-bf08-34765996c06e req-38ffc51e-11a7-4baa-a7fc-c9b9f30db8db service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:29.533755 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c38d6bef-f881-4786-bf08-34765996c06e req-38ffc51e-11a7-4baa-a7fc-c9b9f30db8db service nova] Creating event network-changed:8cb2bc39-2ddf-4e76-b183-0949c1d2e00e for instance 5de099be-4894-4f7a-86ac-d56cc4018723 on nch2-master-1 Sep 10 21:00:29.551889 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c38d6bef-f881-4786-bf08-34765996c06e req-38ffc51e-11a7-4baa-a7fc-c9b9f30db8db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154162 Sep 10 21:00:29.553245 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1628/3324] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:29.569930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bb171dcc-3f89-4957-b503-ba8ddb703b60 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:29.571978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bb171dcc-3f89-4957-b503-ba8ddb703b60 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:29.599454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb171dcc-3f89-4957-b503-ba8ddb703b60 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:29.600752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb171dcc-3f89-4957-b503-ba8ddb703b60 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:29.602661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb171dcc-3f89-4957-b503-ba8ddb703b60 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:29.605427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb171dcc-3f89-4957-b503-ba8ddb703b60 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:29.608041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb171dcc-3f89-4957-b503-ba8ddb703b60 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:29.609394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb171dcc-3f89-4957-b503-ba8ddb703b60 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:29.700815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a5ff904e-d3af-47ee-aced-7273c47fcfe8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:29.724958 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5ff904e-d3af-47ee-aced-7273c47fcfe8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1317 microversion: 2.1 time: 0.750537 Sep 10 21:00:29.744208 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1697/3325] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:28 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:29.751128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ba1a8905-b1ad-41f0-a880-7fe18ff7072c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99448aff70>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:29.817995 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ba1a8905-b1ad-41f0-a880-7fe18ff7072c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.072109 Sep 10 21:00:29.819500 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1698/3326] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:29 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:29.828643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-19744873-4fbb-449f-a61f-7b5479e996bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:29.833006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-19744873-4fbb-449f-a61f-7b5479e996bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:29.867794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19744873-4fbb-449f-a61f-7b5479e996bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:29.868598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19744873-4fbb-449f-a61f-7b5479e996bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:29.869248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19744873-4fbb-449f-a61f-7b5479e996bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:29.870068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19744873-4fbb-449f-a61f-7b5479e996bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:29.870603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19744873-4fbb-449f-a61f-7b5479e996bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:29.871143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19744873-4fbb-449f-a61f-7b5479e996bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:30.014929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bb171dcc-3f89-4957-b503-ba8ddb703b60 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:30.029534 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bb171dcc-3f89-4957-b503-ba8ddb703b60 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1273 microversion: 2.1 time: 0.471292 Sep 10 21:00:30.044122 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1629/3327] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:29 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1273 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:30.059602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-474925190", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "76c0a3d0-4c37-49ac-a364-0756f5d952f3"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:30.210597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] validate_networks() for [('76c0a3d0-4c37-49ac-a364-0756f5d952f3', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:00:31.074715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-19744873-4fbb-449f-a61f-7b5479e996bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:31.094206 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-19744873-4fbb-449f-a61f-7b5479e996bb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1526 microversion: 2.1 time: 1.270535 Sep 10 21:00:31.118764 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1699/3328] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:29 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1526 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:31.132913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f197f718-d4e4-4816-b133-c0eb59dd1103 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:31.134567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f197f718-d4e4-4816-b133-c0eb59dd1103 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:31.149416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f197f718-d4e4-4816-b133-c0eb59dd1103 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:31.152328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f197f718-d4e4-4816-b133-c0eb59dd1103 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:31.154018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f197f718-d4e4-4816-b133-c0eb59dd1103 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:31.159601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f197f718-d4e4-4816-b133-c0eb59dd1103 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:31.160230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f197f718-d4e4-4816-b133-c0eb59dd1103 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:31.160874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f197f718-d4e4-4816-b133-c0eb59dd1103 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:31.165507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:00:31.166571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:00:31.167240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:00:31.167823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:00:31.168461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:00:31.180456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:31.181244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:31.181950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:31.182898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:31.183591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:31.184239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:31.235372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:31.235634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Getting quotas for project 243cfbc91bb24e7ca96f348cd21f1adb. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:00:31.244837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Getting quotas for user 9b9b59fb1a184b958ea619062412cf2d and project 243cfbc91bb24e7ca96f348cd21f1adb. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:00:31.279725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:00:31.303955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:00:31.425053 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d4c5c082-d446-45a3-88ff-9dbeed1e5964 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.374274 Sep 10 21:00:31.454262 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1630/3329] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:00:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:00:31.475129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1a180f16-5bda-4be6-80db-5b2238c407c8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:31.489616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1a180f16-5bda-4be6-80db-5b2238c407c8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:31.519828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a180f16-5bda-4be6-80db-5b2238c407c8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:31.523621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a180f16-5bda-4be6-80db-5b2238c407c8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:31.530333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a180f16-5bda-4be6-80db-5b2238c407c8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:31.531510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a180f16-5bda-4be6-80db-5b2238c407c8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:31.532896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a180f16-5bda-4be6-80db-5b2238c407c8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:31.536440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a180f16-5bda-4be6-80db-5b2238c407c8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:32.480186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1a180f16-5bda-4be6-80db-5b2238c407c8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:32.483329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=77 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:32.497404 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1a180f16-5bda-4be6-80db-5b2238c407c8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1317 microversion: 2.1 time: 1.040600 Sep 10 21:00:32.498041 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1631/3330] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:31 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1317 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:32.515024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-31bab6b2-dff0-45c1-bbad-05b38228e12a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99441ba310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:32.667268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f197f718-d4e4-4816-b133-c0eb59dd1103 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:32.699934 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f197f718-d4e4-4816-b133-c0eb59dd1103 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1325 microversion: 2.1 time: 1.571275 Sep 10 21:00:32.700713 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1700/3331] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:31 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1325 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:32.711450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ee449c84-6862-45e8-8bb6-9e86eeca7060 req-e9f43aa6-7506-4916-9b4d-c85c60b3536d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377f56f0-3163-4417-8d6b-ca4be8de2828", "name": "network-vif-unplugged", "status": "completed", "tag": "7af13252-9cfc-4a98-a5da-d4f6e455291b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:32.736939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ee449c84-6862-45e8-8bb6-9e86eeca7060 req-e9f43aa6-7506-4916-9b4d-c85c60b3536d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:32.749304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ee449c84-6862-45e8-8bb6-9e86eeca7060 req-e9f43aa6-7506-4916-9b4d-c85c60b3536d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:32.749992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ee449c84-6862-45e8-8bb6-9e86eeca7060 req-e9f43aa6-7506-4916-9b4d-c85c60b3536d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:32.762772 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ee449c84-6862-45e8-8bb6-9e86eeca7060 req-e9f43aa6-7506-4916-9b4d-c85c60b3536d service nova] Creating event network-vif-unplugged:7af13252-9cfc-4a98-a5da-d4f6e455291b for instance 377f56f0-3163-4417-8d6b-ca4be8de2828 on nch2-master-1 Sep 10 21:00:32.779786 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ee449c84-6862-45e8-8bb6-9e86eeca7060 req-e9f43aa6-7506-4916-9b4d-c85c60b3536d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072446 Sep 10 21:00:32.781052 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1701/3332] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:32.795612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cc32a86c-5f9a-4bf7-8c87-6b0e4bff5d5d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:32.796641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cc32a86c-5f9a-4bf7-8c87-6b0e4bff5d5d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:32.807464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc32a86c-5f9a-4bf7-8c87-6b0e4bff5d5d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:32.810791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc32a86c-5f9a-4bf7-8c87-6b0e4bff5d5d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:32.811529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc32a86c-5f9a-4bf7-8c87-6b0e4bff5d5d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:32.812517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc32a86c-5f9a-4bf7-8c87-6b0e4bff5d5d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:32.817072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc32a86c-5f9a-4bf7-8c87-6b0e4bff5d5d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:32.817798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc32a86c-5f9a-4bf7-8c87-6b0e4bff5d5d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:32.853289 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-31bab6b2-dff0-45c1-bbad-05b38228e12a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.342025 Sep 10 21:00:32.854804 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1632/3333] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:32 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:32.860262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-631744733", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "451", "networks": [{"uuid": "76c0a3d0-4c37-49ac-a364-0756f5d952f3"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:32.937427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] validate_networks() for [('76c0a3d0-4c37-49ac-a364-0756f5d952f3', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:00:33.003667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cc32a86c-5f9a-4bf7-8c87-6b0e4bff5d5d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:33.015027 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cc32a86c-5f9a-4bf7-8c87-6b0e4bff5d5d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1273 microversion: 2.1 time: 0.232529 Sep 10 21:00:33.018223 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1702/3334] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:32 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:33.030687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ae20a07c-81e6-4def-b0ba-1795f38da13e req-b171108e-5446-4058-846f-403aebf4b0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c645369-3402-414b-bf2c-d82cf4dc75a6", "tag": "07767f3c-d5e3-4bdb-9bb4-11b7952111c2"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:33.050655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ae20a07c-81e6-4def-b0ba-1795f38da13e req-b171108e-5446-4058-846f-403aebf4b0b4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:33.058191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ae20a07c-81e6-4def-b0ba-1795f38da13e req-b171108e-5446-4058-846f-403aebf4b0b4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:33.058893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ae20a07c-81e6-4def-b0ba-1795f38da13e req-b171108e-5446-4058-846f-403aebf4b0b4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:33.085171 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ae20a07c-81e6-4def-b0ba-1795f38da13e req-b171108e-5446-4058-846f-403aebf4b0b4 service nova] Creating event network-changed:07767f3c-d5e3-4bdb-9bb4-11b7952111c2 for instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 on nch2-master-1 Sep 10 21:00:33.091597 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ae20a07c-81e6-4def-b0ba-1795f38da13e req-b171108e-5446-4058-846f-403aebf4b0b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071677 Sep 10 21:00:33.092734 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1703/3335] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:33.099038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6b52f62a-3fbc-4a27-943b-75bd546d0ce2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:33.100222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6b52f62a-3fbc-4a27-943b-75bd546d0ce2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:33.112107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b52f62a-3fbc-4a27-943b-75bd546d0ce2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:33.112761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b52f62a-3fbc-4a27-943b-75bd546d0ce2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:33.113384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b52f62a-3fbc-4a27-943b-75bd546d0ce2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:33.114398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b52f62a-3fbc-4a27-943b-75bd546d0ce2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:33.115015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b52f62a-3fbc-4a27-943b-75bd546d0ce2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:33.115794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b52f62a-3fbc-4a27-943b-75bd546d0ce2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:33.583111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:00:33.583678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:00:33.584272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:00:33.584791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:00:33.585314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:00:33.602272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:33.605638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:33.607061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:33.611010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:33.612047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:33.612716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:33.649031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Getting quotas for project 243cfbc91bb24e7ca96f348cd21f1adb. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:00:33.686432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Getting quotas for user 9b9b59fb1a184b958ea619062412cf2d and project 243cfbc91bb24e7ca96f348cd21f1adb. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:00:33.726684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:00:33.730590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:00:33.935518 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-11f3da72-2d80-42bf-bfb6-fb1d758d1f3c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079425 Sep 10 21:00:33.951669 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1633/3336] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:00:33.984621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-45e883fb-8000-4a74-adf1-a3222cbe35a8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:33.996478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-45e883fb-8000-4a74-adf1-a3222cbe35a8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:34.015569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45e883fb-8000-4a74-adf1-a3222cbe35a8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:34.019901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45e883fb-8000-4a74-adf1-a3222cbe35a8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:34.024317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45e883fb-8000-4a74-adf1-a3222cbe35a8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:34.026696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45e883fb-8000-4a74-adf1-a3222cbe35a8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:34.034371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45e883fb-8000-4a74-adf1-a3222cbe35a8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:34.035447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45e883fb-8000-4a74-adf1-a3222cbe35a8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:34.155478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6b52f62a-3fbc-4a27-943b-75bd546d0ce2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:34.185576 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6b52f62a-3fbc-4a27-943b-75bd546d0ce2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1526 microversion: 2.1 time: 1.091419 Sep 10 21:00:34.187549 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1704/3337] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:33 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1526 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:34.192621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bcac61e5-fd4f-462a-86b8-cf3c3fe1d5ba tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:34.198178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bcac61e5-fd4f-462a-86b8-cf3c3fe1d5ba tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:34.217748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcac61e5-fd4f-462a-86b8-cf3c3fe1d5ba tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:34.219568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcac61e5-fd4f-462a-86b8-cf3c3fe1d5ba tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:34.222053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcac61e5-fd4f-462a-86b8-cf3c3fe1d5ba tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:34.228210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcac61e5-fd4f-462a-86b8-cf3c3fe1d5ba tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:34.232843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcac61e5-fd4f-462a-86b8-cf3c3fe1d5ba tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:34.238027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcac61e5-fd4f-462a-86b8-cf3c3fe1d5ba tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:34.994796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bcac61e5-fd4f-462a-86b8-cf3c3fe1d5ba tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:35.015419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bcac61e5-fd4f-462a-86b8-cf3c3fe1d5ba tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1325 microversion: 2.1 time: 0.824670 Sep 10 21:00:35.035311 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1705/3338] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:34 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1325 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:35.049143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2033ea35-9954-4469-ae98-11d92209ac99 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99448d9ca0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:35.493718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:36.741901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:37.592515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-45e883fb-8000-4a74-adf1-a3222cbe35a8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:37.605100 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-45e883fb-8000-4a74-adf1-a3222cbe35a8 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1317 microversion: 2.1 time: 3.655536 Sep 10 21:00:37.612826 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1634/3339] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:33 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1317 bytes in 3664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:37.656300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3270ad7b-ad4a-4908-9b6f-b031170c1ccf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:37.657415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3270ad7b-ad4a-4908-9b6f-b031170c1ccf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:37.689300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3270ad7b-ad4a-4908-9b6f-b031170c1ccf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:37.690156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3270ad7b-ad4a-4908-9b6f-b031170c1ccf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:37.691367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3270ad7b-ad4a-4908-9b6f-b031170c1ccf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:37.692466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3270ad7b-ad4a-4908-9b6f-b031170c1ccf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:37.693093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3270ad7b-ad4a-4908-9b6f-b031170c1ccf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:37.693675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3270ad7b-ad4a-4908-9b6f-b031170c1ccf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:38.199263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3270ad7b-ad4a-4908-9b6f-b031170c1ccf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:38.237614 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3270ad7b-ad4a-4908-9b6f-b031170c1ccf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1278 microversion: 2.1 time: 0.609023 Sep 10 21:00:38.238993 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1635/3340] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:37 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1278 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:38.248165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-152a9d53-77d6-4195-8e94-1a5c9badbb19 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:38.260096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-152a9d53-77d6-4195-8e94-1a5c9badbb19 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:38.273516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-152a9d53-77d6-4195-8e94-1a5c9badbb19 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:38.297488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-152a9d53-77d6-4195-8e94-1a5c9badbb19 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:38.298831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-152a9d53-77d6-4195-8e94-1a5c9badbb19 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:38.299792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-152a9d53-77d6-4195-8e94-1a5c9badbb19 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:38.304177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-152a9d53-77d6-4195-8e94-1a5c9badbb19 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:38.304871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-152a9d53-77d6-4195-8e94-1a5c9badbb19 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:39.274725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-152a9d53-77d6-4195-8e94-1a5c9badbb19 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:39.291951 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-152a9d53-77d6-4195-8e94-1a5c9badbb19 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1315 microversion: 2.1 time: 1.050204 Sep 10 21:00:39.294052 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1636/3341] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:38 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:39.307271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8b733970-4d8f-4381-a98c-5db07a6702ce req-3e19705c-4532-495a-a6e4-86f637539e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7d1492-dc6d-4ddc-ada0-4d492a0916d6", "name": "network-vif-plugged", "status": "completed", "tag": "3e890f01-2c63-4ec8-9b80-da70352321e9"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:39.337156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8b733970-4d8f-4381-a98c-5db07a6702ce req-3e19705c-4532-495a-a6e4-86f637539e31 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:39.337809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8b733970-4d8f-4381-a98c-5db07a6702ce req-3e19705c-4532-495a-a6e4-86f637539e31 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:39.338436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8b733970-4d8f-4381-a98c-5db07a6702ce req-3e19705c-4532-495a-a6e4-86f637539e31 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:39.370218 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8b733970-4d8f-4381-a98c-5db07a6702ce req-3e19705c-4532-495a-a6e4-86f637539e31 service nova] Creating event network-vif-plugged:3e890f01-2c63-4ec8-9b80-da70352321e9 for instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 on nch2-master-1 Sep 10 21:00:39.382947 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8b733970-4d8f-4381-a98c-5db07a6702ce req-3e19705c-4532-495a-a6e4-86f637539e31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083999 Sep 10 21:00:39.384209 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1637/3342] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:39.395659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1af97e14-88e9-44f3-b2b3-8121e4c62b4c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:39.402041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1af97e14-88e9-44f3-b2b3-8121e4c62b4c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:39.427493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1af97e14-88e9-44f3-b2b3-8121e4c62b4c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:39.428482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1af97e14-88e9-44f3-b2b3-8121e4c62b4c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:39.429106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1af97e14-88e9-44f3-b2b3-8121e4c62b4c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:39.430872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1af97e14-88e9-44f3-b2b3-8121e4c62b4c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:39.431504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1af97e14-88e9-44f3-b2b3-8121e4c62b4c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:39.432118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1af97e14-88e9-44f3-b2b3-8121e4c62b4c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:39.697237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1af97e14-88e9-44f3-b2b3-8121e4c62b4c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:39.711095 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1af97e14-88e9-44f3-b2b3-8121e4c62b4c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1526 microversion: 2.1 time: 0.323966 Sep 10 21:00:39.712288 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1638/3343] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:39 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1526 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:39.721914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e54f561-3eef-4cfa-aa04-76402ed7e641 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:39.722813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5e54f561-3eef-4cfa-aa04-76402ed7e641 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:39.730703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e54f561-3eef-4cfa-aa04-76402ed7e641 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:39.731623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e54f561-3eef-4cfa-aa04-76402ed7e641 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:39.732249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e54f561-3eef-4cfa-aa04-76402ed7e641 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:39.733142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e54f561-3eef-4cfa-aa04-76402ed7e641 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:39.733864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e54f561-3eef-4cfa-aa04-76402ed7e641 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:39.734488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e54f561-3eef-4cfa-aa04-76402ed7e641 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:40.115061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5e54f561-3eef-4cfa-aa04-76402ed7e641 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:40.147216 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5e54f561-3eef-4cfa-aa04-76402ed7e641 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1325 microversion: 2.1 time: 0.417107 Sep 10 21:00:40.188804 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1639/3344] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:39 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:40.188804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a20b8271-c843-44c4-a451-9821ac6f691e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:40.188804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a20b8271-c843-44c4-a451-9821ac6f691e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:40.196345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a20b8271-c843-44c4-a451-9821ac6f691e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:40.196859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a20b8271-c843-44c4-a451-9821ac6f691e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:40.199405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a20b8271-c843-44c4-a451-9821ac6f691e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:40.202076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a20b8271-c843-44c4-a451-9821ac6f691e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:40.203742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a20b8271-c843-44c4-a451-9821ac6f691e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:40.204227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a20b8271-c843-44c4-a451-9821ac6f691e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:40.436065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a20b8271-c843-44c4-a451-9821ac6f691e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:40.447783 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a20b8271-c843-44c4-a451-9821ac6f691e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1317 microversion: 2.1 time: 0.287494 Sep 10 21:00:40.448904 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1640/3345] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:40 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:40.472513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d79bb322-ab60-44ce-b7a5-fb7b1114342e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:40.472513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d79bb322-ab60-44ce-b7a5-fb7b1114342e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:40.481419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d79bb322-ab60-44ce-b7a5-fb7b1114342e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:40.482091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d79bb322-ab60-44ce-b7a5-fb7b1114342e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:40.482552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d79bb322-ab60-44ce-b7a5-fb7b1114342e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:40.483285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d79bb322-ab60-44ce-b7a5-fb7b1114342e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:40.483815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d79bb322-ab60-44ce-b7a5-fb7b1114342e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:40.484254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d79bb322-ab60-44ce-b7a5-fb7b1114342e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:40.602975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d79bb322-ab60-44ce-b7a5-fb7b1114342e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:40.618507 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d79bb322-ab60-44ce-b7a5-fb7b1114342e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1278 microversion: 2.1 time: 0.148700 Sep 10 21:00:40.621503 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1641/3346] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:40 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:40.638725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab52a6f1-f153-4025-963f-4600d82f32b3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:40.640016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ab52a6f1-f153-4025-963f-4600d82f32b3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:40.659254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab52a6f1-f153-4025-963f-4600d82f32b3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:40.659819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab52a6f1-f153-4025-963f-4600d82f32b3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:40.662834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab52a6f1-f153-4025-963f-4600d82f32b3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:40.664788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab52a6f1-f153-4025-963f-4600d82f32b3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:40.666968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab52a6f1-f153-4025-963f-4600d82f32b3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:40.667602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab52a6f1-f153-4025-963f-4600d82f32b3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:41.787862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab52a6f1-f153-4025-963f-4600d82f32b3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:41.813578 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab52a6f1-f153-4025-963f-4600d82f32b3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1315 microversion: 2.1 time: 1.190628 Sep 10 21:00:41.823557 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1642/3347] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:40 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1315 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:41.831843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8698a7c4-05ee-4412-a083-b2ab42f91d87 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:41.842817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8698a7c4-05ee-4412-a083-b2ab42f91d87 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:41.857440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8698a7c4-05ee-4412-a083-b2ab42f91d87 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:41.862441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8698a7c4-05ee-4412-a083-b2ab42f91d87 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:41.863374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8698a7c4-05ee-4412-a083-b2ab42f91d87 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:41.864797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8698a7c4-05ee-4412-a083-b2ab42f91d87 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:41.865547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8698a7c4-05ee-4412-a083-b2ab42f91d87 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:41.866253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8698a7c4-05ee-4412-a083-b2ab42f91d87 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:42.507010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8698a7c4-05ee-4412-a083-b2ab42f91d87 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:42.518731 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8698a7c4-05ee-4412-a083-b2ab42f91d87 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1526 microversion: 2.1 time: 0.691373 Sep 10 21:00:42.529819 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1643/3348] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:41 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1526 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:42.538406 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2033ea35-9954-4469-ae98-11d92209ac99 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 7.501529 Sep 10 21:00:42.539927 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1706/3349] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:35 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 7503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:42.541912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e5b0a45a-fffd-4251-80e6-ca15f6f68e37 req-70b07881-a8c2-4622-86b8-5c66be4a2a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ab7365-3c1e-4122-b234-34076143bce8", "tag": "ffdf3005-b7dc-44e1-8c27-8c4179511d4f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:42.559124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b475da7f-fe2e-4bc6-ae91-6efc260e9d86 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:42.566943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b475da7f-fe2e-4bc6-ae91-6efc260e9d86 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:42.592193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e5b0a45a-fffd-4251-80e6-ca15f6f68e37 req-70b07881-a8c2-4622-86b8-5c66be4a2a4a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:42.593077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e5b0a45a-fffd-4251-80e6-ca15f6f68e37 req-70b07881-a8c2-4622-86b8-5c66be4a2a4a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:42.593753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e5b0a45a-fffd-4251-80e6-ca15f6f68e37 req-70b07881-a8c2-4622-86b8-5c66be4a2a4a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:42.605487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b475da7f-fe2e-4bc6-ae91-6efc260e9d86 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:42.606213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b475da7f-fe2e-4bc6-ae91-6efc260e9d86 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:42.606982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b475da7f-fe2e-4bc6-ae91-6efc260e9d86 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:42.609367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b475da7f-fe2e-4bc6-ae91-6efc260e9d86 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:42.612204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b475da7f-fe2e-4bc6-ae91-6efc260e9d86 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:42.614823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b475da7f-fe2e-4bc6-ae91-6efc260e9d86 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:42.626071 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e5b0a45a-fffd-4251-80e6-ca15f6f68e37 req-70b07881-a8c2-4622-86b8-5c66be4a2a4a service nova] Creating event network-changed:ffdf3005-b7dc-44e1-8c27-8c4179511d4f for instance 16ab7365-3c1e-4122-b234-34076143bce8 on nch1-master-1 Sep 10 21:00:42.634830 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e5b0a45a-fffd-4251-80e6-ca15f6f68e37 req-70b07881-a8c2-4622-86b8-5c66be4a2a4a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103036 Sep 10 21:00:42.636066 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1644/3350] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:42.642183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-ac9bc86b-d9ba-4d99-8461-a7b711ab52d5 req-327c6da8-2e71-4cfd-bb78-9680684e0476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de099be-4894-4f7a-86ac-d56cc4018723", "name": "network-vif-plugged", "status": "completed", "tag": "8cb2bc39-2ddf-4e76-b183-0949c1d2e00e"}, {"server_uuid": "7c645369-3402-414b-bf2c-d82cf4dc75a6", "name": "network-vif-plugged", "status": "completed", "tag": "07767f3c-d5e3-4bdb-9bb4-11b7952111c2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:42.656952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ac9bc86b-d9ba-4d99-8461-a7b711ab52d5 req-327c6da8-2e71-4cfd-bb78-9680684e0476 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:42.658833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ac9bc86b-d9ba-4d99-8461-a7b711ab52d5 req-327c6da8-2e71-4cfd-bb78-9680684e0476 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:42.659583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ac9bc86b-d9ba-4d99-8461-a7b711ab52d5 req-327c6da8-2e71-4cfd-bb78-9680684e0476 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:42.701554 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-ac9bc86b-d9ba-4d99-8461-a7b711ab52d5 req-327c6da8-2e71-4cfd-bb78-9680684e0476 service nova] Creating event network-vif-plugged:8cb2bc39-2ddf-4e76-b183-0949c1d2e00e for instance 5de099be-4894-4f7a-86ac-d56cc4018723 on nch2-master-1 Sep 10 21:00:42.701554 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-ac9bc86b-d9ba-4d99-8461-a7b711ab52d5 req-327c6da8-2e71-4cfd-bb78-9680684e0476 service nova] Creating event network-vif-plugged:07767f3c-d5e3-4bdb-9bb4-11b7952111c2 for instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 on nch2-master-1 Sep 10 21:00:42.709801 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-ac9bc86b-d9ba-4d99-8461-a7b711ab52d5 req-327c6da8-2e71-4cfd-bb78-9680684e0476 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071398 Sep 10 21:00:42.710553 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1645/3351] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:42.718354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-36c716dc-1e47-4ffa-a927-b8403f3b6818 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:42.719068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-36c716dc-1e47-4ffa-a927-b8403f3b6818 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:42.722422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:42.747325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36c716dc-1e47-4ffa-a927-b8403f3b6818 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:42.759383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36c716dc-1e47-4ffa-a927-b8403f3b6818 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:42.760957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36c716dc-1e47-4ffa-a927-b8403f3b6818 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:42.774723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36c716dc-1e47-4ffa-a927-b8403f3b6818 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:42.782121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36c716dc-1e47-4ffa-a927-b8403f3b6818 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:42.784989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36c716dc-1e47-4ffa-a927-b8403f3b6818 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:43.271360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b475da7f-fe2e-4bc6-ae91-6efc260e9d86 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:43.286910 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b475da7f-fe2e-4bc6-ae91-6efc260e9d86 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1325 microversion: 2.1 time: 0.742784 Sep 10 21:00:43.287538 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1707/3352] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:42 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1325 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:43.297096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e24d60c5-6720-4697-a8b1-a95847e495ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:43.300128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e24d60c5-6720-4697-a8b1-a95847e495ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:43.312178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e24d60c5-6720-4697-a8b1-a95847e495ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:43.317505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e24d60c5-6720-4697-a8b1-a95847e495ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:43.318803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e24d60c5-6720-4697-a8b1-a95847e495ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:43.326249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e24d60c5-6720-4697-a8b1-a95847e495ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:43.327022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e24d60c5-6720-4697-a8b1-a95847e495ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:43.327856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e24d60c5-6720-4697-a8b1-a95847e495ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:43.398342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-36c716dc-1e47-4ffa-a927-b8403f3b6818 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:43.407418 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-36c716dc-1e47-4ffa-a927-b8403f3b6818 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1317 microversion: 2.1 time: 0.695652 Sep 10 21:00:43.411838 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1646/3353] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:42 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:43.422866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b31d595b-cabd-41ab-a9f6-7cbed480d979 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:43.425007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b31d595b-cabd-41ab-a9f6-7cbed480d979 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:43.437438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b31d595b-cabd-41ab-a9f6-7cbed480d979 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:43.438381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b31d595b-cabd-41ab-a9f6-7cbed480d979 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:43.439223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b31d595b-cabd-41ab-a9f6-7cbed480d979 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:43.440598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b31d595b-cabd-41ab-a9f6-7cbed480d979 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:43.441374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b31d595b-cabd-41ab-a9f6-7cbed480d979 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:43.442114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b31d595b-cabd-41ab-a9f6-7cbed480d979 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:43.631906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:43.716391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=18 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:43.868921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e24d60c5-6720-4697-a8b1-a95847e495ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:43.878124 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e24d60c5-6720-4697-a8b1-a95847e495ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1320 microversion: 2.1 time: 0.589212 Sep 10 21:00:43.882551 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1708/3354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:43 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1320 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:43.897709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7ba444d1-758d-47bf-9af3-0d56acf08441 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:43.898640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7ba444d1-758d-47bf-9af3-0d56acf08441 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:43.907049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ba444d1-758d-47bf-9af3-0d56acf08441 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:43.912380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ba444d1-758d-47bf-9af3-0d56acf08441 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:43.914482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ba444d1-758d-47bf-9af3-0d56acf08441 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:43.916179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ba444d1-758d-47bf-9af3-0d56acf08441 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:43.926385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ba444d1-758d-47bf-9af3-0d56acf08441 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:43.933027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ba444d1-758d-47bf-9af3-0d56acf08441 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:44.311772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7ba444d1-758d-47bf-9af3-0d56acf08441 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:44.325996 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7ba444d1-758d-47bf-9af3-0d56acf08441 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1508 microversion: 2.1 time: 0.442017 Sep 10 21:00:44.328964 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1709/3355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:43 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1508 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:44.335654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e61fe69d-1ada-4ab0-a26e-424f8070347e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99448af430>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:44.435474 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e61fe69d-1ada-4ab0-a26e-424f8070347e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.103343 Sep 10 21:00:44.441997 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1710/3356] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:44 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:44.448273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3f7a892e-6cb5-4210-971f-aa7e45a181f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:44.449359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3f7a892e-6cb5-4210-971f-aa7e45a181f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:44.456994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f7a892e-6cb5-4210-971f-aa7e45a181f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:44.457807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f7a892e-6cb5-4210-971f-aa7e45a181f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:44.458548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f7a892e-6cb5-4210-971f-aa7e45a181f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:44.459650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f7a892e-6cb5-4210-971f-aa7e45a181f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:44.460325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f7a892e-6cb5-4210-971f-aa7e45a181f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:44.460972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f7a892e-6cb5-4210-971f-aa7e45a181f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:44.636235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b31d595b-cabd-41ab-a9f6-7cbed480d979 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:44.650630 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b31d595b-cabd-41ab-a9f6-7cbed480d979 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1315 microversion: 2.1 time: 1.234240 Sep 10 21:00:44.651165 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1647/3357] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:43 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1315 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:44.683135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23531a82-968f-4d8e-bea6-ce26cc8a7e3a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:44.684330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23531a82-968f-4d8e-bea6-ce26cc8a7e3a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:44.710068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3f7a892e-6cb5-4210-971f-aa7e45a181f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:44.718451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23531a82-968f-4d8e-bea6-ce26cc8a7e3a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:44.718990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23531a82-968f-4d8e-bea6-ce26cc8a7e3a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:44.719444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23531a82-968f-4d8e-bea6-ce26cc8a7e3a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:44.720641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23531a82-968f-4d8e-bea6-ce26cc8a7e3a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:44.722265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23531a82-968f-4d8e-bea6-ce26cc8a7e3a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:44.722876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23531a82-968f-4d8e-bea6-ce26cc8a7e3a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:44.724991 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3f7a892e-6cb5-4210-971f-aa7e45a181f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1325 microversion: 2.1 time: 0.281560 Sep 10 21:00:44.742995 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1711/3358] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:44 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:44.748446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-329fe6e3-6567-4dff-9662-af1bb1623c6a req-733836d8-ba74-4c1f-ac7f-257879c6077b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02503ea6-e924-4967-83ad-59dbfbf3176d", "tag": "1a5c21f2-ced8-4245-a6d6-bfee5a42b09c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:44.760891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-329fe6e3-6567-4dff-9662-af1bb1623c6a req-733836d8-ba74-4c1f-ac7f-257879c6077b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:44.761745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-329fe6e3-6567-4dff-9662-af1bb1623c6a req-733836d8-ba74-4c1f-ac7f-257879c6077b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:44.762834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-329fe6e3-6567-4dff-9662-af1bb1623c6a req-733836d8-ba74-4c1f-ac7f-257879c6077b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:44.785610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-329fe6e3-6567-4dff-9662-af1bb1623c6a req-733836d8-ba74-4c1f-ac7f-257879c6077b service nova] Creating event network-changed:1a5c21f2-ced8-4245-a6d6-bfee5a42b09c for instance 02503ea6-e924-4967-83ad-59dbfbf3176d on nch1-master-1 Sep 10 21:00:44.797415 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-329fe6e3-6567-4dff-9662-af1bb1623c6a req-733836d8-ba74-4c1f-ac7f-257879c6077b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052916 Sep 10 21:00:44.801904 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1712/3359] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:44.909251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-64d8ed3f-812e-40fe-a546-b79b27784c05 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:44.910636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-64d8ed3f-812e-40fe-a546-b79b27784c05 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:44.932661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64d8ed3f-812e-40fe-a546-b79b27784c05 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:44.933493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64d8ed3f-812e-40fe-a546-b79b27784c05 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:44.934149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64d8ed3f-812e-40fe-a546-b79b27784c05 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:44.935088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64d8ed3f-812e-40fe-a546-b79b27784c05 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:44.935718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64d8ed3f-812e-40fe-a546-b79b27784c05 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:44.936344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64d8ed3f-812e-40fe-a546-b79b27784c05 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:45.569803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-64d8ed3f-812e-40fe-a546-b79b27784c05 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:45.582252 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-64d8ed3f-812e-40fe-a546-b79b27784c05 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1320 microversion: 2.1 time: 0.675518 Sep 10 21:00:45.585489 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1713/3360] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:44 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1320 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:45.605403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:45.607092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:45.624368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:45.624884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:45.627641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:45.628474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:45.631184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:45.632740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:45.744767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-23531a82-968f-4d8e-bea6-ce26cc8a7e3a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:45.753858 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23531a82-968f-4d8e-bea6-ce26cc8a7e3a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1317 microversion: 2.1 time: 1.086774 Sep 10 21:00:45.759042 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1648/3361] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:44 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1317 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:45.768305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3c088c9a-2247-43f4-9df1-e033ab2915b5 req-b87cae5c-b0ea-4fe3-8fb5-15b7f9ee9fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c", "tag": "c3d3b4a7-7a79-4daa-9826-80870e8d53e3"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:45.791169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3c088c9a-2247-43f4-9df1-e033ab2915b5 req-b87cae5c-b0ea-4fe3-8fb5-15b7f9ee9fff service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:45.794091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3c088c9a-2247-43f4-9df1-e033ab2915b5 req-b87cae5c-b0ea-4fe3-8fb5-15b7f9ee9fff service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:45.794806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3c088c9a-2247-43f4-9df1-e033ab2915b5 req-b87cae5c-b0ea-4fe3-8fb5-15b7f9ee9fff service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:45.824208 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3c088c9a-2247-43f4-9df1-e033ab2915b5 req-b87cae5c-b0ea-4fe3-8fb5-15b7f9ee9fff service nova] Creating event network-changed:c3d3b4a7-7a79-4daa-9826-80870e8d53e3 for instance c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c on nch1-master-1 Sep 10 21:00:45.841927 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3c088c9a-2247-43f4-9df1-e033ab2915b5 req-b87cae5c-b0ea-4fe3-8fb5-15b7f9ee9fff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077220 Sep 10 21:00:45.842959 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1649/3362] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:45.860135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5484e7e0-3c92-4921-8a35-4be1e45c846b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99495cb430>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:45.941508 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5484e7e0-3c92-4921-8a35-4be1e45c846b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.096723 Sep 10 21:00:45.942790 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1650/3363] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:45 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:45.956414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:45.957465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:45.984022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:45.984528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:45.984966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:45.991335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:45.992228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:45.992901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:46.324002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:46.346105 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1508 microversion: 2.1 time: 0.754063 Sep 10 21:00:46.347104 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1714/3364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:45 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1508 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:46.349472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:46.353868 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-70dcb25b-d1af-40b4-b48c-2a23b4230429 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004137 Sep 10 21:00:46.354705 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1715/3365] 10.222.0.33 () {56 vars in 886 bytes} [Sat Sep 10 21:00:46 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 21:00:46.360297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:46.361284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:46.382923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:46.383428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:46.384023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:46.385000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:46.385461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:46.385968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:46.658999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:46.674778 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1325 microversion: 2.1 time: 0.318704 Sep 10 21:00:46.675704 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1716/3366] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:46 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:46.679512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:46.680799 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2a4a9aa2-9cc6-4fb1-80bc-83a40e2a99a7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001734 Sep 10 21:00:46.682919 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1717/3367] 10.222.0.33 () {54 vars in 1035 bytes} [Sat Sep 10 21:00:46 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 10 21:00:46.692948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0bdf30d-5472-451a-9915-d5d0ea23c38e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:46.699783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0bdf30d-5472-451a-9915-d5d0ea23c38e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:46.710820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0bdf30d-5472-451a-9915-d5d0ea23c38e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:46.711910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0bdf30d-5472-451a-9915-d5d0ea23c38e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:46.714902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0bdf30d-5472-451a-9915-d5d0ea23c38e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:46.715874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0bdf30d-5472-451a-9915-d5d0ea23c38e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:46.717668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0bdf30d-5472-451a-9915-d5d0ea23c38e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:46.719960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0bdf30d-5472-451a-9915-d5d0ea23c38e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:46.731468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:46.743264 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1315 microversion: 2.1 time: 0.796316 Sep 10 21:00:46.744521 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1651/3368] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:45 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:46.749096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:46.750956 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004969 Sep 10 21:00:46.752809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1652/3369] 10.222.0.33 () {54 vars in 1041 bytes} [Sat Sep 10 21:00:46 2022] GET /compute/v2.1/ => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:46.768111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:46.769540 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e87d06d0-d63d-4e28-9e75-8d98a4ba23df tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003034 Sep 10 21:00:46.778455 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1653/3370] 10.222.0.33 () {56 vars in 886 bytes} [Sat Sep 10 21:00:46 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 21:00:46.791961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f174f3a4-a893-4ca7-973b-0715b2072699 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:46.794692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f174f3a4-a893-4ca7-973b-0715b2072699 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:46.810561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f174f3a4-a893-4ca7-973b-0715b2072699 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:46.815936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f174f3a4-a893-4ca7-973b-0715b2072699 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:46.816757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f174f3a4-a893-4ca7-973b-0715b2072699 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:46.817689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f174f3a4-a893-4ca7-973b-0715b2072699 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:46.818343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f174f3a4-a893-4ca7-973b-0715b2072699 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:46.819014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f174f3a4-a893-4ca7-973b-0715b2072699 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:47.908202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0bdf30d-5472-451a-9915-d5d0ea23c38e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:47.922305 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0bdf30d-5472-451a-9915-d5d0ea23c38e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1320 microversion: 2.1 time: 1.234835 Sep 10 21:00:47.923320 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1718/3371] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:46 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1320 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:47.940181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c1a56e25-639c-4ad1-91ce-97fb4d657f02 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99496fa9d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:48.053398 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c1a56e25-639c-4ad1-91ce-97fb4d657f02 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.126738 Sep 10 21:00:48.054030 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1719/3372] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:47 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:48.075267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ff664add-6f6a-40b9-b6c6-9ddf2b567f04 req-7348c231-a3cf-4f46-968b-1d8f83280842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfdc13f-9c2e-44ec-8553-3f779ead89af", "name": "network-vif-unplugged", "status": "completed", "tag": "b18a22e2-b050-417e-bebb-2f9e983473cc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:48.086406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ff664add-6f6a-40b9-b6c6-9ddf2b567f04 req-7348c231-a3cf-4f46-968b-1d8f83280842 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.087192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ff664add-6f6a-40b9-b6c6-9ddf2b567f04 req-7348c231-a3cf-4f46-968b-1d8f83280842 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.087838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ff664add-6f6a-40b9-b6c6-9ddf2b567f04 req-7348c231-a3cf-4f46-968b-1d8f83280842 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.106020 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ff664add-6f6a-40b9-b6c6-9ddf2b567f04 req-7348c231-a3cf-4f46-968b-1d8f83280842 service nova] Creating event network-vif-unplugged:b18a22e2-b050-417e-bebb-2f9e983473cc for instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af on nch2-master-1 Sep 10 21:00:48.112944 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ff664add-6f6a-40b9-b6c6-9ddf2b567f04 req-7348c231-a3cf-4f46-968b-1d8f83280842 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043631 Sep 10 21:00:48.114089 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1720/3373] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:48.120932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2271bd00-e231-42fc-911e-9a1b54efca48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:48.122344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2271bd00-e231-42fc-911e-9a1b54efca48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:48.141564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271bd00-e231-42fc-911e-9a1b54efca48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.142582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271bd00-e231-42fc-911e-9a1b54efca48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.143049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271bd00-e231-42fc-911e-9a1b54efca48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.143779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271bd00-e231-42fc-911e-9a1b54efca48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.144244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271bd00-e231-42fc-911e-9a1b54efca48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.150449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271bd00-e231-42fc-911e-9a1b54efca48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.383069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2271bd00-e231-42fc-911e-9a1b54efca48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:48.394289 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2271bd00-e231-42fc-911e-9a1b54efca48 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1511 microversion: 2.1 time: 0.278058 Sep 10 21:00:48.395405 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1721/3374] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:48 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:48.400827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-de421beb-812e-410c-bc49-88b79e1e68a6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:48.401657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de421beb-812e-410c-bc49-88b79e1e68a6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:48.409227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de421beb-812e-410c-bc49-88b79e1e68a6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.410096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de421beb-812e-410c-bc49-88b79e1e68a6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.410788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de421beb-812e-410c-bc49-88b79e1e68a6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.411775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de421beb-812e-410c-bc49-88b79e1e68a6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.412438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de421beb-812e-410c-bc49-88b79e1e68a6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.413167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de421beb-812e-410c-bc49-88b79e1e68a6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.445960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f174f3a4-a893-4ca7-973b-0715b2072699 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:48.463969 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f174f3a4-a893-4ca7-973b-0715b2072699 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1317 microversion: 2.1 time: 1.681399 Sep 10 21:00:48.467493 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1654/3375] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:46 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1317 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:48.479377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c462b29-d873-4846-b4a5-c17347eb569c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:48.498894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4c462b29-d873-4846-b4a5-c17347eb569c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:48.515186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c462b29-d873-4846-b4a5-c17347eb569c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.516098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c462b29-d873-4846-b4a5-c17347eb569c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.516754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c462b29-d873-4846-b4a5-c17347eb569c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.518303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c462b29-d873-4846-b4a5-c17347eb569c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.520079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c462b29-d873-4846-b4a5-c17347eb569c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.520769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c462b29-d873-4846-b4a5-c17347eb569c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.665380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de421beb-812e-410c-bc49-88b79e1e68a6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:48.674983 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-de421beb-812e-410c-bc49-88b79e1e68a6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1522 microversion: 2.1 time: 0.277950 Sep 10 21:00:48.676224 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1722/3376] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:48 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:48.680898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-59782639-7c1d-45bb-b61f-fa35f3c155c7 req-9760f9ac-8e41-466e-a8b0-8da5d2b1116d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1767a7-4ae2-46ca-a241-b7749ee7a56d", "tag": "8a1eafca-defa-4ca8-b70a-ad4397817ea7"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:48.691485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-59782639-7c1d-45bb-b61f-fa35f3c155c7 req-9760f9ac-8e41-466e-a8b0-8da5d2b1116d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.692059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-59782639-7c1d-45bb-b61f-fa35f3c155c7 req-9760f9ac-8e41-466e-a8b0-8da5d2b1116d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.696192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-59782639-7c1d-45bb-b61f-fa35f3c155c7 req-9760f9ac-8e41-466e-a8b0-8da5d2b1116d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.715185 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-59782639-7c1d-45bb-b61f-fa35f3c155c7 req-9760f9ac-8e41-466e-a8b0-8da5d2b1116d service nova] Creating event network-changed:8a1eafca-defa-4ca8-b70a-ad4397817ea7 for instance 1d1767a7-4ae2-46ca-a241-b7749ee7a56d on nch2-master-1 Sep 10 21:00:48.721245 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-59782639-7c1d-45bb-b61f-fa35f3c155c7 req-9760f9ac-8e41-466e-a8b0-8da5d2b1116d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042662 Sep 10 21:00:48.722272 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1723/3377] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:48.727732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fabc6e29-13f0-4c38-a588-8a0bd8fde677 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:48.728720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fabc6e29-13f0-4c38-a588-8a0bd8fde677 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:48.747373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fabc6e29-13f0-4c38-a588-8a0bd8fde677 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.747933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fabc6e29-13f0-4c38-a588-8a0bd8fde677 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.748371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fabc6e29-13f0-4c38-a588-8a0bd8fde677 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.750298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fabc6e29-13f0-4c38-a588-8a0bd8fde677 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.750948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fabc6e29-13f0-4c38-a588-8a0bd8fde677 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.752579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fabc6e29-13f0-4c38-a588-8a0bd8fde677 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.914923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fabc6e29-13f0-4c38-a588-8a0bd8fde677 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:48.923884 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fabc6e29-13f0-4c38-a588-8a0bd8fde677 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1511 microversion: 2.1 time: 0.199919 Sep 10 21:00:48.929051 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1724/3378] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:48 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:48.935594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4c462b29-d873-4846-b4a5-c17347eb569c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:48.939405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:48.940063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f1a1d72d-7821-4412-9d9e-338e122b15a1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:48.945040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f1a1d72d-7821-4412-9d9e-338e122b15a1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:48.949146 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c462b29-d873-4846-b4a5-c17347eb569c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1315 microversion: 2.1 time: 0.479925 Sep 10 21:00:48.958801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1a1d72d-7821-4412-9d9e-338e122b15a1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.959297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1a1d72d-7821-4412-9d9e-338e122b15a1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.959733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1a1d72d-7821-4412-9d9e-338e122b15a1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.961753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1a1d72d-7821-4412-9d9e-338e122b15a1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:48.962249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1a1d72d-7821-4412-9d9e-338e122b15a1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:48.962830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1a1d72d-7821-4412-9d9e-338e122b15a1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:48.980360 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1655/3379] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:48 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:48.990403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e718a4e-e243-4ce0-ba5e-dab3d9b4088f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:48.992155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:49.001159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e718a4e-e243-4ce0-ba5e-dab3d9b4088f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:49.019975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e718a4e-e243-4ce0-ba5e-dab3d9b4088f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:49.020557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e718a4e-e243-4ce0-ba5e-dab3d9b4088f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:49.020998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e718a4e-e243-4ce0-ba5e-dab3d9b4088f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:49.021779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e718a4e-e243-4ce0-ba5e-dab3d9b4088f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:49.022277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e718a4e-e243-4ce0-ba5e-dab3d9b4088f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:49.022715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e718a4e-e243-4ce0-ba5e-dab3d9b4088f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:49.157871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f1a1d72d-7821-4412-9d9e-338e122b15a1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:49.172614 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f1a1d72d-7821-4412-9d9e-338e122b15a1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1522 microversion: 2.1 time: 0.241818 Sep 10 21:00:49.175398 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1725/3380] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:48 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:49.182524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:49.183584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:49.192186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:49.193420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:49.194140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:49.195248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:49.195876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:49.196462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:49.256930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lazy-loading 'flavor' on Instance uuid 2bfdc13f-9c2e-44ec-8553-3f779ead89af {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:00:49.285978 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Cannot 'shelve' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state shelved_offloaded Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action HTTP/1.1 Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 14 Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: {"shelve": {}} Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: exception: Cannot 'shelve' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state shelved_offloaded Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2bfdc13f-9c2e-44ec-8553-3f779ead89af', 'body': {'shelve': {}}} Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 21:00:49.291874 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state shelved_offloaded Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state shelved_offloaded Sep 10 21:00:49.296462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:49.298917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 409 to user: Cannot 'shelve' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state shelved_offloaded {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:00:49.300261 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0b5c8882-8cbe-46b3-9330-f7966c026b53 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 409 len: 155 microversion: 2.1 time: 0.123167 Sep 10 21:00:49.307431 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1726/3381] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:00:49 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 155 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 21:00:49.319208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9d740fcf-6a1f-41d4-b05c-d953586ec781 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99448d9040>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:49.394000 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9d740fcf-6a1f-41d4-b05c-d953586ec781 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.082828 Sep 10 21:00:49.414820 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1727/3382] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:49 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:49.414820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a82d2124-a9c7-4d1e-8587-182fcfc7aacc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-186291085"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:49.425306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a82d2124-a9c7-4d1e-8587-182fcfc7aacc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:49.441664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a82d2124-a9c7-4d1e-8587-182fcfc7aacc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:49.442186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a82d2124-a9c7-4d1e-8587-182fcfc7aacc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:49.442628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a82d2124-a9c7-4d1e-8587-182fcfc7aacc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:49.443335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a82d2124-a9c7-4d1e-8587-182fcfc7aacc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:49.443787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a82d2124-a9c7-4d1e-8587-182fcfc7aacc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:49.444212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a82d2124-a9c7-4d1e-8587-182fcfc7aacc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:49.725794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e718a4e-e243-4ce0-ba5e-dab3d9b4088f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:49.736431 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e718a4e-e243-4ce0-ba5e-dab3d9b4088f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1320 microversion: 2.1 time: 0.753871 Sep 10 21:00:49.761000 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1656/3383] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:48 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1320 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:49.779223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-284b34f1-b1ce-4599-9463-67be5bef059f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:49.780085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-284b34f1-b1ce-4599-9463-67be5bef059f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:49.794928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284b34f1-b1ce-4599-9463-67be5bef059f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:49.795419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284b34f1-b1ce-4599-9463-67be5bef059f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:49.804027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284b34f1-b1ce-4599-9463-67be5bef059f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:49.805050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284b34f1-b1ce-4599-9463-67be5bef059f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:49.806018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284b34f1-b1ce-4599-9463-67be5bef059f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:49.806629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284b34f1-b1ce-4599-9463-67be5bef059f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:49.876361 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a82d2124-a9c7-4d1e-8587-182fcfc7aacc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "POST /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6/action" status: 202 len: 0 microversion: 2.1 time: 0.468150 Sep 10 21:00:49.902169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-284b34f1-b1ce-4599-9463-67be5bef059f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=145771) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 21:00:49.911498 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1728/3384] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:00:49 2022] POST /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 21:00:49.934157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-80468189-a368-4adf-b292-e0ac0ae43f8e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:49.935649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-80468189-a368-4adf-b292-e0ac0ae43f8e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:49.961494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80468189-a368-4adf-b292-e0ac0ae43f8e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:49.962449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80468189-a368-4adf-b292-e0ac0ae43f8e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:49.962916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80468189-a368-4adf-b292-e0ac0ae43f8e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:49.965225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80468189-a368-4adf-b292-e0ac0ae43f8e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:49.965714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80468189-a368-4adf-b292-e0ac0ae43f8e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:49.966229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80468189-a368-4adf-b292-e0ac0ae43f8e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:50.083280 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-284b34f1-b1ce-4599-9463-67be5bef059f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 202 len: 0 microversion: 2.1 time: 0.319377 Sep 10 21:00:50.084235 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1657/3385] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:00:49 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:00:50.089017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7441e101-a21b-45fc-9c2e-5c963fc370cc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '.version_select at 0x7f99495cb5e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:50.199917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-80468189-a368-4adf-b292-e0ac0ae43f8e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:50.210740 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-80468189-a368-4adf-b292-e0ac0ae43f8e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1466 microversion: 2.1 time: 0.296036 Sep 10 21:00:50.214821 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1729/3386] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:49 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1466 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:50.219873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f95f38ac-8f1a-4877-ba9f-c8dbe8203d1a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:50.222829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f95f38ac-8f1a-4877-ba9f-c8dbe8203d1a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:50.233949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f95f38ac-8f1a-4877-ba9f-c8dbe8203d1a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:50.240122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f95f38ac-8f1a-4877-ba9f-c8dbe8203d1a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:50.240988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f95f38ac-8f1a-4877-ba9f-c8dbe8203d1a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:50.242887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f95f38ac-8f1a-4877-ba9f-c8dbe8203d1a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:50.243528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f95f38ac-8f1a-4877-ba9f-c8dbe8203d1a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:50.245106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f95f38ac-8f1a-4877-ba9f-c8dbe8203d1a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:50.323905 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7441e101-a21b-45fc-9c2e-5c963fc370cc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "DELETE /compute/v2.1/images/118c817d-c8d5-4010-9140-68fe92f9db71" status: 204 len: 0 microversion: 2.1 time: 0.238170 Sep 10 21:00:50.324502 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1658/3387] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:50 2022] DELETE /compute/v2.1/images/118c817d-c8d5-4010-9140-68fe92f9db71 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:00:50.331652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb469700-a313-4a07-a238-010ab8bdde45 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Action: 'create', calling method: .version_select at 0x7f99495b3e50>, body: {"keypair": {"name": "tempest-keypair-997383356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjgyYk0ChqzVg4B6Xn4+FwL0pTmZfD2BCezfR7MQhN/U0YFfa5BG0yhLmI7lD7Je/ytNDSAfbjzokiRvmO1V42QhASbL2wbdOkzZBPqXuUik3CLW+zFH+rRCAVokcAJJg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:50.349552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-fb469700-a313-4a07-a238-010ab8bdde45 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Getting quotas for project d696ed7cdc3945b78d638693a83ac081. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:00:50.357898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-fb469700-a313-4a07-a238-010ab8bdde45 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Getting quotas for user d57829f24d3841eb9c1d6f5c6a5ea7ee and project d696ed7cdc3945b78d638693a83ac081. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:00:50.407146 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fb469700-a313-4a07-a238-010ab8bdde45 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.076302 Sep 10 21:00:50.409685 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1659/3388] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Sep 10 21:00:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 21:00:50.417132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-31b5f7bf-c0f5-4dd3-a70e-86a4a449d16d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:50.417978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-31b5f7bf-c0f5-4dd3-a70e-86a4a449d16d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:50.426345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31b5f7bf-c0f5-4dd3-a70e-86a4a449d16d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:50.427294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31b5f7bf-c0f5-4dd3-a70e-86a4a449d16d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:50.427901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31b5f7bf-c0f5-4dd3-a70e-86a4a449d16d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:50.428994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31b5f7bf-c0f5-4dd3-a70e-86a4a449d16d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:50.429644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31b5f7bf-c0f5-4dd3-a70e-86a4a449d16d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:50.430302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31b5f7bf-c0f5-4dd3-a70e-86a4a449d16d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:50.496182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f95f38ac-8f1a-4877-ba9f-c8dbe8203d1a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:50.506939 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f95f38ac-8f1a-4877-ba9f-c8dbe8203d1a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1315 microversion: 2.1 time: 0.290838 Sep 10 21:00:50.507830 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1730/3389] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:50 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:50.513650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-60792974-f705-4a70-899e-85334bcb2ab8 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:50.516698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-60792974-f705-4a70-899e-85334bcb2ab8 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:50.526406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60792974-f705-4a70-899e-85334bcb2ab8 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:50.527402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60792974-f705-4a70-899e-85334bcb2ab8 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:50.528263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60792974-f705-4a70-899e-85334bcb2ab8 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:50.529346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60792974-f705-4a70-899e-85334bcb2ab8 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:50.530311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60792974-f705-4a70-899e-85334bcb2ab8 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:50.530957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60792974-f705-4a70-899e-85334bcb2ab8 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:50.843276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-31b5f7bf-c0f5-4dd3-a70e-86a4a449d16d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:50.868426 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-31b5f7bf-c0f5-4dd3-a70e-86a4a449d16d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1459 microversion: 2.1 time: 0.457231 Sep 10 21:00:50.871113 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1660/3390] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:50 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1459 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:50.876103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19329e99-65b5-47ca-9e24-ce267e2d95f6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '.version_select at 0x7f99495f1310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:50.992568 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-19329e99-65b5-47ca-9e24-ce267e2d95f6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Image not found. Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19329e99-65b5-47ca-9e24-ce267e2d95f6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/images/118c817d-c8d5-4010-9140-68fe92f9db71 HTTP/1.1 Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: exception: Image not found. Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '118c817d-c8d5-4010-9140-68fe92f9db71'} Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 118c817d-c8d5-4010-9140-68fe92f9db71 Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 21:00:50.994700 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 118c817d-c8d5-4010-9140-68fe92f9db71 could not be found. Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19329e99-65b5-47ca-9e24-ce267e2d95f6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 404 to user: Image not found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:00:50.998923 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-19329e99-65b5-47ca-9e24-ce267e2d95f6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/images/118c817d-c8d5-4010-9140-68fe92f9db71" status: 404 len: 62 microversion: 2.1 time: 0.123835 Sep 10 21:00:51.003563 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1661/3391] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:50 2022] GET /compute/v2.1/images/118c817d-c8d5-4010-9140-68fe92f9db71 => generated 62 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 21:00:51.005030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3e373a4b-af3f-4f9e-b656-93e87ed977a1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99495b3a60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:51.121676 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3e373a4b-af3f-4f9e-b656-93e87ed977a1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.120678 Sep 10 21:00:51.122559 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1662/3392] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:50 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:51.145154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae5296c0-5c20-4a28-a3e4-bae606c8b381 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:51.145872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ae5296c0-5c20-4a28-a3e4-bae606c8b381 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:51.154659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5296c0-5c20-4a28-a3e4-bae606c8b381 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:51.155661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5296c0-5c20-4a28-a3e4-bae606c8b381 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:51.158858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5296c0-5c20-4a28-a3e4-bae606c8b381 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:51.160656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5296c0-5c20-4a28-a3e4-bae606c8b381 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:51.161528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5296c0-5c20-4a28-a3e4-bae606c8b381 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:51.162517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5296c0-5c20-4a28-a3e4-bae606c8b381 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:51.250865 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-60792974-f705-4a70-899e-85334bcb2ab8 tempest-ServersOnMultiNodesTest-1036696206 tempest-ServersOnMultiNodesTest-1036696206-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1617 microversion: 2.1 time: 0.741032 Sep 10 21:00:51.253791 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1731/3393] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:50 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1617 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:51.348879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0bc127b6-ee3f-4f3e-b12b-8b539b7bf174 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] Action: 'create', calling method: .version_select at 0x7f994493b3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-432092589", "metadata": {"Type": "work"}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:51.477463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae5296c0-5c20-4a28-a3e4-bae606c8b381 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:51.487298 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae5296c0-5c20-4a28-a3e4-bae606c8b381 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1320 microversion: 2.1 time: 0.355258 Sep 10 21:00:51.488246 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1663/3394] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:51 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:51.494858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a1772ca2-421b-4c86-a443-e43a384d0fd6 req-7056af41-0599-42b2-b2d8-6d5f7c8bb2cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ab7365-3c1e-4122-b234-34076143bce8", "name": "network-vif-plugged", "status": "completed", "tag": "ffdf3005-b7dc-44e1-8c27-8c4179511d4f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:51.513571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a1772ca2-421b-4c86-a443-e43a384d0fd6 req-7056af41-0599-42b2-b2d8-6d5f7c8bb2cd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:51.514523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a1772ca2-421b-4c86-a443-e43a384d0fd6 req-7056af41-0599-42b2-b2d8-6d5f7c8bb2cd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:51.515226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a1772ca2-421b-4c86-a443-e43a384d0fd6 req-7056af41-0599-42b2-b2d8-6d5f7c8bb2cd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:51.531071 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a1772ca2-421b-4c86-a443-e43a384d0fd6 req-7056af41-0599-42b2-b2d8-6d5f7c8bb2cd service nova] Creating event network-vif-plugged:ffdf3005-b7dc-44e1-8c27-8c4179511d4f for instance 16ab7365-3c1e-4122-b234-34076143bce8 on nch1-master-1 Sep 10 21:00:51.538146 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a1772ca2-421b-4c86-a443-e43a384d0fd6 req-7056af41-0599-42b2-b2d8-6d5f7c8bb2cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048280 Sep 10 21:00:51.539444 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1664/3395] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:51.545683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f16e1e87-aa6f-4e35-8eed-7f7e8ee416f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:51.547561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f16e1e87-aa6f-4e35-8eed-7f7e8ee416f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:51.557600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16e1e87-aa6f-4e35-8eed-7f7e8ee416f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:51.559082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16e1e87-aa6f-4e35-8eed-7f7e8ee416f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:51.559769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16e1e87-aa6f-4e35-8eed-7f7e8ee416f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:51.560716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16e1e87-aa6f-4e35-8eed-7f7e8ee416f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:51.561397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16e1e87-aa6f-4e35-8eed-7f7e8ee416f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:51.562096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f16e1e87-aa6f-4e35-8eed-7f7e8ee416f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:52.012523 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0bc127b6-ee3f-4f3e-b12b-8b539b7bf174 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.757384 Sep 10 21:00:52.013898 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1732/3396] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Sep 10 21:00:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 759 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 10 21:00:52.020815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-327f231f-bed8-4bfd-838e-8c972e086a87 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:52.024253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-327f231f-bed8-4bfd-838e-8c972e086a87 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:52.055949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-327f231f-bed8-4bfd-838e-8c972e086a87 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:52.056556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-327f231f-bed8-4bfd-838e-8c972e086a87 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:52.057038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-327f231f-bed8-4bfd-838e-8c972e086a87 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:52.057878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-327f231f-bed8-4bfd-838e-8c972e086a87 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:52.058331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-327f231f-bed8-4bfd-838e-8c972e086a87 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:52.058767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-327f231f-bed8-4bfd-838e-8c972e086a87 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:52.139702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-327f231f-bed8-4bfd-838e-8c972e086a87 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:00:52.364346 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-327f231f-bed8-4bfd-838e-8c972e086a87 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 204 len: 0 microversion: 2.1 time: 0.347060 Sep 10 21:00:52.367881 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1733/3397] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:00:52 2022] DELETE /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:00:52.373937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f38b3660-4b45-440b-aad6-09b5726d996d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:52.379565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f38b3660-4b45-440b-aad6-09b5726d996d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:52.390362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f38b3660-4b45-440b-aad6-09b5726d996d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:52.391773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f38b3660-4b45-440b-aad6-09b5726d996d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:52.392489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f38b3660-4b45-440b-aad6-09b5726d996d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:52.393465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f38b3660-4b45-440b-aad6-09b5726d996d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:52.394255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f38b3660-4b45-440b-aad6-09b5726d996d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:52.394881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f38b3660-4b45-440b-aad6-09b5726d996d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:52.604049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f16e1e87-aa6f-4e35-8eed-7f7e8ee416f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:52.624461 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f16e1e87-aa6f-4e35-8eed-7f7e8ee416f3 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1534 microversion: 2.1 time: 1.083134 Sep 10 21:00:52.627267 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1665/3398] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:51 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1534 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:52.660185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f14a42be-3635-47df-b078-09ca6b454c97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:52.663062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f14a42be-3635-47df-b078-09ca6b454c97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:52.692391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f14a42be-3635-47df-b078-09ca6b454c97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:52.692977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f14a42be-3635-47df-b078-09ca6b454c97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:52.693437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f14a42be-3635-47df-b078-09ca6b454c97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:52.698646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f14a42be-3635-47df-b078-09ca6b454c97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:52.700226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f14a42be-3635-47df-b078-09ca6b454c97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:52.700674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f14a42be-3635-47df-b078-09ca6b454c97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:52.850178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f38b3660-4b45-440b-aad6-09b5726d996d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:52.860209 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f38b3660-4b45-440b-aad6-09b5726d996d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1315 microversion: 2.1 time: 0.490333 Sep 10 21:00:52.870361 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1734/3399] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:52 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:52.883019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ccd5dafb-bf90-4bd1-b324-9e307931ac17 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] Calling method '.version_select at 0x7f99496c8700>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:53.013097 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ccd5dafb-bf90-4bd1-b324-9e307931ac17 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710" status: 200 len: 346 microversion: 2.1 time: 0.141131 Sep 10 21:00:53.014134 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1735/3400] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:00:52 2022] GET /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710 => generated 346 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:53.027586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-89c3e42f-fc3d-46f1-98d8-eef13c0d312a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99448c8b80>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:53.028167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f14a42be-3635-47df-b078-09ca6b454c97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:53.041376 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f14a42be-3635-47df-b078-09ca6b454c97 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1459 microversion: 2.1 time: 0.409420 Sep 10 21:00:53.054764 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1666/3401] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:52 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1459 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:53.065371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f9b87f4-1c06-42f1-b025-31d4f7870c43 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:53.066087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f9b87f4-1c06-42f1-b025-31d4f7870c43 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:53.075078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f9b87f4-1c06-42f1-b025-31d4f7870c43 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:53.075732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f9b87f4-1c06-42f1-b025-31d4f7870c43 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:53.076178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f9b87f4-1c06-42f1-b025-31d4f7870c43 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:53.077086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f9b87f4-1c06-42f1-b025-31d4f7870c43 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:53.077784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f9b87f4-1c06-42f1-b025-31d4f7870c43 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:53.078460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f9b87f4-1c06-42f1-b025-31d4f7870c43 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:53.100492 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-89c3e42f-fc3d-46f1-98d8-eef13c0d312a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.076932 Sep 10 21:00:53.103342 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1736/3402] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:53 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:53.110489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5a2d9cc0-4fd1-4194-9cbe-61eb721c4c84 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:53.114709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a2d9cc0-4fd1-4194-9cbe-61eb721c4c84 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:53.128652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a2d9cc0-4fd1-4194-9cbe-61eb721c4c84 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:53.131543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a2d9cc0-4fd1-4194-9cbe-61eb721c4c84 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:53.133983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a2d9cc0-4fd1-4194-9cbe-61eb721c4c84 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:53.134860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a2d9cc0-4fd1-4194-9cbe-61eb721c4c84 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:53.137343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a2d9cc0-4fd1-4194-9cbe-61eb721c4c84 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:53.138096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a2d9cc0-4fd1-4194-9cbe-61eb721c4c84 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:53.292527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f9b87f4-1c06-42f1-b025-31d4f7870c43 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:53.308279 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f9b87f4-1c06-42f1-b025-31d4f7870c43 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1472 microversion: 2.1 time: 0.251382 Sep 10 21:00:53.309274 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1667/3403] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:53 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1472 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:53.322379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-57a64b2a-0820-40f4-9ab6-e8db576f8906 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] Calling method '.version_select at 0x7f99495f13a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:53.438309 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-57a64b2a-0820-40f4-9ab6-e8db576f8906 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710" status: 200 len: 346 microversion: 2.1 time: 0.127592 Sep 10 21:00:53.452256 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1668/3404] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:00:53 2022] GET /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710 => generated 346 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:53.458997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79c380c0-c9c1-4b9d-94ad-decf4f6fe7c0 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] Calling method '.version_select at 0x7f994590f310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:53.556321 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-79c380c0-c9c1-4b9d-94ad-decf4f6fe7c0 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710" status: 202 len: 0 microversion: 2.1 time: 0.102312 Sep 10 21:00:53.556932 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1669/3405] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:00:53 2022] DELETE /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:00:53.567075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-47ad33dd-42bc-4e6a-9e16-744a60d13446 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] Calling method '.version_select at 0x7f9944d73790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:53.696133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5a2d9cc0-4fd1-4194-9cbe-61eb721c4c84 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:53.709401 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5a2d9cc0-4fd1-4194-9cbe-61eb721c4c84 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1320 microversion: 2.1 time: 0.604837 Sep 10 21:00:53.714535 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-47ad33dd-42bc-4e6a-9e16-744a60d13446 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710" status: 200 len: 345 microversion: 2.1 time: 0.152754 Sep 10 21:00:53.718243 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1670/3406] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:00:53 2022] GET /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710 => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:53.733624 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1737/3407] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:53 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1320 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:53.740004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4bb328a5-6a37-4146-a792-36185e25932d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:53.742173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4bb328a5-6a37-4146-a792-36185e25932d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:53.774481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb328a5-6a37-4146-a792-36185e25932d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:53.775005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb328a5-6a37-4146-a792-36185e25932d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:53.778882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb328a5-6a37-4146-a792-36185e25932d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:53.783327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb328a5-6a37-4146-a792-36185e25932d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:53.786159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb328a5-6a37-4146-a792-36185e25932d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:53.786834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4bb328a5-6a37-4146-a792-36185e25932d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:53.900789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-41f9bd4c-d464-4326-9a39-684c15717c9a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:53.902523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-41f9bd4c-d464-4326-9a39-684c15717c9a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:53.937026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f9bd4c-d464-4326-9a39-684c15717c9a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:53.947698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f9bd4c-d464-4326-9a39-684c15717c9a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:53.950522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f9bd4c-d464-4326-9a39-684c15717c9a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:53.953666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f9bd4c-d464-4326-9a39-684c15717c9a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:53.957376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f9bd4c-d464-4326-9a39-684c15717c9a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:53.958248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f9bd4c-d464-4326-9a39-684c15717c9a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:54.577235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-41f9bd4c-d464-4326-9a39-684c15717c9a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:54.593306 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-41f9bd4c-d464-4326-9a39-684c15717c9a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1315 microversion: 2.1 time: 0.698100 Sep 10 21:00:54.612215 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1738/3408] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:53 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:00:54.618844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b5f999fe-86f2-42aa-9fcd-37da4aabaea4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:54.619699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b5f999fe-86f2-42aa-9fcd-37da4aabaea4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:54.626891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:54.629080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5f999fe-86f2-42aa-9fcd-37da4aabaea4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:54.629777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5f999fe-86f2-42aa-9fcd-37da4aabaea4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:54.630244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5f999fe-86f2-42aa-9fcd-37da4aabaea4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:54.631177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5f999fe-86f2-42aa-9fcd-37da4aabaea4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:54.632022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5f999fe-86f2-42aa-9fcd-37da4aabaea4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:54.632484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b5f999fe-86f2-42aa-9fcd-37da4aabaea4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:54.756012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4bb328a5-6a37-4146-a792-36185e25932d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:54.764603 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4bb328a5-6a37-4146-a792-36185e25932d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1540 microversion: 2.1 time: 1.032282 Sep 10 21:00:54.782150 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1671/3409] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:53 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1540 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:54.789280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2283aca7-2fe7-4e32-ab27-b98675dd6e1a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99450e7e50>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:54.856906 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2283aca7-2fe7-4e32-ab27-b98675dd6e1a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.071038 Sep 10 21:00:54.857739 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1672/3410] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:54 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:54.868327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-727c7231-b10a-4585-accf-8ff98f5d9f54 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:54.869755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-727c7231-b10a-4585-accf-8ff98f5d9f54 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:54.875800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b5f999fe-86f2-42aa-9fcd-37da4aabaea4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:54.887991 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b5f999fe-86f2-42aa-9fcd-37da4aabaea4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.274582 Sep 10 21:00:54.895096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727c7231-b10a-4585-accf-8ff98f5d9f54 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:54.895886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727c7231-b10a-4585-accf-8ff98f5d9f54 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:54.896477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727c7231-b10a-4585-accf-8ff98f5d9f54 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:54.897338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727c7231-b10a-4585-accf-8ff98f5d9f54 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:54.897975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727c7231-b10a-4585-accf-8ff98f5d9f54 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:54.898556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-727c7231-b10a-4585-accf-8ff98f5d9f54 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:54.899232 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1739/3411] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:54 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:54.913043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aea128db-b871-43e7-a451-7f5a4e1c2b18 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] Calling method '.version_select at 0x7f994493b1f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:54.946210 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-aea128db-b871-43e7-a451-7f5a4e1c2b18 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] HTTP exception thrown: Volume d41c4359-99fb-44e5-80c9-08951beb3710 could not be found. Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aea128db-b871-43e7-a451-7f5a4e1c2b18 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] Request method failure captured: Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710 HTTP/1.1 Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPsC7ZEb2-f0TEduM7UQcCSzmtrHMEoFnSyWwXrYFEcI_rUhFWcoqAjak5FIE2aE2s3ZN13fa38RuToJzEuDQEsqogSEPrgKK_yUJkOkrVn0lRE6wi4tx9KM3WfSQHfoai3xwYhFEzefXKc5qadkaIr-F4gQHsuTXcIPRS7pfCfatUs Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 7f98b25814e941e09751a589f04e2a1f Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesGetTestJSON-238386738 Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7f98b25814e941e09751a589f04e2a1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7f98b25814e941e09751a589f04e2a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7f98b25814e941e09751a589f04e2a1f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7f98b25814e941e09751a589f04e2a1f"}]}] Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesGetTestJSON-238386738 Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 7f98b25814e941e09751a589f04e2a1f Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesGetTestJSON-238386738 Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesGetTestJSON-238386738-project Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: efa76aa7f26c4d3ca239b31bd5e63fe4 Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesGetTestJSON-238386738-project Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: exception: Volume d41c4359-99fb-44e5-80c9-08951beb3710 could not be found. Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'd41c4359-99fb-44e5-80c9-08951beb3710'} Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d41c4359-99fb-44e5-80c9-08951beb3710 could not be found. (HTTP 404) (Request-ID: req-3c943e90-5a27-4b61-bd79-a8d631f084b5) Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 21:00:54.951033 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d41c4359-99fb-44e5-80c9-08951beb3710 could not be found. Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d41c4359-99fb-44e5-80c9-08951beb3710 could not be found. Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d41c4359-99fb-44e5-80c9-08951beb3710 could not be found. Sep 10 21:00:54.957683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:54.963380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aea128db-b871-43e7-a451-7f5a4e1c2b18 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] Returning 404 to user: Volume d41c4359-99fb-44e5-80c9-08951beb3710 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:00:54.965071 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aea128db-b871-43e7-a451-7f5a4e1c2b18 tempest-VolumesGetTestJSON-238386738 tempest-VolumesGetTestJSON-238386738-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710" status: 404 len: 109 microversion: 2.1 time: 0.064779 Sep 10 21:00:54.965901 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1740/3412] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:00:54 2022] GET /compute/v2.1/os-volumes/d41c4359-99fb-44e5-80c9-08951beb3710 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:00:54.972953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9b774dce-85d0-48a8-9d05-13c34f6ae167 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:54.974024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9b774dce-85d0-48a8-9d05-13c34f6ae167 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:54.981104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b774dce-85d0-48a8-9d05-13c34f6ae167 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:54.982154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b774dce-85d0-48a8-9d05-13c34f6ae167 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:54.982755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b774dce-85d0-48a8-9d05-13c34f6ae167 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:54.984306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b774dce-85d0-48a8-9d05-13c34f6ae167 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:54.984925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b774dce-85d0-48a8-9d05-13c34f6ae167 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:54.986447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b774dce-85d0-48a8-9d05-13c34f6ae167 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:55.151497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-727c7231-b10a-4585-accf-8ff98f5d9f54 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:55.163255 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-727c7231-b10a-4585-accf-8ff98f5d9f54 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 200 len: 1472 microversion: 2.1 time: 0.303737 Sep 10 21:00:55.164748 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1673/3413] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:54 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 1472 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:55.169738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-505143953", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "bf1e27ee-8a7d-490d-92cf-c5bf3fac5b67"}, {"port": "311db54b-3ded-45c3-aad5-3b61965f2c39", "tag": "port-1"}, {"port": "eb53acdc-dda5-4628-9875-8c05fd7b949f", "tag": "port-2"}, {"uuid": "3375ae2e-05e1-43d6-8284-142dc9304d98", "tag": "net-1"}, {"uuid": "3375ae2e-05e1-43d6-8284-142dc9304d98"}, {"uuid": "e067eb38-35c3-4e14-b352-a9bdefb4c09f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "e067eb38-35c3-4e14-b352-a9bdefb4c09f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "fc54e08d-2879-4351-b746-1f663a04bb09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b260a8c4-96fb-4154-9b43-b680cf39768c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "10353bbd-79be-4a1e-9fda-d83fe49243d8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--614695839"}], "key_name": "tempest-keypair-997383356", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:55.324414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9b774dce-85d0-48a8-9d05-13c34f6ae167 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:55.333260 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9b774dce-85d0-48a8-9d05-13c34f6ae167 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1320 microversion: 2.1 time: 0.365954 Sep 10 21:00:55.340689 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1741/3414] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:54 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:55.401525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a1c75163-23f1-4517-b88d-f3700f45af9d req-6780b43d-cbb0-4955-a2cf-0c40e19df93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de099be-4894-4f7a-86ac-d56cc4018723", "name": "network-vif-deleted", "tag": "8cb2bc39-2ddf-4e76-b183-0949c1d2e00e"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:55.430345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] validate_networks() for [('bf1e27ee-8a7d-490d-92cf-c5bf3fac5b67', None, None, None, None, None), (None, None, '311db54b-3ded-45c3-aad5-3b61965f2c39', None, None, None), (None, None, 'eb53acdc-dda5-4628-9875-8c05fd7b949f', None, None, None), ('3375ae2e-05e1-43d6-8284-142dc9304d98', None, None, None, None, None), ('3375ae2e-05e1-43d6-8284-142dc9304d98', None, None, None, None, None), ('e067eb38-35c3-4e14-b352-a9bdefb4c09f', '10.2.2.100', None, None, None, None), ('e067eb38-35c3-4e14-b352-a9bdefb4c09f', '10.2.2.200', None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:00:55.440525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a1c75163-23f1-4517-b88d-f3700f45af9d req-6780b43d-cbb0-4955-a2cf-0c40e19df93a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:55.441240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a1c75163-23f1-4517-b88d-f3700f45af9d req-6780b43d-cbb0-4955-a2cf-0c40e19df93a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:55.441859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a1c75163-23f1-4517-b88d-f3700f45af9d req-6780b43d-cbb0-4955-a2cf-0c40e19df93a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:55.484602 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a1c75163-23f1-4517-b88d-f3700f45af9d req-6780b43d-cbb0-4955-a2cf-0c40e19df93a service nova] Creating event network-vif-deleted:8cb2bc39-2ddf-4e76-b183-0949c1d2e00e for instance 5de099be-4894-4f7a-86ac-d56cc4018723 on nch2-master-1 Sep 10 21:00:55.512642 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a1c75163-23f1-4517-b88d-f3700f45af9d req-6780b43d-cbb0-4955-a2cf-0c40e19df93a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116795 Sep 10 21:00:55.513969 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1742/3415] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:55.623927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-13993f47-5e71-450b-9c5d-e5ce0e63ce2c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:55.624638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-13993f47-5e71-450b-9c5d-e5ce0e63ce2c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:55.639851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13993f47-5e71-450b-9c5d-e5ce0e63ce2c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:55.640340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13993f47-5e71-450b-9c5d-e5ce0e63ce2c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:55.640964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13993f47-5e71-450b-9c5d-e5ce0e63ce2c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:55.641960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13993f47-5e71-450b-9c5d-e5ce0e63ce2c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:55.642578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13993f47-5e71-450b-9c5d-e5ce0e63ce2c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:55.643734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13993f47-5e71-450b-9c5d-e5ce0e63ce2c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:55.983435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13993f47-5e71-450b-9c5d-e5ce0e63ce2c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:56.002903 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-13993f47-5e71-450b-9c5d-e5ce0e63ce2c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1315 microversion: 2.1 time: 0.383595 Sep 10 21:00:56.017396 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1743/3416] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:55 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:56.017791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cdd86c86-b0f1-4e08-89fc-c31429ae46ec tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:56.018843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cdd86c86-b0f1-4e08-89fc-c31429ae46ec tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:56.036366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdd86c86-b0f1-4e08-89fc-c31429ae46ec tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:56.038203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdd86c86-b0f1-4e08-89fc-c31429ae46ec tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:56.039702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdd86c86-b0f1-4e08-89fc-c31429ae46ec tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:56.044042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdd86c86-b0f1-4e08-89fc-c31429ae46ec tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:56.044789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdd86c86-b0f1-4e08-89fc-c31429ae46ec tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:56.045307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdd86c86-b0f1-4e08-89fc-c31429ae46ec tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:56.659030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cdd86c86-b0f1-4e08-89fc-c31429ae46ec tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:56.661968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:00:56.670108 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cdd86c86-b0f1-4e08-89fc-c31429ae46ec tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1522 microversion: 2.1 time: 0.664259 Sep 10 21:00:56.678053 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1744/3417] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:56 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1522 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:56.691003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-20ac6d89-da30-436a-95d8-f1a89894499a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f994493b550>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:56.822955 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-20ac6d89-da30-436a-95d8-f1a89894499a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.143348 Sep 10 21:00:56.832259 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1745/3418] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:56 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:56.845747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-acb4da8b-a5d7-498a-bf69-84babe160891 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:56.846886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-acb4da8b-a5d7-498a-bf69-84babe160891 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:56.882379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acb4da8b-a5d7-498a-bf69-84babe160891 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:56.882379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acb4da8b-a5d7-498a-bf69-84babe160891 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:56.882379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acb4da8b-a5d7-498a-bf69-84babe160891 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:56.882379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acb4da8b-a5d7-498a-bf69-84babe160891 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:56.882379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acb4da8b-a5d7-498a-bf69-84babe160891 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:56.882379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acb4da8b-a5d7-498a-bf69-84babe160891 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:57.507551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-acb4da8b-a5d7-498a-bf69-84babe160891 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:57.527608 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-acb4da8b-a5d7-498a-bf69-84babe160891 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.691728 Sep 10 21:00:57.548958 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1746/3419] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:56 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:57.560875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:57.561503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5de099be-4894-4f7a-86ac-d56cc4018723] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:57.589561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:57.593460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:57.594499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:57.598497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:57.599349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:57.600095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:57.633930 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] HTTP exception thrown: Instance 5de099be-4894-4f7a-86ac-d56cc4018723 could not be found. Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Request method failure captured: Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 HTTP/1.1 Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpD3XorJTOmshO8ShrGydR5Yh_ZW0GoFIPFNux3cdIuCEy4uljcIp1YR897IiLrXZKVrCAKwE0sC-SMLCx-PCumGee9Ldi4xcTYCHtnGk7w6VvimIT9qdN4eJRT9gk5WZTFLHhN4iq_vV4cb9iSKJhhLieaETbdjqgODHmuRL06q2E Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d30ef9b7525e4784be26268f46121e62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d30ef9b7525e4784be26268f46121e62"}]}] Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f38321284ec449e599d645625ed11139 Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5de099be-4894-4f7a-86ac-d56cc4018723 could not be found. Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5de099be-4894-4f7a-86ac-d56cc4018723'} Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de099be-4894-4f7a-86ac-d56cc4018723 could not be found. Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de099be-4894-4f7a-86ac-d56cc4018723 could not be found. Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:00:57.635962 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:57.640192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:00:57.640192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:00:57.640192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:00:57.640192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:00:57.640192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:00:57.640192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de099be-4894-4f7a-86ac-d56cc4018723 could not be found. Sep 10 21:00:57.640192 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:00:57.647887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Returning 404 to user: Instance 5de099be-4894-4f7a-86ac-d56cc4018723 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:00:57.649534 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-56eb7060-c88e-4220-9877-67c8c625c46c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723" status: 404 len: 111 microversion: 2.1 time: 0.099167 Sep 10 21:00:57.651386 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1747/3420] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:57 2022] GET /compute/v2.1/servers/5de099be-4894-4f7a-86ac-d56cc4018723 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:00:57.665202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4549219f-b0da-4654-997e-bca023b1597b tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:57.666218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4549219f-b0da-4654-997e-bca023b1597b tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:57.680353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4549219f-b0da-4654-997e-bca023b1597b tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:57.683021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4549219f-b0da-4654-997e-bca023b1597b tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:57.685565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4549219f-b0da-4654-997e-bca023b1597b tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:57.686565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4549219f-b0da-4654-997e-bca023b1597b tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:57.690212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4549219f-b0da-4654-997e-bca023b1597b tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:57.690934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4549219f-b0da-4654-997e-bca023b1597b tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:58.034736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4549219f-b0da-4654-997e-bca023b1597b tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:58.061072 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4549219f-b0da-4654-997e-bca023b1597b tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1320 microversion: 2.1 time: 0.407349 Sep 10 21:00:58.064493 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1748/3421] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:57 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1320 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:58.082487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7a252c2a-d400-46a6-a94f-5f5399fc6014 req-4b406ac3-dc75-4657-8ed0-6fa4ecc86153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c", "name": "network-vif-plugged", "status": "completed", "tag": "c3d3b4a7-7a79-4daa-9826-80870e8d53e3"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:58.105879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a252c2a-d400-46a6-a94f-5f5399fc6014 req-4b406ac3-dc75-4657-8ed0-6fa4ecc86153 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:58.109890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a252c2a-d400-46a6-a94f-5f5399fc6014 req-4b406ac3-dc75-4657-8ed0-6fa4ecc86153 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:58.111170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a252c2a-d400-46a6-a94f-5f5399fc6014 req-4b406ac3-dc75-4657-8ed0-6fa4ecc86153 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:58.141503 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7a252c2a-d400-46a6-a94f-5f5399fc6014 req-4b406ac3-dc75-4657-8ed0-6fa4ecc86153 service nova] Creating event network-vif-plugged:c3d3b4a7-7a79-4daa-9826-80870e8d53e3 for instance c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c on nch1-master-1 Sep 10 21:00:58.153894 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7a252c2a-d400-46a6-a94f-5f5399fc6014 req-4b406ac3-dc75-4657-8ed0-6fa4ecc86153 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087871 Sep 10 21:00:58.159022 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1749/3422] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:58.186200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93530cbc-350d-4c73-8bff-5c7ee8244ea7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:58.186820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-93530cbc-350d-4c73-8bff-5c7ee8244ea7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:58.235865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93530cbc-350d-4c73-8bff-5c7ee8244ea7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:58.236568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93530cbc-350d-4c73-8bff-5c7ee8244ea7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:58.239864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93530cbc-350d-4c73-8bff-5c7ee8244ea7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:58.240665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93530cbc-350d-4c73-8bff-5c7ee8244ea7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:58.241143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93530cbc-350d-4c73-8bff-5c7ee8244ea7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:58.242999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93530cbc-350d-4c73-8bff-5c7ee8244ea7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:58.301857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-93530cbc-350d-4c73-8bff-5c7ee8244ea7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:00:58.557101 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93530cbc-350d-4c73-8bff-5c7ee8244ea7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 204 len: 0 microversion: 2.1 time: 0.396058 Sep 10 21:00:58.560223 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1750/3423] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:00:58 2022] DELETE /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:00:58.569452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c3f144aa-77bc-447f-98e6-e494550a29ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:58.570525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c3f144aa-77bc-447f-98e6-e494550a29ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:58.600073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f144aa-77bc-447f-98e6-e494550a29ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:58.600630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f144aa-77bc-447f-98e6-e494550a29ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:58.601239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f144aa-77bc-447f-98e6-e494550a29ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:58.602356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f144aa-77bc-447f-98e6-e494550a29ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:58.602829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f144aa-77bc-447f-98e6-e494550a29ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:58.603266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c3f144aa-77bc-447f-98e6-e494550a29ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.053224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c3f144aa-77bc-447f-98e6-e494550a29ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:59.072852 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c3f144aa-77bc-447f-98e6-e494550a29ba tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1504 microversion: 2.1 time: 0.510059 Sep 10 21:00:59.076009 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1751/3424] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:58 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:59.088372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da3c7546-6673-4d63-a2e7-4cdd8cba5778 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:59.091210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-da3c7546-6673-4d63-a2e7-4cdd8cba5778 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:59.104028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da3c7546-6673-4d63-a2e7-4cdd8cba5778 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.112278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da3c7546-6673-4d63-a2e7-4cdd8cba5778 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.113464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da3c7546-6673-4d63-a2e7-4cdd8cba5778 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.115274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da3c7546-6673-4d63-a2e7-4cdd8cba5778 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.118620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da3c7546-6673-4d63-a2e7-4cdd8cba5778 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.119284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da3c7546-6673-4d63-a2e7-4cdd8cba5778 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.191637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-da3c7546-6673-4d63-a2e7-4cdd8cba5778 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:00:59.336703 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da3c7546-6673-4d63-a2e7-4cdd8cba5778 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 204 len: 0 microversion: 2.1 time: 0.258762 Sep 10 21:00:59.337594 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1752/3425] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:00:59 2022] DELETE /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:00:59.343419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7b261f0-3107-4ec5-a87e-fdcc21d2f1be tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f994493bf70>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:59.408345 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b7b261f0-3107-4ec5-a87e-fdcc21d2f1be tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1455 microversion: 2.1 time: 0.069372 Sep 10 21:00:59.409733 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1753/3426] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:00:59 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:59.415017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f713f5fd-78b0-45ea-ab5b-a098b681682f req-f00fba14-b9d4-4594-88fc-646c118ff040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfdc13f-9c2e-44ec-8553-3f779ead89af", "tag": "b18a22e2-b050-417e-bebb-2f9e983473cc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:00:59.430266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f713f5fd-78b0-45ea-ab5b-a098b681682f req-f00fba14-b9d4-4594-88fc-646c118ff040 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.431032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f713f5fd-78b0-45ea-ab5b-a098b681682f req-f00fba14-b9d4-4594-88fc-646c118ff040 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.431754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f713f5fd-78b0-45ea-ab5b-a098b681682f req-f00fba14-b9d4-4594-88fc-646c118ff040 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.448968 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f713f5fd-78b0-45ea-ab5b-a098b681682f req-f00fba14-b9d4-4594-88fc-646c118ff040 service nova] Creating event network-changed:b18a22e2-b050-417e-bebb-2f9e983473cc for instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af on nch1-master-1 Sep 10 21:00:59.455293 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f713f5fd-78b0-45ea-ab5b-a098b681682f req-f00fba14-b9d4-4594-88fc-646c118ff040 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042974 Sep 10 21:00:59.455908 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1754/3427] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:00:59.465050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea3fc47a-d73f-4718-b1ba-ab64bc38f5a4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:59.465809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ea3fc47a-d73f-4718-b1ba-ab64bc38f5a4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:59.476379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea3fc47a-d73f-4718-b1ba-ab64bc38f5a4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.476924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea3fc47a-d73f-4718-b1ba-ab64bc38f5a4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.477550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea3fc47a-d73f-4718-b1ba-ab64bc38f5a4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.478366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea3fc47a-d73f-4718-b1ba-ab64bc38f5a4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.478894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea3fc47a-d73f-4718-b1ba-ab64bc38f5a4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.479395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea3fc47a-d73f-4718-b1ba-ab64bc38f5a4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.651258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ea3fc47a-d73f-4718-b1ba-ab64bc38f5a4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:59.663035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:00:59.664093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:00:59.664582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:00:59.665003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:00:59.665461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:00:59.670582 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea3fc47a-d73f-4718-b1ba-ab64bc38f5a4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.210142 Sep 10 21:00:59.671209 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1755/3428] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:59 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:59.679559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.680256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.680911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.682003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.682478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.682906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.683927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-82ddb7e0-dbf4-43ea-97f7-a99553032f6e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:59.684783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-82ddb7e0-dbf4-43ea-97f7-a99553032f6e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:59.695488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82ddb7e0-dbf4-43ea-97f7-a99553032f6e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.696041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82ddb7e0-dbf4-43ea-97f7-a99553032f6e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.696539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82ddb7e0-dbf4-43ea-97f7-a99553032f6e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.697423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82ddb7e0-dbf4-43ea-97f7-a99553032f6e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.697919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82ddb7e0-dbf4-43ea-97f7-a99553032f6e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.698541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82ddb7e0-dbf4-43ea-97f7-a99553032f6e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.702720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Getting quotas for project d696ed7cdc3945b78d638693a83ac081. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:00:59.709047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Getting quotas for user d57829f24d3841eb9c1d6f5c6a5ea7ee and project d696ed7cdc3945b78d638693a83ac081. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:00:59.883290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:00:59.886210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='fc54e08d-2879-4351-b746-1f663a04bb09',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b260a8c4-96fb-4154-9b43-b680cf39768c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10353bbd-79be-4a1e-9fda-d83fe49243d8',volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:00:59.897264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-82ddb7e0-dbf4-43ea-97f7-a99553032f6e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:00:59.905516 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-82ddb7e0-dbf4-43ea-97f7-a99553032f6e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1528 microversion: 2.1 time: 0.233301 Sep 10 21:00:59.906475 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1756/3429] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:59 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1528 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:00:59.921461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7fac5d11-9f30-48bf-9c07-8339ce817399 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:00:59.922581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7fac5d11-9f30-48bf-9c07-8339ce817399 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:00:59.929422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7fac5d11-9f30-48bf-9c07-8339ce817399 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.930048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7fac5d11-9f30-48bf-9c07-8339ce817399 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.930441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7fac5d11-9f30-48bf-9c07-8339ce817399 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:00:59.931535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7fac5d11-9f30-48bf-9c07-8339ce817399 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:00:59.932212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7fac5d11-9f30-48bf-9c07-8339ce817399 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:00:59.932863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7fac5d11-9f30-48bf-9c07-8339ce817399 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:00.116190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7fac5d11-9f30-48bf-9c07-8339ce817399 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:00.125109 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7fac5d11-9f30-48bf-9c07-8339ce817399 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1320 microversion: 2.1 time: 0.207720 Sep 10 21:01:00.125691 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1757/3430] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:00:59 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:00.131897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1adba8c9-cb5e-4a23-a7c0-111403803010 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1624682868"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:00.132442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1adba8c9-cb5e-4a23-a7c0-111403803010 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:00.138497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1adba8c9-cb5e-4a23-a7c0-111403803010 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:00.139366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1adba8c9-cb5e-4a23-a7c0-111403803010 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:00.139834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1adba8c9-cb5e-4a23-a7c0-111403803010 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:00.140552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1adba8c9-cb5e-4a23-a7c0-111403803010 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:00.141030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1adba8c9-cb5e-4a23-a7c0-111403803010 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:00.141537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1adba8c9-cb5e-4a23-a7c0-111403803010 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:00.265288 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4ba5d81f-7f53-4a14-98a7-f714b223c89a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 5.099267 Sep 10 21:01:00.267108 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1674/3431] 10.222.0.33 () {62 vars in 1189 bytes} [Sat Sep 10 21:00:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 5101 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 21:01:00.272243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a7de0492-1fd6-451b-ac50-3d3981ef2a32 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:00.273634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a7de0492-1fd6-451b-ac50-3d3981ef2a32 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:00.280600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7de0492-1fd6-451b-ac50-3d3981ef2a32 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:00.281351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7de0492-1fd6-451b-ac50-3d3981ef2a32 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:00.282033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7de0492-1fd6-451b-ac50-3d3981ef2a32 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:00.283565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7de0492-1fd6-451b-ac50-3d3981ef2a32 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:00.284463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7de0492-1fd6-451b-ac50-3d3981ef2a32 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:00.285068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7de0492-1fd6-451b-ac50-3d3981ef2a32 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:00.338804 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.network.security_group_api [None req-1adba8c9-cb5e-4a23-a7c0-111403803010 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Adding security group cebbb4ae-a656-4074-9ac9-c20edc5dce67 to port ffdf3005-b7dc-44e1-8c27-8c4179511d4f Sep 10 21:01:00.472781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a7de0492-1fd6-451b-ac50-3d3981ef2a32 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:00.482341 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a7de0492-1fd6-451b-ac50-3d3981ef2a32 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1472 microversion: 2.1 time: 0.214082 Sep 10 21:01:00.483162 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1675/3432] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:00 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1472 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:00.491279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3178408-5c8d-4730-a3d5-95dace51db5a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:00.492262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e3178408-5c8d-4730-a3d5-95dace51db5a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:00.564070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e3178408-5c8d-4730-a3d5-95dace51db5a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:00.572373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e3178408-5c8d-4730-a3d5-95dace51db5a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:00.573994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e3178408-5c8d-4730-a3d5-95dace51db5a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:00.575581 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3178408-5c8d-4730-a3d5-95dace51db5a tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1284 microversion: 2.32 time: 0.091060 Sep 10 21:01:00.576809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1676/3433] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:00 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:00.582360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5195d1a3-504b-4bd1-bbb2-78c0ac78c148 req-7efdba9a-9ece-4487-b965-9b88db554fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1767a7-4ae2-46ca-a241-b7749ee7a56d", "name": "network-vif-plugged", "status": "completed", "tag": "8a1eafca-defa-4ca8-b70a-ad4397817ea7"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:00.593283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5195d1a3-504b-4bd1-bbb2-78c0ac78c148 req-7efdba9a-9ece-4487-b965-9b88db554fb4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:00.594109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5195d1a3-504b-4bd1-bbb2-78c0ac78c148 req-7efdba9a-9ece-4487-b965-9b88db554fb4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:00.595499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5195d1a3-504b-4bd1-bbb2-78c0ac78c148 req-7efdba9a-9ece-4487-b965-9b88db554fb4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:00.609421 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5195d1a3-504b-4bd1-bbb2-78c0ac78c148 req-7efdba9a-9ece-4487-b965-9b88db554fb4 service nova] Creating event network-vif-plugged:8a1eafca-defa-4ca8-b70a-ad4397817ea7 for instance 1d1767a7-4ae2-46ca-a241-b7749ee7a56d on nch2-master-1 Sep 10 21:01:00.615669 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5195d1a3-504b-4bd1-bbb2-78c0ac78c148 req-7efdba9a-9ece-4487-b965-9b88db554fb4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037452 Sep 10 21:01:00.617023 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1677/3434] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:00.622771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6288a517-57c5-4f5f-bd38-24d29c5062d0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99440ed670>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:00.689549 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6288a517-57c5-4f5f-bd38-24d29c5062d0 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1464 microversion: 2.1 time: 0.070894 Sep 10 21:01:00.692008 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1678/3435] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:01:00 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1464 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:00.707826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6bec3412-cc11-4794-9cc9-15393d37053b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:00.708937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6bec3412-cc11-4794-9cc9-15393d37053b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:00.724217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bec3412-cc11-4794-9cc9-15393d37053b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:00.725072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bec3412-cc11-4794-9cc9-15393d37053b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:00.725688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bec3412-cc11-4794-9cc9-15393d37053b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:00.728075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bec3412-cc11-4794-9cc9-15393d37053b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:00.728822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bec3412-cc11-4794-9cc9-15393d37053b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:00.729758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bec3412-cc11-4794-9cc9-15393d37053b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:00.993128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1adba8c9-cb5e-4a23-a7c0-111403803010 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8/action" status: 202 len: 0 microversion: 2.1 time: 0.865451 Sep 10 21:01:00.996987 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1758/3436] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:00 2022] POST /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8/action => generated 0 bytes in 867 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:00.998925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d519110-0132-4748-8b43-d165037a437a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99495b10d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:01.057662 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d519110-0132-4748-8b43-d165037a437a tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 200 len: 1464 microversion: 2.1 time: 0.062465 Sep 10 21:01:01.067105 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1759/3437] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:01:00 2022] GET /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 1464 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:01.079948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-91f02792-2a7d-4563-affd-13f9337e040f tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:01.081059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-91f02792-2a7d-4563-affd-13f9337e040f tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:01.094125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91f02792-2a7d-4563-affd-13f9337e040f tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.094264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91f02792-2a7d-4563-affd-13f9337e040f tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.095554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91f02792-2a7d-4563-affd-13f9337e040f tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.096469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91f02792-2a7d-4563-affd-13f9337e040f tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.097190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91f02792-2a7d-4563-affd-13f9337e040f tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.098467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91f02792-2a7d-4563-affd-13f9337e040f tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.124901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6bec3412-cc11-4794-9cc9-15393d37053b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:01.141206 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6bec3412-cc11-4794-9cc9-15393d37053b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.446029 Sep 10 21:01:01.144435 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1679/3438] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:00 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:01.169936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6ea78a5-a4a9-43ab-8749-b1fd8cf23fde tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f9944106550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:01.381998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-91f02792-2a7d-4563-affd-13f9337e040f tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:01.394812 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-91f02792-2a7d-4563-affd-13f9337e040f tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1528 microversion: 2.1 time: 0.325972 Sep 10 21:01:01.395571 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1760/3439] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:01 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1528 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:01.410744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-c6ea78a5-a4a9-43ab-8749-b1fd8cf23fde tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group cebbb4ae-a656-4074-9ac9-c20edc5dce67 in use.", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:01:01.411350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-77a32487-fd67-41af-a31e-015b31e21c18 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:01.411900 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-c6ea78a5-a4a9-43ab-8749-b1fd8cf23fde tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security Group cebbb4ae-a656-4074-9ac9-c20edc5dce67 in use. Sep 10 21:01:01.411900 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-44be8b10-39ac-4bf3-adf2-25c97b77a0e4'] Sep 10 21:01:01.412119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-77a32487-fd67-41af-a31e-015b31e21c18 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6ea78a5-a4a9-43ab-8749-b1fd8cf23fde tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/os-security-groups/cebbb4ae-a656-4074-9ac9-c20edc5dce67 HTTP/1.1 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: exception: Security Group cebbb4ae-a656-4074-9ac9-c20edc5dce67 in use. Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-44be8b10-39ac-4bf3-adf2-25c97b77a0e4'] Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'cebbb4ae-a656-4074-9ac9-c20edc5dce67'} Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:01:01.414773 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group cebbb4ae-a656-4074-9ac9-c20edc5dce67 in use. Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44be8b10-39ac-4bf3-adf2-25c97b77a0e4'] Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group cebbb4ae-a656-4074-9ac9-c20edc5dce67 in use. Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44be8b10-39ac-4bf3-adf2-25c97b77a0e4'] Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group cebbb4ae-a656-4074-9ac9-c20edc5dce67 in use. Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44be8b10-39ac-4bf3-adf2-25c97b77a0e4'] Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group cebbb4ae-a656-4074-9ac9-c20edc5dce67 in use. Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44be8b10-39ac-4bf3-adf2-25c97b77a0e4'] Sep 10 21:01:01.419768 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:01.425534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77a32487-fd67-41af-a31e-015b31e21c18 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.425534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77a32487-fd67-41af-a31e-015b31e21c18 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.425534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77a32487-fd67-41af-a31e-015b31e21c18 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.425534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77a32487-fd67-41af-a31e-015b31e21c18 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.425534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77a32487-fd67-41af-a31e-015b31e21c18 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.425534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77a32487-fd67-41af-a31e-015b31e21c18 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.427272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6ea78a5-a4a9-43ab-8749-b1fd8cf23fde tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 400 to user: Security Group cebbb4ae-a656-4074-9ac9-c20edc5dce67 in use. Sep 10 21:01:01.427272 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-44be8b10-39ac-4bf3-adf2-25c97b77a0e4'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:01.428309 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6ea78a5-a4a9-43ab-8749-b1fd8cf23fde tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/cebbb4ae-a656-4074-9ac9-c20edc5dce67" status: 400 len: 185 microversion: 2.1 time: 0.266746 Sep 10 21:01:01.429499 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1680/3440] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:01 2022] DELETE /compute/v2.1/os-security-groups/cebbb4ae-a656-4074-9ac9-c20edc5dce67 => generated 185 bytes in 268 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:01:01.440742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6f7d9e77-a085-408c-bacd-0c43448a2785 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:01.444079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6f7d9e77-a085-408c-bacd-0c43448a2785 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:01.469091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f7d9e77-a085-408c-bacd-0c43448a2785 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.471021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f7d9e77-a085-408c-bacd-0c43448a2785 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.472524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f7d9e77-a085-408c-bacd-0c43448a2785 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.474079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f7d9e77-a085-408c-bacd-0c43448a2785 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.474561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f7d9e77-a085-408c-bacd-0c43448a2785 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.476222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f7d9e77-a085-408c-bacd-0c43448a2785 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.704859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6f7d9e77-a085-408c-bacd-0c43448a2785 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:01.714251 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6f7d9e77-a085-408c-bacd-0c43448a2785 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1320 microversion: 2.1 time: 0.282978 Sep 10 21:01:01.726277 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1681/3441] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:01 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:01.732650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-39c126b3-1657-4f27-8fc3-6ce2cd64fbc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:01.735863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-39c126b3-1657-4f27-8fc3-6ce2cd64fbc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:01.742992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39c126b3-1657-4f27-8fc3-6ce2cd64fbc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.743586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39c126b3-1657-4f27-8fc3-6ce2cd64fbc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.744096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39c126b3-1657-4f27-8fc3-6ce2cd64fbc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.744884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39c126b3-1657-4f27-8fc3-6ce2cd64fbc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.745417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39c126b3-1657-4f27-8fc3-6ce2cd64fbc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.745871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39c126b3-1657-4f27-8fc3-6ce2cd64fbc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.865768 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-39c126b3-1657-4f27-8fc3-6ce2cd64fbc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8/action" status: 202 len: 0 microversion: 2.1 time: 0.136278 Sep 10 21:01:01.869846 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1682/3442] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:01 2022] POST /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:01.878639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3b4ae837-8e37-4ca5-9b5b-48ce24478027 req-3236c703-71dc-4311-b4d2-968b4b5b2ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ab7365-3c1e-4122-b234-34076143bce8", "tag": "ffdf3005-b7dc-44e1-8c27-8c4179511d4f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:01.889938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3b4ae837-8e37-4ca5-9b5b-48ce24478027 req-3236c703-71dc-4311-b4d2-968b4b5b2ba7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.890889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3b4ae837-8e37-4ca5-9b5b-48ce24478027 req-3236c703-71dc-4311-b4d2-968b4b5b2ba7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.892266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3b4ae837-8e37-4ca5-9b5b-48ce24478027 req-3236c703-71dc-4311-b4d2-968b4b5b2ba7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.911596 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3b4ae837-8e37-4ca5-9b5b-48ce24478027 req-3236c703-71dc-4311-b4d2-968b4b5b2ba7 service nova] Creating event network-changed:ffdf3005-b7dc-44e1-8c27-8c4179511d4f for instance 16ab7365-3c1e-4122-b234-34076143bce8 on nch1-master-1 Sep 10 21:01:01.916521 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3b4ae837-8e37-4ca5-9b5b-48ce24478027 req-3236c703-71dc-4311-b4d2-968b4b5b2ba7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047213 Sep 10 21:01:01.917129 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1683/3443] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:01.922438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a818b0b7-6826-4b52-99ad-3f2fc3dbc651 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:01.923819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a818b0b7-6826-4b52-99ad-3f2fc3dbc651 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:01.930536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a818b0b7-6826-4b52-99ad-3f2fc3dbc651 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.931015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a818b0b7-6826-4b52-99ad-3f2fc3dbc651 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.931455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a818b0b7-6826-4b52-99ad-3f2fc3dbc651 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.932154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a818b0b7-6826-4b52-99ad-3f2fc3dbc651 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:01.932615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a818b0b7-6826-4b52-99ad-3f2fc3dbc651 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:01.933040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a818b0b7-6826-4b52-99ad-3f2fc3dbc651 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:01.937446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:02.229802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a818b0b7-6826-4b52-99ad-3f2fc3dbc651 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:02.231019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-77a32487-fd67-41af-a31e-015b31e21c18 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:02.240925 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-77a32487-fd67-41af-a31e-015b31e21c18 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 200 len: 1468 microversion: 2.1 time: 0.844004 Sep 10 21:01:02.241744 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1761/3444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:01 2022] GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 1468 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:02.243582 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a818b0b7-6826-4b52-99ad-3f2fc3dbc651 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1472 microversion: 2.1 time: 0.324432 Sep 10 21:01:02.253726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:02.254607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:02.259104 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1684/3445] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:01 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1472 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:02.263367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:02.267342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-65b97470-73e7-40d8-83b9-a2abfa024686 req-21a025d9-6a60-4a53-b1c7-6663cacf7bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c645369-3402-414b-bf2c-d82cf4dc75a6", "name": "network-vif-deleted", "tag": "07767f3c-d5e3-4bdb-9bb4-11b7952111c2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:02.267519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:02.268042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:02.268788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:02.269251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:02.269682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:02.281411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-65b97470-73e7-40d8-83b9-a2abfa024686 req-21a025d9-6a60-4a53-b1c7-6663cacf7bbf service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:02.282960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-65b97470-73e7-40d8-83b9-a2abfa024686 req-21a025d9-6a60-4a53-b1c7-6663cacf7bbf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:02.283619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-65b97470-73e7-40d8-83b9-a2abfa024686 req-21a025d9-6a60-4a53-b1c7-6663cacf7bbf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:02.296100 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-65b97470-73e7-40d8-83b9-a2abfa024686 req-21a025d9-6a60-4a53-b1c7-6663cacf7bbf service nova] Creating event network-vif-deleted:07767f3c-d5e3-4bdb-9bb4-11b7952111c2 for instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 on nch2-master-1 Sep 10 21:01:02.305093 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-65b97470-73e7-40d8-83b9-a2abfa024686 req-21a025d9-6a60-4a53-b1c7-6663cacf7bbf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044226 Sep 10 21:01:02.306559 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1685/3446] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:02.319386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e7f2997-5d1b-4095-9de3-5b44d5b0d72d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:02.320734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5e7f2997-5d1b-4095-9de3-5b44d5b0d72d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:02.328576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e7f2997-5d1b-4095-9de3-5b44d5b0d72d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:02.329779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e7f2997-5d1b-4095-9de3-5b44d5b0d72d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:02.330548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e7f2997-5d1b-4095-9de3-5b44d5b0d72d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:02.331511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e7f2997-5d1b-4095-9de3-5b44d5b0d72d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:02.332338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e7f2997-5d1b-4095-9de3-5b44d5b0d72d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:02.332998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e7f2997-5d1b-4095-9de3-5b44d5b0d72d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:02.514862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:02.528727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:02.530680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:02.532097 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0cffdf02-0c23-41c6-a976-31c94e70e4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1518 microversion: 2.32 time: 0.289207 Sep 10 21:01:02.533347 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1762/3447] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:02 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1518 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:02.539597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa31468c-85c3-464e-9c3c-86b703cfb21a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:02.541674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fa31468c-85c3-464e-9c3c-86b703cfb21a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:02.549332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa31468c-85c3-464e-9c3c-86b703cfb21a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:02.550160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa31468c-85c3-464e-9c3c-86b703cfb21a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:02.550922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa31468c-85c3-464e-9c3c-86b703cfb21a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:02.552455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa31468c-85c3-464e-9c3c-86b703cfb21a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:02.553237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa31468c-85c3-464e-9c3c-86b703cfb21a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:02.554332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa31468c-85c3-464e-9c3c-86b703cfb21a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:02.580810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:02.632462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5e7f2997-5d1b-4095-9de3-5b44d5b0d72d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:02.648176 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5e7f2997-5d1b-4095-9de3-5b44d5b0d72d tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1575 microversion: 2.1 time: 0.340157 Sep 10 21:01:02.649327 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1686/3448] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:02 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1575 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:02.659290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89ad5589-fbda-4fda-803e-396726f8d159 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944d73790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:02.792461 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-89ad5589-fbda-4fda-803e-396726f8d159 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images?changes-since=2022-09-10T20%3A58%3A52Z" status: 200 len: 2374 microversion: 2.1 time: 0.141767 Sep 10 21:01:02.805266 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1687/3449] 10.222.0.33 () {58 vars in 1199 bytes} [Sat Sep 10 21:01:02 2022] GET /compute/v2.1/images?changes-since=2022-09-10T20%3A58%3A52Z => generated 2374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:02.810811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:02.811766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:02.819327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:02.820252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:02.820912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:02.821948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:02.822641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:02.823286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:02.870327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:02.874163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:02.874978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:02.876326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lazy-loading 'fault' on Instance uuid 7c645369-3402-414b-bf2c-d82cf4dc75a6 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:03.176278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fa31468c-85c3-464e-9c3c-86b703cfb21a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:03.189143 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fa31468c-85c3-464e-9c3c-86b703cfb21a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.652860 Sep 10 21:01:03.190154 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1763/3450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:02 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:03.204924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:03.206935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d1131685-bed2-4e0a-954f-8020b0e579bb tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:03.208612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d1131685-bed2-4e0a-954f-8020b0e579bb tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:03.213796 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-33b897c1-14fe-428d-aecb-9745afb7d77c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 200 len: 1315 microversion: 2.1 time: 0.407128 Sep 10 21:01:03.223578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1131685-bed2-4e0a-954f-8020b0e579bb tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:03.225735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1131685-bed2-4e0a-954f-8020b0e579bb tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:03.239760 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1688/3451] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:02 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:03.244715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f21cda94-d233-4cf9-a041-e6daa25f1c67 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99496895e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:03.250213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1131685-bed2-4e0a-954f-8020b0e579bb tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:03.257317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1131685-bed2-4e0a-954f-8020b0e579bb tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:03.259059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1131685-bed2-4e0a-954f-8020b0e579bb tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:03.260564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1131685-bed2-4e0a-954f-8020b0e579bb tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:03.510128 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f21cda94-d233-4cf9-a041-e6daa25f1c67 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-708856357" status: 200 len: 484 microversion: 2.1 time: 0.269018 Sep 10 21:01:03.511406 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1689/3452] 10.222.0.33 () {58 vars in 1229 bytes} [Sat Sep 10 21:01:03 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-708856357 => generated 484 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:03.526352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8ee71add-6b95-4bd2-9ecd-0cf1e115d609 req-63a0ab52-8519-461f-a4dd-9ea3f19b022f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02503ea6-e924-4967-83ad-59dbfbf3176d", "name": "network-vif-plugged", "status": "completed", "tag": "1a5c21f2-ced8-4245-a6d6-bfee5a42b09c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:03.545918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8ee71add-6b95-4bd2-9ecd-0cf1e115d609 req-63a0ab52-8519-461f-a4dd-9ea3f19b022f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:03.550517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8ee71add-6b95-4bd2-9ecd-0cf1e115d609 req-63a0ab52-8519-461f-a4dd-9ea3f19b022f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:03.551442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8ee71add-6b95-4bd2-9ecd-0cf1e115d609 req-63a0ab52-8519-461f-a4dd-9ea3f19b022f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:03.581680 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8ee71add-6b95-4bd2-9ecd-0cf1e115d609 req-63a0ab52-8519-461f-a4dd-9ea3f19b022f service nova] Creating event network-vif-plugged:1a5c21f2-ced8-4245-a6d6-bfee5a42b09c for instance 02503ea6-e924-4967-83ad-59dbfbf3176d on nch1-master-1 Sep 10 21:01:03.589333 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8ee71add-6b95-4bd2-9ecd-0cf1e115d609 req-63a0ab52-8519-461f-a4dd-9ea3f19b022f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076149 Sep 10 21:01:03.593675 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1690/3453] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:03.606116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98b32eed-3e47-4640-a3e7-a805e83675ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:03.607669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-98b32eed-3e47-4640-a3e7-a805e83675ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:03.621381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98b32eed-3e47-4640-a3e7-a805e83675ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:03.621923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98b32eed-3e47-4640-a3e7-a805e83675ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:03.622375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98b32eed-3e47-4640-a3e7-a805e83675ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:03.626662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98b32eed-3e47-4640-a3e7-a805e83675ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:03.628972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98b32eed-3e47-4640-a3e7-a805e83675ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:03.629806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98b32eed-3e47-4640-a3e7-a805e83675ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:03.889078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d1131685-bed2-4e0a-954f-8020b0e579bb tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:03.898871 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d1131685-bed2-4e0a-954f-8020b0e579bb tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1510 microversion: 2.1 time: 0.705482 Sep 10 21:01:03.899528 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1764/3454] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:03 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1510 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:03.914654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ce796286-1c70-4efc-9c15-8e70c8faa321 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99448d9ca0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:04.149805 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ce796286-1c70-4efc-9c15-8e70c8faa321 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images?server=9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 200 len: 957 microversion: 2.1 time: 0.247502 Sep 10 21:01:04.171877 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1765/3455] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Sep 10 21:01:03 2022] GET /compute/v2.1/images?server=9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 957 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:04.193904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:04.195039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:04.231220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:04.231749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:04.234246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:04.237063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:04.238569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:04.240115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:04.657820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-98b32eed-3e47-4640-a3e7-a805e83675ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:04.674726 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-98b32eed-3e47-4640-a3e7-a805e83675ee tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1472 microversion: 2.1 time: 1.079222 Sep 10 21:01:04.677500 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1691/3456] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:03 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1472 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:04.711154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cbc17321-9857-495b-90f1-d2c2784e9491 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:04.714360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cbc17321-9857-495b-90f1-d2c2784e9491 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:04.737961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:04.755278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbc17321-9857-495b-90f1-d2c2784e9491 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:04.759369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbc17321-9857-495b-90f1-d2c2784e9491 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:04.759839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbc17321-9857-495b-90f1-d2c2784e9491 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:04.760610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbc17321-9857-495b-90f1-d2c2784e9491 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:04.766910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbc17321-9857-495b-90f1-d2c2784e9491 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:04.772871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbc17321-9857-495b-90f1-d2c2784e9491 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:05.057004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:05.070381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:05.073801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:05.075849 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3de1e452-fda9-4f1e-8bf5-97898a0107c3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1582 microversion: 2.32 time: 0.899651 Sep 10 21:01:05.076782 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1766/3457] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:04 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1582 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:05.096829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d3babe0f-131f-406e-834d-dff2a31d388a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:05.099968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d3babe0f-131f-406e-834d-dff2a31d388a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:05.116433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3babe0f-131f-406e-834d-dff2a31d388a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:05.120501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3babe0f-131f-406e-834d-dff2a31d388a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:05.121285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3babe0f-131f-406e-834d-dff2a31d388a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:05.122450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3babe0f-131f-406e-834d-dff2a31d388a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:05.123132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3babe0f-131f-406e-834d-dff2a31d388a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:05.124274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3babe0f-131f-406e-834d-dff2a31d388a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:05.634250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3babe0f-131f-406e-834d-dff2a31d388a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:05.646545 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d3babe0f-131f-406e-834d-dff2a31d388a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1321 microversion: 2.1 time: 0.568451 Sep 10 21:01:05.647998 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1767/3458] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:05 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:05.662857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cbc17321-9857-495b-90f1-d2c2784e9491 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:05.673865 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cbc17321-9857-495b-90f1-d2c2784e9491 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1575 microversion: 2.1 time: 0.993692 Sep 10 21:01:05.676275 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1692/3459] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:04 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1575 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:05.688088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e291e996-33af-47d4-8aa8-b2516772f1b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:05.689698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e291e996-33af-47d4-8aa8-b2516772f1b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:05.693400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a6988162-ed73-426f-b6ea-092b84b6a294 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99495b5a60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:05.701153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e291e996-33af-47d4-8aa8-b2516772f1b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:05.703961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e291e996-33af-47d4-8aa8-b2516772f1b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:05.710582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e291e996-33af-47d4-8aa8-b2516772f1b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:05.716468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e291e996-33af-47d4-8aa8-b2516772f1b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:05.717296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e291e996-33af-47d4-8aa8-b2516772f1b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:05.717900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e291e996-33af-47d4-8aa8-b2516772f1b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:05.793508 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a6988162-ed73-426f-b6ea-092b84b6a294 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 484 microversion: 2.1 time: 0.126428 Sep 10 21:01:05.794636 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1768/3460] 10.222.0.33 () {58 vars in 1317 bytes} [Sat Sep 10 21:01:05 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 484 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:05.809774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:05.829234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:05.859588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:05.860588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:05.861223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:05.862235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:05.862934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:05.863811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:05.900385 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 HTTP/1.1 Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '7c645369-3402-414b-bf2c-d82cf4dc75a6'} Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:05.906312 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:05.912018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:05.912018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:05.912018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:05.912018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:05.912018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:05.912018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:05.912018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:05.912018 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:05.914942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 404 to user: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:05.917596 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81ffe342-fd20-4659-9da0-d16e8a2a7088 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 404 len: 111 microversion: 2.1 time: 0.120275 Sep 10 21:01:05.929527 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1769/3461] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:05 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:05.940859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f7d65b70-b231-44d4-829a-938287e3850c req-5ba35eb7-aacc-45a0-9c6a-dbd4df5f5e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7301410e-1f12-405a-b630-377c08092f7e", "name": "network-vif-deleted", "tag": "d7969a7f-0a1d-440b-a38c-b5027a4863c6"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:05.963196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f7d65b70-b231-44d4-829a-938287e3850c req-5ba35eb7-aacc-45a0-9c6a-dbd4df5f5e98 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:05.979595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f7d65b70-b231-44d4-829a-938287e3850c req-5ba35eb7-aacc-45a0-9c6a-dbd4df5f5e98 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:05.980868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f7d65b70-b231-44d4-829a-938287e3850c req-5ba35eb7-aacc-45a0-9c6a-dbd4df5f5e98 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:06.002715 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f7d65b70-b231-44d4-829a-938287e3850c req-5ba35eb7-aacc-45a0-9c6a-dbd4df5f5e98 service nova] Creating event network-vif-deleted:d7969a7f-0a1d-440b-a38c-b5027a4863c6 for instance 7301410e-1f12-405a-b630-377c08092f7e on nch1-master-1 Sep 10 21:01:06.013042 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f7d65b70-b231-44d4-829a-938287e3850c req-5ba35eb7-aacc-45a0-9c6a-dbd4df5f5e98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081842 Sep 10 21:01:06.020224 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1770/3462] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:06.026171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-64a5e34f-e29b-4ae4-98c7-eea5cb97ff6d req-22a65258-b007-4917-a5f5-429fb63ce490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7d1492-dc6d-4ddc-ada0-4d492a0916d6", "name": "network-vif-unplugged", "status": "completed", "tag": "3e890f01-2c63-4ec8-9b80-da70352321e9"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:06.051010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-64a5e34f-e29b-4ae4-98c7-eea5cb97ff6d req-22a65258-b007-4917-a5f5-429fb63ce490 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:06.053222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-64a5e34f-e29b-4ae4-98c7-eea5cb97ff6d req-22a65258-b007-4917-a5f5-429fb63ce490 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:06.054354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-64a5e34f-e29b-4ae4-98c7-eea5cb97ff6d req-22a65258-b007-4917-a5f5-429fb63ce490 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:06.080250 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-64a5e34f-e29b-4ae4-98c7-eea5cb97ff6d req-22a65258-b007-4917-a5f5-429fb63ce490 service nova] Creating event network-vif-unplugged:3e890f01-2c63-4ec8-9b80-da70352321e9 for instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 on nch2-master-1 Sep 10 21:01:06.095635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-64a5e34f-e29b-4ae4-98c7-eea5cb97ff6d req-22a65258-b007-4917-a5f5-429fb63ce490 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072725 Sep 10 21:01:06.096815 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1771/3463] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:06.102444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:06.116365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:06.139922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:06.140815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:06.141481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:06.142494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:06.144662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:06.149529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:06.236382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e291e996-33af-47d4-8aa8-b2516772f1b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:06.254497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:06.256221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:06.258891 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e291e996-33af-47d4-8aa8-b2516772f1b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.581194 Sep 10 21:01:06.259576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:06.260244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lazy-loading 'fault' on Instance uuid 7301410e-1f12-405a-b630-377c08092f7e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:06.263664 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1693/3464] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:05 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:06.298892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c961267c-e2d6-46e0-ab11-f819f9a06125 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99451c2ca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:06.387662 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c961267c-e2d6-46e0-ab11-f819f9a06125 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 484 microversion: 2.1 time: 0.100029 Sep 10 21:01:06.388402 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1694/3465] 10.222.0.33 () {58 vars in 1303 bytes} [Sat Sep 10 21:01:06 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 484 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:06.399291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:06.403038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:06.415822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:06.417389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:06.419934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:06.420683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:06.421772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:06.423688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:06.424372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:06.436665 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b792138e-0ce9-4fee-856b-9d420a8de6e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1307 microversion: 2.1 time: 0.336962 Sep 10 21:01:06.442408 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1772/3466] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:06 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1307 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:06.449252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-461657562", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:06.600699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] validate_networks() for [('1cd195d4-857f-42a6-b181-30998baed10d', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:01:06.679337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:06.696771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:06.698531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:06.700489 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-58bc6049-340f-4393-b4fa-c7e23c2c0347 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1592 microversion: 2.32 time: 0.309939 Sep 10 21:01:06.723982 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1695/3467] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:06 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1592 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:06.729139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0a93d9a4-c837-499c-aa14-fb0efc2693e8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99451c2ca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:07.082657 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0a93d9a4-c837-499c-aa14-fb0efc2693e8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.357179 Sep 10 21:01:07.083391 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1696/3468] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 21:01:06 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:07.088685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-571477b5-91d1-421c-b052-b89549a8c236 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:07.089605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-571477b5-91d1-421c-b052-b89549a8c236 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:07.097018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-571477b5-91d1-421c-b052-b89549a8c236 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:07.097979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-571477b5-91d1-421c-b052-b89549a8c236 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:07.099853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-571477b5-91d1-421c-b052-b89549a8c236 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:07.101004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-571477b5-91d1-421c-b052-b89549a8c236 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:07.101684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-571477b5-91d1-421c-b052-b89549a8c236 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:07.102639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-571477b5-91d1-421c-b052-b89549a8c236 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:07.389342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-571477b5-91d1-421c-b052-b89549a8c236 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:07.403036 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-571477b5-91d1-421c-b052-b89549a8c236 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1321 microversion: 2.1 time: 0.318290 Sep 10 21:01:07.403850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1697/3469] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:07 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:07.440970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2e275fc2-8821-4924-82d3-45d9671fb99c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:07.441785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2e275fc2-8821-4924-82d3-45d9671fb99c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:07.467753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e275fc2-8821-4924-82d3-45d9671fb99c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:07.470788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e275fc2-8821-4924-82d3-45d9671fb99c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:07.471456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e275fc2-8821-4924-82d3-45d9671fb99c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:07.472479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e275fc2-8821-4924-82d3-45d9671fb99c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:07.473177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e275fc2-8821-4924-82d3-45d9671fb99c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:07.474126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e275fc2-8821-4924-82d3-45d9671fb99c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:07.671319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2e275fc2-8821-4924-82d3-45d9671fb99c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:07.684968 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2e275fc2-8821-4924-82d3-45d9671fb99c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1575 microversion: 2.1 time: 0.275783 Sep 10 21:01:07.685656 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1698/3470] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:07 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1575 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:07.699793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dda12522-0408-4ffb-81a1-e7304a383624 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9949712430>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:07.842710 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dda12522-0408-4ffb-81a1-e7304a383624 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.155882 Sep 10 21:01:07.843687 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1699/3471] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 21:01:07 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:07.868622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5acd81f9-b327-448b-8bde-f1e6fd7a68b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:07.869279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5acd81f9-b327-448b-8bde-f1e6fd7a68b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:07.884548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5acd81f9-b327-448b-8bde-f1e6fd7a68b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:07.885060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5acd81f9-b327-448b-8bde-f1e6fd7a68b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:07.885511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5acd81f9-b327-448b-8bde-f1e6fd7a68b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:07.886738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5acd81f9-b327-448b-8bde-f1e6fd7a68b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:07.887208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5acd81f9-b327-448b-8bde-f1e6fd7a68b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:07.887652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5acd81f9-b327-448b-8bde-f1e6fd7a68b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:08.161684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5acd81f9-b327-448b-8bde-f1e6fd7a68b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:08.170896 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5acd81f9-b327-448b-8bde-f1e6fd7a68b2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.325195 Sep 10 21:01:08.181987 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1700/3472] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:07 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:08.204655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:08.208939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:08.249597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:08.250236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:08.253225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:08.255457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:08.257786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:08.258335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:08.273938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:01:08.274489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:01:08.275283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:01:08.275915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:01:08.276485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:01:08.303440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:08.304238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:08.309102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:08.310819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:08.311771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:08.314549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:08.370251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Getting quotas for project cebec33205424ecf92b54428bdf5eb61. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:01:08.377293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:08.377797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:08.378271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:08.378743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lazy-loading 'fault' on Instance uuid 7301410e-1f12-405a-b630-377c08092f7e {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:08.387345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Getting quotas for user ae0c7612d933424597e1f176be189a0b and project cebec33205424ecf92b54428bdf5eb61. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:01:08.419192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:01:08.422026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:01:08.481374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:08.494591 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c9b1424d-8979-458d-818d-9b55a3f74b03 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1307 microversion: 2.1 time: 0.309140 Sep 10 21:01:08.496901 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1701/3473] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:08 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1307 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:08.519166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:08.520276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:08.549123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:08.549653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:08.560156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:08.566023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:08.566642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:08.567110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:08.577090 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-979f83c7-06a1-486d-b78d-08cf2d3e3dd6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.133416 Sep 10 21:01:08.584570 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1773/3474] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:01:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:01:08.614938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-25d3b68f-cf46-49cf-8e79-92c0367b567e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944836d30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:08.790572 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-25d3b68f-cf46-49cf-8e79-92c0367b567e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.211728 Sep 10 21:01:08.792590 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1774/3475] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 21:01:08 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:08.805992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-18ad3ee6-c003-42dc-b817-af4ead69c36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:08.807118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-18ad3ee6-c003-42dc-b817-af4ead69c36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:08.826775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18ad3ee6-c003-42dc-b817-af4ead69c36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:08.827785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18ad3ee6-c003-42dc-b817-af4ead69c36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:08.828577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18ad3ee6-c003-42dc-b817-af4ead69c36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:08.829564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18ad3ee6-c003-42dc-b817-af4ead69c36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:08.834518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18ad3ee6-c003-42dc-b817-af4ead69c36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:08.835302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18ad3ee6-c003-42dc-b817-af4ead69c36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:09.555268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-18ad3ee6-c003-42dc-b817-af4ead69c36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:09.577597 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-18ad3ee6-c003-42dc-b817-af4ead69c36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1511 microversion: 2.1 time: 0.783389 Sep 10 21:01:09.586787 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1775/3476] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:08 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1511 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:09.619239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e19d71e8-746e-43d5-bb75-fb57b4afe637 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:09.620274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e19d71e8-746e-43d5-bb75-fb57b4afe637 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:09.692670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:09.810356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e19d71e8-746e-43d5-bb75-fb57b4afe637 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:09.828555 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e19d71e8-746e-43d5-bb75-fb57b4afe637 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1224 microversion: 2.1 time: 0.239574 Sep 10 21:01:09.838295 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1776/3477] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:09 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1224 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:09.847166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-50acea7e-32b4-4abf-ab31-ca902177b4f3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:09.873496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-50acea7e-32b4-4abf-ab31-ca902177b4f3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:09.915388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50acea7e-32b4-4abf-ab31-ca902177b4f3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:09.918741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50acea7e-32b4-4abf-ab31-ca902177b4f3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:09.927216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50acea7e-32b4-4abf-ab31-ca902177b4f3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:09.929384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50acea7e-32b4-4abf-ab31-ca902177b4f3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:09.930114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50acea7e-32b4-4abf-ab31-ca902177b4f3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:09.935346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50acea7e-32b4-4abf-ab31-ca902177b4f3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:10.156019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:10.187064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:10.191588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:10.194145 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9ed7896e-350f-4a05-a7dc-a9dd87f50cca tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1659 microversion: 2.32 time: 1.693727 Sep 10 21:01:10.214722 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1702/3478] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:08 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1659 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:10.220902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19c1aa82-d5ae-44d0-9180-a4990c69d767 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99495b3a60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:10.320537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-50acea7e-32b4-4abf-ab31-ca902177b4f3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:10.349268 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-50acea7e-32b4-4abf-ab31-ca902177b4f3 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1575 microversion: 2.1 time: 0.489826 Sep 10 21:01:10.349268 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1777/3479] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:09 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1575 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:10.349268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d093a94-6e5f-49f0-b55c-078888f89091 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:10.349268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6d093a94-6e5f-49f0-b55c-078888f89091 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:10.357805 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-19c1aa82-d5ae-44d0-9180-a4990c69d767 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/detail?changes-since=2022-09-10T20%3A58%3A47Z" status: 200 len: 6332 microversion: 2.1 time: 0.141401 Sep 10 21:01:10.358313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d093a94-6e5f-49f0-b55c-078888f89091 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:10.358623 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1703/3480] 10.222.0.33 () {58 vars in 1220 bytes} [Sat Sep 10 21:01:10 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-10T20%3A58%3A47Z => generated 6332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:10.359419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d093a94-6e5f-49f0-b55c-078888f89091 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:10.360655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d093a94-6e5f-49f0-b55c-078888f89091 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:10.361631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d093a94-6e5f-49f0-b55c-078888f89091 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:10.369788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d093a94-6e5f-49f0-b55c-078888f89091 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:10.370604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d093a94-6e5f-49f0-b55c-078888f89091 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:10.396572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:10.398023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:10.424719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:10.426412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:10.427231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:10.430214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:10.431169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:10.432562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:10.534720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:10.535612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:10.537041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:10.538360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lazy-loading 'fault' on Instance uuid 7301410e-1f12-405a-b630-377c08092f7e {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:10.585655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=12 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:10.670997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:10.686579 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9685b036-0eb2-4944-8279-9e85f7da5f5a tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 200 len: 1307 microversion: 2.1 time: 0.325298 Sep 10 21:01:10.726309 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1704/3481] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:10 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:10.741034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-236f15c5-f0e4-4d72-b897-d0c9357866e6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:10.741702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-236f15c5-f0e4-4d72-b897-d0c9357866e6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:10.760423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-236f15c5-f0e4-4d72-b897-d0c9357866e6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:10.760868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-236f15c5-f0e4-4d72-b897-d0c9357866e6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:10.762993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-236f15c5-f0e4-4d72-b897-d0c9357866e6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:10.774593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-236f15c5-f0e4-4d72-b897-d0c9357866e6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:10.776356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-236f15c5-f0e4-4d72-b897-d0c9357866e6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:10.777044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-236f15c5-f0e4-4d72-b897-d0c9357866e6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:10.805150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6d093a94-6e5f-49f0-b55c-078888f89091 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:10.821309 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6d093a94-6e5f-49f0-b55c-078888f89091 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.488534 Sep 10 21:01:10.823667 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1778/3482] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:10 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:10.835078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8544848-1d07-4bda-a3c4-f22f33dd70c3 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99495d7dc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:10.922158 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c8544848-1d07-4bda-a3c4-f22f33dd70c3 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-708856357" status: 200 len: 664 microversion: 2.1 time: 0.096783 Sep 10 21:01:10.923170 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1779/3483] 10.222.0.33 () {58 vars in 1250 bytes} [Sat Sep 10 21:01:10 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-708856357 => generated 664 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:10.936416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0caf8d09-b2d3-4f80-945c-b69b7405094e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:10.937072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0caf8d09-b2d3-4f80-945c-b69b7405094e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:10.959702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caf8d09-b2d3-4f80-945c-b69b7405094e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:10.960341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caf8d09-b2d3-4f80-945c-b69b7405094e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:10.960967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caf8d09-b2d3-4f80-945c-b69b7405094e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:10.963165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caf8d09-b2d3-4f80-945c-b69b7405094e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:10.963809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caf8d09-b2d3-4f80-945c-b69b7405094e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:10.964432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caf8d09-b2d3-4f80-945c-b69b7405094e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:11.106945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0caf8d09-b2d3-4f80-945c-b69b7405094e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:11.118827 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0caf8d09-b2d3-4f80-945c-b69b7405094e tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1276 microversion: 2.1 time: 0.194569 Sep 10 21:01:11.127696 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1780/3484] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:10 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:11.156205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ded5b28a-fd76-4171-be0a-8530cac6c6ea tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9945014ca0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:11.292398 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ded5b28a-fd76-4171-be0a-8530cac6c6ea tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1466 microversion: 2.1 time: 0.147217 Sep 10 21:01:11.293466 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1781/3485] 10.222.0.33 () {58 vars in 1338 bytes} [Sat Sep 10 21:01:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1466 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:11.309232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:11.314677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:11.332108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:11.333246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:11.336386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:11.337574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:11.342761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:11.343645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:11.359844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-236f15c5-f0e4-4d72-b897-d0c9357866e6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:11.388895 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-236f15c5-f0e4-4d72-b897-d0c9357866e6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c" status: 200 len: 1510 microversion: 2.1 time: 0.658292 Sep 10 21:01:11.389777 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1705/3486] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:10 2022] GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c => generated 1510 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:11.442634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-617068cb-1d18-4557-bd4d-ca359c0e9a79 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944d73dc0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:11.561122 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-617068cb-1d18-4557-bd4d-ca359c0e9a79 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1466 microversion: 2.1 time: 0.154267 Sep 10 21:01:11.562029 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1706/3487] 10.222.0.33 () {58 vars in 1324 bytes} [Sat Sep 10 21:01:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1466 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:11.572377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f7b76a79-34dd-4ba6-a859-4aa0b7373779 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:11.576176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f7b76a79-34dd-4ba6-a859-4aa0b7373779 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:11.591278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b76a79-34dd-4ba6-a859-4aa0b7373779 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:11.592595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b76a79-34dd-4ba6-a859-4aa0b7373779 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:11.593925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b76a79-34dd-4ba6-a859-4aa0b7373779 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:11.595801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b76a79-34dd-4ba6-a859-4aa0b7373779 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:11.597743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b76a79-34dd-4ba6-a859-4aa0b7373779 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:11.599851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7b76a79-34dd-4ba6-a859-4aa0b7373779 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:11.865584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:11.889944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:11.891516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:11.896748 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c5d6c224-637c-4990-a8ed-195eb9f9239f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1705 microversion: 2.32 time: 0.598087 Sep 10 21:01:11.897687 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1782/3488] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:11 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1705 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:11.910316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:11.920214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:11.920964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:11.940524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:11.957840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:11.958352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:11.979113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:11.980077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:11.982226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:11.982699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:12.017679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f7b76a79-34dd-4ba6-a859-4aa0b7373779 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:12.032320 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f7b76a79-34dd-4ba6-a859-4aa0b7373779 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1580 microversion: 2.1 time: 0.465757 Sep 10 21:01:12.033887 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1707/3489] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:11 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1580 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:12.045634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7b666419-3029-4ca5-b1f7-be24648771c7 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99450e7790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:12.228746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:12.270764 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7b666419-3029-4ca5-b1f7-be24648771c7 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.233222 Sep 10 21:01:12.271971 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1708/3490] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Sep 10 21:01:12 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:12.276882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:12.277778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 7301410e-1f12-405a-b630-377c08092f7e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:12.288376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:12.291451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:12.292187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:12.293147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:12.293842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:12.294561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:12.306239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:12.323472 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] HTTP exception thrown: Instance 7301410e-1f12-405a-b630-377c08092f7e could not be found. Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Request method failure captured: Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e HTTP/1.1 Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpD3XorJTOmshO8ShrGydR5Yh_ZW0GoFIPFNux3cdIuCEy4uljcIp1YR897IiLrXZKVrCAKwE0sC-SMLCx-PCumGee9Ldi4xcTYCHtnGk7w6VvimIT9qdN4eJRT9gk5WZTFLHhN4iq_vV4cb9iSKJhhLieaETbdjqgODHmuRL06q2E Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d30ef9b7525e4784be26268f46121e62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d30ef9b7525e4784be26268f46121e62"}]}] Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: f38321284ec449e599d645625ed11139 Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 7301410e-1f12-405a-b630-377c08092f7e could not be found. Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7301410e-1f12-405a-b630-377c08092f7e'} Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7301410e-1f12-405a-b630-377c08092f7e could not be found. Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7301410e-1f12-405a-b630-377c08092f7e could not be found. Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:12.325545 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:12.332419 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:12.332419 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:12.332419 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:12.332419 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:12.332419 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:12.332419 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7301410e-1f12-405a-b630-377c08092f7e could not be found. Sep 10 21:01:12.332419 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:12.334839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Returning 404 to user: Instance 7301410e-1f12-405a-b630-377c08092f7e could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:12.336643 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4ed63e17-58e9-4a35-b7c4-68d82a98c352 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e" status: 404 len: 111 microversion: 2.1 time: 0.063519 Sep 10 21:01:12.337441 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1709/3491] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:12 2022] GET /compute/v2.1/servers/7301410e-1f12-405a-b630-377c08092f7e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:12.345933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-74212eca-8c8b-489d-8175-db4b38cb8a17 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:12.347344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-74212eca-8c8b-489d-8175-db4b38cb8a17 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:12.352479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:12.355261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74212eca-8c8b-489d-8175-db4b38cb8a17 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:12.356185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74212eca-8c8b-489d-8175-db4b38cb8a17 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:12.356925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74212eca-8c8b-489d-8175-db4b38cb8a17 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:12.358116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74212eca-8c8b-489d-8175-db4b38cb8a17 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:12.358865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74212eca-8c8b-489d-8175-db4b38cb8a17 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:12.359005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:12.359386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:12.359865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:12.360189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74212eca-8c8b-489d-8175-db4b38cb8a17 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:12.653471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-74212eca-8c8b-489d-8175-db4b38cb8a17 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:12.667110 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-74212eca-8c8b-489d-8175-db4b38cb8a17 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.328234 Sep 10 21:01:12.681947 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1710/3492] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:12 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:12.681947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e758d0a3-f45a-4414-bfe1-ae1f4b969419 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:12.681947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e758d0a3-f45a-4414-bfe1-ae1f4b969419 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:12.698663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e758d0a3-f45a-4414-bfe1-ae1f4b969419 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:12.699176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e758d0a3-f45a-4414-bfe1-ae1f4b969419 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:12.705544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e758d0a3-f45a-4414-bfe1-ae1f4b969419 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:12.706405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e758d0a3-f45a-4414-bfe1-ae1f4b969419 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:12.707137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e758d0a3-f45a-4414-bfe1-ae1f4b969419 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:12.707595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e758d0a3-f45a-4414-bfe1-ae1f4b969419 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:12.835635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e758d0a3-f45a-4414-bfe1-ae1f4b969419 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:12.860630 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e758d0a3-f45a-4414-bfe1-ae1f4b969419 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1282 microversion: 2.1 time: 0.186481 Sep 10 21:01:12.862094 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1711/3493] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:12 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:12.873203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d4101149-f7fa-4422-9aa4-7d2f10f52c3b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99495f1c10>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:12.992920 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d4101149-f7fa-4422-9aa4-7d2f10f52c3b tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.129438 Sep 10 21:01:13.005731 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1712/3494] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Sep 10 21:01:12 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:13.013354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-959d5893-ff56-4daf-b2b7-1a63c08eb5e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:13.018666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-959d5893-ff56-4daf-b2b7-1a63c08eb5e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:13.029257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-959d5893-ff56-4daf-b2b7-1a63c08eb5e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:13.030056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-959d5893-ff56-4daf-b2b7-1a63c08eb5e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:13.030663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-959d5893-ff56-4daf-b2b7-1a63c08eb5e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:13.031666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-959d5893-ff56-4daf-b2b7-1a63c08eb5e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:13.032514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-959d5893-ff56-4daf-b2b7-1a63c08eb5e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:13.033381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-959d5893-ff56-4daf-b2b7-1a63c08eb5e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:13.063988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-959d5893-ff56-4daf-b2b7-1a63c08eb5e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:13.180088 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-959d5893-ff56-4daf-b2b7-1a63c08eb5e6 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "DELETE /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 204 len: 0 microversion: 2.1 time: 0.172221 Sep 10 21:01:13.185037 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1713/3495] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:13 2022] DELETE /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:13.192286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:13.193210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:13.202785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:13.203456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:13.204576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:13.205993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:13.206667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:13.207402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:13.413165 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-070d672c-87cf-4790-834c-8d761964c18a tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 1.514341 Sep 10 21:01:13.414481 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1783/3496] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Sep 10 21:01:11 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:13.419457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2d89060d-ea0c-400c-8eb6-ef254192acb3 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99495e69d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:13.531584 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2d89060d-ea0c-400c-8eb6-ef254192acb3 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/b43a7a8a-2616-430e-9e50-ef93c087ed12" status: 200 len: 784 microversion: 2.1 time: 0.115493 Sep 10 21:01:13.532838 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1784/3497] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Sep 10 21:01:13 2022] GET /compute/v2.1/images/b43a7a8a-2616-430e-9e50-ef93c087ed12 => generated 784 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:13.562877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0096c2e3-0e7e-41d4-9527-cd7558058489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:13.564746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0096c2e3-0e7e-41d4-9527-cd7558058489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:13.575733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0096c2e3-0e7e-41d4-9527-cd7558058489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:13.576672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0096c2e3-0e7e-41d4-9527-cd7558058489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:13.577282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0096c2e3-0e7e-41d4-9527-cd7558058489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:13.578254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0096c2e3-0e7e-41d4-9527-cd7558058489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:13.580133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0096c2e3-0e7e-41d4-9527-cd7558058489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:13.580837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0096c2e3-0e7e-41d4-9527-cd7558058489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:13.682009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:13.694825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:13.708503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:13.709950 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c7e12b97-2209-44d7-bd32-e3bc858b25b9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1739 microversion: 2.32 time: 0.523227 Sep 10 21:01:13.710682 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1714/3498] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:13 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1739 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:13.743486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d06c059a-9ba7-4d6d-a9ce-7509012af9fa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:13.744330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d06c059a-9ba7-4d6d-a9ce-7509012af9fa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:13.761650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d06c059a-9ba7-4d6d-a9ce-7509012af9fa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:13.762375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d06c059a-9ba7-4d6d-a9ce-7509012af9fa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:13.762936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d06c059a-9ba7-4d6d-a9ce-7509012af9fa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:13.763813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d06c059a-9ba7-4d6d-a9ce-7509012af9fa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:13.764464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d06c059a-9ba7-4d6d-a9ce-7509012af9fa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:13.765047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d06c059a-9ba7-4d6d-a9ce-7509012af9fa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:13.912528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0096c2e3-0e7e-41d4-9527-cd7558058489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:13.942765 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0096c2e3-0e7e-41d4-9527-cd7558058489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1573 microversion: 2.1 time: 0.406817 Sep 10 21:01:13.945681 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1785/3499] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:13 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1573 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:13.973934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:14.006276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:14.007262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1047077967', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:14.021206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:14.021696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:14.026251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:14.027304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:14.030461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:14.031090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:14.253336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:14.369897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d06c059a-9ba7-4d6d-a9ce-7509012af9fa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:14.375130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:14.381423 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d06c059a-9ba7-4d6d-a9ce-7509012af9fa tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1472 microversion: 2.1 time: 0.654157 Sep 10 21:01:14.392678 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1715/3500] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:13 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1472 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:14.399516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:14.400066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:14.400517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:14.401860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-493ee973-4267-4dbb-b8b6-27b03029fda3 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944c45550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:14.473626 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-493ee973-4267-4dbb-b8b6-27b03029fda3 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.079094 Sep 10 21:01:14.474634 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1716/3501] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 21:01:14 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:14.479704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b1ee2f9a-5f88-40ed-8866-315b9d814c8e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:14.480555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b1ee2f9a-5f88-40ed-8866-315b9d814c8e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:14.496212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1ee2f9a-5f88-40ed-8866-315b9d814c8e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:14.496808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1ee2f9a-5f88-40ed-8866-315b9d814c8e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:14.497250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1ee2f9a-5f88-40ed-8866-315b9d814c8e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:14.498096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1ee2f9a-5f88-40ed-8866-315b9d814c8e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:14.498567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1ee2f9a-5f88-40ed-8866-315b9d814c8e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:14.498995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1ee2f9a-5f88-40ed-8866-315b9d814c8e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:14.666792 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-feddf82f-cfc8-4768-b69d-a3dab4a69b9c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1047077967" status: 200 len: 1514 microversion: 2.1 time: 0.719968 Sep 10 21:01:14.683669 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1786/3502] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 21:01:13 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1047077967 => generated 1514 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:14.683669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c32385c6-334b-43a9-b765-50cf64b8a4f7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:14.683669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c32385c6-334b-43a9-b765-50cf64b8a4f7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:14.691542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c32385c6-334b-43a9-b765-50cf64b8a4f7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:14.691796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c32385c6-334b-43a9-b765-50cf64b8a4f7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:14.692595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c32385c6-334b-43a9-b765-50cf64b8a4f7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:14.693879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c32385c6-334b-43a9-b765-50cf64b8a4f7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:14.696506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c32385c6-334b-43a9-b765-50cf64b8a4f7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:14.697418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c32385c6-334b-43a9-b765-50cf64b8a4f7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:14.788502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b1ee2f9a-5f88-40ed-8866-315b9d814c8e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:14.799230 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b1ee2f9a-5f88-40ed-8866-315b9d814c8e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.323295 Sep 10 21:01:14.799825 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1717/3503] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:14 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:14.805191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e2c74f8a-d162-4596-a440-8c4f04ec587a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2129623339"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:14.806028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e2c74f8a-d162-4596-a440-8c4f04ec587a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:14.814616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c74f8a-d162-4596-a440-8c4f04ec587a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:14.815427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c74f8a-d162-4596-a440-8c4f04ec587a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:14.816091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c74f8a-d162-4596-a440-8c4f04ec587a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:14.816893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c74f8a-d162-4596-a440-8c4f04ec587a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:14.817595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c74f8a-d162-4596-a440-8c4f04ec587a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:14.818189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c74f8a-d162-4596-a440-8c4f04ec587a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:14.927857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c32385c6-334b-43a9-b765-50cf64b8a4f7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:14.941106 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c32385c6-334b-43a9-b765-50cf64b8a4f7 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1324 microversion: 2.1 time: 0.263976 Sep 10 21:01:14.943716 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1787/3504] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:14 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:14.955097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3daa061f-ea08-4220-a137-4faaf446ecac tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944bab8b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:15.119517 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.network.security_group_api [None req-e2c74f8a-d162-4596-a440-8c4f04ec587a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Adding security group c269785c-3bfe-4271-b096-816698db85f6 to port ffdf3005-b7dc-44e1-8c27-8c4179511d4f Sep 10 21:01:16.201084 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e2c74f8a-d162-4596-a440-8c4f04ec587a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8/action" status: 202 len: 0 microversion: 2.1 time: 1.399678 Sep 10 21:01:16.210332 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1718/3505] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:14 2022] POST /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8/action => generated 0 bytes in 1410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:16.216892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:16.229384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:16.232761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:16.253190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:16.256378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:16.258929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:16.263156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:16.264039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:16.265241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:16.535898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:16.544082 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3daa061f-ea08-4220-a137-4faaf446ecac tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "DELETE /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4" status: 204 len: 0 microversion: 2.1 time: 1.593427 Sep 10 21:01:16.544998 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1788/3506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:14 2022] DELETE /compute/v2.1/images/c977fa44-9358-4142-8080-f9f3cb9827a4 => generated 0 bytes in 1601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:16.552758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:16.557401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:16.598142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:16.607193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:16.608648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:16.609641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:16.611152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:16.612228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:16.689234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:16.781861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:16.802513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:16.803229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:16.803735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:17.084818 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-33132dc3-886d-4906-83af-125e95e03a06 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.873044 Sep 10 21:01:17.085778 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1719/3507] 10.222.0.33 () {58 vars in 1173 bytes} [Sat Sep 10 21:01:16 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:17.091036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d4de31f0-1519-4de7-ba77-346a61b50256 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:17.092102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4de31f0-1519-4de7-ba77-346a61b50256 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:17.100088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4de31f0-1519-4de7-ba77-346a61b50256 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:17.101049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4de31f0-1519-4de7-ba77-346a61b50256 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:17.102477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4de31f0-1519-4de7-ba77-346a61b50256 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:17.103714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4de31f0-1519-4de7-ba77-346a61b50256 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:17.104399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4de31f0-1519-4de7-ba77-346a61b50256 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:17.105364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4de31f0-1519-4de7-ba77-346a61b50256 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:17.467390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d4de31f0-1519-4de7-ba77-346a61b50256 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:17.478074 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d4de31f0-1519-4de7-ba77-346a61b50256 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1472 microversion: 2.1 time: 0.390661 Sep 10 21:01:17.498486 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1720/3508] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:17 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:17.509781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-469dee78-c36d-416c-bd32-1e484f8ec9be tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:17.513614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-469dee78-c36d-416c-bd32-1e484f8ec9be tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:17.530717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-469dee78-c36d-416c-bd32-1e484f8ec9be tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:17.533615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-469dee78-c36d-416c-bd32-1e484f8ec9be tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:17.534418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-469dee78-c36d-416c-bd32-1e484f8ec9be tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:17.535430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-469dee78-c36d-416c-bd32-1e484f8ec9be tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:17.537457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-469dee78-c36d-416c-bd32-1e484f8ec9be tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:17.538206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-469dee78-c36d-416c-bd32-1e484f8ec9be tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:17.826699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-469dee78-c36d-416c-bd32-1e484f8ec9be tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:17.837508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:17.844305 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-469dee78-c36d-416c-bd32-1e484f8ec9be tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.342110 Sep 10 21:01:17.845002 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1721/3509] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:17 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:17.853326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ee5a4c34-ad87-49d9-beb5-b8db4acc8db6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:17.854514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ee5a4c34-ad87-49d9-beb5-b8db4acc8db6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:17.861255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee5a4c34-ad87-49d9-beb5-b8db4acc8db6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:17.865870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:17.868817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:17.870028 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bd969761-f949-40d9-938b-ff705bddd6df tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1831 microversion: 2.32 time: 1.324006 Sep 10 21:01:17.870603 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1789/3510] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:16 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1831 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:17.875092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c0c83e57-224f-4e97-bd57-d06fd45ec31b req-ebf6ce91-8162-4423-a2af-7edff0043460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f34498-848f-44b8-92af-e6fbd1760ba6", "tag": "2df22809-20c4-4a16-8747-2eab50949e85"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:17.878405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee5a4c34-ad87-49d9-beb5-b8db4acc8db6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:17.879095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee5a4c34-ad87-49d9-beb5-b8db4acc8db6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:17.879875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee5a4c34-ad87-49d9-beb5-b8db4acc8db6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:17.880352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee5a4c34-ad87-49d9-beb5-b8db4acc8db6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:17.881959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee5a4c34-ad87-49d9-beb5-b8db4acc8db6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:17.899893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c0c83e57-224f-4e97-bd57-d06fd45ec31b req-ebf6ce91-8162-4423-a2af-7edff0043460 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:17.900408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c0c83e57-224f-4e97-bd57-d06fd45ec31b req-ebf6ce91-8162-4423-a2af-7edff0043460 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:17.900954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c0c83e57-224f-4e97-bd57-d06fd45ec31b req-ebf6ce91-8162-4423-a2af-7edff0043460 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:17.916171 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c0c83e57-224f-4e97-bd57-d06fd45ec31b req-ebf6ce91-8162-4423-a2af-7edff0043460 service nova] Creating event network-changed:2df22809-20c4-4a16-8747-2eab50949e85 for instance 03f34498-848f-44b8-92af-e6fbd1760ba6 on nch2-master-1 Sep 10 21:01:17.922728 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c0c83e57-224f-4e97-bd57-d06fd45ec31b req-ebf6ce91-8162-4423-a2af-7edff0043460 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050441 Sep 10 21:01:17.923334 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1790/3511] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:17.930660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-885ea7b3-7f1a-4dd5-952e-bd32573f7dc0 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f993ff0e820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:18.040214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-885ea7b3-7f1a-4dd5-952e-bd32573f7dc0 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group c269785c-3bfe-4271-b096-816698db85f6 in use.", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:01:18.040933 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-885ea7b3-7f1a-4dd5-952e-bd32573f7dc0 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security Group c269785c-3bfe-4271-b096-816698db85f6 in use. Sep 10 21:01:18.040933 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-b5ad5156-179b-4c45-9a2f-41e2c85058a3'] Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-885ea7b3-7f1a-4dd5-952e-bd32573f7dc0 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-security-groups/c269785c-3bfe-4271-b096-816698db85f6 HTTP/1.1 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: exception: Security Group c269785c-3bfe-4271-b096-816698db85f6 in use. Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-b5ad5156-179b-4c45-9a2f-41e2c85058a3'] Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c269785c-3bfe-4271-b096-816698db85f6'} Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:01:18.043298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group c269785c-3bfe-4271-b096-816698db85f6 in use. Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5ad5156-179b-4c45-9a2f-41e2c85058a3'] Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group c269785c-3bfe-4271-b096-816698db85f6 in use. Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5ad5156-179b-4c45-9a2f-41e2c85058a3'] Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group c269785c-3bfe-4271-b096-816698db85f6 in use. Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5ad5156-179b-4c45-9a2f-41e2c85058a3'] Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group c269785c-3bfe-4271-b096-816698db85f6 in use. Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5ad5156-179b-4c45-9a2f-41e2c85058a3'] Sep 10 21:01:18.049324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:18.056215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ee5a4c34-ad87-49d9-beb5-b8db4acc8db6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:18.056408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-885ea7b3-7f1a-4dd5-952e-bd32573f7dc0 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 400 to user: Security Group c269785c-3bfe-4271-b096-816698db85f6 in use. Sep 10 21:01:18.056408 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-b5ad5156-179b-4c45-9a2f-41e2c85058a3'] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:18.056408 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-885ea7b3-7f1a-4dd5-952e-bd32573f7dc0 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/c269785c-3bfe-4271-b096-816698db85f6" status: 400 len: 185 microversion: 2.1 time: 0.130074 Sep 10 21:01:18.056408 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1791/3512] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:17 2022] DELETE /compute/v2.1/os-security-groups/c269785c-3bfe-4271-b096-816698db85f6 => generated 185 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:01:18.061308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28608e06-66a3-49fa-859d-33dd608d8a59 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944916dc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:18.061552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ee5a4c34-ad87-49d9-beb5-b8db4acc8db6 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1324 microversion: 2.1 time: 0.215122 Sep 10 21:01:18.062416 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1722/3513] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:17 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1324 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:18.086627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:18.098160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:18.099063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.compute.servers [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Removing options 'limit' from query {{(pid=145771) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 21:01:18.099923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:18.105537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.106209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.106754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:18.107693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.108581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.109089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:18.145045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:18.151401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.152005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.152517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:18.280017 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-40728b05-c319-4dfa-aff2-7a1a4b1d61c0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.203208 Sep 10 21:01:18.280791 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1723/3514] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 21:01:18 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:18.286327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e14f96c7-b57a-42c4-8d70-54537c3a2e40 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:18.287052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e14f96c7-b57a-42c4-8d70-54537c3a2e40 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:18.304157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e14f96c7-b57a-42c4-8d70-54537c3a2e40 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.306037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e14f96c7-b57a-42c4-8d70-54537c3a2e40 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.306997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e14f96c7-b57a-42c4-8d70-54537c3a2e40 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:18.308147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e14f96c7-b57a-42c4-8d70-54537c3a2e40 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.309290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e14f96c7-b57a-42c4-8d70-54537c3a2e40 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.309735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e14f96c7-b57a-42c4-8d70-54537c3a2e40 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:18.345862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e14f96c7-b57a-42c4-8d70-54537c3a2e40 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:18.416007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:18.448288 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e14f96c7-b57a-42c4-8d70-54537c3a2e40 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 204 len: 0 microversion: 2.1 time: 0.165984 Sep 10 21:01:18.448890 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1724/3515] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:18 2022] DELETE /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:18.454619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:18.459488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:18.460281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:18.465680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.466219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.466855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:18.467591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.468239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.468488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:18.562226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:18.663664 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5525ec87-4351-45f6-b81f-a27a3256b03f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.212661 Sep 10 21:01:18.665160 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1725/3516] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 21:01:18 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:18.673450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-45ada5fb-0534-45b7-b4ec-9df50ee808b5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:18.674776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-45ada5fb-0534-45b7-b4ec-9df50ee808b5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:18.689729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45ada5fb-0534-45b7-b4ec-9df50ee808b5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.691301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45ada5fb-0534-45b7-b4ec-9df50ee808b5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.692782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45ada5fb-0534-45b7-b4ec-9df50ee808b5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:18.694247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45ada5fb-0534-45b7-b4ec-9df50ee808b5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.695279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45ada5fb-0534-45b7-b4ec-9df50ee808b5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.696203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45ada5fb-0534-45b7-b4ec-9df50ee808b5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:18.763104 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-28608e06-66a3-49fa-859d-33dd608d8a59 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "DELETE /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e" status: 204 len: 0 microversion: 2.1 time: 0.706676 Sep 10 21:01:18.763668 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1792/3517] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:18 2022] DELETE /compute/v2.1/images/03a0038b-7a05-4232-88d9-d3d794d8d70e => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:18.770026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f29e980c-94ff-4f43-8a2c-8cd2d47a75d7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:18.773559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f29e980c-94ff-4f43-8a2c-8cd2d47a75d7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:18.786216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f29e980c-94ff-4f43-8a2c-8cd2d47a75d7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.787107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f29e980c-94ff-4f43-8a2c-8cd2d47a75d7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.787777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f29e980c-94ff-4f43-8a2c-8cd2d47a75d7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:18.788716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f29e980c-94ff-4f43-8a2c-8cd2d47a75d7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:18.789407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f29e980c-94ff-4f43-8a2c-8cd2d47a75d7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:18.790078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f29e980c-94ff-4f43-8a2c-8cd2d47a75d7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.055427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f29e980c-94ff-4f43-8a2c-8cd2d47a75d7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:19.063583 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f29e980c-94ff-4f43-8a2c-8cd2d47a75d7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1472 microversion: 2.1 time: 0.298448 Sep 10 21:01:19.082137 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1793/3518] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:18 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:19.082336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-45ada5fb-0534-45b7-b4ec-9df50ee808b5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:19.092131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:19.093455 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-45ada5fb-0534-45b7-b4ec-9df50ee808b5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1648 microversion: 2.1 time: 0.424997 Sep 10 21:01:19.095964 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1726/3519] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:18 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1648 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:19.102853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09237e17-56c6-4047-93a2-39f3c484ff00 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944e4c310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:19.114681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:19.115453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.compute.servers [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Removing options 'limit' from query {{(pid=145772) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 21:01:19.116499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:19.125014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.125754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.126374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.127307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.127938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.128542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.170673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:19.216234 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-adb41e29-d879-43d0-aba9-b32c4b95d877 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.132296 Sep 10 21:01:19.218150 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1794/3520] 10.222.0.33 () {58 vars in 1150 bytes} [Sat Sep 10 21:01:19 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:19.225594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ca5f3fc2-7fd6-4e7e-8fb0-d69a206e0eca tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:19.226469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ca5f3fc2-7fd6-4e7e-8fb0-d69a206e0eca tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:19.233124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5f3fc2-7fd6-4e7e-8fb0-d69a206e0eca tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.233904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5f3fc2-7fd6-4e7e-8fb0-d69a206e0eca tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.234554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5f3fc2-7fd6-4e7e-8fb0-d69a206e0eca tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.235765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5f3fc2-7fd6-4e7e-8fb0-d69a206e0eca tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.236382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5f3fc2-7fd6-4e7e-8fb0-d69a206e0eca tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.236968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5f3fc2-7fd6-4e7e-8fb0-d69a206e0eca tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.512749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ca5f3fc2-7fd6-4e7e-8fb0-d69a206e0eca tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:19.542176 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ca5f3fc2-7fd6-4e7e-8fb0-d69a206e0eca tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.322633 Sep 10 21:01:19.542747 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1795/3521] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:19 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:19.549393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:19.550039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:19.555981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.556687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.557347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.558237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.558862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.559739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.772402 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09237e17-56c6-4047-93a2-39f3c484ff00 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "DELETE /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be" status: 204 len: 0 microversion: 2.1 time: 0.675156 Sep 10 21:01:19.773118 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1727/3522] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:19 2022] DELETE /compute/v2.1/images/5cdf9b55-0b48-453a-b40c-49fedd51b5be => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:19.780714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-445e2d7b-d678-46e8-9d3b-decebc961f49 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:19.781469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-445e2d7b-d678-46e8-9d3b-decebc961f49 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:19.788920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-445e2d7b-d678-46e8-9d3b-decebc961f49 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.793917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-445e2d7b-d678-46e8-9d3b-decebc961f49 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.795970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-445e2d7b-d678-46e8-9d3b-decebc961f49 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.800713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-445e2d7b-d678-46e8-9d3b-decebc961f49 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.801194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-445e2d7b-d678-46e8-9d3b-decebc961f49 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.802006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-445e2d7b-d678-46e8-9d3b-decebc961f49 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.810186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:19.821343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:19.823393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:19.824571 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-143824f8-503f-41a1-8a7d-68f3d6533af4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1831 microversion: 2.32 time: 0.278910 Sep 10 21:01:19.825431 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1796/3523] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:19 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1831 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:19.830908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:19.835947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:19.836831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:19.842201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.842946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.843535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.844594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.845206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.845769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.878810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:19.909152 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b06dc9ff-99a7-42f6-81aa-c184177144ee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.082469 Sep 10 21:01:19.910310 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1797/3524] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 21:01:19 2022] GET /compute/v2.1/servers => generated 1010 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:19.915168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a3e6f9bf-94cc-4a87-a05a-5bfb134b633c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:19.915889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a3e6f9bf-94cc-4a87-a05a-5bfb134b633c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:19.922659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3e6f9bf-94cc-4a87-a05a-5bfb134b633c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.923214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3e6f9bf-94cc-4a87-a05a-5bfb134b633c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.924071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3e6f9bf-94cc-4a87-a05a-5bfb134b633c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.924785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3e6f9bf-94cc-4a87-a05a-5bfb134b633c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:19.925237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3e6f9bf-94cc-4a87-a05a-5bfb134b633c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:19.925661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a3e6f9bf-94cc-4a87-a05a-5bfb134b633c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:19.952438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a3e6f9bf-94cc-4a87-a05a-5bfb134b633c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:20.035550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-445e2d7b-d678-46e8-9d3b-decebc961f49 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:20.056843 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-445e2d7b-d678-46e8-9d3b-decebc961f49 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1324 microversion: 2.1 time: 0.281814 Sep 10 21:01:20.057732 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a3e6f9bf-94cc-4a87-a05a-5bfb134b633c tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 204 len: 0 microversion: 2.1 time: 0.145934 Sep 10 21:01:20.058946 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1798/3525] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:19 2022] DELETE /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:20.067920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6f6fbb85-b576-41ba-bb02-fc740e3c8b49 req-570a50bd-e848-4b80-86f1-652f0db67d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "tag": "927c985e-c5fa-49ba-ad56-493d19eca859"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:20.077175 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1728/3526] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:19 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1324 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:20.081592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6f6fbb85-b576-41ba-bb02-fc740e3c8b49 req-570a50bd-e848-4b80-86f1-652f0db67d8d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.083151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6f6fbb85-b576-41ba-bb02-fc740e3c8b49 req-570a50bd-e848-4b80-86f1-652f0db67d8d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.084084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6f6fbb85-b576-41ba-bb02-fc740e3c8b49 req-570a50bd-e848-4b80-86f1-652f0db67d8d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.089816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:20.100602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:20.101573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:20.102010 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6f6fbb85-b576-41ba-bb02-fc740e3c8b49 req-570a50bd-e848-4b80-86f1-652f0db67d8d service nova] Creating event network-changed:927c985e-c5fa-49ba-ad56-493d19eca859 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:01:20.110730 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6f6fbb85-b576-41ba-bb02-fc740e3c8b49 req-570a50bd-e848-4b80-86f1-652f0db67d8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047610 Sep 10 21:01:20.112676 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1799/3527] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:20.117794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.118495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.119103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.120005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.120615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.121024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d5f8a8c1-a501-4717-989a-8952fee3add6 req-ef114c3f-9baa-4288-85ce-c48889655f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ab7365-3c1e-4122-b234-34076143bce8", "tag": "ffdf3005-b7dc-44e1-8c27-8c4179511d4f"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:20.121397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.135109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d5f8a8c1-a501-4717-989a-8952fee3add6 req-ef114c3f-9baa-4288-85ce-c48889655f8d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.135624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d5f8a8c1-a501-4717-989a-8952fee3add6 req-ef114c3f-9baa-4288-85ce-c48889655f8d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.136122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d5f8a8c1-a501-4717-989a-8952fee3add6 req-ef114c3f-9baa-4288-85ce-c48889655f8d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.153705 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d5f8a8c1-a501-4717-989a-8952fee3add6 req-ef114c3f-9baa-4288-85ce-c48889655f8d service nova] Creating event network-changed:ffdf3005-b7dc-44e1-8c27-8c4179511d4f for instance 16ab7365-3c1e-4122-b234-34076143bce8 on nch1-master-1 Sep 10 21:01:20.160364 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d5f8a8c1-a501-4717-989a-8952fee3add6 req-ef114c3f-9baa-4288-85ce-c48889655f8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046241 Sep 10 21:01:20.161534 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1800/3528] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:20.167669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-64e058d9-5aa8-440e-842c-7125f4e37585 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:20.168711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-64e058d9-5aa8-440e-842c-7125f4e37585 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:20.175975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64e058d9-5aa8-440e-842c-7125f4e37585 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.176588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64e058d9-5aa8-440e-842c-7125f4e37585 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.177123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64e058d9-5aa8-440e-842c-7125f4e37585 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.178261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64e058d9-5aa8-440e-842c-7125f4e37585 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.178823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64e058d9-5aa8-440e-842c-7125f4e37585 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.179364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64e058d9-5aa8-440e-842c-7125f4e37585 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.225440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:20.294959 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62945c52-7930-41d4-b8b5-5c6b0e50dc99 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.216196 Sep 10 21:01:20.295182 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1729/3529] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 21:01:20 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:20.301109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b4698434-3918-4740-9b51-0524d20517f9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:20.304112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b4698434-3918-4740-9b51-0524d20517f9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:20.308016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4698434-3918-4740-9b51-0524d20517f9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.308520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4698434-3918-4740-9b51-0524d20517f9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.308940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4698434-3918-4740-9b51-0524d20517f9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.309666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4698434-3918-4740-9b51-0524d20517f9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.310147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4698434-3918-4740-9b51-0524d20517f9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.310591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4698434-3918-4740-9b51-0524d20517f9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.396348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-64e058d9-5aa8-440e-842c-7125f4e37585 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:20.405619 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-64e058d9-5aa8-440e-842c-7125f4e37585 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1473 microversion: 2.1 time: 0.242705 Sep 10 21:01:20.409441 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1801/3530] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:20 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1473 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:20.417890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c4d36b0-2db9-4066-a05f-d2b467bf0c1f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:20.418705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c4d36b0-2db9-4066-a05f-d2b467bf0c1f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:20.436387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d36b0-2db9-4066-a05f-d2b467bf0c1f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.440394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d36b0-2db9-4066-a05f-d2b467bf0c1f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.440863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d36b0-2db9-4066-a05f-d2b467bf0c1f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.441615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d36b0-2db9-4066-a05f-d2b467bf0c1f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.442931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d36b0-2db9-4066-a05f-d2b467bf0c1f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.443380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d36b0-2db9-4066-a05f-d2b467bf0c1f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.494249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b4698434-3918-4740-9b51-0524d20517f9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:20.504502 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b4698434-3918-4740-9b51-0524d20517f9 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1472 microversion: 2.1 time: 0.207646 Sep 10 21:01:20.505106 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1730/3531] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:20 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1472 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:20.509800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:20.514974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:20.515612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.compute.servers [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Removing options 'limit' from query {{(pid=145771) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 21:01:20.518156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:20.523903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.524604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.525031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.526311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.526748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.527125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.559809 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-95c2866a-2d75-4df6-bf8d-0b78d1b76f5f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.052001 Sep 10 21:01:20.559809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1731/3532] 10.222.0.33 () {58 vars in 1140 bytes} [Sat Sep 10 21:01:20 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:20.574751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:20.581886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:20.583210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1047077967', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:20.589385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.590518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.591112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.591922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.592370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.592792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.683693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:20.751383 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d6d8aff3-d89f-4cd1-915a-a3e9e5085c81 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1047077967" status: 200 len: 346 microversion: 2.1 time: 0.180959 Sep 10 21:01:20.752373 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1732/3533] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Sep 10 21:01:20 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1047077967 => generated 346 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:20.756976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a3485adc-23de-43e6-ac5b-fd6923f06494 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:20.757586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a3485adc-23de-43e6-ac5b-fd6923f06494 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:20.763530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3485adc-23de-43e6-ac5b-fd6923f06494 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.764020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3485adc-23de-43e6-ac5b-fd6923f06494 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.764458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3485adc-23de-43e6-ac5b-fd6923f06494 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.765218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3485adc-23de-43e6-ac5b-fd6923f06494 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.765373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c4d36b0-2db9-4066-a05f-d2b467bf0c1f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:20.765614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3485adc-23de-43e6-ac5b-fd6923f06494 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.766652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3485adc-23de-43e6-ac5b-fd6923f06494 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.776499 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c4d36b0-2db9-4066-a05f-d2b467bf0c1f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1648 microversion: 2.1 time: 0.365546 Sep 10 21:01:20.787478 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1802/3534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:20 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1648 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:20.793358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-274831ec-0324-4edc-a8b3-49f57ab992b7 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:20.804838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-274831ec-0324-4edc-a8b3-49f57ab992b7 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.805335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-274831ec-0324-4edc-a8b3-49f57ab992b7 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.805793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-274831ec-0324-4edc-a8b3-49f57ab992b7 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.831449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-274831ec-0324-4edc-a8b3-49f57ab992b7 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Going to try to stop instance {{(pid=145772) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 21:01:20.888520 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-274831ec-0324-4edc-a8b3-49f57ab992b7 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "POST /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d/action" status: 202 len: 0 microversion: 2.1 time: 0.099629 Sep 10 21:01:20.889152 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1803/3535] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:20 2022] POST /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:20.895505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:20.896252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:20.902473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.902971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.903793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.904733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.905425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.906125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:20.956435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3485adc-23de-43e6-ac5b-fd6923f06494 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:20.965566 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a3485adc-23de-43e6-ac5b-fd6923f06494 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.212086 Sep 10 21:01:20.986303 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1733/3536] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:20 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:20.991549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-21e40a04-aa1e-4281-a5fe-3e6ccee46d2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:20.992354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-21e40a04-aa1e-4281-a5fe-3e6ccee46d2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:20.998501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e40a04-aa1e-4281-a5fe-3e6ccee46d2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:20.998990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e40a04-aa1e-4281-a5fe-3e6ccee46d2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:20.999429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e40a04-aa1e-4281-a5fe-3e6ccee46d2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:21.000124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e40a04-aa1e-4281-a5fe-3e6ccee46d2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:21.000616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e40a04-aa1e-4281-a5fe-3e6ccee46d2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:21.001047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e40a04-aa1e-4281-a5fe-3e6ccee46d2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:21.136423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-21e40a04-aa1e-4281-a5fe-3e6ccee46d2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:21.145766 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-21e40a04-aa1e-4281-a5fe-3e6ccee46d2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.158043 Sep 10 21:01:21.146475 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1734/3537] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:20 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:21.151747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ec717e62-ea05-4e83-9250-749360ff60aa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:21.152363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ec717e62-ea05-4e83-9250-749360ff60aa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:21.159009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec717e62-ea05-4e83-9250-749360ff60aa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:21.159503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec717e62-ea05-4e83-9250-749360ff60aa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:21.159948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec717e62-ea05-4e83-9250-749360ff60aa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:21.160658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec717e62-ea05-4e83-9250-749360ff60aa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:21.161116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec717e62-ea05-4e83-9250-749360ff60aa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:21.161548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec717e62-ea05-4e83-9250-749360ff60aa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:21.218985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:21.230590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:21.232139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:21.233296 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-443d26cd-8c08-4a30-9f8b-25e65cbcc2bc tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1852 microversion: 2.32 time: 0.342428 Sep 10 21:01:21.233912 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1804/3538] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:20 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1852 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:21.355529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ec717e62-ea05-4e83-9250-749360ff60aa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:21.364033 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ec717e62-ea05-4e83-9250-749360ff60aa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1324 microversion: 2.1 time: 0.216388 Sep 10 21:01:21.364712 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1735/3539] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:21 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:21.433194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-761d5368-4369-46ea-a49a-20d7dbb9b6c1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:21.433938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-761d5368-4369-46ea-a49a-20d7dbb9b6c1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:21.440901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-761d5368-4369-46ea-a49a-20d7dbb9b6c1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:21.441894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-761d5368-4369-46ea-a49a-20d7dbb9b6c1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:21.442408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-761d5368-4369-46ea-a49a-20d7dbb9b6c1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:21.443579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-761d5368-4369-46ea-a49a-20d7dbb9b6c1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:21.444245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-761d5368-4369-46ea-a49a-20d7dbb9b6c1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:21.445014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-761d5368-4369-46ea-a49a-20d7dbb9b6c1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:21.531605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5a304ff6-9c83-49f3-aa63-ab5ac7e6ea8b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:21.533810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5a304ff6-9c83-49f3-aa63-ab5ac7e6ea8b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:21.543686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a304ff6-9c83-49f3-aa63-ab5ac7e6ea8b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:21.544578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a304ff6-9c83-49f3-aa63-ab5ac7e6ea8b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:21.545161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a304ff6-9c83-49f3-aa63-ab5ac7e6ea8b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:21.546549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a304ff6-9c83-49f3-aa63-ab5ac7e6ea8b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:21.561300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a304ff6-9c83-49f3-aa63-ab5ac7e6ea8b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:21.562538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a304ff6-9c83-49f3-aa63-ab5ac7e6ea8b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:21.670479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-761d5368-4369-46ea-a49a-20d7dbb9b6c1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:21.683095 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-761d5368-4369-46ea-a49a-20d7dbb9b6c1 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1473 microversion: 2.1 time: 0.254715 Sep 10 21:01:21.686729 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1805/3540] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:21 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:21.816985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-90afbc25-a02a-48d0-8907-9b5ab31f74c5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:21.819610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-90afbc25-a02a-48d0-8907-9b5ab31f74c5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:21.851351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90afbc25-a02a-48d0-8907-9b5ab31f74c5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:21.851617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5a304ff6-9c83-49f3-aa63-ab5ac7e6ea8b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:21.851992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90afbc25-a02a-48d0-8907-9b5ab31f74c5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:21.852508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90afbc25-a02a-48d0-8907-9b5ab31f74c5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:21.853443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90afbc25-a02a-48d0-8907-9b5ab31f74c5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:21.854006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90afbc25-a02a-48d0-8907-9b5ab31f74c5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:21.854505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90afbc25-a02a-48d0-8907-9b5ab31f74c5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:21.874568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:21.877172 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5a304ff6-9c83-49f3-aa63-ab5ac7e6ea8b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1472 microversion: 2.1 time: 0.352095 Sep 10 21:01:21.884176 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1736/3541] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:21 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:01:21.990747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e917d19-8ac7-480d-87ac-62e5b23bad47 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:21.991445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e917d19-8ac7-480d-87ac-62e5b23bad47 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:22.008845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e917d19-8ac7-480d-87ac-62e5b23bad47 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:22.009366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e917d19-8ac7-480d-87ac-62e5b23bad47 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:22.009820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e917d19-8ac7-480d-87ac-62e5b23bad47 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:22.011101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e917d19-8ac7-480d-87ac-62e5b23bad47 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:22.011564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e917d19-8ac7-480d-87ac-62e5b23bad47 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:22.011994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e917d19-8ac7-480d-87ac-62e5b23bad47 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:22.246476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-90afbc25-a02a-48d0-8907-9b5ab31f74c5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:22.266407 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-90afbc25-a02a-48d0-8907-9b5ab31f74c5 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1648 microversion: 2.1 time: 0.465559 Sep 10 21:01:22.267729 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1806/3542] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:21 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1648 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:22.284142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-65e03c10-2394-4e9c-9c97-2146e62ff858 req-a2e00113-7c1e-444d-89d7-0e115aaa58d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "tag": "311db54b-3ded-45c3-aad5-3b61965f2c39"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:22.308592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-65e03c10-2394-4e9c-9c97-2146e62ff858 req-a2e00113-7c1e-444d-89d7-0e115aaa58d5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:22.309572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-65e03c10-2394-4e9c-9c97-2146e62ff858 req-a2e00113-7c1e-444d-89d7-0e115aaa58d5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:22.310551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-65e03c10-2394-4e9c-9c97-2146e62ff858 req-a2e00113-7c1e-444d-89d7-0e115aaa58d5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:22.325674 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-65e03c10-2394-4e9c-9c97-2146e62ff858 req-a2e00113-7c1e-444d-89d7-0e115aaa58d5 service nova] Creating event network-changed:311db54b-3ded-45c3-aad5-3b61965f2c39 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:01:22.332119 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-65e03c10-2394-4e9c-9c97-2146e62ff858 req-a2e00113-7c1e-444d-89d7-0e115aaa58d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056518 Sep 10 21:01:22.333623 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1807/3543] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:22.340396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b38d531-8060-41ed-8c83-384c7ce7d36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:22.341659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b38d531-8060-41ed-8c83-384c7ce7d36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:22.350959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b38d531-8060-41ed-8c83-384c7ce7d36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:22.351855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b38d531-8060-41ed-8c83-384c7ce7d36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:22.352533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b38d531-8060-41ed-8c83-384c7ce7d36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:22.353450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b38d531-8060-41ed-8c83-384c7ce7d36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:22.354131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b38d531-8060-41ed-8c83-384c7ce7d36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:22.354805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b38d531-8060-41ed-8c83-384c7ce7d36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:22.676250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b38d531-8060-41ed-8c83-384c7ce7d36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:22.684775 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b38d531-8060-41ed-8c83-384c7ce7d36c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.349400 Sep 10 21:01:22.692590 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1808/3544] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:22 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:22.713855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:22.720009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:22.738130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:22.738867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:22.741400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:22.753588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:22.754297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:22.754910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:22.758518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e917d19-8ac7-480d-87ac-62e5b23bad47 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:22.769701 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e917d19-8ac7-480d-87ac-62e5b23bad47 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.782547 Sep 10 21:01:22.770635 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1737/3545] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:21 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:22.777216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9dc6f39-6f4c-4a44-8054-1ec06a4365c4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:22.778402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9dc6f39-6f4c-4a44-8054-1ec06a4365c4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:22.789070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9dc6f39-6f4c-4a44-8054-1ec06a4365c4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:22.790346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9dc6f39-6f4c-4a44-8054-1ec06a4365c4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:22.791725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9dc6f39-6f4c-4a44-8054-1ec06a4365c4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:22.792570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9dc6f39-6f4c-4a44-8054-1ec06a4365c4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:22.793102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9dc6f39-6f4c-4a44-8054-1ec06a4365c4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:22.793683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9dc6f39-6f4c-4a44-8054-1ec06a4365c4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:23.265979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:23.282591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:23.287266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:23.290460 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6394b385-dd2d-4d06-9b1f-8ce2f9939401 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.589304 Sep 10 21:01:23.291827 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1809/3546] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:22 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:23.311294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d7414731-5897-46bb-9e38-b75affb8a7e9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:23.312201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d7414731-5897-46bb-9e38-b75affb8a7e9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:23.325959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7414731-5897-46bb-9e38-b75affb8a7e9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:23.329385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7414731-5897-46bb-9e38-b75affb8a7e9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:23.330312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7414731-5897-46bb-9e38-b75affb8a7e9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:23.331643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7414731-5897-46bb-9e38-b75affb8a7e9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:23.332370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7414731-5897-46bb-9e38-b75affb8a7e9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:23.333107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7414731-5897-46bb-9e38-b75affb8a7e9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:23.340898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a9dc6f39-6f4c-4a44-8054-1ec06a4365c4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:23.358567 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9dc6f39-6f4c-4a44-8054-1ec06a4365c4 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1324 microversion: 2.1 time: 0.586614 Sep 10 21:01:23.359161 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1738/3547] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:22 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1324 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:23.365360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b4d368c5-ce0c-4e0b-96a6-cee0b891d3d0 req-c6dda3b9-542f-4cc1-b8c9-4cdd076b3ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18936341-5f68-4676-abb6-eb63c45da66e", "name": "network-vif-unplugged", "status": "completed", "tag": "5c189b4d-3548-4392-b69f-af791fa93755"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:23.387450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b4d368c5-ce0c-4e0b-96a6-cee0b891d3d0 req-c6dda3b9-542f-4cc1-b8c9-4cdd076b3ee0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:23.387929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b4d368c5-ce0c-4e0b-96a6-cee0b891d3d0 req-c6dda3b9-542f-4cc1-b8c9-4cdd076b3ee0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:23.388355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b4d368c5-ce0c-4e0b-96a6-cee0b891d3d0 req-c6dda3b9-542f-4cc1-b8c9-4cdd076b3ee0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:23.417042 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b4d368c5-ce0c-4e0b-96a6-cee0b891d3d0 req-c6dda3b9-542f-4cc1-b8c9-4cdd076b3ee0 service nova] Creating event network-vif-unplugged:5c189b4d-3548-4392-b69f-af791fa93755 for instance 18936341-5f68-4676-abb6-eb63c45da66e on nch1-master-1 Sep 10 21:01:23.427873 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b4d368c5-ce0c-4e0b-96a6-cee0b891d3d0 req-c6dda3b9-542f-4cc1-b8c9-4cdd076b3ee0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066878 Sep 10 21:01:23.429652 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1739/3548] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:23.439841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-efce8641-ef0e-4a20-a6f9-2eba8b16166e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:23.440549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-efce8641-ef0e-4a20-a6f9-2eba8b16166e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:23.463024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:23.465363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efce8641-ef0e-4a20-a6f9-2eba8b16166e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:23.466155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efce8641-ef0e-4a20-a6f9-2eba8b16166e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:23.467170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efce8641-ef0e-4a20-a6f9-2eba8b16166e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:23.468259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efce8641-ef0e-4a20-a6f9-2eba8b16166e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:23.469139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efce8641-ef0e-4a20-a6f9-2eba8b16166e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:23.470209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efce8641-ef0e-4a20-a6f9-2eba8b16166e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:23.773510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d7414731-5897-46bb-9e38-b75affb8a7e9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:23.780670 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d7414731-5897-46bb-9e38-b75affb8a7e9 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1473 microversion: 2.1 time: 0.486386 Sep 10 21:01:23.789151 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1810/3549] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:23 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1473 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:23.800393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21e86730-eb53-436f-9ac0-162c1ca61b8a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:23.802597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21e86730-eb53-436f-9ac0-162c1ca61b8a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:23.811328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e86730-eb53-436f-9ac0-162c1ca61b8a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:23.812066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e86730-eb53-436f-9ac0-162c1ca61b8a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:23.813789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e86730-eb53-436f-9ac0-162c1ca61b8a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:23.814775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e86730-eb53-436f-9ac0-162c1ca61b8a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:23.815519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e86730-eb53-436f-9ac0-162c1ca61b8a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:23.816983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e86730-eb53-436f-9ac0-162c1ca61b8a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.103038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-efce8641-ef0e-4a20-a6f9-2eba8b16166e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:24.113948 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-efce8641-ef0e-4a20-a6f9-2eba8b16166e tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1472 microversion: 2.1 time: 0.678538 Sep 10 21:01:24.116375 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1740/3550] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:23 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1472 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:24.121467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-583f8349-c59a-4c09-9f46-f540b7e9b096 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:24.123412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-583f8349-c59a-4c09-9f46-f540b7e9b096 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:24.134090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-21e86730-eb53-436f-9ac0-162c1ca61b8a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:24.149820 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21e86730-eb53-436f-9ac0-162c1ca61b8a tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1648 microversion: 2.1 time: 0.354760 Sep 10 21:01:24.151139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-583f8349-c59a-4c09-9f46-f540b7e9b096 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.152797 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1811/3551] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:23 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1648 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:24.153401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-583f8349-c59a-4c09-9f46-f540b7e9b096 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.154259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-583f8349-c59a-4c09-9f46-f540b7e9b096 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.158112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-583f8349-c59a-4c09-9f46-f540b7e9b096 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.159857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-583f8349-c59a-4c09-9f46-f540b7e9b096 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.160821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-583f8349-c59a-4c09-9f46-f540b7e9b096 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.170287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0186639d-c201-4fa8-890f-70a64dbb2a81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:24.172155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0186639d-c201-4fa8-890f-70a64dbb2a81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:24.196681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0186639d-c201-4fa8-890f-70a64dbb2a81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.197187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0186639d-c201-4fa8-890f-70a64dbb2a81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.198478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0186639d-c201-4fa8-890f-70a64dbb2a81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.200035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0186639d-c201-4fa8-890f-70a64dbb2a81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.200035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0186639d-c201-4fa8-890f-70a64dbb2a81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.200035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0186639d-c201-4fa8-890f-70a64dbb2a81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.370905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:24.491064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-583f8349-c59a-4c09-9f46-f540b7e9b096 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:24.501779 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-583f8349-c59a-4c09-9f46-f540b7e9b096 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.384058 Sep 10 21:01:24.505622 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1741/3552] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:24 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:24.528087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5b60ecf5-aeaf-49e3-99b4-57a0acb0f6ec req-dd110769-f35c-4402-a0a6-870dbe07ded7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377f56f0-3163-4417-8d6b-ca4be8de2828", "name": "network-vif-deleted", "tag": "7af13252-9cfc-4a98-a5da-d4f6e455291b"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:24.541369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5b60ecf5-aeaf-49e3-99b4-57a0acb0f6ec req-dd110769-f35c-4402-a0a6-870dbe07ded7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.541894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5b60ecf5-aeaf-49e3-99b4-57a0acb0f6ec req-dd110769-f35c-4402-a0a6-870dbe07ded7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.542334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5b60ecf5-aeaf-49e3-99b4-57a0acb0f6ec req-dd110769-f35c-4402-a0a6-870dbe07ded7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.556781 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5b60ecf5-aeaf-49e3-99b4-57a0acb0f6ec req-dd110769-f35c-4402-a0a6-870dbe07ded7 service nova] Creating event network-vif-deleted:7af13252-9cfc-4a98-a5da-d4f6e455291b for instance 377f56f0-3163-4417-8d6b-ca4be8de2828 on nch2-master-1 Sep 10 21:01:24.565116 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5b60ecf5-aeaf-49e3-99b4-57a0acb0f6ec req-dd110769-f35c-4402-a0a6-870dbe07ded7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041432 Sep 10 21:01:24.566544 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1742/3553] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:24.579820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:24.581031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:24.590441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.591077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.591676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.592547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.593308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.594606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.613303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:24.666714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0186639d-c201-4fa8-890f-70a64dbb2a81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:24.689056 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0186639d-c201-4fa8-890f-70a64dbb2a81 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.533338 Sep 10 21:01:24.689663 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1812/3554] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:24 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:24.706056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-472ef484-b15d-4571-9204-326b4481fe27 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:24.707241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-472ef484-b15d-4571-9204-326b4481fe27 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:24.720786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-472ef484-b15d-4571-9204-326b4481fe27 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.722344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-472ef484-b15d-4571-9204-326b4481fe27 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.724276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-472ef484-b15d-4571-9204-326b4481fe27 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.725182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-472ef484-b15d-4571-9204-326b4481fe27 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.727039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-472ef484-b15d-4571-9204-326b4481fe27 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.727651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-472ef484-b15d-4571-9204-326b4481fe27 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.867126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:24.880339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:24.882466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:24.883930 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6851c454-239d-44c5-96f7-0b2732814119 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.315692 Sep 10 21:01:24.885138 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1743/3555] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:24 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:24.890654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-48e3855b-9941-4204-995b-056e61e7c916 req-aebd10f3-e8cc-4759-a223-fce1a5eee897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "tag": "eb53acdc-dda5-4628-9875-8c05fd7b949f"}, {"server_uuid": "18936341-5f68-4676-abb6-eb63c45da66e", "name": "network-vif-deleted", "tag": "5c189b4d-3548-4392-b69f-af791fa93755"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:24.904356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-48e3855b-9941-4204-995b-056e61e7c916 req-aebd10f3-e8cc-4759-a223-fce1a5eee897 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.905047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-48e3855b-9941-4204-995b-056e61e7c916 req-aebd10f3-e8cc-4759-a223-fce1a5eee897 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.905623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-48e3855b-9941-4204-995b-056e61e7c916 req-aebd10f3-e8cc-4759-a223-fce1a5eee897 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.924644 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-48e3855b-9941-4204-995b-056e61e7c916 req-aebd10f3-e8cc-4759-a223-fce1a5eee897 service nova] Creating event network-changed:eb53acdc-dda5-4628-9875-8c05fd7b949f for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:01:24.925248 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-48e3855b-9941-4204-995b-056e61e7c916 req-aebd10f3-e8cc-4759-a223-fce1a5eee897 service nova] Creating event network-vif-deleted:5c189b4d-3548-4392-b69f-af791fa93755 for instance 18936341-5f68-4676-abb6-eb63c45da66e on nch1-master-1 Sep 10 21:01:24.934042 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-48e3855b-9941-4204-995b-056e61e7c916 req-aebd10f3-e8cc-4759-a223-fce1a5eee897 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047241 Sep 10 21:01:24.935020 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1744/3556] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:24.941592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:24.942403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:24.953367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-472ef484-b15d-4571-9204-326b4481fe27 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:24.957523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.958070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.958517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.959246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:24.959701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:24.961448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:24.962255 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-472ef484-b15d-4571-9204-326b4481fe27 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1324 microversion: 2.1 time: 0.267469 Sep 10 21:01:24.979313 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1813/3557] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:24 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1324 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:25.041015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:25.041663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:25.042422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:25.044192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lazy-loading 'fault' on Instance uuid 377f56f0-3163-4417-8d6b-ca4be8de2828 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:25.128954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:25.142328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-23387d0d-8c42-4d33-9e5e-043a1ceb6547 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:25.144034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-23387d0d-8c42-4d33-9e5e-043a1ceb6547 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:25.152614 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27646274-b5ad-4aab-8911-feee9c2c13c8 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 200 len: 1307 microversion: 2.1 time: 0.211756 Sep 10 21:01:25.153405 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1745/3558] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:24 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:25.168821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23387d0d-8c42-4d33-9e5e-043a1ceb6547 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:25.168821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23387d0d-8c42-4d33-9e5e-043a1ceb6547 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:25.168821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23387d0d-8c42-4d33-9e5e-043a1ceb6547 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:25.168821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23387d0d-8c42-4d33-9e5e-043a1ceb6547 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:25.168821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23387d0d-8c42-4d33-9e5e-043a1ceb6547 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:25.168821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23387d0d-8c42-4d33-9e5e-043a1ceb6547 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:25.182217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-71173adb-dd86-4a47-81ba-ddc50a365f09 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:25.183023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-71173adb-dd86-4a47-81ba-ddc50a365f09 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:25.209089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71173adb-dd86-4a47-81ba-ddc50a365f09 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:25.213680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71173adb-dd86-4a47-81ba-ddc50a365f09 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:25.214997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71173adb-dd86-4a47-81ba-ddc50a365f09 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:25.216942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71173adb-dd86-4a47-81ba-ddc50a365f09 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:25.222354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71173adb-dd86-4a47-81ba-ddc50a365f09 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:25.223044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71173adb-dd86-4a47-81ba-ddc50a365f09 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:25.632094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-23387d0d-8c42-4d33-9e5e-043a1ceb6547 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:25.643961 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-23387d0d-8c42-4d33-9e5e-043a1ceb6547 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1430 microversion: 2.1 time: 0.507357 Sep 10 21:01:25.644844 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1814/3559] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:25 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1430 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:25.667128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8ae18192-f641-4e6b-9ddd-2f11cea28b71 req-912467d1-f06b-4850-84ab-fc6f35ccc436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f34498-848f-44b8-92af-e6fbd1760ba6", "name": "network-vif-plugged", "status": "completed", "tag": "2df22809-20c4-4a16-8747-2eab50949e85"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:25.680167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-71173adb-dd86-4a47-81ba-ddc50a365f09 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:25.694413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8ae18192-f641-4e6b-9ddd-2f11cea28b71 req-912467d1-f06b-4850-84ab-fc6f35ccc436 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:25.694807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8ae18192-f641-4e6b-9ddd-2f11cea28b71 req-912467d1-f06b-4850-84ab-fc6f35ccc436 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:25.695247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8ae18192-f641-4e6b-9ddd-2f11cea28b71 req-912467d1-f06b-4850-84ab-fc6f35ccc436 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:25.696654 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-71173adb-dd86-4a47-81ba-ddc50a365f09 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1648 microversion: 2.1 time: 0.519335 Sep 10 21:01:25.700571 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1746/3560] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:25 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1648 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:25.719077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b055df29-37c2-45b3-91a1-96cd539f4dee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:25.719792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b055df29-37c2-45b3-91a1-96cd539f4dee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:25.731972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b055df29-37c2-45b3-91a1-96cd539f4dee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:25.732787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b055df29-37c2-45b3-91a1-96cd539f4dee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:25.733428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b055df29-37c2-45b3-91a1-96cd539f4dee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:25.734356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b055df29-37c2-45b3-91a1-96cd539f4dee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:25.740958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b055df29-37c2-45b3-91a1-96cd539f4dee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:25.742236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b055df29-37c2-45b3-91a1-96cd539f4dee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:25.746418 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8ae18192-f641-4e6b-9ddd-2f11cea28b71 req-912467d1-f06b-4850-84ab-fc6f35ccc436 service nova] Creating event network-vif-plugged:2df22809-20c4-4a16-8747-2eab50949e85 for instance 03f34498-848f-44b8-92af-e6fbd1760ba6 on nch2-master-1 Sep 10 21:01:25.764285 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8ae18192-f641-4e6b-9ddd-2f11cea28b71 req-912467d1-f06b-4850-84ab-fc6f35ccc436 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117816 Sep 10 21:01:25.765517 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1815/3561] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:25.774002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35de0f2e-03f6-49fd-a974-21854fc02e41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:25.774908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35de0f2e-03f6-49fd-a974-21854fc02e41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:25.782696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35de0f2e-03f6-49fd-a974-21854fc02e41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:25.784438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35de0f2e-03f6-49fd-a974-21854fc02e41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:25.785637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35de0f2e-03f6-49fd-a974-21854fc02e41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:25.787578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35de0f2e-03f6-49fd-a974-21854fc02e41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:25.788468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35de0f2e-03f6-49fd-a974-21854fc02e41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:25.789131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35de0f2e-03f6-49fd-a974-21854fc02e41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.237493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35de0f2e-03f6-49fd-a974-21854fc02e41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:26.246786 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35de0f2e-03f6-49fd-a974-21854fc02e41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.478678 Sep 10 21:01:26.249184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1816/3562] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:25 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:26.255779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:26.256587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:26.265608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.265956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b055df29-37c2-45b3-91a1-96cd539f4dee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:26.267061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.267682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.269035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.273566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.274476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.283759 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b055df29-37c2-45b3-91a1-96cd539f4dee tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.581871 Sep 10 21:01:26.284348 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1747/3563] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:25 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:26.299900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ce8fa1c-d8be-4aea-8373-98e6cf67e57d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:26.300519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7ce8fa1c-d8be-4aea-8373-98e6cf67e57d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:26.307484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ce8fa1c-d8be-4aea-8373-98e6cf67e57d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.308296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ce8fa1c-d8be-4aea-8373-98e6cf67e57d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.308901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ce8fa1c-d8be-4aea-8373-98e6cf67e57d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.309850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ce8fa1c-d8be-4aea-8373-98e6cf67e57d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.310524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ce8fa1c-d8be-4aea-8373-98e6cf67e57d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.311112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ce8fa1c-d8be-4aea-8373-98e6cf67e57d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.605159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7ce8fa1c-d8be-4aea-8373-98e6cf67e57d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:26.613725 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ce8fa1c-d8be-4aea-8373-98e6cf67e57d tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1324 microversion: 2.1 time: 0.328057 Sep 10 21:01:26.614502 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1748/3564] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:26 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:26.634691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:26.635306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 377f56f0-3163-4417-8d6b-ca4be8de2828] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:26.641703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.642232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.642781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.643481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.643940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.644368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.658926 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] HTTP exception thrown: Instance 377f56f0-3163-4417-8d6b-ca4be8de2828 could not be found. Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Request method failure captured: Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 HTTP/1.1 Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqHKJMr9n4zFBrwCDwggOICWTV5On1JiBAMDvH8fT8-NNoh73qnESdvbRp5btSPUfcXOWmR6sAsxEx8RIQp_JClZdXb2cSOfIz3x1mdp6jyHpbOyDvOb38iKe4c0pwkvIhv6QXiGdipvzJ_b-BYm9ffGz7YrTRpz9iFUHUaXClTMJM Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9c091a483f8b466f89ea487d13fe422b Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ListImageFiltersTestJSON-1731426525 Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c091a483f8b466f89ea487d13fe422b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c091a483f8b466f89ea487d13fe422b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9c091a483f8b466f89ea487d13fe422b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9c091a483f8b466f89ea487d13fe422b"}]}] Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ListImageFiltersTestJSON-1731426525 Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9c091a483f8b466f89ea487d13fe422b Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1731426525 Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ListImageFiltersTestJSON-1731426525-project Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 81ee4fa83ef649d0bdc273243cd717c4 Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ListImageFiltersTestJSON-1731426525-project Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 377f56f0-3163-4417-8d6b-ca4be8de2828 could not be found. Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '377f56f0-3163-4417-8d6b-ca4be8de2828'} Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377f56f0-3163-4417-8d6b-ca4be8de2828 could not be found. Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377f56f0-3163-4417-8d6b-ca4be8de2828 could not be found. Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:26.660598 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:26.667099 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:26.667099 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:26.667099 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:26.667099 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:26.667099 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:26.667099 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377f56f0-3163-4417-8d6b-ca4be8de2828 could not be found. Sep 10 21:01:26.667099 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:26.667099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Returning 404 to user: Instance 377f56f0-3163-4417-8d6b-ca4be8de2828 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:26.667099 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-10f5d47c-931b-40b5-b186-4d556f29d6f6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828" status: 404 len: 111 microversion: 2.1 time: 0.031182 Sep 10 21:01:26.667099 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1749/3565] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:26 2022] GET /compute/v2.1/servers/377f56f0-3163-4417-8d6b-ca4be8de2828 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:26.670392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:26.671021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:26.678048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.678540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.678981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.679691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.680156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.680576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.717569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.718536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.718536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.719012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lazy-loading 'fault' on Instance uuid 18936341-5f68-4676-abb6-eb63c45da66e {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:26.779770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:26.795468 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-93e9f77a-5dcf-41f1-965d-ec8977612bae tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 200 len: 1306 microversion: 2.1 time: 0.128634 Sep 10 21:01:26.796717 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1750/3566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:26 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 1306 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:26.803153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:26.806968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0a27df4d-2cd0-4147-bc4b-db4395ba7005 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:26.807904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0a27df4d-2cd0-4147-bc4b-db4395ba7005 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:26.822837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a27df4d-2cd0-4147-bc4b-db4395ba7005 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.823593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a27df4d-2cd0-4147-bc4b-db4395ba7005 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.824458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a27df4d-2cd0-4147-bc4b-db4395ba7005 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.825358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a27df4d-2cd0-4147-bc4b-db4395ba7005 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.826093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a27df4d-2cd0-4147-bc4b-db4395ba7005 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.826706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a27df4d-2cd0-4147-bc4b-db4395ba7005 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.830725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:26.832202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:26.833626 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-92cf949e-a54a-442c-b43d-e0beb9152c23 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.583231 Sep 10 21:01:26.834409 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1817/3567] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:26 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:26.847225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4ad1046e-b510-43f1-8f9c-ee0a1e4aafae tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:26.848141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4ad1046e-b510-43f1-8f9c-ee0a1e4aafae tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:26.864941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0a27df4d-2cd0-4147-bc4b-db4395ba7005 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:26.873657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ad1046e-b510-43f1-8f9c-ee0a1e4aafae tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.874261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ad1046e-b510-43f1-8f9c-ee0a1e4aafae tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.874928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ad1046e-b510-43f1-8f9c-ee0a1e4aafae tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:26.876173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ad1046e-b510-43f1-8f9c-ee0a1e4aafae tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:26.876740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ad1046e-b510-43f1-8f9c-ee0a1e4aafae tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:26.881998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4ad1046e-b510-43f1-8f9c-ee0a1e4aafae tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.027114 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0a27df4d-2cd0-4147-bc4b-db4395ba7005 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 204 len: 0 microversion: 2.1 time: 0.227318 Sep 10 21:01:27.028475 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1751/3568] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:26 2022] DELETE /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:27.036158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-958b13de-491a-42a7-ab9b-f2a66ad894c9 req-b829766d-e96c-469d-9ca9-2b2ebb73cf79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "tag": "4619895f-8d16-490c-8f4a-a6d5aa999a89"}, {"server_uuid": "16ab7365-3c1e-4122-b234-34076143bce8", "name": "network-vif-deleted", "tag": "ffdf3005-b7dc-44e1-8c27-8c4179511d4f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:27.057501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-958b13de-491a-42a7-ab9b-f2a66ad894c9 req-b829766d-e96c-469d-9ca9-2b2ebb73cf79 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.058562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-958b13de-491a-42a7-ab9b-f2a66ad894c9 req-b829766d-e96c-469d-9ca9-2b2ebb73cf79 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.059341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-958b13de-491a-42a7-ab9b-f2a66ad894c9 req-b829766d-e96c-469d-9ca9-2b2ebb73cf79 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.060068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4ad1046e-b510-43f1-8f9c-ee0a1e4aafae tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:27.074910 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4ad1046e-b510-43f1-8f9c-ee0a1e4aafae tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1468 microversion: 2.1 time: 0.239261 Sep 10 21:01:27.075820 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1818/3569] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:26 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1468 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:27.090141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cbac2e09-034c-4874-9b5d-3ef5a261cf4d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:27.091021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cbac2e09-034c-4874-9b5d-3ef5a261cf4d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:27.103169 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-958b13de-491a-42a7-ab9b-f2a66ad894c9 req-b829766d-e96c-469d-9ca9-2b2ebb73cf79 service nova] Creating event network-changed:4619895f-8d16-490c-8f4a-a6d5aa999a89 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:01:27.103688 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-958b13de-491a-42a7-ab9b-f2a66ad894c9 req-b829766d-e96c-469d-9ca9-2b2ebb73cf79 service nova] Creating event network-vif-deleted:ffdf3005-b7dc-44e1-8c27-8c4179511d4f for instance 16ab7365-3c1e-4122-b234-34076143bce8 on nch1-master-1 Sep 10 21:01:27.107835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbac2e09-034c-4874-9b5d-3ef5a261cf4d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.109219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbac2e09-034c-4874-9b5d-3ef5a261cf4d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.111139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbac2e09-034c-4874-9b5d-3ef5a261cf4d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.111963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbac2e09-034c-4874-9b5d-3ef5a261cf4d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.112441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbac2e09-034c-4874-9b5d-3ef5a261cf4d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.115762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbac2e09-034c-4874-9b5d-3ef5a261cf4d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.119556 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-958b13de-491a-42a7-ab9b-f2a66ad894c9 req-b829766d-e96c-469d-9ca9-2b2ebb73cf79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.087421 Sep 10 21:01:27.120198 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1752/3570] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:27.281328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fe3c6bfb-9794-4d6f-957c-44526a30af43 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:27.284327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fe3c6bfb-9794-4d6f-957c-44526a30af43 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:27.304145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3c6bfb-9794-4d6f-957c-44526a30af43 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.305398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3c6bfb-9794-4d6f-957c-44526a30af43 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.306535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3c6bfb-9794-4d6f-957c-44526a30af43 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.307527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3c6bfb-9794-4d6f-957c-44526a30af43 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.309912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3c6bfb-9794-4d6f-957c-44526a30af43 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.310601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe3c6bfb-9794-4d6f-957c-44526a30af43 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.402146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cbac2e09-034c-4874-9b5d-3ef5a261cf4d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:27.412930 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cbac2e09-034c-4874-9b5d-3ef5a261cf4d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 200 len: 1474 microversion: 2.1 time: 0.335664 Sep 10 21:01:27.428687 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1819/3571] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:27 2022] GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:27.440711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e7efc8f-a460-41dc-9cde-4f58f0d8697c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:27.444015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e7efc8f-a460-41dc-9cde-4f58f0d8697c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:27.452723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e7efc8f-a460-41dc-9cde-4f58f0d8697c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.453762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e7efc8f-a460-41dc-9cde-4f58f0d8697c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.454408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e7efc8f-a460-41dc-9cde-4f58f0d8697c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.455303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e7efc8f-a460-41dc-9cde-4f58f0d8697c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.455927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e7efc8f-a460-41dc-9cde-4f58f0d8697c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.456535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e7efc8f-a460-41dc-9cde-4f58f0d8697c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.606625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fe3c6bfb-9794-4d6f-957c-44526a30af43 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:27.619442 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fe3c6bfb-9794-4d6f-957c-44526a30af43 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.346544 Sep 10 21:01:27.620128 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1753/3572] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:27 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:27.639906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e0def079-7b16-45eb-9bfb-36c7337df2ee tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:27.641287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e0def079-7b16-45eb-9bfb-36c7337df2ee tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:27.647812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0def079-7b16-45eb-9bfb-36c7337df2ee tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.648321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0def079-7b16-45eb-9bfb-36c7337df2ee tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.648761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0def079-7b16-45eb-9bfb-36c7337df2ee tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.649688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0def079-7b16-45eb-9bfb-36c7337df2ee tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.650180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0def079-7b16-45eb-9bfb-36c7337df2ee tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.650614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0def079-7b16-45eb-9bfb-36c7337df2ee tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.671390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e7efc8f-a460-41dc-9cde-4f58f0d8697c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:27.679890 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e7efc8f-a460-41dc-9cde-4f58f0d8697c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.249881 Sep 10 21:01:27.680533 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1820/3573] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:27 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:27.798851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e0def079-7b16-45eb-9bfb-36c7337df2ee tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:27.806583 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e0def079-7b16-45eb-9bfb-36c7337df2ee tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1324 microversion: 2.1 time: 0.171013 Sep 10 21:01:27.807159 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1754/3574] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:27 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:27.823079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:27.823692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 18936341-5f68-4676-abb6-eb63c45da66e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:27.830683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.831161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.831597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.832279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.832909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.833503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.850282 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] HTTP exception thrown: Instance 18936341-5f68-4676-abb6-eb63c45da66e could not be found. Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Request method failure captured: Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e HTTP/1.1 Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpD3XorJTOmshO8ShrGydR5Yh_ZW0GoFIPFNux3cdIuCEy4uljcIp1YR897IiLrXZKVrCAKwE0sC-SMLCx-PCumGee9Ldi4xcTYCHtnGk7w6VvimIT9qdN4eJRT9gk5WZTFLHhN4iq_vV4cb9iSKJhhLieaETbdjqgODHmuRL06q2E Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d30ef9b7525e4784be26268f46121e62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d30ef9b7525e4784be26268f46121e62"}]}] Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f38321284ec449e599d645625ed11139 Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 18936341-5f68-4676-abb6-eb63c45da66e could not be found. Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '18936341-5f68-4676-abb6-eb63c45da66e'} Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18936341-5f68-4676-abb6-eb63c45da66e could not be found. Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18936341-5f68-4676-abb6-eb63c45da66e could not be found. Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:27.851932 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:27.856152 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:27.856152 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:27.856152 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:27.856152 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:27.856152 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:27.856152 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18936341-5f68-4676-abb6-eb63c45da66e could not be found. Sep 10 21:01:27.856152 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:27.856152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Returning 404 to user: Instance 18936341-5f68-4676-abb6-eb63c45da66e could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:27.856152 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4486e8d3-7984-4686-9538-599ea3317369 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e" status: 404 len: 111 microversion: 2.1 time: 0.034826 Sep 10 21:01:27.856152 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1821/3575] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:27 2022] GET /compute/v2.1/servers/18936341-5f68-4676-abb6-eb63c45da66e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:27.862917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:27.863539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:27.868820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a46c139a-268a-43d1-a8d4-ba9d7aa3fede tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:27.869675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.870202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.870512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a46c139a-268a-43d1-a8d4-ba9d7aa3fede tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:27.870639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.871325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.871773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.872200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.881052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a46c139a-268a-43d1-a8d4-ba9d7aa3fede tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.881729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a46c139a-268a-43d1-a8d4-ba9d7aa3fede tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.882193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a46c139a-268a-43d1-a8d4-ba9d7aa3fede tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.883046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a46c139a-268a-43d1-a8d4-ba9d7aa3fede tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:27.883787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a46c139a-268a-43d1-a8d4-ba9d7aa3fede tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:27.883787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a46c139a-268a-43d1-a8d4-ba9d7aa3fede tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:27.910800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a46c139a-268a-43d1-a8d4-ba9d7aa3fede tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:28.006753 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a46c139a-268a-43d1-a8d4-ba9d7aa3fede tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 204 len: 0 microversion: 2.1 time: 0.144552 Sep 10 21:01:28.007332 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1822/3576] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:27 2022] DELETE /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:01:28.022439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b77a4dcc-3d9e-4c07-8b7a-e7d9f211110c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:28.024054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b77a4dcc-3d9e-4c07-8b7a-e7d9f211110c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:28.030299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a4dcc-3d9e-4c07-8b7a-e7d9f211110c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.031040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a4dcc-3d9e-4c07-8b7a-e7d9f211110c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.031823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a4dcc-3d9e-4c07-8b7a-e7d9f211110c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.032950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a4dcc-3d9e-4c07-8b7a-e7d9f211110c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.033767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a4dcc-3d9e-4c07-8b7a-e7d9f211110c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.034392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b77a4dcc-3d9e-4c07-8b7a-e7d9f211110c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.055239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:28.068974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b77a4dcc-3d9e-4c07-8b7a-e7d9f211110c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:28.081450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:28.091682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:28.093255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:28.094958 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e81dd446-f672-458e-9ce7-b6e67a763705 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.237094 Sep 10 21:01:28.099111 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1755/3577] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:27 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:28.103702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:28.104314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:28.111339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.111819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.112314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.112953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.113410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.113883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.143872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:28.147653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.148142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.148584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.149035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lazy-loading 'fault' on Instance uuid 16ab7365-3c1e-4122-b234-34076143bce8 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:28.167813 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b77a4dcc-3d9e-4c07-8b7a-e7d9f211110c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "DELETE /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 204 len: 0 microversion: 2.1 time: 0.147995 Sep 10 21:01:28.169026 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1823/3578] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:28 2022] DELETE /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:28.191581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-51f534ea-2a51-4001-a6a3-6ba0a6f16ef0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:28.192397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-51f534ea-2a51-4001-a6a3-6ba0a6f16ef0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:28.199413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51f534ea-2a51-4001-a6a3-6ba0a6f16ef0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.200160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51f534ea-2a51-4001-a6a3-6ba0a6f16ef0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.200830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51f534ea-2a51-4001-a6a3-6ba0a6f16ef0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.201802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51f534ea-2a51-4001-a6a3-6ba0a6f16ef0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.202482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51f534ea-2a51-4001-a6a3-6ba0a6f16ef0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.203686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51f534ea-2a51-4001-a6a3-6ba0a6f16ef0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.206931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:28.221406 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-432936fc-d3bb-43e8-b862-50f6d150e2b2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 200 len: 1305 microversion: 2.1 time: 0.121160 Sep 10 21:01:28.222356 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1756/3579] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:28 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:28.388646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-51f534ea-2a51-4001-a6a3-6ba0a6f16ef0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:28.399210 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-51f534ea-2a51-4001-a6a3-6ba0a6f16ef0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1474 microversion: 2.1 time: 0.217162 Sep 10 21:01:28.400175 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1824/3580] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:28 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:28.441522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e9f04f3-f233-4378-a9b6-05af131909c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:28.442992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5e9f04f3-f233-4378-a9b6-05af131909c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:28.450839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e9f04f3-f233-4378-a9b6-05af131909c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.451577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e9f04f3-f233-4378-a9b6-05af131909c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.452449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e9f04f3-f233-4378-a9b6-05af131909c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.454047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e9f04f3-f233-4378-a9b6-05af131909c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.454521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e9f04f3-f233-4378-a9b6-05af131909c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.454943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e9f04f3-f233-4378-a9b6-05af131909c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.588050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5e9f04f3-f233-4378-a9b6-05af131909c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:28.596646 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5e9f04f3-f233-4378-a9b6-05af131909c5 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 200 len: 1474 microversion: 2.1 time: 0.159753 Sep 10 21:01:28.597217 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1757/3581] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:28 2022] GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 1474 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:28.642432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fad2d4d9-e1d4-48df-b732-46b06ca505da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:28.643077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fad2d4d9-e1d4-48df-b732-46b06ca505da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:28.646811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:28.650840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fad2d4d9-e1d4-48df-b732-46b06ca505da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.651327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fad2d4d9-e1d4-48df-b732-46b06ca505da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.651767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fad2d4d9-e1d4-48df-b732-46b06ca505da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.652488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fad2d4d9-e1d4-48df-b732-46b06ca505da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.652944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fad2d4d9-e1d4-48df-b732-46b06ca505da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.653378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fad2d4d9-e1d4-48df-b732-46b06ca505da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.702934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-239d8136-d76e-4037-bfde-53ae2f999f87 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:28.704644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-239d8136-d76e-4037-bfde-53ae2f999f87 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:28.712160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-239d8136-d76e-4037-bfde-53ae2f999f87 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.712727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-239d8136-d76e-4037-bfde-53ae2f999f87 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.713292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-239d8136-d76e-4037-bfde-53ae2f999f87 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.714039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-239d8136-d76e-4037-bfde-53ae2f999f87 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.714495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-239d8136-d76e-4037-bfde-53ae2f999f87 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.714938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-239d8136-d76e-4037-bfde-53ae2f999f87 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.800676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fad2d4d9-e1d4-48df-b732-46b06ca505da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:28.808634 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fad2d4d9-e1d4-48df-b732-46b06ca505da tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.170049 Sep 10 21:01:28.809511 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1825/3582] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:28 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:28.833770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e16dcaa-984c-4628-a3c3-23fd1e027580 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:28.834394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e16dcaa-984c-4628-a3c3-23fd1e027580 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:28.840845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e16dcaa-984c-4628-a3c3-23fd1e027580 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.841328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e16dcaa-984c-4628-a3c3-23fd1e027580 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.841763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e16dcaa-984c-4628-a3c3-23fd1e027580 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.842485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e16dcaa-984c-4628-a3c3-23fd1e027580 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:28.843119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e16dcaa-984c-4628-a3c3-23fd1e027580 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:28.843546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e16dcaa-984c-4628-a3c3-23fd1e027580 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:28.917191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-239d8136-d76e-4037-bfde-53ae2f999f87 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:28.932498 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-239d8136-d76e-4037-bfde-53ae2f999f87 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.233246 Sep 10 21:01:28.937890 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1758/3583] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:28 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:29.059422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8e16dcaa-984c-4628-a3c3-23fd1e027580 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:29.068517 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e16dcaa-984c-4628-a3c3-23fd1e027580 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1324 microversion: 2.1 time: 0.241773 Sep 10 21:01:29.069129 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1826/3584] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:28 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:29.120967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:29.121787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:29.129732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.130273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.130713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.131457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.131908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.132365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.149194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-aa75f140-f74b-4177-aa9b-ca97d470e75d req-a07178f2-2f51-4b68-9993-94ffcf0d8a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "tag": "99a05956-b818-4d1e-9f19-c00ce1c706e3"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:29.150850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:29.162272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa75f140-f74b-4177-aa9b-ca97d470e75d req-a07178f2-2f51-4b68-9993-94ffcf0d8a16 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.162760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa75f140-f74b-4177-aa9b-ca97d470e75d req-a07178f2-2f51-4b68-9993-94ffcf0d8a16 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.163416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa75f140-f74b-4177-aa9b-ca97d470e75d req-a07178f2-2f51-4b68-9993-94ffcf0d8a16 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.188128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-aa75f140-f74b-4177-aa9b-ca97d470e75d req-a07178f2-2f51-4b68-9993-94ffcf0d8a16 service nova] Creating event network-changed:99a05956-b818-4d1e-9f19-c00ce1c706e3 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:01:29.194029 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-aa75f140-f74b-4177-aa9b-ca97d470e75d req-a07178f2-2f51-4b68-9993-94ffcf0d8a16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048484 Sep 10 21:01:29.194819 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1827/3585] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:29.248766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:29.249477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:29.257325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.257861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.258302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.259012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.259470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.259902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.274175 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 HTTP/1.1 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '16ab7365-3c1e-4122-b234-34076143bce8'} Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:29.275840 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:29.280762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:29.280762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:29.280762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:29.280762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:29.280762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:29.280762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:29.280762 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:29.282057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:29.282803 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b7844889-02bd-40f1-ac27-f10c008df53c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 404 len: 111 microversion: 2.1 time: 0.038401 Sep 10 21:01:29.283709 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1828/3586] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:29 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:29.292500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8112ef93-a04d-409c-9ed2-0adb34e7829b tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f993fcbd790>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:29.347307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:29.356846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:29.358457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:29.360165 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-36954bba-27d6-4be2-95b8-2cb740856d19 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.243002 Sep 10 21:01:29.361069 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1759/3587] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:29 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:29.425205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-68363faf-a176-4699-b588-2ef6d08b8a95 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:29.425855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-68363faf-a176-4699-b588-2ef6d08b8a95 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:29.433749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68363faf-a176-4699-b588-2ef6d08b8a95 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.435395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68363faf-a176-4699-b588-2ef6d08b8a95 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.436696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68363faf-a176-4699-b588-2ef6d08b8a95 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.438522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68363faf-a176-4699-b588-2ef6d08b8a95 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.440651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68363faf-a176-4699-b588-2ef6d08b8a95 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.441811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68363faf-a176-4699-b588-2ef6d08b8a95 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.555590 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8112ef93-a04d-409c-9ed2-0adb34e7829b tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/cebbb4ae-a656-4074-9ac9-c20edc5dce67" status: 202 len: 0 microversion: 2.1 time: 0.267814 Sep 10 21:01:29.559754 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1829/3588] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:29 2022] DELETE /compute/v2.1/os-security-groups/cebbb4ae-a656-4074-9ac9-c20edc5dce67 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:29.566118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f2222197-3716-41ec-89b4-3f106105eb00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f993fc709d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:29.649072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-68363faf-a176-4699-b588-2ef6d08b8a95 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:29.664639 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-68363faf-a176-4699-b588-2ef6d08b8a95 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1474 microversion: 2.1 time: 0.244536 Sep 10 21:01:29.666804 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1760/3589] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:29 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1474 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:29.674743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a15fcda3-9ea9-4271-9cb3-4fa725750cfe tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:29.677113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a15fcda3-9ea9-4271-9cb3-4fa725750cfe tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:29.686193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a15fcda3-9ea9-4271-9cb3-4fa725750cfe tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.686993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a15fcda3-9ea9-4271-9cb3-4fa725750cfe tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.688481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a15fcda3-9ea9-4271-9cb3-4fa725750cfe tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.689414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a15fcda3-9ea9-4271-9cb3-4fa725750cfe tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.690117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a15fcda3-9ea9-4271-9cb3-4fa725750cfe tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.690876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a15fcda3-9ea9-4271-9cb3-4fa725750cfe tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.840427 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f2222197-3716-41ec-89b4-3f106105eb00 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/c269785c-3bfe-4271-b096-816698db85f6" status: 202 len: 0 microversion: 2.1 time: 0.279196 Sep 10 21:01:29.854266 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1830/3590] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:29 2022] DELETE /compute/v2.1/os-security-groups/c269785c-3bfe-4271-b096-816698db85f6 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:29.854266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4283abe4-6b37-4101-8f88-18944e1596ee req-6fffb24d-4fe8-4873-b8cd-e081fb106a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfdc13f-9c2e-44ec-8553-3f779ead89af", "name": "network-vif-plugged", "status": "completed", "tag": "b18a22e2-b050-417e-bebb-2f9e983473cc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:29.858585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a15fcda3-9ea9-4271-9cb3-4fa725750cfe tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:29.867563 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a15fcda3-9ea9-4271-9cb3-4fa725750cfe tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 200 len: 1474 microversion: 2.1 time: 0.198882 Sep 10 21:01:29.868374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=10 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:29.871118 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1761/3591] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:29 2022] GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 1474 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:29.874669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4283abe4-6b37-4101-8f88-18944e1596ee req-6fffb24d-4fe8-4873-b8cd-e081fb106a05 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.875889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4283abe4-6b37-4101-8f88-18944e1596ee req-6fffb24d-4fe8-4873-b8cd-e081fb106a05 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.876432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4283abe4-6b37-4101-8f88-18944e1596ee req-6fffb24d-4fe8-4873-b8cd-e081fb106a05 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.880300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-127ec9ac-e2f9-4fc8-b6a9-ac1ef04ebe59 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:29.881519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-127ec9ac-e2f9-4fc8-b6a9-ac1ef04ebe59 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:29.893158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-127ec9ac-e2f9-4fc8-b6a9-ac1ef04ebe59 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.894256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-127ec9ac-e2f9-4fc8-b6a9-ac1ef04ebe59 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.894927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-127ec9ac-e2f9-4fc8-b6a9-ac1ef04ebe59 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.895951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-127ec9ac-e2f9-4fc8-b6a9-ac1ef04ebe59 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:29.896597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-127ec9ac-e2f9-4fc8-b6a9-ac1ef04ebe59 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:29.897235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-127ec9ac-e2f9-4fc8-b6a9-ac1ef04ebe59 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:29.899484 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4283abe4-6b37-4101-8f88-18944e1596ee req-6fffb24d-4fe8-4873-b8cd-e081fb106a05 service nova] Creating event network-vif-plugged:b18a22e2-b050-417e-bebb-2f9e983473cc for instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af on nch1-master-1 Sep 10 21:01:29.905751 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4283abe4-6b37-4101-8f88-18944e1596ee req-6fffb24d-4fe8-4873-b8cd-e081fb106a05 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063121 Sep 10 21:01:29.906695 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1831/3592] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:29.917719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12f8b501-8312-4ef1-924b-d39fc45dd1d2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'create', calling method: .version_select at 0x7f993fc5dd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1635273091", "description": "tempest-description-1407347455"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:30.123913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-127ec9ac-e2f9-4fc8-b6a9-ac1ef04ebe59 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:30.137108 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-127ec9ac-e2f9-4fc8-b6a9-ac1ef04ebe59 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.264318 Sep 10 21:01:30.138458 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1762/3593] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:29 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:30.143815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-179199f6-19f8-4749-910e-e95ad61fbf91 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:30.144976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-179199f6-19f8-4749-910e-e95ad61fbf91 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:30.152661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179199f6-19f8-4749-910e-e95ad61fbf91 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:30.153382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179199f6-19f8-4749-910e-e95ad61fbf91 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:30.154011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179199f6-19f8-4749-910e-e95ad61fbf91 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:30.154892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179199f6-19f8-4749-910e-e95ad61fbf91 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:30.155500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179199f6-19f8-4749-910e-e95ad61fbf91 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:30.156010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179199f6-19f8-4749-910e-e95ad61fbf91 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:30.236160 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-12f8b501-8312-4ef1-924b-d39fc45dd1d2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.326896 Sep 10 21:01:30.237503 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1832/3594] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 21:01:29 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:30.243524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-862a8a17-de57-497b-9919-18da40bfb849 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:30.244920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-862a8a17-de57-497b-9919-18da40bfb849 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:30.254887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-862a8a17-de57-497b-9919-18da40bfb849 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:30.255386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-862a8a17-de57-497b-9919-18da40bfb849 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:30.256346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-862a8a17-de57-497b-9919-18da40bfb849 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:30.257048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-862a8a17-de57-497b-9919-18da40bfb849 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:30.257500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-862a8a17-de57-497b-9919-18da40bfb849 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:30.257980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-862a8a17-de57-497b-9919-18da40bfb849 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:30.430018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-179199f6-19f8-4749-910e-e95ad61fbf91 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:30.448789 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-179199f6-19f8-4749-910e-e95ad61fbf91 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.306925 Sep 10 21:01:30.449843 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1763/3595] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:30 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:30.461284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09e52162-2403-4ca4-8215-4f6b48888e64 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Action: 'update', calling method: .version_select at 0x7f994441f040>, body: {"security_group": {"name": "tempest-sg-hth-339818568", "description": "tempest-description-hth-173542255"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:30.576755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-862a8a17-de57-497b-9919-18da40bfb849 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:30.590070 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-862a8a17-de57-497b-9919-18da40bfb849 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1520 microversion: 2.1 time: 0.351095 Sep 10 21:01:30.591108 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1833/3596] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:30 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:30.603165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:30.607328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:30.622179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:30.622932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:30.623529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:30.624203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=12 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:30.628472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:30.629347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:30.630006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:30.912714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:30.927300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:30.930874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:30.932889 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8f91f286-5019-49c5-8c98-0ff605313d9c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.340034 Sep 10 21:01:30.934780 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1834/3597] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:30 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:30.954072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b81f9b09-acef-41fe-884e-1221250bd6ef tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:30.956708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b81f9b09-acef-41fe-884e-1221250bd6ef tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:30.968153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81f9b09-acef-41fe-884e-1221250bd6ef tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:30.968928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81f9b09-acef-41fe-884e-1221250bd6ef tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:30.969327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81f9b09-acef-41fe-884e-1221250bd6ef tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:30.970609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81f9b09-acef-41fe-884e-1221250bd6ef tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:30.972572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81f9b09-acef-41fe-884e-1221250bd6ef tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:30.973298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b81f9b09-acef-41fe-884e-1221250bd6ef tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.017471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b81f9b09-acef-41fe-884e-1221250bd6ef tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:31.162578 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b81f9b09-acef-41fe-884e-1221250bd6ef tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 204 len: 0 microversion: 2.1 time: 0.224121 Sep 10 21:01:31.163248 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1835/3598] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:30 2022] DELETE /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:31.173734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d52b3fd-1d35-4cfe-9255-abda79217368 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:31.174482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6d52b3fd-1d35-4cfe-9255-abda79217368 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:31.182643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d52b3fd-1d35-4cfe-9255-abda79217368 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:31.183156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d52b3fd-1d35-4cfe-9255-abda79217368 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:31.183599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d52b3fd-1d35-4cfe-9255-abda79217368 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.184617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d52b3fd-1d35-4cfe-9255-abda79217368 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:31.185110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d52b3fd-1d35-4cfe-9255-abda79217368 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:31.185592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d52b3fd-1d35-4cfe-9255-abda79217368 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.352445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6d52b3fd-1d35-4cfe-9255-abda79217368 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:31.362300 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6d52b3fd-1d35-4cfe-9255-abda79217368 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1474 microversion: 2.1 time: 0.193941 Sep 10 21:01:31.374350 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1836/3599] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:31 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1474 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:31.381569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-379ecba1-2d71-4dec-a9a8-c34f002a7a75 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:31.382234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-379ecba1-2d71-4dec-a9a8-c34f002a7a75 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:31.389043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379ecba1-2d71-4dec-a9a8-c34f002a7a75 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:31.389900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379ecba1-2d71-4dec-a9a8-c34f002a7a75 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:31.390597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379ecba1-2d71-4dec-a9a8-c34f002a7a75 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.391658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379ecba1-2d71-4dec-a9a8-c34f002a7a75 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:31.392115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379ecba1-2d71-4dec-a9a8-c34f002a7a75 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:31.392662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379ecba1-2d71-4dec-a9a8-c34f002a7a75 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.541026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-379ecba1-2d71-4dec-a9a8-c34f002a7a75 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:31.550960 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-379ecba1-2d71-4dec-a9a8-c34f002a7a75 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 200 len: 1474 microversion: 2.1 time: 0.174899 Sep 10 21:01:31.551639 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1837/3600] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:31 2022] GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 1474 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:31.557358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-32b61939-326f-43a3-87be-fb081785777f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:31.558184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-32b61939-326f-43a3-87be-fb081785777f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:31.572262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32b61939-326f-43a3-87be-fb081785777f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:31.572980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32b61939-326f-43a3-87be-fb081785777f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:31.573594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32b61939-326f-43a3-87be-fb081785777f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.574672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32b61939-326f-43a3-87be-fb081785777f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:31.575292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32b61939-326f-43a3-87be-fb081785777f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:31.575878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32b61939-326f-43a3-87be-fb081785777f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.744608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-32b61939-326f-43a3-87be-fb081785777f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:31.755269 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-32b61939-326f-43a3-87be-fb081785777f tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1517 microversion: 2.1 time: 0.202410 Sep 10 21:01:31.755989 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1838/3601] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:31 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:31.761234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-37c9d73f-2cae-4923-9701-5db2ca6511f1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:31.762153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-37c9d73f-2cae-4923-9701-5db2ca6511f1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:31.784789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37c9d73f-2cae-4923-9701-5db2ca6511f1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:31.788965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37c9d73f-2cae-4923-9701-5db2ca6511f1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:31.789795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37c9d73f-2cae-4923-9701-5db2ca6511f1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.790886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37c9d73f-2cae-4923-9701-5db2ca6511f1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:31.791421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37c9d73f-2cae-4923-9701-5db2ca6511f1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:31.791920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37c9d73f-2cae-4923-9701-5db2ca6511f1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.831635 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09e52162-2403-4ca4-8215-4f6b48888e64 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/5f792f80-83f5-4f30-8787-23de36f85fcf" status: 200 len: 216 microversion: 2.1 time: 1.380752 Sep 10 21:01:31.832912 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1764/3602] 10.222.0.33 () {60 vars in 1290 bytes} [Sat Sep 10 21:01:30 2022] PUT /compute/v2.1/os-security-groups/5f792f80-83f5-4f30-8787-23de36f85fcf => generated 216 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:31.847980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1fceb0a1-32e8-47d8-ad75-686daa5613a8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:31.849703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1fceb0a1-32e8-47d8-ad75-686daa5613a8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:31.860435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fceb0a1-32e8-47d8-ad75-686daa5613a8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:31.861184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fceb0a1-32e8-47d8-ad75-686daa5613a8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:31.861852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fceb0a1-32e8-47d8-ad75-686daa5613a8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.862969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fceb0a1-32e8-47d8-ad75-686daa5613a8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:31.863467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fceb0a1-32e8-47d8-ad75-686daa5613a8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:31.863882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fceb0a1-32e8-47d8-ad75-686daa5613a8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:31.990698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-37c9d73f-2cae-4923-9701-5db2ca6511f1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:31.999151 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-37c9d73f-2cae-4923-9701-5db2ca6511f1 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1526 microversion: 2.1 time: 0.241857 Sep 10 21:01:31.999651 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1839/3603] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:31 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1526 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:32.019148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-25f27052-ca38-4839-8151-03fec2b27df0 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f993fc5ddc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:32.087256 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-25f27052-ca38-4839-8151-03fec2b27df0 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/5f792f80-83f5-4f30-8787-23de36f85fcf" status: 200 len: 216 microversion: 2.1 time: 0.085887 Sep 10 21:01:32.096487 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1840/3604] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 21:01:31 2022] GET /compute/v2.1/os-security-groups/5f792f80-83f5-4f30-8787-23de36f85fcf => generated 216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:32.096487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:32.097024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:32.122375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:32.123438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:32.124416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:32.125816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:32.127610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:32.128466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:32.530630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1fceb0a1-32e8-47d8-ad75-686daa5613a8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:32.540016 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1fceb0a1-32e8-47d8-ad75-686daa5613a8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.704628 Sep 10 21:01:32.540875 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1765/3605] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:31 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:32.545926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a2f4f58a-ffdc-4e03-80c1-8af78fc31655 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f9944bc1c10>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:32.843071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:32.853995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:32.861285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:32.865945 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b1fb2fa2-4886-4bea-a737-a00268caed2b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.776959 Sep 10 21:01:32.867048 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1841/3606] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:32 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:32.878021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-139f78c5-bd4a-4cff-a522-5eb258ccc7ab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:32.882844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-139f78c5-bd4a-4cff-a522-5eb258ccc7ab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:32.899951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-139f78c5-bd4a-4cff-a522-5eb258ccc7ab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:32.901477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-139f78c5-bd4a-4cff-a522-5eb258ccc7ab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:32.902057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-139f78c5-bd4a-4cff-a522-5eb258ccc7ab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:32.902786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-139f78c5-bd4a-4cff-a522-5eb258ccc7ab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:32.903351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-139f78c5-bd4a-4cff-a522-5eb258ccc7ab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:32.903756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-139f78c5-bd4a-4cff-a522-5eb258ccc7ab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:33.466425 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a2f4f58a-ffdc-4e03-80c1-8af78fc31655 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5f792f80-83f5-4f30-8787-23de36f85fcf" status: 202 len: 0 microversion: 2.1 time: 0.924152 Sep 10 21:01:33.467427 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1766/3607] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:32 2022] DELETE /compute/v2.1/os-security-groups/5f792f80-83f5-4f30-8787-23de36f85fcf => generated 0 bytes in 926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:33.475714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:33.476775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:33.508531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:33.509103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-139f78c5-bd4a-4cff-a522-5eb258ccc7ab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:33.511320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:33.511453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:33.515613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:33.519126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:33.519126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:33.522825 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-139f78c5-bd4a-4cff-a522-5eb258ccc7ab tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 200 len: 1432 microversion: 2.1 time: 0.652833 Sep 10 21:01:33.523823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:33.524411 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1842/3608] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:32 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 1432 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:33.551154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-37923c1a-2b79-45b8-bcfa-108aff2a7b84 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:33.554133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-37923c1a-2b79-45b8-bcfa-108aff2a7b84 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:33.566072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37923c1a-2b79-45b8-bcfa-108aff2a7b84 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:33.566631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37923c1a-2b79-45b8-bcfa-108aff2a7b84 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:33.567418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37923c1a-2b79-45b8-bcfa-108aff2a7b84 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:33.568627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37923c1a-2b79-45b8-bcfa-108aff2a7b84 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:33.569403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37923c1a-2b79-45b8-bcfa-108aff2a7b84 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:33.570177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37923c1a-2b79-45b8-bcfa-108aff2a7b84 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:33.611124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:33.611640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:33.617923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:33.618745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lazy-loading 'fault' on Instance uuid 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:33.700964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ee4fa83ef649d0bdc273243cd717c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c091a483f8b466f89ea487d13fe422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:33.717952 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-79e09036-5fc1-426a-898d-09dc5c29280d tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 200 len: 1308 microversion: 2.1 time: 0.248883 Sep 10 21:01:33.721615 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1767/3609] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:33 2022] GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:33.760922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-39520fed-d17f-47a5-894c-be89aeefa511 req-9ba08910-1a18-40f3-a17f-28e0483023ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af65c85f-8f25-4d07-bc16-637834210814", "name": "network-vif-deleted", "tag": "9a0c1860-2a38-4b12-bd81-ee22500329c0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:33.790774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-39520fed-d17f-47a5-894c-be89aeefa511 req-9ba08910-1a18-40f3-a17f-28e0483023ad service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:33.791485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-39520fed-d17f-47a5-894c-be89aeefa511 req-9ba08910-1a18-40f3-a17f-28e0483023ad service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:33.799855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-39520fed-d17f-47a5-894c-be89aeefa511 req-9ba08910-1a18-40f3-a17f-28e0483023ad service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:33.811850 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-39520fed-d17f-47a5-894c-be89aeefa511 req-9ba08910-1a18-40f3-a17f-28e0483023ad service nova] Creating event network-vif-deleted:9a0c1860-2a38-4b12-bd81-ee22500329c0 for instance af65c85f-8f25-4d07-bc16-637834210814 on nch2-master-1 Sep 10 21:01:33.832913 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-39520fed-d17f-47a5-894c-be89aeefa511 req-9ba08910-1a18-40f3-a17f-28e0483023ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096641 Sep 10 21:01:33.837917 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1768/3610] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:33.849487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6f534cec-daab-41ed-85ba-49b4059487dc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:33.853140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6f534cec-daab-41ed-85ba-49b4059487dc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:33.872921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f534cec-daab-41ed-85ba-49b4059487dc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:33.876467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f534cec-daab-41ed-85ba-49b4059487dc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:33.876974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f534cec-daab-41ed-85ba-49b4059487dc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:33.878392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f534cec-daab-41ed-85ba-49b4059487dc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:33.880645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f534cec-daab-41ed-85ba-49b4059487dc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:33.882343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f534cec-daab-41ed-85ba-49b4059487dc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:34.176377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-37923c1a-2b79-45b8-bcfa-108aff2a7b84 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:34.192932 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-37923c1a-2b79-45b8-bcfa-108aff2a7b84 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.649145 Sep 10 21:01:34.198096 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1843/3611] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:33 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:34.203449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:34.208691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:34.223646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:34.226290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:34.227688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:34.230125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:34.230881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:34.233634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:34.273631 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 HTTP/1.1 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '16ab7365-3c1e-4122-b234-34076143bce8'} Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:34.277444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:34.281659 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:34.284191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:34.285337 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96390449-865f-46ec-b124-ae7f74917464 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 404 len: 111 microversion: 2.1 time: 0.086231 Sep 10 21:01:34.286503 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1844/3612] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:34 2022] DELETE /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:34.291500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5059c57-c6c9-4731-ac5c-55c201cbd7f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:34.292947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e5059c57-c6c9-4731-ac5c-55c201cbd7f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:34.304097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5059c57-c6c9-4731-ac5c-55c201cbd7f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:34.305175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5059c57-c6c9-4731-ac5c-55c201cbd7f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:34.307230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5059c57-c6c9-4731-ac5c-55c201cbd7f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:34.308577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5059c57-c6c9-4731-ac5c-55c201cbd7f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:34.318651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5059c57-c6c9-4731-ac5c-55c201cbd7f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:34.319439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5059c57-c6c9-4731-ac5c-55c201cbd7f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:34.540851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6f534cec-daab-41ed-85ba-49b4059487dc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0c7612d933424597e1f176be189a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebec33205424ecf92b54428bdf5eb61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:34.557667 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6f534cec-daab-41ed-85ba-49b4059487dc tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 200 len: 1526 microversion: 2.1 time: 0.718092 Sep 10 21:01:34.558303 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1769/3613] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:33 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 1526 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:34.578668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:34.581889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:34.592389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:34.593321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:34.594736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:34.595765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:34.596466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:34.597062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:34.809158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e5059c57-c6c9-4731-ac5c-55c201cbd7f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:34.820300 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5059c57-c6c9-4731-ac5c-55c201cbd7f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.531373 Sep 10 21:01:34.821721 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1845/3614] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:34 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:34.826970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-deab2b08-937a-44b6-97ae-d3c526298a5a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:34.828731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-deab2b08-937a-44b6-97ae-d3c526298a5a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:34.835692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-deab2b08-937a-44b6-97ae-d3c526298a5a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:34.836531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-deab2b08-937a-44b6-97ae-d3c526298a5a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:34.837308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-deab2b08-937a-44b6-97ae-d3c526298a5a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:34.839335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-deab2b08-937a-44b6-97ae-d3c526298a5a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:34.840219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-deab2b08-937a-44b6-97ae-d3c526298a5a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:34.840761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-deab2b08-937a-44b6-97ae-d3c526298a5a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:34.963256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:34.977561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:34.979905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:34.981557 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9e829dd1-f366-47bf-ae08-6306d135afac tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.415339 Sep 10 21:01:34.995142 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1770/3615] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:34 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:35.001731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.002697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: 16ab7365-3c1e-4122-b234-34076143bce8] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:35.012217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.012880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.013488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.014536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.015185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.016765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.036678 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 HTTP/1.1 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '16ab7365-3c1e-4122-b234-34076143bce8'} Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.039101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.043961 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.043961 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.043961 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.043961 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:35.043961 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:35.043961 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. Sep 10 21:01:35.043961 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.045297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Instance 16ab7365-3c1e-4122-b234-34076143bce8 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:35.048685 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eeb77922-c917-4f60-8da3-b201ea2e5b31 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8" status: 404 len: 111 microversion: 2.1 time: 0.050229 Sep 10 21:01:35.049539 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1771/3616] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:34 2022] GET /compute/v2.1/servers/16ab7365-3c1e-4122-b234-34076143bce8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:35.054814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a753754d-aab4-495e-8069-d8b328e3d582 req-83b29f18-0215-40dd-a587-5be71b30ecbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f34498-848f-44b8-92af-e6fbd1760ba6", "name": "network-vif-deleted", "tag": "2df22809-20c4-4a16-8747-2eab50949e85"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:35.068028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a753754d-aab4-495e-8069-d8b328e3d582 req-83b29f18-0215-40dd-a587-5be71b30ecbd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.068604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a753754d-aab4-495e-8069-d8b328e3d582 req-83b29f18-0215-40dd-a587-5be71b30ecbd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.069113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a753754d-aab4-495e-8069-d8b328e3d582 req-83b29f18-0215-40dd-a587-5be71b30ecbd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.083775 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a753754d-aab4-495e-8069-d8b328e3d582 req-83b29f18-0215-40dd-a587-5be71b30ecbd service nova] Creating event network-vif-deleted:2df22809-20c4-4a16-8747-2eab50949e85 for instance 03f34498-848f-44b8-92af-e6fbd1760ba6 on nch2-master-1 Sep 10 21:01:35.089339 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a753754d-aab4-495e-8069-d8b328e3d582 req-83b29f18-0215-40dd-a587-5be71b30ecbd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038179 Sep 10 21:01:35.090207 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1772/3617] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:35.098091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.099143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 5295c29d-1e1a-4858-81b2-80ff782a328f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:35.105483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.106017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.106463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.107173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.107638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.108071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.123271 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] HTTP exception thrown: Instance 5295c29d-1e1a-4858-81b2-80ff782a328f could not be found. Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Request method failure captured: Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f HTTP/1.1 Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpD3XorJTOmshO8ShrGydR5Yh_ZW0GoFIPFNux3cdIuCEy4uljcIp1YR897IiLrXZKVrCAKwE0sC-SMLCx-PCumGee9Ldi4xcTYCHtnGk7w6VvimIT9qdN4eJRT9gk5WZTFLHhN4iq_vV4cb9iSKJhhLieaETbdjqgODHmuRL06q2E Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d30ef9b7525e4784be26268f46121e62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d30ef9b7525e4784be26268f46121e62"}]}] Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: f38321284ec449e599d645625ed11139 Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5295c29d-1e1a-4858-81b2-80ff782a328f could not be found. Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5295c29d-1e1a-4858-81b2-80ff782a328f'} Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5295c29d-1e1a-4858-81b2-80ff782a328f could not be found. Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5295c29d-1e1a-4858-81b2-80ff782a328f could not be found. Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.126808 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.131860 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.131860 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.131860 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.131860 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:35.131860 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:35.131860 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5295c29d-1e1a-4858-81b2-80ff782a328f could not be found. Sep 10 21:01:35.131860 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.133088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Returning 404 to user: Instance 5295c29d-1e1a-4858-81b2-80ff782a328f could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:35.134467 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0cd802c4-d828-43df-ad6d-c7ee082d9308 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f" status: 404 len: 111 microversion: 2.1 time: 0.041190 Sep 10 21:01:35.135571 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1773/3618] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:35 2022] GET /compute/v2.1/servers/5295c29d-1e1a-4858-81b2-80ff782a328f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:35.141774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.142432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] [instance: 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:35.149405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.150470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.150927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.151649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.152578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.153021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.168139 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] HTTP exception thrown: Instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 could not be found. Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Request method failure captured: Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 HTTP/1.1 Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqHKJMr9n4zFBrwCDwggOICWTV5On1JiBAMDvH8fT8-NNoh73qnESdvbRp5btSPUfcXOWmR6sAsxEx8RIQp_JClZdXb2cSOfIz3x1mdp6jyHpbOyDvOb38iKe4c0pwkvIhv6QXiGdipvzJ_b-BYm9ffGz7YrTRpz9iFUHUaXClTMJM Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9c091a483f8b466f89ea487d13fe422b Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ListImageFiltersTestJSON-1731426525 Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c091a483f8b466f89ea487d13fe422b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c091a483f8b466f89ea487d13fe422b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9c091a483f8b466f89ea487d13fe422b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9c091a483f8b466f89ea487d13fe422b"}]}] Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ListImageFiltersTestJSON-1731426525 Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9c091a483f8b466f89ea487d13fe422b Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1731426525 Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ListImageFiltersTestJSON-1731426525-project Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 81ee4fa83ef649d0bdc273243cd717c4 Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ListImageFiltersTestJSON-1731426525-project Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 could not be found. Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '9e7d1492-dc6d-4ddc-ada0-4d492a0916d6'} Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 could not be found. Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 could not be found. Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.169711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.177231 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.177231 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.177231 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.177231 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:35.177231 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:35.177231 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 could not be found. Sep 10 21:01:35.177231 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.177231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Returning 404 to user: Instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:35.177231 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-964d2371-b951-4f8a-aa76-22219cb454c2 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6" status: 404 len: 111 microversion: 2.1 time: 0.034417 Sep 10 21:01:35.177231 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1774/3619] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:35 2022] GET /compute/v2.1/servers/9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:35.180120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16cddc23-583a-4fbc-a88a-ebd6c77a73aa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f9944d73e50>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.196700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-deab2b08-937a-44b6-97ae-d3c526298a5a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:35.205567 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-deab2b08-937a-44b6-97ae-d3c526298a5a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.382402 Sep 10 21:01:35.206208 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1846/3620] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:34 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:35.212358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.213247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: af65c85f-8f25-4d07-bc16-637834210814] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:35.219918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.220311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.220851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.223679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.224309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.224760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.225268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-16cddc23-583a-4fbc-a88a-ebd6c77a73aa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c269785c-3bfe-4271-b096-816698db85f6 does not exist", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:01:35.226314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.security_group_api [None req-16cddc23-583a-4fbc-a88a-ebd6c77a73aa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Neutron security group c269785c-3bfe-4271-b096-816698db85f6 not found {{(pid=145771) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 21:01:35.227020 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-16cddc23-583a-4fbc-a88a-ebd6c77a73aa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security group c269785c-3bfe-4271-b096-816698db85f6 does not exist Sep 10 21:01:35.227020 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-42df2f82-8031-44d4-a230-127dc09c1188'] Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16cddc23-583a-4fbc-a88a-ebd6c77a73aa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/os-security-groups/c269785c-3bfe-4271-b096-816698db85f6 HTTP/1.1 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: exception: Security group c269785c-3bfe-4271-b096-816698db85f6 does not exist Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-42df2f82-8031-44d4-a230-127dc09c1188'] Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'c269785c-3bfe-4271-b096-816698db85f6'} Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:01:35.229855 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c269785c-3bfe-4271-b096-816698db85f6 does not exist Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42df2f82-8031-44d4-a230-127dc09c1188'] Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c269785c-3bfe-4271-b096-816698db85f6 does not exist Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42df2f82-8031-44d4-a230-127dc09c1188'] Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c269785c-3bfe-4271-b096-816698db85f6 does not exist Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42df2f82-8031-44d4-a230-127dc09c1188'] Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c269785c-3bfe-4271-b096-816698db85f6 does not exist Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42df2f82-8031-44d4-a230-127dc09c1188'] Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16cddc23-583a-4fbc-a88a-ebd6c77a73aa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Security group c269785c-3bfe-4271-b096-816698db85f6 does not exist Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-42df2f82-8031-44d4-a230-127dc09c1188'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-16cddc23-583a-4fbc-a88a-ebd6c77a73aa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/c269785c-3bfe-4271-b096-816698db85f6" status: 404 len: 194 microversion: 2.1 time: 0.055035 Sep 10 21:01:35.236668 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1775/3621] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:35 2022] DELETE /compute/v2.1/os-security-groups/c269785c-3bfe-4271-b096-816698db85f6 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:35.243574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4bf9c0c1-85b2-4887-bb8c-47e702c00795 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f994468b790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.244459 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] HTTP exception thrown: Instance af65c85f-8f25-4d07-bc16-637834210814 could not be found. Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Request method failure captured: Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 HTTP/1.1 Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpD3XorJTOmshO8ShrGydR5Yh_ZW0GoFIPFNux3cdIuCEy4uljcIp1YR897IiLrXZKVrCAKwE0sC-SMLCx-PCumGee9Ldi4xcTYCHtnGk7w6VvimIT9qdN4eJRT9gk5WZTFLHhN4iq_vV4cb9iSKJhhLieaETbdjqgODHmuRL06q2E Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d30ef9b7525e4784be26268f46121e62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d30ef9b7525e4784be26268f46121e62"}]}] Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f38321284ec449e599d645625ed11139 Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance af65c85f-8f25-4d07-bc16-637834210814 could not be found. Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'af65c85f-8f25-4d07-bc16-637834210814'} Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af65c85f-8f25-4d07-bc16-637834210814 could not be found. Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af65c85f-8f25-4d07-bc16-637834210814 could not be found. Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.246239 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.251982 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.251982 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.251982 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.251982 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:35.251982 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:35.251982 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af65c85f-8f25-4d07-bc16-637834210814 could not be found. Sep 10 21:01:35.251982 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.251982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Returning 404 to user: Instance af65c85f-8f25-4d07-bc16-637834210814 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:35.251982 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0c6489f0-3dca-46be-b409-f9e4b22bdfa7 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814" status: 404 len: 111 microversion: 2.1 time: 0.040444 Sep 10 21:01:35.251982 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1847/3622] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:35 2022] GET /compute/v2.1/servers/af65c85f-8f25-4d07-bc16-637834210814 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:35.254424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1198947b-f58a-4d02-a65c-acc9933f11e3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.255491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1198947b-f58a-4d02-a65c-acc9933f11e3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:35.261031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1198947b-f58a-4d02-a65c-acc9933f11e3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.261522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1198947b-f58a-4d02-a65c-acc9933f11e3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.262000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1198947b-f58a-4d02-a65c-acc9933f11e3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.262672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1198947b-f58a-4d02-a65c-acc9933f11e3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.263317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1198947b-f58a-4d02-a65c-acc9933f11e3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.263774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1198947b-f58a-4d02-a65c-acc9933f11e3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.426120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1198947b-f58a-4d02-a65c-acc9933f11e3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:35.435204 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1198947b-f58a-4d02-a65c-acc9933f11e3 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.185527 Sep 10 21:01:35.436620 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1848/3623] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:35 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:35.442613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-643d0018-3aa3-4205-b055-4fd9cb1e4a42 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f993fc5da60>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.492222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-643d0018-3aa3-4205-b055-4fd9cb1e4a42 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cebbb4ae-a656-4074-9ac9-c20edc5dce67 does not exist", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:01:35.492833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.security_group_api [None req-643d0018-3aa3-4205-b055-4fd9cb1e4a42 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Neutron security group cebbb4ae-a656-4074-9ac9-c20edc5dce67 not found {{(pid=145772) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 21:01:35.493360 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-643d0018-3aa3-4205-b055-4fd9cb1e4a42 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security group cebbb4ae-a656-4074-9ac9-c20edc5dce67 does not exist Sep 10 21:01:35.493360 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-12749b40-8250-4550-af7f-db59e42ffbbf'] Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-643d0018-3aa3-4205-b055-4fd9cb1e4a42 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-security-groups/cebbb4ae-a656-4074-9ac9-c20edc5dce67 HTTP/1.1 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: exception: Security group cebbb4ae-a656-4074-9ac9-c20edc5dce67 does not exist Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-12749b40-8250-4550-af7f-db59e42ffbbf'] Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'cebbb4ae-a656-4074-9ac9-c20edc5dce67'} Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:01:35.495462 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cebbb4ae-a656-4074-9ac9-c20edc5dce67 does not exist Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12749b40-8250-4550-af7f-db59e42ffbbf'] Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cebbb4ae-a656-4074-9ac9-c20edc5dce67 does not exist Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12749b40-8250-4550-af7f-db59e42ffbbf'] Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cebbb4ae-a656-4074-9ac9-c20edc5dce67 does not exist Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12749b40-8250-4550-af7f-db59e42ffbbf'] Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cebbb4ae-a656-4074-9ac9-c20edc5dce67 does not exist Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12749b40-8250-4550-af7f-db59e42ffbbf'] Sep 10 21:01:35.500705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.508196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-643d0018-3aa3-4205-b055-4fd9cb1e4a42 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Security group cebbb4ae-a656-4074-9ac9-c20edc5dce67 does not exist Sep 10 21:01:35.508196 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-12749b40-8250-4550-af7f-db59e42ffbbf'] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:35.508196 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-643d0018-3aa3-4205-b055-4fd9cb1e4a42 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/cebbb4ae-a656-4074-9ac9-c20edc5dce67" status: 404 len: 194 microversion: 2.1 time: 0.067064 Sep 10 21:01:35.508196 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1849/3624] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:35 2022] DELETE /compute/v2.1/os-security-groups/cebbb4ae-a656-4074-9ac9-c20edc5dce67 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:35.515256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3d27c703-0be7-4bcf-9475-d4f9b17cbadb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.553790 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3d27c703-0be7-4bcf-9475-d4f9b17cbadb tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/242ea9e9-4cd4-4f66-85d6-2ff28dd2d775" status: 204 len: 0 microversion: 2.1 time: 0.046686 Sep 10 21:01:35.554638 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1850/3625] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 21:01:35 2022] DELETE /compute/v2.1/os-server-groups/242ea9e9-4cd4-4f66-85d6-2ff28dd2d775 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:35.559363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3440cb97-7499-4dc4-a9bc-3e15c0c320c5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:35.566150 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-3440cb97-7499-4dc4-a9bc-3e15c0c320c5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 809ce373-2298-4b64-b213-ad989ce8d431 has no mapping to a cell. Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3440cb97-7499-4dc4-a9bc-3e15c0c320c5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/809ce373-2298-4b64-b213-ad989ce8d431/action HTTP/1.1 Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 15 Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: {"os-stop": {}} Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 809ce373-2298-4b64-b213-ad989ce8d431 has no mapping to a cell. Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '809ce373-2298-4b64-b213-ad989ce8d431', 'body': {'os-stop': {}}} Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 809ce373-2298-4b64-b213-ad989ce8d431 has no mapping to a cell. Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:35.578023 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 809ce373-2298-4b64-b213-ad989ce8d431 has no mapping to a cell. Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 809ce373-2298-4b64-b213-ad989ce8d431 has no mapping to a cell. Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3440cb97-7499-4dc4-a9bc-3e15c0c320c5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 809ce373-2298-4b64-b213-ad989ce8d431 has no mapping to a cell. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3440cb97-7499-4dc4-a9bc-3e15c0c320c5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/809ce373-2298-4b64-b213-ad989ce8d431/action" status: 404 len: 117 microversion: 2.1 time: 0.024556 Sep 10 21:01:35.584002 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1851/3626] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:35 2022] POST /compute/v2.1/servers/809ce373-2298-4b64-b213-ad989ce8d431/action => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:35.586948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08ff0a34-1bb5-4dda-94c7-dc530a2c5525 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f993fc99940>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.626021 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4bf9c0c1-85b2-4887-bb8c-47e702c00795 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "DELETE /compute/v2.1/images/b24e3cc0-e842-4c7a-b844-dc5628012687" status: 204 len: 0 microversion: 2.1 time: 0.390328 Sep 10 21:01:35.626600 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1776/3627] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:35 2022] DELETE /compute/v2.1/images/b24e3cc0-e842-4c7a-b844-dc5628012687 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:35.631178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-50293f57-f0db-4a3f-987d-9958e3bd1583 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.631682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-50293f57-f0db-4a3f-987d-9958e3bd1583 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 4f5284d9-8123-4e15-8576-be144c016b44] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:35.644274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50293f57-f0db-4a3f-987d-9958e3bd1583 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.644775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50293f57-f0db-4a3f-987d-9958e3bd1583 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.645205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50293f57-f0db-4a3f-987d-9958e3bd1583 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.646013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50293f57-f0db-4a3f-987d-9958e3bd1583 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.646828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50293f57-f0db-4a3f-987d-9958e3bd1583 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.647159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50293f57-f0db-4a3f-987d-9958e3bd1583 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.671475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-08ff0a34-1bb5-4dda-94c7-dc530a2c5525 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:01:35.672667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.security_group_api [None req-08ff0a34-1bb5-4dda-94c7-dc530a2c5525 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Neutron security group e8aad778-afd1-420f-a28b-2290dab387a9 not found {{(pid=145772) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 21:01:35.673197 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-08ff0a34-1bb5-4dda-94c7-dc530a2c5525 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:01:35.673197 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-e7581f10-7cea-4d9e-b962-410c50a850c2'] Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08ff0a34-1bb5-4dda-94c7-dc530a2c5525 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-security-groups/e8aad778-afd1-420f-a28b-2290dab387a9 HTTP/1.1 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: exception: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-e7581f10-7cea-4d9e-b962-410c50a850c2'] Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e8aad778-afd1-420f-a28b-2290dab387a9'} Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:01:35.675969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7581f10-7cea-4d9e-b962-410c50a850c2'] Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7581f10-7cea-4d9e-b962-410c50a850c2'] Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7581f10-7cea-4d9e-b962-410c50a850c2'] Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7581f10-7cea-4d9e-b962-410c50a850c2'] Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08ff0a34-1bb5-4dda-94c7-dc530a2c5525 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Security group e8aad778-afd1-420f-a28b-2290dab387a9 does not exist Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-e7581f10-7cea-4d9e-b962-410c50a850c2'] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:35.681047 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-08ff0a34-1bb5-4dda-94c7-dc530a2c5525 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e8aad778-afd1-420f-a28b-2290dab387a9" status: 404 len: 194 microversion: 2.1 time: 0.095691 Sep 10 21:01:35.685499 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1852/3628] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:35 2022] DELETE /compute/v2.1/os-security-groups/e8aad778-afd1-420f-a28b-2290dab387a9 => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:35.698331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.699577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 03f34498-848f-44b8-92af-e6fbd1760ba6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:35.708208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-50293f57-f0db-4a3f-987d-9958e3bd1583 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 4f5284d9-8123-4e15-8576-be144c016b44] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:35.717082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.718125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.719698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.720785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.721603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.722369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.741334 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Instance 03f34498-848f-44b8-92af-e6fbd1760ba6 could not be found. Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 HTTP/1.1 Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 03f34498-848f-44b8-92af-e6fbd1760ba6 could not be found. Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '03f34498-848f-44b8-92af-e6fbd1760ba6'} Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f34498-848f-44b8-92af-e6fbd1760ba6 could not be found. Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f34498-848f-44b8-92af-e6fbd1760ba6 could not be found. Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.742914 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f34498-848f-44b8-92af-e6fbd1760ba6 could not be found. Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 404 to user: Instance 03f34498-848f-44b8-92af-e6fbd1760ba6 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fe2c813a-d739-4f2a-b7ad-8dcba89799f0 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6" status: 404 len: 111 microversion: 2.1 time: 0.058588 Sep 10 21:01:35.747359 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1853/3629] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:35 2022] GET /compute/v2.1/servers/03f34498-848f-44b8-92af-e6fbd1760ba6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:35.754591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-88420791-b74b-460a-8472-7100ffbe0cef tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.755366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-88420791-b74b-460a-8472-7100ffbe0cef tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:35.762045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88420791-b74b-460a-8472-7100ffbe0cef tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.762620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88420791-b74b-460a-8472-7100ffbe0cef tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.763340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88420791-b74b-460a-8472-7100ffbe0cef tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.764260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88420791-b74b-460a-8472-7100ffbe0cef tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:35.764945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88420791-b74b-460a-8472-7100ffbe0cef tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:35.765541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88420791-b74b-460a-8472-7100ffbe0cef tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:35.826084 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-50293f57-f0db-4a3f-987d-9958e3bd1583 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44" status: 204 len: 0 microversion: 2.1 time: 0.198195 Sep 10 21:01:35.830149 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1777/3630] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:35 2022] DELETE /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:35.838435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f62f802a-15c7-49dc-ba2f-1b52692215a6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f99446938b0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.940891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-88420791-b74b-460a-8472-7100ffbe0cef tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:35.949608 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-88420791-b74b-460a-8472-7100ffbe0cef tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.200113 Sep 10 21:01:35.950239 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1854/3631] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:35 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:35.955795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5fa3cd64-1eac-4337-a472-7382ce147489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f993fc17820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:35.989998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-5fa3cd64-1eac-4337-a472-7382ce147489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:01:35.990602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.security_group_api [None req-5fa3cd64-1eac-4337-a472-7382ce147489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Neutron security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 not found {{(pid=145772) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 21:01:35.991188 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-5fa3cd64-1eac-4337-a472-7382ce147489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:01:35.991188 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-a83d5d84-5703-442d-a2e2-6ce230731afe'] Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5fa3cd64-1eac-4337-a472-7382ce147489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-security-groups/4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 HTTP/1.1 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: exception: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-a83d5d84-5703-442d-a2e2-6ce230731afe'] Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '4c2593f8-ed2a-4b8b-87ef-3e77141a83a6'} Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:01:35.992937 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a83d5d84-5703-442d-a2e2-6ce230731afe'] Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a83d5d84-5703-442d-a2e2-6ce230731afe'] Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a83d5d84-5703-442d-a2e2-6ce230731afe'] Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a83d5d84-5703-442d-a2e2-6ce230731afe'] Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5fa3cd64-1eac-4337-a472-7382ce147489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Security group 4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 does not exist Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-a83d5d84-5703-442d-a2e2-6ce230731afe'] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5fa3cd64-1eac-4337-a472-7382ce147489 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4c2593f8-ed2a-4b8b-87ef-3e77141a83a6" status: 404 len: 194 microversion: 2.1 time: 0.042919 Sep 10 21:01:36.000364 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1855/3632] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:35 2022] DELETE /compute/v2.1/os-security-groups/4c2593f8-ed2a-4b8b-87ef-3e77141a83a6 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:36.009859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-391ca72c-7ce8-4af3-9b02-180fadcd1887 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '.version_select at 0x7f993fbc4af0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.030166 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-391ca72c-7ce8-4af3-9b02-180fadcd1887 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Image not found. Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-391ca72c-7ce8-4af3-9b02-180fadcd1887 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/images/118c817d-c8d5-4010-9140-68fe92f9db71 HTTP/1.1 Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: exception: Image not found. Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '118c817d-c8d5-4010-9140-68fe92f9db71'} Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 118c817d-c8d5-4010-9140-68fe92f9db71 to delete Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 118c817d-c8d5-4010-9140-68fe92f9db71 could not be found. Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.033772 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-391ca72c-7ce8-4af3-9b02-180fadcd1887 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 404 to user: Image not found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-391ca72c-7ce8-4af3-9b02-180fadcd1887 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "DELETE /compute/v2.1/images/118c817d-c8d5-4010-9140-68fe92f9db71" status: 404 len: 62 microversion: 2.1 time: 0.038789 Sep 10 21:01:36.038594 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1856/3633] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:35 2022] DELETE /compute/v2.1/images/118c817d-c8d5-4010-9140-68fe92f9db71 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 21:01:36.044345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4bf15bcc-e3a3-4425-a953-790bb65d7b2b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.044900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4bf15bcc-e3a3-4425-a953-790bb65d7b2b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:36.053008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bf15bcc-e3a3-4425-a953-790bb65d7b2b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.053590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bf15bcc-e3a3-4425-a953-790bb65d7b2b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.054051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bf15bcc-e3a3-4425-a953-790bb65d7b2b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.054758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bf15bcc-e3a3-4425-a953-790bb65d7b2b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.055212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bf15bcc-e3a3-4425-a953-790bb65d7b2b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.055664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bf15bcc-e3a3-4425-a953-790bb65d7b2b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.088785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4bf15bcc-e3a3-4425-a953-790bb65d7b2b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:36.102563 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f62f802a-15c7-49dc-ba2f-1b52692215a6 tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "DELETE /compute/v2.1/images/55bb66da-3ea7-4612-ab6c-31e0edffad2e" status: 204 len: 0 microversion: 2.1 time: 0.274133 Sep 10 21:01:36.106472 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1778/3634] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:35 2022] DELETE /compute/v2.1/images/55bb66da-3ea7-4612-ab6c-31e0edffad2e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:36.112085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55e0a517-7935-43bd-b8ad-765995006bf4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.113523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55e0a517-7935-43bd-b8ad-765995006bf4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:36.122520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e0a517-7935-43bd-b8ad-765995006bf4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.123030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e0a517-7935-43bd-b8ad-765995006bf4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.123533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e0a517-7935-43bd-b8ad-765995006bf4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.124454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e0a517-7935-43bd-b8ad-765995006bf4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.126140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e0a517-7935-43bd-b8ad-765995006bf4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.126759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e0a517-7935-43bd-b8ad-765995006bf4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.176128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4bf15bcc-e3a3-4425-a953-790bb65d7b2b tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 204 len: 0 microversion: 2.1 time: 0.135551 Sep 10 21:01:36.177059 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1857/3635] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:36 2022] DELETE /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:36.182094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9bd70353-0db5-4526-a713-5b708960f245 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.182870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9bd70353-0db5-4526-a713-5b708960f245 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:36.189698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bd70353-0db5-4526-a713-5b708960f245 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.190288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bd70353-0db5-4526-a713-5b708960f245 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.190795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bd70353-0db5-4526-a713-5b708960f245 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.191562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bd70353-0db5-4526-a713-5b708960f245 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.192023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bd70353-0db5-4526-a713-5b708960f245 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.192472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9bd70353-0db5-4526-a713-5b708960f245 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.335237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9bd70353-0db5-4526-a713-5b708960f245 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:36.343768 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9bd70353-0db5-4526-a713-5b708960f245 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.165719 Sep 10 21:01:36.344362 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1858/3636] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:36 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:36.357564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f65f7166-05fb-4943-a721-06261f9c23f9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f9944bab8b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.382194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG neutronclient.v2_0.client [None req-f65f7166-05fb-4943-a721-06261f9c23f9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist", "detail": ""}} {{(pid=145772) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:01:36.382847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.security_group_api [None req-f65f7166-05fb-4943-a721-06261f9c23f9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Neutron security group acc7ee41-d785-428f-8576-ebc6a929b9cc not found {{(pid=145772) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 21:01:36.383390 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f65f7166-05fb-4943-a721-06261f9c23f9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:01:36.383390 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-698db382-17aa-4ea3-9e5b-098f7408a7da'] Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f65f7166-05fb-4943-a721-06261f9c23f9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-security-groups/acc7ee41-d785-428f-8576-ebc6a929b9cc HTTP/1.1 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: exception: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-698db382-17aa-4ea3-9e5b-098f7408a7da'] Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'acc7ee41-d785-428f-8576-ebc6a929b9cc'} Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:01:36.385377 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-698db382-17aa-4ea3-9e5b-098f7408a7da'] Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-698db382-17aa-4ea3-9e5b-098f7408a7da'] Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-698db382-17aa-4ea3-9e5b-098f7408a7da'] Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-698db382-17aa-4ea3-9e5b-098f7408a7da'] Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f65f7166-05fb-4943-a721-06261f9c23f9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Security group acc7ee41-d785-428f-8576-ebc6a929b9cc does not exist Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: Neutron server returns request_ids: ['req-698db382-17aa-4ea3-9e5b-098f7408a7da'] {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f65f7166-05fb-4943-a721-06261f9c23f9 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/acc7ee41-d785-428f-8576-ebc6a929b9cc" status: 404 len: 194 microversion: 2.1 time: 0.041389 Sep 10 21:01:36.389236 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1859/3637] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:36 2022] DELETE /compute/v2.1/os-security-groups/acc7ee41-d785-428f-8576-ebc6a929b9cc => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:36.400097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.400717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:36.407735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.408377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.408672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.409375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.409846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.410310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.448899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-55e0a517-7935-43bd-b8ad-765995006bf4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:36.456944 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55e0a517-7935-43bd-b8ad-765995006bf4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.351995 Sep 10 21:01:36.457544 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1779/3638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:36 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:36.465766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.466306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:36.472865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.473361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.474091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.474837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.475298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.475729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.490399 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 HTTP/1.1 Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7c645369-3402-414b-bf2c-d82cf4dc75a6'} Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:36.492064 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 404 to user: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3e018592-912f-4c2b-8e13-833853c62de9 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 404 len: 111 microversion: 2.1 time: 0.034748 Sep 10 21:01:36.496020 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1780/3639] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:36 2022] DELETE /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:36.501487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3e25aa99-7de5-4ef7-8559-8b6c2a51be6e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] Calling method '.version_select at 0x7f9944624f70>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.634389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:36.647721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:36.649461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:36.650794 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-44ac3e8f-f311-4e31-a3bc-557231b97dd0 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.262478 Sep 10 21:01:36.651350 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1860/3640] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:36 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:36.667438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-80287ce2-d836-4697-ac4f-b3fe5690a584 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.668049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-80287ce2-d836-4697-ac4f-b3fe5690a584 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 4f5284d9-8123-4e15-8576-be144c016b44] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:36.675521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80287ce2-d836-4697-ac4f-b3fe5690a584 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.676052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80287ce2-d836-4697-ac4f-b3fe5690a584 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.676493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80287ce2-d836-4697-ac4f-b3fe5690a584 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.677197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80287ce2-d836-4697-ac4f-b3fe5690a584 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.677656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80287ce2-d836-4697-ac4f-b3fe5690a584 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.678120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80287ce2-d836-4697-ac4f-b3fe5690a584 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.825891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-80287ce2-d836-4697-ac4f-b3fe5690a584 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:36.834319 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-80287ce2-d836-4697-ac4f-b3fe5690a584 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44" status: 200 len: 1474 microversion: 2.1 time: 0.181697 Sep 10 21:01:36.834986 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1861/3641] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:36 2022] GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44 => generated 1474 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:36.839508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-766772d4-6282-4cfd-835d-41f440a1ee89 req-8b2f6c07-9f9d-44bd-8d2e-c7ab1d52e6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7d1492-dc6d-4ddc-ada0-4d492a0916d6", "name": "network-vif-deleted", "tag": "3e890f01-2c63-4ec8-9b80-da70352321e9"}, {"server_uuid": "5295c29d-1e1a-4858-81b2-80ff782a328f", "name": "network-vif-deleted", "tag": "cf4611af-9b8c-480b-b7fa-343204618b45"}, {"name": "network-changed", "server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "tag": "591c086f-46ef-4794-bd82-3e7775206b42"}, {"name": "network-changed", "server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "tag": "31ec25a2-b534-4f40-ae04-3216ce7462b4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:36.856804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-766772d4-6282-4cfd-835d-41f440a1ee89 req-8b2f6c07-9f9d-44bd-8d2e-c7ab1d52e6da service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.857558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-766772d4-6282-4cfd-835d-41f440a1ee89 req-8b2f6c07-9f9d-44bd-8d2e-c7ab1d52e6da service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.858168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-766772d4-6282-4cfd-835d-41f440a1ee89 req-8b2f6c07-9f9d-44bd-8d2e-c7ab1d52e6da service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.875378 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-766772d4-6282-4cfd-835d-41f440a1ee89 req-8b2f6c07-9f9d-44bd-8d2e-c7ab1d52e6da service nova] Creating event network-vif-deleted:3e890f01-2c63-4ec8-9b80-da70352321e9 for instance 9e7d1492-dc6d-4ddc-ada0-4d492a0916d6 on nch2-master-1 Sep 10 21:01:36.876264 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-766772d4-6282-4cfd-835d-41f440a1ee89 req-8b2f6c07-9f9d-44bd-8d2e-c7ab1d52e6da service nova] Creating event network-vif-deleted:cf4611af-9b8c-480b-b7fa-343204618b45 for instance 5295c29d-1e1a-4858-81b2-80ff782a328f on nch1-master-1 Sep 10 21:01:36.876618 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-766772d4-6282-4cfd-835d-41f440a1ee89 req-8b2f6c07-9f9d-44bd-8d2e-c7ab1d52e6da service nova] Creating event network-changed:591c086f-46ef-4794-bd82-3e7775206b42 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:01:36.877209 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-766772d4-6282-4cfd-835d-41f440a1ee89 req-8b2f6c07-9f9d-44bd-8d2e-c7ab1d52e6da service nova] Creating event network-changed:31ec25a2-b534-4f40-ae04-3216ce7462b4 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:01:36.887852 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-766772d4-6282-4cfd-835d-41f440a1ee89 req-8b2f6c07-9f9d-44bd-8d2e-c7ab1d52e6da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.051689 Sep 10 21:01:36.888612 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1862/3642] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:36.894125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-223750f0-43c2-4761-a425-bbb9f4dab08b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:36.894750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-223750f0-43c2-4761-a425-bbb9f4dab08b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: a2b27e4a-b949-46ff-9fe5-1679cd005042] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:36.900765 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-223750f0-43c2-4761-a425-bbb9f4dab08b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance a2b27e4a-b949-46ff-9fe5-1679cd005042 could not be found. Sep 10 21:01:36.902634 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3e25aa99-7de5-4ef7-8559-8b6c2a51be6e tempest-ListImageFiltersTestJSON-1731426525 tempest-ListImageFiltersTestJSON-1731426525-project] 10.222.0.33 "DELETE /compute/v2.1/images/eb7fa6c6-3c93-43ba-97c1-1cfcdfd1b99e" status: 204 len: 0 microversion: 2.1 time: 0.406938 Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-223750f0-43c2-4761-a425-bbb9f4dab08b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/a2b27e4a-b949-46ff-9fe5-1679cd005042/action HTTP/1.1 Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 15 Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: {"suspend": {}} Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance a2b27e4a-b949-46ff-9fe5-1679cd005042 could not be found. Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a2b27e4a-b949-46ff-9fe5-1679cd005042', 'body': {'suspend': {}}} Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b27e4a-b949-46ff-9fe5-1679cd005042 could not be found. Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b27e4a-b949-46ff-9fe5-1679cd005042 could not be found. Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.903179 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.911698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:36.911698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:36.911698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b27e4a-b949-46ff-9fe5-1679cd005042 could not be found. Sep 10 21:01:36.911698 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.912410 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1781/3643] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:36 2022] DELETE /compute/v2.1/images/eb7fa6c6-3c93-43ba-97c1-1cfcdfd1b99e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:36.912757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-223750f0-43c2-4761-a425-bbb9f4dab08b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance a2b27e4a-b949-46ff-9fe5-1679cd005042 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:36.912757 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-223750f0-43c2-4761-a425-bbb9f4dab08b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/a2b27e4a-b949-46ff-9fe5-1679cd005042/action" status: 404 len: 111 microversion: 2.1 time: 0.014332 Sep 10 21:01:36.912757 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1863/3644] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:36 2022] POST /compute/v2.1/servers/a2b27e4a-b949-46ff-9fe5-1679cd005042/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:36.914082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d315552c-7ba1-472f-9fef-507e7feee280 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f994441f3a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.920670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.921291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: 7c645369-3402-414b-bf2c-d82cf4dc75a6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:36.928492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.929111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.929557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.930268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.930950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.931556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.945716 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 HTTP/1.1 Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '7c645369-3402-414b-bf2c-d82cf4dc75a6'} Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.947946 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 404 to user: Instance 7c645369-3402-414b-bf2c-d82cf4dc75a6 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0d0bdb06-f763-451e-afa0-be327cef2daa tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6" status: 404 len: 111 microversion: 2.1 time: 0.043640 Sep 10 21:01:36.954575 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1864/3645] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:36 2022] GET /compute/v2.1/servers/7c645369-3402-414b-bf2c-d82cf4dc75a6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG neutronclient.v2_0.client [None req-d315552c-7ba1-472f-9fef-507e7feee280 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist", "detail": ""}} {{(pid=145771) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.security_group_api [None req-d315552c-7ba1-472f-9fef-507e7feee280 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Neutron security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 not found {{(pid=145771) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-d315552c-7ba1-472f-9fef-507e7feee280 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-269bbe7b-eb13-4565-ac40-e6df817f66cd'] Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d315552c-7ba1-472f-9fef-507e7feee280 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/os-security-groups/b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 HTTP/1.1 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: exception: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-269bbe7b-eb13-4565-ac40-e6df817f66cd'] Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9'} Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 21:01:36.956583 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-269bbe7b-eb13-4565-ac40-e6df817f66cd'] Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-269bbe7b-eb13-4565-ac40-e6df817f66cd'] Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-269bbe7b-eb13-4565-ac40-e6df817f66cd'] Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-269bbe7b-eb13-4565-ac40-e6df817f66cd'] Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d315552c-7ba1-472f-9fef-507e7feee280 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Security group b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 does not exist Sep 10 21:01:36.965421 ncdv-master-1 devstack@n-api.service[145771]: Neutron server returns request_ids: ['req-269bbe7b-eb13-4565-ac40-e6df817f66cd'] {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:36.974421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9f72060d-05d2-40ca-a7ee-e0268d2dbbec tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.974421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9f72060d-05d2-40ca-a7ee-e0268d2dbbec tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:36.974748 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d315552c-7ba1-472f-9fef-507e7feee280 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9" status: 404 len: 194 microversion: 2.1 time: 0.053906 Sep 10 21:01:36.974748 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1782/3646] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:36 2022] DELETE /compute/v2.1/os-security-groups/b5d1e8bc-d03f-4289-8b9b-88d28a3a06d9 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:36.976023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd597dc2-b087-4d59-9112-7ed73283db0c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '.version_select at 0x7f994468b9d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:36.983579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f72060d-05d2-40ca-a7ee-e0268d2dbbec tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.984619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f72060d-05d2-40ca-a7ee-e0268d2dbbec tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.984842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f72060d-05d2-40ca-a7ee-e0268d2dbbec tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:36.985575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f72060d-05d2-40ca-a7ee-e0268d2dbbec tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:36.986091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f72060d-05d2-40ca-a7ee-e0268d2dbbec tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:36.986526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f72060d-05d2-40ca-a7ee-e0268d2dbbec tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.015912 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd597dc2-b087-4d59-9112-7ed73283db0c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295182887" status: 202 len: 0 microversion: 2.1 time: 0.043589 Sep 10 21:01:37.017676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1783/3647] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 21:01:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295182887 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:37.025341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b2bfb11c-4a78-4110-a88f-80c901fdcefc tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:37.025862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b2bfb11c-4a78-4110-a88f-80c901fdcefc tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:37.033229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bfb11c-4a78-4110-a88f-80c901fdcefc tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.034061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bfb11c-4a78-4110-a88f-80c901fdcefc tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.034499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bfb11c-4a78-4110-a88f-80c901fdcefc tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.035240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bfb11c-4a78-4110-a88f-80c901fdcefc tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.035661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bfb11c-4a78-4110-a88f-80c901fdcefc tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.036087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2bfb11c-4a78-4110-a88f-80c901fdcefc tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.067315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b2bfb11c-4a78-4110-a88f-80c901fdcefc tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:37.155415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:37.194558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:37.201472 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b2bfb11c-4a78-4110-a88f-80c901fdcefc tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 204 len: 0 microversion: 2.1 time: 0.182226 Sep 10 21:01:37.208350 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1784/3648] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:37 2022] DELETE /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:37.216565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ddb3426a-9a17-4762-930d-8c1086a6528c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:37.217637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ddb3426a-9a17-4762-930d-8c1086a6528c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:37.228965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb3426a-9a17-4762-930d-8c1086a6528c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.229490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb3426a-9a17-4762-930d-8c1086a6528c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.229946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb3426a-9a17-4762-930d-8c1086a6528c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.231050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb3426a-9a17-4762-930d-8c1086a6528c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.231690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb3426a-9a17-4762-930d-8c1086a6528c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.232353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb3426a-9a17-4762-930d-8c1086a6528c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.246157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9f72060d-05d2-40ca-a7ee-e0268d2dbbec tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:37.258923 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9f72060d-05d2-40ca-a7ee-e0268d2dbbec tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.307610 Sep 10 21:01:37.263929 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1865/3649] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:36 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:37.292324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d4028bce-571a-4b96-a426-e041334ca28a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:37.293149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d4028bce-571a-4b96-a426-e041334ca28a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:37.300557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4028bce-571a-4b96-a426-e041334ca28a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.301074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4028bce-571a-4b96-a426-e041334ca28a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.301506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4028bce-571a-4b96-a426-e041334ca28a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.302217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4028bce-571a-4b96-a426-e041334ca28a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.302845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4028bce-571a-4b96-a426-e041334ca28a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.303432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4028bce-571a-4b96-a426-e041334ca28a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.472465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ddb3426a-9a17-4762-930d-8c1086a6528c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:37.482701 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ddb3426a-9a17-4762-930d-8c1086a6528c tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1645 microversion: 2.1 time: 0.272645 Sep 10 21:01:37.489234 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1785/3650] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:37 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1645 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:37.499207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c601c785-b875-48b8-87ae-0f0ec8e6e3f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:37.500798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c601c785-b875-48b8-87ae-0f0ec8e6e3f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:37.509183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c601c785-b875-48b8-87ae-0f0ec8e6e3f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.510273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c601c785-b875-48b8-87ae-0f0ec8e6e3f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.510965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c601c785-b875-48b8-87ae-0f0ec8e6e3f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.511787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c601c785-b875-48b8-87ae-0f0ec8e6e3f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.512248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c601c785-b875-48b8-87ae-0f0ec8e6e3f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.512744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c601c785-b875-48b8-87ae-0f0ec8e6e3f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.658780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c601c785-b875-48b8-87ae-0f0ec8e6e3f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:37.670163 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c601c785-b875-48b8-87ae-0f0ec8e6e3f6 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.179428 Sep 10 21:01:37.671361 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1786/3651] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:37 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:37.677989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:37.679144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:37.687050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d4028bce-571a-4b96-a426-e041334ca28a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:37.688224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.688842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.689459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.690342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.690898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.691422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.698368 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d4028bce-571a-4b96-a426-e041334ca28a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.409582 Sep 10 21:01:37.699526 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1866/3652] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:37 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:01:37.723306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2fef3746-f66e-4363-87f2-7b1aa37f80c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:37.724432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2fef3746-f66e-4363-87f2-7b1aa37f80c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:37.730982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fef3746-f66e-4363-87f2-7b1aa37f80c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.731811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fef3746-f66e-4363-87f2-7b1aa37f80c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.732451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fef3746-f66e-4363-87f2-7b1aa37f80c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.733455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fef3746-f66e-4363-87f2-7b1aa37f80c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.734688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fef3746-f66e-4363-87f2-7b1aa37f80c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.735255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fef3746-f66e-4363-87f2-7b1aa37f80c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.763842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-2fef3746-f66e-4363-87f2-7b1aa37f80c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lazy-loading 'flavor' on Instance uuid 2bfdc13f-9c2e-44ec-8553-3f779ead89af {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:37.831814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:37.856213 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2fef3746-f66e-4363-87f2-7b1aa37f80c2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 202 len: 0 microversion: 2.1 time: 0.136669 Sep 10 21:01:37.857424 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1867/3653] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:37 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:01:37.864889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f035525-931d-409e-adb9-df6d15e4a044 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:37.865807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4f035525-931d-409e-adb9-df6d15e4a044 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 4f5284d9-8123-4e15-8576-be144c016b44] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:37.873984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f035525-931d-409e-adb9-df6d15e4a044 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.875220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f035525-931d-409e-adb9-df6d15e4a044 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.875973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f035525-931d-409e-adb9-df6d15e4a044 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.876916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f035525-931d-409e-adb9-df6d15e4a044 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.877503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f035525-931d-409e-adb9-df6d15e4a044 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.878185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f035525-931d-409e-adb9-df6d15e4a044 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.949392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:37.959555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:37.961040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:37.962727 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f7194e49-cdf8-4873-aa2f-82017d005822 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.289706 Sep 10 21:01:37.973857 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1787/3654] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:37 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:37.987569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d8fea9b-2f1a-47c6-bdbe-09fcec2c5d8d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:37.989154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d8fea9b-2f1a-47c6-bdbe-09fcec2c5d8d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:37.997271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d8fea9b-2f1a-47c6-bdbe-09fcec2c5d8d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.997778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d8fea9b-2f1a-47c6-bdbe-09fcec2c5d8d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:37.998289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d8fea9b-2f1a-47c6-bdbe-09fcec2c5d8d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:37.999012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d8fea9b-2f1a-47c6-bdbe-09fcec2c5d8d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:37.999472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d8fea9b-2f1a-47c6-bdbe-09fcec2c5d8d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:38.000154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d8fea9b-2f1a-47c6-bdbe-09fcec2c5d8d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:38.160858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4f035525-931d-409e-adb9-df6d15e4a044 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:38.172641 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f035525-931d-409e-adb9-df6d15e4a044 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44" status: 200 len: 1474 microversion: 2.1 time: 0.312826 Sep 10 21:01:38.174214 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1868/3655] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:37 2022] GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44 => generated 1474 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:38.183451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3d8fea9b-2f1a-47c6-bdbe-09fcec2c5d8d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:38.200984 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d8fea9b-2f1a-47c6-bdbe-09fcec2c5d8d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1512 microversion: 2.1 time: 0.224643 Sep 10 21:01:38.201587 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1788/3656] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:37 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1512 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:38.311399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85730a5c-f5e4-4299-8792-f1de1c1b0901 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '.version_select at 0x7f993fcbd940>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:38.335100 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-85730a5c-f5e4-4299-8792-f1de1c1b0901 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Image not found. Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85730a5c-f5e4-4299-8792-f1de1c1b0901 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/images/5571b19b-b116-497d-b7db-b2031038ae70 HTTP/1.1 Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: exception: Image not found. Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5571b19b-b116-497d-b7db-b2031038ae70'} Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5571b19b-b116-497d-b7db-b2031038ae70 to delete Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5571b19b-b116-497d-b7db-b2031038ae70 could not be found. Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:38.337503 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85730a5c-f5e4-4299-8792-f1de1c1b0901 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 404 to user: Image not found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-85730a5c-f5e4-4299-8792-f1de1c1b0901 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "DELETE /compute/v2.1/images/5571b19b-b116-497d-b7db-b2031038ae70" status: 404 len: 62 microversion: 2.1 time: 0.031589 Sep 10 21:01:38.342256 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1869/3657] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:38 2022] DELETE /compute/v2.1/images/5571b19b-b116-497d-b7db-b2031038ae70 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 21:01:38.350293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:38.351020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:38.364687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:38.365187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:38.365632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:38.366408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:38.366866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:38.367294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:38.382729 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a HTTP/1.1 Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'a009fbee-aff7-41a2-be0f-785d15e2e42a'} Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:38.384576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 404 to user: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:38.389516 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0be41262-fd6e-45f9-a210-c23568547e6c tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 404 len: 111 microversion: 2.1 time: 0.040238 Sep 10 21:01:38.396164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:38.396336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] [instance: a009fbee-aff7-41a2-be0f-785d15e2e42a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:38.400046 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1789/3658] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:38 2022] DELETE /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:38.409219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:38.409947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:38.410668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:38.411949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:38.412607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:38.414244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:38.431135 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] HTTP exception thrown: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Request method failure captured: Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a HTTP/1.1 Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPqUtYaBEDNo6fNDM6Mt7lY-eEZFYFPqSMgRLfvm0PBNnOvRaK5KgjU3LVPeVtXl9Nod288YgMhyXiFJmyu38QwTXc0FOgjFAXz-kQzzUL3htxw-i3i706chgdBDHYe62qLDhnFln28qSOfTGm1mqohncnVLY-FhNbgma82ic_sot1k Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cebec33205424ecf92b54428bdf5eb61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cebec33205424ecf92b54428bdf5eb61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cebec33205424ecf92b54428bdf5eb61"}]}] Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: cebec33205424ecf92b54428bdf5eb61 Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318 Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: ae0c7612d933424597e1f176be189a0b Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1791941318-project Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a009fbee-aff7-41a2-be0f-785d15e2e42a'} Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.433391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:38.438560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.438560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:38.438560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:38.438560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:38.438560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:38.438560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:38.438560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. Sep 10 21:01:38.438560 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:38.438560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] Returning 404 to user: Instance a009fbee-aff7-41a2-be0f-785d15e2e42a could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:38.438560 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81cdb30d-d8a8-4205-bfd1-a2712fa01969 tempest-ImagesOneServerNegativeTestJSON-1791941318 tempest-ImagesOneServerNegativeTestJSON-1791941318-project] 10.222.0.33 "GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a" status: 404 len: 111 microversion: 2.1 time: 0.043333 Sep 10 21:01:38.439718 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1870/3659] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:38 2022] GET /compute/v2.1/servers/a009fbee-aff7-41a2-be0f-785d15e2e42a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:38.513726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aca82fce-305a-4a23-9d95-0be747458aaa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:38.514488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aca82fce-305a-4a23-9d95-0be747458aaa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:38.523166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aca82fce-305a-4a23-9d95-0be747458aaa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:38.523984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aca82fce-305a-4a23-9d95-0be747458aaa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:38.524583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aca82fce-305a-4a23-9d95-0be747458aaa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:38.525506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aca82fce-305a-4a23-9d95-0be747458aaa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:38.526146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aca82fce-305a-4a23-9d95-0be747458aaa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:38.526757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aca82fce-305a-4a23-9d95-0be747458aaa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:38.697865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cf7ce202-c1b3-44a3-b992-b3d26b805a5e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:38.698840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cf7ce202-c1b3-44a3-b992-b3d26b805a5e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:38.728852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf7ce202-c1b3-44a3-b992-b3d26b805a5e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:38.737601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf7ce202-c1b3-44a3-b992-b3d26b805a5e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:38.751486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf7ce202-c1b3-44a3-b992-b3d26b805a5e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:38.758878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf7ce202-c1b3-44a3-b992-b3d26b805a5e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:38.760013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf7ce202-c1b3-44a3-b992-b3d26b805a5e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:38.760903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf7ce202-c1b3-44a3-b992-b3d26b805a5e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:38.812029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aca82fce-305a-4a23-9d95-0be747458aaa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:38.824960 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aca82fce-305a-4a23-9d95-0be747458aaa tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1645 microversion: 2.1 time: 0.316900 Sep 10 21:01:38.829345 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1790/3660] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:38 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1645 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:38.995068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:38.996406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:39.010565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:39.011325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:39.012145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:39.013097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:39.013774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:39.014244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:39.659326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:39.674879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:39.677002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:39.681426 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bd5b2e95-0fa0-464e-a57b-5cecd0636288 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.689538 Sep 10 21:01:39.683645 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1791/3661] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:38 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:39.694565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6bd852b8-02d2-4f2a-bdaf-3bae95a8f1cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:39.696827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6bd852b8-02d2-4f2a-bdaf-3bae95a8f1cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 4f5284d9-8123-4e15-8576-be144c016b44] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:39.705901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bd852b8-02d2-4f2a-bdaf-3bae95a8f1cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:39.706725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bd852b8-02d2-4f2a-bdaf-3bae95a8f1cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:39.707648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bd852b8-02d2-4f2a-bdaf-3bae95a8f1cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:39.710132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bd852b8-02d2-4f2a-bdaf-3bae95a8f1cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:39.711069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bd852b8-02d2-4f2a-bdaf-3bae95a8f1cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:39.711742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bd852b8-02d2-4f2a-bdaf-3bae95a8f1cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:39.808488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf7ce202-c1b3-44a3-b992-b3d26b805a5e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:39.825803 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cf7ce202-c1b3-44a3-b992-b3d26b805a5e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 1.135428 Sep 10 21:01:39.826587 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1871/3662] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:38 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:39.832798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3a809b7f-6a2f-4846-bd5d-95b6c7d6dbba tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:39.834013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3a809b7f-6a2f-4846-bd5d-95b6c7d6dbba tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:39.841784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a809b7f-6a2f-4846-bd5d-95b6c7d6dbba tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:39.842414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a809b7f-6a2f-4846-bd5d-95b6c7d6dbba tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:39.843196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a809b7f-6a2f-4846-bd5d-95b6c7d6dbba tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:39.844582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a809b7f-6a2f-4846-bd5d-95b6c7d6dbba tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:39.845388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a809b7f-6a2f-4846-bd5d-95b6c7d6dbba tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:39.845862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a809b7f-6a2f-4846-bd5d-95b6c7d6dbba tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:40.145478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6bd852b8-02d2-4f2a-bdaf-3bae95a8f1cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:40.165549 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6bd852b8-02d2-4f2a-bdaf-3bae95a8f1cf tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44" status: 200 len: 1474 microversion: 2.1 time: 0.479194 Sep 10 21:01:40.166410 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1792/3663] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:39 2022] GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44 => generated 1474 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:40.174915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c56de762-fb1d-4866-821c-83a3c931dcc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:40.175784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c56de762-fb1d-4866-821c-83a3c931dcc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:40.184996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c56de762-fb1d-4866-821c-83a3c931dcc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:40.188282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c56de762-fb1d-4866-821c-83a3c931dcc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:40.189370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c56de762-fb1d-4866-821c-83a3c931dcc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:40.195429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c56de762-fb1d-4866-821c-83a3c931dcc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:40.196071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c56de762-fb1d-4866-821c-83a3c931dcc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:40.196983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c56de762-fb1d-4866-821c-83a3c931dcc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:40.435681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a809b7f-6a2f-4846-bd5d-95b6c7d6dbba tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:40.442969 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3a809b7f-6a2f-4846-bd5d-95b6c7d6dbba tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1495 microversion: 2.1 time: 0.615338 Sep 10 21:01:40.443552 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1872/3664] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:39 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1495 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:40.475199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:40.476126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:40.489032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:40.491063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:40.491518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:40.492245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:40.494771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:40.495183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:40.536151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lazy-loading 'flavor' on Instance uuid 2bfdc13f-9c2e-44ec-8553-3f779ead89af {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:40.556055 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Cannot 'suspend' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state suspended Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action HTTP/1.1 Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 15 Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: {"suspend": {}} Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: exception: Cannot 'suspend' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state suspended Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2bfdc13f-9c2e-44ec-8553-3f779ead89af', 'body': {'suspend': {}}} Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af in vm_state suspended. Cannot suspend while the instance is in this state. Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 10 21:01:40.557971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state suspended Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state suspended Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 409 to user: Cannot 'suspend' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state suspended {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:40.563512 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-87e51ec5-be1f-491b-8b55-f3c4b7ab4117 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 409 len: 148 microversion: 2.1 time: 0.093393 Sep 10 21:01:40.565767 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1873/3665] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:40 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 148 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 21:01:40.570330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-9ef906a6-12ba-438a-abc9-e5dccaca3fed req-7f91ce54-5b0c-403d-8bde-b8bd51ba925a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5284d9-8123-4e15-8576-be144c016b44", "name": "network-vif-deleted", "tag": "fcae92b2-6a4a-43fe-b894-3e34661b8d2a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:40.581458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9ef906a6-12ba-438a-abc9-e5dccaca3fed req-7f91ce54-5b0c-403d-8bde-b8bd51ba925a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:40.582009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9ef906a6-12ba-438a-abc9-e5dccaca3fed req-7f91ce54-5b0c-403d-8bde-b8bd51ba925a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:40.582440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9ef906a6-12ba-438a-abc9-e5dccaca3fed req-7f91ce54-5b0c-403d-8bde-b8bd51ba925a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:40.600687 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-9ef906a6-12ba-438a-abc9-e5dccaca3fed req-7f91ce54-5b0c-403d-8bde-b8bd51ba925a service nova] Creating event network-vif-deleted:fcae92b2-6a4a-43fe-b894-3e34661b8d2a for instance 4f5284d9-8123-4e15-8576-be144c016b44 on nch2-master-1 Sep 10 21:01:40.607836 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-9ef906a6-12ba-438a-abc9-e5dccaca3fed req-7f91ce54-5b0c-403d-8bde-b8bd51ba925a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040742 Sep 10 21:01:40.610114 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1874/3666] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:40.616478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8819529e-e9e9-4988-878c-f05c2736c6c7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:40.617293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8819529e-e9e9-4988-878c-f05c2736c6c7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:40.625633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8819529e-e9e9-4988-878c-f05c2736c6c7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:40.626170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8819529e-e9e9-4988-878c-f05c2736c6c7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:40.626787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8819529e-e9e9-4988-878c-f05c2736c6c7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:40.627788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8819529e-e9e9-4988-878c-f05c2736c6c7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:40.628250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8819529e-e9e9-4988-878c-f05c2736c6c7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:40.628730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8819529e-e9e9-4988-878c-f05c2736c6c7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:40.758497 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8819529e-e9e9-4988-878c-f05c2736c6c7 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 202 len: 0 microversion: 2.1 time: 0.145825 Sep 10 21:01:40.759697 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1875/3667] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:40 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:40.783240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:40.784542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:40.795559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:40.798859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:40.799691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:40.800626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:40.802182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:40.803039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:40.804215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:41.146107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c56de762-fb1d-4866-821c-83a3c931dcc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:41.165202 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c56de762-fb1d-4866-821c-83a3c931dcc2 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1645 microversion: 2.1 time: 0.997648 Sep 10 21:01:41.166103 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1793/3668] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:40 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1645 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:41.170986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9feea867-9829-427e-acea-0a0e522b5d54 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:41.174950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9feea867-9829-427e-acea-0a0e522b5d54 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:41.187614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9feea867-9829-427e-acea-0a0e522b5d54 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:41.198679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9feea867-9829-427e-acea-0a0e522b5d54 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:41.199505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9feea867-9829-427e-acea-0a0e522b5d54 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:41.200983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9feea867-9829-427e-acea-0a0e522b5d54 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:41.201678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9feea867-9829-427e-acea-0a0e522b5d54 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:41.202359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9feea867-9829-427e-acea-0a0e522b5d54 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:41.503250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:41.524853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:41.529768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:41.538080 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8963487f-58d3-4ccd-9d19-e699f54ac2c7 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.772399 Sep 10 21:01:41.539692 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1876/3669] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:40 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:41.553927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-241a2631-a1d1-48b9-a5f1-b93b4589fcf0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:41.554927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-241a2631-a1d1-48b9-a5f1-b93b4589fcf0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:41.569977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-241a2631-a1d1-48b9-a5f1-b93b4589fcf0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:41.570485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-241a2631-a1d1-48b9-a5f1-b93b4589fcf0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:41.574353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-241a2631-a1d1-48b9-a5f1-b93b4589fcf0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:41.575728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-241a2631-a1d1-48b9-a5f1-b93b4589fcf0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:41.580891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-241a2631-a1d1-48b9-a5f1-b93b4589fcf0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:41.582237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-241a2631-a1d1-48b9-a5f1-b93b4589fcf0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:41.835120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9feea867-9829-427e-acea-0a0e522b5d54 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:41.846727 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9feea867-9829-427e-acea-0a0e522b5d54 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1501 microversion: 2.1 time: 0.678391 Sep 10 21:01:41.847590 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1794/3670] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:41 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1501 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:41.848946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-241a2631-a1d1-48b9-a5f1-b93b4589fcf0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:41.853973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c1ffe82c-d4e1-44ff-a644-fb65d0e4e842 req-ea433f15-9685-4860-890a-86c4bd6ec43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2246b83-c09c-4d0e-8744-421b2eec5985", "name": "network-vif-deleted", "tag": "5d34ee03-4994-483a-aaf3-880e271e480d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:41.859296 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-241a2631-a1d1-48b9-a5f1-b93b4589fcf0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1521 microversion: 2.1 time: 0.317787 Sep 10 21:01:41.860514 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1877/3671] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:41 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:41.866826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:41.867841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 4f5284d9-8123-4e15-8576-be144c016b44] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:41.880682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:41.881753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:41.882867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:41.883464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c1ffe82c-d4e1-44ff-a644-fb65d0e4e842 req-ea433f15-9685-4860-890a-86c4bd6ec43c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:41.884150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c1ffe82c-d4e1-44ff-a644-fb65d0e4e842 req-ea433f15-9685-4860-890a-86c4bd6ec43c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:41.884863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:41.885463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c1ffe82c-d4e1-44ff-a644-fb65d0e4e842 req-ea433f15-9685-4860-890a-86c4bd6ec43c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:41.886438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:41.887114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:41.900934 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c1ffe82c-d4e1-44ff-a644-fb65d0e4e842 req-ea433f15-9685-4860-890a-86c4bd6ec43c service nova] Creating event network-vif-deleted:5d34ee03-4994-483a-aaf3-880e271e480d for instance e2246b83-c09c-4d0e-8744-421b2eec5985 on nch1-master-1 Sep 10 21:01:41.908347 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c1ffe82c-d4e1-44ff-a644-fb65d0e4e842 req-ea433f15-9685-4860-890a-86c4bd6ec43c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058163 Sep 10 21:01:41.909120 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1795/3672] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:41.917640 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] HTTP exception thrown: Instance 4f5284d9-8123-4e15-8576-be144c016b44 could not be found. Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Request method failure captured: Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44 HTTP/1.1 Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpD3XorJTOmshO8ShrGydR5Yh_ZW0GoFIPFNux3cdIuCEy4uljcIp1YR897IiLrXZKVrCAKwE0sC-SMLCx-PCumGee9Ldi4xcTYCHtnGk7w6VvimIT9qdN4eJRT9gk5WZTFLHhN4iq_vV4cb9iSKJhhLieaETbdjqgODHmuRL06q2E Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d30ef9b7525e4784be26268f46121e62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d30ef9b7525e4784be26268f46121e62"}]}] Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f38321284ec449e599d645625ed11139 Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 4f5284d9-8123-4e15-8576-be144c016b44 could not be found. Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '4f5284d9-8123-4e15-8576-be144c016b44'} Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5284d9-8123-4e15-8576-be144c016b44 could not be found. Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5284d9-8123-4e15-8576-be144c016b44 could not be found. Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:41.920032 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:41.926193 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:41.926193 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:41.926193 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:41.926193 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:41.926193 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:41.926193 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5284d9-8123-4e15-8576-be144c016b44 could not be found. Sep 10 21:01:41.926193 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:41.928678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Returning 404 to user: Instance 4f5284d9-8123-4e15-8576-be144c016b44 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:41.929713 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-86202e74-fa03-4987-816a-17d58ce11bbe tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44" status: 404 len: 111 microversion: 2.1 time: 0.067912 Sep 10 21:01:41.930325 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1878/3673] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:41 2022] GET /compute/v2.1/servers/4f5284d9-8123-4e15-8576-be144c016b44 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:41.942481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:41.946236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:41.958358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:41.958584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:41.959347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:41.960626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:41.961435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:41.963019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.031319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.031940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.032702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.033328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lazy-loading 'fault' on Instance uuid 9857472b-f236-4d85-b592-68d9cd4cfdf7 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:42.203802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:42.204580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:42.205201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:42.213366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.214501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.215206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.219077 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-77ea2156-9fdb-4b24-ad2a-307bd13eb581 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 200 len: 1309 microversion: 2.1 time: 0.282077 Sep 10 21:01:42.219843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.220819 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1796/3674] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:41 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:42.235036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.235036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.315286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.315844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.316238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.316656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lazy-loading 'fault' on Instance uuid e2246b83-c09c-4d0e-8744-421b2eec5985 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:01:42.409202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5bc12930c946ccaffcc524795ad965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7289ce4dcfe9474ea286bcbe7ef179a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:42.417153 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1c2986fd-8467-489a-8379-1787ad83a311 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 200 len: 1306 microversion: 2.1 time: 0.225037 Sep 10 21:01:42.418150 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1879/3675] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:42 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 1306 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:42.568536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:42.569899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:42.576072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.578664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.581457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.583906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.584553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.585648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.698147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] Calling method '.version_select at 0x7f994468ba60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:42.700439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.701120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.701971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.733613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.735445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.736516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.754308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.755331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.755997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.763873 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-641f6f8c-b83b-4892-a5e5-a2472191fe34 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227 tempest-PortsAdminExtendedAttrsIpV6TestJSON-560394227-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.330348 Sep 10 21:01:42.764463 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1797/3676] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 21:01:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:42.770153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b2b9b431-99be-46fc-9f1e-78bd2f42f8cd req-4fda6b4b-2221-4209-ba50-d653580bcda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9857472b-f236-4d85-b592-68d9cd4cfdf7", "name": "network-vif-deleted", "tag": "e1b862e2-4037-4e26-9cba-7a0cab43d786"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:42.781126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b2b9b431-99be-46fc-9f1e-78bd2f42f8cd req-4fda6b4b-2221-4209-ba50-d653580bcda0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.781989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b2b9b431-99be-46fc-9f1e-78bd2f42f8cd req-4fda6b4b-2221-4209-ba50-d653580bcda0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.782603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b2b9b431-99be-46fc-9f1e-78bd2f42f8cd req-4fda6b4b-2221-4209-ba50-d653580bcda0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.800150 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b2b9b431-99be-46fc-9f1e-78bd2f42f8cd req-4fda6b4b-2221-4209-ba50-d653580bcda0 service nova] Creating event network-vif-deleted:e1b862e2-4037-4e26-9cba-7a0cab43d786 for instance 9857472b-f236-4d85-b592-68d9cd4cfdf7 on nch2-master-1 Sep 10 21:01:42.807468 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b2b9b431-99be-46fc-9f1e-78bd2f42f8cd req-4fda6b4b-2221-4209-ba50-d653580bcda0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040532 Sep 10 21:01:42.808727 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1798/3677] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:42.877103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-08942730-eadd-4a41-b55f-9909fe9c5823 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:42.878257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-08942730-eadd-4a41-b55f-9909fe9c5823 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:42.893982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08942730-eadd-4a41-b55f-9909fe9c5823 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.894755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08942730-eadd-4a41-b55f-9909fe9c5823 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.895364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08942730-eadd-4a41-b55f-9909fe9c5823 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:42.896269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08942730-eadd-4a41-b55f-9909fe9c5823 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:42.896894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08942730-eadd-4a41-b55f-9909fe9c5823 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:42.897485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08942730-eadd-4a41-b55f-9909fe9c5823 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:43.142787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:43.168568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:43.171188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:43.173973 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8e7ac7c-32e8-498b-9814-329775cb36d9 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.609353 Sep 10 21:01:43.193209 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1880/3678] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:42 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:01:43.205852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ffcec708-f551-42e1-9910-58ac4b8ff83e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:43.206885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ffcec708-f551-42e1-9910-58ac4b8ff83e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:43.218092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcec708-f551-42e1-9910-58ac4b8ff83e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:43.222607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcec708-f551-42e1-9910-58ac4b8ff83e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:43.224449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcec708-f551-42e1-9910-58ac4b8ff83e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:43.225471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcec708-f551-42e1-9910-58ac4b8ff83e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:43.226384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcec708-f551-42e1-9910-58ac4b8ff83e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:43.227264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ffcec708-f551-42e1-9910-58ac4b8ff83e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:43.407396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-08942730-eadd-4a41-b55f-9909fe9c5823 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:43.430774 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-08942730-eadd-4a41-b55f-9909fe9c5823 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1501 microversion: 2.1 time: 0.559704 Sep 10 21:01:43.433475 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1799/3679] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:42 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1501 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:43.439046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:43.439843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 9857472b-f236-4d85-b592-68d9cd4cfdf7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:43.448947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:43.449721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:43.450362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:43.451282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:43.452276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:43.452945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:43.474364 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] HTTP exception thrown: Instance 9857472b-f236-4d85-b592-68d9cd4cfdf7 could not be found. Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Request method failure captured: Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 HTTP/1.1 Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpD3XorJTOmshO8ShrGydR5Yh_ZW0GoFIPFNux3cdIuCEy4uljcIp1YR897IiLrXZKVrCAKwE0sC-SMLCx-PCumGee9Ldi4xcTYCHtnGk7w6VvimIT9qdN4eJRT9gk5WZTFLHhN4iq_vV4cb9iSKJhhLieaETbdjqgODHmuRL06q2E Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d30ef9b7525e4784be26268f46121e62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d30ef9b7525e4784be26268f46121e62"}]}] Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: f38321284ec449e599d645625ed11139 Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 9857472b-f236-4d85-b592-68d9cd4cfdf7 could not be found. Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '9857472b-f236-4d85-b592-68d9cd4cfdf7'} Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9857472b-f236-4d85-b592-68d9cd4cfdf7 could not be found. Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9857472b-f236-4d85-b592-68d9cd4cfdf7 could not be found. Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:43.492143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:43.497031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:43.497031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:43.497031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:43.497031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:43.497031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:43.497031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9857472b-f236-4d85-b592-68d9cd4cfdf7 could not be found. Sep 10 21:01:43.497031 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:43.497031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Returning 404 to user: Instance 9857472b-f236-4d85-b592-68d9cd4cfdf7 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:43.501633 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-25b49dd6-bf9a-4e4b-9f57-907bc093685c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7" status: 404 len: 111 microversion: 2.1 time: 0.065514 Sep 10 21:01:43.502256 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1800/3680] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:43 2022] GET /compute/v2.1/servers/9857472b-f236-4d85-b592-68d9cd4cfdf7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:43.520558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:43.528092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] [instance: e2246b83-c09c-4d0e-8744-421b2eec5985] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:43.537085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:43.537785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:43.539048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:43.540196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:43.540808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:43.541484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:43.578902 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] HTTP exception thrown: Instance e2246b83-c09c-4d0e-8744-421b2eec5985 could not be found. Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Request method failure captured: Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 HTTP/1.1 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPqmC9q_9CtbyznUFVaRZyRxWWh81OE7dZWWNSkEbMRuy7_pu6rtnA0q29ifU7F4q-TCoiu6hZOjf5JlNe2nQDoBCavURPSxgHr3ttpZ6NdNvqEZUHIW9QxpjeyWEmBBQ7pNQivdOz9fiwbLRhdMrZR1PhRAICIg08d1zXWe_O2ZHw4 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7289ce4dcfe9474ea286bcbe7ef179a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7289ce4dcfe9474ea286bcbe7ef179a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7289ce4dcfe9474ea286bcbe7ef179a1"}]}] Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 7289ce4dcfe9474ea286bcbe7ef179a1 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1820452159 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1b5bc12930c946ccaffcc524795ad965 Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-SecurityGroupsTestJSON-1820452159-project Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance e2246b83-c09c-4d0e-8744-421b2eec5985 could not be found. Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'e2246b83-c09c-4d0e-8744-421b2eec5985'} Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2246b83-c09c-4d0e-8744-421b2eec5985 could not be found. Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2246b83-c09c-4d0e-8744-421b2eec5985 could not be found. Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:43.586290 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:43.591302 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:43.591302 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:43.591302 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:43.591302 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:43.591302 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:43.591302 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2246b83-c09c-4d0e-8744-421b2eec5985 could not be found. Sep 10 21:01:43.591302 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:43.596137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Returning 404 to user: Instance e2246b83-c09c-4d0e-8744-421b2eec5985 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:43.597237 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38c27350-67ef-4959-b6a5-1a68f126381f tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985" status: 404 len: 111 microversion: 2.1 time: 0.093191 Sep 10 21:01:43.599968 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1801/3681] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:43 2022] GET /compute/v2.1/servers/e2246b83-c09c-4d0e-8744-421b2eec5985 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:43.611416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cdd2a849-8b26-4dfc-af3a-dfea5e21a595 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:43.661795 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cdd2a849-8b26-4dfc-af3a-dfea5e21a595 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/232b9ea3-3351-4a5d-87e3-b7519b40cd27" status: 204 len: 0 microversion: 2.1 time: 0.056937 Sep 10 21:01:43.662610 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1802/3682] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Sep 10 21:01:43 2022] DELETE /compute/v2.1/os-server-groups/232b9ea3-3351-4a5d-87e3-b7519b40cd27 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:43.668400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f328ed09-43f6-49d8-902a-fc9f25e54a9b tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f99494c4ca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:44.068792 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f328ed09-43f6-49d8-902a-fc9f25e54a9b tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/73241f18-28a8-4540-bf68-00dc117db51b" status: 202 len: 0 microversion: 2.1 time: 0.405032 Sep 10 21:01:44.072826 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1803/3683] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:43 2022] DELETE /compute/v2.1/os-security-groups/73241f18-28a8-4540-bf68-00dc117db51b => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:44.079521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7200945f-1f19-47bf-843a-b2f5319eed4c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:44.080414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7200945f-1f19-47bf-843a-b2f5319eed4c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:44.089361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7200945f-1f19-47bf-843a-b2f5319eed4c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:44.090558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7200945f-1f19-47bf-843a-b2f5319eed4c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:44.091358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7200945f-1f19-47bf-843a-b2f5319eed4c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:44.092290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7200945f-1f19-47bf-843a-b2f5319eed4c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:44.093115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7200945f-1f19-47bf-843a-b2f5319eed4c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:44.094043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7200945f-1f19-47bf-843a-b2f5319eed4c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:44.110201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ffcec708-f551-42e1-9910-58ac4b8ff83e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:44.127573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7200945f-1f19-47bf-843a-b2f5319eed4c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:01:44.128723 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ffcec708-f551-42e1-9910-58ac4b8ff83e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1498 microversion: 2.1 time: 0.933150 Sep 10 21:01:44.129706 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1881/3684] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:43 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1498 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:44.134555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c1d4a738-a8b6-4a3f-aa10-d7e5e7773972 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] Calling method '.version_select at 0x7f993fbc4790>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:44.199554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:44.274405 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7200945f-1f19-47bf-843a-b2f5319eed4c tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "DELETE /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad" status: 204 len: 0 microversion: 2.1 time: 0.199886 Sep 10 21:01:44.278021 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1804/3685] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:01:44 2022] DELETE /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:01:44.289233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:44.298999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:44.299835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:44.308320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:44.308812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:44.309250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:44.310102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:44.310559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:44.310981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:44.356253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:44.408893 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8ff83416-2f12-4a01-9b35-518bbe58a6e8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.131415 Sep 10 21:01:44.409931 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1805/3686] 10.222.0.33 () {58 vars in 1154 bytes} [Sat Sep 10 21:01:44 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:44.418466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:44.419655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:44.429204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:44.430254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:44.431096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:44.432778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:44.434661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:44.435399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:44.900151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:44.910411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:44.915177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:44.917088 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4682a666-7177-4572-a192-a8d3e0ba87fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.505343 Sep 10 21:01:44.921001 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1806/3687] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:44 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:44.929433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d817a67e-4b4f-4abc-82df-5da06b4ed42d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:44.930078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d817a67e-4b4f-4abc-82df-5da06b4ed42d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:44.946717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d817a67e-4b4f-4abc-82df-5da06b4ed42d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:44.947216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d817a67e-4b4f-4abc-82df-5da06b4ed42d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:44.949946 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c1d4a738-a8b6-4a3f-aa10-d7e5e7773972 tempest-SecurityGroupsTestJSON-1820452159 tempest-SecurityGroupsTestJSON-1820452159-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f08fbb92-71d0-43aa-8229-1a318a3a7601" status: 202 len: 0 microversion: 2.1 time: 0.818797 Sep 10 21:01:44.951179 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1882/3688] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:01:44 2022] DELETE /compute/v2.1/os-security-groups/f08fbb92-71d0-43aa-8229-1a318a3a7601 => generated 0 bytes in 821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:44.955955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d817a67e-4b4f-4abc-82df-5da06b4ed42d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:44.956754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d817a67e-4b4f-4abc-82df-5da06b4ed42d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:44.957242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d817a67e-4b4f-4abc-82df-5da06b4ed42d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:44.957683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d817a67e-4b4f-4abc-82df-5da06b4ed42d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:44.959288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-68afdf08-c506-47c7-a7e3-9c5bc9f5dfae tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:45.005066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68afdf08-c506-47c7-a7e3-9c5bc9f5dfae tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:45.005895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68afdf08-c506-47c7-a7e3-9c5bc9f5dfae tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:45.006591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68afdf08-c506-47c7-a7e3-9c5bc9f5dfae tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:45.042267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-68afdf08-c506-47c7-a7e3-9c5bc9f5dfae tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Going to try to start instance {{(pid=145772) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 21:01:45.115673 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-68afdf08-c506-47c7-a7e3-9c5bc9f5dfae tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "POST /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d/action" status: 202 len: 0 microversion: 2.1 time: 0.162351 Sep 10 21:01:45.117126 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1883/3689] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:44 2022] POST /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:01:45.126545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85b72975-f6d2-4b0d-a414-8cc10328836c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:45.128169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-85b72975-f6d2-4b0d-a414-8cc10328836c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:45.147404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b72975-f6d2-4b0d-a414-8cc10328836c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:45.148693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b72975-f6d2-4b0d-a414-8cc10328836c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:45.149435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b72975-f6d2-4b0d-a414-8cc10328836c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:45.150681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b72975-f6d2-4b0d-a414-8cc10328836c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:45.151370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b72975-f6d2-4b0d-a414-8cc10328836c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:45.152067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b72975-f6d2-4b0d-a414-8cc10328836c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:45.202401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d817a67e-4b4f-4abc-82df-5da06b4ed42d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:45.211627 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d817a67e-4b4f-4abc-82df-5da06b4ed42d tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad" status: 200 len: 1472 microversion: 2.1 time: 0.288903 Sep 10 21:01:45.212222 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1807/3690] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:44 2022] GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:45.232267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d89192b-220a-4188-8ab9-2991fcbd1836 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:45.232825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d89192b-220a-4188-8ab9-2991fcbd1836 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:45.241321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89192b-220a-4188-8ab9-2991fcbd1836 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:45.241836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89192b-220a-4188-8ab9-2991fcbd1836 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:45.242612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89192b-220a-4188-8ab9-2991fcbd1836 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:45.242983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89192b-220a-4188-8ab9-2991fcbd1836 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:45.243441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89192b-220a-4188-8ab9-2991fcbd1836 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:45.243869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89192b-220a-4188-8ab9-2991fcbd1836 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:45.571545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3d89192b-220a-4188-8ab9-2991fcbd1836 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:45.586361 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d89192b-220a-4188-8ab9-2991fcbd1836 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1507 microversion: 2.1 time: 0.366153 Sep 10 21:01:45.587215 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1808/3691] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:45 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:45.945651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:45.946846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:45.953039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:45.953963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:45.954476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:45.955269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:45.955772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:45.956344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:46.018218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-85b72975-f6d2-4b0d-a414-8cc10328836c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:46.026212 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-85b72975-f6d2-4b0d-a414-8cc10328836c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.906853 Sep 10 21:01:46.037889 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1884/3692] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:45 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:46.053387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-420a9bba-ea82-4174-8ec2-0ff7db82c317 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:46.054157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-420a9bba-ea82-4174-8ec2-0ff7db82c317 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:46.060877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-420a9bba-ea82-4174-8ec2-0ff7db82c317 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:46.061671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-420a9bba-ea82-4174-8ec2-0ff7db82c317 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:46.063058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-420a9bba-ea82-4174-8ec2-0ff7db82c317 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:46.064011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-420a9bba-ea82-4174-8ec2-0ff7db82c317 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:46.064538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-420a9bba-ea82-4174-8ec2-0ff7db82c317 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:46.065057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-420a9bba-ea82-4174-8ec2-0ff7db82c317 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:46.410977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:46.423183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:46.425019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:46.426651 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7a59d0b3-ca47-4a66-8b00-6fca1c978151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.484782 Sep 10 21:01:46.427495 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1809/3693] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:45 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:46.433914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b59116b-987d-4ec3-be5e-433850fba152 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:46.434544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5b59116b-987d-4ec3-be5e-433850fba152 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:46.445950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b59116b-987d-4ec3-be5e-433850fba152 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:46.446377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b59116b-987d-4ec3-be5e-433850fba152 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:46.446863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b59116b-987d-4ec3-be5e-433850fba152 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:46.447590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b59116b-987d-4ec3-be5e-433850fba152 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:46.448264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b59116b-987d-4ec3-be5e-433850fba152 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:46.451554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b59116b-987d-4ec3-be5e-433850fba152 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:46.742482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5b59116b-987d-4ec3-be5e-433850fba152 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:46.755860 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5b59116b-987d-4ec3-be5e-433850fba152 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad" status: 200 len: 1472 microversion: 2.1 time: 0.326939 Sep 10 21:01:46.757013 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1810/3694] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:46 2022] GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:46.762121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bce0cf2c-3983-4860-aaec-0985d6515f8d tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:46.762735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bce0cf2c-3983-4860-aaec-0985d6515f8d tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:46.781492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bce0cf2c-3983-4860-aaec-0985d6515f8d tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:46.786562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bce0cf2c-3983-4860-aaec-0985d6515f8d tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:46.787710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bce0cf2c-3983-4860-aaec-0985d6515f8d tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:46.788519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bce0cf2c-3983-4860-aaec-0985d6515f8d tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:46.792925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bce0cf2c-3983-4860-aaec-0985d6515f8d tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:46.793516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bce0cf2c-3983-4860-aaec-0985d6515f8d tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:47.108053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bce0cf2c-3983-4860-aaec-0985d6515f8d tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:47.116747 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bce0cf2c-3983-4860-aaec-0985d6515f8d tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1507 microversion: 2.1 time: 0.358422 Sep 10 21:01:47.117556 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1811/3695] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:46 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1507 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:47.168124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-420a9bba-ea82-4174-8ec2-0ff7db82c317 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:47.202652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:47.210578 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-420a9bba-ea82-4174-8ec2-0ff7db82c317 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 1.161013 Sep 10 21:01:47.211966 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1885/3696] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:46 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:47.239067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a5449857-3aca-40d9-b2aa-0ca46879062a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:47.240606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a5449857-3aca-40d9-b2aa-0ca46879062a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 30f74054-6cbb-42d3-9325-48365c83b302] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:47.248068 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-a5449857-3aca-40d9-b2aa-0ca46879062a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 30f74054-6cbb-42d3-9325-48365c83b302 could not be found. Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a5449857-3aca-40d9-b2aa-0ca46879062a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/30f74054-6cbb-42d3-9325-48365c83b302/action HTTP/1.1 Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 15 Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: {"unpause": {}} Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 30f74054-6cbb-42d3-9325-48365c83b302 could not be found. Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '30f74054-6cbb-42d3-9325-48365c83b302', 'body': {'unpause': {}}} Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f74054-6cbb-42d3-9325-48365c83b302 could not be found. Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f74054-6cbb-42d3-9325-48365c83b302 could not be found. Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:47.250681 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:47.256060 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:47.256060 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:47.256060 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f74054-6cbb-42d3-9325-48365c83b302 could not be found. Sep 10 21:01:47.256060 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:47.256892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a5449857-3aca-40d9-b2aa-0ca46879062a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 30f74054-6cbb-42d3-9325-48365c83b302 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:47.257925 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a5449857-3aca-40d9-b2aa-0ca46879062a tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/30f74054-6cbb-42d3-9325-48365c83b302/action" status: 404 len: 111 microversion: 2.1 time: 0.025639 Sep 10 21:01:47.258632 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1812/3697] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:47 2022] POST /compute/v2.1/servers/30f74054-6cbb-42d3-9325-48365c83b302/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:47.267047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b0bc66dd-3d08-4855-9dab-b033ef04b0e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:47.267801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b0bc66dd-3d08-4855-9dab-b033ef04b0e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:47.275531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0bc66dd-3d08-4855-9dab-b033ef04b0e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:47.276387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0bc66dd-3d08-4855-9dab-b033ef04b0e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:47.276977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0bc66dd-3d08-4855-9dab-b033ef04b0e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:47.278485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0bc66dd-3d08-4855-9dab-b033ef04b0e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:47.279063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0bc66dd-3d08-4855-9dab-b033ef04b0e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:47.279613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0bc66dd-3d08-4855-9dab-b033ef04b0e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:47.467019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:47.467869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:47.477868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:47.478685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:47.479265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:47.481086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:47.482439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:47.483084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:47.868103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b0bc66dd-3d08-4855-9dab-b033ef04b0e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:47.876405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:47.883747 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b0bc66dd-3d08-4855-9dab-b033ef04b0e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.620527 Sep 10 21:01:47.887574 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1886/3698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:47 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:47.895208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dca952f9-d32f-4f2b-8a68-8988da13f0b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:47.895835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dca952f9-d32f-4f2b-8a68-8988da13f0b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:47.903149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dca952f9-d32f-4f2b-8a68-8988da13f0b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:47.903654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dca952f9-d32f-4f2b-8a68-8988da13f0b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:47.904564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dca952f9-d32f-4f2b-8a68-8988da13f0b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:47.905413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:47.905567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dca952f9-d32f-4f2b-8a68-8988da13f0b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:47.906125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dca952f9-d32f-4f2b-8a68-8988da13f0b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:47.906567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dca952f9-d32f-4f2b-8a68-8988da13f0b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:47.912006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:47.913369 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a5ad3c5f-0f5d-4048-b0b2-f95003436c89 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.463174 Sep 10 21:01:47.914149 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1813/3699] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:47 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:47.918838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0845b748-9683-47bd-b6f9-c1d83da5800d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:47.919439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0845b748-9683-47bd-b6f9-c1d83da5800d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:47.925628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0845b748-9683-47bd-b6f9-c1d83da5800d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:47.926362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0845b748-9683-47bd-b6f9-c1d83da5800d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:47.926959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0845b748-9683-47bd-b6f9-c1d83da5800d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:47.927797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0845b748-9683-47bd-b6f9-c1d83da5800d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:47.928406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0845b748-9683-47bd-b6f9-c1d83da5800d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:47.928971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0845b748-9683-47bd-b6f9-c1d83da5800d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:48.136171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0845b748-9683-47bd-b6f9-c1d83da5800d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:48.145065 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0845b748-9683-47bd-b6f9-c1d83da5800d tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.229696 Sep 10 21:01:48.145752 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1814/3700] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:47 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:48.150565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-393c046b-dada-43fd-a9e7-70a11490c485 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:48.151427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-393c046b-dada-43fd-a9e7-70a11490c485 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:48.162142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-393c046b-dada-43fd-a9e7-70a11490c485 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:48.162938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-393c046b-dada-43fd-a9e7-70a11490c485 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:48.163538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-393c046b-dada-43fd-a9e7-70a11490c485 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:48.164414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-393c046b-dada-43fd-a9e7-70a11490c485 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:48.165028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-393c046b-dada-43fd-a9e7-70a11490c485 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:48.165645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-393c046b-dada-43fd-a9e7-70a11490c485 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:48.432619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-393c046b-dada-43fd-a9e7-70a11490c485 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:48.451711 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-393c046b-dada-43fd-a9e7-70a11490c485 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1507 microversion: 2.1 time: 0.304606 Sep 10 21:01:48.453161 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1815/3701] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:48 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:48.459193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:48.460024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:48.481440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:48.482175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:48.482800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:48.488191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dca952f9-d32f-4f2b-8a68-8988da13f0b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38321284ec449e599d645625ed11139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30ef9b7525e4784be26268f46121e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:48.500658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:48.502453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:48.503344 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dca952f9-d32f-4f2b-8a68-8988da13f0b2 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad" status: 200 len: 1472 microversion: 2.1 time: 0.614104 Sep 10 21:01:48.504163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:48.509133 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1887/3702] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:47 2022] GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad => generated 1472 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:48.522679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-2bead74f-e120-40d8-b96c-d9098d2a09c0 req-e7078da2-ab8a-4ff5-b488-5385bb6196d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830cb245-7e91-4f1a-ae12-8010551e3aad", "name": "network-vif-deleted", "tag": "3dedfaed-43ea-42a2-8915-2abec516acbe"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:48.545283 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Cannot 'unpause' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action HTTP/1.1 Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 15 Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: {"unpause": {}} Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: exception: Cannot 'unpause' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2bfdc13f-9c2e-44ec-8553-3f779ead89af', 'body': {'unpause': {}}} Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af in vm_state active. Cannot unpause while the instance is in this state. Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:48.548183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:48.553542 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:48.553542 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:48.553542 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:48.553542 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 21:01:48.553542 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:48.554888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2bead74f-e120-40d8-b96c-d9098d2a09c0 req-e7078da2-ab8a-4ff5-b488-5385bb6196d1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:48.555870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 409 to user: Cannot 'unpause' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:48.557762 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62ca6cca-aa44-4a1b-bf3e-061a14e7aded tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 409 len: 145 microversion: 2.1 time: 0.102515 Sep 10 21:01:48.558903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2bead74f-e120-40d8-b96c-d9098d2a09c0 req-e7078da2-ab8a-4ff5-b488-5385bb6196d1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:48.563367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2bead74f-e120-40d8-b96c-d9098d2a09c0 req-e7078da2-ab8a-4ff5-b488-5385bb6196d1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:48.564614 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1816/3703] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:48 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 145 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 21:01:48.572217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d9770da2-f781-4526-ba13-eed28f3f040e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:48.573004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d9770da2-f781-4526-ba13-eed28f3f040e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:48.580766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9770da2-f781-4526-ba13-eed28f3f040e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:48.581560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9770da2-f781-4526-ba13-eed28f3f040e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:48.582253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9770da2-f781-4526-ba13-eed28f3f040e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:48.583147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9770da2-f781-4526-ba13-eed28f3f040e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:48.583998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9770da2-f781-4526-ba13-eed28f3f040e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:48.584612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9770da2-f781-4526-ba13-eed28f3f040e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:48.635997 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-2bead74f-e120-40d8-b96c-d9098d2a09c0 req-e7078da2-ab8a-4ff5-b488-5385bb6196d1 service nova] Creating event network-vif-deleted:3dedfaed-43ea-42a2-8915-2abec516acbe for instance 830cb245-7e91-4f1a-ae12-8010551e3aad on nch2-master-1 Sep 10 21:01:48.651513 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-2bead74f-e120-40d8-b96c-d9098d2a09c0 req-e7078da2-ab8a-4ff5-b488-5385bb6196d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138379 Sep 10 21:01:48.660271 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1888/3704] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:48.945927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:48.947088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:48.960254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:48.961098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:48.962022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:48.963241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:48.963981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:48.965360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:49.749000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d9770da2-f781-4526-ba13-eed28f3f040e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:49.771858 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d9770da2-f781-4526-ba13-eed28f3f040e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 1.205723 Sep 10 21:01:49.793776 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1817/3705] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:48 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:49.800823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-11e174a7-cc4a-4a90-936a-f63ad99eb8cd tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:49.801815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-11e174a7-cc4a-4a90-936a-f63ad99eb8cd tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:49.810146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11e174a7-cc4a-4a90-936a-f63ad99eb8cd tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:49.811044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11e174a7-cc4a-4a90-936a-f63ad99eb8cd tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:49.811721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11e174a7-cc4a-4a90-936a-f63ad99eb8cd tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:49.813345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11e174a7-cc4a-4a90-936a-f63ad99eb8cd tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:49.814232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11e174a7-cc4a-4a90-936a-f63ad99eb8cd tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:49.815051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11e174a7-cc4a-4a90-936a-f63ad99eb8cd tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:49.891512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:49.904531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:49.908447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:49.910510 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93da93bb-5c0a-4de0-97dc-6203a44cadbe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.971333 Sep 10 21:01:49.926866 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1889/3706] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:48 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:49.938307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:49.939357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] [instance: 830cb245-7e91-4f1a-ae12-8010551e3aad] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:49.949707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:49.950720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:49.951461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:49.953314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:49.954108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:49.954882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:50.025807 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] HTTP exception thrown: Instance 830cb245-7e91-4f1a-ae12-8010551e3aad could not be found. Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Request method failure captured: Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad HTTP/1.1 Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpD3XorJTOmshO8ShrGydR5Yh_ZW0GoFIPFNux3cdIuCEy4uljcIp1YR897IiLrXZKVrCAKwE0sC-SMLCx-PCumGee9Ldi4xcTYCHtnGk7w6VvimIT9qdN4eJRT9gk5WZTFLHhN4iq_vV4cb9iSKJhhLieaETbdjqgODHmuRL06q2E Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d30ef9b7525e4784be26268f46121e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d30ef9b7525e4784be26268f46121e62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d30ef9b7525e4784be26268f46121e62"}]}] Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d30ef9b7525e4784be26268f46121e62 Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-155380116 Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: f38321284ec449e599d645625ed11139 Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersOnMultiNodesTest-155380116-project Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 830cb245-7e91-4f1a-ae12-8010551e3aad could not be found. Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '830cb245-7e91-4f1a-ae12-8010551e3aad'} Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 830cb245-7e91-4f1a-ae12-8010551e3aad could not be found. Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 830cb245-7e91-4f1a-ae12-8010551e3aad could not be found. Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:50.042002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:50.049175 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:50.049175 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:50.049175 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:50.049175 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:50.049175 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:50.049175 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 830cb245-7e91-4f1a-ae12-8010551e3aad could not be found. Sep 10 21:01:50.049175 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:50.051218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] Returning 404 to user: Instance 830cb245-7e91-4f1a-ae12-8010551e3aad could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:50.052326 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4832ee87-fab5-45df-accc-ef0a924799e0 tempest-ServersOnMultiNodesTest-155380116 tempest-ServersOnMultiNodesTest-155380116-project] 10.222.0.33 "GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad" status: 404 len: 111 microversion: 2.1 time: 0.124220 Sep 10 21:01:50.057281 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1890/3707] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:49 2022] GET /compute/v2.1/servers/830cb245-7e91-4f1a-ae12-8010551e3aad => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:50.065483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-116d7ea2-62f3-4728-be7b-71c0487b3b3e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:50.066297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-116d7ea2-62f3-4728-be7b-71c0487b3b3e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:50.075996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-116d7ea2-62f3-4728-be7b-71c0487b3b3e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:50.077313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-116d7ea2-62f3-4728-be7b-71c0487b3b3e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:50.078283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-116d7ea2-62f3-4728-be7b-71c0487b3b3e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:50.079312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-116d7ea2-62f3-4728-be7b-71c0487b3b3e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:50.080469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-116d7ea2-62f3-4728-be7b-71c0487b3b3e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:50.081155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-116d7ea2-62f3-4728-be7b-71c0487b3b3e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:50.451191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-11e174a7-cc4a-4a90-936a-f63ad99eb8cd tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:50.463206 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-11e174a7-cc4a-4a90-936a-f63ad99eb8cd tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1511 microversion: 2.1 time: 0.667434 Sep 10 21:01:50.488563 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1818/3708] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:49 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1511 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:50.488946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-116d7ea2-62f3-4728-be7b-71c0487b3b3e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:50.503374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:50.505480 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-116d7ea2-62f3-4728-be7b-71c0487b3b3e tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.446837 Sep 10 21:01:50.509189 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1891/3709] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:50 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:50.515407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:50.515864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.compute.servers [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Removing options 'limit' from query {{(pid=145771) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 21:01:50.518672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:50.519815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:50.521012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:50.521458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:50.523091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:50.523557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:50.524538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:50.527311 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b82ea70f-8b78-4aa8-9f90-945e8cb76fd1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.036471 Sep 10 21:01:50.529570 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1819/3710] 10.222.0.33 () {58 vars in 1140 bytes} [Sat Sep 10 21:01:50 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:01:50.536764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d6ac169e-47fe-4d40-9b7d-5756d3173f1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:50.538250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d6ac169e-47fe-4d40-9b7d-5756d3173f1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 712fe086-23de-4ac1-a7a6-d8960d5e5be1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:50.550544 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-d6ac169e-47fe-4d40-9b7d-5756d3173f1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 712fe086-23de-4ac1-a7a6-d8960d5e5be1 could not be found. Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d6ac169e-47fe-4d40-9b7d-5756d3173f1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/712fe086-23de-4ac1-a7a6-d8960d5e5be1/action HTTP/1.1 Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 18 Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: {"unshelve": null} Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 712fe086-23de-4ac1-a7a6-d8960d5e5be1 could not be found. Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '712fe086-23de-4ac1-a7a6-d8960d5e5be1', 'body': {'unshelve': None}} Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712fe086-23de-4ac1-a7a6-d8960d5e5be1 could not be found. Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712fe086-23de-4ac1-a7a6-d8960d5e5be1 could not be found. Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:50.555649 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712fe086-23de-4ac1-a7a6-d8960d5e5be1 could not be found. Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d6ac169e-47fe-4d40-9b7d-5756d3173f1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 712fe086-23de-4ac1-a7a6-d8960d5e5be1 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d6ac169e-47fe-4d40-9b7d-5756d3173f1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/712fe086-23de-4ac1-a7a6-d8960d5e5be1/action" status: 404 len: 111 microversion: 2.1 time: 0.026170 Sep 10 21:01:50.561245 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1892/3711] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:50 2022] POST /compute/v2.1/servers/712fe086-23de-4ac1-a7a6-d8960d5e5be1/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:50.564734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a00ac17-f64f-457a-a110-edafe61dd686 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:50.565773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2a00ac17-f64f-457a-a110-edafe61dd686 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:50.573643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a00ac17-f64f-457a-a110-edafe61dd686 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:50.574388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a00ac17-f64f-457a-a110-edafe61dd686 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:50.575992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a00ac17-f64f-457a-a110-edafe61dd686 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:50.576916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a00ac17-f64f-457a-a110-edafe61dd686 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:50.578228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a00ac17-f64f-457a-a110-edafe61dd686 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:50.578952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a00ac17-f64f-457a-a110-edafe61dd686 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:50.581979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-328508eb-3b56-4898-82a9-e3b8978d57b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:50.582791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-328508eb-3b56-4898-82a9-e3b8978d57b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:50.607913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-328508eb-3b56-4898-82a9-e3b8978d57b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:50.609710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-328508eb-3b56-4898-82a9-e3b8978d57b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:50.610259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-328508eb-3b56-4898-82a9-e3b8978d57b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:50.612209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-328508eb-3b56-4898-82a9-e3b8978d57b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:50.612752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-328508eb-3b56-4898-82a9-e3b8978d57b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:50.613115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-328508eb-3b56-4898-82a9-e3b8978d57b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:51.000642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2a00ac17-f64f-457a-a110-edafe61dd686 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:51.012653 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2a00ac17-f64f-457a-a110-edafe61dd686 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1511 microversion: 2.1 time: 0.463585 Sep 10 21:01:51.013470 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1820/3712] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:50 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:51.018335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:51.019214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:51.023387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-328508eb-3b56-4898-82a9-e3b8978d57b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:51.026640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:51.027422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:51.028243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:51.029273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:51.030029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:51.031352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:51.034137 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-328508eb-3b56-4898-82a9-e3b8978d57b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.465429 Sep 10 21:01:51.042152 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1893/3713] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:50 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:51.052432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e6c18608-b59f-4280-9bcb-66892412a17c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:51.053447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e6c18608-b59f-4280-9bcb-66892412a17c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:51.065235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6c18608-b59f-4280-9bcb-66892412a17c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:51.066085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6c18608-b59f-4280-9bcb-66892412a17c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:51.066751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6c18608-b59f-4280-9bcb-66892412a17c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:51.067687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6c18608-b59f-4280-9bcb-66892412a17c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:51.068945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6c18608-b59f-4280-9bcb-66892412a17c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:51.069626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6c18608-b59f-4280-9bcb-66892412a17c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:51.456293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e6c18608-b59f-4280-9bcb-66892412a17c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:51.477329 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e6c18608-b59f-4280-9bcb-66892412a17c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c" status: 200 len: 1510 microversion: 2.1 time: 0.433698 Sep 10 21:01:51.478443 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1894/3714] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:51 2022] GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c => generated 1510 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:51.485057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d88a792-cbd5-436a-a1c7-c1c4b2a924cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:51.486613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d88a792-cbd5-436a-a1c7-c1c4b2a924cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:51.493715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d88a792-cbd5-436a-a1c7-c1c4b2a924cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:51.494604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d88a792-cbd5-436a-a1c7-c1c4b2a924cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:51.495314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d88a792-cbd5-436a-a1c7-c1c4b2a924cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:51.508883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d88a792-cbd5-436a-a1c7-c1c4b2a924cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:51.510529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d88a792-cbd5-436a-a1c7-c1c4b2a924cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:51.512828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d88a792-cbd5-436a-a1c7-c1c4b2a924cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:51.580074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:51.595076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:51.596911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:51.601115 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-252b23fd-2251-4561-93d1-64ba688f6efe tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.584599 Sep 10 21:01:51.619204 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1821/3715] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:51 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:51.633113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b99beec6-b12b-43c9-8101-bd993e9e54f3 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:51.637556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b99beec6-b12b-43c9-8101-bd993e9e54f3 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:51.667920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99beec6-b12b-43c9-8101-bd993e9e54f3 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:51.671008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99beec6-b12b-43c9-8101-bd993e9e54f3 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:51.672481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99beec6-b12b-43c9-8101-bd993e9e54f3 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:51.674498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99beec6-b12b-43c9-8101-bd993e9e54f3 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:51.675217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99beec6-b12b-43c9-8101-bd993e9e54f3 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:51.677707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99beec6-b12b-43c9-8101-bd993e9e54f3 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:52.185911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b99beec6-b12b-43c9-8101-bd993e9e54f3 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:52.204965 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b99beec6-b12b-43c9-8101-bd993e9e54f3 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1510 microversion: 2.1 time: 0.584559 Sep 10 21:01:52.207512 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1822/3716] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:51 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1510 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:52.231402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:52.240853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:52.242005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:52.331296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d88a792-cbd5-436a-a1c7-c1c4b2a924cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:52.347754 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d88a792-cbd5-436a-a1c7-c1c4b2a924cb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.867691 Sep 10 21:01:52.348246 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1895/3717] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:51 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:52.376418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:52.377316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:52.386953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:52.395398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:52.396141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:52.397072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:52.397810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:52.398435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:52.485484 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Cannot 'unshelve' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action HTTP/1.1 Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 18 Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: {"unshelve": null} Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: exception: Cannot 'unshelve' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2bfdc13f-9c2e-44ec-8553-3f779ead89af', 'body': {'unshelve': None}} Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af in vm_state active. Cannot unshelve while the instance is in this state. Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 21:01:52.487323 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 409 to user: Cannot 'unshelve' instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af while it is in vm_state active {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9d6211a6-253e-4e90-8474-8dbc38705868 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action" status: 409 len: 146 microversion: 2.1 time: 0.117791 Sep 10 21:01:52.492357 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1896/3718] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:01:52 2022] POST /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af/action => generated 146 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 21:01:52.495055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:52.495055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:52.495346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:52.495980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:52.496614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:52.497056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:52.497404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1bc71db7-2b7a-463b-a836-9866db5485e4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:52.498112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1bc71db7-2b7a-463b-a836-9866db5485e4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:52.511619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bc71db7-2b7a-463b-a836-9866db5485e4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:52.512112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bc71db7-2b7a-463b-a836-9866db5485e4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:52.512548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bc71db7-2b7a-463b-a836-9866db5485e4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:52.513329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bc71db7-2b7a-463b-a836-9866db5485e4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:52.513787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bc71db7-2b7a-463b-a836-9866db5485e4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:52.522659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bc71db7-2b7a-463b-a836-9866db5485e4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:52.671638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:52.727455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:52.857080 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3b287526-df95-45be-8e37-9407e9af2b2c tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 346 microversion: 2.1 time: 0.629394 Sep 10 21:01:52.858282 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1823/3719] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 21:01:52 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 346 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:01:52.864199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:52.870304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:52.882037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:52.883284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:52.883501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:52.884434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:52.885248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:52.885957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:52.973143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1bc71db7-2b7a-463b-a836-9866db5485e4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:52.991864 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1bc71db7-2b7a-463b-a836-9866db5485e4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.498205 Sep 10 21:01:52.992735 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1897/3720] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:52 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:01:52.997660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9919615a-34b5-4173-8055-197718d56629 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:52.998945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9919615a-34b5-4173-8055-197718d56629 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:53.006351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9919615a-34b5-4173-8055-197718d56629 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:53.007091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9919615a-34b5-4173-8055-197718d56629 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:53.007721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9919615a-34b5-4173-8055-197718d56629 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:53.008853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9919615a-34b5-4173-8055-197718d56629 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:53.009586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9919615a-34b5-4173-8055-197718d56629 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:53.012471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9919615a-34b5-4173-8055-197718d56629 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:53.279872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9919615a-34b5-4173-8055-197718d56629 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:53.292433 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9919615a-34b5-4173-8055-197718d56629 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1511 microversion: 2.1 time: 0.297882 Sep 10 21:01:53.297906 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1898/3721] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:52 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:53.310028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4689f24d-7f6d-4067-b60f-60ee9f8e4eea tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:53.310646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4689f24d-7f6d-4067-b60f-60ee9f8e4eea tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:53.321158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:53.362325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:53.364732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4689f24d-7f6d-4067-b60f-60ee9f8e4eea tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:53.366257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:53.367350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4689f24d-7f6d-4067-b60f-60ee9f8e4eea tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:53.368059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4689f24d-7f6d-4067-b60f-60ee9f8e4eea tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:53.368844 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8024df73-6588-4f8b-bb01-d58786c4e528 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.508872 Sep 10 21:01:53.369422 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1824/3722] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:52 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:53.369847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4689f24d-7f6d-4067-b60f-60ee9f8e4eea tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:53.370323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4689f24d-7f6d-4067-b60f-60ee9f8e4eea tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:53.370921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4689f24d-7f6d-4067-b60f-60ee9f8e4eea tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:53.383277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70d34f7b-449a-492b-b789-c2e87bc06a80 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:53.384123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-70d34f7b-449a-492b-b789-c2e87bc06a80 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:53.401336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d34f7b-449a-492b-b789-c2e87bc06a80 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:53.404039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d34f7b-449a-492b-b789-c2e87bc06a80 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:53.407957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d34f7b-449a-492b-b789-c2e87bc06a80 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:53.410751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d34f7b-449a-492b-b789-c2e87bc06a80 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:53.412746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d34f7b-449a-492b-b789-c2e87bc06a80 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:53.415190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d34f7b-449a-492b-b789-c2e87bc06a80 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:53.993358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-70d34f7b-449a-492b-b789-c2e87bc06a80 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:54.006239 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-70d34f7b-449a-492b-b789-c2e87bc06a80 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c" status: 200 len: 1510 microversion: 2.1 time: 0.633659 Sep 10 21:01:54.010299 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1825/3723] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:53 2022] GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c => generated 1510 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:54.033727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6f64eb50-8fd4-45d7-85a3-bee5668160c8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:54.034875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6f64eb50-8fd4-45d7-85a3-bee5668160c8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:54.048270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f64eb50-8fd4-45d7-85a3-bee5668160c8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:54.049172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f64eb50-8fd4-45d7-85a3-bee5668160c8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:54.050088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f64eb50-8fd4-45d7-85a3-bee5668160c8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:54.051476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f64eb50-8fd4-45d7-85a3-bee5668160c8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:54.052229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f64eb50-8fd4-45d7-85a3-bee5668160c8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:54.052938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f64eb50-8fd4-45d7-85a3-bee5668160c8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:54.426660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4689f24d-7f6d-4067-b60f-60ee9f8e4eea tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:54.444793 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4689f24d-7f6d-4067-b60f-60ee9f8e4eea tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 1.148670 Sep 10 21:01:54.446266 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1899/3724] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:53 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:54.475075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:54.475721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:54.490124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:54.494357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:54.494998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:54.495916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:54.496557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:54.497043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:54.658355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6f64eb50-8fd4-45d7-85a3-bee5668160c8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:54.669276 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6f64eb50-8fd4-45d7-85a3-bee5668160c8 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1510 microversion: 2.1 time: 0.640950 Sep 10 21:01:54.692640 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1826/3725] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:54 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1510 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:01:54.699059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eff9aed2-3723-47d6-8d57-36bfcf16df1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-213774278_updated"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:54.702993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eff9aed2-3723-47d6-8d57-36bfcf16df1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 97b8a50d-71ce-4249-be72-5cd0d76c8294] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:54.712418 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-eff9aed2-3723-47d6-8d57-36bfcf16df1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 97b8a50d-71ce-4249-be72-5cd0d76c8294 could not be found. Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eff9aed2-3723-47d6-8d57-36bfcf16df1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/servers/97b8a50d-71ce-4249-be72-5cd0d76c8294 HTTP/1.1 Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 80 Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-213774278_updated"}} Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 97b8a50d-71ce-4249-be72-5cd0d76c8294 could not be found. Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '97b8a50d-71ce-4249-be72-5cd0d76c8294', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-213774278_updated'}}} Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b8a50d-71ce-4249-be72-5cd0d76c8294 could not be found. Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 10 21:01:54.716015 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b8a50d-71ce-4249-be72-5cd0d76c8294 could not be found. Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b8a50d-71ce-4249-be72-5cd0d76c8294 could not be found. Sep 10 21:01:54.721183 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:54.725311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eff9aed2-3723-47d6-8d57-36bfcf16df1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 97b8a50d-71ce-4249-be72-5cd0d76c8294 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:54.727048 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eff9aed2-3723-47d6-8d57-36bfcf16df1c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "PUT /compute/v2.1/servers/97b8a50d-71ce-4249-be72-5cd0d76c8294" status: 404 len: 111 microversion: 2.1 time: 0.032935 Sep 10 21:01:54.737208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1827/3726] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Sep 10 21:01:54 2022] PUT /compute/v2.1/servers/97b8a50d-71ce-4249-be72-5cd0d76c8294 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:01:54.756185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:54.766716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:54.768421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:54.773166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=95,nova_api:DELETE=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:54.775398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:54.776137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:54.776835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:54.778220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:54.778900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:54.779533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:54.825453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:54.925422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:54.934208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:54.934920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:54.935386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:55.260005 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-880dd9b7-8d5d-4aa6-8b99-e9069c8f8424 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.519554 Sep 10 21:01:55.260620 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1828/3727] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 21:01:54 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:55.275756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4b6f9166-add0-4c5e-adc3-e665ccd88adb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:55.275756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4b6f9166-add0-4c5e-adc3-e665ccd88adb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:55.276966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b6f9166-add0-4c5e-adc3-e665ccd88adb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:55.279289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b6f9166-add0-4c5e-adc3-e665ccd88adb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:55.280987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b6f9166-add0-4c5e-adc3-e665ccd88adb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:55.282715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b6f9166-add0-4c5e-adc3-e665ccd88adb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:55.284053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b6f9166-add0-4c5e-adc3-e665ccd88adb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:55.285153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b6f9166-add0-4c5e-adc3-e665ccd88adb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:55.406277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:55.438034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:55.446592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:55.450185 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f6b3e6e5-6595-49df-aaa2-d40c0a76cf32 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 1.000834 Sep 10 21:01:55.452246 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1900/3728] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:54 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:55.462401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:55.469265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:55.470487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:55.671742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b6f9166-add0-4c5e-adc3-e665ccd88adb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:55.687285 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4b6f9166-add0-4c5e-adc3-e665ccd88adb tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.425470 Sep 10 21:01:55.688082 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1829/3729] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:55 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:55.727710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ebd3500-1524-4f4f-b3d7-4efa41102b9b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:55.728650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ebd3500-1524-4f4f-b3d7-4efa41102b9b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:55.738680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ebd3500-1524-4f4f-b3d7-4efa41102b9b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:55.747219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ebd3500-1524-4f4f-b3d7-4efa41102b9b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:55.748403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ebd3500-1524-4f4f-b3d7-4efa41102b9b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:55.750870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ebd3500-1524-4f4f-b3d7-4efa41102b9b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:55.751589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ebd3500-1524-4f4f-b3d7-4efa41102b9b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:55.752009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ebd3500-1524-4f4f-b3d7-4efa41102b9b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:55.965051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:55.966052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:55.966661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:55.967580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:55.968324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:55.968945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:56.578954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:56.616208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1ebd3500-1524-4f4f-b3d7-4efa41102b9b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:56.632208 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ebd3500-1524-4f4f-b3d7-4efa41102b9b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.912455 Sep 10 21:01:56.633260 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1830/3730] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:55 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:56.752349 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c9f6489a-d705-4518-9a58-07c35d16d177 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 1.297095 Sep 10 21:01:56.774249 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1901/3731] 10.222.0.33 () {58 vars in 1150 bytes} [Sat Sep 10 21:01:55 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:56.813606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:56.814385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:56.832875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:56.834635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:56.859909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:56.863711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:56.864630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:56.865475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:56.966541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aefeaab5-0efc-4c15-9714-e7ecdb58ad5b tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:56.980402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aefeaab5-0efc-4c15-9714-e7ecdb58ad5b tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:56.986191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aefeaab5-0efc-4c15-9714-e7ecdb58ad5b tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:56.988076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aefeaab5-0efc-4c15-9714-e7ecdb58ad5b tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:56.991068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aefeaab5-0efc-4c15-9714-e7ecdb58ad5b tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:56.992979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aefeaab5-0efc-4c15-9714-e7ecdb58ad5b tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:56.994802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aefeaab5-0efc-4c15-9714-e7ecdb58ad5b tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:57.125961 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aefeaab5-0efc-4c15-9714-e7ecdb58ad5b tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.491326 Sep 10 21:01:57.126812 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1831/3732] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 21:01:56 2022] GET /compute/v2.1/os-services => generated 947 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:57.249121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c737ad8a-622e-4aed-8502-1d32c90c7d6b tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Action: 'create', calling method: .version_select at 0x7f9944647ca0>, body: {"keypair": {"name": "tempest-keypair-739449473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLM/uoBYlK1ZmJrPFqGgCTls3oT/CQGPZa84bsqwvl0kUSxr6uymmuHTr3FbG+1pKsL+96qicU+Vg8TYBfXKQ4raCV7EkVPd30CFiY7vrdyrmMFQW1n2xGD0zjHv94igOg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:57.303621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c737ad8a-622e-4aed-8502-1d32c90c7d6b tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Getting quotas for project 75ff64ac8631450bb5e2d269118982a8. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:01:57.339968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c737ad8a-622e-4aed-8502-1d32c90c7d6b tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Getting quotas for user b638a9e7f0934e47a3883be65e42d558 and project 75ff64ac8631450bb5e2d269118982a8. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:01:57.395274 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c737ad8a-622e-4aed-8502-1d32c90c7d6b tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.259320 Sep 10 21:01:57.396106 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1832/3733] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:01:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:57.406916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c93b6c4c-c713-44cc-a938-2ed0e30ae6bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c93b6c4c-c713-44cc-a938-2ed0e30ae6bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af HTTP/1.1 Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 280 Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2bfdc13f-9c2e-44ec-8553-3f779ead89af', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:57.424259 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:01:57.428529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c93b6c4c-c713-44cc-a938-2ed0e30ae6bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:01:57.431307 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c93b6c4c-c713-44cc-a938-2ed0e30ae6bd tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "PUT /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 400 len: 619 microversion: 2.1 time: 0.030864 Sep 10 21:01:57.431307 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1833/3734] 10.222.0.33 () {60 vars in 1257 bytes} [Sat Sep 10 21:01:57 2022] PUT /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:01:57.446045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:57.462799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:57.465080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:57.481087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:57.481580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:57.482053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:57.482790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:57.487599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:57.488120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:57.678270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:57.700039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:57.701872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:57.705543 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c1e6d9b-293c-4192-bd73-31b0c78e7816 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.927304 Sep 10 21:01:57.711964 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1902/3735] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:56 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:57.720210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85cd88ee-e7aa-4e11-8406-73d2b415626d tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:57.732918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85cd88ee-e7aa-4e11-8406-73d2b415626d tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:57.738699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85cd88ee-e7aa-4e11-8406-73d2b415626d tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:57.740191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85cd88ee-e7aa-4e11-8406-73d2b415626d tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:57.743185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85cd88ee-e7aa-4e11-8406-73d2b415626d tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:57.744319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85cd88ee-e7aa-4e11-8406-73d2b415626d tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:57.747467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85cd88ee-e7aa-4e11-8406-73d2b415626d tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:57.786804 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-85cd88ee-e7aa-4e11-8406-73d2b415626d tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.072251 Sep 10 21:01:57.789323 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1903/3736] 10.222.0.33 () {58 vars in 1174 bytes} [Sat Sep 10 21:01:57 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:57.814380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5e6617bc-f203-426d-8eb5-bac761a64b41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:57.816063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5e6617bc-f203-426d-8eb5-bac761a64b41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:57.825554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e6617bc-f203-426d-8eb5-bac761a64b41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:57.826699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e6617bc-f203-426d-8eb5-bac761a64b41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:57.827896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e6617bc-f203-426d-8eb5-bac761a64b41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:57.829715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e6617bc-f203-426d-8eb5-bac761a64b41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:57.831095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e6617bc-f203-426d-8eb5-bac761a64b41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:57.831703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e6617bc-f203-426d-8eb5-bac761a64b41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:57.860203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:57.957769 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3b5c4d00-75e9-4bc6-ac97-07b54d6ac7c4 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.522691 Sep 10 21:01:57.957769 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1834/3737] 10.222.0.33 () {58 vars in 1212 bytes} [Sat Sep 10 21:01:57 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:57.975700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38e68eda-dd87-4d39-96b4-33cd7b7503b0 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:57.981853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e68eda-dd87-4d39-96b4-33cd7b7503b0 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:57.982862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e68eda-dd87-4d39-96b4-33cd7b7503b0 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:57.984655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e68eda-dd87-4d39-96b4-33cd7b7503b0 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:57.985795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e68eda-dd87-4d39-96b4-33cd7b7503b0 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:57.986472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e68eda-dd87-4d39-96b4-33cd7b7503b0 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:57.987652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e68eda-dd87-4d39-96b4-33cd7b7503b0 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:58.022485 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38e68eda-dd87-4d39-96b4-33cd7b7503b0 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051030 Sep 10 21:01:58.032706 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1835/3738] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Sep 10 21:01:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:58.038519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:58.044974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:58.046797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:58.053171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:58.053873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:58.054485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:58.055386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:58.055851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:58.056335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:58.167542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:58.320641 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f5316f6c-e772-43b0-97c2-8c0c4f3c2b18 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.286155 Sep 10 21:01:58.330961 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1836/3739] 10.222.0.33 () {58 vars in 1196 bytes} [Sat Sep 10 21:01:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:58.336894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2371406f-4f68-4869-ad4d-367cf5470d06 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:58.341909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2371406f-4f68-4869-ad4d-367cf5470d06 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:58.342412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2371406f-4f68-4869-ad4d-367cf5470d06 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:58.343398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2371406f-4f68-4869-ad4d-367cf5470d06 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:58.344142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2371406f-4f68-4869-ad4d-367cf5470d06 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:58.344601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2371406f-4f68-4869-ad4d-367cf5470d06 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:58.345319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2371406f-4f68-4869-ad4d-367cf5470d06 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:58.374748 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2371406f-4f68-4869-ad4d-367cf5470d06 tempest-ServicesAdminTestJSON-861866726 tempest-ServicesAdminTestJSON-861866726-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.040895 Sep 10 21:01:58.375591 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1837/3740] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 21:01:58 2022] GET /compute/v2.1/os-services => generated 947 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:58.409770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:58.423647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:58.424441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'name': '1047077967', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:58.463319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:58.463904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:58.464368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:58.471500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:58.472003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:58.472550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:58.781418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:58.919781 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-21e6f615-d970-45eb-a0e7-8f30bcbc6da2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?name=1047077967" status: 200 len: 346 microversion: 2.1 time: 0.521329 Sep 10 21:01:58.925618 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1838/3741] 10.222.0.33 () {58 vars in 1156 bytes} [Sat Sep 10 21:01:58 2022] GET /compute/v2.1/servers?name=1047077967 => generated 346 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:01:58.936715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:58.938874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:58.950316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:58.950832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:58.951258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:58.958354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:58.958865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:58.959328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:59.212635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5e6617bc-f203-426d-8eb5-bac761a64b41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:59.227394 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5e6617bc-f203-426d-8eb5-bac761a64b41 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 1.436698 Sep 10 21:01:59.227945 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1904/3742] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:57 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:59.234269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:59.261521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:59.266094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:59.276507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:59.277143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:59.277961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:59.278838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:59.279982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:59.281318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:59.486229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:01:59.523206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:01:59.701677 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e02713a-73b3-4b42-8a7b-416e85e291a0 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.472386 Sep 10 21:01:59.703017 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1905/3743] 10.222.0.33 () {58 vars in 1154 bytes} [Sat Sep 10 21:01:59 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:01:59.714709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eecefe72-aee8-45df-aee4-9fbe3baa1bf8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:59.715637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eecefe72-aee8-45df-aee4-9fbe3baa1bf8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:01:59.725220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eecefe72-aee8-45df-aee4-9fbe3baa1bf8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:59.730661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eecefe72-aee8-45df-aee4-9fbe3baa1bf8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:59.731421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eecefe72-aee8-45df-aee4-9fbe3baa1bf8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:59.732384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eecefe72-aee8-45df-aee4-9fbe3baa1bf8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:59.733058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eecefe72-aee8-45df-aee4-9fbe3baa1bf8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:59.734138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eecefe72-aee8-45df-aee4-9fbe3baa1bf8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:59.839299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:59.850441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:59.855959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:59.860302 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d57c0876-f651-4dd9-a7df-50871d193dc2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.933348 Sep 10 21:01:59.865864 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1839/3744] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:01:58 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:01:59.882598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:01:59.890408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:01:59.898951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-104707796', 'deleted': False, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:01:59.939380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:59.939919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:59.940428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:01:59.942464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:01:59.942926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:01:59.943362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:00.133237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:02:00.235424 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-16fb8fce-1d76-41c7-a2fa-10579aa33e47 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-104707796" status: 200 len: 346 microversion: 2.1 time: 0.366600 Sep 10 21:02:00.236647 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1840/3745] 10.222.0.33 () {58 vars in 1228 bytes} [Sat Sep 10 21:01:59 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-104707796 => generated 346 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:00.313349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eecefe72-aee8-45df-aee4-9fbe3baa1bf8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:00.326674 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eecefe72-aee8-45df-aee4-9fbe3baa1bf8 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.622191 Sep 10 21:02:00.330907 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1906/3746] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:01:59 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:00.341707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b3be000d-7d32-42a9-bf88-4b126c5432c2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:00.342499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b3be000d-7d32-42a9-bf88-4b126c5432c2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:00.357734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3be000d-7d32-42a9-bf88-4b126c5432c2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:00.361348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3be000d-7d32-42a9-bf88-4b126c5432c2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:00.364322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3be000d-7d32-42a9-bf88-4b126c5432c2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:00.365307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3be000d-7d32-42a9-bf88-4b126c5432c2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:00.366454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3be000d-7d32-42a9-bf88-4b126c5432c2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:00.370065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3be000d-7d32-42a9-bf88-4b126c5432c2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:00.464357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b3be000d-7d32-42a9-bf88-4b126c5432c2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:02:00.689204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f6f702c4-b21f-42f5-97b2-0f33c130e015 tempest-AZV2TestJSON-1486889676 tempest-AZV2TestJSON-1486889676-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:00.690961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6f702c4-b21f-42f5-97b2-0f33c130e015 tempest-AZV2TestJSON-1486889676 tempest-AZV2TestJSON-1486889676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:00.691771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6f702c4-b21f-42f5-97b2-0f33c130e015 tempest-AZV2TestJSON-1486889676 tempest-AZV2TestJSON-1486889676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:00.692380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6f702c4-b21f-42f5-97b2-0f33c130e015 tempest-AZV2TestJSON-1486889676 tempest-AZV2TestJSON-1486889676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:00.695037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6f702c4-b21f-42f5-97b2-0f33c130e015 tempest-AZV2TestJSON-1486889676 tempest-AZV2TestJSON-1486889676-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:00.695512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6f702c4-b21f-42f5-97b2-0f33c130e015 tempest-AZV2TestJSON-1486889676 tempest-AZV2TestJSON-1486889676-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:00.695949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6f702c4-b21f-42f5-97b2-0f33c130e015 tempest-AZV2TestJSON-1486889676 tempest-AZV2TestJSON-1486889676-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:00.711224 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b3be000d-7d32-42a9-bf88-4b126c5432c2 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 204 len: 0 microversion: 2.1 time: 0.377362 Sep 10 21:02:00.714912 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1907/3747] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:02:00 2022] DELETE /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:02:00.739931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f81a8518-c8ca-438d-9d79-7ad4c5b55732 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f81a8518-c8ca-438d-9d79-7ad4c5b55732 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: request: PUT /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af HTTP/1.1 Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 24 Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": ""}} Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2bfdc13f-9c2e-44ec-8553-3f779ead89af', 'body': {'server': {'name': ''}}} Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi '' Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:02:00.760494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:00.766515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f81a8518-c8ca-438d-9d79-7ad4c5b55732 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:00.769261 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f81a8518-c8ca-438d-9d79-7ad4c5b55732 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "PUT /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 400 len: 108 microversion: 2.1 time: 0.051311 Sep 10 21:02:00.771623 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1908/3748] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Sep 10 21:02:00 2022] PUT /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 108 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:02:00.790523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c24a1b35-21d2-4580-a8db-4631bd98940f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:00.791849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c24a1b35-21d2-4580-a8db-4631bd98940f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:00.793501 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f6f702c4-b21f-42f5-97b2-0f33c130e015 tempest-AZV2TestJSON-1486889676 tempest-AZV2TestJSON-1486889676-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.549243 Sep 10 21:02:00.798386 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1841/3749] 10.222.0.33 () {58 vars in 1164 bytes} [Sat Sep 10 21:02:00 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:02:00.814496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09c78219-c57c-4262-b940-a215d3e6de4b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:00.815314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-09c78219-c57c-4262-b940-a215d3e6de4b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:00.821885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24a1b35-21d2-4580-a8db-4631bd98940f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:00.822904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24a1b35-21d2-4580-a8db-4631bd98940f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:00.826404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24a1b35-21d2-4580-a8db-4631bd98940f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:00.827493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24a1b35-21d2-4580-a8db-4631bd98940f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:00.829850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24a1b35-21d2-4580-a8db-4631bd98940f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:00.832275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c24a1b35-21d2-4580-a8db-4631bd98940f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:00.846065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09c78219-c57c-4262-b940-a215d3e6de4b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:00.846692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09c78219-c57c-4262-b940-a215d3e6de4b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:00.847398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09c78219-c57c-4262-b940-a215d3e6de4b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:00.849068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09c78219-c57c-4262-b940-a215d3e6de4b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:00.851837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09c78219-c57c-4262-b940-a215d3e6de4b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:00.852787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09c78219-c57c-4262-b940-a215d3e6de4b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:01.208204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c24a1b35-21d2-4580-a8db-4631bd98940f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:01.231975 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c24a1b35-21d2-4580-a8db-4631bd98940f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1516 microversion: 2.1 time: 0.459169 Sep 10 21:02:01.232502 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1909/3750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:00 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1516 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:01.253936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:01.254664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:01.279681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:01.280988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:01.281630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:01.284173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:01.284833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:01.291552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:01.590689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09c78219-c57c-4262-b940-a215d3e6de4b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:01.603533 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09c78219-c57c-4262-b940-a215d3e6de4b tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1504 microversion: 2.1 time: 0.803961 Sep 10 21:02:01.604122 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1842/3751] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:00 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1504 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:01.820217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:01.842936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:01.852090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:01.854217 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-af38160a-13c9-46d8-8441-0e7125152ed5 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.620700 Sep 10 21:02:01.862758 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1910/3752] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:01 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:02:02.259787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc2f0b66-ecde-4a81-a39d-9d70ad48350f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:02.261459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cc2f0b66-ecde-4a81-a39d-9d70ad48350f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:02.274443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc2f0b66-ecde-4a81-a39d-9d70ad48350f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:02.274949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc2f0b66-ecde-4a81-a39d-9d70ad48350f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:02.275641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc2f0b66-ecde-4a81-a39d-9d70ad48350f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:02.277376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc2f0b66-ecde-4a81-a39d-9d70ad48350f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:02.278081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc2f0b66-ecde-4a81-a39d-9d70ad48350f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:02.278712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc2f0b66-ecde-4a81-a39d-9d70ad48350f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:02.293613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:02.892558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:02.893291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:02.909949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:02.910525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:02.910995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:02.911719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:02.912513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:02.914237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:03.493381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cc2f0b66-ecde-4a81-a39d-9d70ad48350f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:03.497620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:03.534956 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cc2f0b66-ecde-4a81-a39d-9d70ad48350f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1516 microversion: 2.1 time: 1.277142 Sep 10 21:02:03.536466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:03.537524 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1843/3753] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:02 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1516 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:03.539287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:03.550024 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1a55d6ee-449a-49e0-b3e9-d93367190c6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.655016 Sep 10 21:02:03.551331 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1911/3754] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:02 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:02:04.191658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:04.192240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:04.206410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:04.206986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:04.207807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:04.208867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:04.209340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:04.209860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:04.237611 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 HTTP/1.1 Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5f1f769d-7314-4652-8dff-f06c1b403046'} Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:02:04.239649 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:04.244243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:04.245150 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f9b827ba-e7c3-42b3-b561-98e81996da5c tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 404 len: 111 microversion: 2.1 time: 0.061768 Sep 10 21:02:04.252447 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1844/3755] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:02:04 2022] DELETE /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:04.259793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:04.267752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 5f1f769d-7314-4652-8dff-f06c1b403046] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:04.285222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:04.286167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:04.286871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:04.288269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:04.288960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:04.289617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:04.318016 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 HTTP/1.1 Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5f1f769d-7314-4652-8dff-f06c1b403046'} Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:04.320895 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:04.325294 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:04.325294 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:04.325294 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:04.325294 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:04.325294 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:04.325294 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. Sep 10 21:02:04.325294 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:04.330237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 5f1f769d-7314-4652-8dff-f06c1b403046 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:04.331490 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-49c3f74e-f97b-4a6a-bbd7-7320cca7a846 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046" status: 404 len: 111 microversion: 2.1 time: 0.079368 Sep 10 21:02:04.332592 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1912/3756] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:04 2022] GET /compute/v2.1/servers/5f1f769d-7314-4652-8dff-f06c1b403046 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:04.341669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-792edb00-e0a4-43ad-b10f-5f1d9db476b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:04.343440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-792edb00-e0a4-43ad-b10f-5f1d9db476b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:04.354326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792edb00-e0a4-43ad-b10f-5f1d9db476b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:04.360553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792edb00-e0a4-43ad-b10f-5f1d9db476b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:04.361395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792edb00-e0a4-43ad-b10f-5f1d9db476b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:04.362449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792edb00-e0a4-43ad-b10f-5f1d9db476b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:04.363222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792edb00-e0a4-43ad-b10f-5f1d9db476b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:04.363664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792edb00-e0a4-43ad-b10f-5f1d9db476b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:04.459643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-792edb00-e0a4-43ad-b10f-5f1d9db476b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:02:04.567797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ca98903a-2f11-4412-a8d1-4d576f39a2cf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:04.569411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ca98903a-2f11-4412-a8d1-4d576f39a2cf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:04.582065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca98903a-2f11-4412-a8d1-4d576f39a2cf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:04.584138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca98903a-2f11-4412-a8d1-4d576f39a2cf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:04.584596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca98903a-2f11-4412-a8d1-4d576f39a2cf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:04.585341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca98903a-2f11-4412-a8d1-4d576f39a2cf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:04.585809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca98903a-2f11-4412-a8d1-4d576f39a2cf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:04.589014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca98903a-2f11-4412-a8d1-4d576f39a2cf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:04.849996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ca98903a-2f11-4412-a8d1-4d576f39a2cf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:04.864139 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ca98903a-2f11-4412-a8d1-4d576f39a2cf tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1516 microversion: 2.1 time: 0.301043 Sep 10 21:02:04.883574 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1913/3757] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:04 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1516 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:04.901724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:04.907607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:04.920322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:04.922060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:04.923045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:04.927800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:04.929965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:04.930731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:05.116817 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-792edb00-e0a4-43ad-b10f-5f1d9db476b4 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 204 len: 0 microversion: 2.1 time: 0.779274 Sep 10 21:02:05.120315 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1845/3758] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:02:04 2022] DELETE /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 0 bytes in 784 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:02:05.136928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ce2a1aa-0af6-4fc2-8534-9be89054f219 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:05.138570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ce2a1aa-0af6-4fc2-8534-9be89054f219 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:05.146679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce2a1aa-0af6-4fc2-8534-9be89054f219 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:05.147365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce2a1aa-0af6-4fc2-8534-9be89054f219 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:05.148305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce2a1aa-0af6-4fc2-8534-9be89054f219 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:05.149319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce2a1aa-0af6-4fc2-8534-9be89054f219 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:05.149987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce2a1aa-0af6-4fc2-8534-9be89054f219 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:05.152283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce2a1aa-0af6-4fc2-8534-9be89054f219 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:05.277422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:05.293974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:05.295702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:05.299872 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a09f023a-c290-4240-8531-4af55b0fad6f tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.400854 Sep 10 21:02:05.315393 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1914/3759] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:04 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:02:05.580812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4bb23ee4-ad0d-4912-93ad-817f6317d1ec req-a8be159b-8ded-4b35-bdc5-256df902b193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1767a7-4ae2-46ca-a241-b7749ee7a56d", "name": "network-vif-deleted", "tag": "8a1eafca-defa-4ca8-b70a-ad4397817ea7"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:05.625274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4bb23ee4-ad0d-4912-93ad-817f6317d1ec req-a8be159b-8ded-4b35-bdc5-256df902b193 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:05.629368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4bb23ee4-ad0d-4912-93ad-817f6317d1ec req-a8be159b-8ded-4b35-bdc5-256df902b193 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:05.633096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4bb23ee4-ad0d-4912-93ad-817f6317d1ec req-a8be159b-8ded-4b35-bdc5-256df902b193 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:05.676416 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4bb23ee4-ad0d-4912-93ad-817f6317d1ec req-a8be159b-8ded-4b35-bdc5-256df902b193 service nova] Creating event network-vif-deleted:8a1eafca-defa-4ca8-b70a-ad4397817ea7 for instance 1d1767a7-4ae2-46ca-a241-b7749ee7a56d on nch2-master-1 Sep 10 21:02:05.688208 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4bb23ee4-ad0d-4912-93ad-817f6317d1ec req-a8be159b-8ded-4b35-bdc5-256df902b193 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113776 Sep 10 21:02:05.690115 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1915/3760] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:02:05.898306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:05.902449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:05.913958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:05.914765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:05.916498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:05.918795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:05.919464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:05.920554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:05.945023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1ce2a1aa-0af6-4fc2-8534-9be89054f219 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:05.956931 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ce2a1aa-0af6-4fc2-8534-9be89054f219 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.831803 Sep 10 21:02:05.964747 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1846/3761] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:05 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:05.993314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:05.994339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:05.994995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:05.995799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lazy-loading 'fault' on Instance uuid 1d1767a7-4ae2-46ca-a241-b7749ee7a56d {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:02:06.041223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "13ebaf08-c6f6-4811-bd86-21208bb745bd"}], "security_groups": [{"name": "tempest-securitygroup--1872545869"}], "key_name": "tempest-keypair-739449473", "user_data": "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:06.080221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:06.092047 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e803607-a2aa-4ce7-b1c8-32fbbef5b5a1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 200 len: 1310 microversion: 2.1 time: 0.206178 Sep 10 21:02:06.094902 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1916/3762] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:05 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 1310 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:06.329919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:06.331248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:06.347211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:06.348174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:06.349330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:06.350595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:06.351268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:06.352111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:06.355256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] validate_networks() for [('13ebaf08-c6f6-4811-bd86-21208bb745bd', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:02:06.729401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:06.739479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:06.740935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:06.752404 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3acf494b-ec15-4e3f-9b3a-176b053234fb tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.424402 Sep 10 21:02:06.753156 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1917/3763] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:06 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:02:07.358172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:07.371138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8ab0d02-045a-493c-a3da-01b6fc19071c tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:07.375810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8ab0d02-045a-493c-a3da-01b6fc19071c tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:07.376209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8ab0d02-045a-493c-a3da-01b6fc19071c tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:07.376646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8ab0d02-045a-493c-a3da-01b6fc19071c tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:07.384578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8ab0d02-045a-493c-a3da-01b6fc19071c tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:07.385296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8ab0d02-045a-493c-a3da-01b6fc19071c tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:07.388097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8ab0d02-045a-493c-a3da-01b6fc19071c tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:07.463300 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8ab0d02-045a-493c-a3da-01b6fc19071c tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.706488 Sep 10 21:02:07.465106 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1918/3764] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 21:02:06 2022] GET /compute/v2.1/os-services => generated 947 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:07.472448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-dd1746d9-e627-4f6d-9965-8db82fbd5161 req-d2c98bf4-e4cb-40bc-a024-e401190e587f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-plugged", "status": "completed", "tag": "591c086f-46ef-4794-bd82-3e7775206b42"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:07.494964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-dd1746d9-e627-4f6d-9965-8db82fbd5161 req-d2c98bf4-e4cb-40bc-a024-e401190e587f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:07.495592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-dd1746d9-e627-4f6d-9965-8db82fbd5161 req-d2c98bf4-e4cb-40bc-a024-e401190e587f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:07.498099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-dd1746d9-e627-4f6d-9965-8db82fbd5161 req-d2c98bf4-e4cb-40bc-a024-e401190e587f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:07.529286 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-dd1746d9-e627-4f6d-9965-8db82fbd5161 req-d2c98bf4-e4cb-40bc-a024-e401190e587f service nova] Creating event network-vif-plugged:591c086f-46ef-4794-bd82-3e7775206b42 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:02:07.547787 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-dd1746d9-e627-4f6d-9965-8db82fbd5161 req-d2c98bf4-e4cb-40bc-a024-e401190e587f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078774 Sep 10 21:02:07.548711 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1919/3765] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:07.554768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ccd3b1fa-3a0b-425c-a6a6-970b2d42b9ce tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:07.555493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ccd3b1fa-3a0b-425c-a6a6-970b2d42b9ce tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:07.563318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd3b1fa-3a0b-425c-a6a6-970b2d42b9ce tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:07.564561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd3b1fa-3a0b-425c-a6a6-970b2d42b9ce tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:07.565217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd3b1fa-3a0b-425c-a6a6-970b2d42b9ce tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:07.566406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd3b1fa-3a0b-425c-a6a6-970b2d42b9ce tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:07.567177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd3b1fa-3a0b-425c-a6a6-970b2d42b9ce tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:07.567776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd3b1fa-3a0b-425c-a6a6-970b2d42b9ce tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:07.712624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:02:07.713048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:02:07.713813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:02:07.714679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:02:07.715267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:02:07.739920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:07.742673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:07.743340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:07.744327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:07.746386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:07.747550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:07.770275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Getting quotas for project 75ff64ac8631450bb5e2d269118982a8. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:02:07.782237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Getting quotas for user b638a9e7f0934e47a3883be65e42d558 and project 75ff64ac8631450bb5e2d269118982a8. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:02:07.798232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:02:07.801549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:02:07.870936 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f7de4d7-b678-4606-8001-51a383129122 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.834994 Sep 10 21:02:07.878333 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1847/3766] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:02:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:02:07.885213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:07.886258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 1d1767a7-4ae2-46ca-a241-b7749ee7a56d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:07.896415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:07.897016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:07.897751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:07.898908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:07.899529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:07.900170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:07.937779 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] HTTP exception thrown: Instance 1d1767a7-4ae2-46ca-a241-b7749ee7a56d could not be found. Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Request method failure captured: Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d HTTP/1.1 Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPrn6G6_EZdtOKJ9h6PnhceyP2k_jTvlI-MZCpp6NDrtyGRLvTeqlbJId5JKOhxxsWhTvmjp7D-CgL97-V1KBTc9XrCJMv75oCPHNX4cgZbbkQeZMY_kXA_zfYN2zXDB6nbPvobTVHQKsgudyq7JNoSeD8tMSt0tJ08I5KhnW9dU7GM Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 243cfbc91bb24e7ca96f348cd21f1adb Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ListServerFiltersTestJSON-1610821138 Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/243cfbc91bb24e7ca96f348cd21f1adb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/243cfbc91bb24e7ca96f348cd21f1adb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_243cfbc91bb24e7ca96f348cd21f1adb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/243cfbc91bb24e7ca96f348cd21f1adb"}]}] Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ListServerFiltersTestJSON-1610821138 Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 243cfbc91bb24e7ca96f348cd21f1adb Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1610821138 Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ListServerFiltersTestJSON-1610821138-project Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 9b9b59fb1a184b958ea619062412cf2d Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ListServerFiltersTestJSON-1610821138-project Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 1d1767a7-4ae2-46ca-a241-b7749ee7a56d could not be found. Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '1d1767a7-4ae2-46ca-a241-b7749ee7a56d'} Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1767a7-4ae2-46ca-a241-b7749ee7a56d could not be found. Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1767a7-4ae2-46ca-a241-b7749ee7a56d could not be found. Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:07.943227 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:07.952756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:07.952756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:07.952756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:07.952756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:07.952756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:07.952756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1767a7-4ae2-46ca-a241-b7749ee7a56d could not be found. Sep 10 21:02:07.952756 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:07.956696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Returning 404 to user: Instance 1d1767a7-4ae2-46ca-a241-b7749ee7a56d could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:07.966165 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-653bb75c-97f4-438b-9f47-10f378c9975e tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d" status: 404 len: 111 microversion: 2.1 time: 0.083203 Sep 10 21:02:07.970959 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1848/3767] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:07 2022] GET /compute/v2.1/servers/1d1767a7-4ae2-46ca-a241-b7749ee7a56d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:07.988651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-08798d11-63cf-4cd0-8755-f0118c2607cc tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:08.018922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08798d11-63cf-4cd0-8755-f0118c2607cc tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:08.019674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08798d11-63cf-4cd0-8755-f0118c2607cc tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:08.022698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08798d11-63cf-4cd0-8755-f0118c2607cc tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:08.026246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08798d11-63cf-4cd0-8755-f0118c2607cc tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:08.027504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08798d11-63cf-4cd0-8755-f0118c2607cc tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:08.030391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-08798d11-63cf-4cd0-8755-f0118c2607cc tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:08.044677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ccd3b1fa-3a0b-425c-a6a6-970b2d42b9ce tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:08.059196 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ccd3b1fa-3a0b-425c-a6a6-970b2d42b9ce tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1510 microversion: 2.1 time: 0.509191 Sep 10 21:02:08.060138 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1920/3768] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:07 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1510 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:08.071837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:08.074040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:08.091159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:08.091765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:08.092457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:08.097408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:08.098035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:08.099134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:08.105704 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-08798d11-63cf-4cd0-8755-f0118c2607cc tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.132987 Sep 10 21:02:08.113407 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1849/3769] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Sep 10 21:02:07 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:08.120380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-668c1a7d-75fd-4db5-a615-f6f212d4c62e tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:08.122775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-668c1a7d-75fd-4db5-a615-f6f212d4c62e tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:08.818637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-668c1a7d-75fd-4db5-a615-f6f212d4c62e tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:08.826124 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-668c1a7d-75fd-4db5-a615-f6f212d4c62e tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1225 microversion: 2.1 time: 0.711158 Sep 10 21:02:08.846291 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1850/3770] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:08 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1225 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:08.866246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:08.878388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:08.888978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:08.891386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc009c73-347d-4de9-a7ba-ff3c743d0c83 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:08.891680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cc009c73-347d-4de9-a7ba-ff3c743d0c83 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:08.892340 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-abc38738-0af6-44c4-af32-9da5a1eeb151 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.827157 Sep 10 21:02:08.893138 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1921/3771] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:08 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:02:08.897818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9b37a9f2-2ebf-41f1-a743-a6db25541834 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:08.926043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b37a9f2-2ebf-41f1-a743-a6db25541834 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:08.926685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b37a9f2-2ebf-41f1-a743-a6db25541834 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:08.927159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b37a9f2-2ebf-41f1-a743-a6db25541834 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:08.927972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b37a9f2-2ebf-41f1-a743-a6db25541834 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:08.928435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b37a9f2-2ebf-41f1-a743-a6db25541834 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:08.928862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b37a9f2-2ebf-41f1-a743-a6db25541834 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:08.946609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc009c73-347d-4de9-a7ba-ff3c743d0c83 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:08.947114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc009c73-347d-4de9-a7ba-ff3c743d0c83 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:08.947560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc009c73-347d-4de9-a7ba-ff3c743d0c83 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:08.948278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc009c73-347d-4de9-a7ba-ff3c743d0c83 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:08.948741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc009c73-347d-4de9-a7ba-ff3c743d0c83 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:08.949166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc009c73-347d-4de9-a7ba-ff3c743d0c83 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.003350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:09.025687 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9b37a9f2-2ebf-41f1-a743-a6db25541834 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.131279 Sep 10 21:02:09.026973 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1922/3772] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 21:02:08 2022] GET /compute/v2.1/os-services => generated 947 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:09.042341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-50b5e4a1-9382-44e3-917c-25d52505d5f1 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:09.056151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b5e4a1-9382-44e3-917c-25d52505d5f1 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.056633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b5e4a1-9382-44e3-917c-25d52505d5f1 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.058177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cc009c73-347d-4de9-a7ba-ff3c743d0c83 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:02:09.061040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b5e4a1-9382-44e3-917c-25d52505d5f1 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.062516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b5e4a1-9382-44e3-917c-25d52505d5f1 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.066910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b5e4a1-9382-44e3-917c-25d52505d5f1 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.067653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50b5e4a1-9382-44e3-917c-25d52505d5f1 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.179377 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-50b5e4a1-9382-44e3-917c-25d52505d5f1 tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.136183 Sep 10 21:02:09.180143 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1923/3773] 10.222.0.33 () {58 vars in 1196 bytes} [Sat Sep 10 21:02:09 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:02:09.201393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1b221c3f-0cab-4bba-83a3-efe8da026ad9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:09.203350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1b221c3f-0cab-4bba-83a3-efe8da026ad9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:09.233922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b221c3f-0cab-4bba-83a3-efe8da026ad9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.245333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b221c3f-0cab-4bba-83a3-efe8da026ad9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.247566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b221c3f-0cab-4bba-83a3-efe8da026ad9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.250670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b221c3f-0cab-4bba-83a3-efe8da026ad9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.251244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b221c3f-0cab-4bba-83a3-efe8da026ad9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.251696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b221c3f-0cab-4bba-83a3-efe8da026ad9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.332483 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cc009c73-347d-4de9-a7ba-ff3c743d0c83 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c" status: 204 len: 0 microversion: 2.1 time: 0.484599 Sep 10 21:02:09.333421 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1851/3774] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:02:08 2022] DELETE /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:02:09.342397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4af2cde2-39fa-41e7-8e2f-d79bb19d386b tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:09.360434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4af2cde2-39fa-41e7-8e2f-d79bb19d386b tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.361043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4af2cde2-39fa-41e7-8e2f-d79bb19d386b tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.361495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4af2cde2-39fa-41e7-8e2f-d79bb19d386b tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.362335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4af2cde2-39fa-41e7-8e2f-d79bb19d386b tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.362793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4af2cde2-39fa-41e7-8e2f-d79bb19d386b tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.363219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4af2cde2-39fa-41e7-8e2f-d79bb19d386b tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.439324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:09.482602 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4af2cde2-39fa-41e7-8e2f-d79bb19d386b tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.146244 Sep 10 21:02:09.486648 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1852/3775] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 21:02:09 2022] GET /compute/v2.1/os-services => generated 947 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:09.507447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c089d8fb-9c09-4fa7-aa7e-51f907d527f1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:09.514261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c089d8fb-9c09-4fa7-aa7e-51f907d527f1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:09.526331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c089d8fb-9c09-4fa7-aa7e-51f907d527f1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.526844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c089d8fb-9c09-4fa7-aa7e-51f907d527f1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.527296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c089d8fb-9c09-4fa7-aa7e-51f907d527f1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.528682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c089d8fb-9c09-4fa7-aa7e-51f907d527f1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.529324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c089d8fb-9c09-4fa7-aa7e-51f907d527f1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.530003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c089d8fb-9c09-4fa7-aa7e-51f907d527f1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.875090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c089d8fb-9c09-4fa7-aa7e-51f907d527f1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:09.889492 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c089d8fb-9c09-4fa7-aa7e-51f907d527f1 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c" status: 200 len: 1516 microversion: 2.1 time: 0.392260 Sep 10 21:02:09.894682 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1853/3776] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:09 2022] GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c => generated 1516 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:09.896876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b221c3f-0cab-4bba-83a3-efe8da026ad9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:09.899424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:09.900667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6501b6cd-bba8-4beb-b0fc-73608f50fe1a tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:09.912807 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1b221c3f-0cab-4bba-83a3-efe8da026ad9 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1302 microversion: 2.1 time: 0.730260 Sep 10 21:02:09.913028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6501b6cd-bba8-4beb-b0fc-73608f50fe1a tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.927911 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1924/3777] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:09 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1302 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:09.928253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6501b6cd-bba8-4beb-b0fc-73608f50fe1a tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.928253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6501b6cd-bba8-4beb-b0fc-73608f50fe1a tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.930217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6501b6cd-bba8-4beb-b0fc-73608f50fe1a tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.930887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6501b6cd-bba8-4beb-b0fc-73608f50fe1a tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.931379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6501b6cd-bba8-4beb-b0fc-73608f50fe1a tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.936361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-009d8565-630f-48a8-b0b8-9088458ab53b req-f94e6518-5f57-4f7b-a15c-965edc30369a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfdc13f-9c2e-44ec-8553-3f779ead89af", "name": "network-vif-deleted", "tag": "b18a22e2-b050-417e-bebb-2f9e983473cc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:09.959603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-009d8565-630f-48a8-b0b8-9088458ab53b req-f94e6518-5f57-4f7b-a15c-965edc30369a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:09.959890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-009d8565-630f-48a8-b0b8-9088458ab53b req-f94e6518-5f57-4f7b-a15c-965edc30369a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:09.964044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-009d8565-630f-48a8-b0b8-9088458ab53b req-f94e6518-5f57-4f7b-a15c-965edc30369a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:09.990448 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-009d8565-630f-48a8-b0b8-9088458ab53b req-f94e6518-5f57-4f7b-a15c-965edc30369a service nova] Creating event network-vif-deleted:b18a22e2-b050-417e-bebb-2f9e983473cc for instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af on nch1-master-1 Sep 10 21:02:09.996673 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-009d8565-630f-48a8-b0b8-9088458ab53b req-f94e6518-5f57-4f7b-a15c-965edc30369a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070595 Sep 10 21:02:09.997513 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1925/3778] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:10.003457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-db1c2d3d-a1bf-4d65-84f3-5f3281eba78d req-ce8632b7-c495-4fab-ac08-9c1e510e1180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-plugged", "status": "completed", "tag": "4619895f-8d16-490c-8f4a-a6d5aa999a89"}, {"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-plugged", "status": "completed", "tag": "eb53acdc-dda5-4628-9875-8c05fd7b949f"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:10.021664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-db1c2d3d-a1bf-4d65-84f3-5f3281eba78d req-ce8632b7-c495-4fab-ac08-9c1e510e1180 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:10.022456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-db1c2d3d-a1bf-4d65-84f3-5f3281eba78d req-ce8632b7-c495-4fab-ac08-9c1e510e1180 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:10.023107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-db1c2d3d-a1bf-4d65-84f3-5f3281eba78d req-ce8632b7-c495-4fab-ac08-9c1e510e1180 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:10.028650 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6501b6cd-bba8-4beb-b0fc-73608f50fe1a tempest-ServicesAdminNegativeTestJSON-1205268580 tempest-ServicesAdminNegativeTestJSON-1205268580-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.131480 Sep 10 21:02:10.029385 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1854/3779] 10.222.0.33 () {58 vars in 1198 bytes} [Sat Sep 10 21:02:09 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:02:10.043112 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-db1c2d3d-a1bf-4d65-84f3-5f3281eba78d req-ce8632b7-c495-4fab-ac08-9c1e510e1180 service nova] Creating event network-vif-plugged:4619895f-8d16-490c-8f4a-a6d5aa999a89 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:02:10.047993 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-db1c2d3d-a1bf-4d65-84f3-5f3281eba78d req-ce8632b7-c495-4fab-ac08-9c1e510e1180 service nova] Creating event network-vif-plugged:eb53acdc-dda5-4628-9875-8c05fd7b949f for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:02:10.056930 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-db1c2d3d-a1bf-4d65-84f3-5f3281eba78d req-ce8632b7-c495-4fab-ac08-9c1e510e1180 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057582 Sep 10 21:02:10.058239 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1926/3780] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:10.062620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c1d19292-da1f-444b-9ac6-1a554440c5b2 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:10.066143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:10.067004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c1d19292-da1f-444b-9ac6-1a554440c5b2 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:10.067218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:10.074728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:10.075491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:10.076095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:10.077584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:10.078251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:10.078877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:10.084995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1d19292-da1f-444b-9ac6-1a554440c5b2 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:10.088405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1d19292-da1f-444b-9ac6-1a554440c5b2 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:10.088950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1d19292-da1f-444b-9ac6-1a554440c5b2 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:10.093189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1d19292-da1f-444b-9ac6-1a554440c5b2 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:10.094090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1d19292-da1f-444b-9ac6-1a554440c5b2 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:10.095187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c1d19292-da1f-444b-9ac6-1a554440c5b2 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:10.232531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c1d19292-da1f-444b-9ac6-1a554440c5b2 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:10.254829 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c1d19292-da1f-444b-9ac6-1a554440c5b2 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1277 microversion: 2.1 time: 0.209644 Sep 10 21:02:10.255878 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1855/3781] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:10 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:10.401374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:10.416047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:10.419566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:10.424408 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4e14633b-21a1-4dad-97fb-b1a30ef2fdb4 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.361225 Sep 10 21:02:10.424930 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1927/3782] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:10 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:02:10.535026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1682061203", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e4401218-c6fb-4457-975c-35dd67e4cb14"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:10.595843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f871f685-0854-4405-a5d9-9eda0132e1f3 tempest-ServicesAdminNegativeTestJSON-947921033 tempest-ServicesAdminNegativeTestJSON-947921033-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:10.603151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f871f685-0854-4405-a5d9-9eda0132e1f3 tempest-ServicesAdminNegativeTestJSON-947921033 tempest-ServicesAdminNegativeTestJSON-947921033-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '31c9521425ef447b873dbce6841775d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ac1a286f2a468dad5296c209919b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f871f685-0854-4405-a5d9-9eda0132e1f3 tempest-ServicesAdminNegativeTestJSON-947921033 tempest-ServicesAdminNegativeTestJSON-947921033-project] Request method failure captured: Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtMVcpq8QgdTOb7AkSqTFJZr77BOMT98lZBUkUr3CLOMiMwG8HGTJF5p4Q4MQSHkQSnwZLb1BbkodBVDqGfjjBSS_crZLUf2ZVQjJeUMGfqTLBJ-7aQJv3ZW4yCDvKCI_DQQcglXt21p-9uYCQk8BtDrOqCIFX6TTanfww-QovNh5U Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 86ac1a286f2a468dad5296c209919b88 Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-947921033 Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86ac1a286f2a468dad5296c209919b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86ac1a286f2a468dad5296c209919b88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_86ac1a286f2a468dad5296c209919b88", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/86ac1a286f2a468dad5296c209919b88"}]}] Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-947921033 Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 86ac1a286f2a468dad5296c209919b88 Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-947921033 Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServicesAdminNegativeTestJSON-947921033-project Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 31c9521425ef447b873dbce6841775d8 Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-947921033-project Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: action_args: {} Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 21:02:10.606258 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f871f685-0854-4405-a5d9-9eda0132e1f3 tempest-ServicesAdminNegativeTestJSON-947921033 tempest-ServicesAdminNegativeTestJSON-947921033-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f871f685-0854-4405-a5d9-9eda0132e1f3 tempest-ServicesAdminNegativeTestJSON-947921033 tempest-ServicesAdminNegativeTestJSON-947921033-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.349856 Sep 10 21:02:10.613359 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1856/3783] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 21:02:10 2022] GET /compute/v2.1/os-services => generated 112 bytes in 353 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:10.652112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] validate_networks() for [('e4401218-c6fb-4457-975c-35dd67e4cb14', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:02:10.922309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a29dbbd6-5817-4727-8669-6f8e59077743 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:10.923358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a29dbbd6-5817-4727-8669-6f8e59077743 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:10.962870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a29dbbd6-5817-4727-8669-6f8e59077743 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:10.964904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a29dbbd6-5817-4727-8669-6f8e59077743 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:10.971967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a29dbbd6-5817-4727-8669-6f8e59077743 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:10.975316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a29dbbd6-5817-4727-8669-6f8e59077743 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:10.980575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a29dbbd6-5817-4727-8669-6f8e59077743 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:10.982001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a29dbbd6-5817-4727-8669-6f8e59077743 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:11.336782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a29dbbd6-5817-4727-8669-6f8e59077743 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:11.348373 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a29dbbd6-5817-4727-8669-6f8e59077743 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c" status: 200 len: 1516 microversion: 2.1 time: 0.431325 Sep 10 21:02:11.350845 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1857/3784] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:10 2022] GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c => generated 1516 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:11.356231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:11.357054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:11.369686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:11.370487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:11.371781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:11.372727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:11.373395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:11.374842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:11.467096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:11.468133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:11.468803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:11.469620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lazy-loading 'fault' on Instance uuid 2bfdc13f-9c2e-44ec-8553-3f779ead89af {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:02:11.525462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed1a15bbff41c6928afd3c057e7dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd640711fd8c64403adc4d7e7235a8fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:11.536718 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1317b25f-f392-47bd-bf35-ef43567ee8e2 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 200 len: 1307 microversion: 2.1 time: 0.184623 Sep 10 21:02:11.537918 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1858/3785] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:11 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 1307 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:11.542951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3faa77bf-3b96-4fe6-a104-bec5c2c1ec81 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:11.543852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3faa77bf-3b96-4fe6-a104-bec5c2c1ec81 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:11.550959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3faa77bf-3b96-4fe6-a104-bec5c2c1ec81 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:11.551572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3faa77bf-3b96-4fe6-a104-bec5c2c1ec81 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:11.552311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3faa77bf-3b96-4fe6-a104-bec5c2c1ec81 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:11.561813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3faa77bf-3b96-4fe6-a104-bec5c2c1ec81 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:11.562685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3faa77bf-3b96-4fe6-a104-bec5c2c1ec81 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:11.563867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3faa77bf-3b96-4fe6-a104-bec5c2c1ec81 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:11.724401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3faa77bf-3b96-4fe6-a104-bec5c2c1ec81 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:11.738249 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3faa77bf-3b96-4fe6-a104-bec5c2c1ec81 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1285 microversion: 2.1 time: 0.196624 Sep 10 21:02:11.740732 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1859/3786] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:11 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:11.757749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:11.758662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:11.791568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:11.795133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:11.796548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:11.797719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:11.798647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:11.799349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:12.163716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:12.176293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:12.177886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:12.179311 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9a776c07-d2e2-4a91-a412-70d6ef5432e3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.436077 Sep 10 21:02:12.180150 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1860/3787] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:11 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:02:12.186367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-897583f3-f8d7-478f-b076-a8a2737c2fe0 req-a6c017f4-b135-4f9c-a055-42a123878b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-plugged", "status": "completed", "tag": "31ec25a2-b534-4f40-ae04-3216ce7462b4"}, {"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-plugged", "status": "completed", "tag": "927c985e-c5fa-49ba-ad56-493d19eca859"}, {"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-plugged", "status": "completed", "tag": "99a05956-b818-4d1e-9f19-c00ce1c706e3"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:12.199159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-897583f3-f8d7-478f-b076-a8a2737c2fe0 req-a6c017f4-b135-4f9c-a055-42a123878b8b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:12.200038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-897583f3-f8d7-478f-b076-a8a2737c2fe0 req-a6c017f4-b135-4f9c-a055-42a123878b8b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:12.200723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-897583f3-f8d7-478f-b076-a8a2737c2fe0 req-a6c017f4-b135-4f9c-a055-42a123878b8b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:12.214884 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-897583f3-f8d7-478f-b076-a8a2737c2fe0 req-a6c017f4-b135-4f9c-a055-42a123878b8b service nova] Creating event network-vif-plugged:31ec25a2-b534-4f40-ae04-3216ce7462b4 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:02:12.215749 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-897583f3-f8d7-478f-b076-a8a2737c2fe0 req-a6c017f4-b135-4f9c-a055-42a123878b8b service nova] Creating event network-vif-plugged:927c985e-c5fa-49ba-ad56-493d19eca859 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:02:12.216658 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-897583f3-f8d7-478f-b076-a8a2737c2fe0 req-a6c017f4-b135-4f9c-a055-42a123878b8b service nova] Creating event network-vif-plugged:99a05956-b818-4d1e-9f19-c00ce1c706e3 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:02:12.231552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-897583f3-f8d7-478f-b076-a8a2737c2fe0 req-a6c017f4-b135-4f9c-a055-42a123878b8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.049944 Sep 10 21:02:12.232791 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1861/3788] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:12.373265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e6e08056-c579-4b36-967c-54627e9ef0c5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:12.374789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e6e08056-c579-4b36-967c-54627e9ef0c5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:12.395137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6e08056-c579-4b36-967c-54627e9ef0c5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:12.399947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6e08056-c579-4b36-967c-54627e9ef0c5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:12.406903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6e08056-c579-4b36-967c-54627e9ef0c5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:12.408334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6e08056-c579-4b36-967c-54627e9ef0c5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:12.410781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6e08056-c579-4b36-967c-54627e9ef0c5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:12.411254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6e08056-c579-4b36-967c-54627e9ef0c5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:12.676963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e6e08056-c579-4b36-967c-54627e9ef0c5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:12.679428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:12.688397 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e6e08056-c579-4b36-967c-54627e9ef0c5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c" status: 200 len: 1516 microversion: 2.1 time: 0.319488 Sep 10 21:02:12.692056 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1862/3789] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:12 2022] GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c => generated 1516 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:12.703929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:12.708508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] [instance: 2bfdc13f-9c2e-44ec-8553-3f779ead89af] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:12.721284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:12.721788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:12.723296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:12.726578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:12.730457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:12.731117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:12.756680 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] HTTP exception thrown: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af could not be found. Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Request method failure captured: Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af HTTP/1.1 Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPpP3WdSdKiA0KTe_WljUkolb8G5Bsp-qNsW12irtfArhKvH0hVpum5U6OYpWt3TXH_ThogBNfYvxdiYeFyJFc0eyLKApc9WYKJyBL6uISNtiZrJC4w6TX7rOqPEByC9XDycKQzZyuyBE7MNBobVlyIv2s6n1zZvShVTyaUx-gQK6Us Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d640711fd8c64403adc4d7e7235a8fad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d640711fd8c64403adc4d7e7235a8fad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d640711fd8c64403adc4d7e7235a8fad"}]}] Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d640711fd8c64403adc4d7e7235a8fad Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1335686226 Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2bed1a15bbff41c6928afd3c057e7dfc Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-1335686226-project Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af could not be found. Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2bfdc13f-9c2e-44ec-8553-3f779ead89af'} Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af could not be found. Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af could not be found. Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:12.763475 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:12.768741 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:12.768741 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:12.768741 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:12.768741 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:12.768741 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:12.768741 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af could not be found. Sep 10 21:02:12.768741 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:12.782820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] Returning 404 to user: Instance 2bfdc13f-9c2e-44ec-8553-3f779ead89af could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:12.783999 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-64c7394a-2207-41f2-b208-c09d0e1616b5 tempest-ServersNegativeTestJSON-1335686226 tempest-ServersNegativeTestJSON-1335686226-project] 10.222.0.33 "GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af" status: 404 len: 111 microversion: 2.1 time: 0.090778 Sep 10 21:02:12.785083 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1863/3790] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:12 2022] GET /compute/v2.1/servers/2bfdc13f-9c2e-44ec-8553-3f779ead89af => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:12.790430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e25bf4fc-1310-456d-888f-8d0f5bbb3a04 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:12.792091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e25bf4fc-1310-456d-888f-8d0f5bbb3a04 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:12.805570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e25bf4fc-1310-456d-888f-8d0f5bbb3a04 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:12.810109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e25bf4fc-1310-456d-888f-8d0f5bbb3a04 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:12.810801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e25bf4fc-1310-456d-888f-8d0f5bbb3a04 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:12.812117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e25bf4fc-1310-456d-888f-8d0f5bbb3a04 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:12.812590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e25bf4fc-1310-456d-888f-8d0f5bbb3a04 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:12.813033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e25bf4fc-1310-456d-888f-8d0f5bbb3a04 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:12.974346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e25bf4fc-1310-456d-888f-8d0f5bbb3a04 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:12.994006 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e25bf4fc-1310-456d-888f-8d0f5bbb3a04 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1283 microversion: 2.1 time: 0.198061 Sep 10 21:02:12.995017 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1864/3791] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:12 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1283 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:13.210449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:13.211876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:13.222567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:13.223480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:13.225676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:13.226760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:13.229679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:13.230539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:13.722599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:02:13.725222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:02:13.725939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:02:13.726873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:02:13.727472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:02:13.744558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:13.750617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:13.752990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:13.756219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:13.756929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:13.757679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:13.809851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Getting quotas for project dd2cd4bb350d452eb8c5e2533642c0f0. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:02:13.824663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Getting quotas for user 6f50ca756d594703846f1dade2d38eac and project dd2cd4bb350d452eb8c5e2533642c0f0. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:02:13.859791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Going to run 2 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:02:13.862893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:02:13.937998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:02:14.097060 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-281d727d-de31-4223-90c8-92a0185233d0 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.670722 Sep 10 21:02:14.107139 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1928/3792] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:02:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:02:14.113917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fea6b23c-b42a-476e-be59-d41e4b825f8f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:14.115735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fea6b23c-b42a-476e-be59-d41e4b825f8f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:14.124596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fea6b23c-b42a-476e-be59-d41e4b825f8f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:14.125308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fea6b23c-b42a-476e-be59-d41e4b825f8f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:14.125996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fea6b23c-b42a-476e-be59-d41e4b825f8f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:14.126950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fea6b23c-b42a-476e-be59-d41e4b825f8f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:14.127616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fea6b23c-b42a-476e-be59-d41e4b825f8f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:14.128244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fea6b23c-b42a-476e-be59-d41e4b825f8f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:14.230344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fea6b23c-b42a-476e-be59-d41e4b825f8f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:14.250370 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fea6b23c-b42a-476e-be59-d41e4b825f8f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c" status: 200 len: 1474 microversion: 2.1 time: 0.139001 Sep 10 21:02:14.251020 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1929/3793] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:14 2022] GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c => generated 1474 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:14.263184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3820ae47-b1df-4309-9398-b0361cb75601 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:14.266005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3820ae47-b1df-4309-9398-b0361cb75601 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:14.281353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3820ae47-b1df-4309-9398-b0361cb75601 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:14.282480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3820ae47-b1df-4309-9398-b0361cb75601 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:14.284471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3820ae47-b1df-4309-9398-b0361cb75601 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:14.288282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3820ae47-b1df-4309-9398-b0361cb75601 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:14.290859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3820ae47-b1df-4309-9398-b0361cb75601 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:14.291530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3820ae47-b1df-4309-9398-b0361cb75601 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:14.380251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:14.390634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:14.392119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:14.393341 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e537e9a3-f848-4d0b-b3fb-f24222d52b10 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 1.187178 Sep 10 21:02:14.427333 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1865/3794] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:13 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:02:14.441144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ceac6274-102c-4e04-8826-abca0d986378 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:14.467745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ceac6274-102c-4e04-8826-abca0d986378 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:14.468873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ceac6274-102c-4e04-8826-abca0d986378 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Searching by: {'deleted': False, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:02:14.534057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceac6274-102c-4e04-8826-abca0d986378 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:14.534650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceac6274-102c-4e04-8826-abca0d986378 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:14.535023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceac6274-102c-4e04-8826-abca0d986378 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:14.536856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceac6274-102c-4e04-8826-abca0d986378 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:14.542770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceac6274-102c-4e04-8826-abca0d986378 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:14.543258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceac6274-102c-4e04-8826-abca0d986378 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:14.554720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=31 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:14.649533 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ceac6274-102c-4e04-8826-abca0d986378 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.211898 Sep 10 21:02:14.649533 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1866/3795] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 21:02:14 2022] GET /compute/v2.1/servers => generated 677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:14.653080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c84cef92-f711-4e5f-979e-a7a071166641 req-da489a1c-ba9e-4985-9ec1-8db476425af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c", "name": "network-vif-deleted", "tag": "c3d3b4a7-7a79-4daa-9826-80870e8d53e3"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:14.681523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c84cef92-f711-4e5f-979e-a7a071166641 req-da489a1c-ba9e-4985-9ec1-8db476425af2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:14.681989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c84cef92-f711-4e5f-979e-a7a071166641 req-da489a1c-ba9e-4985-9ec1-8db476425af2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:14.684591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c84cef92-f711-4e5f-979e-a7a071166641 req-da489a1c-ba9e-4985-9ec1-8db476425af2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:14.736254 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c84cef92-f711-4e5f-979e-a7a071166641 req-da489a1c-ba9e-4985-9ec1-8db476425af2 service nova] Creating event network-vif-deleted:c3d3b4a7-7a79-4daa-9826-80870e8d53e3 for instance c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c on nch1-master-1 Sep 10 21:02:14.752942 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c84cef92-f711-4e5f-979e-a7a071166641 req-da489a1c-ba9e-4985-9ec1-8db476425af2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105783 Sep 10 21:02:14.754350 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1867/3796] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:14.773900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e0914c5d-b196-4d70-9560-04cef40b9403 req-7f6bbd6d-c6a2-45fb-9140-c355a7060541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-plugged", "status": "completed", "tag": "311db54b-3ded-45c3-aad5-3b61965f2c39"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:14.794927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e0914c5d-b196-4d70-9560-04cef40b9403 req-7f6bbd6d-c6a2-45fb-9140-c355a7060541 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:14.795951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e0914c5d-b196-4d70-9560-04cef40b9403 req-7f6bbd6d-c6a2-45fb-9140-c355a7060541 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:14.796419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e0914c5d-b196-4d70-9560-04cef40b9403 req-7f6bbd6d-c6a2-45fb-9140-c355a7060541 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:14.821252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3820ae47-b1df-4309-9398-b0361cb75601 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:14.837178 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e0914c5d-b196-4d70-9560-04cef40b9403 req-7f6bbd6d-c6a2-45fb-9140-c355a7060541 service nova] Creating event network-vif-plugged:311db54b-3ded-45c3-aad5-3b61965f2c39 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:02:14.851249 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e0914c5d-b196-4d70-9560-04cef40b9403 req-7f6bbd6d-c6a2-45fb-9140-c355a7060541 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095472 Sep 10 21:02:14.859986 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1868/3797] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:14.863098 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3820ae47-b1df-4309-9398-b0361cb75601 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1351 microversion: 2.1 time: 0.607404 Sep 10 21:02:14.875985 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1930/3798] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:14 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1351 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:14.889252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3961cbbf-14e6-47d1-a91c-5cf992dd1c8d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:14.889949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3961cbbf-14e6-47d1-a91c-5cf992dd1c8d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:15.276733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:15.277350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:15.285043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:15.285738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:15.286235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:15.286960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:15.287427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:15.287861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:15.323350 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] HTTP exception thrown: Instance c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c could not be found. Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Request method failure captured: Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c HTTP/1.1 Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPrn6G6_EZdtOKJ9h6PnhceyP2k_jTvlI-MZCpp6NDrtyGRLvTeqlbJId5JKOhxxsWhTvmjp7D-CgL97-V1KBTc9XrCJMv75oCPHNX4cgZbbkQeZMY_kXA_zfYN2zXDB6nbPvobTVHQKsgudyq7JNoSeD8tMSt0tJ08I5KhnW9dU7GM Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 243cfbc91bb24e7ca96f348cd21f1adb Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ListServerFiltersTestJSON-1610821138 Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/243cfbc91bb24e7ca96f348cd21f1adb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/243cfbc91bb24e7ca96f348cd21f1adb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_243cfbc91bb24e7ca96f348cd21f1adb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/243cfbc91bb24e7ca96f348cd21f1adb"}]}] Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ListServerFiltersTestJSON-1610821138 Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 243cfbc91bb24e7ca96f348cd21f1adb Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1610821138 Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ListServerFiltersTestJSON-1610821138-project Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9b9b59fb1a184b958ea619062412cf2d Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ListServerFiltersTestJSON-1610821138-project Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c could not be found. Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c'} Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c could not be found. Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c could not be found. Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:15.325356 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:15.330388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:15.330388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:15.330388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:15.330388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:15.330388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:15.330388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c could not be found. Sep 10 21:02:15.330388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:15.332420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Returning 404 to user: Instance c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:15.333532 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9189c358-b6fc-47a0-8305-864e0f354ea5 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c" status: 404 len: 111 microversion: 2.1 time: 0.060778 Sep 10 21:02:15.334709 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1931/3799] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:15 2022] GET /compute/v2.1/servers/c1a2d9c6-8c66-406d-b4f4-0dfe0993af8c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:15.343667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6596f739-da10-49c5-89bf-e5db253d140f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:15.344829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6596f739-da10-49c5-89bf-e5db253d140f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:15.352740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6596f739-da10-49c5-89bf-e5db253d140f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:15.353583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6596f739-da10-49c5-89bf-e5db253d140f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:15.354345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6596f739-da10-49c5-89bf-e5db253d140f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:15.355835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6596f739-da10-49c5-89bf-e5db253d140f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:15.356728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6596f739-da10-49c5-89bf-e5db253d140f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:15.358001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6596f739-da10-49c5-89bf-e5db253d140f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:15.404872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6596f739-da10-49c5-89bf-e5db253d140f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:02:15.476221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3961cbbf-14e6-47d1-a91c-5cf992dd1c8d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:15.489935 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3961cbbf-14e6-47d1-a91c-5cf992dd1c8d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1220 microversion: 2.1 time: 0.614321 Sep 10 21:02:15.490849 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1869/3800] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:14 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1220 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:15.505755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:15.506441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:15.532161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:15.532698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:15.533128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:15.533990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:15.534310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:15.534739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:15.590816 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6596f739-da10-49c5-89bf-e5db253d140f tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "DELETE /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 204 len: 0 microversion: 2.1 time: 0.251804 Sep 10 21:02:15.592791 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1932/3801] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:02:15 2022] DELETE /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:02:15.624730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bd2299b1-47b0-4ef6-8876-ea5ffe81edcc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:15.632100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bd2299b1-47b0-4ef6-8876-ea5ffe81edcc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:15.662855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd2299b1-47b0-4ef6-8876-ea5ffe81edcc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:15.663823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd2299b1-47b0-4ef6-8876-ea5ffe81edcc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:15.665441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd2299b1-47b0-4ef6-8876-ea5ffe81edcc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:15.667457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd2299b1-47b0-4ef6-8876-ea5ffe81edcc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:15.669316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd2299b1-47b0-4ef6-8876-ea5ffe81edcc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:15.674342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd2299b1-47b0-4ef6-8876-ea5ffe81edcc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:16.113653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bd2299b1-47b0-4ef6-8876-ea5ffe81edcc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:16.137947 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bd2299b1-47b0-4ef6-8876-ea5ffe81edcc tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1517 microversion: 2.1 time: 0.533411 Sep 10 21:02:16.156007 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1933/3802] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:15 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1517 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:16.161057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:16.175062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:16.177015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:16.177288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-213c4685-5a28-477a-bdf9-ebd939910c37 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:16.178708 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3e7dc898-1c7a-4f76-8dc7-07b36d2365f2 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 0.685339 Sep 10 21:02:16.179503 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1870/3803] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:15 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:02:16.204424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-213c4685-5a28-477a-bdf9-ebd939910c37 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:16.219861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-213c4685-5a28-477a-bdf9-ebd939910c37 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:16.221440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-213c4685-5a28-477a-bdf9-ebd939910c37 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:16.222137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-213c4685-5a28-477a-bdf9-ebd939910c37 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:16.224047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-213c4685-5a28-477a-bdf9-ebd939910c37 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:16.224754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-213c4685-5a28-477a-bdf9-ebd939910c37 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:16.225761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-213c4685-5a28-477a-bdf9-ebd939910c37 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:16.518635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4385faaf-4f3b-40d8-8250-99a9e39b9411 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:16.520079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4385faaf-4f3b-40d8-8250-99a9e39b9411 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:16.527094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4385faaf-4f3b-40d8-8250-99a9e39b9411 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:16.527677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4385faaf-4f3b-40d8-8250-99a9e39b9411 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:16.528339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4385faaf-4f3b-40d8-8250-99a9e39b9411 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:16.529056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4385faaf-4f3b-40d8-8250-99a9e39b9411 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:16.529517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4385faaf-4f3b-40d8-8250-99a9e39b9411 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:16.530520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4385faaf-4f3b-40d8-8250-99a9e39b9411 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:16.540048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-213c4685-5a28-477a-bdf9-ebd939910c37 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:16.548940 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-213c4685-5a28-477a-bdf9-ebd939910c37 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1351 microversion: 2.1 time: 0.391473 Sep 10 21:02:16.549501 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1934/3804] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:16 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1351 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:16.758203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4385faaf-4f3b-40d8-8250-99a9e39b9411 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:16.770219 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4385faaf-4f3b-40d8-8250-99a9e39b9411 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1224 microversion: 2.1 time: 0.255872 Sep 10 21:02:16.770827 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1871/3805] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:16 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1224 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:17.164027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be836a2b-5034-4826-b0e4-162c9393d5af tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:17.164659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-be836a2b-5034-4826-b0e4-162c9393d5af tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:17.174665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be836a2b-5034-4826-b0e4-162c9393d5af tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:17.175173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be836a2b-5034-4826-b0e4-162c9393d5af tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:17.175713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be836a2b-5034-4826-b0e4-162c9393d5af tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:17.187095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be836a2b-5034-4826-b0e4-162c9393d5af tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:17.187893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be836a2b-5034-4826-b0e4-162c9393d5af tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:17.189561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be836a2b-5034-4826-b0e4-162c9393d5af tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:17.207290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:17.208396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:17.225214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:17.230982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:17.231775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:17.234538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:17.236159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:17.237215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:18.198352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-be836a2b-5034-4826-b0e4-162c9393d5af tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:18.219980 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be836a2b-5034-4826-b0e4-162c9393d5af tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1517 microversion: 2.1 time: 1.059838 Sep 10 21:02:18.225411 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1935/3806] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:17 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1517 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:18.237341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f4e1fa0-c7f1-42cd-a018-3c23aaabe5e3 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:18.238485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5f4e1fa0-c7f1-42cd-a018-3c23aaabe5e3 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:18.257317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f4e1fa0-c7f1-42cd-a018-3c23aaabe5e3 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:18.259148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f4e1fa0-c7f1-42cd-a018-3c23aaabe5e3 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:18.260201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f4e1fa0-c7f1-42cd-a018-3c23aaabe5e3 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:18.261781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f4e1fa0-c7f1-42cd-a018-3c23aaabe5e3 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:18.262757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f4e1fa0-c7f1-42cd-a018-3c23aaabe5e3 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:18.264846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f4e1fa0-c7f1-42cd-a018-3c23aaabe5e3 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:18.355542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:18.395358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:18.410633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:18.415644 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ced969b1-f339-4b21-8512-146441382a5b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1873 microversion: 2.32 time: 1.213837 Sep 10 21:02:18.445688 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1872/3807] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:17 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1873 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:02:18.469908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-35b09e9e-9b94-45a8-9538-f6041f6b7da4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:18.471180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-35b09e9e-9b94-45a8-9538-f6041f6b7da4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:18.496295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b09e9e-9b94-45a8-9538-f6041f6b7da4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:18.497321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b09e9e-9b94-45a8-9538-f6041f6b7da4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:18.498119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b09e9e-9b94-45a8-9538-f6041f6b7da4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:18.500652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b09e9e-9b94-45a8-9538-f6041f6b7da4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:18.501334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b09e9e-9b94-45a8-9538-f6041f6b7da4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:18.505169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b09e9e-9b94-45a8-9538-f6041f6b7da4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:19.071471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5f4e1fa0-c7f1-42cd-a018-3c23aaabe5e3 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:19.081481 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f4e1fa0-c7f1-42cd-a018-3c23aaabe5e3 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1351 microversion: 2.1 time: 0.854869 Sep 10 21:02:19.082955 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1936/3808] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:18 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1351 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:19.088000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-744ae96b-036d-4df6-a30a-a05841d52723 req-a2417ca5-9e8a-45a5-a3ed-9a5ce62a3501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b3e1c0-3109-4dbc-be56-f909f76fd613", "tag": "f5d87996-dbb7-41f9-91cf-13dd283033a8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:19.104296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-744ae96b-036d-4df6-a30a-a05841d52723 req-a2417ca5-9e8a-45a5-a3ed-9a5ce62a3501 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:19.105074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-744ae96b-036d-4df6-a30a-a05841d52723 req-a2417ca5-9e8a-45a5-a3ed-9a5ce62a3501 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:19.105788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-744ae96b-036d-4df6-a30a-a05841d52723 req-a2417ca5-9e8a-45a5-a3ed-9a5ce62a3501 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:19.124088 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-744ae96b-036d-4df6-a30a-a05841d52723 req-a2417ca5-9e8a-45a5-a3ed-9a5ce62a3501 service nova] Creating event network-changed:f5d87996-dbb7-41f9-91cf-13dd283033a8 for instance 73b3e1c0-3109-4dbc-be56-f909f76fd613 on nch1-master-1 Sep 10 21:02:19.132782 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-744ae96b-036d-4df6-a30a-a05841d52723 req-a2417ca5-9e8a-45a5-a3ed-9a5ce62a3501 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047714 Sep 10 21:02:19.134721 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1937/3809] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:19.148230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e94b240b-e302-4cb1-885d-49382963812f req-b7c2b1b9-8299-431b-97e6-09f92358c395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02503ea6-e924-4967-83ad-59dbfbf3176d", "name": "network-vif-deleted", "tag": "1a5c21f2-ced8-4245-a6d6-bfee5a42b09c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:19.164601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e94b240b-e302-4cb1-885d-49382963812f req-b7c2b1b9-8299-431b-97e6-09f92358c395 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:19.165634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e94b240b-e302-4cb1-885d-49382963812f req-b7c2b1b9-8299-431b-97e6-09f92358c395 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:19.166974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e94b240b-e302-4cb1-885d-49382963812f req-b7c2b1b9-8299-431b-97e6-09f92358c395 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:19.185529 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e94b240b-e302-4cb1-885d-49382963812f req-b7c2b1b9-8299-431b-97e6-09f92358c395 service nova] Creating event network-vif-deleted:1a5c21f2-ced8-4245-a6d6-bfee5a42b09c for instance 02503ea6-e924-4967-83ad-59dbfbf3176d on nch1-master-1 Sep 10 21:02:19.221942 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e94b240b-e302-4cb1-885d-49382963812f req-b7c2b1b9-8299-431b-97e6-09f92358c395 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072460 Sep 10 21:02:19.225167 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1938/3810] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:19.258428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-89086ebd-48de-43f4-8010-193058de57df tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:19.260273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-89086ebd-48de-43f4-8010-193058de57df tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:19.270422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89086ebd-48de-43f4-8010-193058de57df tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:19.272802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89086ebd-48de-43f4-8010-193058de57df tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:19.282274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89086ebd-48de-43f4-8010-193058de57df tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:19.287170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89086ebd-48de-43f4-8010-193058de57df tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:19.290061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89086ebd-48de-43f4-8010-193058de57df tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:19.299367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89086ebd-48de-43f4-8010-193058de57df tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:19.426351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-89086ebd-48de-43f4-8010-193058de57df tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9b59fb1a184b958ea619062412cf2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243cfbc91bb24e7ca96f348cd21f1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:19.444088 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-89086ebd-48de-43f4-8010-193058de57df tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 200 len: 1306 microversion: 2.1 time: 0.198027 Sep 10 21:02:19.445815 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1939/3811] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:19 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 1306 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:19.459917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:19.460911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:19.468135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:19.469301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:19.470936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:19.471958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:19.472661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:19.473619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:19.601905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-35b09e9e-9b94-45a8-9538-f6041f6b7da4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:19.614071 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-35b09e9e-9b94-45a8-9538-f6041f6b7da4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1280 microversion: 2.1 time: 1.167095 Sep 10 21:02:19.623290 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1873/3812] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:18 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1280 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:20.113717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:20.119631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c69e3be3-56fe-4fc4-a305-376701816d1f tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:20.126450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c69e3be3-56fe-4fc4-a305-376701816d1f tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:20.149872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:20.152139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c69e3be3-56fe-4fc4-a305-376701816d1f tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:20.152792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c69e3be3-56fe-4fc4-a305-376701816d1f tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:20.153324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c69e3be3-56fe-4fc4-a305-376701816d1f tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:20.155993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:20.159013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c69e3be3-56fe-4fc4-a305-376701816d1f tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:20.159657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c69e3be3-56fe-4fc4-a305-376701816d1f tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:20.160193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c69e3be3-56fe-4fc4-a305-376701816d1f tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:20.164990 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-01acc5a3-7a1f-49fe-ba73-e0852554e15b tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2826 microversion: 2.32 time: 0.709761 Sep 10 21:02:20.169061 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1940/3813] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:02:19 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2826 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:02:20.210110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2cf9b807-6af5-48d7-9447-96ee9ec22c40 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:20.210733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2cf9b807-6af5-48d7-9447-96ee9ec22c40 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:20.226257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cf9b807-6af5-48d7-9447-96ee9ec22c40 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:20.226962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cf9b807-6af5-48d7-9447-96ee9ec22c40 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:20.236215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cf9b807-6af5-48d7-9447-96ee9ec22c40 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:20.239660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cf9b807-6af5-48d7-9447-96ee9ec22c40 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:20.240292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cf9b807-6af5-48d7-9447-96ee9ec22c40 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:20.245482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cf9b807-6af5-48d7-9447-96ee9ec22c40 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:20.864484 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2cf9b807-6af5-48d7-9447-96ee9ec22c40 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.662637 Sep 10 21:02:20.867894 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1941/3814] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Sep 10 21:02:20 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f/os-interface => generated 1831 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:02:20.875298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:20.876159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] [instance: 02503ea6-e924-4967-83ad-59dbfbf3176d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:20.880453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c69e3be3-56fe-4fc4-a305-376701816d1f tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:20.892777 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c69e3be3-56fe-4fc4-a305-376701816d1f tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1351 microversion: 2.1 time: 0.785611 Sep 10 21:02:20.899190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:20.899723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:20.900172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:20.900907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:20.901372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:20.901807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:20.917498 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1874/3815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:20 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1351 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:20.927676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f229f3d1-52a6-47db-9503-c271802d459c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:20.928594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f229f3d1-52a6-47db-9503-c271802d459c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:20.935172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f229f3d1-52a6-47db-9503-c271802d459c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:20.936398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f229f3d1-52a6-47db-9503-c271802d459c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:20.937773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f229f3d1-52a6-47db-9503-c271802d459c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:20.938769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f229f3d1-52a6-47db-9503-c271802d459c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:20.939609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f229f3d1-52a6-47db-9503-c271802d459c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:20.940262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f229f3d1-52a6-47db-9503-c271802d459c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:20.940582 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] HTTP exception thrown: Instance 02503ea6-e924-4967-83ad-59dbfbf3176d could not be found. Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Request method failure captured: Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d HTTP/1.1 Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPrn6G6_EZdtOKJ9h6PnhceyP2k_jTvlI-MZCpp6NDrtyGRLvTeqlbJId5JKOhxxsWhTvmjp7D-CgL97-V1KBTc9XrCJMv75oCPHNX4cgZbbkQeZMY_kXA_zfYN2zXDB6nbPvobTVHQKsgudyq7JNoSeD8tMSt0tJ08I5KhnW9dU7GM Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 243cfbc91bb24e7ca96f348cd21f1adb Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ListServerFiltersTestJSON-1610821138 Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/243cfbc91bb24e7ca96f348cd21f1adb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/243cfbc91bb24e7ca96f348cd21f1adb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_243cfbc91bb24e7ca96f348cd21f1adb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/243cfbc91bb24e7ca96f348cd21f1adb"}]}] Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ListServerFiltersTestJSON-1610821138 Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 243cfbc91bb24e7ca96f348cd21f1adb Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1610821138 Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ListServerFiltersTestJSON-1610821138-project Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9b9b59fb1a184b958ea619062412cf2d Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ListServerFiltersTestJSON-1610821138-project Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 02503ea6-e924-4967-83ad-59dbfbf3176d could not be found. Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '02503ea6-e924-4967-83ad-59dbfbf3176d'} Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02503ea6-e924-4967-83ad-59dbfbf3176d could not be found. Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02503ea6-e924-4967-83ad-59dbfbf3176d could not be found. Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:20.942533 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:20.947588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:20.947588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:20.947588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:20.947588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:20.947588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:20.947588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02503ea6-e924-4967-83ad-59dbfbf3176d could not be found. Sep 10 21:02:20.947588 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:20.947588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] Returning 404 to user: Instance 02503ea6-e924-4967-83ad-59dbfbf3176d could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:20.947588 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0196da71-fd4e-41fc-b12e-d8208b32d346 tempest-ListServerFiltersTestJSON-1610821138 tempest-ListServerFiltersTestJSON-1610821138-project] 10.222.0.33 "GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d" status: 404 len: 111 microversion: 2.1 time: 0.074219 Sep 10 21:02:20.949022 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1942/3816] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:20 2022] GET /compute/v2.1/servers/02503ea6-e924-4967-83ad-59dbfbf3176d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:21.229102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f229f3d1-52a6-47db-9503-c271802d459c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:21.242883 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f229f3d1-52a6-47db-9503-c271802d459c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1278 microversion: 2.1 time: 0.323282 Sep 10 21:02:21.248019 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1875/3817] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:20 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1278 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:21.405965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1357778916", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f5a2cd59-1be7-47bd-82a5-e6307d510b6e"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:21.502342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] validate_networks() for [('f5a2cd59-1be7-47bd-82a5-e6307d510b6e', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:02:21.924994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dbebad5a-2fc9-467b-9d6e-61257627fac8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:21.926538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dbebad5a-2fc9-467b-9d6e-61257627fac8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:21.944274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbebad5a-2fc9-467b-9d6e-61257627fac8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:21.944978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbebad5a-2fc9-467b-9d6e-61257627fac8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:21.947212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbebad5a-2fc9-467b-9d6e-61257627fac8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:21.957744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbebad5a-2fc9-467b-9d6e-61257627fac8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:21.960792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbebad5a-2fc9-467b-9d6e-61257627fac8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:21.979012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbebad5a-2fc9-467b-9d6e-61257627fac8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:22.792591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dbebad5a-2fc9-467b-9d6e-61257627fac8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:22.808918 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dbebad5a-2fc9-467b-9d6e-61257627fac8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1351 microversion: 2.1 time: 0.891707 Sep 10 21:02:22.809903 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1876/3818] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:21 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1351 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:22.820525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55d558bc-c87d-463c-87ac-0d4edd734e7e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:22.821152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55d558bc-c87d-463c-87ac-0d4edd734e7e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:22.836232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55d558bc-c87d-463c-87ac-0d4edd734e7e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:22.839033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55d558bc-c87d-463c-87ac-0d4edd734e7e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:22.839509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55d558bc-c87d-463c-87ac-0d4edd734e7e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:22.844203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55d558bc-c87d-463c-87ac-0d4edd734e7e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:22.845414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55d558bc-c87d-463c-87ac-0d4edd734e7e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:22.846075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55d558bc-c87d-463c-87ac-0d4edd734e7e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:23.053096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:02:23.053701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:02:23.054151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:02:23.056252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:02:23.056697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:02:23.106348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:23.107052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:23.107674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:23.109528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:23.114863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:23.115647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:23.128216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=15 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:23.142053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:02:23.158139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for user 4faa458c158141efaf707317411cd544 and project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:02:23.180949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:02:23.185128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:02:23.271708 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3e74386b-b378-4c67-9dbc-80769d4b4692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.068677 Sep 10 21:02:23.273068 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1943/3819] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:02:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:02:23.285010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0e11d1b2-434f-4544-9f13-357b45bab274 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:23.290631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0e11d1b2-434f-4544-9f13-357b45bab274 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:23.404377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-55d558bc-c87d-463c-87ac-0d4edd734e7e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:23.418139 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55d558bc-c87d-463c-87ac-0d4edd734e7e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1278 microversion: 2.1 time: 0.606864 Sep 10 21:02:23.422809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1877/3820] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:22 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1278 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:23.641241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0e11d1b2-434f-4544-9f13-357b45bab274 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:23.661012 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0e11d1b2-434f-4544-9f13-357b45bab274 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1215 microversion: 2.1 time: 0.379918 Sep 10 21:02:23.684245 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1944/3821] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:23 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1215 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:23.839370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be1bac93-ecf4-436d-be5f-3164318e4d6c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:23.839995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-be1bac93-ecf4-436d-be5f-3164318e4d6c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:23.867220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be1bac93-ecf4-436d-be5f-3164318e4d6c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:23.867943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be1bac93-ecf4-436d-be5f-3164318e4d6c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:23.868405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be1bac93-ecf4-436d-be5f-3164318e4d6c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:23.869168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be1bac93-ecf4-436d-be5f-3164318e4d6c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:23.869630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be1bac93-ecf4-436d-be5f-3164318e4d6c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:23.870092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be1bac93-ecf4-436d-be5f-3164318e4d6c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:24.449166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ecf4949f-7e71-460c-b8f2-b426187d925a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:24.450593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ecf4949f-7e71-460c-b8f2-b426187d925a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:24.471521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecf4949f-7e71-460c-b8f2-b426187d925a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:24.473548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecf4949f-7e71-460c-b8f2-b426187d925a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:24.474711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecf4949f-7e71-460c-b8f2-b426187d925a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:24.481246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecf4949f-7e71-460c-b8f2-b426187d925a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:24.485069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecf4949f-7e71-460c-b8f2-b426187d925a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:24.488667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecf4949f-7e71-460c-b8f2-b426187d925a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:24.583116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:25.028585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ecf4949f-7e71-460c-b8f2-b426187d925a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:25.042787 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ecf4949f-7e71-460c-b8f2-b426187d925a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1278 microversion: 2.1 time: 0.595646 Sep 10 21:02:25.054779 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1945/3822] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:24 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1278 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:25.080571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-af49c47b-c76c-4d04-bb28-16e49839ebc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:25.082699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-af49c47b-c76c-4d04-bb28-16e49839ebc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:25.113313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af49c47b-c76c-4d04-bb28-16e49839ebc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:25.117292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af49c47b-c76c-4d04-bb28-16e49839ebc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:25.119130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af49c47b-c76c-4d04-bb28-16e49839ebc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:25.122438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af49c47b-c76c-4d04-bb28-16e49839ebc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:25.123219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af49c47b-c76c-4d04-bb28-16e49839ebc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:25.125182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af49c47b-c76c-4d04-bb28-16e49839ebc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:25.171824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:25.452979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-be1bac93-ecf4-436d-be5f-3164318e4d6c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:25.463814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-af49c47b-c76c-4d04-bb28-16e49839ebc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:25.479875 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be1bac93-ecf4-436d-be5f-3164318e4d6c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1351 microversion: 2.1 time: 1.643931 Sep 10 21:02:25.500005 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-af49c47b-c76c-4d04-bb28-16e49839ebc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1267 microversion: 2.1 time: 0.438654 Sep 10 21:02:25.500996 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1946/3823] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:25 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1267 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:25.533002 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1878/3824] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:23 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1351 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:26.072372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-762721b7-a184-428e-ae9b-32058d494372 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:26.073607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-762721b7-a184-428e-ae9b-32058d494372 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:26.098150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762721b7-a184-428e-ae9b-32058d494372 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:26.099326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762721b7-a184-428e-ae9b-32058d494372 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:26.101192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762721b7-a184-428e-ae9b-32058d494372 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:26.108232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762721b7-a184-428e-ae9b-32058d494372 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:26.115706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762721b7-a184-428e-ae9b-32058d494372 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:26.116641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762721b7-a184-428e-ae9b-32058d494372 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:26.520723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=10 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:26.526774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27f76578-32b3-4656-b14f-ebc0e63fe833 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:26.527654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-27f76578-32b3-4656-b14f-ebc0e63fe833 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:26.543336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f76578-32b3-4656-b14f-ebc0e63fe833 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:26.544027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f76578-32b3-4656-b14f-ebc0e63fe833 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:26.544483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f76578-32b3-4656-b14f-ebc0e63fe833 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:26.545755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f76578-32b3-4656-b14f-ebc0e63fe833 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:26.546263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f76578-32b3-4656-b14f-ebc0e63fe833 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:26.546858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f76578-32b3-4656-b14f-ebc0e63fe833 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:27.309795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-762721b7-a184-428e-ae9b-32058d494372 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:27.322219 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-762721b7-a184-428e-ae9b-32058d494372 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1320 microversion: 2.1 time: 1.258808 Sep 10 21:02:27.322891 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1947/3825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:26 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1320 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:27.328232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ce49bb65-61eb-4372-9ff7-b421807b569a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:27.328843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ce49bb65-61eb-4372-9ff7-b421807b569a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:27.350568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce49bb65-61eb-4372-9ff7-b421807b569a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:27.351095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce49bb65-61eb-4372-9ff7-b421807b569a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:27.354442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce49bb65-61eb-4372-9ff7-b421807b569a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:27.355251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce49bb65-61eb-4372-9ff7-b421807b569a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:27.355923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce49bb65-61eb-4372-9ff7-b421807b569a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:27.356580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce49bb65-61eb-4372-9ff7-b421807b569a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:27.539649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27f76578-32b3-4656-b14f-ebc0e63fe833 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:27.555654 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27f76578-32b3-4656-b14f-ebc0e63fe833 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1351 microversion: 2.1 time: 1.035563 Sep 10 21:02:27.574325 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1879/3826] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:26 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1351 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:27.599192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ce49bb65-61eb-4372-9ff7-b421807b569a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:27.612849 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ce49bb65-61eb-4372-9ff7-b421807b569a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1273 microversion: 2.1 time: 0.287166 Sep 10 21:02:27.613634 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1948/3827] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:27 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:27.856291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-fb39c0a7-b5a3-403d-a5bd-b52fcdc843f0 req-190cb1e8-25a1-4b95-8f56-b42fd3af40ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "tag": "927c985e-c5fa-49ba-ad56-493d19eca859"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:27.873642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fb39c0a7-b5a3-403d-a5bd-b52fcdc843f0 req-190cb1e8-25a1-4b95-8f56-b42fd3af40ba service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:27.876747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fb39c0a7-b5a3-403d-a5bd-b52fcdc843f0 req-190cb1e8-25a1-4b95-8f56-b42fd3af40ba service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:27.878738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fb39c0a7-b5a3-403d-a5bd-b52fcdc843f0 req-190cb1e8-25a1-4b95-8f56-b42fd3af40ba service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:27.902534 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-fb39c0a7-b5a3-403d-a5bd-b52fcdc843f0 req-190cb1e8-25a1-4b95-8f56-b42fd3af40ba service nova] Creating event network-changed:927c985e-c5fa-49ba-ad56-493d19eca859 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:02:27.911308 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-fb39c0a7-b5a3-403d-a5bd-b52fcdc843f0 req-190cb1e8-25a1-4b95-8f56-b42fd3af40ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059483 Sep 10 21:02:27.912698 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1880/3828] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:28.224011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-02d0244c-cafe-4ab2-85d9-7e077c968ef1 req-11e91b25-f589-4093-abc2-fc05e6a63671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b3e1c0-3109-4dbc-be56-f909f76fd613", "name": "network-vif-plugged", "status": "completed", "tag": "f5d87996-dbb7-41f9-91cf-13dd283033a8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:28.254890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-02d0244c-cafe-4ab2-85d9-7e077c968ef1 req-11e91b25-f589-4093-abc2-fc05e6a63671 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:28.258430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-02d0244c-cafe-4ab2-85d9-7e077c968ef1 req-11e91b25-f589-4093-abc2-fc05e6a63671 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:28.260409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-02d0244c-cafe-4ab2-85d9-7e077c968ef1 req-11e91b25-f589-4093-abc2-fc05e6a63671 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:28.296106 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-02d0244c-cafe-4ab2-85d9-7e077c968ef1 req-11e91b25-f589-4093-abc2-fc05e6a63671 service nova] Creating event network-vif-plugged:f5d87996-dbb7-41f9-91cf-13dd283033a8 for instance 73b3e1c0-3109-4dbc-be56-f909f76fd613 on nch1-master-1 Sep 10 21:02:28.313488 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-02d0244c-cafe-4ab2-85d9-7e077c968ef1 req-11e91b25-f589-4093-abc2-fc05e6a63671 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094175 Sep 10 21:02:28.317112 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1949/3829] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:28.352669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-219c9b57-514e-4e43-b26b-206dbe5441c4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:28.353314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-219c9b57-514e-4e43-b26b-206dbe5441c4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:28.364325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-219c9b57-514e-4e43-b26b-206dbe5441c4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:28.364830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-219c9b57-514e-4e43-b26b-206dbe5441c4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:28.365284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-219c9b57-514e-4e43-b26b-206dbe5441c4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:28.370946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-219c9b57-514e-4e43-b26b-206dbe5441c4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:28.371545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-219c9b57-514e-4e43-b26b-206dbe5441c4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:28.372722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-219c9b57-514e-4e43-b26b-206dbe5441c4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:28.586279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93a53827-93e2-4838-9757-06d161b230f1 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:28.587014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-93a53827-93e2-4838-9757-06d161b230f1 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:28.604340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:28.626416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93a53827-93e2-4838-9757-06d161b230f1 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:28.627671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93a53827-93e2-4838-9757-06d161b230f1 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:28.628131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93a53827-93e2-4838-9757-06d161b230f1 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:28.633499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93a53827-93e2-4838-9757-06d161b230f1 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:28.634061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93a53827-93e2-4838-9757-06d161b230f1 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:28.634526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93a53827-93e2-4838-9757-06d161b230f1 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:29.214552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-219c9b57-514e-4e43-b26b-206dbe5441c4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:29.236118 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-219c9b57-514e-4e43-b26b-206dbe5441c4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1320 microversion: 2.1 time: 0.889011 Sep 10 21:02:29.237150 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1881/3830] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:28 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1320 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:29.243579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a43db72e-646a-4254-942a-e69986ccda9a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:29.244623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a43db72e-646a-4254-942a-e69986ccda9a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:29.254104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43db72e-646a-4254-942a-e69986ccda9a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:29.254608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43db72e-646a-4254-942a-e69986ccda9a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:29.255056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43db72e-646a-4254-942a-e69986ccda9a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:29.256133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43db72e-646a-4254-942a-e69986ccda9a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:29.256605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43db72e-646a-4254-942a-e69986ccda9a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:29.258429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43db72e-646a-4254-942a-e69986ccda9a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:29.600711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93a53827-93e2-4838-9757-06d161b230f1 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:29.617687 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93a53827-93e2-4838-9757-06d161b230f1 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1351 microversion: 2.1 time: 1.037786 Sep 10 21:02:29.621562 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1950/3831] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:28 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1351 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:30.262192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c291c89-a598-4e08-9498-0b63b95ed2f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:30.262927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c291c89-a598-4e08-9498-0b63b95ed2f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:30.270286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c291c89-a598-4e08-9498-0b63b95ed2f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:30.271171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c291c89-a598-4e08-9498-0b63b95ed2f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:30.271844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c291c89-a598-4e08-9498-0b63b95ed2f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:30.273484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c291c89-a598-4e08-9498-0b63b95ed2f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:30.274239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c291c89-a598-4e08-9498-0b63b95ed2f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:30.274909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c291c89-a598-4e08-9498-0b63b95ed2f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:30.328897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a43db72e-646a-4254-942a-e69986ccda9a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:30.341661 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a43db72e-646a-4254-942a-e69986ccda9a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1315 microversion: 2.1 time: 1.102515 Sep 10 21:02:30.343353 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1882/3832] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:29 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1315 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:30.548261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e96ce56b-02aa-4cac-8761-99987b3670a1 req-2db19ef6-95b2-4a3b-adfa-edafd89b7a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9", "tag": "7706df87-5ef4-41af-b422-569f5c345cdf"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:30.575005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e96ce56b-02aa-4cac-8761-99987b3670a1 req-2db19ef6-95b2-4a3b-adfa-edafd89b7a58 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:30.575750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e96ce56b-02aa-4cac-8761-99987b3670a1 req-2db19ef6-95b2-4a3b-adfa-edafd89b7a58 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:30.576976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e96ce56b-02aa-4cac-8761-99987b3670a1 req-2db19ef6-95b2-4a3b-adfa-edafd89b7a58 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:30.591585 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e96ce56b-02aa-4cac-8761-99987b3670a1 req-2db19ef6-95b2-4a3b-adfa-edafd89b7a58 service nova] Creating event network-changed:7706df87-5ef4-41af-b422-569f5c345cdf for instance 6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9 on nch2-master-1 Sep 10 21:02:30.604997 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e96ce56b-02aa-4cac-8761-99987b3670a1 req-2db19ef6-95b2-4a3b-adfa-edafd89b7a58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069222 Sep 10 21:02:30.606342 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1883/3833] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:02:30.648199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-36174474-c245-4cfb-ba17-c94fdae2e2b8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:30.649536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-36174474-c245-4cfb-ba17-c94fdae2e2b8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:30.658925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36174474-c245-4cfb-ba17-c94fdae2e2b8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:30.659937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36174474-c245-4cfb-ba17-c94fdae2e2b8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:30.660803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36174474-c245-4cfb-ba17-c94fdae2e2b8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:30.661624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36174474-c245-4cfb-ba17-c94fdae2e2b8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:30.662503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36174474-c245-4cfb-ba17-c94fdae2e2b8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:30.663483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36174474-c245-4cfb-ba17-c94fdae2e2b8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:30.697471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:31.278432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-36174474-c245-4cfb-ba17-c94fdae2e2b8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:31.292482 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-36174474-c245-4cfb-ba17-c94fdae2e2b8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1351 microversion: 2.1 time: 0.647768 Sep 10 21:02:31.294156 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1884/3834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:30 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1351 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:31.369926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62ffd688-9653-4a8b-9435-17b1dabc172a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:31.372786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62ffd688-9653-4a8b-9435-17b1dabc172a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:31.384124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ffd688-9653-4a8b-9435-17b1dabc172a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:31.385680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ffd688-9653-4a8b-9435-17b1dabc172a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:31.386442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ffd688-9653-4a8b-9435-17b1dabc172a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:31.388193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ffd688-9653-4a8b-9435-17b1dabc172a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:31.389502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ffd688-9653-4a8b-9435-17b1dabc172a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:31.390246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ffd688-9653-4a8b-9435-17b1dabc172a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:31.419847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c291c89-a598-4e08-9498-0b63b95ed2f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:31.434312 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c291c89-a598-4e08-9498-0b63b95ed2f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1320 microversion: 2.1 time: 1.175249 Sep 10 21:02:31.441456 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1951/3835] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:30 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1320 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:32.247613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-62ffd688-9653-4a8b-9435-17b1dabc172a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:32.263046 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62ffd688-9653-4a8b-9435-17b1dabc172a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1315 microversion: 2.1 time: 0.899638 Sep 10 21:02:32.265530 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1885/3836] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:31 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1315 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:32.318888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb61786b-fe65-4e97-ad85-86dfa44f0258 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:32.319586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bb61786b-fe65-4e97-ad85-86dfa44f0258 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:32.338562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb61786b-fe65-4e97-ad85-86dfa44f0258 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:32.340105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb61786b-fe65-4e97-ad85-86dfa44f0258 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:32.340561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb61786b-fe65-4e97-ad85-86dfa44f0258 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:32.341302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb61786b-fe65-4e97-ad85-86dfa44f0258 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:32.344503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb61786b-fe65-4e97-ad85-86dfa44f0258 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:32.345665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb61786b-fe65-4e97-ad85-86dfa44f0258 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:32.469157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fdee2ff0-871d-4ade-ae43-51da32cc5e3e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:32.470587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fdee2ff0-871d-4ade-ae43-51da32cc5e3e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:32.481365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdee2ff0-871d-4ade-ae43-51da32cc5e3e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:32.481978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdee2ff0-871d-4ade-ae43-51da32cc5e3e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:32.485222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdee2ff0-871d-4ade-ae43-51da32cc5e3e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:32.486317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdee2ff0-871d-4ade-ae43-51da32cc5e3e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:32.487758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdee2ff0-871d-4ade-ae43-51da32cc5e3e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:32.489498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fdee2ff0-871d-4ade-ae43-51da32cc5e3e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:32.882533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bb61786b-fe65-4e97-ad85-86dfa44f0258 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:32.899478 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bb61786b-fe65-4e97-ad85-86dfa44f0258 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1541 microversion: 2.1 time: 0.583129 Sep 10 21:02:32.904861 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1952/3837] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:32 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1541 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:32.914998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7aefd283-f3e8-414b-a309-dd721c0ec159 req-344136bb-71b0-4938-ba61-be917644c4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "001b620b-0084-42b3-a0c3-a2a50427fcf9", "tag": "20e5f4b8-1f3f-4d2a-b711-e4e314166835"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:32.938110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7aefd283-f3e8-414b-a309-dd721c0ec159 req-344136bb-71b0-4938-ba61-be917644c4f0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:32.939121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7aefd283-f3e8-414b-a309-dd721c0ec159 req-344136bb-71b0-4938-ba61-be917644c4f0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:32.940724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7aefd283-f3e8-414b-a309-dd721c0ec159 req-344136bb-71b0-4938-ba61-be917644c4f0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:32.964209 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7aefd283-f3e8-414b-a309-dd721c0ec159 req-344136bb-71b0-4938-ba61-be917644c4f0 service nova] Creating event network-changed:20e5f4b8-1f3f-4d2a-b711-e4e314166835 for instance 001b620b-0084-42b3-a0c3-a2a50427fcf9 on nch1-master-1 Sep 10 21:02:32.976940 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7aefd283-f3e8-414b-a309-dd721c0ec159 req-344136bb-71b0-4938-ba61-be917644c4f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068497 Sep 10 21:02:32.979078 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1953/3838] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:32.994850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-78278757-8fe1-40ec-8a51-85cada515bad tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:32.995768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-78278757-8fe1-40ec-8a51-85cada515bad tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:33.039046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78278757-8fe1-40ec-8a51-85cada515bad tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:33.039974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78278757-8fe1-40ec-8a51-85cada515bad tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:33.044668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fdee2ff0-871d-4ade-ae43-51da32cc5e3e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:33.055761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78278757-8fe1-40ec-8a51-85cada515bad tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:33.058061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78278757-8fe1-40ec-8a51-85cada515bad tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:33.059066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78278757-8fe1-40ec-8a51-85cada515bad tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:33.059843 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fdee2ff0-871d-4ade-ae43-51da32cc5e3e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1320 microversion: 2.1 time: 0.594922 Sep 10 21:02:33.061358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78278757-8fe1-40ec-8a51-85cada515bad tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:33.063470 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1886/3839] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:32 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1320 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:33.161583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:33.174408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-424246f5-3d0d-4e18-bedf-d878c65b0552 req-b5b54818-0857-48bd-83b7-eeafdb00d178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96eb8dae-5750-4fc2-b074-1fff3a5de31e", "tag": "e4ace8d4-a4cb-403a-a0c8-241a19ac7219"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:33.195913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-424246f5-3d0d-4e18-bedf-d878c65b0552 req-b5b54818-0857-48bd-83b7-eeafdb00d178 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:33.198671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-424246f5-3d0d-4e18-bedf-d878c65b0552 req-b5b54818-0857-48bd-83b7-eeafdb00d178 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:33.199451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-424246f5-3d0d-4e18-bedf-d878c65b0552 req-b5b54818-0857-48bd-83b7-eeafdb00d178 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:33.214828 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-424246f5-3d0d-4e18-bedf-d878c65b0552 req-b5b54818-0857-48bd-83b7-eeafdb00d178 service nova] Creating event network-changed:e4ace8d4-a4cb-403a-a0c8-241a19ac7219 for instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e on nch2-master-1 Sep 10 21:02:33.220187 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-424246f5-3d0d-4e18-bedf-d878c65b0552 req-b5b54818-0857-48bd-83b7-eeafdb00d178 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052051 Sep 10 21:02:33.221374 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1887/3840] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:02:33.290564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dd2213d7-bf79-4c72-a10a-1c5a452920d9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:33.291652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dd2213d7-bf79-4c72-a10a-1c5a452920d9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:33.300051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd2213d7-bf79-4c72-a10a-1c5a452920d9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:33.301052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd2213d7-bf79-4c72-a10a-1c5a452920d9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:33.301760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd2213d7-bf79-4c72-a10a-1c5a452920d9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:33.302794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd2213d7-bf79-4c72-a10a-1c5a452920d9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:33.303490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd2213d7-bf79-4c72-a10a-1c5a452920d9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:33.304200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd2213d7-bf79-4c72-a10a-1c5a452920d9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:33.478459 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-78278757-8fe1-40ec-8a51-85cada515bad tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.496181 Sep 10 21:02:33.479319 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1954/3841] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:02:32 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613/os-interface => generated 284 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:33.686891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dd2213d7-bf79-4c72-a10a-1c5a452920d9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:33.699087 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dd2213d7-bf79-4c72-a10a-1c5a452920d9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1315 microversion: 2.1 time: 0.412623 Sep 10 21:02:33.700902 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1888/3842] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:33 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:34.093921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0caffbda-ca0b-4dff-8cd9-a635354d256e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:34.094773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0caffbda-ca0b-4dff-8cd9-a635354d256e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:34.102074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=14 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:34.105202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caffbda-ca0b-4dff-8cd9-a635354d256e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:34.105859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caffbda-ca0b-4dff-8cd9-a635354d256e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:34.106441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caffbda-ca0b-4dff-8cd9-a635354d256e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:34.108106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caffbda-ca0b-4dff-8cd9-a635354d256e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:34.116729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caffbda-ca0b-4dff-8cd9-a635354d256e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:34.117429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0caffbda-ca0b-4dff-8cd9-a635354d256e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:34.733714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1e12dbd8-24d9-4fb0-a4bf-1d3ee477a44d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:34.735142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e12dbd8-24d9-4fb0-a4bf-1d3ee477a44d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:34.752605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e12dbd8-24d9-4fb0-a4bf-1d3ee477a44d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:34.753423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e12dbd8-24d9-4fb0-a4bf-1d3ee477a44d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:34.761599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e12dbd8-24d9-4fb0-a4bf-1d3ee477a44d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:34.764280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e12dbd8-24d9-4fb0-a4bf-1d3ee477a44d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:34.765013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e12dbd8-24d9-4fb0-a4bf-1d3ee477a44d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:34.767007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e12dbd8-24d9-4fb0-a4bf-1d3ee477a44d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:35.562854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0caffbda-ca0b-4dff-8cd9-a635354d256e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:35.601545 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0caffbda-ca0b-4dff-8cd9-a635354d256e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1320 microversion: 2.1 time: 1.513076 Sep 10 21:02:35.621912 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1955/3843] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:34 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1320 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:35.958277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1e12dbd8-24d9-4fb0-a4bf-1d3ee477a44d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:35.972905 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1e12dbd8-24d9-4fb0-a4bf-1d3ee477a44d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1315 microversion: 2.1 time: 1.249269 Sep 10 21:02:35.976265 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1889/3844] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:34 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1315 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:36.001633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-66bda756-1ada-411e-ae26-df90cd6adff8 tempest-QuotasTestJSON-1042514520 tempest-QuotasTestJSON-1042514520-project] Calling method '.version_select at 0x7f993fc5d8b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:36.345468 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-66bda756-1ada-411e-ae26-df90cd6adff8 tempest-QuotasTestJSON-1042514520 tempest-QuotasTestJSON-1042514520-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/41b446a06aed49938ae24e5c69c5741a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.722265 Sep 10 21:02:36.346671 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1956/3845] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 21:02:35 2022] GET /compute/v2.1/os-quota-sets/41b446a06aed49938ae24e5c69c5741a/defaults => generated 371 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:36.360487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09a88d7c-f836-438f-9fcf-d3a3e38f2394 tempest-QuotasTestJSON-1042514520 tempest-QuotasTestJSON-1042514520-project] Calling method '.version_select at 0x7f99446365e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:36.530440 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09a88d7c-f836-438f-9fcf-d3a3e38f2394 tempest-QuotasTestJSON-1042514520 tempest-QuotasTestJSON-1042514520-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/41b446a06aed49938ae24e5c69c5741a" status: 200 len: 371 microversion: 2.1 time: 0.173548 Sep 10 21:02:36.532347 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1890/3846] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Sep 10 21:02:36 2022] GET /compute/v2.1/os-quota-sets/41b446a06aed49938ae24e5c69c5741a => generated 371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:36.549241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bf64f15e-e96a-4b14-a3ac-f55330414fb5 tempest-QuotasTestJSON-1042514520 tempest-QuotasTestJSON-1042514520-project] Calling method '.version_select at 0x7f99495b14c0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:36.627011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7032e542-684e-4d00-8166-4d2860f859f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:36.627948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7032e542-684e-4d00-8166-4d2860f859f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:36.637852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7032e542-684e-4d00-8166-4d2860f859f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:36.641021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7032e542-684e-4d00-8166-4d2860f859f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:36.643677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7032e542-684e-4d00-8166-4d2860f859f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:36.644655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7032e542-684e-4d00-8166-4d2860f859f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:36.646963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7032e542-684e-4d00-8166-4d2860f859f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:36.650372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7032e542-684e-4d00-8166-4d2860f859f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:36.660958 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bf64f15e-e96a-4b14-a3ac-f55330414fb5 tempest-QuotasTestJSON-1042514520 tempest-QuotasTestJSON-1042514520-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/41b446a06aed49938ae24e5c69c5741a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.118754 Sep 10 21:02:36.661724 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1957/3847] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 21:02:36 2022] GET /compute/v2.1/os-quota-sets/41b446a06aed49938ae24e5c69c5741a/defaults => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:36.676759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5fefabf6-65d5-47ef-91ec-a748b13ed357 tempest-QuotasTestJSON-1042514520 tempest-QuotasTestJSON-1042514520-project] Calling method '.version_select at 0x7f9949642310>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:36.770697 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5fefabf6-65d5-47ef-91ec-a748b13ed357 tempest-QuotasTestJSON-1042514520 tempest-QuotasTestJSON-1042514520-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/41b446a06aed49938ae24e5c69c5741a" status: 200 len: 371 microversion: 2.1 time: 0.097309 Sep 10 21:02:36.771932 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1958/3848] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Sep 10 21:02:36 2022] GET /compute/v2.1/os-quota-sets/41b446a06aed49938ae24e5c69c5741a => generated 371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:02:36.787895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39e10f3d-d1fc-4ce8-9d90-7cfcd55a207b tempest-QuotasTestJSON-1042514520 tempest-QuotasTestJSON-1042514520-project] Calling method '.version_select at 0x7f9944953c10>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:36.912906 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-39e10f3d-d1fc-4ce8-9d90-7cfcd55a207b tempest-QuotasTestJSON-1042514520 tempest-QuotasTestJSON-1042514520-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/41b446a06aed49938ae24e5c69c5741a?user_id=e3c9cfc67bb6497fa6ee77c1c7d98fbd" status: 200 len: 371 microversion: 2.1 time: 0.131906 Sep 10 21:02:36.914255 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1959/3849] 10.222.0.33 () {58 vars in 1323 bytes} [Sat Sep 10 21:02:36 2022] GET /compute/v2.1/os-quota-sets/41b446a06aed49938ae24e5c69c5741a?user_id=e3c9cfc67bb6497fa6ee77c1c7d98fbd => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:37.001268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4d71b957-80f3-4ff6-ad5e-91ff1511b189 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:37.001931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4d71b957-80f3-4ff6-ad5e-91ff1511b189 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:37.010732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d71b957-80f3-4ff6-ad5e-91ff1511b189 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:37.012424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d71b957-80f3-4ff6-ad5e-91ff1511b189 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:37.020098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d71b957-80f3-4ff6-ad5e-91ff1511b189 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:37.026308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d71b957-80f3-4ff6-ad5e-91ff1511b189 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:37.027085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d71b957-80f3-4ff6-ad5e-91ff1511b189 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:37.027702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d71b957-80f3-4ff6-ad5e-91ff1511b189 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:37.536448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7032e542-684e-4d00-8166-4d2860f859f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:37.565549 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7032e542-684e-4d00-8166-4d2860f859f6 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1320 microversion: 2.1 time: 0.939811 Sep 10 21:02:37.569622 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1891/3850] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:36 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1320 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:37.583750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4d71b957-80f3-4ff6-ad5e-91ff1511b189 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:37.601178 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4d71b957-80f3-4ff6-ad5e-91ff1511b189 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1315 microversion: 2.1 time: 0.604254 Sep 10 21:02:37.615239 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1960/3851] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:36 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:37.780423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-bd255ff7-ae72-460c-b47c-29abf8ad482a req-79c1f769-4ee0-4098-a6ca-5b1852124a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b3e1c0-3109-4dbc-be56-f909f76fd613", "tag": "f5d87996-dbb7-41f9-91cf-13dd283033a8"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:37.800825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bd255ff7-ae72-460c-b47c-29abf8ad482a req-79c1f769-4ee0-4098-a6ca-5b1852124a6e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:37.801246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bd255ff7-ae72-460c-b47c-29abf8ad482a req-79c1f769-4ee0-4098-a6ca-5b1852124a6e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:37.806624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bd255ff7-ae72-460c-b47c-29abf8ad482a req-79c1f769-4ee0-4098-a6ca-5b1852124a6e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:37.836544 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-bd255ff7-ae72-460c-b47c-29abf8ad482a req-79c1f769-4ee0-4098-a6ca-5b1852124a6e service nova] Creating event network-changed:f5d87996-dbb7-41f9-91cf-13dd283033a8 for instance 73b3e1c0-3109-4dbc-be56-f909f76fd613 on nch1-master-1 Sep 10 21:02:37.856903 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-bd255ff7-ae72-460c-b47c-29abf8ad482a req-79c1f769-4ee0-4098-a6ca-5b1852124a6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079329 Sep 10 21:02:37.863158 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1892/3852] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:38.593691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7304c89-9b59-4436-a382-4d487001c73a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:38.595197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b7304c89-9b59-4436-a382-4d487001c73a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:38.608992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7304c89-9b59-4436-a382-4d487001c73a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:38.612782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7304c89-9b59-4436-a382-4d487001c73a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:38.616033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7304c89-9b59-4436-a382-4d487001c73a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:38.617139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7304c89-9b59-4436-a382-4d487001c73a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:38.618105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7304c89-9b59-4436-a382-4d487001c73a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:38.629592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-82c76cb3-0818-476c-b8ac-60e5dfc5a1e8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:38.630987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-82c76cb3-0818-476c-b8ac-60e5dfc5a1e8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:38.636690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7304c89-9b59-4436-a382-4d487001c73a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:38.653589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c76cb3-0818-476c-b8ac-60e5dfc5a1e8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:38.662103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c76cb3-0818-476c-b8ac-60e5dfc5a1e8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:38.662919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c76cb3-0818-476c-b8ac-60e5dfc5a1e8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:38.667165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c76cb3-0818-476c-b8ac-60e5dfc5a1e8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:38.672911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c76cb3-0818-476c-b8ac-60e5dfc5a1e8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:38.673812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c76cb3-0818-476c-b8ac-60e5dfc5a1e8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:39.067219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7304c89-9b59-4436-a382-4d487001c73a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:39.083898 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b7304c89-9b59-4436-a382-4d487001c73a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1320 microversion: 2.1 time: 0.495687 Sep 10 21:02:39.089979 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1961/3853] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:38 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1320 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:39.688657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-82c76cb3-0818-476c-b8ac-60e5dfc5a1e8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:39.702929 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-82c76cb3-0818-476c-b8ac-60e5dfc5a1e8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1315 microversion: 2.1 time: 1.080056 Sep 10 21:02:39.718153 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1893/3854] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:38 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1315 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:39.735723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-bfcdff05-74c9-4455-b5f6-9abd40d358e4 req-a684ad10-48d7-42bc-8201-16a87fc7a857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001b620b-0084-42b3-a0c3-a2a50427fcf9", "name": "network-vif-plugged", "status": "completed", "tag": "20e5f4b8-1f3f-4d2a-b711-e4e314166835"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:39.758153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bfcdff05-74c9-4455-b5f6-9abd40d358e4 req-a684ad10-48d7-42bc-8201-16a87fc7a857 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:39.758635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bfcdff05-74c9-4455-b5f6-9abd40d358e4 req-a684ad10-48d7-42bc-8201-16a87fc7a857 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:39.759280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bfcdff05-74c9-4455-b5f6-9abd40d358e4 req-a684ad10-48d7-42bc-8201-16a87fc7a857 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:39.790223 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-bfcdff05-74c9-4455-b5f6-9abd40d358e4 req-a684ad10-48d7-42bc-8201-16a87fc7a857 service nova] Creating event network-vif-plugged:20e5f4b8-1f3f-4d2a-b711-e4e314166835 for instance 001b620b-0084-42b3-a0c3-a2a50427fcf9 on nch1-master-1 Sep 10 21:02:39.807043 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-bfcdff05-74c9-4455-b5f6-9abd40d358e4 req-a684ad10-48d7-42bc-8201-16a87fc7a857 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072899 Sep 10 21:02:39.807043 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1962/3855] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:40.114156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-799250c4-df47-4d5a-92fd-fb67e74de2cf tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:40.114991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-799250c4-df47-4d5a-92fd-fb67e74de2cf tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:40.125323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=89 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:40.133538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-799250c4-df47-4d5a-92fd-fb67e74de2cf tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:40.134155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-799250c4-df47-4d5a-92fd-fb67e74de2cf tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:40.134679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-799250c4-df47-4d5a-92fd-fb67e74de2cf tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:40.138045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-799250c4-df47-4d5a-92fd-fb67e74de2cf tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:40.139381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-799250c4-df47-4d5a-92fd-fb67e74de2cf tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:40.143696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-799250c4-df47-4d5a-92fd-fb67e74de2cf tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:40.475282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-799250c4-df47-4d5a-92fd-fb67e74de2cf tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:40.489078 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-799250c4-df47-4d5a-92fd-fb67e74de2cf tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1320 microversion: 2.1 time: 0.377702 Sep 10 21:02:40.490419 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1894/3856] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:40 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1320 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:40.507397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-77a14b29-0de9-4398-985d-224a0fe5448f tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Action: 'create', calling method: .version_select at 0x7f99496810d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1473875778"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:40.735341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cad2568b-cce6-489b-bf24-6c0d10b252a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:40.735961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cad2568b-cce6-489b-bf24-6c0d10b252a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:40.753103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad2568b-cce6-489b-bf24-6c0d10b252a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:40.754083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad2568b-cce6-489b-bf24-6c0d10b252a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:40.754816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad2568b-cce6-489b-bf24-6c0d10b252a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:40.755720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad2568b-cce6-489b-bf24-6c0d10b252a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:40.756348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad2568b-cce6-489b-bf24-6c0d10b252a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:40.757058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad2568b-cce6-489b-bf24-6c0d10b252a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:41.102718 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-77a14b29-0de9-4398-985d-224a0fe5448f tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.927749 Sep 10 21:02:41.111330 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1963/3857] 10.222.0.33 () {60 vars in 1155 bytes} [Sat Sep 10 21:02:40 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 931 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 10 21:02:41.126699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0b9a43c-7202-4fd4-95c2-158959eefabd tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f99448e49d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:41.133492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cad2568b-cce6-489b-bf24-6c0d10b252a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:41.145000 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cad2568b-cce6-489b-bf24-6c0d10b252a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1315 microversion: 2.1 time: 0.414259 Sep 10 21:02:41.148585 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1895/3858] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:40 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:41.259034 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0b9a43c-7202-4fd4-95c2-158959eefabd tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba" status: 200 len: 338 microversion: 2.1 time: 0.145127 Sep 10 21:02:41.266686 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1964/3859] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:02:41 2022] GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba => generated 338 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:41.517720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6823fcaa-e6b3-4b9e-8f81-c864a5c6e74f tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:41.518466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6823fcaa-e6b3-4b9e-8f81-c864a5c6e74f tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:41.531176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6823fcaa-e6b3-4b9e-8f81-c864a5c6e74f tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:41.532706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6823fcaa-e6b3-4b9e-8f81-c864a5c6e74f tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:41.534890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6823fcaa-e6b3-4b9e-8f81-c864a5c6e74f tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:41.536310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6823fcaa-e6b3-4b9e-8f81-c864a5c6e74f tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:41.537015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6823fcaa-e6b3-4b9e-8f81-c864a5c6e74f tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:41.539603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6823fcaa-e6b3-4b9e-8f81-c864a5c6e74f tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:41.913280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7cd20eac-f541-4817-be33-0d1ca1c79938 req-b3d0c79c-bb1f-43dd-8979-3bf5c3d2e4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9", "name": "network-vif-plugged", "status": "completed", "tag": "7706df87-5ef4-41af-b422-569f5c345cdf"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:41.940544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6823fcaa-e6b3-4b9e-8f81-c864a5c6e74f tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:41.946732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7cd20eac-f541-4817-be33-0d1ca1c79938 req-b3d0c79c-bb1f-43dd-8979-3bf5c3d2e4b9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:41.947241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7cd20eac-f541-4817-be33-0d1ca1c79938 req-b3d0c79c-bb1f-43dd-8979-3bf5c3d2e4b9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:41.947690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7cd20eac-f541-4817-be33-0d1ca1c79938 req-b3d0c79c-bb1f-43dd-8979-3bf5c3d2e4b9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:41.961532 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6823fcaa-e6b3-4b9e-8f81-c864a5c6e74f tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1320 microversion: 2.1 time: 0.449504 Sep 10 21:02:41.962647 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1896/3860] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:41 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:41.976484 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7cd20eac-f541-4817-be33-0d1ca1c79938 req-b3d0c79c-bb1f-43dd-8979-3bf5c3d2e4b9 service nova] Creating event network-vif-plugged:7706df87-5ef4-41af-b422-569f5c345cdf for instance 6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9 on nch2-master-1 Sep 10 21:02:41.999289 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7cd20eac-f541-4817-be33-0d1ca1c79938 req-b3d0c79c-bb1f-43dd-8979-3bf5c3d2e4b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097085 Sep 10 21:02:42.001513 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1965/3861] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:42.187065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1dbe7030-9779-4ecf-a7b0-34bc2daa4242 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:42.190391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1dbe7030-9779-4ecf-a7b0-34bc2daa4242 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:42.207017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dbe7030-9779-4ecf-a7b0-34bc2daa4242 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:42.207930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dbe7030-9779-4ecf-a7b0-34bc2daa4242 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:42.208579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dbe7030-9779-4ecf-a7b0-34bc2daa4242 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:42.209496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dbe7030-9779-4ecf-a7b0-34bc2daa4242 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:42.210852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dbe7030-9779-4ecf-a7b0-34bc2daa4242 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:42.211540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1dbe7030-9779-4ecf-a7b0-34bc2daa4242 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:42.278216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-275d1c70-a514-46f0-9a70-09337c96a7a4 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f9949681ca0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:42.386137 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-275d1c70-a514-46f0-9a70-09337c96a7a4 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba" status: 200 len: 339 microversion: 2.1 time: 0.114557 Sep 10 21:02:42.387395 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1966/3862] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:02:42 2022] GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba => generated 339 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:02:42.402686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5ab6e41-2ea1-4a40-ad39-85b30ef3fb2f tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Action: 'create', calling method: .version_select at 0x7f99448e4af0>, body: {"snapshot": {"volume_id": "9d0720c9-f80a-4617-956c-4f1cea08a2ba", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1687603644"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:42.626354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1dbe7030-9779-4ecf-a7b0-34bc2daa4242 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:42.653551 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1dbe7030-9779-4ecf-a7b0-34bc2daa4242 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1315 microversion: 2.1 time: 0.478623 Sep 10 21:02:42.657431 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1897/3863] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:42 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:42.829329 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5ab6e41-2ea1-4a40-ad39-85b30ef3fb2f tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.430989 Sep 10 21:02:42.837304 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1967/3864] 10.222.0.33 () {60 vars in 1162 bytes} [Sat Sep 10 21:02:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:42.842702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8604bcfd-1a3b-488b-8e37-a9b4923f7734 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f9944673af0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:42.981643 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8604bcfd-1a3b-488b-8e37-a9b4923f7734 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6" status: 200 len: 287 microversion: 2.1 time: 0.143389 Sep 10 21:02:42.983232 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1898/3865] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 21:02:42 2022] GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6 => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:42.996415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7225678d-3ce1-4310-b25d-27aa72d44bca tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:42.997495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7225678d-3ce1-4310-b25d-27aa72d44bca tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:43.000145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-71aa6995-231d-4f00-86a1-88e106b60d12 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f99448d94c0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:43.015826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7225678d-3ce1-4310-b25d-27aa72d44bca tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:43.023743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7225678d-3ce1-4310-b25d-27aa72d44bca tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:43.024737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7225678d-3ce1-4310-b25d-27aa72d44bca tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:43.027830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7225678d-3ce1-4310-b25d-27aa72d44bca tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:43.030439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7225678d-3ce1-4310-b25d-27aa72d44bca tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:43.031240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7225678d-3ce1-4310-b25d-27aa72d44bca tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:43.064591 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-71aa6995-231d-4f00-86a1-88e106b60d12 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.073092 Sep 10 21:02:43.072741 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1968/3866] 10.222.0.33 () {58 vars in 1140 bytes} [Sat Sep 10 21:02:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:43.078798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d4459d9-d402-485f-abd8-d520b3caa6ee tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f99448e4d30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:43.150674 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d4459d9-d402-485f-abd8-d520b3caa6ee tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6" status: 200 len: 287 microversion: 2.1 time: 0.077368 Sep 10 21:02:43.151925 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1969/3867] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 21:02:43 2022] GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:02:43.398985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7225678d-3ce1-4310-b25d-27aa72d44bca tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:43.414190 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7225678d-3ce1-4310-b25d-27aa72d44bca tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 200 len: 1507 microversion: 2.1 time: 0.421546 Sep 10 21:02:43.431031 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1899/3868] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:42 2022] GET /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:43.442854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e0ff1d0d-66fa-4170-84ea-4522b0aa0914 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:43.443756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e0ff1d0d-66fa-4170-84ea-4522b0aa0914 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:43.451862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0ff1d0d-66fa-4170-84ea-4522b0aa0914 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:43.452659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0ff1d0d-66fa-4170-84ea-4522b0aa0914 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:43.453206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0ff1d0d-66fa-4170-84ea-4522b0aa0914 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:43.454333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0ff1d0d-66fa-4170-84ea-4522b0aa0914 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:43.455122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0ff1d0d-66fa-4170-84ea-4522b0aa0914 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:43.456522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0ff1d0d-66fa-4170-84ea-4522b0aa0914 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:43.690705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-87a0e777-6699-46e2-aa93-45f66cd58ab5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:43.698342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-87a0e777-6699-46e2-aa93-45f66cd58ab5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:43.709187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a0e777-6699-46e2-aa93-45f66cd58ab5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:43.709964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a0e777-6699-46e2-aa93-45f66cd58ab5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:43.710675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a0e777-6699-46e2-aa93-45f66cd58ab5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:43.711827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a0e777-6699-46e2-aa93-45f66cd58ab5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:43.712695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a0e777-6699-46e2-aa93-45f66cd58ab5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:43.713469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87a0e777-6699-46e2-aa93-45f66cd58ab5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:43.938780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e0ff1d0d-66fa-4170-84ea-4522b0aa0914 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:43.953229 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e0ff1d0d-66fa-4170-84ea-4522b0aa0914 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9" status: 200 len: 1320 microversion: 2.1 time: 0.514472 Sep 10 21:02:43.955520 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1970/3869] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:43 2022] GET /compute/v2.1/servers/6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9 => generated 1320 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:44.215678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1434513523", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "98558582-a554-4294-98e1-61b13737370f"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:44.313036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] validate_networks() for [('98558582-a554-4294-98e1-61b13737370f', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:02:44.324080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87a0e777-6699-46e2-aa93-45f66cd58ab5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:44.338585 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-87a0e777-6699-46e2-aa93-45f66cd58ab5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1315 microversion: 2.1 time: 0.657986 Sep 10 21:02:44.339799 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1900/3870] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:43 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:44.345020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-34bef210-2cf8-41a2-9165-2047c25009f5 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f9944da6550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:44.408774 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-34bef210-2cf8-41a2-9165-2047c25009f5 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6" status: 200 len: 288 microversion: 2.1 time: 0.067448 Sep 10 21:02:44.411203 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1901/3871] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 21:02:44 2022] GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6 => generated 288 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:44.423984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-15f028b4-59cc-4014-8ae0-c83879b49c1d tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f993fb0c9d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:44.630483 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-15f028b4-59cc-4014-8ae0-c83879b49c1d tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6" status: 202 len: 0 microversion: 2.1 time: 0.207441 Sep 10 21:02:44.631796 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1902/3872] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Sep 10 21:02:44 2022] DELETE /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:02:44.637600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-cf75af10-1a91-49d7-a48e-df65798d5326 req-1ab7c0f8-543a-495d-a43a-ae9b49900d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96eb8dae-5750-4fc2-b074-1fff3a5de31e", "name": "network-vif-plugged", "status": "completed", "tag": "e4ace8d4-a4cb-403a-a0c8-241a19ac7219"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:44.650571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cf75af10-1a91-49d7-a48e-df65798d5326 req-1ab7c0f8-543a-495d-a43a-ae9b49900d72 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:44.651104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cf75af10-1a91-49d7-a48e-df65798d5326 req-1ab7c0f8-543a-495d-a43a-ae9b49900d72 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:44.651488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cf75af10-1a91-49d7-a48e-df65798d5326 req-1ab7c0f8-543a-495d-a43a-ae9b49900d72 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:44.670742 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cf75af10-1a91-49d7-a48e-df65798d5326 req-1ab7c0f8-543a-495d-a43a-ae9b49900d72 service nova] Creating event network-vif-plugged:e4ace8d4-a4cb-403a-a0c8-241a19ac7219 for instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e on nch2-master-1 Sep 10 21:02:44.678172 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-cf75af10-1a91-49d7-a48e-df65798d5326 req-1ab7c0f8-543a-495d-a43a-ae9b49900d72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043944 Sep 10 21:02:44.679189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1903/3873] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:44.690099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-544512e3-f214-4996-856c-2caf9dd58652 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f9944da6f70>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:44.776827 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-544512e3-f214-4996-856c-2caf9dd58652 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6" status: 200 len: 287 microversion: 2.1 time: 0.095999 Sep 10 21:02:44.777478 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1904/3874] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 21:02:44 2022] GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:44.979830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0a345270-517b-4f6d-b800-2856fa5922a8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:44.980689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0a345270-517b-4f6d-b800-2856fa5922a8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:45.001186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a345270-517b-4f6d-b800-2856fa5922a8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:45.002271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a345270-517b-4f6d-b800-2856fa5922a8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:45.007598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a345270-517b-4f6d-b800-2856fa5922a8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:45.008726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a345270-517b-4f6d-b800-2856fa5922a8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:45.009440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a345270-517b-4f6d-b800-2856fa5922a8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:45.010559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a345270-517b-4f6d-b800-2856fa5922a8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:45.121145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:02:45.123367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:02:45.124308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:02:45.124947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:02:45.126714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:02:45.156781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:45.173208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:45.174426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:45.175496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:45.176190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:45.176873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:45.228831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Getting quotas for project daa76318457c400b80564b1035b25633. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:02:45.239948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Getting quotas for user edef2887c6b741108da9b88745486339 and project daa76318457c400b80564b1035b25633. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:02:45.260666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:02:45.264269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:02:45.354683 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3982b285-cc9e-4e8d-9072-7b6875731ab5 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353856 Sep 10 21:02:45.356163 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1971/3875] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:02:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:02:45.378357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09d8472b-ebe1-444f-836d-920d25af6797 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:45.379426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09d8472b-ebe1-444f-836d-920d25af6797 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:45.400529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d8472b-ebe1-444f-836d-920d25af6797 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:45.400987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d8472b-ebe1-444f-836d-920d25af6797 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:45.401947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d8472b-ebe1-444f-836d-920d25af6797 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:45.403635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d8472b-ebe1-444f-836d-920d25af6797 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:45.406298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d8472b-ebe1-444f-836d-920d25af6797 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:45.410500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09d8472b-ebe1-444f-836d-920d25af6797 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:45.643916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09d8472b-ebe1-444f-836d-920d25af6797 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:45.666440 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09d8472b-ebe1-444f-836d-920d25af6797 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1315 microversion: 2.1 time: 0.303757 Sep 10 21:02:45.671248 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1972/3876] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:45 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:45.693084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49bdbf3f-d79b-4342-be5a-c9e7f9dd9021 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:45.694089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-49bdbf3f-d79b-4342-be5a-c9e7f9dd9021 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:45.806512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-49bdbf3f-d79b-4342-be5a-c9e7f9dd9021 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:45.844029 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-49bdbf3f-d79b-4342-be5a-c9e7f9dd9021 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1225 microversion: 2.1 time: 0.169637 Sep 10 21:02:45.845107 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1973/3877] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:45 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1225 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:45.853556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-23b3b512-298a-4d97-86e2-0f6aa7e68590 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f99448e4c10>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:45.906844 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-23b3b512-298a-4d97-86e2-0f6aa7e68590 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6" status: 200 len: 287 microversion: 2.1 time: 0.059799 Sep 10 21:02:45.908169 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1974/3878] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 21:02:45 2022] GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:45.983078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0a345270-517b-4f6d-b800-2856fa5922a8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:45.999861 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0a345270-517b-4f6d-b800-2856fa5922a8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9" status: 200 len: 1508 microversion: 2.1 time: 1.023971 Sep 10 21:02:46.009220 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1905/3879] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:44 2022] GET /compute/v2.1/servers/6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9 => generated 1508 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:46.037200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9fc8aede-2f84-4815-b1d4-eba191f37071 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:46.040146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9fc8aede-2f84-4815-b1d4-eba191f37071 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:46.053993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc8aede-2f84-4815-b1d4-eba191f37071 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:46.058079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc8aede-2f84-4815-b1d4-eba191f37071 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:46.058079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc8aede-2f84-4815-b1d4-eba191f37071 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:46.058079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc8aede-2f84-4815-b1d4-eba191f37071 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:46.058079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc8aede-2f84-4815-b1d4-eba191f37071 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:46.058079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc8aede-2f84-4815-b1d4-eba191f37071 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:46.142384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9fc8aede-2f84-4815-b1d4-eba191f37071 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:02:46.336831 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9fc8aede-2f84-4815-b1d4-eba191f37071 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9" status: 204 len: 0 microversion: 2.1 time: 0.311582 Sep 10 21:02:46.338204 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1975/3880] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:02:46 2022] DELETE /compute/v2.1/servers/6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:02:46.347340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-75f953e8-d54c-4a8c-9b76-39c6655ff244 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:46.348353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-75f953e8-d54c-4a8c-9b76-39c6655ff244 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:46.361570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f953e8-d54c-4a8c-9b76-39c6655ff244 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:46.366099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f953e8-d54c-4a8c-9b76-39c6655ff244 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:46.366916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f953e8-d54c-4a8c-9b76-39c6655ff244 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:46.368507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f953e8-d54c-4a8c-9b76-39c6655ff244 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:46.369597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f953e8-d54c-4a8c-9b76-39c6655ff244 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:46.370398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75f953e8-d54c-4a8c-9b76-39c6655ff244 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:46.471414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-75f953e8-d54c-4a8c-9b76-39c6655ff244 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 001b620b-0084-42b3-a0c3-a2a50427fcf9] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:02:46.524704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:46.555009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:46.619499 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-75f953e8-d54c-4a8c-9b76-39c6655ff244 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "DELETE /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9" status: 204 len: 0 microversion: 2.1 time: 0.276609 Sep 10 21:02:46.624604 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1906/3881] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:02:46 2022] DELETE /compute/v2.1/servers/001b620b-0084-42b3-a0c3-a2a50427fcf9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:02:46.695373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b0b58e2c-873f-4f9c-b6a0-0d07a0b152b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:46.696214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b0b58e2c-873f-4f9c-b6a0-0d07a0b152b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:46.711572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0b58e2c-873f-4f9c-b6a0-0d07a0b152b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:46.712109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0b58e2c-873f-4f9c-b6a0-0d07a0b152b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:46.712581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0b58e2c-873f-4f9c-b6a0-0d07a0b152b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:46.713293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0b58e2c-873f-4f9c-b6a0-0d07a0b152b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:46.713759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0b58e2c-873f-4f9c-b6a0-0d07a0b152b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:46.716104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0b58e2c-873f-4f9c-b6a0-0d07a0b152b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:46.824667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-499592611", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e4401218-c6fb-4457-975c-35dd67e4cb14"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:46.941134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] validate_networks() for [('e4401218-c6fb-4457-975c-35dd67e4cb14', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:02:46.977323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b0b58e2c-873f-4f9c-b6a0-0d07a0b152b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:46.993198 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b0b58e2c-873f-4f9c-b6a0-0d07a0b152b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1501 microversion: 2.1 time: 0.307810 Sep 10 21:02:46.994778 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1976/3882] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:46 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:47.007239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0dd0a876-da46-438a-81b4-db877b27776c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:47.008367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0dd0a876-da46-438a-81b4-db877b27776c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:47.015791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd0a876-da46-438a-81b4-db877b27776c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:47.017308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd0a876-da46-438a-81b4-db877b27776c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:47.018377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd0a876-da46-438a-81b4-db877b27776c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:47.019862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd0a876-da46-438a-81b4-db877b27776c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:47.020628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd0a876-da46-438a-81b4-db877b27776c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:47.021308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd0a876-da46-438a-81b4-db877b27776c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:47.027209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:47.141489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0dd0a876-da46-438a-81b4-db877b27776c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:47.166926 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0dd0a876-da46-438a-81b4-db877b27776c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1229 microversion: 2.1 time: 0.168851 Sep 10 21:02:47.170605 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1977/3883] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:46 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1229 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:47.176692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4ef7422a-5dc2-4437-aa64-b41d09af4c00 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f993fbf3040>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:47.233681 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-4ef7422a-5dc2-4437-aa64-b41d09af4c00 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] HTTP exception thrown: Snapshot 92fce2de-7d2b-4586-88d0-af51720c31c6 could not be found. Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4ef7422a-5dc2-4437-aa64-b41d09af4c00 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Request method failure captured: Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6 HTTP/1.1 Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtvGSgdm3O4D6ijXqS2SELQ4uxN3R3YsE8HsHhbZZm7M_u5pwWq-RS4CXOv6Iyqm5j2nhjPug8NcLPSQLnYYU05l2otDRhCnuhBd4OTieR34z6jMiCO5mhg9ZunBxxv2o7e6N-wfpUgvZ66tqb8swQ1JOq5yx9CgKYVyiHqeiY8twU Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: ff1d75a125014e7ea9fe4b62cbbdfa2a Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff1d75a125014e7ea9fe4b62cbbdfa2a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}] Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: ff1d75a125014e7ea9fe4b62cbbdfa2a Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesSnapshotsTestJSON-1502965432-project Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 29fdd87326be407b8840931f9f7a8bde Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1502965432-project Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: exception: Snapshot 92fce2de-7d2b-4586-88d0-af51720c31c6 could not be found. Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '92fce2de-7d2b-4586-88d0-af51720c31c6'} Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 92fce2de-7d2b-4586-88d0-af51720c31c6 could not be found. (HTTP 404) (Request-ID: req-6e5271be-4d54-4a15-9cd4-127e00465779) Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 21:02:47.242076 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 92fce2de-7d2b-4586-88d0-af51720c31c6 could not be found. Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 92fce2de-7d2b-4586-88d0-af51720c31c6 could not be found. Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 92fce2de-7d2b-4586-88d0-af51720c31c6 could not be found. Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4ef7422a-5dc2-4437-aa64-b41d09af4c00 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Returning 404 to user: Snapshot 92fce2de-7d2b-4586-88d0-af51720c31c6 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4ef7422a-5dc2-4437-aa64-b41d09af4c00 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6" status: 404 len: 111 microversion: 2.1 time: 0.071751 Sep 10 21:02:47.247013 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1978/3884] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 21:02:47 2022] GET /compute/v2.1/os-snapshots/92fce2de-7d2b-4586-88d0-af51720c31c6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:47.253676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-db807fa9-9d2d-4a4e-84ed-3fce288a759c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:47.253676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-db807fa9-9d2d-4a4e-84ed-3fce288a759c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:47.276818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db807fa9-9d2d-4a4e-84ed-3fce288a759c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:47.278725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db807fa9-9d2d-4a4e-84ed-3fce288a759c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:47.279467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db807fa9-9d2d-4a4e-84ed-3fce288a759c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:47.280227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db807fa9-9d2d-4a4e-84ed-3fce288a759c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:47.280693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db807fa9-9d2d-4a4e-84ed-3fce288a759c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:47.281124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db807fa9-9d2d-4a4e-84ed-3fce288a759c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:47.334071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-db807fa9-9d2d-4a4e-84ed-3fce288a759c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:02:47.570748 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-db807fa9-9d2d-4a4e-84ed-3fce288a759c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 204 len: 0 microversion: 2.1 time: 0.324418 Sep 10 21:02:47.571790 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1979/3885] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:02:47 2022] DELETE /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:02:47.589850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-65567492-6d0a-4ea2-a3f2-6a834548b3ce tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f9949642dc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:47.727143 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-65567492-6d0a-4ea2-a3f2-6a834548b3ce tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba" status: 202 len: 0 microversion: 2.1 time: 0.152094 Sep 10 21:02:47.730832 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1980/3886] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:02:47 2022] DELETE /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:02:47.746250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8038e25c-f87f-4d70-bdbb-eb5eed86a7f1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:47.748371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8038e25c-f87f-4d70-bdbb-eb5eed86a7f1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:47.803614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8038e25c-f87f-4d70-bdbb-eb5eed86a7f1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:47.804155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8038e25c-f87f-4d70-bdbb-eb5eed86a7f1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:47.804621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8038e25c-f87f-4d70-bdbb-eb5eed86a7f1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:47.805369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8038e25c-f87f-4d70-bdbb-eb5eed86a7f1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:47.805861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8038e25c-f87f-4d70-bdbb-eb5eed86a7f1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:47.817273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8038e25c-f87f-4d70-bdbb-eb5eed86a7f1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:48.143648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8038e25c-f87f-4d70-bdbb-eb5eed86a7f1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:48.173349 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8038e25c-f87f-4d70-bdbb-eb5eed86a7f1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1507 microversion: 2.1 time: 0.441145 Sep 10 21:02:48.174971 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1981/3887] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:47 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:48.180975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-58295645-f8c3-4557-822a-136c04b1565b tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f994971a550>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:48.269193 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-58295645-f8c3-4557-822a-136c04b1565b tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba" status: 200 len: 338 microversion: 2.1 time: 0.092894 Sep 10 21:02:48.271061 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1982/3888] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:02:48 2022] GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba => generated 338 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:48.282805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-91ce9b82-0bd3-441d-b07a-c585f131c209 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:48.283609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-91ce9b82-0bd3-441d-b07a-c585f131c209 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:48.300493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91ce9b82-0bd3-441d-b07a-c585f131c209 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:48.300493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91ce9b82-0bd3-441d-b07a-c585f131c209 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:48.301702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91ce9b82-0bd3-441d-b07a-c585f131c209 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:48.308691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91ce9b82-0bd3-441d-b07a-c585f131c209 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:48.309583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91ce9b82-0bd3-441d-b07a-c585f131c209 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:48.312002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91ce9b82-0bd3-441d-b07a-c585f131c209 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:48.448714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-91ce9b82-0bd3-441d-b07a-c585f131c209 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:48.463837 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-91ce9b82-0bd3-441d-b07a-c585f131c209 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1277 microversion: 2.1 time: 0.191294 Sep 10 21:02:48.474848 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1983/3889] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:48 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:48.498617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:02:48.498617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:02:48.499373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:02:48.499484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:02:48.499910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:02:48.520761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:48.522803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:48.527468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:48.529081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:48.535291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:48.536016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:48.570612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Getting quotas for project dd2cd4bb350d452eb8c5e2533642c0f0. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:02:48.577110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Getting quotas for user 6f50ca756d594703846f1dade2d38eac and project dd2cd4bb350d452eb8c5e2533642c0f0. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:02:48.614920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Going to run 2 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:02:48.623875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 2be32989-55a9-4f80-a36b-7e846b72fdca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:02:48.695311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=2be32989-55a9-4f80-a36b-7e846b72fdca,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:02:48.841698 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0b3f95e4-7443-443c-abb9-11af27cc7df8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.024635 Sep 10 21:02:48.843585 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1907/3890] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:02:46 2022] POST /compute/v2.1/servers => generated 32 bytes in 2028 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Sep 10 21:02:48.853692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:48.867023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:48.870265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Searching by: {'deleted': False, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:02:48.986810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:48.990284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:48.993963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:48.995215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:48.999793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:49.000831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:49.174839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:02:49.202722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-57cfcf0a-7f9f-46ff-a759-763790a3838d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:49.203768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-57cfcf0a-7f9f-46ff-a759-763790a3838d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:49.233667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57cfcf0a-7f9f-46ff-a759-763790a3838d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:49.239961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57cfcf0a-7f9f-46ff-a759-763790a3838d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:49.240644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57cfcf0a-7f9f-46ff-a759-763790a3838d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:49.246233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57cfcf0a-7f9f-46ff-a759-763790a3838d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:49.247121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57cfcf0a-7f9f-46ff-a759-763790a3838d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:49.250729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57cfcf0a-7f9f-46ff-a759-763790a3838d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:49.326995 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e7b7a0d2-5f28-4980-9e92-a4623a221577 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.478069 Sep 10 21:02:49.350148 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1984/3891] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 21:02:48 2022] GET /compute/v2.1/servers => generated 1335 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:49.380181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6b82023-2352-4c8f-9ad7-bf11f6c19881 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f99455e6d30>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:49.447157 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f6b82023-2352-4c8f-9ad7-bf11f6c19881 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] HTTP exception thrown: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6b82023-2352-4c8f-9ad7-bf11f6c19881 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Request method failure captured: Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba HTTP/1.1 Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtvGSgdm3O4D6ijXqS2SELQ4uxN3R3YsE8HsHhbZZm7M_u5pwWq-RS4CXOv6Iyqm5j2nhjPug8NcLPSQLnYYU05l2otDRhCnuhBd4OTieR34z6jMiCO5mhg9ZunBxxv2o7e6N-wfpUgvZ66tqb8swQ1JOq5yx9CgKYVyiHqeiY8twU Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: ff1d75a125014e7ea9fe4b62cbbdfa2a Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff1d75a125014e7ea9fe4b62cbbdfa2a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}] Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: ff1d75a125014e7ea9fe4b62cbbdfa2a Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesSnapshotsTestJSON-1502965432-project Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 29fdd87326be407b8840931f9f7a8bde Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1502965432-project Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: exception: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '9d0720c9-f80a-4617-956c-4f1cea08a2ba'} Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. (HTTP 404) (Request-ID: req-82220800-8bae-44af-884c-a4d462695630) Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 21:02:49.450330 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6b82023-2352-4c8f-9ad7-bf11f6c19881 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Returning 404 to user: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f6b82023-2352-4c8f-9ad7-bf11f6c19881 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba" status: 404 len: 109 microversion: 2.1 time: 0.101234 Sep 10 21:02:49.455722 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1985/3892] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:02:49 2022] GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:49.463639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c442beb-f732-459f-a151-0f112e973e85 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:49.463639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c442beb-f732-459f-a151-0f112e973e85 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:49.617310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c442beb-f732-459f-a151-0f112e973e85 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:49.630050 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c442beb-f732-459f-a151-0f112e973e85 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1217 microversion: 2.1 time: 0.175452 Sep 10 21:02:49.631307 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1986/3893] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:49 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:49.636915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40d0ced0-8598-40a3-b89e-db6654ae5a5c tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f9949681160>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:49.700780 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-40d0ced0-8598-40a3-b89e-db6654ae5a5c tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] HTTP exception thrown: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40d0ced0-8598-40a3-b89e-db6654ae5a5c tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Request method failure captured: Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba HTTP/1.1 Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtvGSgdm3O4D6ijXqS2SELQ4uxN3R3YsE8HsHhbZZm7M_u5pwWq-RS4CXOv6Iyqm5j2nhjPug8NcLPSQLnYYU05l2otDRhCnuhBd4OTieR34z6jMiCO5mhg9ZunBxxv2o7e6N-wfpUgvZ66tqb8swQ1JOq5yx9CgKYVyiHqeiY8twU Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: ff1d75a125014e7ea9fe4b62cbbdfa2a Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff1d75a125014e7ea9fe4b62cbbdfa2a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}] Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: ff1d75a125014e7ea9fe4b62cbbdfa2a Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesSnapshotsTestJSON-1502965432-project Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 29fdd87326be407b8840931f9f7a8bde Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1502965432-project Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: exception: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '9d0720c9-f80a-4617-956c-4f1cea08a2ba'} Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. (HTTP 404) (Request-ID: req-46605771-3bd7-48fb-ab25-28b283b2a9b7) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 21:02:49.704501 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:49.710399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40d0ced0-8598-40a3-b89e-db6654ae5a5c tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Returning 404 to user: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:49.719032 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40d0ced0-8598-40a3-b89e-db6654ae5a5c tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba" status: 404 len: 109 microversion: 2.1 time: 0.078047 Sep 10 21:02:49.719032 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1987/3894] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:02:49 2022] DELETE /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:49.727272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d7580573-1f40-4e4b-98ab-429e1eb51d53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:49.728145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d7580573-1f40-4e4b-98ab-429e1eb51d53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:49.751561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7580573-1f40-4e4b-98ab-429e1eb51d53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:49.755377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7580573-1f40-4e4b-98ab-429e1eb51d53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:49.755963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7580573-1f40-4e4b-98ab-429e1eb51d53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:49.757162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7580573-1f40-4e4b-98ab-429e1eb51d53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:49.757743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7580573-1f40-4e4b-98ab-429e1eb51d53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:49.760469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7580573-1f40-4e4b-98ab-429e1eb51d53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:49.890610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d7580573-1f40-4e4b-98ab-429e1eb51d53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:49.906728 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d7580573-1f40-4e4b-98ab-429e1eb51d53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1283 microversion: 2.1 time: 0.191395 Sep 10 21:02:49.917711 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1988/3895] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:49 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1283 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:49.933696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b2cfffb1-99eb-4cf8-b515-64c8d7234dc9 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Calling method '.version_select at 0x7f99448e40d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:49.999206 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-b2cfffb1-99eb-4cf8-b515-64c8d7234dc9 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] HTTP exception thrown: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b2cfffb1-99eb-4cf8-b515-64c8d7234dc9 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Request method failure captured: Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba HTTP/1.1 Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtvGSgdm3O4D6ijXqS2SELQ4uxN3R3YsE8HsHhbZZm7M_u5pwWq-RS4CXOv6Iyqm5j2nhjPug8NcLPSQLnYYU05l2otDRhCnuhBd4OTieR34z6jMiCO5mhg9ZunBxxv2o7e6N-wfpUgvZ66tqb8swQ1JOq5yx9CgKYVyiHqeiY8twU Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: ff1d75a125014e7ea9fe4b62cbbdfa2a Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff1d75a125014e7ea9fe4b62cbbdfa2a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff1d75a125014e7ea9fe4b62cbbdfa2a"}]}] Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: ff1d75a125014e7ea9fe4b62cbbdfa2a Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1502965432 Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesSnapshotsTestJSON-1502965432-project Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 29fdd87326be407b8840931f9f7a8bde Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1502965432-project Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: exception: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '9d0720c9-f80a-4617-956c-4f1cea08a2ba'} Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. (HTTP 404) (Request-ID: req-354e7a0b-47bd-4ff2-83eb-6d20d3e3c313) Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 21:02:50.002382 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b2cfffb1-99eb-4cf8-b515-64c8d7234dc9 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] Returning 404 to user: Volume 9d0720c9-f80a-4617-956c-4f1cea08a2ba could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:50.010072 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b2cfffb1-99eb-4cf8-b515-64c8d7234dc9 tempest-VolumesSnapshotsTestJSON-1502965432 tempest-VolumesSnapshotsTestJSON-1502965432-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba" status: 404 len: 109 microversion: 2.1 time: 0.089495 Sep 10 21:02:50.018291 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1989/3896] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:02:49 2022] GET /compute/v2.1/os-volumes/9d0720c9-f80a-4617-956c-4f1cea08a2ba => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:02:50.330535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0eb981e7-f64a-4e5d-9a0c-6dd59e539a85 req-0bf0841c-26a2-4e91-b4f4-2de0d3169baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9", "name": "network-vif-deleted", "tag": "7706df87-5ef4-41af-b422-569f5c345cdf"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:50.365568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0eb981e7-f64a-4e5d-9a0c-6dd59e539a85 req-0bf0841c-26a2-4e91-b4f4-2de0d3169baa service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:50.367979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0eb981e7-f64a-4e5d-9a0c-6dd59e539a85 req-0bf0841c-26a2-4e91-b4f4-2de0d3169baa service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:50.389615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0eb981e7-f64a-4e5d-9a0c-6dd59e539a85 req-0bf0841c-26a2-4e91-b4f4-2de0d3169baa service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:50.431278 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0eb981e7-f64a-4e5d-9a0c-6dd59e539a85 req-0bf0841c-26a2-4e91-b4f4-2de0d3169baa service nova] Creating event network-vif-deleted:7706df87-5ef4-41af-b422-569f5c345cdf for instance 6e6f9ac7-22b6-4ac6-a5d1-104c21c86cf9 on nch2-master-1 Sep 10 21:02:50.460295 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0eb981e7-f64a-4e5d-9a0c-6dd59e539a85 req-0bf0841c-26a2-4e91-b4f4-2de0d3169baa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124618 Sep 10 21:02:50.466986 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1990/3897] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:02:50.658444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f121a036-ec9d-4bf2-ac29-de1c1c02c25a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:50.659835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f121a036-ec9d-4bf2-ac29-de1c1c02c25a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:50.922307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f121a036-ec9d-4bf2-ac29-de1c1c02c25a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:50.934683 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f121a036-ec9d-4bf2-ac29-de1c1c02c25a tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1217 microversion: 2.1 time: 0.280874 Sep 10 21:02:50.952181 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1991/3898] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:50 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1217 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:50.958837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1e333b6-bf21-4f03-a600-ea293f5096ef tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:50.959734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e1e333b6-bf21-4f03-a600-ea293f5096ef tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:50.972383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1e333b6-bf21-4f03-a600-ea293f5096ef tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:50.973286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1e333b6-bf21-4f03-a600-ea293f5096ef tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:50.974319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1e333b6-bf21-4f03-a600-ea293f5096ef tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:50.975835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1e333b6-bf21-4f03-a600-ea293f5096ef tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:50.976097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1e333b6-bf21-4f03-a600-ea293f5096ef tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:50.977497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1e333b6-bf21-4f03-a600-ea293f5096ef tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:51.183787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1e333b6-bf21-4f03-a600-ea293f5096ef tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:51.210414 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1e333b6-bf21-4f03-a600-ea293f5096ef tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1283 microversion: 2.1 time: 0.255053 Sep 10 21:02:51.212611 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1992/3899] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:50 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1283 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:51.555110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-57cfcf0a-7f9f-46ff-a759-763790a3838d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:51.574510 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-57cfcf0a-7f9f-46ff-a759-763790a3838d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1507 microversion: 2.1 time: 2.377793 Sep 10 21:02:51.581341 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1908/3900] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:49 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1507 bytes in 2385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:51.960066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f81feddf-c7a6-41f0-ab6e-a4275dac6b06 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:51.962353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f81feddf-c7a6-41f0-ab6e-a4275dac6b06 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:51.976068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f81feddf-c7a6-41f0-ab6e-a4275dac6b06 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:51.978054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f81feddf-c7a6-41f0-ab6e-a4275dac6b06 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:51.980373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f81feddf-c7a6-41f0-ab6e-a4275dac6b06 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:51.981360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f81feddf-c7a6-41f0-ab6e-a4275dac6b06 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:51.983227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f81feddf-c7a6-41f0-ab6e-a4275dac6b06 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:51.986533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f81feddf-c7a6-41f0-ab6e-a4275dac6b06 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:52.165513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f81feddf-c7a6-41f0-ab6e-a4275dac6b06 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:52.183964 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f81feddf-c7a6-41f0-ab6e-a4275dac6b06 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1269 microversion: 2.1 time: 0.229259 Sep 10 21:02:52.185086 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1993/3901] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:51 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1269 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:52.244833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1a7e773-a3c4-43b6-ad73-3bf77f9b4e8c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:52.245955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a1a7e773-a3c4-43b6-ad73-3bf77f9b4e8c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:52.260756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1a7e773-a3c4-43b6-ad73-3bf77f9b4e8c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:52.262263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1a7e773-a3c4-43b6-ad73-3bf77f9b4e8c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:52.264450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1a7e773-a3c4-43b6-ad73-3bf77f9b4e8c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:52.267091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1a7e773-a3c4-43b6-ad73-3bf77f9b4e8c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:52.268711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1a7e773-a3c4-43b6-ad73-3bf77f9b4e8c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:52.271207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1a7e773-a3c4-43b6-ad73-3bf77f9b4e8c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:52.592295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-2a75f640-a9ba-4a8f-82bb-c801d4d731c6 req-3abab8ed-f7a7-4eff-93df-9691a4b7faa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96eb8dae-5750-4fc2-b074-1fff3a5de31e", "name": "network-vif-unplugged", "status": "completed", "tag": "e4ace8d4-a4cb-403a-a0c8-241a19ac7219"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:52.632879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:52.635521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2a75f640-a9ba-4a8f-82bb-c801d4d731c6 req-3abab8ed-f7a7-4eff-93df-9691a4b7faa7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:52.636009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2a75f640-a9ba-4a8f-82bb-c801d4d731c6 req-3abab8ed-f7a7-4eff-93df-9691a4b7faa7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:52.636711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2a75f640-a9ba-4a8f-82bb-c801d4d731c6 req-3abab8ed-f7a7-4eff-93df-9691a4b7faa7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:52.685976 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-2a75f640-a9ba-4a8f-82bb-c801d4d731c6 req-3abab8ed-f7a7-4eff-93df-9691a4b7faa7 service nova] Creating event network-vif-unplugged:e4ace8d4-a4cb-403a-a0c8-241a19ac7219 for instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e on nch2-master-1 Sep 10 21:02:52.700558 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-2a75f640-a9ba-4a8f-82bb-c801d4d731c6 req-3abab8ed-f7a7-4eff-93df-9691a4b7faa7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113884 Sep 10 21:02:52.707153 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1994/3902] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:52.718132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5e5794f-9e9d-4724-9114-45f49235b9ce tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:52.730231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5e5794f-9e9d-4724-9114-45f49235b9ce tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:52.744369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a1a7e773-a3c4-43b6-ad73-3bf77f9b4e8c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:52.758335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5e5794f-9e9d-4724-9114-45f49235b9ce tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:52.762149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5e5794f-9e9d-4724-9114-45f49235b9ce tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:52.763144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5e5794f-9e9d-4724-9114-45f49235b9ce tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:52.765425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5e5794f-9e9d-4724-9114-45f49235b9ce tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:52.768173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5e5794f-9e9d-4724-9114-45f49235b9ce tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:52.770431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5e5794f-9e9d-4724-9114-45f49235b9ce tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:52.782238 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a1a7e773-a3c4-43b6-ad73-3bf77f9b4e8c tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1283 microversion: 2.1 time: 0.543067 Sep 10 21:02:52.787332 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1909/3903] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:52 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1283 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:53.214159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2d509eb7-5e67-4041-809f-87c07ab3ad89 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:53.215306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2d509eb7-5e67-4041-809f-87c07ab3ad89 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:53.229877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d509eb7-5e67-4041-809f-87c07ab3ad89 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:53.230913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d509eb7-5e67-4041-809f-87c07ab3ad89 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:53.231652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d509eb7-5e67-4041-809f-87c07ab3ad89 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:53.244223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d509eb7-5e67-4041-809f-87c07ab3ad89 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:53.247206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d509eb7-5e67-4041-809f-87c07ab3ad89 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:53.266266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d509eb7-5e67-4041-809f-87c07ab3ad89 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:53.460130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a5e5794f-9e9d-4724-9114-45f49235b9ce tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:53.471504 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5e5794f-9e9d-4724-9114-45f49235b9ce tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1465 microversion: 2.1 time: 0.762643 Sep 10 21:02:53.472159 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1995/3904] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:52 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1465 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:53.663119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2d509eb7-5e67-4041-809f-87c07ab3ad89 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:53.673426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-5b366089-e580-4173-8652-4091541e3bf4 req-88b44bf6-7e22-40d3-a776-77c85ad6108a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96eb8dae-5750-4fc2-b074-1fff3a5de31e", "name": "network-vif-deleted", "tag": "e4ace8d4-a4cb-403a-a0c8-241a19ac7219"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:53.680850 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2d509eb7-5e67-4041-809f-87c07ab3ad89 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1275 microversion: 2.1 time: 0.471529 Sep 10 21:02:53.708648 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1910/3905] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:53 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1275 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:53.713046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5b366089-e580-4173-8652-4091541e3bf4 req-88b44bf6-7e22-40d3-a776-77c85ad6108a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:53.713535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5b366089-e580-4173-8652-4091541e3bf4 req-88b44bf6-7e22-40d3-a776-77c85ad6108a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:53.715006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5b366089-e580-4173-8652-4091541e3bf4 req-88b44bf6-7e22-40d3-a776-77c85ad6108a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:53.741366 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-5b366089-e580-4173-8652-4091541e3bf4 req-88b44bf6-7e22-40d3-a776-77c85ad6108a service nova] Creating event network-vif-deleted:e4ace8d4-a4cb-403a-a0c8-241a19ac7219 for instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e on nch2-master-1 Sep 10 21:02:53.765977 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-5b366089-e580-4173-8652-4091541e3bf4 req-88b44bf6-7e22-40d3-a776-77c85ad6108a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109180 Sep 10 21:02:53.787353 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1996/3906] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:53.808687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6d862e66-a7be-424e-a842-64b570fd0cb8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:53.810618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6d862e66-a7be-424e-a842-64b570fd0cb8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:53.826641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d862e66-a7be-424e-a842-64b570fd0cb8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:53.827417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d862e66-a7be-424e-a842-64b570fd0cb8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:53.828065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d862e66-a7be-424e-a842-64b570fd0cb8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:53.828955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d862e66-a7be-424e-a842-64b570fd0cb8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:53.830433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d862e66-a7be-424e-a842-64b570fd0cb8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:53.831261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6d862e66-a7be-424e-a842-64b570fd0cb8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:54.051448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6d862e66-a7be-424e-a842-64b570fd0cb8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:54.071898 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6d862e66-a7be-424e-a842-64b570fd0cb8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1283 microversion: 2.1 time: 0.266881 Sep 10 21:02:54.081877 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1911/3907] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:53 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1283 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:54.504987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:54.506338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:54.519817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:54.522993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:54.524979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:54.526077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:54.528362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:54.529229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:54.615017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:54.625696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:54.626520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:54.631113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lazy-loading 'fault' on Instance uuid 96eb8dae-5750-4fc2-b074-1fff3a5de31e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:02:54.736224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3346a6d1-4a4d-461f-a7ee-f7394670c63c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:54.737432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3346a6d1-4a4d-461f-a7ee-f7394670c63c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:54.755774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3346a6d1-4a4d-461f-a7ee-f7394670c63c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:54.756681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3346a6d1-4a4d-461f-a7ee-f7394670c63c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:54.758370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3346a6d1-4a4d-461f-a7ee-f7394670c63c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:54.759373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3346a6d1-4a4d-461f-a7ee-f7394670c63c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:54.762817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3346a6d1-4a4d-461f-a7ee-f7394670c63c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:54.764270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3346a6d1-4a4d-461f-a7ee-f7394670c63c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:55.016719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3346a6d1-4a4d-461f-a7ee-f7394670c63c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:55.032188 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3346a6d1-4a4d-461f-a7ee-f7394670c63c tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1275 microversion: 2.1 time: 0.300203 Sep 10 21:02:55.035026 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1912/3908] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:54 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:55.110229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ee388bb2-ae3b-4d2d-a9e6-dc94cf2f881b tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:55.111278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ee388bb2-ae3b-4d2d-a9e6-dc94cf2f881b tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:55.135479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee388bb2-ae3b-4d2d-a9e6-dc94cf2f881b tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:55.136453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee388bb2-ae3b-4d2d-a9e6-dc94cf2f881b tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:55.137186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee388bb2-ae3b-4d2d-a9e6-dc94cf2f881b tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:55.138775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee388bb2-ae3b-4d2d-a9e6-dc94cf2f881b tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:55.139461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee388bb2-ae3b-4d2d-a9e6-dc94cf2f881b tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:55.140280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee388bb2-ae3b-4d2d-a9e6-dc94cf2f881b tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:55.767589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:55.782068 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c583ed73-7a9b-4060-a43e-44c12c12fc07 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 200 len: 1305 microversion: 2.1 time: 1.282691 Sep 10 21:02:55.782590 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1997/3909] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:54 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 1305 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:56.062789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-80b424c6-41e9-4d33-bb1c-c8198b055043 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:56.064638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-80b424c6-41e9-4d33-bb1c-c8198b055043 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:56.075961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80b424c6-41e9-4d33-bb1c-c8198b055043 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:56.077737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80b424c6-41e9-4d33-bb1c-c8198b055043 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:56.078060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80b424c6-41e9-4d33-bb1c-c8198b055043 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:56.078931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80b424c6-41e9-4d33-bb1c-c8198b055043 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:56.080665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80b424c6-41e9-4d33-bb1c-c8198b055043 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:56.082107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80b424c6-41e9-4d33-bb1c-c8198b055043 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:56.163512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ee388bb2-ae3b-4d2d-a9e6-dc94cf2f881b tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:56.193798 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ee388bb2-ae3b-4d2d-a9e6-dc94cf2f881b tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1325 microversion: 2.1 time: 1.089123 Sep 10 21:02:56.197669 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1913/3910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:55 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1325 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:56.224181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-32d666a9-56fa-4062-9ae2-904d6a7813ff req-866c4c53-090a-41c8-b9f0-5b3aa9b1adb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001b620b-0084-42b3-a0c3-a2a50427fcf9", "name": "network-vif-deleted", "tag": "20e5f4b8-1f3f-4d2a-b711-e4e314166835"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:56.236511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-32d666a9-56fa-4062-9ae2-904d6a7813ff req-866c4c53-090a-41c8-b9f0-5b3aa9b1adb3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:56.238110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-32d666a9-56fa-4062-9ae2-904d6a7813ff req-866c4c53-090a-41c8-b9f0-5b3aa9b1adb3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:56.238973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-32d666a9-56fa-4062-9ae2-904d6a7813ff req-866c4c53-090a-41c8-b9f0-5b3aa9b1adb3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:56.257312 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-32d666a9-56fa-4062-9ae2-904d6a7813ff req-866c4c53-090a-41c8-b9f0-5b3aa9b1adb3 service nova] Creating event network-vif-deleted:20e5f4b8-1f3f-4d2a-b711-e4e314166835 for instance 001b620b-0084-42b3-a0c3-a2a50427fcf9 on nch1-master-1 Sep 10 21:02:56.264552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-32d666a9-56fa-4062-9ae2-904d6a7813ff req-866c4c53-090a-41c8-b9f0-5b3aa9b1adb3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048111 Sep 10 21:02:56.265927 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1914/3911] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:56.817489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:56.818330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:56.832241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:56.832754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:56.833208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:56.833962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:56.834432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:56.834877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:56.868204 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e HTTP/1.1 Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '96eb8dae-5750-4fc2-b074-1fff3a5de31e'} Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:02:56.870990 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:56.878055 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:02:56.878055 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:02:56.878055 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:02:56.878055 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:02:56.878055 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:02:56.878055 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:02:56.878055 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:02:56.880048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:02:56.883396 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a178c86d-54d9-408e-bf4c-19f6d85f2692 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 404 len: 111 microversion: 2.1 time: 0.073943 Sep 10 21:02:56.884614 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1915/3912] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:56 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:02:56.996145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-80b424c6-41e9-4d33-bb1c-c8198b055043 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:57.015223 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-80b424c6-41e9-4d33-bb1c-c8198b055043 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1317 microversion: 2.1 time: 0.956678 Sep 10 21:02:57.016418 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1998/3913] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:56 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1317 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:57.146281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1800604517", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f5a2cd59-1be7-47bd-82a5-e6307d510b6e"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:57.227870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ae97da85-d49a-4694-8126-125437fb786f tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:57.232180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ae97da85-d49a-4694-8126-125437fb786f tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:57.244535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae97da85-d49a-4694-8126-125437fb786f tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:57.245595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae97da85-d49a-4694-8126-125437fb786f tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:57.246770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae97da85-d49a-4694-8126-125437fb786f tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:57.248912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae97da85-d49a-4694-8126-125437fb786f tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:57.249561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae97da85-d49a-4694-8126-125437fb786f tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:57.250510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ae97da85-d49a-4694-8126-125437fb786f tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:57.266731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] validate_networks() for [('f5a2cd59-1be7-47bd-82a5-e6307d510b6e', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:02:58.104675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ae97da85-d49a-4694-8126-125437fb786f tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:58.134206 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ae97da85-d49a-4694-8126-125437fb786f tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1325 microversion: 2.1 time: 0.907582 Sep 10 21:02:58.157010 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 1999/3914] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:57 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1325 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:02:58.182689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dd0d4fc6-7249-4f3f-ad28-d697199688ae tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:58.183966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dd0d4fc6-7249-4f3f-ad28-d697199688ae tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:58.218360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd0d4fc6-7249-4f3f-ad28-d697199688ae tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:58.219407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd0d4fc6-7249-4f3f-ad28-d697199688ae tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:58.221686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd0d4fc6-7249-4f3f-ad28-d697199688ae tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:58.224555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd0d4fc6-7249-4f3f-ad28-d697199688ae tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:58.230283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd0d4fc6-7249-4f3f-ad28-d697199688ae tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:58.234171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd0d4fc6-7249-4f3f-ad28-d697199688ae tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:58.558107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:58.587746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:58.853407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:02:58.861589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:02:58.864036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:02:58.864156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:02:58.864942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:02:58.955272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:58.963056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:58.964537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:58.965858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:58.967813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:58.968728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:59.027883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:02:59.047661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for user 4faa458c158141efaf707317411cd544 and project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:02:59.064686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:59.088460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:02:59.112092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:02:59.240799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dd0d4fc6-7249-4f3f-ad28-d697199688ae tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:02:59.317800 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dd0d4fc6-7249-4f3f-ad28-d697199688ae tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1317 microversion: 2.1 time: 1.151459 Sep 10 21:02:59.323567 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2000/3915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:58 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1317 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:02:59.360588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-991b4bfd-159c-4b43-b016-6b47b7f71c3f req-cb0fb20a-7fe0-4ce2-999d-29fa03380f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b134814a-9577-41e9-93ca-b32554a68b25", "tag": "e58b76c6-7f0d-4130-adc7-aee72db4887d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:02:59.405385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-991b4bfd-159c-4b43-b016-6b47b7f71c3f req-cb0fb20a-7fe0-4ce2-999d-29fa03380f0d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:59.405975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-991b4bfd-159c-4b43-b016-6b47b7f71c3f req-cb0fb20a-7fe0-4ce2-999d-29fa03380f0d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:59.408441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-991b4bfd-159c-4b43-b016-6b47b7f71c3f req-cb0fb20a-7fe0-4ce2-999d-29fa03380f0d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:59.436951 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-991b4bfd-159c-4b43-b016-6b47b7f71c3f req-cb0fb20a-7fe0-4ce2-999d-29fa03380f0d service nova] Creating event network-changed:e58b76c6-7f0d-4130-adc7-aee72db4887d for instance b134814a-9577-41e9-93ca-b32554a68b25 on nch1-master-1 Sep 10 21:02:59.446346 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-991b4bfd-159c-4b43-b016-6b47b7f71c3f req-cb0fb20a-7fe0-4ce2-999d-29fa03380f0d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120437 Sep 10 21:02:59.446975 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2001/3916] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:02:59.474647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4159fbda-9564-4d46-a2c6-a140edec0a53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:59.480188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4159fbda-9564-4d46-a2c6-a140edec0a53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:59.508504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4159fbda-9564-4d46-a2c6-a140edec0a53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:59.510336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4159fbda-9564-4d46-a2c6-a140edec0a53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:59.512184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4159fbda-9564-4d46-a2c6-a140edec0a53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:59.517322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4159fbda-9564-4d46-a2c6-a140edec0a53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:02:59.518478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4159fbda-9564-4d46-a2c6-a140edec0a53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:02:59.519617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4159fbda-9564-4d46-a2c6-a140edec0a53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:02:59.540898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:02:59.551572 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3bce6551-35f1-475c-aa53-e6bf30a43217 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.405734 Sep 10 21:02:59.556441 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1916/3917] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:02:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:02:59.619658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8969d295-3960-436f-9d1c-9191b86cb93e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:02:59.631847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8969d295-3960-436f-9d1c-9191b86cb93e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:02:59.955459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8969d295-3960-436f-9d1c-9191b86cb93e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:00.003394 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8969d295-3960-436f-9d1c-9191b86cb93e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1215 microversion: 2.1 time: 0.415722 Sep 10 21:03:00.023087 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1917/3918] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:59 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1215 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:00.357888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bdff56eb-cbd8-4eb8-ae06-fb87215dba84 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:00.358525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bdff56eb-cbd8-4eb8-ae06-fb87215dba84 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:00.365701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdff56eb-cbd8-4eb8-ae06-fb87215dba84 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:00.378326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdff56eb-cbd8-4eb8-ae06-fb87215dba84 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:00.379068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdff56eb-cbd8-4eb8-ae06-fb87215dba84 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:00.380049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdff56eb-cbd8-4eb8-ae06-fb87215dba84 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:00.380546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdff56eb-cbd8-4eb8-ae06-fb87215dba84 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:00.380962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bdff56eb-cbd8-4eb8-ae06-fb87215dba84 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:00.931881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=18 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:01.341303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4159fbda-9564-4d46-a2c6-a140edec0a53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:01.353879 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4159fbda-9564-4d46-a2c6-a140edec0a53 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1325 microversion: 2.1 time: 1.905640 Sep 10 21:03:01.359759 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2002/3919] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:02:59 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1325 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:01.374709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e16974e-6b1d-406a-9b6b-0e283c99d212 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:01.401895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e16974e-6b1d-406a-9b6b-0e283c99d212 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:01.441091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e16974e-6b1d-406a-9b6b-0e283c99d212 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:01.441597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e16974e-6b1d-406a-9b6b-0e283c99d212 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:01.459408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e16974e-6b1d-406a-9b6b-0e283c99d212 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:01.460164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e16974e-6b1d-406a-9b6b-0e283c99d212 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:01.460653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e16974e-6b1d-406a-9b6b-0e283c99d212 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:01.465513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e16974e-6b1d-406a-9b6b-0e283c99d212 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:01.823029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bdff56eb-cbd8-4eb8-ae06-fb87215dba84 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:01.842207 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bdff56eb-cbd8-4eb8-ae06-fb87215dba84 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1317 microversion: 2.1 time: 1.500548 Sep 10 21:03:01.866547 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1918/3920] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:00 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1317 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:01.892187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-7674c8da-62ce-4009-9e27-144fe59e9dac req-acc01cc4-5aa9-4936-892b-a61e9a40f87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f6143f-f25d-402b-9361-af366b1fb20d", "tag": "cbd2c763-a952-4e35-853b-1ba7b14348de"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:01.963041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7674c8da-62ce-4009-9e27-144fe59e9dac req-acc01cc4-5aa9-4936-892b-a61e9a40f87b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:01.963041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7674c8da-62ce-4009-9e27-144fe59e9dac req-acc01cc4-5aa9-4936-892b-a61e9a40f87b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:01.963041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7674c8da-62ce-4009-9e27-144fe59e9dac req-acc01cc4-5aa9-4936-892b-a61e9a40f87b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:01.980598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6e16974e-6b1d-406a-9b6b-0e283c99d212 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:02.010020 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e16974e-6b1d-406a-9b6b-0e283c99d212 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1211 microversion: 2.1 time: 0.642996 Sep 10 21:03:02.011348 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2003/3921] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:01 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1211 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:02.068334 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7674c8da-62ce-4009-9e27-144fe59e9dac req-acc01cc4-5aa9-4936-892b-a61e9a40f87b service nova] Creating event network-changed:cbd2c763-a952-4e35-853b-1ba7b14348de for instance b2f6143f-f25d-402b-9361-af366b1fb20d on nch1-master-1 Sep 10 21:03:02.094527 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-7674c8da-62ce-4009-9e27-144fe59e9dac req-acc01cc4-5aa9-4936-892b-a61e9a40f87b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224123 Sep 10 21:03:02.096441 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1919/3922] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:02.392174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9904467b-3a6a-4395-bc4a-2664f0b9e9d8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:02.393532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9904467b-3a6a-4395-bc4a-2664f0b9e9d8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:02.427339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9904467b-3a6a-4395-bc4a-2664f0b9e9d8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:02.428601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9904467b-3a6a-4395-bc4a-2664f0b9e9d8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:02.431852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9904467b-3a6a-4395-bc4a-2664f0b9e9d8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:02.435870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9904467b-3a6a-4395-bc4a-2664f0b9e9d8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:02.439485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9904467b-3a6a-4395-bc4a-2664f0b9e9d8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:02.440876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9904467b-3a6a-4395-bc4a-2664f0b9e9d8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:02.912222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-092e39eb-cd7e-4dcc-a4f7-d37b0b8fb03d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:02.913959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-092e39eb-cd7e-4dcc-a4f7-d37b0b8fb03d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:02.938965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-092e39eb-cd7e-4dcc-a4f7-d37b0b8fb03d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:02.939890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-092e39eb-cd7e-4dcc-a4f7-d37b0b8fb03d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:02.940652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-092e39eb-cd7e-4dcc-a4f7-d37b0b8fb03d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:02.941772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-092e39eb-cd7e-4dcc-a4f7-d37b0b8fb03d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:02.942804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-092e39eb-cd7e-4dcc-a4f7-d37b0b8fb03d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:02.943460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-092e39eb-cd7e-4dcc-a4f7-d37b0b8fb03d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:03.684259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9904467b-3a6a-4395-bc4a-2664f0b9e9d8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:03.701122 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9904467b-3a6a-4395-bc4a-2664f0b9e9d8 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1325 microversion: 2.1 time: 1.313414 Sep 10 21:03:03.704545 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2004/3923] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:02 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1325 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:03.719051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-135c438f-ade2-4649-bc8a-a6f3c46236c1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:03.722531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-135c438f-ade2-4649-bc8a-a6f3c46236c1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:03.739119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135c438f-ade2-4649-bc8a-a6f3c46236c1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:03.741921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135c438f-ade2-4649-bc8a-a6f3c46236c1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:03.743622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135c438f-ade2-4649-bc8a-a6f3c46236c1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:03.748145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135c438f-ade2-4649-bc8a-a6f3c46236c1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:03.749914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135c438f-ade2-4649-bc8a-a6f3c46236c1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:03.751029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-135c438f-ade2-4649-bc8a-a6f3c46236c1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:04.060149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-135c438f-ade2-4649-bc8a-a6f3c46236c1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:04.071963 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-135c438f-ade2-4649-bc8a-a6f3c46236c1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1273 microversion: 2.1 time: 0.364616 Sep 10 21:03:04.073477 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2005/3924] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:03 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1273 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:04.299542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0ee5cb18-1de7-4071-97ae-60988af87daa req-92b464cd-4721-49fc-a081-2182ab5af43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be32989-55a9-4f80-a36b-7e846b72fdca", "tag": "70b124a2-40a7-4db5-82bc-f4f4c2ef8627"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:04.371321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0ee5cb18-1de7-4071-97ae-60988af87daa req-92b464cd-4721-49fc-a081-2182ab5af43e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:04.374801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0ee5cb18-1de7-4071-97ae-60988af87daa req-92b464cd-4721-49fc-a081-2182ab5af43e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:04.375578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0ee5cb18-1de7-4071-97ae-60988af87daa req-92b464cd-4721-49fc-a081-2182ab5af43e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:04.449309 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0ee5cb18-1de7-4071-97ae-60988af87daa req-92b464cd-4721-49fc-a081-2182ab5af43e service nova] Creating event network-changed:70b124a2-40a7-4db5-82bc-f4f4c2ef8627 for instance 2be32989-55a9-4f80-a36b-7e846b72fdca on nch2-master-1 Sep 10 21:03:04.465247 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0ee5cb18-1de7-4071-97ae-60988af87daa req-92b464cd-4721-49fc-a081-2182ab5af43e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210530 Sep 10 21:03:04.469782 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2006/3925] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:04.740492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10f6029b-4807-4a6c-9a2d-b7a1fb46faa0 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:04.742500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10f6029b-4807-4a6c-9a2d-b7a1fb46faa0 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:04.756616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10f6029b-4807-4a6c-9a2d-b7a1fb46faa0 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:04.758560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10f6029b-4807-4a6c-9a2d-b7a1fb46faa0 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:04.759235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10f6029b-4807-4a6c-9a2d-b7a1fb46faa0 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:04.761729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10f6029b-4807-4a6c-9a2d-b7a1fb46faa0 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:04.763503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10f6029b-4807-4a6c-9a2d-b7a1fb46faa0 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:04.767458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10f6029b-4807-4a6c-9a2d-b7a1fb46faa0 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:05.276410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10f6029b-4807-4a6c-9a2d-b7a1fb46faa0 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:05.285872 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10f6029b-4807-4a6c-9a2d-b7a1fb46faa0 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1325 microversion: 2.1 time: 0.558226 Sep 10 21:03:05.300894 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2007/3926] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:04 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1325 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:05.318797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-79c254fc-535f-4a27-b941-82053a3a685d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:05.319914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-79c254fc-535f-4a27-b941-82053a3a685d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:05.333271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79c254fc-535f-4a27-b941-82053a3a685d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:05.334110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79c254fc-535f-4a27-b941-82053a3a685d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:05.338914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79c254fc-535f-4a27-b941-82053a3a685d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:05.340079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79c254fc-535f-4a27-b941-82053a3a685d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:05.341467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79c254fc-535f-4a27-b941-82053a3a685d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:05.342427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79c254fc-535f-4a27-b941-82053a3a685d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:05.411032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-092e39eb-cd7e-4dcc-a4f7-d37b0b8fb03d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:05.432292 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-092e39eb-cd7e-4dcc-a4f7-d37b0b8fb03d tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1317 microversion: 2.1 time: 2.541973 Sep 10 21:03:05.434179 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1920/3927] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:02 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1317 bytes in 2545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:05.454032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-79c254fc-535f-4a27-b941-82053a3a685d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:05.468634 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-79c254fc-535f-4a27-b941-82053a3a685d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1273 microversion: 2.1 time: 0.165181 Sep 10 21:03:05.475673 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2008/3928] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:05 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:06.323295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-060e9234-0d4a-4383-bf2e-0e4e260507cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:06.323950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-060e9234-0d4a-4383-bf2e-0e4e260507cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:06.343116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-060e9234-0d4a-4383-bf2e-0e4e260507cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:06.344277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-060e9234-0d4a-4383-bf2e-0e4e260507cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:06.345873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-060e9234-0d4a-4383-bf2e-0e4e260507cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:06.347648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-060e9234-0d4a-4383-bf2e-0e4e260507cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:06.351762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-060e9234-0d4a-4383-bf2e-0e4e260507cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:06.352878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-060e9234-0d4a-4383-bf2e-0e4e260507cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:06.471562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21dd1c2f-7859-4d73-929e-1e938d682d94 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:06.472490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21dd1c2f-7859-4d73-929e-1e938d682d94 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:06.485252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21dd1c2f-7859-4d73-929e-1e938d682d94 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:06.486735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21dd1c2f-7859-4d73-929e-1e938d682d94 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:06.487649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21dd1c2f-7859-4d73-929e-1e938d682d94 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:06.489073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21dd1c2f-7859-4d73-929e-1e938d682d94 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:06.489704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21dd1c2f-7859-4d73-929e-1e938d682d94 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:06.491178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21dd1c2f-7859-4d73-929e-1e938d682d94 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:06.787089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-060e9234-0d4a-4383-bf2e-0e4e260507cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:06.807928 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-060e9234-0d4a-4383-bf2e-0e4e260507cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1325 microversion: 2.1 time: 0.486488 Sep 10 21:03:06.815803 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1921/3929] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:06 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1325 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:06.824124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f01c834-10df-4f92-902a-a55c13d99d74 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:06.830822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f01c834-10df-4f92-902a-a55c13d99d74 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:06.845323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f01c834-10df-4f92-902a-a55c13d99d74 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:06.846217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f01c834-10df-4f92-902a-a55c13d99d74 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:06.847139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f01c834-10df-4f92-902a-a55c13d99d74 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:06.848187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f01c834-10df-4f92-902a-a55c13d99d74 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:06.850407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f01c834-10df-4f92-902a-a55c13d99d74 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:06.851091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f01c834-10df-4f92-902a-a55c13d99d74 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:06.995456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-21dd1c2f-7859-4d73-929e-1e938d682d94 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:07.006872 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21dd1c2f-7859-4d73-929e-1e938d682d94 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1317 microversion: 2.1 time: 0.542984 Sep 10 21:03:07.009919 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2009/3930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:06 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:07.063162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c78251fd-d262-43d2-8b82-ec5b6b667d2a req-12f2ca0b-158c-44da-8f08-78e115d8ae12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b134814a-9577-41e9-93ca-b32554a68b25", "name": "network-vif-plugged", "status": "completed", "tag": "e58b76c6-7f0d-4130-adc7-aee72db4887d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:07.090697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c78251fd-d262-43d2-8b82-ec5b6b667d2a req-12f2ca0b-158c-44da-8f08-78e115d8ae12 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:07.095412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c78251fd-d262-43d2-8b82-ec5b6b667d2a req-12f2ca0b-158c-44da-8f08-78e115d8ae12 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:07.099276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c78251fd-d262-43d2-8b82-ec5b6b667d2a req-12f2ca0b-158c-44da-8f08-78e115d8ae12 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:07.167975 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c78251fd-d262-43d2-8b82-ec5b6b667d2a req-12f2ca0b-158c-44da-8f08-78e115d8ae12 service nova] Creating event network-vif-plugged:e58b76c6-7f0d-4130-adc7-aee72db4887d for instance b134814a-9577-41e9-93ca-b32554a68b25 on nch1-master-1 Sep 10 21:03:07.186794 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c78251fd-d262-43d2-8b82-ec5b6b667d2a req-12f2ca0b-158c-44da-8f08-78e115d8ae12 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128658 Sep 10 21:03:07.192142 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2010/3931] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 10 21:03:07.843727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a7cda3f0-d5d1-4e24-a4b3-fd60da7b21cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:07.845460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a7cda3f0-d5d1-4e24-a4b3-fd60da7b21cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:07.862202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7cda3f0-d5d1-4e24-a4b3-fd60da7b21cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:07.864568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7cda3f0-d5d1-4e24-a4b3-fd60da7b21cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:07.865806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7cda3f0-d5d1-4e24-a4b3-fd60da7b21cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:07.868815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7cda3f0-d5d1-4e24-a4b3-fd60da7b21cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:07.869526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7cda3f0-d5d1-4e24-a4b3-fd60da7b21cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:07.870911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7cda3f0-d5d1-4e24-a4b3-fd60da7b21cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:08.022660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f01c834-10df-4f92-902a-a55c13d99d74 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:08.037671 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f01c834-10df-4f92-902a-a55c13d99d74 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1315 microversion: 2.1 time: 1.219615 Sep 10 21:03:08.046221 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1922/3932] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:06 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1315 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:08.079577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab8fbab3-652c-4a91-be62-971eb9d068ac tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:08.080465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ab8fbab3-652c-4a91-be62-971eb9d068ac tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:08.097553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8fbab3-652c-4a91-be62-971eb9d068ac tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:08.098351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8fbab3-652c-4a91-be62-971eb9d068ac tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:08.099297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8fbab3-652c-4a91-be62-971eb9d068ac tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:08.101505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8fbab3-652c-4a91-be62-971eb9d068ac tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:08.107836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8fbab3-652c-4a91-be62-971eb9d068ac tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:08.108659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab8fbab3-652c-4a91-be62-971eb9d068ac tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:08.577235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a7cda3f0-d5d1-4e24-a4b3-fd60da7b21cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:08.602317 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a7cda3f0-d5d1-4e24-a4b3-fd60da7b21cc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1325 microversion: 2.1 time: 0.758110 Sep 10 21:03:08.603062 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2011/3933] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:07 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1325 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:09.005224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:09.081950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59e3a061-44b1-4f5b-9c3f-32fb553c7c47 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:09.083246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59e3a061-44b1-4f5b-9c3f-32fb553c7c47 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:09.102800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3a061-44b1-4f5b-9c3f-32fb553c7c47 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:09.103750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3a061-44b1-4f5b-9c3f-32fb553c7c47 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:09.104519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3a061-44b1-4f5b-9c3f-32fb553c7c47 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:09.105945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3a061-44b1-4f5b-9c3f-32fb553c7c47 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:09.112390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3a061-44b1-4f5b-9c3f-32fb553c7c47 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:09.113268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3a061-44b1-4f5b-9c3f-32fb553c7c47 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:09.523188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab8fbab3-652c-4a91-be62-971eb9d068ac tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:09.539643 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab8fbab3-652c-4a91-be62-971eb9d068ac tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1317 microversion: 2.1 time: 1.483006 Sep 10 21:03:09.542044 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1923/3934] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:08 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1317 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:09.662524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7313128a-f027-4467-8612-5618d0792a6e tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:09.663629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7313128a-f027-4467-8612-5618d0792a6e tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:09.674171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7313128a-f027-4467-8612-5618d0792a6e tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:09.675100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7313128a-f027-4467-8612-5618d0792a6e tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:09.675765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7313128a-f027-4467-8612-5618d0792a6e tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:09.678031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7313128a-f027-4467-8612-5618d0792a6e tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:09.679239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7313128a-f027-4467-8612-5618d0792a6e tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:09.680519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7313128a-f027-4467-8612-5618d0792a6e tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:10.000122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:10.257945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-59e3a061-44b1-4f5b-9c3f-32fb553c7c47 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:10.275116 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59e3a061-44b1-4f5b-9c3f-32fb553c7c47 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1315 microversion: 2.1 time: 1.195835 Sep 10 21:03:10.275887 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2012/3935] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:09 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1315 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:10.485121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7313128a-f027-4467-8612-5618d0792a6e tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:10.497473 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7313128a-f027-4467-8612-5618d0792a6e tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1325 microversion: 2.1 time: 0.851309 Sep 10 21:03:10.500278 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1924/3936] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:09 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1325 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:10.574849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e6315fb-a61c-4aa5-9311-6abf9f33a6ea tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:10.575973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3e6315fb-a61c-4aa5-9311-6abf9f33a6ea tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:10.585841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e6315fb-a61c-4aa5-9311-6abf9f33a6ea tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:10.592751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e6315fb-a61c-4aa5-9311-6abf9f33a6ea tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:10.594343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e6315fb-a61c-4aa5-9311-6abf9f33a6ea tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:10.595366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e6315fb-a61c-4aa5-9311-6abf9f33a6ea tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:10.596055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e6315fb-a61c-4aa5-9311-6abf9f33a6ea tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:10.596712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e6315fb-a61c-4aa5-9311-6abf9f33a6ea tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:11.029044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3e6315fb-a61c-4aa5-9311-6abf9f33a6ea tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:11.062087 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3e6315fb-a61c-4aa5-9311-6abf9f33a6ea tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1317 microversion: 2.1 time: 0.491795 Sep 10 21:03:11.063345 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2013/3937] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:10 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:11.302686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4aefe622-1731-4e2b-a862-becc0fab2ea8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:11.303985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4aefe622-1731-4e2b-a862-becc0fab2ea8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:11.311692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:11.314809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aefe622-1731-4e2b-a862-becc0fab2ea8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:11.317028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aefe622-1731-4e2b-a862-becc0fab2ea8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:11.317748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aefe622-1731-4e2b-a862-becc0fab2ea8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:11.318773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aefe622-1731-4e2b-a862-becc0fab2ea8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:11.319516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aefe622-1731-4e2b-a862-becc0fab2ea8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:11.320381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4aefe622-1731-4e2b-a862-becc0fab2ea8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:11.529178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bff12160-fc83-4ea0-9030-ec93065805dc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:11.529857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bff12160-fc83-4ea0-9030-ec93065805dc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:11.624705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff12160-fc83-4ea0-9030-ec93065805dc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:11.625563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff12160-fc83-4ea0-9030-ec93065805dc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:11.639107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff12160-fc83-4ea0-9030-ec93065805dc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:11.640618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff12160-fc83-4ea0-9030-ec93065805dc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:11.641686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff12160-fc83-4ea0-9030-ec93065805dc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:11.646964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bff12160-fc83-4ea0-9030-ec93065805dc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:12.259734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bff12160-fc83-4ea0-9030-ec93065805dc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:12.294731 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bff12160-fc83-4ea0-9030-ec93065805dc tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1522 microversion: 2.1 time: 0.770777 Sep 10 21:03:12.297777 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2014/3938] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:11 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1522 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:12.316586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-5c3dae26-0406-400d-bc3c-7caec18887f4 req-338d34e8-25ac-4e2e-8155-4a2a4df14bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be32989-55a9-4f80-a36b-7e846b72fdca", "name": "network-vif-plugged", "status": "completed", "tag": "70b124a2-40a7-4db5-82bc-f4f4c2ef8627"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:12.344235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5c3dae26-0406-400d-bc3c-7caec18887f4 req-338d34e8-25ac-4e2e-8155-4a2a4df14bf2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:12.345000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5c3dae26-0406-400d-bc3c-7caec18887f4 req-338d34e8-25ac-4e2e-8155-4a2a4df14bf2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:12.363068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5c3dae26-0406-400d-bc3c-7caec18887f4 req-338d34e8-25ac-4e2e-8155-4a2a4df14bf2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:12.381904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4aefe622-1731-4e2b-a862-becc0fab2ea8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:12.397685 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4aefe622-1731-4e2b-a862-becc0fab2ea8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1315 microversion: 2.1 time: 1.098888 Sep 10 21:03:12.401958 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-5c3dae26-0406-400d-bc3c-7caec18887f4 req-338d34e8-25ac-4e2e-8155-4a2a4df14bf2 service nova] Creating event network-vif-plugged:70b124a2-40a7-4db5-82bc-f4f4c2ef8627 for instance 2be32989-55a9-4f80-a36b-7e846b72fdca on nch2-master-1 Sep 10 21:03:12.407505 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-5c3dae26-0406-400d-bc3c-7caec18887f4 req-338d34e8-25ac-4e2e-8155-4a2a4df14bf2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108265 Sep 10 21:03:12.408800 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2015/3940] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:12.412912 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1925/3940] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:11 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1315 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:12.415905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f8785333-1030-4772-b36e-9fe72be560a9 req-9f381938-d1fe-4ed4-bbac-0d51df9da4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b075e8a7-4b8d-41c4-876b-6c7e6efa95f3", "tag": "27e4a694-e943-4eba-9421-80138ba614dd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:12.436258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6fb2bcc4-fe48-476a-8f5e-6f67ad57a7ab tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:12.437225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6fb2bcc4-fe48-476a-8f5e-6f67ad57a7ab tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:12.449238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fb2bcc4-fe48-476a-8f5e-6f67ad57a7ab tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:12.451663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fb2bcc4-fe48-476a-8f5e-6f67ad57a7ab tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:12.455758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fb2bcc4-fe48-476a-8f5e-6f67ad57a7ab tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:12.456717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fb2bcc4-fe48-476a-8f5e-6f67ad57a7ab tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:12.458379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fb2bcc4-fe48-476a-8f5e-6f67ad57a7ab tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:12.459619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fb2bcc4-fe48-476a-8f5e-6f67ad57a7ab tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:12.476266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f8785333-1030-4772-b36e-9fe72be560a9 req-9f381938-d1fe-4ed4-bbac-0d51df9da4e0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:12.476782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f8785333-1030-4772-b36e-9fe72be560a9 req-9f381938-d1fe-4ed4-bbac-0d51df9da4e0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:12.477515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f8785333-1030-4772-b36e-9fe72be560a9 req-9f381938-d1fe-4ed4-bbac-0d51df9da4e0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:12.548358 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f8785333-1030-4772-b36e-9fe72be560a9 req-9f381938-d1fe-4ed4-bbac-0d51df9da4e0 service nova] Creating event network-changed:27e4a694-e943-4eba-9421-80138ba614dd for instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 on nch2-master-1 Sep 10 21:03:12.581198 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f8785333-1030-4772-b36e-9fe72be560a9 req-9f381938-d1fe-4ed4-bbac-0d51df9da4e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170452 Sep 10 21:03:12.584911 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2016/3941] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:12.607371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:12.640282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:12.662037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:12.663296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:12.685629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:12.691162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:12.695913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:12.697272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:12.777294 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] HTTP exception thrown: Instance is not a member of specified network Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Request method failure captured: Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25/ips/invalid HTTP/1.1 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtzra33rznuySghPAQqQNLUIECk71t5Z3gzv8LZ7XvZ6iJNOji89S80UgWWmGCyW8O8a2NhjvhxNRNLxseH4wVgBtDwQ6VB4UiQ7eKU58wBRxit1m4JTpsgQ2VhEoOedo6Lo-2bt_DaR5cPRy2XglvCKR7k6AKudZ78eEmLVnkOks8 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: daa76318457c400b80564b1035b25633 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-746823336 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daa76318457c400b80564b1035b25633"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daa76318457c400b80564b1035b25633"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daa76318457c400b80564b1035b25633", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daa76318457c400b80564b1035b25633"}]}] Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-746823336 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: daa76318457c400b80564b1035b25633 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-746823336 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerAddressesNegativeTestJSON-746823336-project Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: edef2887c6b741108da9b88745486339 Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-746823336-project Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance is not a member of specified network Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'server_id': 'b134814a-9577-41e9-93ca-b32554a68b25', 'id': 'invalid'} Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 10 21:03:12.793194 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:12.801418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Returning 404 to user: Instance is not a member of specified network {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:03:12.801418 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-70e904da-f890-4bfd-a454-eefb6744c946 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.207135 Sep 10 21:03:12.801418 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2017/3942] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:03:12 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25/ips/invalid => generated 91 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 21:03:12.821784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86286e7d-91d9-4172-af1e-9d6e90575374 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:12.822654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-86286e7d-91d9-4172-af1e-9d6e90575374 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Failed to fetch instance by id 999 {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 21:03:12.824633 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-86286e7d-91d9-4172-af1e-9d6e90575374 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] HTTP exception thrown: Instance 999 could not be found. Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86286e7d-91d9-4172-af1e-9d6e90575374 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Request method failure captured: Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtzra33rznuySghPAQqQNLUIECk71t5Z3gzv8LZ7XvZ6iJNOji89S80UgWWmGCyW8O8a2NhjvhxNRNLxseH4wVgBtDwQ6VB4UiQ7eKU58wBRxit1m4JTpsgQ2VhEoOedo6Lo-2bt_DaR5cPRy2XglvCKR7k6AKudZ78eEmLVnkOks8 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: daa76318457c400b80564b1035b25633 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-746823336 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daa76318457c400b80564b1035b25633"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daa76318457c400b80564b1035b25633"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daa76318457c400b80564b1035b25633", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daa76318457c400b80564b1035b25633"}]}] Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-746823336 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: daa76318457c400b80564b1035b25633 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-746823336 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerAddressesNegativeTestJSON-746823336-project Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: edef2887c6b741108da9b88745486339 Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-746823336-project Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 999 could not be found. Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'server_id': '999'} Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 10 21:03:12.830304 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:12.838677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86286e7d-91d9-4172-af1e-9d6e90575374 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Returning 404 to user: Instance 999 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:03:12.841686 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-86286e7d-91d9-4172-af1e-9d6e90575374 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.028074 Sep 10 21:03:12.849936 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2018/3943] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 21:03:12 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 21:03:12.857542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b65dfc4b-3fa0-4252-be68-419c5d1a5936 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:12.858732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b65dfc4b-3fa0-4252-be68-419c5d1a5936 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:12.871422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b65dfc4b-3fa0-4252-be68-419c5d1a5936 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:12.872340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b65dfc4b-3fa0-4252-be68-419c5d1a5936 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:12.877852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b65dfc4b-3fa0-4252-be68-419c5d1a5936 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:12.879755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b65dfc4b-3fa0-4252-be68-419c5d1a5936 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:12.881014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b65dfc4b-3fa0-4252-be68-419c5d1a5936 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:12.882734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b65dfc4b-3fa0-4252-be68-419c5d1a5936 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:12.954886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b65dfc4b-3fa0-4252-be68-419c5d1a5936 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:03:13.155474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6fb2bcc4-fe48-476a-8f5e-6f67ad57a7ab tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:13.174529 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6fb2bcc4-fe48-476a-8f5e-6f67ad57a7ab tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1317 microversion: 2.1 time: 0.760017 Sep 10 21:03:13.175076 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1926/3944] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:12 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1317 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:13.237107 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b65dfc4b-3fa0-4252-be68-419c5d1a5936 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 204 len: 0 microversion: 2.1 time: 0.357680 Sep 10 21:03:13.237107 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2019/3945] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:03:12 2022] DELETE /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:03:13.237959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29e27d1e-4958-4778-a382-a1b02ee64b39 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:13.237959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-29e27d1e-4958-4778-a382-a1b02ee64b39 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:13.261411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29e27d1e-4958-4778-a382-a1b02ee64b39 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:13.261978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29e27d1e-4958-4778-a382-a1b02ee64b39 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:13.262996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29e27d1e-4958-4778-a382-a1b02ee64b39 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:13.263937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29e27d1e-4958-4778-a382-a1b02ee64b39 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:13.264443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29e27d1e-4958-4778-a382-a1b02ee64b39 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:13.264903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29e27d1e-4958-4778-a382-a1b02ee64b39 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:13.367981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:13.428636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f464866a-8152-4b3e-94ad-82402fa85650 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:13.429344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f464866a-8152-4b3e-94ad-82402fa85650 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:13.444381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f464866a-8152-4b3e-94ad-82402fa85650 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:13.444745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f464866a-8152-4b3e-94ad-82402fa85650 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:13.445188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f464866a-8152-4b3e-94ad-82402fa85650 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:13.445942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f464866a-8152-4b3e-94ad-82402fa85650 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:13.446415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f464866a-8152-4b3e-94ad-82402fa85650 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:13.446842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f464866a-8152-4b3e-94ad-82402fa85650 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:13.604674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-29e27d1e-4958-4778-a382-a1b02ee64b39 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:13.614166 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-29e27d1e-4958-4778-a382-a1b02ee64b39 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1528 microversion: 2.1 time: 0.394460 Sep 10 21:03:13.615275 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1927/3946] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:13 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1528 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:13.933523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f464866a-8152-4b3e-94ad-82402fa85650 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:13.943976 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f464866a-8152-4b3e-94ad-82402fa85650 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1315 microversion: 2.1 time: 0.519306 Sep 10 21:03:13.944585 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2020/3947] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:13 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:14.207414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b53fe42a-e7f2-4425-90d4-1f48799afed1 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:14.208395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b53fe42a-e7f2-4425-90d4-1f48799afed1 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:14.214838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b53fe42a-e7f2-4425-90d4-1f48799afed1 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:14.215326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b53fe42a-e7f2-4425-90d4-1f48799afed1 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:14.216246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b53fe42a-e7f2-4425-90d4-1f48799afed1 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:14.217526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b53fe42a-e7f2-4425-90d4-1f48799afed1 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:14.218399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b53fe42a-e7f2-4425-90d4-1f48799afed1 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:14.218997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b53fe42a-e7f2-4425-90d4-1f48799afed1 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:14.405783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b53fe42a-e7f2-4425-90d4-1f48799afed1 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:14.431809 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b53fe42a-e7f2-4425-90d4-1f48799afed1 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1317 microversion: 2.1 time: 0.228079 Sep 10 21:03:14.432705 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1928/3948] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:14 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:14.436922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6a4f2e5f-33f8-404f-a83f-d6fc9ff198a3 req-37b04c51-886b-411a-9b88-d67bb437054d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f6143f-f25d-402b-9361-af366b1fb20d", "name": "network-vif-plugged", "status": "completed", "tag": "cbd2c763-a952-4e35-853b-1ba7b14348de"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:14.471386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6a4f2e5f-33f8-404f-a83f-d6fc9ff198a3 req-37b04c51-886b-411a-9b88-d67bb437054d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:14.483375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6a4f2e5f-33f8-404f-a83f-d6fc9ff198a3 req-37b04c51-886b-411a-9b88-d67bb437054d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:14.484885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6a4f2e5f-33f8-404f-a83f-d6fc9ff198a3 req-37b04c51-886b-411a-9b88-d67bb437054d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:14.493603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:14.508576 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6a4f2e5f-33f8-404f-a83f-d6fc9ff198a3 req-37b04c51-886b-411a-9b88-d67bb437054d service nova] Creating event network-vif-plugged:cbd2c763-a952-4e35-853b-1ba7b14348de for instance b2f6143f-f25d-402b-9361-af366b1fb20d on nch1-master-1 Sep 10 21:03:14.515279 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6a4f2e5f-33f8-404f-a83f-d6fc9ff198a3 req-37b04c51-886b-411a-9b88-d67bb437054d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088391 Sep 10 21:03:14.516254 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2021/3949] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:14.640275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7496afcb-062e-46e5-a778-d95640aab947 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:14.641644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7496afcb-062e-46e5-a778-d95640aab947 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:14.649766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7496afcb-062e-46e5-a778-d95640aab947 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:14.650648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7496afcb-062e-46e5-a778-d95640aab947 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:14.651342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7496afcb-062e-46e5-a778-d95640aab947 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:14.652423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7496afcb-062e-46e5-a778-d95640aab947 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:14.654245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7496afcb-062e-46e5-a778-d95640aab947 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:14.655546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7496afcb-062e-46e5-a778-d95640aab947 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:14.977018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1fb2c92a-4ce0-4090-b78f-250c2c7c44b3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:14.977795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1fb2c92a-4ce0-4090-b78f-250c2c7c44b3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:15.011415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb2c92a-4ce0-4090-b78f-250c2c7c44b3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:15.012034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb2c92a-4ce0-4090-b78f-250c2c7c44b3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:15.013244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb2c92a-4ce0-4090-b78f-250c2c7c44b3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:15.014042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb2c92a-4ce0-4090-b78f-250c2c7c44b3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:15.014511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb2c92a-4ce0-4090-b78f-250c2c7c44b3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:15.014973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb2c92a-4ce0-4090-b78f-250c2c7c44b3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:15.374147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7496afcb-062e-46e5-a778-d95640aab947 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:15.392813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1fb2c92a-4ce0-4090-b78f-250c2c7c44b3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:15.403565 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1fb2c92a-4ce0-4090-b78f-250c2c7c44b3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1315 microversion: 2.1 time: 0.431219 Sep 10 21:03:15.405212 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7496afcb-062e-46e5-a778-d95640aab947 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1528 microversion: 2.1 time: 0.768747 Sep 10 21:03:15.409901 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1929/3950] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:14 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1528 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:15.422472 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2022/3951] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:14 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:15.459133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-665d8abe-6059-4674-b956-7af86b60b27e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:15.460197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-665d8abe-6059-4674-b956-7af86b60b27e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:15.470743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-665d8abe-6059-4674-b956-7af86b60b27e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:15.471146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-665d8abe-6059-4674-b956-7af86b60b27e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:15.471923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-665d8abe-6059-4674-b956-7af86b60b27e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:15.472887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-665d8abe-6059-4674-b956-7af86b60b27e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:15.473570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-665d8abe-6059-4674-b956-7af86b60b27e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:15.474583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-665d8abe-6059-4674-b956-7af86b60b27e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:16.441094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea04f717-89f8-443c-af42-99b2b1269842 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:16.443976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ea04f717-89f8-443c-af42-99b2b1269842 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:16.461619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea04f717-89f8-443c-af42-99b2b1269842 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:16.463721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea04f717-89f8-443c-af42-99b2b1269842 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:16.466524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea04f717-89f8-443c-af42-99b2b1269842 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:16.467941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea04f717-89f8-443c-af42-99b2b1269842 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:16.468836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea04f717-89f8-443c-af42-99b2b1269842 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:16.471080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea04f717-89f8-443c-af42-99b2b1269842 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:16.856568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-665d8abe-6059-4674-b956-7af86b60b27e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:16.877606 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-665d8abe-6059-4674-b956-7af86b60b27e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1317 microversion: 2.1 time: 1.424162 Sep 10 21:03:16.878460 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1930/3952] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:15 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1317 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:16.883424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d41c3024-46c3-48b9-a468-d4d844c9e014 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:16.884108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d41c3024-46c3-48b9-a468-d4d844c9e014 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:16.898143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d41c3024-46c3-48b9-a468-d4d844c9e014 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:16.898653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d41c3024-46c3-48b9-a468-d4d844c9e014 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:16.899309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d41c3024-46c3-48b9-a468-d4d844c9e014 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:16.902532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d41c3024-46c3-48b9-a468-d4d844c9e014 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:16.903370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d41c3024-46c3-48b9-a468-d4d844c9e014 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:16.903919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d41c3024-46c3-48b9-a468-d4d844c9e014 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:17.152431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ea04f717-89f8-443c-af42-99b2b1269842 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:17.167855 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea04f717-89f8-443c-af42-99b2b1269842 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1528 microversion: 2.1 time: 0.733314 Sep 10 21:03:17.192319 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2023/3953] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:16 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1528 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:17.327351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d41c3024-46c3-48b9-a468-d4d844c9e014 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:17.344615 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d41c3024-46c3-48b9-a468-d4d844c9e014 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1315 microversion: 2.1 time: 0.459676 Sep 10 21:03:17.345871 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1931/3954] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:16 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:17.583664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-64719879-bf83-42c1-9445-d987a20dbb25 req-9ff8b529-3df1-462f-8faa-ff40a46e3af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b134814a-9577-41e9-93ca-b32554a68b25", "name": "network-vif-deleted", "tag": "e58b76c6-7f0d-4130-adc7-aee72db4887d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:17.628085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-64719879-bf83-42c1-9445-d987a20dbb25 req-9ff8b529-3df1-462f-8faa-ff40a46e3af6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:17.630447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-64719879-bf83-42c1-9445-d987a20dbb25 req-9ff8b529-3df1-462f-8faa-ff40a46e3af6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:17.633455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-64719879-bf83-42c1-9445-d987a20dbb25 req-9ff8b529-3df1-462f-8faa-ff40a46e3af6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:17.653710 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-64719879-bf83-42c1-9445-d987a20dbb25 req-9ff8b529-3df1-462f-8faa-ff40a46e3af6 service nova] Creating event network-vif-deleted:e58b76c6-7f0d-4130-adc7-aee72db4887d for instance b134814a-9577-41e9-93ca-b32554a68b25 on nch1-master-1 Sep 10 21:03:17.661579 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-64719879-bf83-42c1-9445-d987a20dbb25 req-9ff8b529-3df1-462f-8faa-ff40a46e3af6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086390 Sep 10 21:03:17.663049 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2024/3955] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:17.790492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-7b5235eb-2006-4c7f-b1fc-9d8d4bb2ef7b req-df6d6345-1ad9-46fe-8c28-49dd0f7cc4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b075e8a7-4b8d-41c4-876b-6c7e6efa95f3", "name": "network-vif-plugged", "status": "completed", "tag": "27e4a694-e943-4eba-9421-80138ba614dd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:17.827835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7b5235eb-2006-4c7f-b1fc-9d8d4bb2ef7b req-df6d6345-1ad9-46fe-8c28-49dd0f7cc4e4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:17.829756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7b5235eb-2006-4c7f-b1fc-9d8d4bb2ef7b req-df6d6345-1ad9-46fe-8c28-49dd0f7cc4e4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:17.831591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7b5235eb-2006-4c7f-b1fc-9d8d4bb2ef7b req-df6d6345-1ad9-46fe-8c28-49dd0f7cc4e4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:17.870866 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7b5235eb-2006-4c7f-b1fc-9d8d4bb2ef7b req-df6d6345-1ad9-46fe-8c28-49dd0f7cc4e4 service nova] Creating event network-vif-plugged:27e4a694-e943-4eba-9421-80138ba614dd for instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 on nch2-master-1 Sep 10 21:03:17.888282 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-7b5235eb-2006-4c7f-b1fc-9d8d4bb2ef7b req-df6d6345-1ad9-46fe-8c28-49dd0f7cc4e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105037 Sep 10 21:03:17.890601 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1932/3956] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:17.905547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ee0be97e-82c1-443d-8ae8-486bb8bbc7e4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:17.906549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ee0be97e-82c1-443d-8ae8-486bb8bbc7e4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:17.938390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee0be97e-82c1-443d-8ae8-486bb8bbc7e4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:17.952711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee0be97e-82c1-443d-8ae8-486bb8bbc7e4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:17.953299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee0be97e-82c1-443d-8ae8-486bb8bbc7e4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:17.959701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee0be97e-82c1-443d-8ae8-486bb8bbc7e4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:17.960196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee0be97e-82c1-443d-8ae8-486bb8bbc7e4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:17.979742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee0be97e-82c1-443d-8ae8-486bb8bbc7e4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:18.197490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:18.198348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:18.213623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:18.214180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:18.214636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:18.215493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:18.216189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:18.219428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:18.316666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:18.322640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:18.327320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:18.332495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lazy-loading 'fault' on Instance uuid b134814a-9577-41e9-93ca-b32554a68b25 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:03:18.466828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edef2887c6b741108da9b88745486339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa76318457c400b80564b1035b25633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:18.479812 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3205b7f2-1d13-4f7f-8ab9-04be5b9ac606 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 200 len: 1315 microversion: 2.1 time: 0.286728 Sep 10 21:03:18.481013 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1933/3957] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:18 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:18.483734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ee0be97e-82c1-443d-8ae8-486bb8bbc7e4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:18.488280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-69574487-a3b2-4517-b56c-60e8c1175b06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:18.489440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-69574487-a3b2-4517-b56c-60e8c1175b06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:18.498970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69574487-a3b2-4517-b56c-60e8c1175b06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:18.499926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69574487-a3b2-4517-b56c-60e8c1175b06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:18.500952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69574487-a3b2-4517-b56c-60e8c1175b06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:18.502087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69574487-a3b2-4517-b56c-60e8c1175b06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:18.502564 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ee0be97e-82c1-443d-8ae8-486bb8bbc7e4 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 200 len: 1505 microversion: 2.1 time: 0.603046 Sep 10 21:03:18.503091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69574487-a3b2-4517-b56c-60e8c1175b06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:18.504095 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2025/3958] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:17 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 1505 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:18.504845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69574487-a3b2-4517-b56c-60e8c1175b06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:18.532340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dafa20db-7be9-4c18-9600-000016e2fcbb tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:18.532879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dafa20db-7be9-4c18-9600-000016e2fcbb tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 2be32989-55a9-4f80-a36b-7e846b72fdca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:18.548141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dafa20db-7be9-4c18-9600-000016e2fcbb tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:18.552645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dafa20db-7be9-4c18-9600-000016e2fcbb tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:18.556941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dafa20db-7be9-4c18-9600-000016e2fcbb tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:18.569040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dafa20db-7be9-4c18-9600-000016e2fcbb tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:18.569536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dafa20db-7be9-4c18-9600-000016e2fcbb tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:18.570033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dafa20db-7be9-4c18-9600-000016e2fcbb tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:18.819474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-69574487-a3b2-4517-b56c-60e8c1175b06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:18.833880 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-69574487-a3b2-4517-b56c-60e8c1175b06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1315 microversion: 2.1 time: 0.350983 Sep 10 21:03:18.834818 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1934/3959] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:18 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:18.910664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dafa20db-7be9-4c18-9600-000016e2fcbb tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:18.923185 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dafa20db-7be9-4c18-9600-000016e2fcbb tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca" status: 200 len: 1504 microversion: 2.1 time: 0.395512 Sep 10 21:03:18.924364 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2026/3960] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:18 2022] GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:18.954593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e1219ee8-7725-4d46-a344-03cf2ca21b63 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:18.955319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e1219ee8-7725-4d46-a344-03cf2ca21b63 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 2be32989-55a9-4f80-a36b-7e846b72fdca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:18.966364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1219ee8-7725-4d46-a344-03cf2ca21b63 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:18.970222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1219ee8-7725-4d46-a344-03cf2ca21b63 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:18.970843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1219ee8-7725-4d46-a344-03cf2ca21b63 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:18.971800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1219ee8-7725-4d46-a344-03cf2ca21b63 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:18.972429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1219ee8-7725-4d46-a344-03cf2ca21b63 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:18.973477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1219ee8-7725-4d46-a344-03cf2ca21b63 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:19.039504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e1219ee8-7725-4d46-a344-03cf2ca21b63 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 2be32989-55a9-4f80-a36b-7e846b72fdca] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:03:19.299202 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e1219ee8-7725-4d46-a344-03cf2ca21b63 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca" status: 204 len: 0 microversion: 2.1 time: 0.348535 Sep 10 21:03:19.300538 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1935/3961] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:03:18 2022] DELETE /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:03:19.313063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6b8692ca-f506-45f8-bda4-2b8ace94eb5b tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:19.313997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6b8692ca-f506-45f8-bda4-2b8ace94eb5b tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:19.342452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b8692ca-f506-45f8-bda4-2b8ace94eb5b tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:19.363860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b8692ca-f506-45f8-bda4-2b8ace94eb5b tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:19.378742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b8692ca-f506-45f8-bda4-2b8ace94eb5b tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:19.379985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b8692ca-f506-45f8-bda4-2b8ace94eb5b tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:19.380655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b8692ca-f506-45f8-bda4-2b8ace94eb5b tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:19.381270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b8692ca-f506-45f8-bda4-2b8ace94eb5b tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:19.418586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6b8692ca-f506-45f8-bda4-2b8ace94eb5b tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:03:19.508691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:19.509769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] [instance: b134814a-9577-41e9-93ca-b32554a68b25] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:19.521013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:19.522700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:19.523327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:19.524356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:19.525927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:19.527112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:19.546544 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] HTTP exception thrown: Instance b134814a-9577-41e9-93ca-b32554a68b25 could not be found. Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Request method failure captured: Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 HTTP/1.1 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtzra33rznuySghPAQqQNLUIECk71t5Z3gzv8LZ7XvZ6iJNOji89S80UgWWmGCyW8O8a2NhjvhxNRNLxseH4wVgBtDwQ6VB4UiQ7eKU58wBRxit1m4JTpsgQ2VhEoOedo6Lo-2bt_DaR5cPRy2XglvCKR7k6AKudZ78eEmLVnkOks8 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: daa76318457c400b80564b1035b25633 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-746823336 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daa76318457c400b80564b1035b25633"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daa76318457c400b80564b1035b25633"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daa76318457c400b80564b1035b25633", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daa76318457c400b80564b1035b25633"}]}] Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-746823336 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: daa76318457c400b80564b1035b25633 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-746823336 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerAddressesNegativeTestJSON-746823336-project Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: edef2887c6b741108da9b88745486339 Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-746823336-project Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b134814a-9577-41e9-93ca-b32554a68b25 could not be found. Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b134814a-9577-41e9-93ca-b32554a68b25'} Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b134814a-9577-41e9-93ca-b32554a68b25 could not be found. Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b134814a-9577-41e9-93ca-b32554a68b25 could not be found. Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:19.548829 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b134814a-9577-41e9-93ca-b32554a68b25 could not be found. Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] Returning 404 to user: Instance b134814a-9577-41e9-93ca-b32554a68b25 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0200351e-2928-41eb-9d78-13248c123844 tempest-ServerAddressesNegativeTestJSON-746823336 tempest-ServerAddressesNegativeTestJSON-746823336-project] 10.222.0.33 "GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25" status: 404 len: 111 microversion: 2.1 time: 0.051063 Sep 10 21:03:19.563965 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1936/3962] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:19 2022] GET /compute/v2.1/servers/b134814a-9577-41e9-93ca-b32554a68b25 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:03:19.589582 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6b8692ca-f506-45f8-bda4-2b8ace94eb5b tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 204 len: 0 microversion: 2.1 time: 0.282661 Sep 10 21:03:19.591912 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2027/3963] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:03:19 2022] DELETE /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:03:19.601533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91660a1a-10b1-40f0-8420-842077a97bc2 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:19.602687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-91660a1a-10b1-40f0-8420-842077a97bc2 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 2be32989-55a9-4f80-a36b-7e846b72fdca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:19.614940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91660a1a-10b1-40f0-8420-842077a97bc2 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:19.615438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91660a1a-10b1-40f0-8420-842077a97bc2 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:19.617328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91660a1a-10b1-40f0-8420-842077a97bc2 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:19.618805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91660a1a-10b1-40f0-8420-842077a97bc2 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:19.619881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91660a1a-10b1-40f0-8420-842077a97bc2 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:19.620849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91660a1a-10b1-40f0-8420-842077a97bc2 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:19.869346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5b02af6f-f0e9-47c9-9e71-4810f1f77a5f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:19.871304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5b02af6f-f0e9-47c9-9e71-4810f1f77a5f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:19.888416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b02af6f-f0e9-47c9-9e71-4810f1f77a5f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:19.890947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b02af6f-f0e9-47c9-9e71-4810f1f77a5f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:19.895295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b02af6f-f0e9-47c9-9e71-4810f1f77a5f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:19.896884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b02af6f-f0e9-47c9-9e71-4810f1f77a5f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:19.903177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b02af6f-f0e9-47c9-9e71-4810f1f77a5f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:19.904780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b02af6f-f0e9-47c9-9e71-4810f1f77a5f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:20.105097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-91660a1a-10b1-40f0-8420-842077a97bc2 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:20.121362 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91660a1a-10b1-40f0-8420-842077a97bc2 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca" status: 200 len: 1510 microversion: 2.1 time: 0.524727 Sep 10 21:03:20.132986 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1937/3964] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:19 2022] GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca => generated 1510 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:20.192613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5b02af6f-f0e9-47c9-9e71-4810f1f77a5f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:20.207496 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5b02af6f-f0e9-47c9-9e71-4810f1f77a5f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1502 microversion: 2.1 time: 0.343271 Sep 10 21:03:20.223501 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2028/3965] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:19 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1502 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:21.155145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6a3849b2-1bcc-40e2-bac2-6c7654641fb8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:21.156561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6a3849b2-1bcc-40e2-bac2-6c7654641fb8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 2be32989-55a9-4f80-a36b-7e846b72fdca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:21.166824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a3849b2-1bcc-40e2-bac2-6c7654641fb8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:21.167652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a3849b2-1bcc-40e2-bac2-6c7654641fb8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:21.168573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a3849b2-1bcc-40e2-bac2-6c7654641fb8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:21.169519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a3849b2-1bcc-40e2-bac2-6c7654641fb8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:21.171887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a3849b2-1bcc-40e2-bac2-6c7654641fb8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:21.172589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a3849b2-1bcc-40e2-bac2-6c7654641fb8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:21.948201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-860456fb-4467-47a6-888f-cd644db33e93 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0751443e-5126-424c-9b52-c6cce5d4b589"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:21.957294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-860456fb-4467-47a6-888f-cd644db33e93 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:21.991200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-860456fb-4467-47a6-888f-cd644db33e93 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:21.992913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-860456fb-4467-47a6-888f-cd644db33e93 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:21.998010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-860456fb-4467-47a6-888f-cd644db33e93 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:22.001962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-860456fb-4467-47a6-888f-cd644db33e93 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:22.006183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-860456fb-4467-47a6-888f-cd644db33e93 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:22.011447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-860456fb-4467-47a6-888f-cd644db33e93 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:22.569054 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-860456fb-4467-47a6-888f-cd644db33e93 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627393 Sep 10 21:03:22.576225 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2029/3966] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:03:21 2022] POST /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3/os-volume_attachments => generated 194 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:22.601980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e116afaa-213c-4263-9468-d66d8b5d9557 req-c659a04a-54ba-4016-b4b1-7e088a29750a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f6143f-f25d-402b-9361-af366b1fb20d", "name": "network-vif-deleted", "tag": "cbd2c763-a952-4e35-853b-1ba7b14348de"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:22.655703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e116afaa-213c-4263-9468-d66d8b5d9557 req-c659a04a-54ba-4016-b4b1-7e088a29750a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:22.656652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e116afaa-213c-4263-9468-d66d8b5d9557 req-c659a04a-54ba-4016-b4b1-7e088a29750a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:22.659180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e116afaa-213c-4263-9468-d66d8b5d9557 req-c659a04a-54ba-4016-b4b1-7e088a29750a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:22.729477 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e116afaa-213c-4263-9468-d66d8b5d9557 req-c659a04a-54ba-4016-b4b1-7e088a29750a service nova] Creating event network-vif-deleted:cbd2c763-a952-4e35-853b-1ba7b14348de for instance b2f6143f-f25d-402b-9361-af366b1fb20d on nch1-master-1 Sep 10 21:03:22.769980 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e116afaa-213c-4263-9468-d66d8b5d9557 req-c659a04a-54ba-4016-b4b1-7e088a29750a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186433 Sep 10 21:03:22.777019 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2030/3967] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:23.307187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6a3849b2-1bcc-40e2-bac2-6c7654641fb8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:23.330545 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6a3849b2-1bcc-40e2-bac2-6c7654641fb8 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca" status: 200 len: 1510 microversion: 2.1 time: 2.181571 Sep 10 21:03:23.335728 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1938/3968] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:21 2022] GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca => generated 1510 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:24.036314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-84d3bc7e-f828-4086-8491-af5843a30d4b req-5a6f3367-8ec1-4157-94dd-7024d489ce74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be32989-55a9-4f80-a36b-7e846b72fdca", "name": "network-vif-deleted", "tag": "70b124a2-40a7-4db5-82bc-f4f4c2ef8627"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:24.056975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:24.077679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-84d3bc7e-f828-4086-8491-af5843a30d4b req-5a6f3367-8ec1-4157-94dd-7024d489ce74 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:24.078843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-84d3bc7e-f828-4086-8491-af5843a30d4b req-5a6f3367-8ec1-4157-94dd-7024d489ce74 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:24.079588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-84d3bc7e-f828-4086-8491-af5843a30d4b req-5a6f3367-8ec1-4157-94dd-7024d489ce74 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:24.150961 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-84d3bc7e-f828-4086-8491-af5843a30d4b req-5a6f3367-8ec1-4157-94dd-7024d489ce74 service nova] Creating event network-vif-deleted:70b124a2-40a7-4db5-82bc-f4f4c2ef8627 for instance 2be32989-55a9-4f80-a36b-7e846b72fdca on nch2-master-1 Sep 10 21:03:24.174453 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-84d3bc7e-f828-4086-8491-af5843a30d4b req-5a6f3367-8ec1-4157-94dd-7024d489ce74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142352 Sep 10 21:03:24.177364 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2031/3969] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:24.366523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:24.368202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 2be32989-55a9-4f80-a36b-7e846b72fdca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:24.385579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:24.386655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:24.388268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:24.389314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:24.392047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:24.396050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:24.499335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:24.499869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:24.500325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:24.500793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lazy-loading 'fault' on Instance uuid 2be32989-55a9-4f80-a36b-7e846b72fdca {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:03:24.862116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f50ca756d594703846f1dade2d38eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd2cd4bb350d452eb8c5e2533642c0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:24.874959 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b1cd4167-c97f-4223-ab35-19e0d511cce9 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca" status: 200 len: 1307 microversion: 2.1 time: 0.512692 Sep 10 21:03:24.877959 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1939/3970] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:24 2022] GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca => generated 1307 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:25.905465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:25.907068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: 2be32989-55a9-4f80-a36b-7e846b72fdca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:25.936373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:25.942479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:25.945359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:25.946483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:25.953223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:25.953994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:25.999567 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] HTTP exception thrown: Instance 2be32989-55a9-4f80-a36b-7e846b72fdca could not be found. Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Request method failure captured: Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca HTTP/1.1 Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtRt6IF1RdpfdWml1RHVONc86qYL4-acviSmpBuoV2X5CFf2aThYG7x6KGHv7CDdueIDYcHCIyWJD_lk6RDBwjyNG-mPpWZYVGiR_SJJlahe7UxUtzqA9MK2Pk-fY0WMB2ZODfGPSm55GLScAdlJ3S7UfcsKoUMYSEqfoC4ghkldSk Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: dd2cd4bb350d452eb8c5e2533642c0f0 Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-MultipleCreateTestJSON-1986867882 Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd2cd4bb350d452eb8c5e2533642c0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd2cd4bb350d452eb8c5e2533642c0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd2cd4bb350d452eb8c5e2533642c0f0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd2cd4bb350d452eb8c5e2533642c0f0"}]}] Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-MultipleCreateTestJSON-1986867882 Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: dd2cd4bb350d452eb8c5e2533642c0f0 Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1986867882 Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-MultipleCreateTestJSON-1986867882-project Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6f50ca756d594703846f1dade2d38eac Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-MultipleCreateTestJSON-1986867882-project Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 2be32989-55a9-4f80-a36b-7e846b72fdca could not be found. Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2be32989-55a9-4f80-a36b-7e846b72fdca'} Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be32989-55a9-4f80-a36b-7e846b72fdca could not be found. Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be32989-55a9-4f80-a36b-7e846b72fdca could not be found. Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:26.002534 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:26.013218 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:26.013218 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:26.013218 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:26.013218 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:03:26.013218 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:03:26.013218 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be32989-55a9-4f80-a36b-7e846b72fdca could not be found. Sep 10 21:03:26.013218 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:26.016726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Returning 404 to user: Instance 2be32989-55a9-4f80-a36b-7e846b72fdca could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:03:26.018128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-28cbfd43-b9df-4e73-9b28-15346fb9683e tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca" status: 404 len: 111 microversion: 2.1 time: 0.118806 Sep 10 21:03:26.019215 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2032/3971] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:25 2022] GET /compute/v2.1/servers/2be32989-55a9-4f80-a36b-7e846b72fdca => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:03:26.027624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:26.030452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] [instance: b2f6143f-f25d-402b-9361-af366b1fb20d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:26.053894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:26.058388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:26.059484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:26.060610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:26.061091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:26.075900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:26.094140 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] HTTP exception thrown: Instance b2f6143f-f25d-402b-9361-af366b1fb20d could not be found. Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Request method failure captured: Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d HTTP/1.1 Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtRt6IF1RdpfdWml1RHVONc86qYL4-acviSmpBuoV2X5CFf2aThYG7x6KGHv7CDdueIDYcHCIyWJD_lk6RDBwjyNG-mPpWZYVGiR_SJJlahe7UxUtzqA9MK2Pk-fY0WMB2ZODfGPSm55GLScAdlJ3S7UfcsKoUMYSEqfoC4ghkldSk Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: dd2cd4bb350d452eb8c5e2533642c0f0 Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-MultipleCreateTestJSON-1986867882 Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd2cd4bb350d452eb8c5e2533642c0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd2cd4bb350d452eb8c5e2533642c0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd2cd4bb350d452eb8c5e2533642c0f0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd2cd4bb350d452eb8c5e2533642c0f0"}]}] Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-MultipleCreateTestJSON-1986867882 Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: dd2cd4bb350d452eb8c5e2533642c0f0 Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1986867882 Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-MultipleCreateTestJSON-1986867882-project Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6f50ca756d594703846f1dade2d38eac Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-MultipleCreateTestJSON-1986867882-project Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b2f6143f-f25d-402b-9361-af366b1fb20d could not be found. Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b2f6143f-f25d-402b-9361-af366b1fb20d'} Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f6143f-f25d-402b-9361-af366b1fb20d could not be found. Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f6143f-f25d-402b-9361-af366b1fb20d could not be found. Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:26.095739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:26.103592 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:26.103592 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:26.103592 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:26.103592 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:03:26.103592 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:03:26.103592 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f6143f-f25d-402b-9361-af366b1fb20d could not be found. Sep 10 21:03:26.103592 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:26.103592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] Returning 404 to user: Instance b2f6143f-f25d-402b-9361-af366b1fb20d could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:03:26.103592 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6fee59bd-901d-4b9c-ae24-5665c7bd7c52 tempest-MultipleCreateTestJSON-1986867882 tempest-MultipleCreateTestJSON-1986867882-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d" status: 404 len: 111 microversion: 2.1 time: 0.073724 Sep 10 21:03:26.103592 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1940/3972] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:26 2022] GET /compute/v2.1/servers/b2f6143f-f25d-402b-9361-af366b1fb20d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:03:28.695807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3879d06e-39f3-4bc5-aa47-b85de0ccb5cb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:28.696351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3879d06e-39f3-4bc5-aa47-b85de0ccb5cb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:28.717437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3879d06e-39f3-4bc5-aa47-b85de0ccb5cb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:28.718900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3879d06e-39f3-4bc5-aa47-b85de0ccb5cb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:28.719541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3879d06e-39f3-4bc5-aa47-b85de0ccb5cb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:28.720485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3879d06e-39f3-4bc5-aa47-b85de0ccb5cb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:28.732421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3879d06e-39f3-4bc5-aa47-b85de0ccb5cb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:28.733169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3879d06e-39f3-4bc5-aa47-b85de0ccb5cb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:28.782417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3879d06e-39f3-4bc5-aa47-b85de0ccb5cb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:03:29.038766 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3879d06e-39f3-4bc5-aa47-b85de0ccb5cb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 204 len: 0 microversion: 2.1 time: 0.347913 Sep 10 21:03:29.040080 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2033/3973] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:03:28 2022] DELETE /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:03:29.051299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-96cad3c9-8cb3-49b7-9e76-871d04968938 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:29.051933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-96cad3c9-8cb3-49b7-9e76-871d04968938 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:29.069958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96cad3c9-8cb3-49b7-9e76-871d04968938 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:29.075153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96cad3c9-8cb3-49b7-9e76-871d04968938 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:29.077802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96cad3c9-8cb3-49b7-9e76-871d04968938 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:29.080958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96cad3c9-8cb3-49b7-9e76-871d04968938 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:29.082343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96cad3c9-8cb3-49b7-9e76-871d04968938 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:29.083966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96cad3c9-8cb3-49b7-9e76-871d04968938 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:29.560706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-96cad3c9-8cb3-49b7-9e76-871d04968938 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:29.573240 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-96cad3c9-8cb3-49b7-9e76-871d04968938 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1554 microversion: 2.1 time: 0.526005 Sep 10 21:03:29.577786 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1941/3974] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:29 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1554 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:30.601302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8b0d0ce2-9c59-4417-8294-28c7345e7d2b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:30.602793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8b0d0ce2-9c59-4417-8294-28c7345e7d2b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:30.616790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b0d0ce2-9c59-4417-8294-28c7345e7d2b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:30.620845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b0d0ce2-9c59-4417-8294-28c7345e7d2b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:30.622529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b0d0ce2-9c59-4417-8294-28c7345e7d2b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:30.624630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b0d0ce2-9c59-4417-8294-28c7345e7d2b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:30.627536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b0d0ce2-9c59-4417-8294-28c7345e7d2b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:30.628225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b0d0ce2-9c59-4417-8294-28c7345e7d2b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:31.141013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8b0d0ce2-9c59-4417-8294-28c7345e7d2b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:31.161275 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8b0d0ce2-9c59-4417-8294-28c7345e7d2b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1554 microversion: 2.1 time: 0.563311 Sep 10 21:03:31.162499 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2034/3975] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:30 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1554 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:32.192926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cbe7b574-8a3a-4cdd-8c66-8c64c07c16eb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:32.193608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cbe7b574-8a3a-4cdd-8c66-8c64c07c16eb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:32.216930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbe7b574-8a3a-4cdd-8c66-8c64c07c16eb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:32.219545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbe7b574-8a3a-4cdd-8c66-8c64c07c16eb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:32.220711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbe7b574-8a3a-4cdd-8c66-8c64c07c16eb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:32.221572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbe7b574-8a3a-4cdd-8c66-8c64c07c16eb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:32.223976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbe7b574-8a3a-4cdd-8c66-8c64c07c16eb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:32.225178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbe7b574-8a3a-4cdd-8c66-8c64c07c16eb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:32.869609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cbe7b574-8a3a-4cdd-8c66-8c64c07c16eb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:32.890735 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cbe7b574-8a3a-4cdd-8c66-8c64c07c16eb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1554 microversion: 2.1 time: 0.702514 Sep 10 21:03:32.891661 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1942/3976] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:32 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1554 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:33.369625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-71c46c84-e972-49c2-865f-538af249b812 req-504e4cef-8088-4d52-adb3-21db7f36bde9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b075e8a7-4b8d-41c4-876b-6c7e6efa95f3", "name": "network-vif-deleted", "tag": "27e4a694-e943-4eba-9421-80138ba614dd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:33.399420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-71c46c84-e972-49c2-865f-538af249b812 req-504e4cef-8088-4d52-adb3-21db7f36bde9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:33.400299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-71c46c84-e972-49c2-865f-538af249b812 req-504e4cef-8088-4d52-adb3-21db7f36bde9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:33.401206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-71c46c84-e972-49c2-865f-538af249b812 req-504e4cef-8088-4d52-adb3-21db7f36bde9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:33.436609 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-71c46c84-e972-49c2-865f-538af249b812 req-504e4cef-8088-4d52-adb3-21db7f36bde9 service nova] Creating event network-vif-deleted:27e4a694-e943-4eba-9421-80138ba614dd for instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 on nch2-master-1 Sep 10 21:03:33.443753 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-71c46c84-e972-49c2-865f-538af249b812 req-504e4cef-8088-4d52-adb3-21db7f36bde9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079236 Sep 10 21:03:33.445601 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2035/3977] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:33.920596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:33.921350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:33.967915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:33.971134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:33.981504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:33.984260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:33.986629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:33.989938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:34.098277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:34.101719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:34.102426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:34.103083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lazy-loading 'fault' on Instance uuid b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:03:34.115748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:34.211283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:34.233201 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-584ed4ad-692d-4fe9-adeb-391813d57c67 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 200 len: 1351 microversion: 2.1 time: 0.310588 Sep 10 21:03:34.238343 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1943/3978] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:33 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 1351 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:35.259763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:35.260526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:35.267279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:35.268168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:35.268926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:35.269961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:35.270668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:35.271380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:35.288395 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 HTTP/1.1 Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b075e8a7-4b8d-41c4-876b-6c7e6efa95f3'} Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:35.290529 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:35.296507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:35.296507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:35.296507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:35.296507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:03:35.296507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:03:35.296507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:03:35.296507 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:35.299836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:03:35.301136 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-17b2f725-b9f6-4e7a-b833-74c17e4a635e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 404 len: 111 microversion: 2.1 time: 0.046668 Sep 10 21:03:35.303230 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2036/3979] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:35 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:03:35.512635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:35.519467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:35.550895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:35.553679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:35.555131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:35.557922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:35.560935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:35.563123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:35.619715 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3/os-volume_attachments HTTP/1.1 Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'server_id': 'b075e8a7-4b8d-41c4-876b-6c7e6efa95f3'} Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:03:35.626522 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-25779d33-24a2-463d-b580-316d1e41c3f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.125169 Sep 10 21:03:35.636288 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1944/3980] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:03:35 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3/os-volume_attachments => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:03:35.920826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1114772962", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f5a2cd59-1be7-47bd-82a5-e6307d510b6e"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:36.021952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] validate_networks() for [('f5a2cd59-1be7-47bd-82a5-e6307d510b6e', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:03:37.192192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:03:37.193278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:03:37.196915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:03:37.197542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:03:37.198164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:03:37.247161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:37.248339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:37.249026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:37.250207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:37.250911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:37.251566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:37.342025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:03:37.365409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for user 4faa458c158141efaf707317411cd544 and project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:03:37.439205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:03:37.441698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: c4d95754-df07-4eaa-be1f-13ec791344e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:03:37.512073 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ee5bc90c-aa55-4a25-a8ac-de1c479d82f7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595362 Sep 10 21:03:37.513465 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2037/3981] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:03:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:03:37.525344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ec7e5d6-5dbb-4215-ab47-b8c8e6e7124f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:37.526669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7ec7e5d6-5dbb-4215-ab47-b8c8e6e7124f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: c4d95754-df07-4eaa-be1f-13ec791344e6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:37.657235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7ec7e5d6-5dbb-4215-ab47-b8c8e6e7124f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:37.670203 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ec7e5d6-5dbb-4215-ab47-b8c8e6e7124f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6" status: 200 len: 1215 microversion: 2.1 time: 0.149244 Sep 10 21:03:37.671135 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1945/3982] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:37 2022] GET /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6 => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:37.702016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3ab4bb3c-1848-48ae-a067-aa559b2e5284 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:37.702546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3ab4bb3c-1848-48ae-a067-aa559b2e5284 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: c4d95754-df07-4eaa-be1f-13ec791344e6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:37.742026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3ab4bb3c-1848-48ae-a067-aa559b2e5284 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: c4d95754-df07-4eaa-be1f-13ec791344e6] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:03:38.545609 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3ab4bb3c-1848-48ae-a067-aa559b2e5284 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6" status: 204 len: 0 microversion: 2.1 time: 0.848515 Sep 10 21:03:38.546572 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2038/3983] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:03:37 2022] DELETE /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:03:38.560316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da41b74d-75f3-4132-bfcc-746650cfb0ac tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:38.565041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-da41b74d-75f3-4132-bfcc-746650cfb0ac tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: c4d95754-df07-4eaa-be1f-13ec791344e6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:38.608662 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-da41b74d-75f3-4132-bfcc-746650cfb0ac tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da41b74d-75f3-4132-bfcc-746650cfb0ac tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6 HTTP/1.1 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c4d95754-df07-4eaa-be1f-13ec791344e6'} Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance c4d95754-df07-4eaa-be1f-13ec791344e6 Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:38.639260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:03:38.644226 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:38.645867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-efd8f60c-2a88-426c-81c5-93bae462281a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Action: 'create', calling method: .version_select at 0x7f99494c4af0>, body: {"keypair": {"name": "tempest-keypair-108942855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGU/9Ft803khbeyG9uFtG9iJrXG7JBk8L1+/iNf5sZtuj09hcm8ARrslrwd8/LJN+/3FJRAJCsc4rPqXNEo7EE4c+v8SVFAHyI7oBJ+YBRcNIrt3ixLd81jia599zww0GA=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:38.650890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da41b74d-75f3-4132-bfcc-746650cfb0ac tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:03:38.652051 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da41b74d-75f3-4132-bfcc-746650cfb0ac tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6" status: 404 len: 111 microversion: 2.1 time: 0.100221 Sep 10 21:03:38.654010 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2039/3984] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:38 2022] GET /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:03:38.709075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-efd8f60c-2a88-426c-81c5-93bae462281a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Getting quotas for project 1da09fdc751e406f9c3bad4bf0e1b067. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:03:38.724060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-efd8f60c-2a88-426c-81c5-93bae462281a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Getting quotas for user 96372af27d29482491d613b5a783a0d1 and project 1da09fdc751e406f9c3bad4bf0e1b067. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:03:38.832584 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-efd8f60c-2a88-426c-81c5-93bae462281a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.037098 Sep 10 21:03:38.834763 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1946/3985] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:03:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:03:38.920271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1450239280", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f5a2cd59-1be7-47bd-82a5-e6307d510b6e"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:39.057632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] validate_networks() for [('f5a2cd59-1be7-47bd-82a5-e6307d510b6e', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:03:40.275252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:03:40.276137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:03:40.276548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:03:40.277260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:03:40.280612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:03:40.306413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:40.306914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:40.307965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:40.310313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:40.311008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:40.311636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:40.338380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:03:40.345564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for user 4faa458c158141efaf707317411cd544 and project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:03:40.365088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:03:40.368745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:03:40.466374 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9dee98a0-e99b-4301-a8d9-fd3d48670096 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569386 Sep 10 21:03:40.467765 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2040/3986] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:03:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:03:40.484483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e6ab703c-3b99-40b6-94e8-23369f197d54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:40.485266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e6ab703c-3b99-40b6-94e8-23369f197d54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:40.704852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e6ab703c-3b99-40b6-94e8-23369f197d54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:40.717997 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e6ab703c-3b99-40b6-94e8-23369f197d54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1215 microversion: 2.1 time: 0.237595 Sep 10 21:03:40.720264 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1947/3987] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:40 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1215 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:40.949543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1076063b-8877-4f7a-a452-0e29ad5ed87c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:40.951088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1076063b-8877-4f7a-a452-0e29ad5ed87c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:40.966556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1076063b-8877-4f7a-a452-0e29ad5ed87c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:40.973610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1076063b-8877-4f7a-a452-0e29ad5ed87c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:40.974200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1076063b-8877-4f7a-a452-0e29ad5ed87c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:40.977532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1076063b-8877-4f7a-a452-0e29ad5ed87c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:40.978114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1076063b-8877-4f7a-a452-0e29ad5ed87c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:40.978560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1076063b-8877-4f7a-a452-0e29ad5ed87c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:41.029156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:41.071390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1076063b-8877-4f7a-a452-0e29ad5ed87c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:03:41.393194 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1076063b-8877-4f7a-a452-0e29ad5ed87c tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "DELETE /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 204 len: 0 microversion: 2.1 time: 0.455870 Sep 10 21:03:41.394631 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2041/3988] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:03:40 2022] DELETE /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:03:41.410018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-24cc5a43-fab0-40eb-bbe3-8ef6103572d8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:41.411353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-24cc5a43-fab0-40eb-bbe3-8ef6103572d8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:41.430464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24cc5a43-fab0-40eb-bbe3-8ef6103572d8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:41.432240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24cc5a43-fab0-40eb-bbe3-8ef6103572d8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:41.433699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24cc5a43-fab0-40eb-bbe3-8ef6103572d8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:41.438030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24cc5a43-fab0-40eb-bbe3-8ef6103572d8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:41.438968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24cc5a43-fab0-40eb-bbe3-8ef6103572d8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:41.440422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24cc5a43-fab0-40eb-bbe3-8ef6103572d8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:41.747010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0bebfbfc-6470-45ab-a010-72f603af3b43 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:41.748051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0bebfbfc-6470-45ab-a010-72f603af3b43 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:41.758168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bebfbfc-6470-45ab-a010-72f603af3b43 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:41.763489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bebfbfc-6470-45ab-a010-72f603af3b43 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:41.764316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bebfbfc-6470-45ab-a010-72f603af3b43 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:41.765358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bebfbfc-6470-45ab-a010-72f603af3b43 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:41.768411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bebfbfc-6470-45ab-a010-72f603af3b43 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:41.769067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bebfbfc-6470-45ab-a010-72f603af3b43 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:42.726646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0bebfbfc-6470-45ab-a010-72f603af3b43 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:42.756219 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0bebfbfc-6470-45ab-a010-72f603af3b43 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1211 microversion: 2.1 time: 1.013745 Sep 10 21:03:42.761941 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2042/3989] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:41 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1211 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:42.828749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-24cc5a43-fab0-40eb-bbe3-8ef6103572d8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:42.842627 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-24cc5a43-fab0-40eb-bbe3-8ef6103572d8 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1666 microversion: 2.1 time: 1.442613 Sep 10 21:03:42.843243 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1948/3990] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:41 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1666 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:43.787178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e3fe3f6-8318-44a0-97b9-242688ff4aaf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:43.787788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e3fe3f6-8318-44a0-97b9-242688ff4aaf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:43.805081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3fe3f6-8318-44a0-97b9-242688ff4aaf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:43.813202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3fe3f6-8318-44a0-97b9-242688ff4aaf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:43.814103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3fe3f6-8318-44a0-97b9-242688ff4aaf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:43.815089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3fe3f6-8318-44a0-97b9-242688ff4aaf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:43.815627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3fe3f6-8318-44a0-97b9-242688ff4aaf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:43.816031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3fe3f6-8318-44a0-97b9-242688ff4aaf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:43.885501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a17b3dfe-b512-4cbb-afbc-8409c87ec3f7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:43.897087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a17b3dfe-b512-4cbb-afbc-8409c87ec3f7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:43.916104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:43.925373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17b3dfe-b512-4cbb-afbc-8409c87ec3f7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:43.926826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17b3dfe-b512-4cbb-afbc-8409c87ec3f7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:43.927645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17b3dfe-b512-4cbb-afbc-8409c87ec3f7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:43.929140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17b3dfe-b512-4cbb-afbc-8409c87ec3f7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:43.929999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17b3dfe-b512-4cbb-afbc-8409c87ec3f7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:43.930697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a17b3dfe-b512-4cbb-afbc-8409c87ec3f7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:44.053780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e3fe3f6-8318-44a0-97b9-242688ff4aaf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:44.069185 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e3fe3f6-8318-44a0-97b9-242688ff4aaf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1273 microversion: 2.1 time: 0.284364 Sep 10 21:03:44.070596 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2043/3991] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:43 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:45.096299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08555f5c-2685-44ee-b384-d91298367f50 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:45.097091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-08555f5c-2685-44ee-b384-d91298367f50 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:45.115181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08555f5c-2685-44ee-b384-d91298367f50 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:45.116589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08555f5c-2685-44ee-b384-d91298367f50 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:45.118559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08555f5c-2685-44ee-b384-d91298367f50 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:45.119318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08555f5c-2685-44ee-b384-d91298367f50 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:45.122140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08555f5c-2685-44ee-b384-d91298367f50 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:45.122658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08555f5c-2685-44ee-b384-d91298367f50 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:45.254522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a17b3dfe-b512-4cbb-afbc-8409c87ec3f7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:45.264235 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a17b3dfe-b512-4cbb-afbc-8409c87ec3f7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1666 microversion: 2.1 time: 1.399767 Sep 10 21:03:45.265578 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1949/3992] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:43 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1666 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:45.447703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-08555f5c-2685-44ee-b384-d91298367f50 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:45.471686 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-08555f5c-2685-44ee-b384-d91298367f50 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1273 microversion: 2.1 time: 0.379219 Sep 10 21:03:45.472279 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2044/3993] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:45 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1273 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:45.557852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-591094900", "imageRef": "16088aa0-6bf3-4e74-883f-c3d7298a870d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "66a42bc9-169a-48e7-a2ed-79d853fe8d09"}], "security_groups": [{"name": "tempest-securitygroup--1689109969"}], "key_name": "tempest-keypair-108942855", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:45.977993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-27bc8849-f2a8-4b5b-b4d6-63267a05c586 req-abd02b40-37fe-46e0-a7f3-10c99e898cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b3e1c0-3109-4dbc-be56-f909f76fd613", "name": "network-vif-deleted", "tag": "f5d87996-dbb7-41f9-91cf-13dd283033a8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:46.021107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-27bc8849-f2a8-4b5b-b4d6-63267a05c586 req-abd02b40-37fe-46e0-a7f3-10c99e898cae service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:46.021956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-27bc8849-f2a8-4b5b-b4d6-63267a05c586 req-abd02b40-37fe-46e0-a7f3-10c99e898cae service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:46.022559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-27bc8849-f2a8-4b5b-b4d6-63267a05c586 req-abd02b40-37fe-46e0-a7f3-10c99e898cae service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:46.049619 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-27bc8849-f2a8-4b5b-b4d6-63267a05c586 req-abd02b40-37fe-46e0-a7f3-10c99e898cae service nova] Creating event network-vif-deleted:f5d87996-dbb7-41f9-91cf-13dd283033a8 for instance 73b3e1c0-3109-4dbc-be56-f909f76fd613 on nch1-master-1 Sep 10 21:03:46.061138 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-27bc8849-f2a8-4b5b-b4d6-63267a05c586 req-abd02b40-37fe-46e0-a7f3-10c99e898cae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273560 Sep 10 21:03:46.061890 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2045/3994] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:03:46.292260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:46.294044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:46.308866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:46.314211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:46.317249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:46.318286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:46.330596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:46.331332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:46.437226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:46.437720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:46.438189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:46.439152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lazy-loading 'fault' on Instance uuid 73b3e1c0-3109-4dbc-be56-f909f76fd613 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:03:46.531205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] validate_networks() for [('66a42bc9-169a-48e7-a2ed-79d853fe8d09', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:03:46.640566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b638a9e7f0934e47a3883be65e42d558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ff64ac8631450bb5e2d269118982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:46.655050 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-617b7996-33c6-4cbe-9678-ecba0116ed23 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 200 len: 1315 microversion: 2.1 time: 0.370094 Sep 10 21:03:46.658130 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2046/3995] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:46 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:46.676102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-04d4c8a5-77e9-464c-ab7f-a81f4858c391 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:46.676920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-04d4c8a5-77e9-464c-ab7f-a81f4858c391 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:46.695264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04d4c8a5-77e9-464c-ab7f-a81f4858c391 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:46.696002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04d4c8a5-77e9-464c-ab7f-a81f4858c391 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:46.699634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04d4c8a5-77e9-464c-ab7f-a81f4858c391 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:46.700569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04d4c8a5-77e9-464c-ab7f-a81f4858c391 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:46.701204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04d4c8a5-77e9-464c-ab7f-a81f4858c391 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:46.706729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-04d4c8a5-77e9-464c-ab7f-a81f4858c391 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:46.859056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-04d4c8a5-77e9-464c-ab7f-a81f4858c391 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:46.869950 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-04d4c8a5-77e9-464c-ab7f-a81f4858c391 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1273 microversion: 2.1 time: 0.205302 Sep 10 21:03:46.870571 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2047/3996] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:46 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:47.684947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:47.685686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] [instance: 73b3e1c0-3109-4dbc-be56-f909f76fd613] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:47.702096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:47.702818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:47.704021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:47.704968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:47.705652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:47.706298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:47.744233 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] HTTP exception thrown: Instance 73b3e1c0-3109-4dbc-be56-f909f76fd613 could not be found. Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Request method failure captured: Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 HTTP/1.1 Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtE_R9aaBJpoHnXIqzdObKDWiQrY2j9KfGjYhL1tqiD1MwqPuBxsAWL3YW1hGHsa3CRuGN2z4jodkNhRRG3HCxPykYKamy4aeat2rokhPiYVNKTFd5LGw7Sl_fxSxArJvRN93KlVAaVm-iMQ2_ous5cb6HIYa1T8Ilc52JX9WHWiVw Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 75ff64ac8631450bb5e2d269118982a8 Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestFqdnHostnames-1236528692 Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/75ff64ac8631450bb5e2d269118982a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/75ff64ac8631450bb5e2d269118982a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_75ff64ac8631450bb5e2d269118982a8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/75ff64ac8631450bb5e2d269118982a8"}]}] Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestFqdnHostnames-1236528692 Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 75ff64ac8631450bb5e2d269118982a8 Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1236528692 Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestFqdnHostnames-1236528692-project Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: b638a9e7f0934e47a3883be65e42d558 Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestFqdnHostnames-1236528692-project Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 73b3e1c0-3109-4dbc-be56-f909f76fd613 could not be found. Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '73b3e1c0-3109-4dbc-be56-f909f76fd613'} Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b3e1c0-3109-4dbc-be56-f909f76fd613 could not be found. Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b3e1c0-3109-4dbc-be56-f909f76fd613 could not be found. Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:03:47.752871 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:47.757734 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:03:47.757734 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:03:47.757734 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:03:47.757734 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:03:47.757734 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:03:47.757734 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b3e1c0-3109-4dbc-be56-f909f76fd613 could not be found. Sep 10 21:03:47.757734 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:03:47.762873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Returning 404 to user: Instance 73b3e1c0-3109-4dbc-be56-f909f76fd613 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:03:47.766143 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-622ad3a4-9944-4e23-bbf8-11be72e492a7 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613" status: 404 len: 111 microversion: 2.1 time: 0.085259 Sep 10 21:03:47.768006 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2048/3997] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:47 2022] GET /compute/v2.1/servers/73b3e1c0-3109-4dbc-be56-f909f76fd613 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:03:47.778973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-17588843-e385-46f7-9e4b-9887cea62128 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] Calling method '.version_select at 0x7f9944aee280>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:47.828430 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-17588843-e385-46f7-9e4b-9887cea62128 tempest-ServersTestFqdnHostnames-1236528692 tempest-ServersTestFqdnHostnames-1236528692-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-739449473" status: 202 len: 0 microversion: 2.1 time: 0.056149 Sep 10 21:03:47.835965 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2049/3998] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 21:03:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-739449473 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:03:47.896847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e44064a5-d11b-46f1-a6b7-a8b599a5c30e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:47.897473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e44064a5-d11b-46f1-a6b7-a8b599a5c30e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:47.909412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:47.914066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44064a5-d11b-46f1-a6b7-a8b599a5c30e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:47.914602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44064a5-d11b-46f1-a6b7-a8b599a5c30e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:47.915043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44064a5-d11b-46f1-a6b7-a8b599a5c30e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:47.915762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44064a5-d11b-46f1-a6b7-a8b599a5c30e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:47.931224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44064a5-d11b-46f1-a6b7-a8b599a5c30e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:47.941791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e44064a5-d11b-46f1-a6b7-a8b599a5c30e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:48.492850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e44064a5-d11b-46f1-a6b7-a8b599a5c30e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:48.533629 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e44064a5-d11b-46f1-a6b7-a8b599a5c30e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1315 microversion: 2.1 time: 0.637421 Sep 10 21:03:48.535200 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2050/3999] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:47 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:49.207497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:03:49.208166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:03:49.208731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:03:49.209219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:03:49.210016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:03:49.221519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:49.222149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:49.223277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:49.224557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:49.225101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:49.225610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:49.245330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Getting quotas for project 1da09fdc751e406f9c3bad4bf0e1b067. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:03:49.252156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Getting quotas for user 96372af27d29482491d613b5a783a0d1 and project 1da09fdc751e406f9c3bad4bf0e1b067. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:03:49.266230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:03:49.269326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='16088aa0-6bf3-4e74-883f-c3d7298a870d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:03:49.336372 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c4720bb8-9d9b-4038-9477-0994f93f55a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.786597 Sep 10 21:03:49.345206 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1950/4000] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:03:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 3795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:03:49.349879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a50d1a25-4b91-427d-bbab-5601c30906e2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:49.351382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a50d1a25-4b91-427d-bbab-5601c30906e2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:49.523447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a50d1a25-4b91-427d-bbab-5601c30906e2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:49.531335 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a50d1a25-4b91-427d-bbab-5601c30906e2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1244 microversion: 2.1 time: 0.185783 Sep 10 21:03:49.531957 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2051/4001] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:49 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1244 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:49.563097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da72452d-ef25-4f8b-9abf-7575d2fba0e7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:49.563837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da72452d-ef25-4f8b-9abf-7575d2fba0e7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:49.613344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da72452d-ef25-4f8b-9abf-7575d2fba0e7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:49.614468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da72452d-ef25-4f8b-9abf-7575d2fba0e7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:49.614948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da72452d-ef25-4f8b-9abf-7575d2fba0e7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:49.628367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da72452d-ef25-4f8b-9abf-7575d2fba0e7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:49.633849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da72452d-ef25-4f8b-9abf-7575d2fba0e7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:49.634292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da72452d-ef25-4f8b-9abf-7575d2fba0e7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:49.896408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1483950381", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "a84b2be0-79f5-4d52-ac0b-0ce537c7c9f8"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:49.988380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] validate_networks() for [('a84b2be0-79f5-4d52-ac0b-0ce537c7c9f8', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:03:50.191260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da72452d-ef25-4f8b-9abf-7575d2fba0e7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:50.203935 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da72452d-ef25-4f8b-9abf-7575d2fba0e7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1315 microversion: 2.1 time: 0.648403 Sep 10 21:03:50.204862 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1951/4002] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:49 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:50.328899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:50.556340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d2573f45-1d5f-4d20-9abe-595d73e89f9f tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:50.557768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d2573f45-1d5f-4d20-9abe-595d73e89f9f tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:50.573202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2573f45-1d5f-4d20-9abe-595d73e89f9f tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:50.574678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2573f45-1d5f-4d20-9abe-595d73e89f9f tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:50.575493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2573f45-1d5f-4d20-9abe-595d73e89f9f tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:50.576592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2573f45-1d5f-4d20-9abe-595d73e89f9f tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:50.579400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2573f45-1d5f-4d20-9abe-595d73e89f9f tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:50.580114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2573f45-1d5f-4d20-9abe-595d73e89f9f tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:51.517679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d2573f45-1d5f-4d20-9abe-595d73e89f9f tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:51.527896 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d2573f45-1d5f-4d20-9abe-595d73e89f9f tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1240 microversion: 2.1 time: 0.975676 Sep 10 21:03:51.528508 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1952/4003] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:50 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1240 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:51.533118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bfb80c54-66f2-41b6-b9bc-ee26c628f1cf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:51.533740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bfb80c54-66f2-41b6-b9bc-ee26c628f1cf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:51.580700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfb80c54-66f2-41b6-b9bc-ee26c628f1cf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:51.581299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfb80c54-66f2-41b6-b9bc-ee26c628f1cf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:51.581745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfb80c54-66f2-41b6-b9bc-ee26c628f1cf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:51.584770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfb80c54-66f2-41b6-b9bc-ee26c628f1cf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:51.586507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfb80c54-66f2-41b6-b9bc-ee26c628f1cf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:51.593223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfb80c54-66f2-41b6-b9bc-ee26c628f1cf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:52.050108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bfb80c54-66f2-41b6-b9bc-ee26c628f1cf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:52.069212 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bfb80c54-66f2-41b6-b9bc-ee26c628f1cf tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1315 microversion: 2.1 time: 0.539618 Sep 10 21:03:52.077229 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1953/4004] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:51 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:52.555084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a92ac273-c3e8-4875-a91e-d5815beb4b08 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:52.555713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a92ac273-c3e8-4875-a91e-d5815beb4b08 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:52.575120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a92ac273-c3e8-4875-a91e-d5815beb4b08 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:52.578269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a92ac273-c3e8-4875-a91e-d5815beb4b08 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:52.580399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a92ac273-c3e8-4875-a91e-d5815beb4b08 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:52.581573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a92ac273-c3e8-4875-a91e-d5815beb4b08 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:52.584774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a92ac273-c3e8-4875-a91e-d5815beb4b08 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:52.586738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a92ac273-c3e8-4875-a91e-d5815beb4b08 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:52.797069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:03:52.797581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:03:52.798343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:03:52.799693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:03:52.800126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:03:52.824595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:52.825093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:52.831855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:52.837066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:52.837599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:52.840057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:52.895922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Getting quotas for project 54cc07e66b1d4c55827d9b723a8df459. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:03:52.907480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Getting quotas for user 42fe36190f974a289414202fe1e4ee44 and project 54cc07e66b1d4c55827d9b723a8df459. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:03:52.928870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:03:52.932407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:03:53.065743 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d71d31f3-517c-4e44-8781-31136897980b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.452184 Sep 10 21:03:53.067368 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2052/4005] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:03:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:03:53.097778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ced56f8d-3d47-417c-b682-2006f9b83bd4 req-d14bc41b-f43c-4863-9888-597303ac976d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5f777c-02bd-4bbb-aad0-b79d88257152", "tag": "d1c8dd22-dc75-40c3-ac50-4df8c5811a72"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:03:53.162468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ced56f8d-3d47-417c-b682-2006f9b83bd4 req-d14bc41b-f43c-4863-9888-597303ac976d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:53.163363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ced56f8d-3d47-417c-b682-2006f9b83bd4 req-d14bc41b-f43c-4863-9888-597303ac976d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:53.164877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ced56f8d-3d47-417c-b682-2006f9b83bd4 req-d14bc41b-f43c-4863-9888-597303ac976d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:53.215081 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ced56f8d-3d47-417c-b682-2006f9b83bd4 req-d14bc41b-f43c-4863-9888-597303ac976d service nova] Creating event network-changed:d1c8dd22-dc75-40c3-ac50-4df8c5811a72 for instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 on nch2-master-1 Sep 10 21:03:53.232386 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ced56f8d-3d47-417c-b682-2006f9b83bd4 req-d14bc41b-f43c-4863-9888-597303ac976d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157950 Sep 10 21:03:53.233075 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2053/4006] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:03:53.263654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-57f40426-f713-44ea-a5c1-8b2e2c6ff916 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:53.264874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-57f40426-f713-44ea-a5c1-8b2e2c6ff916 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:53.399748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a92ac273-c3e8-4875-a91e-d5815beb4b08 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:53.411420 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a92ac273-c3e8-4875-a91e-d5815beb4b08 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1302 microversion: 2.1 time: 0.860144 Sep 10 21:03:53.418415 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1954/4007] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:52 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1302 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:53.431574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-90145542-d154-43ea-9a6c-63deb89084f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:53.439322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-90145542-d154-43ea-9a6c-63deb89084f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:53.475310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90145542-d154-43ea-9a6c-63deb89084f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:53.478536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90145542-d154-43ea-9a6c-63deb89084f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:53.479178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90145542-d154-43ea-9a6c-63deb89084f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:53.480939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90145542-d154-43ea-9a6c-63deb89084f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:53.482913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90145542-d154-43ea-9a6c-63deb89084f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:53.484530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90145542-d154-43ea-9a6c-63deb89084f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:54.537747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-57f40426-f713-44ea-a5c1-8b2e2c6ff916 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:54.553869 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-57f40426-f713-44ea-a5c1-8b2e2c6ff916 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1216 microversion: 2.1 time: 1.315973 Sep 10 21:03:54.559611 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2054/4008] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:53 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1216 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:54.570105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d63056d6-3698-4410-a53f-a5794c6315c4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:54.572059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d63056d6-3698-4410-a53f-a5794c6315c4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:54.601391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63056d6-3698-4410-a53f-a5794c6315c4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:54.603182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63056d6-3698-4410-a53f-a5794c6315c4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:54.605782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63056d6-3698-4410-a53f-a5794c6315c4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:54.608167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63056d6-3698-4410-a53f-a5794c6315c4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:54.609351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63056d6-3698-4410-a53f-a5794c6315c4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:54.613021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63056d6-3698-4410-a53f-a5794c6315c4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:55.192619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d63056d6-3698-4410-a53f-a5794c6315c4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:55.203655 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d63056d6-3698-4410-a53f-a5794c6315c4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1302 microversion: 2.1 time: 0.642604 Sep 10 21:03:55.208371 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2055/4009] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:54 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1302 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:55.581381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-69a63e1d-b3cf-4879-8477-324a0092b5c1 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:55.582152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-69a63e1d-b3cf-4879-8477-324a0092b5c1 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:55.608600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a63e1d-b3cf-4879-8477-324a0092b5c1 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:55.609721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a63e1d-b3cf-4879-8477-324a0092b5c1 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:55.610210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a63e1d-b3cf-4879-8477-324a0092b5c1 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:55.615234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a63e1d-b3cf-4879-8477-324a0092b5c1 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:55.615994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a63e1d-b3cf-4879-8477-324a0092b5c1 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:55.623970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69a63e1d-b3cf-4879-8477-324a0092b5c1 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:55.692649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-90145542-d154-43ea-9a6c-63deb89084f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:55.704386 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-90145542-d154-43ea-9a6c-63deb89084f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1315 microversion: 2.1 time: 2.281748 Sep 10 21:03:55.705116 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1955/4010] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:53 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1315 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:55.716567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:55.717582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:55.733189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:55.734097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:55.743483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:55.744515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:55.745232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:55.746012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:56.018555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-69a63e1d-b3cf-4879-8477-324a0092b5c1 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:56.058633 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-69a63e1d-b3cf-4879-8477-324a0092b5c1 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1268 microversion: 2.1 time: 0.477778 Sep 10 21:03:56.063805 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2056/4011] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:55 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1268 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:56.242904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ba9167de-bfc6-49db-8f67-2db2b4ce2832 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:56.243850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ba9167de-bfc6-49db-8f67-2db2b4ce2832 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:56.264444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba9167de-bfc6-49db-8f67-2db2b4ce2832 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:56.265032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba9167de-bfc6-49db-8f67-2db2b4ce2832 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:56.274432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba9167de-bfc6-49db-8f67-2db2b4ce2832 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:56.275566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba9167de-bfc6-49db-8f67-2db2b4ce2832 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:56.276955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba9167de-bfc6-49db-8f67-2db2b4ce2832 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:56.278364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ba9167de-bfc6-49db-8f67-2db2b4ce2832 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:56.494281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ba9167de-bfc6-49db-8f67-2db2b4ce2832 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:56.517175 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ba9167de-bfc6-49db-8f67-2db2b4ce2832 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1302 microversion: 2.1 time: 0.279144 Sep 10 21:03:56.520730 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2057/4012] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:56 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1302 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:03:56.746198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8015bb5c-860c-4772-b455-bfd1792764b1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:56.747063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8015bb5c-860c-4772-b455-bfd1792764b1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:56.768844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8015bb5c-860c-4772-b455-bfd1792764b1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:56.771652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8015bb5c-860c-4772-b455-bfd1792764b1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:56.774476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8015bb5c-860c-4772-b455-bfd1792764b1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:56.775599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8015bb5c-860c-4772-b455-bfd1792764b1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:56.776334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8015bb5c-860c-4772-b455-bfd1792764b1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:56.778124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8015bb5c-860c-4772-b455-bfd1792764b1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:56.899890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:56.917982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:56.935111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:56.936565 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e506c105-b2bb-462a-b68d-118fddd6d4be tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2945 microversion: 2.32 time: 1.226769 Sep 10 21:03:56.937416 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1956/4013] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:03:55 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2945 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:03:56.985220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f7a0b93f-4791-4610-944b-74c039084419 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:56.986149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f7a0b93f-4791-4610-944b-74c039084419 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:57.000674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7a0b93f-4791-4610-944b-74c039084419 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:57.012662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7a0b93f-4791-4610-944b-74c039084419 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:57.012662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7a0b93f-4791-4610-944b-74c039084419 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:57.012662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7a0b93f-4791-4610-944b-74c039084419 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:57.012662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7a0b93f-4791-4610-944b-74c039084419 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:57.012662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7a0b93f-4791-4610-944b-74c039084419 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:57.343816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8015bb5c-860c-4772-b455-bfd1792764b1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:57.378422 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8015bb5c-860c-4772-b455-bfd1792764b1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1315 microversion: 2.1 time: 0.636869 Sep 10 21:03:57.379622 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2058/4014] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:56 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:57.412607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-41f8fc8d-ad3a-4d05-9a2e-4439f60649a4 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:57.413715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-41f8fc8d-ad3a-4d05-9a2e-4439f60649a4 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:57.447228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f8fc8d-ad3a-4d05-9a2e-4439f60649a4 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:57.448248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f8fc8d-ad3a-4d05-9a2e-4439f60649a4 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:57.451391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f8fc8d-ad3a-4d05-9a2e-4439f60649a4 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:57.455328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f8fc8d-ad3a-4d05-9a2e-4439f60649a4 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:57.456068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f8fc8d-ad3a-4d05-9a2e-4439f60649a4 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:57.458504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41f8fc8d-ad3a-4d05-9a2e-4439f60649a4 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:57.709775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-41f8fc8d-ad3a-4d05-9a2e-4439f60649a4 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:57.744275 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-41f8fc8d-ad3a-4d05-9a2e-4439f60649a4 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1274 microversion: 2.1 time: 0.346682 Sep 10 21:03:57.745441 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2059/4015] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:57 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1274 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:57.763178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-55ccbf5c-d7ed-4e46-9d14-6404bb1ede8a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:57.764043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-55ccbf5c-d7ed-4e46-9d14-6404bb1ede8a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:57.796585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55ccbf5c-d7ed-4e46-9d14-6404bb1ede8a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:57.797502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55ccbf5c-d7ed-4e46-9d14-6404bb1ede8a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:57.798279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55ccbf5c-d7ed-4e46-9d14-6404bb1ede8a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:57.799445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55ccbf5c-d7ed-4e46-9d14-6404bb1ede8a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:57.800461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55ccbf5c-d7ed-4e46-9d14-6404bb1ede8a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:57.801075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55ccbf5c-d7ed-4e46-9d14-6404bb1ede8a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:57.864631 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f7a0b93f-4791-4610-944b-74c039084419 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.884900 Sep 10 21:03:57.865854 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1957/4016] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Sep 10 21:03:56 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f/os-interface => generated 1831 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:03:58.304651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-55ccbf5c-d7ed-4e46-9d14-6404bb1ede8a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:58.328181 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-55ccbf5c-d7ed-4e46-9d14-6404bb1ede8a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 0.580709 Sep 10 21:03:58.332463 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2060/4017] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:57 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:58.411008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f335d1b1-36e5-463d-8db3-0b9ff3c7162b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:58.411746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f335d1b1-36e5-463d-8db3-0b9ff3c7162b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:58.430965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f335d1b1-36e5-463d-8db3-0b9ff3c7162b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:58.436011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f335d1b1-36e5-463d-8db3-0b9ff3c7162b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:58.439919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f335d1b1-36e5-463d-8db3-0b9ff3c7162b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:58.440743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f335d1b1-36e5-463d-8db3-0b9ff3c7162b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:58.441226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f335d1b1-36e5-463d-8db3-0b9ff3c7162b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:58.441660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f335d1b1-36e5-463d-8db3-0b9ff3c7162b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:58.772399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9cddb8de-923b-4ad3-81e7-183415f1920a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:58.774312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9cddb8de-923b-4ad3-81e7-183415f1920a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:58.788769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cddb8de-923b-4ad3-81e7-183415f1920a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:58.789748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cddb8de-923b-4ad3-81e7-183415f1920a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:58.791064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cddb8de-923b-4ad3-81e7-183415f1920a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:58.792069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cddb8de-923b-4ad3-81e7-183415f1920a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:58.794983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cddb8de-923b-4ad3-81e7-183415f1920a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:58.795893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cddb8de-923b-4ad3-81e7-183415f1920a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:58.827637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:59.157092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9cddb8de-923b-4ad3-81e7-183415f1920a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:59.171619 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9cddb8de-923b-4ad3-81e7-183415f1920a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1274 microversion: 2.1 time: 0.405923 Sep 10 21:03:59.199594 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2061/4018] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:58 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1274 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:03:59.234467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:59.259073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=14 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:03:59.382585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-67fee2d4-6d6c-4b11-8bbe-e82a9d2af2ad tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:03:59.390672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-67fee2d4-6d6c-4b11-8bbe-e82a9d2af2ad tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:03:59.415716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67fee2d4-6d6c-4b11-8bbe-e82a9d2af2ad tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:59.416328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67fee2d4-6d6c-4b11-8bbe-e82a9d2af2ad tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:59.423555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67fee2d4-6d6c-4b11-8bbe-e82a9d2af2ad tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:59.424741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67fee2d4-6d6c-4b11-8bbe-e82a9d2af2ad tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:03:59.425601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67fee2d4-6d6c-4b11-8bbe-e82a9d2af2ad tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:03:59.426474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67fee2d4-6d6c-4b11-8bbe-e82a9d2af2ad tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:03:59.505322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f335d1b1-36e5-463d-8db3-0b9ff3c7162b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:03:59.539350 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f335d1b1-36e5-463d-8db3-0b9ff3c7162b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1315 microversion: 2.1 time: 1.132794 Sep 10 21:03:59.543455 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1958/4019] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:58 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1315 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:00.208862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-92e36812-f809-4811-a460-c1c99f93ab59 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:00.209590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-92e36812-f809-4811-a460-c1c99f93ab59 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:00.232539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e36812-f809-4811-a460-c1c99f93ab59 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:00.233110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e36812-f809-4811-a460-c1c99f93ab59 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:00.235920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e36812-f809-4811-a460-c1c99f93ab59 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:00.239005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e36812-f809-4811-a460-c1c99f93ab59 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:00.240966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e36812-f809-4811-a460-c1c99f93ab59 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:00.242492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e36812-f809-4811-a460-c1c99f93ab59 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:00.376280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-67fee2d4-6d6c-4b11-8bbe-e82a9d2af2ad tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:00.424587 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-67fee2d4-6d6c-4b11-8bbe-e82a9d2af2ad tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 1.048925 Sep 10 21:04:00.429293 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2062/4020] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:03:59 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:00.821752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-92e36812-f809-4811-a460-c1c99f93ab59 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:00.836663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-835719033", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f6506e65-ecc7-44a4-80db-6f479c52a33e"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:00.838188 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-92e36812-f809-4811-a460-c1c99f93ab59 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1274 microversion: 2.1 time: 0.635497 Sep 10 21:04:00.840182 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1959/4021] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:00 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1274 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:00.846948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a6959c1e-825f-4a22-a35d-8975409899a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:00.847828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a6959c1e-825f-4a22-a35d-8975409899a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:00.856286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6959c1e-825f-4a22-a35d-8975409899a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:00.857070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6959c1e-825f-4a22-a35d-8975409899a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:00.868140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6959c1e-825f-4a22-a35d-8975409899a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:00.868140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6959c1e-825f-4a22-a35d-8975409899a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:00.868140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6959c1e-825f-4a22-a35d-8975409899a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:00.868140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6959c1e-825f-4a22-a35d-8975409899a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:01.019561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] validate_networks() for [('f6506e65-ecc7-44a4-80db-6f479c52a33e', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:04:02.876186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:03.064369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a6959c1e-825f-4a22-a35d-8975409899a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:03.086646 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a6959c1e-825f-4a22-a35d-8975409899a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1315 microversion: 2.1 time: 2.244612 Sep 10 21:04:03.088014 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1960/4022] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:00 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1315 bytes in 2247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:03.095404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f3259800-70d8-4f7f-800f-a028c762b760 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:03.097066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f3259800-70d8-4f7f-800f-a028c762b760 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:03.113232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3259800-70d8-4f7f-800f-a028c762b760 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:03.114098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3259800-70d8-4f7f-800f-a028c762b760 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:03.115393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3259800-70d8-4f7f-800f-a028c762b760 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:03.116150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3259800-70d8-4f7f-800f-a028c762b760 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:03.118050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3259800-70d8-4f7f-800f-a028c762b760 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:03.119540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3259800-70d8-4f7f-800f-a028c762b760 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:03.770805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f3259800-70d8-4f7f-800f-a028c762b760 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:03.783592 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f3259800-70d8-4f7f-800f-a028c762b760 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 0.693093 Sep 10 21:04:03.785429 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1961/4023] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:03 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:03.796895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-60dc03a9-6098-4813-89e9-231be17e8db5 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:03.807142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-60dc03a9-6098-4813-89e9-231be17e8db5 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:03.831334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60dc03a9-6098-4813-89e9-231be17e8db5 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:03.833736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60dc03a9-6098-4813-89e9-231be17e8db5 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:03.835267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60dc03a9-6098-4813-89e9-231be17e8db5 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:03.840851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60dc03a9-6098-4813-89e9-231be17e8db5 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:03.842479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60dc03a9-6098-4813-89e9-231be17e8db5 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:03.844381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60dc03a9-6098-4813-89e9-231be17e8db5 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:04.549703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=24 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:05.246685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-60dc03a9-6098-4813-89e9-231be17e8db5 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:05.249218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=88 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:05.278504 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-60dc03a9-6098-4813-89e9-231be17e8db5 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 1.491453 Sep 10 21:04:05.279306 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1962/4024] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:03 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:05.301901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3b63742f-2cad-481d-b9c5-6931f6a31036 req-77b5aefe-0650-4622-a63b-8cc4d0af6c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d690d87c-2883-4181-8552-01f2be84e93c", "tag": "c9e1a782-f90c-4541-ba9a-c993f5ef1b41"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:05.334272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3b63742f-2cad-481d-b9c5-6931f6a31036 req-77b5aefe-0650-4622-a63b-8cc4d0af6c84 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:05.334704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3b63742f-2cad-481d-b9c5-6931f6a31036 req-77b5aefe-0650-4622-a63b-8cc4d0af6c84 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:05.335150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3b63742f-2cad-481d-b9c5-6931f6a31036 req-77b5aefe-0650-4622-a63b-8cc4d0af6c84 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:05.385004 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3b63742f-2cad-481d-b9c5-6931f6a31036 req-77b5aefe-0650-4622-a63b-8cc4d0af6c84 service nova] Creating event network-changed:c9e1a782-f90c-4541-ba9a-c993f5ef1b41 for instance d690d87c-2883-4181-8552-01f2be84e93c on nch1-master-1 Sep 10 21:04:05.408744 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3b63742f-2cad-481d-b9c5-6931f6a31036 req-77b5aefe-0650-4622-a63b-8cc4d0af6c84 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116175 Sep 10 21:04:05.409402 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1963/4025] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:05.426189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85fa7009-9ba5-4d72-9ab2-d10f57ac200a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:05.426913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-85fa7009-9ba5-4d72-9ab2-d10f57ac200a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:05.452205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85fa7009-9ba5-4d72-9ab2-d10f57ac200a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:05.452719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85fa7009-9ba5-4d72-9ab2-d10f57ac200a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:05.456581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85fa7009-9ba5-4d72-9ab2-d10f57ac200a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:05.457490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85fa7009-9ba5-4d72-9ab2-d10f57ac200a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:05.460504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85fa7009-9ba5-4d72-9ab2-d10f57ac200a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:05.460990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85fa7009-9ba5-4d72-9ab2-d10f57ac200a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:05.675786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:04:05.676589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:04:05.677246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:04:05.677811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:04:05.678570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:04:05.714062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:05.714647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:05.715127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:05.715938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:05.716491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:05.716951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:05.781853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Getting quotas for project 7c3ba8eb9cfb41cb87be6ffad5cb3789. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:04:05.801238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Getting quotas for user 3561f4fb18f84b899f68c5fcf897ca12 and project 7c3ba8eb9cfb41cb87be6ffad5cb3789. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:04:05.853141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:04:05.871680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:04:06.058736 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0935f61b-911e-46b6-923f-1fa10ac487e5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.541795 Sep 10 21:04:06.060916 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2063/4026] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 5545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:04:06.536385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-85fa7009-9ba5-4d72-9ab2-d10f57ac200a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:06.555336 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-85fa7009-9ba5-4d72-9ab2-d10f57ac200a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1315 microversion: 2.1 time: 1.144606 Sep 10 21:04:06.559940 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1964/4027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:05 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1315 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:06.579407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-afea1f70-3d09-4d47-a94c-7ed1e5826b15 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:06.580128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-afea1f70-3d09-4d47-a94c-7ed1e5826b15 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:06.591111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afea1f70-3d09-4d47-a94c-7ed1e5826b15 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:06.600566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afea1f70-3d09-4d47-a94c-7ed1e5826b15 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:06.609066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afea1f70-3d09-4d47-a94c-7ed1e5826b15 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:06.610554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afea1f70-3d09-4d47-a94c-7ed1e5826b15 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:06.611588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afea1f70-3d09-4d47-a94c-7ed1e5826b15 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:06.612239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afea1f70-3d09-4d47-a94c-7ed1e5826b15 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:06.700066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-fb976d36-d1ab-4678-a1c2-411bab7f35b8 req-9b4e4efe-66a6-4b85-b967-cad7567da304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5f777c-02bd-4bbb-aad0-b79d88257152", "name": "network-vif-plugged", "status": "completed", "tag": "d1c8dd22-dc75-40c3-ac50-4df8c5811a72"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:06.746334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-fb976d36-d1ab-4678-a1c2-411bab7f35b8 req-9b4e4efe-66a6-4b85-b967-cad7567da304 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:06.746794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-fb976d36-d1ab-4678-a1c2-411bab7f35b8 req-9b4e4efe-66a6-4b85-b967-cad7567da304 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:06.747339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-fb976d36-d1ab-4678-a1c2-411bab7f35b8 req-9b4e4efe-66a6-4b85-b967-cad7567da304 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:06.799032 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-fb976d36-d1ab-4678-a1c2-411bab7f35b8 req-9b4e4efe-66a6-4b85-b967-cad7567da304 service nova] Creating event network-vif-plugged:d1c8dd22-dc75-40c3-ac50-4df8c5811a72 for instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 on nch2-master-1 Sep 10 21:04:06.826932 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-fb976d36-d1ab-4678-a1c2-411bab7f35b8 req-9b4e4efe-66a6-4b85-b967-cad7567da304 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.763389 Sep 10 21:04:06.849916 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2064/4028] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:06.885392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-67ac194d-f009-4481-950f-0b1ae2b3e1bf tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:06.893662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-67ac194d-f009-4481-950f-0b1ae2b3e1bf tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:07.366776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-67ac194d-f009-4481-950f-0b1ae2b3e1bf tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:07.380063 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-67ac194d-f009-4481-950f-0b1ae2b3e1bf tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1216 microversion: 2.1 time: 0.528288 Sep 10 21:04:07.395527 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2065/4029] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:06 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1216 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:07.404656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6b0d62b3-caed-4806-880f-9969bbbe52f8 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:07.405391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6b0d62b3-caed-4806-880f-9969bbbe52f8 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:07.421553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b0d62b3-caed-4806-880f-9969bbbe52f8 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:07.422225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b0d62b3-caed-4806-880f-9969bbbe52f8 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:07.422988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b0d62b3-caed-4806-880f-9969bbbe52f8 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:07.426121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b0d62b3-caed-4806-880f-9969bbbe52f8 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:07.426876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b0d62b3-caed-4806-880f-9969bbbe52f8 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:07.427609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b0d62b3-caed-4806-880f-9969bbbe52f8 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:07.756200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-afea1f70-3d09-4d47-a94c-7ed1e5826b15 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:07.767674 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-afea1f70-3d09-4d47-a94c-7ed1e5826b15 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 1.203715 Sep 10 21:04:07.768926 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1965/4030] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:06 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:07.774684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c8fbc239-4386-4fa4-a0bf-b84503674bd1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:07.776408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c8fbc239-4386-4fa4-a0bf-b84503674bd1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:07.784421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8fbc239-4386-4fa4-a0bf-b84503674bd1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:07.785436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8fbc239-4386-4fa4-a0bf-b84503674bd1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:07.786264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8fbc239-4386-4fa4-a0bf-b84503674bd1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:07.787313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8fbc239-4386-4fa4-a0bf-b84503674bd1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:07.788143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8fbc239-4386-4fa4-a0bf-b84503674bd1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:07.788835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8fbc239-4386-4fa4-a0bf-b84503674bd1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:07.850525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6b0d62b3-caed-4806-880f-9969bbbe52f8 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:07.865015 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6b0d62b3-caed-4806-880f-9969bbbe52f8 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 0.468194 Sep 10 21:04:07.865672 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2066/4031] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:07 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:08.157110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b183fca9-b44e-4062-bfeb-e9f01122c183 req-38a3993b-ed0a-4a2a-a11a-57809471f6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b3c03dd-c695-45a2-9f38-644898a83d54", "tag": "cb320d7b-6513-4eb1-a214-2f8c317c9084"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:08.169301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b183fca9-b44e-4062-bfeb-e9f01122c183 req-38a3993b-ed0a-4a2a-a11a-57809471f6bc service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:08.169640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b183fca9-b44e-4062-bfeb-e9f01122c183 req-38a3993b-ed0a-4a2a-a11a-57809471f6bc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:08.170475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b183fca9-b44e-4062-bfeb-e9f01122c183 req-38a3993b-ed0a-4a2a-a11a-57809471f6bc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:08.185478 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b183fca9-b44e-4062-bfeb-e9f01122c183 req-38a3993b-ed0a-4a2a-a11a-57809471f6bc service nova] Creating event network-changed:cb320d7b-6513-4eb1-a214-2f8c317c9084 for instance 8b3c03dd-c695-45a2-9f38-644898a83d54 on nch1-master-1 Sep 10 21:04:08.194135 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b183fca9-b44e-4062-bfeb-e9f01122c183 req-38a3993b-ed0a-4a2a-a11a-57809471f6bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326771 Sep 10 21:04:08.195929 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2067/4032] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:08.267365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c8fbc239-4386-4fa4-a0bf-b84503674bd1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:08.291885 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c8fbc239-4386-4fa4-a0bf-b84503674bd1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1315 microversion: 2.1 time: 0.521357 Sep 10 21:04:08.295327 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1966/4033] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:07 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:08.425642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-68bb48d3-3c3e-48dc-afd4-9d4c3fdc268d tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:08.427592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-68bb48d3-3c3e-48dc-afd4-9d4c3fdc268d tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:08.451513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68bb48d3-3c3e-48dc-afd4-9d4c3fdc268d tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:08.454207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68bb48d3-3c3e-48dc-afd4-9d4c3fdc268d tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:08.454807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68bb48d3-3c3e-48dc-afd4-9d4c3fdc268d tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:08.456257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68bb48d3-3c3e-48dc-afd4-9d4c3fdc268d tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:08.458355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68bb48d3-3c3e-48dc-afd4-9d4c3fdc268d tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:08.459544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68bb48d3-3c3e-48dc-afd4-9d4c3fdc268d tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:08.617877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-68bb48d3-3c3e-48dc-afd4-9d4c3fdc268d tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:08.631498 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-68bb48d3-3c3e-48dc-afd4-9d4c3fdc268d tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1268 microversion: 2.1 time: 0.224603 Sep 10 21:04:08.633905 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2068/4034] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:08 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1268 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:08.798071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d9b13003-d4a1-42d2-b847-16a13ed4f409 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:08.798905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d9b13003-d4a1-42d2-b847-16a13ed4f409 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:08.809304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9b13003-d4a1-42d2-b847-16a13ed4f409 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:08.810208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9b13003-d4a1-42d2-b847-16a13ed4f409 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:08.810951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9b13003-d4a1-42d2-b847-16a13ed4f409 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:08.811922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9b13003-d4a1-42d2-b847-16a13ed4f409 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:08.812634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9b13003-d4a1-42d2-b847-16a13ed4f409 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:08.813299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9b13003-d4a1-42d2-b847-16a13ed4f409 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:08.896748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10fb1e60-f300-4825-9d81-e7d0c6faa508 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:08.897947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10fb1e60-f300-4825-9d81-e7d0c6faa508 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:08.948597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10fb1e60-f300-4825-9d81-e7d0c6faa508 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:08.949258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10fb1e60-f300-4825-9d81-e7d0c6faa508 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:08.949748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10fb1e60-f300-4825-9d81-e7d0c6faa508 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:08.951674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10fb1e60-f300-4825-9d81-e7d0c6faa508 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:08.953317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10fb1e60-f300-4825-9d81-e7d0c6faa508 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:08.953785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10fb1e60-f300-4825-9d81-e7d0c6faa508 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:09.371821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d9b13003-d4a1-42d2-b847-16a13ed4f409 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:09.391439 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d9b13003-d4a1-42d2-b847-16a13ed4f409 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 0.597913 Sep 10 21:04:09.393151 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1967/4035] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:08 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:09.402246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a23e3b89-41d2-4334-a280-84d4f635c5b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:09.403489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a23e3b89-41d2-4334-a280-84d4f635c5b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:09.413087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a23e3b89-41d2-4334-a280-84d4f635c5b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:09.413886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a23e3b89-41d2-4334-a280-84d4f635c5b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:09.414779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a23e3b89-41d2-4334-a280-84d4f635c5b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:09.416466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a23e3b89-41d2-4334-a280-84d4f635c5b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:09.417201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a23e3b89-41d2-4334-a280-84d4f635c5b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:09.418391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a23e3b89-41d2-4334-a280-84d4f635c5b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:09.516550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10fb1e60-f300-4825-9d81-e7d0c6faa508 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:09.525163 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10fb1e60-f300-4825-9d81-e7d0c6faa508 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 0.640154 Sep 10 21:04:09.525756 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2069/4036] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:08 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:09.657155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5b4bd83c-9bce-40f1-9ccb-389566c710f7 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:09.657776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5b4bd83c-9bce-40f1-9ccb-389566c710f7 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:09.665470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b4bd83c-9bce-40f1-9ccb-389566c710f7 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:09.666676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b4bd83c-9bce-40f1-9ccb-389566c710f7 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:09.667958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b4bd83c-9bce-40f1-9ccb-389566c710f7 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:09.669295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b4bd83c-9bce-40f1-9ccb-389566c710f7 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:09.670037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b4bd83c-9bce-40f1-9ccb-389566c710f7 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:09.670933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b4bd83c-9bce-40f1-9ccb-389566c710f7 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:09.808198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5b4bd83c-9bce-40f1-9ccb-389566c710f7 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:09.823383 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5b4bd83c-9bce-40f1-9ccb-389566c710f7 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1274 microversion: 2.1 time: 0.168449 Sep 10 21:04:09.832647 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2070/4037] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:09 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:10.046513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a23e3b89-41d2-4334-a280-84d4f635c5b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:10.054932 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a23e3b89-41d2-4334-a280-84d4f635c5b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1501 microversion: 2.1 time: 0.659255 Sep 10 21:04:10.055880 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1968/4038] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:09 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1501 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:10.081224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e3e704e-bdfe-41a5-ac3e-066518c25849 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:10.081805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e3e704e-bdfe-41a5-ac3e-066518c25849 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:10.093431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3e704e-bdfe-41a5-ac3e-066518c25849 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:10.094278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3e704e-bdfe-41a5-ac3e-066518c25849 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:10.094938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3e704e-bdfe-41a5-ac3e-066518c25849 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:10.095674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3e704e-bdfe-41a5-ac3e-066518c25849 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:10.096141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3e704e-bdfe-41a5-ac3e-066518c25849 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:10.096577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e3e704e-bdfe-41a5-ac3e-066518c25849 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:10.187517 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e3e704e-bdfe-41a5-ac3e-066518c25849 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152/action" status: 202 len: 0 microversion: 2.1 time: 0.112393 Sep 10 21:04:10.190082 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2071/4039] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:04:10 2022] POST /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:04:10.197874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-51a8b818-6352-4fff-a56e-e7e8e72fe8d3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:10.199320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-51a8b818-6352-4fff-a56e-e7e8e72fe8d3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:10.207746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8b818-6352-4fff-a56e-e7e8e72fe8d3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:10.208622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8b818-6352-4fff-a56e-e7e8e72fe8d3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:10.209284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8b818-6352-4fff-a56e-e7e8e72fe8d3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:10.211284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8b818-6352-4fff-a56e-e7e8e72fe8d3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:10.212331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8b818-6352-4fff-a56e-e7e8e72fe8d3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:10.213091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8b818-6352-4fff-a56e-e7e8e72fe8d3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:10.420970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-79aa865c-2ba3-4520-be4c-a446f92edcd9 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:10.422067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-79aa865c-2ba3-4520-be4c-a446f92edcd9 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:10.439682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79aa865c-2ba3-4520-be4c-a446f92edcd9 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:10.441326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79aa865c-2ba3-4520-be4c-a446f92edcd9 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:10.441815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79aa865c-2ba3-4520-be4c-a446f92edcd9 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:10.445959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79aa865c-2ba3-4520-be4c-a446f92edcd9 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:10.449304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79aa865c-2ba3-4520-be4c-a446f92edcd9 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:10.449789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79aa865c-2ba3-4520-be4c-a446f92edcd9 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:10.714564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51a8b818-6352-4fff-a56e-e7e8e72fe8d3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:10.725624 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-51a8b818-6352-4fff-a56e-e7e8e72fe8d3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1506 microversion: 2.1 time: 0.531976 Sep 10 21:04:10.726562 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1969/4040] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:10 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:10.750629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79f6ab0c-22b1-44bc-a716-0c4699ea8f9f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:10.751383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-79f6ab0c-22b1-44bc-a716-0c4699ea8f9f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:10.758552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79f6ab0c-22b1-44bc-a716-0c4699ea8f9f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:10.759404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79f6ab0c-22b1-44bc-a716-0c4699ea8f9f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:10.759980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79f6ab0c-22b1-44bc-a716-0c4699ea8f9f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:10.761461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79f6ab0c-22b1-44bc-a716-0c4699ea8f9f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:10.762246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79f6ab0c-22b1-44bc-a716-0c4699ea8f9f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:10.762751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79f6ab0c-22b1-44bc-a716-0c4699ea8f9f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:10.855534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-79aa865c-2ba3-4520-be4c-a446f92edcd9 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:10.863862 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-79aa865c-2ba3-4520-be4c-a446f92edcd9 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 0.448052 Sep 10 21:04:10.864554 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2072/4041] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:10 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:10.869373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40b6d19e-6129-4c6b-802e-37f81785f75c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:10.870291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-40b6d19e-6129-4c6b-802e-37f81785f75c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:10.878234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40b6d19e-6129-4c6b-802e-37f81785f75c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:10.879040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40b6d19e-6129-4c6b-802e-37f81785f75c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:10.879753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40b6d19e-6129-4c6b-802e-37f81785f75c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:10.880685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40b6d19e-6129-4c6b-802e-37f81785f75c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:10.881148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40b6d19e-6129-4c6b-802e-37f81785f75c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:10.881581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40b6d19e-6129-4c6b-802e-37f81785f75c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:11.006914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40b6d19e-6129-4c6b-802e-37f81785f75c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:11.032362 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40b6d19e-6129-4c6b-802e-37f81785f75c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1274 microversion: 2.1 time: 0.158587 Sep 10 21:04:11.047298 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2073/4042] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:10 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1274 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:11.455873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-79f6ab0c-22b1-44bc-a716-0c4699ea8f9f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:11.474674 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-79f6ab0c-22b1-44bc-a716-0c4699ea8f9f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 0.725704 Sep 10 21:04:11.475730 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1970/4043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:10 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:11.752583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3548a281-7881-4c15-b8ae-574bcbfe9efb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:11.753233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3548a281-7881-4c15-b8ae-574bcbfe9efb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:11.764151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3548a281-7881-4c15-b8ae-574bcbfe9efb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:11.764669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3548a281-7881-4c15-b8ae-574bcbfe9efb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:11.765106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3548a281-7881-4c15-b8ae-574bcbfe9efb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:11.765866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3548a281-7881-4c15-b8ae-574bcbfe9efb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:11.766320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3548a281-7881-4c15-b8ae-574bcbfe9efb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:11.769640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3548a281-7881-4c15-b8ae-574bcbfe9efb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:11.889711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-294664c8-d499-44b1-a8b5-1255ea7a8d36 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:11.892539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-294664c8-d499-44b1-a8b5-1255ea7a8d36 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:11.906865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-294664c8-d499-44b1-a8b5-1255ea7a8d36 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:11.908282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-294664c8-d499-44b1-a8b5-1255ea7a8d36 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:11.909791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-294664c8-d499-44b1-a8b5-1255ea7a8d36 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:11.911012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-294664c8-d499-44b1-a8b5-1255ea7a8d36 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:11.911730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-294664c8-d499-44b1-a8b5-1255ea7a8d36 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:11.912565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-294664c8-d499-44b1-a8b5-1255ea7a8d36 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:12.172001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3548a281-7881-4c15-b8ae-574bcbfe9efb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:12.180403 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3548a281-7881-4c15-b8ae-574bcbfe9efb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1486 microversion: 2.1 time: 0.431588 Sep 10 21:04:12.181860 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2074/4044] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:11 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1486 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:12.203707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39892685-2a8d-432f-a805-4eb6c4952ab8 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:12.205150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-39892685-2a8d-432f-a805-4eb6c4952ab8 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:12.212677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39892685-2a8d-432f-a805-4eb6c4952ab8 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:12.213545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39892685-2a8d-432f-a805-4eb6c4952ab8 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:12.214878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39892685-2a8d-432f-a805-4eb6c4952ab8 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:12.216384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39892685-2a8d-432f-a805-4eb6c4952ab8 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:12.217230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39892685-2a8d-432f-a805-4eb6c4952ab8 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:12.219101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39892685-2a8d-432f-a805-4eb6c4952ab8 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:12.441066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-294664c8-d499-44b1-a8b5-1255ea7a8d36 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:12.455279 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-294664c8-d499-44b1-a8b5-1255ea7a8d36 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 0.571611 Sep 10 21:04:12.455895 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1971/4045] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:11 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:12.465057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1e0c1ca2-4695-4173-b0b3-c1fc97e25460 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:12.465709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e0c1ca2-4695-4173-b0b3-c1fc97e25460 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:12.470600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-39892685-2a8d-432f-a805-4eb6c4952ab8 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:12.479057 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-39892685-2a8d-432f-a805-4eb6c4952ab8 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1316 microversion: 2.1 time: 0.295826 Sep 10 21:04:12.483262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e0c1ca2-4695-4173-b0b3-c1fc97e25460 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:12.484008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e0c1ca2-4695-4173-b0b3-c1fc97e25460 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:12.500249 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2075/4046] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:12 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:12.501385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e0c1ca2-4695-4173-b0b3-c1fc97e25460 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:12.502402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e0c1ca2-4695-4173-b0b3-c1fc97e25460 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:12.503049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e0c1ca2-4695-4173-b0b3-c1fc97e25460 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:12.503658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e0c1ca2-4695-4173-b0b3-c1fc97e25460 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:12.539650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e0c1ca2-4695-4173-b0b3-c1fc97e25460 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:04:12.689941 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1e0c1ca2-4695-4173-b0b3-c1fc97e25460 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 204 len: 0 microversion: 2.1 time: 0.232422 Sep 10 21:04:12.690665 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1972/4047] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:04:12 2022] DELETE /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:04:12.702973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-26c14d4b-978e-43fb-bd04-772dbfc0152b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:12.705008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-26c14d4b-978e-43fb-bd04-772dbfc0152b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:12.720521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26c14d4b-978e-43fb-bd04-772dbfc0152b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:12.723200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26c14d4b-978e-43fb-bd04-772dbfc0152b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:12.723811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26c14d4b-978e-43fb-bd04-772dbfc0152b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:12.726060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26c14d4b-978e-43fb-bd04-772dbfc0152b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:12.728742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26c14d4b-978e-43fb-bd04-772dbfc0152b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:12.729199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26c14d4b-978e-43fb-bd04-772dbfc0152b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:12.845583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2c05b7bc-2821-4306-94fe-7cbe1d8d4aa6 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-748350377", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:12.852605 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-2c05b7bc-2821-4306-94fe-7cbe1d8d4aa6 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] HTTP exception thrown: min_count must be <= max_count Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2c05b7bc-2821-4306-94fe-7cbe1d8d4aa6 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Request method failure captured: Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 183 Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPvMIVizFP9caLqO4PCWOzpAwyQ_85eelZw8LdKv3KULG7uLstCoGkJQhyLIcQl8piPG7eqG5C87W8rTyOGGYik1maYgPWXh5E7ZHtPbzc5a8avgEMvzhR0rt_CVHILBHhgx0iVziKSp9csTy6xgaUW7UNnF5iBJZd4fjl-dxXQ-_fs Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 449ab68ad6e7456dbf9d0ba3a16e2754 Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/449ab68ad6e7456dbf9d0ba3a16e2754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/449ab68ad6e7456dbf9d0ba3a16e2754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_449ab68ad6e7456dbf9d0ba3a16e2754", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/449ab68ad6e7456dbf9d0ba3a16e2754"}]}] Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 449ab68ad6e7456dbf9d0ba3a16e2754 Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-MultipleCreateNegativeTestJSON-657211867-project Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5cc5d837f74b40118e01a4e53ff194ca Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-657211867-project Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-748350377", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: exception: min_count must be <= max_count Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-748350377', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 10 21:04:12.858951 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:12.866287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2c05b7bc-2821-4306-94fe-7cbe1d8d4aa6 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Returning 400 to user: min_count must be <= max_count {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:12.868782 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2c05b7bc-2821-4306-94fe-7cbe1d8d4aa6 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.382398 Sep 10 21:04:12.872816 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2076/4048] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:04:12 2022] POST /compute/v2.1/servers => generated 74 bytes in 388 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 21:04:12.888306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6fa6087f-7cad-4df7-9e76-40a7b67308c8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:12.889215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6fa6087f-7cad-4df7-9e76-40a7b67308c8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:12.902094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fa6087f-7cad-4df7-9e76-40a7b67308c8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:12.904271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fa6087f-7cad-4df7-9e76-40a7b67308c8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:12.905172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fa6087f-7cad-4df7-9e76-40a7b67308c8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:12.906750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fa6087f-7cad-4df7-9e76-40a7b67308c8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:12.907794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fa6087f-7cad-4df7-9e76-40a7b67308c8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:12.909516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fa6087f-7cad-4df7-9e76-40a7b67308c8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:13.052054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-26c14d4b-978e-43fb-bd04-772dbfc0152b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:13.060947 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-26c14d4b-978e-43fb-bd04-772dbfc0152b tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 0.368816 Sep 10 21:04:13.070133 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1973/4049] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:12 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:13.084472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-bc61f007-abe5-4a80-b26f-c4264bb98808 req-b13973b0-be29-48d0-8a4c-b8941346cb26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1", "tag": "dd553670-f89e-472f-bd36-2afd5e60b463"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:13.108160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bc61f007-abe5-4a80-b26f-c4264bb98808 req-b13973b0-be29-48d0-8a4c-b8941346cb26 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:13.111213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bc61f007-abe5-4a80-b26f-c4264bb98808 req-b13973b0-be29-48d0-8a4c-b8941346cb26 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:13.112315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bc61f007-abe5-4a80-b26f-c4264bb98808 req-b13973b0-be29-48d0-8a4c-b8941346cb26 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:13.154817 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-bc61f007-abe5-4a80-b26f-c4264bb98808 req-b13973b0-be29-48d0-8a4c-b8941346cb26 service nova] Creating event network-changed:dd553670-f89e-472f-bd36-2afd5e60b463 for instance e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 on nch2-master-1 Sep 10 21:04:13.167009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-bc61f007-abe5-4a80-b26f-c4264bb98808 req-b13973b0-be29-48d0-8a4c-b8941346cb26 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094017 Sep 10 21:04:13.168848 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1974/4050] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:13.187248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f1042ce-0b78-4f67-addb-69959a71bc0d tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-457417702", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "max_count": 0}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f1042ce-0b78-4f67-addb-69959a71bc0d tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Request method failure captured: Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 167 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPvMIVizFP9caLqO4PCWOzpAwyQ_85eelZw8LdKv3KULG7uLstCoGkJQhyLIcQl8piPG7eqG5C87W8rTyOGGYik1maYgPWXh5E7ZHtPbzc5a8avgEMvzhR0rt_CVHILBHhgx0iVziKSp9csTy6xgaUW7UNnF5iBJZd4fjl-dxXQ-_fs Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 449ab68ad6e7456dbf9d0ba3a16e2754 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/449ab68ad6e7456dbf9d0ba3a16e2754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/449ab68ad6e7456dbf9d0ba3a16e2754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_449ab68ad6e7456dbf9d0ba3a16e2754", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/449ab68ad6e7456dbf9d0ba3a16e2754"}]}] Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 449ab68ad6e7456dbf9d0ba3a16e2754 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-MultipleCreateNegativeTestJSON-657211867-project Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5cc5d837f74b40118e01a4e53ff194ca Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-657211867-project Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-457417702", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "max_count": 0}} Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-457417702', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'max_count': 0}}} Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 0 Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 21:04:13.196043 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f1042ce-0b78-4f67-addb-69959a71bc0d tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f1042ce-0b78-4f67-addb-69959a71bc0d tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.015034 Sep 10 21:04:13.202672 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1975/4051] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:04:13 2022] POST /compute/v2.1/servers => generated 130 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 21:04:13.228306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6fa6087f-7cad-4df7-9e76-40a7b67308c8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:13.242414 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6fa6087f-7cad-4df7-9e76-40a7b67308c8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1492 microversion: 2.1 time: 0.366533 Sep 10 21:04:13.243637 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2077/4052] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:12 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1492 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:13.318242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-929d24a7-3a48-40b4-8f0a-4bfe5169ced6 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-371502878", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "max_count": 2.5}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-929d24a7-3a48-40b4-8f0a-4bfe5169ced6 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Request method failure captured: Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 169 Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPvMIVizFP9caLqO4PCWOzpAwyQ_85eelZw8LdKv3KULG7uLstCoGkJQhyLIcQl8piPG7eqG5C87W8rTyOGGYik1maYgPWXh5E7ZHtPbzc5a8avgEMvzhR0rt_CVHILBHhgx0iVziKSp9csTy6xgaUW7UNnF5iBJZd4fjl-dxXQ-_fs Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 449ab68ad6e7456dbf9d0ba3a16e2754 Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/449ab68ad6e7456dbf9d0ba3a16e2754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/449ab68ad6e7456dbf9d0ba3a16e2754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_449ab68ad6e7456dbf9d0ba3a16e2754", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/449ab68ad6e7456dbf9d0ba3a16e2754"}]}] Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 449ab68ad6e7456dbf9d0ba3a16e2754 Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-MultipleCreateNegativeTestJSON-657211867-project Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5cc5d837f74b40118e01a4e53ff194ca Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-657211867-project Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-371502878", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "max_count": 2.5}} Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-371502878', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'max_count': 2.5}}} Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 2.5 Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 21:04:13.322921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 21:04:13.328319 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.331027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-929d24a7-3a48-40b4-8f0a-4bfe5169ced6 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:13.332080 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-929d24a7-3a48-40b4-8f0a-4bfe5169ced6 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018584 Sep 10 21:04:13.333047 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1976/4053] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:04:13 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:04:13.393702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dbbd7455-bcf4-4397-bcd0-f9968c4688d7 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-91032325", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 0}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dbbd7455-bcf4-4397-bcd0-f9968c4688d7 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Request method failure captured: Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 166 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPvMIVizFP9caLqO4PCWOzpAwyQ_85eelZw8LdKv3KULG7uLstCoGkJQhyLIcQl8piPG7eqG5C87W8rTyOGGYik1maYgPWXh5E7ZHtPbzc5a8avgEMvzhR0rt_CVHILBHhgx0iVziKSp9csTy6xgaUW7UNnF5iBJZd4fjl-dxXQ-_fs Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 449ab68ad6e7456dbf9d0ba3a16e2754 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/449ab68ad6e7456dbf9d0ba3a16e2754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/449ab68ad6e7456dbf9d0ba3a16e2754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_449ab68ad6e7456dbf9d0ba3a16e2754", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/449ab68ad6e7456dbf9d0ba3a16e2754"}]}] Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 449ab68ad6e7456dbf9d0ba3a16e2754 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-MultipleCreateNegativeTestJSON-657211867-project Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5cc5d837f74b40118e01a4e53ff194ca Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-657211867-project Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-91032325", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 0}} Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-91032325', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'min_count': 0}}} Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 0 Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 21:04:13.398601 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 10 21:04:13.405297 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.409239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dbbd7455-bcf4-4397-bcd0-f9968c4688d7 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:13.410448 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dbbd7455-bcf4-4397-bcd0-f9968c4688d7 tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021114 Sep 10 21:04:13.411218 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2078/4054] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:04:13 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:04:13.481348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-edd88bcc-da8b-4e33-9842-34b5ad05190e tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:13.482846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-edd88bcc-da8b-4e33-9842-34b5ad05190e tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:13.491512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edd88bcc-da8b-4e33-9842-34b5ad05190e tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:13.492292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edd88bcc-da8b-4e33-9842-34b5ad05190e tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:13.492973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edd88bcc-da8b-4e33-9842-34b5ad05190e tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:13.494089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edd88bcc-da8b-4e33-9842-34b5ad05190e tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:13.495868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edd88bcc-da8b-4e33-9842-34b5ad05190e tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:13.496545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edd88bcc-da8b-4e33-9842-34b5ad05190e tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:13.507535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-837d3e0e-aea0-457d-9757-27950f7e425c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:13.508161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-837d3e0e-aea0-457d-9757-27950f7e425c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:13.518238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-837d3e0e-aea0-457d-9757-27950f7e425c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:13.519776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-837d3e0e-aea0-457d-9757-27950f7e425c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:13.524372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-837d3e0e-aea0-457d-9757-27950f7e425c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:13.526509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-837d3e0e-aea0-457d-9757-27950f7e425c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:13.528157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-837d3e0e-aea0-457d-9757-27950f7e425c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:13.528785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-837d3e0e-aea0-457d-9757-27950f7e425c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:13.703802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-edd88bcc-da8b-4e33-9842-34b5ad05190e tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:13.707614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-837d3e0e-aea0-457d-9757-27950f7e425c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:13.715502 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-edd88bcc-da8b-4e33-9842-34b5ad05190e tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 0.238221 Sep 10 21:04:13.716100 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1977/4055] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:13 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:13.722754 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-837d3e0e-aea0-457d-9757-27950f7e425c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1316 microversion: 2.1 time: 0.219120 Sep 10 21:04:13.723584 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2079/4056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:13 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:13.726010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-664924b9-ad14-4946-af2d-70a916a14a3a tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1034141912", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 2.5}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-664924b9-ad14-4946-af2d-70a916a14a3a tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Request method failure captured: Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 170 Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPvMIVizFP9caLqO4PCWOzpAwyQ_85eelZw8LdKv3KULG7uLstCoGkJQhyLIcQl8piPG7eqG5C87W8rTyOGGYik1maYgPWXh5E7ZHtPbzc5a8avgEMvzhR0rt_CVHILBHhgx0iVziKSp9csTy6xgaUW7UNnF5iBJZd4fjl-dxXQ-_fs Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 449ab68ad6e7456dbf9d0ba3a16e2754 Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/449ab68ad6e7456dbf9d0ba3a16e2754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/449ab68ad6e7456dbf9d0ba3a16e2754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_449ab68ad6e7456dbf9d0ba3a16e2754", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/449ab68ad6e7456dbf9d0ba3a16e2754"}]}] Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 449ab68ad6e7456dbf9d0ba3a16e2754 Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-657211867 Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-MultipleCreateNegativeTestJSON-657211867-project Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5cc5d837f74b40118e01a4e53ff194ca Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-657211867-project Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1034141912", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 2.5}} Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1034141912', 'imageRef': 'b43a7a8a-2616-430e-9e50-ef93c087ed12', 'flavorRef': '452', 'min_count': 2.5}}} Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 2.5 Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 21:04:13.731252 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-664924b9-ad14-4946-af2d-70a916a14a3a tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-664924b9-ad14-4946-af2d-70a916a14a3a tempest-MultipleCreateNegativeTestJSON-657211867 tempest-MultipleCreateNegativeTestJSON-657211867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015604 Sep 10 21:04:13.737514 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1978/4057] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:04:13 2022] POST /compute/v2.1/servers => generated 139 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:04:14.094151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-77d96583-cf9c-4f7a-b564-48339114855f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:14.094772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-77d96583-cf9c-4f7a-b564-48339114855f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:14.106991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77d96583-cf9c-4f7a-b564-48339114855f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:14.109107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77d96583-cf9c-4f7a-b564-48339114855f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:14.110395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77d96583-cf9c-4f7a-b564-48339114855f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:14.112126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77d96583-cf9c-4f7a-b564-48339114855f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:14.113806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77d96583-cf9c-4f7a-b564-48339114855f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:14.114350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77d96583-cf9c-4f7a-b564-48339114855f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:14.272744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aac82a87-39f6-4261-ac9f-9f55cf34ef33 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:14.273452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aac82a87-39f6-4261-ac9f-9f55cf34ef33 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:14.275675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:14.293273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac82a87-39f6-4261-ac9f-9f55cf34ef33 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:14.293969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac82a87-39f6-4261-ac9f-9f55cf34ef33 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:14.294678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac82a87-39f6-4261-ac9f-9f55cf34ef33 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:14.295467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac82a87-39f6-4261-ac9f-9f55cf34ef33 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:14.296005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac82a87-39f6-4261-ac9f-9f55cf34ef33 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:14.296694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aac82a87-39f6-4261-ac9f-9f55cf34ef33 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:14.524824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aac82a87-39f6-4261-ac9f-9f55cf34ef33 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:14.533338 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aac82a87-39f6-4261-ac9f-9f55cf34ef33 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1492 microversion: 2.1 time: 0.266327 Sep 10 21:04:14.534075 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1979/4058] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:14 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1492 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:14.740558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70475f3b-b020-46a5-a0a5-8e5c4b95b937 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:14.741490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-70475f3b-b020-46a5-a0a5-8e5c4b95b937 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:14.749767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70475f3b-b020-46a5-a0a5-8e5c4b95b937 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:14.750318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70475f3b-b020-46a5-a0a5-8e5c4b95b937 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:14.750765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70475f3b-b020-46a5-a0a5-8e5c4b95b937 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:14.751490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70475f3b-b020-46a5-a0a5-8e5c4b95b937 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:14.752587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70475f3b-b020-46a5-a0a5-8e5c4b95b937 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:14.753361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70475f3b-b020-46a5-a0a5-8e5c4b95b937 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:15.018443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-77d96583-cf9c-4f7a-b564-48339114855f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:15.028463 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-77d96583-cf9c-4f7a-b564-48339114855f tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 0.939230 Sep 10 21:04:15.029544 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2080/4059] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:14 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:15.049438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5578e268-5d24-4ebf-93b8-e3ac67ae91fb tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:15.050824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5578e268-5d24-4ebf-93b8-e3ac67ae91fb tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:15.065394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5578e268-5d24-4ebf-93b8-e3ac67ae91fb tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:15.067171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5578e268-5d24-4ebf-93b8-e3ac67ae91fb tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:15.068026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5578e268-5d24-4ebf-93b8-e3ac67ae91fb tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:15.070165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5578e268-5d24-4ebf-93b8-e3ac67ae91fb tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:15.072394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5578e268-5d24-4ebf-93b8-e3ac67ae91fb tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:15.073695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5578e268-5d24-4ebf-93b8-e3ac67ae91fb tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:15.207051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-70475f3b-b020-46a5-a0a5-8e5c4b95b937 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:15.220944 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-70475f3b-b020-46a5-a0a5-8e5c4b95b937 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 0.483976 Sep 10 21:04:15.222988 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1980/4060] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:14 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:15.559207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c385022b-a0a8-4cf6-9baa-7d61cca36674 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:15.559840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c385022b-a0a8-4cf6-9baa-7d61cca36674 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:15.594666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c385022b-a0a8-4cf6-9baa-7d61cca36674 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:15.595196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c385022b-a0a8-4cf6-9baa-7d61cca36674 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:15.597722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c385022b-a0a8-4cf6-9baa-7d61cca36674 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:15.598540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c385022b-a0a8-4cf6-9baa-7d61cca36674 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:15.600498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c385022b-a0a8-4cf6-9baa-7d61cca36674 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:15.600958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c385022b-a0a8-4cf6-9baa-7d61cca36674 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:15.619640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5578e268-5d24-4ebf-93b8-e3ac67ae91fb tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:15.635918 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5578e268-5d24-4ebf-93b8-e3ac67ae91fb tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1316 microversion: 2.1 time: 0.599318 Sep 10 21:04:15.636950 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2081/4061] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:15 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:16.054907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-161bb4c4-3f7c-4a7e-b881-87d3fe53dbbe tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:16.055496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-161bb4c4-3f7c-4a7e-b881-87d3fe53dbbe tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:16.057542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:16.066928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-161bb4c4-3f7c-4a7e-b881-87d3fe53dbbe tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:16.067445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-161bb4c4-3f7c-4a7e-b881-87d3fe53dbbe tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:16.067847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-161bb4c4-3f7c-4a7e-b881-87d3fe53dbbe tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:16.068552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-161bb4c4-3f7c-4a7e-b881-87d3fe53dbbe tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:16.069002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-161bb4c4-3f7c-4a7e-b881-87d3fe53dbbe tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:16.075079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-161bb4c4-3f7c-4a7e-b881-87d3fe53dbbe tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:16.081518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c385022b-a0a8-4cf6-9baa-7d61cca36674 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:16.084427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:16.097514 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c385022b-a0a8-4cf6-9baa-7d61cca36674 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1492 microversion: 2.1 time: 0.544419 Sep 10 21:04:16.103336 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1981/4062] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:15 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1492 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:16.247036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66a2ed54-1e3d-466d-aab0-f52be5ef9bbc tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:16.247687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-66a2ed54-1e3d-466d-aab0-f52be5ef9bbc tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:16.261306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66a2ed54-1e3d-466d-aab0-f52be5ef9bbc tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:16.261854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66a2ed54-1e3d-466d-aab0-f52be5ef9bbc tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:16.262296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66a2ed54-1e3d-466d-aab0-f52be5ef9bbc tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:16.263031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66a2ed54-1e3d-466d-aab0-f52be5ef9bbc tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:16.265696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66a2ed54-1e3d-466d-aab0-f52be5ef9bbc tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:16.266178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66a2ed54-1e3d-466d-aab0-f52be5ef9bbc tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:16.277161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:16.585096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-161bb4c4-3f7c-4a7e-b881-87d3fe53dbbe tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:16.607486 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-161bb4c4-3f7c-4a7e-b881-87d3fe53dbbe tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 0.555994 Sep 10 21:04:16.608699 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2082/4063] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:16 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:16.630495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-edd33f41-3e39-47ad-a5d7-c0d4b68aa6fb req-8edfafb6-d18d-4fd2-a0cc-09227d20d3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5f777c-02bd-4bbb-aad0-b79d88257152", "name": "network-vif-deleted", "tag": "d1c8dd22-dc75-40c3-ac50-4df8c5811a72"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:16.644999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-edd33f41-3e39-47ad-a5d7-c0d4b68aa6fb req-8edfafb6-d18d-4fd2-a0cc-09227d20d3b6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:16.645894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-edd33f41-3e39-47ad-a5d7-c0d4b68aa6fb req-8edfafb6-d18d-4fd2-a0cc-09227d20d3b6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:16.646602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-edd33f41-3e39-47ad-a5d7-c0d4b68aa6fb req-8edfafb6-d18d-4fd2-a0cc-09227d20d3b6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:16.669616 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-edd33f41-3e39-47ad-a5d7-c0d4b68aa6fb req-8edfafb6-d18d-4fd2-a0cc-09227d20d3b6 service nova] Creating event network-vif-deleted:d1c8dd22-dc75-40c3-ac50-4df8c5811a72 for instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 on nch2-master-1 Sep 10 21:04:16.677259 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-edd33f41-3e39-47ad-a5d7-c0d4b68aa6fb req-8edfafb6-d18d-4fd2-a0cc-09227d20d3b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064247 Sep 10 21:04:16.678486 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2083/4064] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:16.687147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4740f191-6abc-4468-adb0-be0559330274 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:16.688269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4740f191-6abc-4468-adb0-be0559330274 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:16.697265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4740f191-6abc-4468-adb0-be0559330274 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:16.698985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4740f191-6abc-4468-adb0-be0559330274 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:16.699494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4740f191-6abc-4468-adb0-be0559330274 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:16.700552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4740f191-6abc-4468-adb0-be0559330274 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:16.701078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4740f191-6abc-4468-adb0-be0559330274 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:16.701739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4740f191-6abc-4468-adb0-be0559330274 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:16.710443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-66a2ed54-1e3d-466d-aab0-f52be5ef9bbc tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:16.722953 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-66a2ed54-1e3d-466d-aab0-f52be5ef9bbc tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 0.480819 Sep 10 21:04:16.725192 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1982/4065] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:16 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:16.874690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4740f191-6abc-4468-adb0-be0559330274 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:16.883330 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4740f191-6abc-4468-adb0-be0559330274 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1316 microversion: 2.1 time: 0.203352 Sep 10 21:04:16.883925 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2084/4066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:16 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:17.126813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:17.127905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:17.135358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:17.136922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:17.137714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:17.138974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:17.139860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:17.140579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:17.205381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:17.206264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:17.206945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:17.207650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lazy-loading 'fault' on Instance uuid 7a5f777c-02bd-4bbb-aad0-b79d88257152 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:04:17.273538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7e8e2df5-0526-4a5d-bd11-0a4b01c50d57 req-7cdd3156-373b-46cd-8698-03537178d2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d690d87c-2883-4181-8552-01f2be84e93c", "name": "network-vif-plugged", "status": "completed", "tag": "c9e1a782-f90c-4541-ba9a-c993f5ef1b41"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:17.286290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:17.299545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7e8e2df5-0526-4a5d-bd11-0a4b01c50d57 req-7cdd3156-373b-46cd-8698-03537178d2db service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:17.299716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:17.300028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7e8e2df5-0526-4a5d-bd11-0a4b01c50d57 req-7cdd3156-373b-46cd-8698-03537178d2db service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:17.300470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7e8e2df5-0526-4a5d-bd11-0a4b01c50d57 req-7cdd3156-373b-46cd-8698-03537178d2db service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:17.314787 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd008a35-5fcf-4a81-97a2-d048fd30e749 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 200 len: 1305 microversion: 2.1 time: 0.189641 Sep 10 21:04:17.316911 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1983/4067] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:17 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 1305 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:17.334877 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7e8e2df5-0526-4a5d-bd11-0a4b01c50d57 req-7cdd3156-373b-46cd-8698-03537178d2db service nova] Creating event network-vif-plugged:c9e1a782-f90c-4541-ba9a-c993f5ef1b41 for instance d690d87c-2883-4181-8552-01f2be84e93c on nch1-master-1 Sep 10 21:04:17.351408 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7e8e2df5-0526-4a5d-bd11-0a4b01c50d57 req-7cdd3156-373b-46cd-8698-03537178d2db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081858 Sep 10 21:04:17.354718 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2085/4068] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:04:17.634648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55b1434a-9cec-4053-8b4f-72bb0121454a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:17.637307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55b1434a-9cec-4053-8b4f-72bb0121454a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:17.653398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55b1434a-9cec-4053-8b4f-72bb0121454a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:17.654079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55b1434a-9cec-4053-8b4f-72bb0121454a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:17.654906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55b1434a-9cec-4053-8b4f-72bb0121454a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:17.658467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55b1434a-9cec-4053-8b4f-72bb0121454a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:17.659040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55b1434a-9cec-4053-8b4f-72bb0121454a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:17.659502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55b1434a-9cec-4053-8b4f-72bb0121454a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:17.750332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b418a90a-07ac-4705-9d0c-57526e7c5c91 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:17.751292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b418a90a-07ac-4705-9d0c-57526e7c5c91 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:17.753628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:17.764553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b418a90a-07ac-4705-9d0c-57526e7c5c91 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:17.765052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b418a90a-07ac-4705-9d0c-57526e7c5c91 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:17.765495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b418a90a-07ac-4705-9d0c-57526e7c5c91 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:17.768715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b418a90a-07ac-4705-9d0c-57526e7c5c91 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:17.769194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b418a90a-07ac-4705-9d0c-57526e7c5c91 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:17.769636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b418a90a-07ac-4705-9d0c-57526e7c5c91 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:17.899690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-55b1434a-9cec-4053-8b4f-72bb0121454a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:17.914017 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55b1434a-9cec-4053-8b4f-72bb0121454a tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 0.283563 Sep 10 21:04:17.915237 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1984/4069] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:17 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:17.928754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d58cbc6b-fa2c-4c59-be56-f5f115f8df57 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:17.931109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d58cbc6b-fa2c-4c59-be56-f5f115f8df57 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:17.940417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d58cbc6b-fa2c-4c59-be56-f5f115f8df57 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:17.946972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d58cbc6b-fa2c-4c59-be56-f5f115f8df57 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:17.950882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d58cbc6b-fa2c-4c59-be56-f5f115f8df57 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:17.952283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d58cbc6b-fa2c-4c59-be56-f5f115f8df57 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:17.953020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d58cbc6b-fa2c-4c59-be56-f5f115f8df57 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:17.954462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d58cbc6b-fa2c-4c59-be56-f5f115f8df57 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:18.150718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b418a90a-07ac-4705-9d0c-57526e7c5c91 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:18.165848 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b418a90a-07ac-4705-9d0c-57526e7c5c91 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1370 microversion: 2.1 time: 0.420236 Sep 10 21:04:18.183552 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2086/4070] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:17 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1370 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:18.202522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d58cbc6b-fa2c-4c59-be56-f5f115f8df57 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:18.212731 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d58cbc6b-fa2c-4c59-be56-f5f115f8df57 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1316 microversion: 2.1 time: 0.294172 Sep 10 21:04:18.213412 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1985/4071] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:17 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:18.346633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:18.347274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:18.376613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:18.378149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:18.378769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:18.379949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:18.380607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:18.381474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:18.436604 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 HTTP/1.1 Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '7a5f777c-02bd-4bbb-aad0-b79d88257152'} Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:18.438412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:18.456256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:18.456256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:18.456256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:18.456256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:04:18.456256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:04:18.456256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:04:18.456256 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:18.456256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:18.456256 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3a070a6-788a-4935-9bae-58e9cefe68a0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 404 len: 111 microversion: 2.1 time: 0.104375 Sep 10 21:04:18.456256 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2087/4072] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:18 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:04:18.565377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-991008405", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f5a2cd59-1be7-47bd-82a5-e6307d510b6e"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:18.651930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] validate_networks() for [('f5a2cd59-1be7-47bd-82a5-e6307d510b6e', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:04:18.944318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e5f2cf1-dfe2-4bf7-af77-1421286d7203 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:18.944790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e5f2cf1-dfe2-4bf7-af77-1421286d7203 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:18.952916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e5f2cf1-dfe2-4bf7-af77-1421286d7203 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:18.956164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e5f2cf1-dfe2-4bf7-af77-1421286d7203 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:18.959251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e5f2cf1-dfe2-4bf7-af77-1421286d7203 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:18.960238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e5f2cf1-dfe2-4bf7-af77-1421286d7203 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:18.961487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e5f2cf1-dfe2-4bf7-af77-1421286d7203 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:18.962140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e5f2cf1-dfe2-4bf7-af77-1421286d7203 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:19.362037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6e5f2cf1-dfe2-4bf7-af77-1421286d7203 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:19.372234 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e5f2cf1-dfe2-4bf7-af77-1421286d7203 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 0.432942 Sep 10 21:04:19.373190 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2088/4073] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:18 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:19.378387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f6c5c22-ee4d-43f2-b61b-c9124daf95a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:19.379205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2f6c5c22-ee4d-43f2-b61b-c9124daf95a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:19.386485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f6c5c22-ee4d-43f2-b61b-c9124daf95a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:19.387254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f6c5c22-ee4d-43f2-b61b-c9124daf95a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:19.387921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f6c5c22-ee4d-43f2-b61b-c9124daf95a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:19.389078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f6c5c22-ee4d-43f2-b61b-c9124daf95a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:19.389741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f6c5c22-ee4d-43f2-b61b-c9124daf95a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:19.390419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f6c5c22-ee4d-43f2-b61b-c9124daf95a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:19.520554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:04:19.521063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:04:19.521448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:04:19.521884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:04:19.522306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:04:19.536255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:19.537338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:19.538037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:19.539289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:19.540284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:19.541202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:19.566198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:04:19.572668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for user 4faa458c158141efaf707317411cd544 and project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:04:19.597807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:04:19.600559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:04:19.667343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2f6c5c22-ee4d-43f2-b61b-c9124daf95a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:19.678418 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f6c5c22-ee4d-43f2-b61b-c9124daf95a0 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1555 microversion: 2.1 time: 0.303732 Sep 10 21:04:19.679093 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2089/4074] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:19 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1555 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:19.690149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9808c77b-7a9f-47f0-aef5-f8951f84cce0 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:19.691733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9808c77b-7a9f-47f0-aef5-f8951f84cce0 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:19.700295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9808c77b-7a9f-47f0-aef5-f8951f84cce0 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:19.701023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9808c77b-7a9f-47f0-aef5-f8951f84cce0 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:19.701191 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1e9df41a-4833-4e0d-b523-fdfbf85430e5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.140363 Sep 10 21:04:19.704459 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1986/4075] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:04:19.707398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9808c77b-7a9f-47f0-aef5-f8951f84cce0 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:19.708392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9808c77b-7a9f-47f0-aef5-f8951f84cce0 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:19.709046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9808c77b-7a9f-47f0-aef5-f8951f84cce0 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:19.710037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9808c77b-7a9f-47f0-aef5-f8951f84cce0 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:19.719503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-cda272a8-f3f2-4022-8bd4-9ac939c7d886 req-415dc036-bf71-4c94-ad38-4930d848ce90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b3c03dd-c695-45a2-9f38-644898a83d54", "name": "network-vif-plugged", "status": "completed", "tag": "cb320d7b-6513-4eb1-a214-2f8c317c9084"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:19.754015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cda272a8-f3f2-4022-8bd4-9ac939c7d886 req-415dc036-bf71-4c94-ad38-4930d848ce90 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:19.755711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cda272a8-f3f2-4022-8bd4-9ac939c7d886 req-415dc036-bf71-4c94-ad38-4930d848ce90 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:19.756640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cda272a8-f3f2-4022-8bd4-9ac939c7d886 req-415dc036-bf71-4c94-ad38-4930d848ce90 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:19.792035 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cda272a8-f3f2-4022-8bd4-9ac939c7d886 req-415dc036-bf71-4c94-ad38-4930d848ce90 service nova] Creating event network-vif-plugged:cb320d7b-6513-4eb1-a214-2f8c317c9084 for instance 8b3c03dd-c695-45a2-9f38-644898a83d54 on nch1-master-1 Sep 10 21:04:19.806979 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-cda272a8-f3f2-4022-8bd4-9ac939c7d886 req-415dc036-bf71-4c94-ad38-4930d848ce90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101226 Sep 10 21:04:19.809957 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1987/4076] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:19.819222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9018639e-df1b-46f3-8426-1d76f45532f2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:19.827549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9018639e-df1b-46f3-8426-1d76f45532f2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:19.849984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9018639e-df1b-46f3-8426-1d76f45532f2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:19.850848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9018639e-df1b-46f3-8426-1d76f45532f2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:19.852523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9018639e-df1b-46f3-8426-1d76f45532f2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:19.856552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9018639e-df1b-46f3-8426-1d76f45532f2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:19.860402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9018639e-df1b-46f3-8426-1d76f45532f2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:19.861136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9018639e-df1b-46f3-8426-1d76f45532f2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:20.466509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9808c77b-7a9f-47f0-aef5-f8951f84cce0 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:20.478575 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9808c77b-7a9f-47f0-aef5-f8951f84cce0 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1316 microversion: 2.1 time: 0.797215 Sep 10 21:04:20.481075 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2090/4077] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:19 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1316 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:20.489097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6f096a95-2502-47bb-83c6-e41dd8fed95c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:20.490694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6f096a95-2502-47bb-83c6-e41dd8fed95c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:20.575781 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9018639e-df1b-46f3-8426-1d76f45532f2 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.762908 Sep 10 21:04:20.576440 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1988/4078] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:04:19 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-interface => generated 284 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:20.585082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ed137214-7a87-425b-829d-dd38d521c1e6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:20.585082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ed137214-7a87-425b-829d-dd38d521c1e6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:20.589366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed137214-7a87-425b-829d-dd38d521c1e6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:20.590129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed137214-7a87-425b-829d-dd38d521c1e6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:20.590581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed137214-7a87-425b-829d-dd38d521c1e6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:20.591290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed137214-7a87-425b-829d-dd38d521c1e6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:20.592190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed137214-7a87-425b-829d-dd38d521c1e6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:20.592796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed137214-7a87-425b-829d-dd38d521c1e6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:20.606570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6f096a95-2502-47bb-83c6-e41dd8fed95c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:20.614308 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6f096a95-2502-47bb-83c6-e41dd8fed95c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1214 microversion: 2.1 time: 0.132152 Sep 10 21:04:20.622023 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2091/4079] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:20 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:20.903521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed137214-7a87-425b-829d-dd38d521c1e6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:20.934164 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ed137214-7a87-425b-829d-dd38d521c1e6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 0.354594 Sep 10 21:04:20.936150 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1989/4080] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:20 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:21.506680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-98d2cb70-aa62-41bb-af5f-8bc4bd9f8e11 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:21.508335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-98d2cb70-aa62-41bb-af5f-8bc4bd9f8e11 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:21.519583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98d2cb70-aa62-41bb-af5f-8bc4bd9f8e11 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:21.521101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98d2cb70-aa62-41bb-af5f-8bc4bd9f8e11 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:21.522243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98d2cb70-aa62-41bb-af5f-8bc4bd9f8e11 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:21.523539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98d2cb70-aa62-41bb-af5f-8bc4bd9f8e11 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:21.524347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98d2cb70-aa62-41bb-af5f-8bc4bd9f8e11 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:21.525016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98d2cb70-aa62-41bb-af5f-8bc4bd9f8e11 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:21.648773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8212bf18-56df-455c-8f40-bc538ac5e346 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:21.650265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8212bf18-56df-455c-8f40-bc538ac5e346 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:21.663242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8212bf18-56df-455c-8f40-bc538ac5e346 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:21.668438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8212bf18-56df-455c-8f40-bc538ac5e346 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:21.668928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8212bf18-56df-455c-8f40-bc538ac5e346 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:21.670016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8212bf18-56df-455c-8f40-bc538ac5e346 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:21.673064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8212bf18-56df-455c-8f40-bc538ac5e346 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:21.673665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8212bf18-56df-455c-8f40-bc538ac5e346 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:21.804497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8212bf18-56df-455c-8f40-bc538ac5e346 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:21.813743 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8212bf18-56df-455c-8f40-bc538ac5e346 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1284 microversion: 2.1 time: 0.169497 Sep 10 21:04:21.815982 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1990/4081] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:21 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:21.886917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-dffe7fd8-9dd2-44c2-a6e4-508cdeb8a6f9 req-1382bf8d-568b-41d1-8f80-d06c639ef4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1", "name": "network-vif-plugged", "status": "completed", "tag": "dd553670-f89e-472f-bd36-2afd5e60b463"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:21.896945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dffe7fd8-9dd2-44c2-a6e4-508cdeb8a6f9 req-1382bf8d-568b-41d1-8f80-d06c639ef4a3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:21.897997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dffe7fd8-9dd2-44c2-a6e4-508cdeb8a6f9 req-1382bf8d-568b-41d1-8f80-d06c639ef4a3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:21.898294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dffe7fd8-9dd2-44c2-a6e4-508cdeb8a6f9 req-1382bf8d-568b-41d1-8f80-d06c639ef4a3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:21.912865 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-dffe7fd8-9dd2-44c2-a6e4-508cdeb8a6f9 req-1382bf8d-568b-41d1-8f80-d06c639ef4a3 service nova] Creating event network-vif-plugged:dd553670-f89e-472f-bd36-2afd5e60b463 for instance e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 on nch2-master-1 Sep 10 21:04:21.921937 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-dffe7fd8-9dd2-44c2-a6e4-508cdeb8a6f9 req-1382bf8d-568b-41d1-8f80-d06c639ef4a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038575 Sep 10 21:04:21.923746 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1991/4082] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:04:21.971525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55745af2-0b5b-456f-8252-18b4624042a7 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:21.983675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55745af2-0b5b-456f-8252-18b4624042a7 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:21.997064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55745af2-0b5b-456f-8252-18b4624042a7 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:21.998617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55745af2-0b5b-456f-8252-18b4624042a7 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:21.999561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55745af2-0b5b-456f-8252-18b4624042a7 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:22.000310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55745af2-0b5b-456f-8252-18b4624042a7 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:22.000777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55745af2-0b5b-456f-8252-18b4624042a7 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:22.001209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55745af2-0b5b-456f-8252-18b4624042a7 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:22.074269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-98d2cb70-aa62-41bb-af5f-8bc4bd9f8e11 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:22.084533 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-98d2cb70-aa62-41bb-af5f-8bc4bd9f8e11 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1316 microversion: 2.1 time: 0.583814 Sep 10 21:04:22.085588 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2092/4083] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:21 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:22.222517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-55745af2-0b5b-456f-8252-18b4624042a7 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:22.234708 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55745af2-0b5b-456f-8252-18b4624042a7 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1316 microversion: 2.1 time: 0.278949 Sep 10 21:04:22.255203 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1992/4084] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:21 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:22.838552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-68d0abba-fede-4305-bf69-014beef551f9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:22.839604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-68d0abba-fede-4305-bf69-014beef551f9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:22.853233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68d0abba-fede-4305-bf69-014beef551f9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:22.856000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68d0abba-fede-4305-bf69-014beef551f9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:22.856938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68d0abba-fede-4305-bf69-014beef551f9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:22.858481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68d0abba-fede-4305-bf69-014beef551f9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:22.860186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68d0abba-fede-4305-bf69-014beef551f9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:22.863763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68d0abba-fede-4305-bf69-014beef551f9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:23.113646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c612798-f61e-409a-86a4-c0ae2983e31c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:23.115581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c612798-f61e-409a-86a4-c0ae2983e31c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:23.142602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c612798-f61e-409a-86a4-c0ae2983e31c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:23.144157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c612798-f61e-409a-86a4-c0ae2983e31c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:23.145781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c612798-f61e-409a-86a4-c0ae2983e31c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:23.147140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c612798-f61e-409a-86a4-c0ae2983e31c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:23.147949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c612798-f61e-409a-86a4-c0ae2983e31c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:23.148601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c612798-f61e-409a-86a4-c0ae2983e31c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:23.452978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-68d0abba-fede-4305-bf69-014beef551f9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:23.460842 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-68d0abba-fede-4305-bf69-014beef551f9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1314 microversion: 2.1 time: 0.627927 Sep 10 21:04:23.461681 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2093/4085] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:22 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:23.484455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-11674f24-42f1-43fd-b772-f0e62badd198 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:23.485900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-11674f24-42f1-43fd-b772-f0e62badd198 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:23.492792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11674f24-42f1-43fd-b772-f0e62badd198 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:23.494108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11674f24-42f1-43fd-b772-f0e62badd198 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:23.494807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11674f24-42f1-43fd-b772-f0e62badd198 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:23.495763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11674f24-42f1-43fd-b772-f0e62badd198 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:23.496415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11674f24-42f1-43fd-b772-f0e62badd198 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:23.497025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11674f24-42f1-43fd-b772-f0e62badd198 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:23.525299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6c612798-f61e-409a-86a4-c0ae2983e31c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:23.533341 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c612798-f61e-409a-86a4-c0ae2983e31c tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1316 microversion: 2.1 time: 0.427109 Sep 10 21:04:23.534084 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1993/4086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:23 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:24.175282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-11674f24-42f1-43fd-b772-f0e62badd198 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:24.198518 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-11674f24-42f1-43fd-b772-f0e62badd198 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1504 microversion: 2.1 time: 0.708047 Sep 10 21:04:24.199847 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2094/4087] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:23 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1504 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:24.224131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-77645d4c-a8c7-49c2-9ef5-8d45ac77ba61 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:24.224991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-77645d4c-a8c7-49c2-9ef5-8d45ac77ba61 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:24.234762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77645d4c-a8c7-49c2-9ef5-8d45ac77ba61 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.235631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77645d4c-a8c7-49c2-9ef5-8d45ac77ba61 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.236789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77645d4c-a8c7-49c2-9ef5-8d45ac77ba61 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.237732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77645d4c-a8c7-49c2-9ef5-8d45ac77ba61 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.239077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77645d4c-a8c7-49c2-9ef5-8d45ac77ba61 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.239751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77645d4c-a8c7-49c2-9ef5-8d45ac77ba61 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.255781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-38793a1e-c709-4d83-aa50-764d46da7d9d req-ce644e56-a221-447b-8842-174a3a34473d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d690d87c-2883-4181-8552-01f2be84e93c", "tag": "c9e1a782-f90c-4541-ba9a-c993f5ef1b41"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:24.275645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-38793a1e-c709-4d83-aa50-764d46da7d9d req-ce644e56-a221-447b-8842-174a3a34473d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.276875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-38793a1e-c709-4d83-aa50-764d46da7d9d req-ce644e56-a221-447b-8842-174a3a34473d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.277645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-38793a1e-c709-4d83-aa50-764d46da7d9d req-ce644e56-a221-447b-8842-174a3a34473d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.311712 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-38793a1e-c709-4d83-aa50-764d46da7d9d req-ce644e56-a221-447b-8842-174a3a34473d service nova] Creating event network-changed:c9e1a782-f90c-4541-ba9a-c993f5ef1b41 for instance d690d87c-2883-4181-8552-01f2be84e93c on nch1-master-1 Sep 10 21:04:24.320672 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-38793a1e-c709-4d83-aa50-764d46da7d9d req-ce644e56-a221-447b-8842-174a3a34473d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068452 Sep 10 21:04:24.321305 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2095/4088] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:04:24.345599 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-77645d4c-a8c7-49c2-9ef5-8d45ac77ba61 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.126172 Sep 10 21:04:24.346805 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1994/4089] 10.222.0.33 () {58 vars in 1296 bytes} [Sat Sep 10 21:04:24 2022] DELETE /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54/os-server-password => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:04:24.359797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-20d1f772-c33e-4751-9970-1828fb7b4143 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:24.360710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-20d1f772-c33e-4751-9970-1828fb7b4143 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:24.367679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20d1f772-c33e-4751-9970-1828fb7b4143 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.368488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20d1f772-c33e-4751-9970-1828fb7b4143 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.369110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20d1f772-c33e-4751-9970-1828fb7b4143 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.370354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20d1f772-c33e-4751-9970-1828fb7b4143 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.373085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20d1f772-c33e-4751-9970-1828fb7b4143 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.373812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20d1f772-c33e-4751-9970-1828fb7b4143 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.413657 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-20d1f772-c33e-4751-9970-1828fb7b4143 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.061101 Sep 10 21:04:24.415054 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2096/4090] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Sep 10 21:04:24 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54/os-server-password => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 21:04:24.436292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3bd2949f-55e1-4258-a0a6-d20d964f509d tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:24.437550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3bd2949f-55e1-4258-a0a6-d20d964f509d tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:24.459340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bd2949f-55e1-4258-a0a6-d20d964f509d tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.460724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bd2949f-55e1-4258-a0a6-d20d964f509d tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.461467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bd2949f-55e1-4258-a0a6-d20d964f509d tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.462489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bd2949f-55e1-4258-a0a6-d20d964f509d tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.463246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bd2949f-55e1-4258-a0a6-d20d964f509d tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.464654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3bd2949f-55e1-4258-a0a6-d20d964f509d tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.488542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35a27c01-5535-4946-be85-2c0b56cec276 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:24.489314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35a27c01-5535-4946-be85-2c0b56cec276 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:24.502642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a27c01-5535-4946-be85-2c0b56cec276 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.505863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3bd2949f-55e1-4258-a0a6-d20d964f509d tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:04:24.506510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a27c01-5535-4946-be85-2c0b56cec276 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.507071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a27c01-5535-4946-be85-2c0b56cec276 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.510148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a27c01-5535-4946-be85-2c0b56cec276 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.511913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a27c01-5535-4946-be85-2c0b56cec276 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.514467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35a27c01-5535-4946-be85-2c0b56cec276 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.745948 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3bd2949f-55e1-4258-a0a6-d20d964f509d tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 204 len: 0 microversion: 2.1 time: 0.319931 Sep 10 21:04:24.747556 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1995/4091] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:04:24 2022] DELETE /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:04:24.766477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-306480cb-c27e-4c87-b805-8ba80cc158d2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:24.771548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-306480cb-c27e-4c87-b805-8ba80cc158d2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:24.791283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306480cb-c27e-4c87-b805-8ba80cc158d2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.796033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306480cb-c27e-4c87-b805-8ba80cc158d2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.796964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306480cb-c27e-4c87-b805-8ba80cc158d2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.799843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306480cb-c27e-4c87-b805-8ba80cc158d2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.801725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306480cb-c27e-4c87-b805-8ba80cc158d2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.802485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-306480cb-c27e-4c87-b805-8ba80cc158d2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.926083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35a27c01-5535-4946-be85-2c0b56cec276 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:24.935255 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35a27c01-5535-4946-be85-2c0b56cec276 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1314 microversion: 2.1 time: 0.450516 Sep 10 21:04:24.943611 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2097/4092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:24 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:24.949542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3130f4d1-9559-48ac-a291-efb26962c480 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:24.952939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3130f4d1-9559-48ac-a291-efb26962c480 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:24.967701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3130f4d1-9559-48ac-a291-efb26962c480 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.970519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3130f4d1-9559-48ac-a291-efb26962c480 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.971043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3130f4d1-9559-48ac-a291-efb26962c480 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:24.971999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3130f4d1-9559-48ac-a291-efb26962c480 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:24.973074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3130f4d1-9559-48ac-a291-efb26962c480 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:24.982829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3130f4d1-9559-48ac-a291-efb26962c480 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.280789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-306480cb-c27e-4c87-b805-8ba80cc158d2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:25.295945 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-306480cb-c27e-4c87-b805-8ba80cc158d2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1506 microversion: 2.1 time: 0.536034 Sep 10 21:04:25.297032 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1996/4093] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:24 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:25.313404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8503d9e8-d5db-4258-9ec5-697ec6c7bd35 req-785ed714-e313-47d3-bdd8-c80e7732d905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73", "tag": "b1b3e948-57a8-4218-844e-44d056f25995"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:25.335718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3130f4d1-9559-48ac-a291-efb26962c480 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:25.353544 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3130f4d1-9559-48ac-a291-efb26962c480 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1510 microversion: 2.1 time: 0.408422 Sep 10 21:04:25.353677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8503d9e8-d5db-4258-9ec5-697ec6c7bd35 req-785ed714-e313-47d3-bdd8-c80e7732d905 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.354197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8503d9e8-d5db-4258-9ec5-697ec6c7bd35 req-785ed714-e313-47d3-bdd8-c80e7732d905 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.356116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8503d9e8-d5db-4258-9ec5-697ec6c7bd35 req-785ed714-e313-47d3-bdd8-c80e7732d905 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.356714 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2098/4094] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:24 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1510 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:25.375443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3b0ca1c9-1b15-4564-b75f-164560efbcdd tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:25.376436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3b0ca1c9-1b15-4564-b75f-164560efbcdd tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:25.381269 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8503d9e8-d5db-4258-9ec5-697ec6c7bd35 req-785ed714-e313-47d3-bdd8-c80e7732d905 service nova] Creating event network-changed:b1b3e948-57a8-4218-844e-44d056f25995 for instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 on nch2-master-1 Sep 10 21:04:25.384814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0ca1c9-1b15-4564-b75f-164560efbcdd tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.385670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0ca1c9-1b15-4564-b75f-164560efbcdd tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.386741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0ca1c9-1b15-4564-b75f-164560efbcdd tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.387987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0ca1c9-1b15-4564-b75f-164560efbcdd tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.388726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0ca1c9-1b15-4564-b75f-164560efbcdd tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.389364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b0ca1c9-1b15-4564-b75f-164560efbcdd tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.394339 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8503d9e8-d5db-4258-9ec5-697ec6c7bd35 req-785ed714-e313-47d3-bdd8-c80e7732d905 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095200 Sep 10 21:04:25.394972 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1997/4095] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:25.437011 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3b0ca1c9-1b15-4564-b75f-164560efbcdd tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1/ips" status: 200 len: 110 microversion: 2.1 time: 0.068856 Sep 10 21:04:25.437925 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2099/4096] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:04:25 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1/ips => generated 110 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:25.451941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-31867bd3-ac49-476d-8f54-a1e77b27fbf2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:25.452541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-31867bd3-ac49-476d-8f54-a1e77b27fbf2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:25.472739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31867bd3-ac49-476d-8f54-a1e77b27fbf2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.475340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31867bd3-ac49-476d-8f54-a1e77b27fbf2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.476040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31867bd3-ac49-476d-8f54-a1e77b27fbf2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.477791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31867bd3-ac49-476d-8f54-a1e77b27fbf2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.478516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31867bd3-ac49-476d-8f54-a1e77b27fbf2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.479714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31867bd3-ac49-476d-8f54-a1e77b27fbf2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.525328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:25.542785 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-31867bd3-ac49-476d-8f54-a1e77b27fbf2 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1/ips" status: 200 len: 110 microversion: 2.1 time: 0.094958 Sep 10 21:04:25.544055 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1998/4097] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:04:25 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1/ips => generated 110 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:25.556015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5884a4f1-b8aa-4cfb-8b85-3cbb725304d3 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:25.556483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5884a4f1-b8aa-4cfb-8b85-3cbb725304d3 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:25.563742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5884a4f1-b8aa-4cfb-8b85-3cbb725304d3 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.564480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5884a4f1-b8aa-4cfb-8b85-3cbb725304d3 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.565094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5884a4f1-b8aa-4cfb-8b85-3cbb725304d3 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.566002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5884a4f1-b8aa-4cfb-8b85-3cbb725304d3 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.566644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5884a4f1-b8aa-4cfb-8b85-3cbb725304d3 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.571233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5884a4f1-b8aa-4cfb-8b85-3cbb725304d3 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.613297 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5884a4f1-b8aa-4cfb-8b85-3cbb725304d3 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1/ips/tempest-ServerAddressesTestJSON-1024463853-network" status: 200 len: 95 microversion: 2.1 time: 0.062083 Sep 10 21:04:25.613933 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2100/4098] 10.222.0.33 () {58 vars in 1401 bytes} [Sat Sep 10 21:04:25 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1/ips/tempest-ServerAddressesTestJSON-1024463853-network => generated 95 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:04:25.627504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a6be192a-5240-4c25-b30d-3386b183f80a tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:25.628507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a6be192a-5240-4c25-b30d-3386b183f80a tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:25.635762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6be192a-5240-4c25-b30d-3386b183f80a tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.636925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6be192a-5240-4c25-b30d-3386b183f80a tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.637901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6be192a-5240-4c25-b30d-3386b183f80a tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.638940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6be192a-5240-4c25-b30d-3386b183f80a tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.639607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6be192a-5240-4c25-b30d-3386b183f80a tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.640040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6be192a-5240-4c25-b30d-3386b183f80a tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.670892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a6be192a-5240-4c25-b30d-3386b183f80a tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:04:25.836491 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a6be192a-5240-4c25-b30d-3386b183f80a tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 204 len: 0 microversion: 2.1 time: 0.213439 Sep 10 21:04:25.840321 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 1999/4099] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:04:25 2022] DELETE /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:04:25.851058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3224de4c-3e52-4fdf-8577-87715e5ab08f tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:25.852062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3224de4c-3e52-4fdf-8577-87715e5ab08f tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:25.866209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3224de4c-3e52-4fdf-8577-87715e5ab08f tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.867117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3224de4c-3e52-4fdf-8577-87715e5ab08f tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.879867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3224de4c-3e52-4fdf-8577-87715e5ab08f tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.882133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3224de4c-3e52-4fdf-8577-87715e5ab08f tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.882640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3224de4c-3e52-4fdf-8577-87715e5ab08f tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.883084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3224de4c-3e52-4fdf-8577-87715e5ab08f tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.968154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7d1834c2-338d-4b63-a5bb-baa780977eae tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:25.969185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7d1834c2-338d-4b63-a5bb-baa780977eae tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:25.976582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d1834c2-338d-4b63-a5bb-baa780977eae tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.977057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d1834c2-338d-4b63-a5bb-baa780977eae tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.979932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d1834c2-338d-4b63-a5bb-baa780977eae tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:25.980991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d1834c2-338d-4b63-a5bb-baa780977eae tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:25.981888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d1834c2-338d-4b63-a5bb-baa780977eae tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:25.981993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7d1834c2-338d-4b63-a5bb-baa780977eae tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:26.159658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3224de4c-3e52-4fdf-8577-87715e5ab08f tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:26.174423 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3224de4c-3e52-4fdf-8577-87715e5ab08f tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1512 microversion: 2.1 time: 0.329469 Sep 10 21:04:26.181887 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2101/4100] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:25 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:26.389307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9077cc66-4614-4e18-af60-4f865cd038b6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:26.391175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9077cc66-4614-4e18-af60-4f865cd038b6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:26.401435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9077cc66-4614-4e18-af60-4f865cd038b6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:26.402192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9077cc66-4614-4e18-af60-4f865cd038b6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:26.403171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9077cc66-4614-4e18-af60-4f865cd038b6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:26.405117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9077cc66-4614-4e18-af60-4f865cd038b6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:26.405869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9077cc66-4614-4e18-af60-4f865cd038b6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:26.407143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9077cc66-4614-4e18-af60-4f865cd038b6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:26.577154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7d1834c2-338d-4b63-a5bb-baa780977eae tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:26.589816 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7d1834c2-338d-4b63-a5bb-baa780977eae tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1314 microversion: 2.1 time: 0.626512 Sep 10 21:04:26.591764 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2000/4101] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:25 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:26.914418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9077cc66-4614-4e18-af60-4f865cd038b6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:26.919787 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9077cc66-4614-4e18-af60-4f865cd038b6 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1510 microversion: 2.1 time: 0.541399 Sep 10 21:04:26.921166 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2102/4102] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:26 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:27.201524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8a0ed23d-970e-4d86-ba29-dcf86b278f47 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:27.203667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8a0ed23d-970e-4d86-ba29-dcf86b278f47 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:27.211116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a0ed23d-970e-4d86-ba29-dcf86b278f47 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:27.213196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a0ed23d-970e-4d86-ba29-dcf86b278f47 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:27.213951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a0ed23d-970e-4d86-ba29-dcf86b278f47 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:27.214889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a0ed23d-970e-4d86-ba29-dcf86b278f47 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:27.216217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a0ed23d-970e-4d86-ba29-dcf86b278f47 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:27.216862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a0ed23d-970e-4d86-ba29-dcf86b278f47 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:27.445943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8a0ed23d-970e-4d86-ba29-dcf86b278f47 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:27.469952 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8a0ed23d-970e-4d86-ba29-dcf86b278f47 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1512 microversion: 2.1 time: 0.273275 Sep 10 21:04:27.471754 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2001/4103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:27 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:27.621486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a7d54391-c3d5-45a0-8a17-e6644855785b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:27.622818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a7d54391-c3d5-45a0-8a17-e6644855785b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:27.632195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7d54391-c3d5-45a0-8a17-e6644855785b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:27.638709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7d54391-c3d5-45a0-8a17-e6644855785b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:27.639475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7d54391-c3d5-45a0-8a17-e6644855785b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:27.640412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7d54391-c3d5-45a0-8a17-e6644855785b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:27.641077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7d54391-c3d5-45a0-8a17-e6644855785b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:27.641682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7d54391-c3d5-45a0-8a17-e6644855785b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:27.670994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:27.703401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5397c537-c6c3-48f3-b647-4ddc37247780 req-8fa746d7-0bfe-4c40-9ae0-a4e8e5d52fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b3c03dd-c695-45a2-9f38-644898a83d54", "name": "network-vif-deleted", "tag": "cb320d7b-6513-4eb1-a214-2f8c317c9084"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:27.730396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5397c537-c6c3-48f3-b647-4ddc37247780 req-8fa746d7-0bfe-4c40-9ae0-a4e8e5d52fd8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:27.731440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5397c537-c6c3-48f3-b647-4ddc37247780 req-8fa746d7-0bfe-4c40-9ae0-a4e8e5d52fd8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:27.731892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5397c537-c6c3-48f3-b647-4ddc37247780 req-8fa746d7-0bfe-4c40-9ae0-a4e8e5d52fd8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:27.769704 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5397c537-c6c3-48f3-b647-4ddc37247780 req-8fa746d7-0bfe-4c40-9ae0-a4e8e5d52fd8 service nova] Creating event network-vif-deleted:cb320d7b-6513-4eb1-a214-2f8c317c9084 for instance 8b3c03dd-c695-45a2-9f38-644898a83d54 on nch1-master-1 Sep 10 21:04:27.793282 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5397c537-c6c3-48f3-b647-4ddc37247780 req-8fa746d7-0bfe-4c40-9ae0-a4e8e5d52fd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094998 Sep 10 21:04:27.794552 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2002/4104] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:04:27.946737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:27.947457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:27.972878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:27.980888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:27.982577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:27.983611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:27.986607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:27.987515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:28.065682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a7d54391-c3d5-45a0-8a17-e6644855785b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:28.081189 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a7d54391-c3d5-45a0-8a17-e6644855785b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1314 microversion: 2.1 time: 0.463909 Sep 10 21:04:28.085130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:28.085770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:28.086455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:28.086949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lazy-loading 'fault' on Instance uuid 8b3c03dd-c695-45a2-9f38-644898a83d54 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:04:28.102591 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2103/4105] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:27 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:28.238761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe36190f974a289414202fe1e4ee44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cc07e66b1d4c55827d9b723a8df459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:28.252199 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5fca802f-1e22-4536-8899-96d57ede56fd tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 200 len: 1306 microversion: 2.1 time: 0.309643 Sep 10 21:04:28.266225 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2003/4106] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:27 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 1306 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:28.500768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c372be4-1d4f-4c7a-b18d-39adb2a9a234 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:28.501436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1c372be4-1d4f-4c7a-b18d-39adb2a9a234 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:28.517346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c372be4-1d4f-4c7a-b18d-39adb2a9a234 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:28.519054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c372be4-1d4f-4c7a-b18d-39adb2a9a234 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:28.519530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c372be4-1d4f-4c7a-b18d-39adb2a9a234 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:28.521723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c372be4-1d4f-4c7a-b18d-39adb2a9a234 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:28.523398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c372be4-1d4f-4c7a-b18d-39adb2a9a234 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:28.524007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c372be4-1d4f-4c7a-b18d-39adb2a9a234 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:28.758365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1c372be4-1d4f-4c7a-b18d-39adb2a9a234 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3561f4fb18f84b899f68c5fcf897ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ba8eb9cfb41cb87be6ffad5cb3789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:28.767215 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1c372be4-1d4f-4c7a-b18d-39adb2a9a234 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 200 len: 1512 microversion: 2.1 time: 0.272157 Sep 10 21:04:28.767972 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2104/4107] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:28 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:29.107934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d2406cfd-1074-4678-9ffc-95e54da8f493 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:29.109265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d2406cfd-1074-4678-9ffc-95e54da8f493 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:29.116322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2406cfd-1074-4678-9ffc-95e54da8f493 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:29.117318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2406cfd-1074-4678-9ffc-95e54da8f493 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:29.118039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2406cfd-1074-4678-9ffc-95e54da8f493 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:29.119057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2406cfd-1074-4678-9ffc-95e54da8f493 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:29.120675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2406cfd-1074-4678-9ffc-95e54da8f493 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:29.121386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d2406cfd-1074-4678-9ffc-95e54da8f493 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:29.278639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:29.279330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] [instance: 8b3c03dd-c695-45a2-9f38-644898a83d54] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:29.286859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:29.288071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:29.289084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:29.290165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:29.290950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:29.291983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:29.312909 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] HTTP exception thrown: Instance 8b3c03dd-c695-45a2-9f38-644898a83d54 could not be found. Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Request method failure captured: Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 HTTP/1.1 Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPu1pbDawgvkAyeu4dRdmwHsBhNfGqL3k-WulIyVo0vBVzQd5D9BN0j5TsHGfpShRdiZ4OuY-2fLifHgUSkxlTXCYz3S1Q9GN-upXWnp7qF4pHcN-0LlCQyh_8PiWJ5-l_d2yWFA9JRaS_3VngVHisJLelLElrCWKQ4570m8kgQJ1Jc Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 54cc07e66b1d4c55827d9b723a8df459 Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerPasswordTestJSON-1711263460 Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54cc07e66b1d4c55827d9b723a8df459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54cc07e66b1d4c55827d9b723a8df459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54cc07e66b1d4c55827d9b723a8df459", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54cc07e66b1d4c55827d9b723a8df459"}]}] Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerPasswordTestJSON-1711263460 Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 54cc07e66b1d4c55827d9b723a8df459 Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1711263460 Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerPasswordTestJSON-1711263460-project Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 42fe36190f974a289414202fe1e4ee44 Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerPasswordTestJSON-1711263460-project Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 8b3c03dd-c695-45a2-9f38-644898a83d54 could not be found. Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '8b3c03dd-c695-45a2-9f38-644898a83d54'} Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b3c03dd-c695-45a2-9f38-644898a83d54 could not be found. Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b3c03dd-c695-45a2-9f38-644898a83d54 could not be found. Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:29.317261 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:29.323751 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:29.323751 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:29.323751 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:29.323751 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:04:29.323751 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:04:29.323751 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b3c03dd-c695-45a2-9f38-644898a83d54 could not be found. Sep 10 21:04:29.323751 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:29.323751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] Returning 404 to user: Instance 8b3c03dd-c695-45a2-9f38-644898a83d54 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:29.323751 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-544e578a-2395-4177-adb2-dd37b6380899 tempest-ServerPasswordTestJSON-1711263460 tempest-ServerPasswordTestJSON-1711263460-project] 10.222.0.33 "GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54" status: 404 len: 111 microversion: 2.1 time: 0.043963 Sep 10 21:04:29.323751 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2105/4108] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:29 2022] GET /compute/v2.1/servers/8b3c03dd-c695-45a2-9f38-644898a83d54 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:04:29.553263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:29.582025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:29.696021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d2406cfd-1074-4678-9ffc-95e54da8f493 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:29.709926 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d2406cfd-1074-4678-9ffc-95e54da8f493 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1314 microversion: 2.1 time: 0.606480 Sep 10 21:04:29.721859 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2004/4109] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:29 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:29.801719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:29.802680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] [instance: e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:29.815058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:29.815563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:29.815999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:29.819680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:29.820246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:29.822695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:29.854119 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] HTTP exception thrown: Instance e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 could not be found. Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Request method failure captured: Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 HTTP/1.1 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPvADY1fSpyXg9_viWEhZhWncaeqlw9e7a4iQLOl2q-A7C9obKDS-PgAcyxkpQ3xhCTqiBv908hTTfyHNS7eY_g4yLl-XhWfyzlZ5UKutzFu1c9JUNGxUZpgMcE_8p4e9Jjs56KEfIb-VKfhYDxZoeo_sk1yFxDo47GDkrvr9UnDBx0 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 7c3ba8eb9cfb41cb87be6ffad5cb3789 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerAddressesTestJSON-1865556087 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c3ba8eb9cfb41cb87be6ffad5cb3789"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c3ba8eb9cfb41cb87be6ffad5cb3789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c3ba8eb9cfb41cb87be6ffad5cb3789", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c3ba8eb9cfb41cb87be6ffad5cb3789"}]}] Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerAddressesTestJSON-1865556087 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 7c3ba8eb9cfb41cb87be6ffad5cb3789 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1865556087 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerAddressesTestJSON-1865556087-project Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 3561f4fb18f84b899f68c5fcf897ca12 Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerAddressesTestJSON-1865556087-project Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 could not be found. Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1'} Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 could not be found. Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 could not be found. Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:29.856324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:29.861712 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:29.861712 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:29.861712 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:29.861712 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:04:29.861712 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:04:29.861712 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 could not be found. Sep 10 21:04:29.861712 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:29.864307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] Returning 404 to user: Instance e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:29.866697 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3c2fcb77-c628-4e96-83f0-509c24ae04a5 tempest-ServerAddressesTestJSON-1865556087 tempest-ServerAddressesTestJSON-1865556087-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1" status: 404 len: 111 microversion: 2.1 time: 0.071345 Sep 10 21:04:29.867348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-6dd05c82-b838-406f-9594-7834cce2e829 req-69a4e08e-7c21-48b9-9605-3ea07a0446ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1", "name": "network-vif-deleted", "tag": "dd553670-f89e-472f-bd36-2afd5e60b463"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:29.867628 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2106/4110] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:29 2022] GET /compute/v2.1/servers/e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:04:29.880741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6dd05c82-b838-406f-9594-7834cce2e829 req-69a4e08e-7c21-48b9-9605-3ea07a0446ea service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:29.881307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6dd05c82-b838-406f-9594-7834cce2e829 req-69a4e08e-7c21-48b9-9605-3ea07a0446ea service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:29.882053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6dd05c82-b838-406f-9594-7834cce2e829 req-69a4e08e-7c21-48b9-9605-3ea07a0446ea service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:29.895260 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-6dd05c82-b838-406f-9594-7834cce2e829 req-69a4e08e-7c21-48b9-9605-3ea07a0446ea service nova] Creating event network-vif-deleted:dd553670-f89e-472f-bd36-2afd5e60b463 for instance e0ecb8bf-cbaa-4a40-9fd0-1982f44a80e1 on nch2-master-1 Sep 10 21:04:29.902351 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-6dd05c82-b838-406f-9594-7834cce2e829 req-69a4e08e-7c21-48b9-9605-3ea07a0446ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045951 Sep 10 21:04:29.903729 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2005/4111] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:04:30.736785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3d0070e3-a4ce-4466-9c26-f3eafa933a39 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:30.738718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3d0070e3-a4ce-4466-9c26-f3eafa933a39 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:30.747161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:30.751763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d0070e3-a4ce-4466-9c26-f3eafa933a39 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:30.752794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d0070e3-a4ce-4466-9c26-f3eafa933a39 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:30.753279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d0070e3-a4ce-4466-9c26-f3eafa933a39 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:30.754583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d0070e3-a4ce-4466-9c26-f3eafa933a39 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:30.755177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d0070e3-a4ce-4466-9c26-f3eafa933a39 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:30.756520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d0070e3-a4ce-4466-9c26-f3eafa933a39 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:31.006042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3d0070e3-a4ce-4466-9c26-f3eafa933a39 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:31.019690 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3d0070e3-a4ce-4466-9c26-f3eafa933a39 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1314 microversion: 2.1 time: 0.286670 Sep 10 21:04:31.022098 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2107/4112] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:30 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:32.046646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eb6f7103-989a-430d-8035-88ff64e64fea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:32.048366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eb6f7103-989a-430d-8035-88ff64e64fea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:32.070639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb6f7103-989a-430d-8035-88ff64e64fea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:32.079541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb6f7103-989a-430d-8035-88ff64e64fea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:32.080493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb6f7103-989a-430d-8035-88ff64e64fea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:32.081776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb6f7103-989a-430d-8035-88ff64e64fea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:32.083963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb6f7103-989a-430d-8035-88ff64e64fea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:32.086127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb6f7103-989a-430d-8035-88ff64e64fea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:32.594263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1410892348", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:32.611491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eb6f7103-989a-430d-8035-88ff64e64fea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:32.638445 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eb6f7103-989a-430d-8035-88ff64e64fea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1314 microversion: 2.1 time: 0.596877 Sep 10 21:04:32.650136 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2006/4113] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:32 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:32.650136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2a2c0bdb-2927-42b4-813f-dd4523d02bed req-9edf1789-61b7-4ad0-a176-58fb5c261372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73", "name": "network-vif-plugged", "status": "completed", "tag": "b1b3e948-57a8-4218-844e-44d056f25995"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:32.676215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2a2c0bdb-2927-42b4-813f-dd4523d02bed req-9edf1789-61b7-4ad0-a176-58fb5c261372 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:32.676712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2a2c0bdb-2927-42b4-813f-dd4523d02bed req-9edf1789-61b7-4ad0-a176-58fb5c261372 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:32.677157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2a2c0bdb-2927-42b4-813f-dd4523d02bed req-9edf1789-61b7-4ad0-a176-58fb5c261372 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:32.708535 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2a2c0bdb-2927-42b4-813f-dd4523d02bed req-9edf1789-61b7-4ad0-a176-58fb5c261372 service nova] Creating event network-vif-plugged:b1b3e948-57a8-4218-844e-44d056f25995 for instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 on nch2-master-1 Sep 10 21:04:32.713331 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2a2c0bdb-2927-42b4-813f-dd4523d02bed req-9edf1789-61b7-4ad0-a176-58fb5c261372 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071759 Sep 10 21:04:32.713511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] validate_networks() for [('18913022-e91e-4b19-b334-3a8712f3ce66', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:04:32.714632 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2007/4114] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:33.665747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-179c91e6-9c4b-4a44-80f2-157abe2ee289 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:33.667322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-179c91e6-9c4b-4a44-80f2-157abe2ee289 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:33.694127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179c91e6-9c4b-4a44-80f2-157abe2ee289 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:33.695051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179c91e6-9c4b-4a44-80f2-157abe2ee289 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:33.695517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179c91e6-9c4b-4a44-80f2-157abe2ee289 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:33.696517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179c91e6-9c4b-4a44-80f2-157abe2ee289 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:33.697633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179c91e6-9c4b-4a44-80f2-157abe2ee289 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:33.698363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-179c91e6-9c4b-4a44-80f2-157abe2ee289 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:33.741547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:04:33.742634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:04:33.745761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:04:33.746948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:04:33.749036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:04:33.805510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:33.813413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:33.817155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:33.818619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:33.824784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:33.827153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:33.951933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Getting quotas for project e9df0b572a1844bda38471874d2afe92. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:04:33.983391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Getting quotas for user bbbfb72cf13347ce901cad42460e7dce and project e9df0b572a1844bda38471874d2afe92. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:04:34.050588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:04:34.053986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:04:34.127602 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3b3efb85-66b9-4c82-8e84-61383f2f2641 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.829868 Sep 10 21:04:34.129050 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2108/4115] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:04:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:04:34.141810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-414450f2-ff40-4e6b-9906-cb3492c297d2 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:34.146317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-414450f2-ff40-4e6b-9906-cb3492c297d2 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:34.329456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-414450f2-ff40-4e6b-9906-cb3492c297d2 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:34.340169 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-414450f2-ff40-4e6b-9906-cb3492c297d2 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1223 microversion: 2.1 time: 0.203759 Sep 10 21:04:34.345562 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2109/4116] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:34 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1223 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:34.606982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-179c91e6-9c4b-4a44-80f2-157abe2ee289 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:34.618481 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-179c91e6-9c4b-4a44-80f2-157abe2ee289 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1314 microversion: 2.1 time: 0.957662 Sep 10 21:04:34.620012 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2008/4117] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:33 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1314 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:35.365641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea0ec98b-4b3f-4bd9-9185-78a683b917dd tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:35.367275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ea0ec98b-4b3f-4bd9-9185-78a683b917dd tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:35.378417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea0ec98b-4b3f-4bd9-9185-78a683b917dd tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:35.379466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea0ec98b-4b3f-4bd9-9185-78a683b917dd tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:35.380383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea0ec98b-4b3f-4bd9-9185-78a683b917dd tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:35.381904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea0ec98b-4b3f-4bd9-9185-78a683b917dd tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:35.382761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea0ec98b-4b3f-4bd9-9185-78a683b917dd tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:35.383557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea0ec98b-4b3f-4bd9-9185-78a683b917dd tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:35.645943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f0c03a2d-895c-409e-ad3b-b8b9743173d1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:35.647391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f0c03a2d-895c-409e-ad3b-b8b9743173d1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:35.657224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0c03a2d-895c-409e-ad3b-b8b9743173d1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:35.657733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0c03a2d-895c-409e-ad3b-b8b9743173d1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:35.658516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0c03a2d-895c-409e-ad3b-b8b9743173d1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:35.659101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0c03a2d-895c-409e-ad3b-b8b9743173d1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:35.659943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0c03a2d-895c-409e-ad3b-b8b9743173d1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:35.660947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0c03a2d-895c-409e-ad3b-b8b9743173d1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:35.936560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ea0ec98b-4b3f-4bd9-9185-78a683b917dd tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:35.947168 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea0ec98b-4b3f-4bd9-9185-78a683b917dd tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1227 microversion: 2.1 time: 0.586485 Sep 10 21:04:35.961040 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2110/4118] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:35 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1227 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:35.990593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f0c03a2d-895c-409e-ad3b-b8b9743173d1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:36.007368 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f0c03a2d-895c-409e-ad3b-b8b9743173d1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1500 microversion: 2.1 time: 0.365397 Sep 10 21:04:36.011644 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2009/4119] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:35 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1500 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:36.045319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bfdde445-d233-4805-b254-80ce3dda461c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:36.045888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bfdde445-d233-4805-b254-80ce3dda461c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:36.060980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfdde445-d233-4805-b254-80ce3dda461c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:36.061484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfdde445-d233-4805-b254-80ce3dda461c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:36.061967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfdde445-d233-4805-b254-80ce3dda461c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:36.062679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfdde445-d233-4805-b254-80ce3dda461c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:36.063137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfdde445-d233-4805-b254-80ce3dda461c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:36.063566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfdde445-d233-4805-b254-80ce3dda461c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:36.096605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-bfdde445-d233-4805-b254-80ce3dda461c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lazy-loading 'flavor' on Instance uuid 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:04:36.522304 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bfdde445-d233-4805-b254-80ce3dda461c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73/action" status: 202 len: 0 microversion: 2.1 time: 0.488129 Sep 10 21:04:36.529471 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2111/4120] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:04:36 2022] POST /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:04:36.539313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-51b750a1-5619-4051-9f6f-f773ebab6a13 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:36.540246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-51b750a1-5619-4051-9f6f-f773ebab6a13 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:36.554166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51b750a1-5619-4051-9f6f-f773ebab6a13 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:36.555189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51b750a1-5619-4051-9f6f-f773ebab6a13 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:36.559203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51b750a1-5619-4051-9f6f-f773ebab6a13 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:36.560353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51b750a1-5619-4051-9f6f-f773ebab6a13 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:36.561335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51b750a1-5619-4051-9f6f-f773ebab6a13 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:36.562725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51b750a1-5619-4051-9f6f-f773ebab6a13 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:36.976396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6ddfed2-6ebe-48d9-8a79-159de5c51539 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:36.980042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f6ddfed2-6ebe-48d9-8a79-159de5c51539 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:37.003440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6ddfed2-6ebe-48d9-8a79-159de5c51539 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:37.003935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6ddfed2-6ebe-48d9-8a79-159de5c51539 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:37.004362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6ddfed2-6ebe-48d9-8a79-159de5c51539 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:37.012722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6ddfed2-6ebe-48d9-8a79-159de5c51539 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:37.013421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6ddfed2-6ebe-48d9-8a79-159de5c51539 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:37.021780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6ddfed2-6ebe-48d9-8a79-159de5c51539 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:37.216117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f6ddfed2-6ebe-48d9-8a79-159de5c51539 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:37.228048 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f6ddfed2-6ebe-48d9-8a79-159de5c51539 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1281 microversion: 2.1 time: 0.256085 Sep 10 21:04:37.231204 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2112/4121] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:36 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:37.469669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51b750a1-5619-4051-9f6f-f773ebab6a13 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:37.481431 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-51b750a1-5619-4051-9f6f-f773ebab6a13 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.947129 Sep 10 21:04:37.482030 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2010/4122] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:36 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:38.258235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-43761c86-6a0f-45da-b101-98b1869d1a0c tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:38.259509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-43761c86-6a0f-45da-b101-98b1869d1a0c tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:38.269323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43761c86-6a0f-45da-b101-98b1869d1a0c tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:38.270198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43761c86-6a0f-45da-b101-98b1869d1a0c tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:38.271089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43761c86-6a0f-45da-b101-98b1869d1a0c tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:38.272268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43761c86-6a0f-45da-b101-98b1869d1a0c tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:38.272900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43761c86-6a0f-45da-b101-98b1869d1a0c tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:38.273511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43761c86-6a0f-45da-b101-98b1869d1a0c tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:38.506214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3c91357a-066e-41ff-aaf2-4c147cae931b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:38.507099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3c91357a-066e-41ff-aaf2-4c147cae931b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:38.517389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91357a-066e-41ff-aaf2-4c147cae931b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:38.518371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91357a-066e-41ff-aaf2-4c147cae931b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:38.519388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91357a-066e-41ff-aaf2-4c147cae931b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:38.520406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91357a-066e-41ff-aaf2-4c147cae931b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:38.521229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91357a-066e-41ff-aaf2-4c147cae931b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:38.522089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c91357a-066e-41ff-aaf2-4c147cae931b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:38.781699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-43761c86-6a0f-45da-b101-98b1869d1a0c tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:38.784957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3c91357a-066e-41ff-aaf2-4c147cae931b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:38.795920 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3c91357a-066e-41ff-aaf2-4c147cae931b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.294631 Sep 10 21:04:38.803918 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-43761c86-6a0f-45da-b101-98b1869d1a0c tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1281 microversion: 2.1 time: 0.552086 Sep 10 21:04:38.810658 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2011/4123] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:38 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:38.815121 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2113/4124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:38 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1281 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:39.829166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a7b9094-bea3-45bb-a711-4f8d2a0970f3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:39.830199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4a7b9094-bea3-45bb-a711-4f8d2a0970f3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:39.841169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a7b9094-bea3-45bb-a711-4f8d2a0970f3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:39.841681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a7b9094-bea3-45bb-a711-4f8d2a0970f3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:39.841911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a26d8ba-2f64-4e74-97ec-86b17538f3b9 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:39.842375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a7b9094-bea3-45bb-a711-4f8d2a0970f3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:39.842519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a26d8ba-2f64-4e74-97ec-86b17538f3b9 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:39.843107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a7b9094-bea3-45bb-a711-4f8d2a0970f3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:39.843868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a7b9094-bea3-45bb-a711-4f8d2a0970f3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:39.844465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a7b9094-bea3-45bb-a711-4f8d2a0970f3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:39.861188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a26d8ba-2f64-4e74-97ec-86b17538f3b9 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:39.862359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a26d8ba-2f64-4e74-97ec-86b17538f3b9 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:39.863383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a26d8ba-2f64-4e74-97ec-86b17538f3b9 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:39.880068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a26d8ba-2f64-4e74-97ec-86b17538f3b9 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:39.887137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a26d8ba-2f64-4e74-97ec-86b17538f3b9 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:39.891349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a26d8ba-2f64-4e74-97ec-86b17538f3b9 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:40.293011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4a7b9094-bea3-45bb-a711-4f8d2a0970f3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:40.306008 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a7b9094-bea3-45bb-a711-4f8d2a0970f3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.481402 Sep 10 21:04:40.307334 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2012/4125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:39 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:40.640687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7a26d8ba-2f64-4e74-97ec-86b17538f3b9 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:40.665559 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a26d8ba-2f64-4e74-97ec-86b17538f3b9 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1323 microversion: 2.1 time: 0.827821 Sep 10 21:04:40.667661 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2114/4126] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:39 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1323 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:41.336302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f1a4a8e6-2d67-4bf3-a3c6-72b34dc5c85c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:41.336959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f1a4a8e6-2d67-4bf3-a3c6-72b34dc5c85c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:41.347448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1a4a8e6-2d67-4bf3-a3c6-72b34dc5c85c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:41.347947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1a4a8e6-2d67-4bf3-a3c6-72b34dc5c85c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:41.348395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1a4a8e6-2d67-4bf3-a3c6-72b34dc5c85c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:41.349111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1a4a8e6-2d67-4bf3-a3c6-72b34dc5c85c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:41.350512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1a4a8e6-2d67-4bf3-a3c6-72b34dc5c85c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:41.351128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1a4a8e6-2d67-4bf3-a3c6-72b34dc5c85c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:41.690979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4bb14bb0-5b08-4fd5-81f0-ed0be7b42bda tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:41.692273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4bb14bb0-5b08-4fd5-81f0-ed0be7b42bda tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:41.701248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bb14bb0-5b08-4fd5-81f0-ed0be7b42bda tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:41.702063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bb14bb0-5b08-4fd5-81f0-ed0be7b42bda tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:41.702772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bb14bb0-5b08-4fd5-81f0-ed0be7b42bda tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:41.703703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bb14bb0-5b08-4fd5-81f0-ed0be7b42bda tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:41.704341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bb14bb0-5b08-4fd5-81f0-ed0be7b42bda tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:41.705135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bb14bb0-5b08-4fd5-81f0-ed0be7b42bda tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:41.815576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f1a4a8e6-2d67-4bf3-a3c6-72b34dc5c85c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:41.824806 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f1a4a8e6-2d67-4bf3-a3c6-72b34dc5c85c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.492477 Sep 10 21:04:41.842141 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2013/4127] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:41 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:41.847721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-6aff48a4-ad27-4c94-a86d-4dad1244e46b req-776194bf-b971-465a-bcc4-fcaf0c643202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7791e1c9-0ea1-42b6-9732-f3088f9fee11", "tag": "9720d5e6-b71e-46dd-a1ca-700a06956155"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:41.854271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:41.861386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6aff48a4-ad27-4c94-a86d-4dad1244e46b req-776194bf-b971-465a-bcc4-fcaf0c643202 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:41.862320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6aff48a4-ad27-4c94-a86d-4dad1244e46b req-776194bf-b971-465a-bcc4-fcaf0c643202 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:41.862954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6aff48a4-ad27-4c94-a86d-4dad1244e46b req-776194bf-b971-465a-bcc4-fcaf0c643202 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:41.882433 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-6aff48a4-ad27-4c94-a86d-4dad1244e46b req-776194bf-b971-465a-bcc4-fcaf0c643202 service nova] Creating event network-changed:9720d5e6-b71e-46dd-a1ca-700a06956155 for instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 on nch1-master-1 Sep 10 21:04:41.901331 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-6aff48a4-ad27-4c94-a86d-4dad1244e46b req-776194bf-b971-465a-bcc4-fcaf0c643202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057513 Sep 10 21:04:41.902194 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2014/4128] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:42.214309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4bb14bb0-5b08-4fd5-81f0-ed0be7b42bda tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:42.234711 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4bb14bb0-5b08-4fd5-81f0-ed0be7b42bda tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1323 microversion: 2.1 time: 0.547883 Sep 10 21:04:42.236098 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2115/4129] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:41 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1323 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:42.851035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-897af1f9-b98e-4ffd-943d-bc998532aafa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:42.851772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-897af1f9-b98e-4ffd-943d-bc998532aafa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:42.863533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-897af1f9-b98e-4ffd-943d-bc998532aafa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:42.864040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-897af1f9-b98e-4ffd-943d-bc998532aafa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:42.864494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-897af1f9-b98e-4ffd-943d-bc998532aafa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:42.865218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-897af1f9-b98e-4ffd-943d-bc998532aafa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:42.865690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-897af1f9-b98e-4ffd-943d-bc998532aafa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:42.866155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-897af1f9-b98e-4ffd-943d-bc998532aafa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:43.260023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34defdc4-02cf-4d63-b4b3-efccd603a6ca tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:43.260623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-34defdc4-02cf-4d63-b4b3-efccd603a6ca tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:43.267803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34defdc4-02cf-4d63-b4b3-efccd603a6ca tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:43.268671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34defdc4-02cf-4d63-b4b3-efccd603a6ca tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:43.269358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34defdc4-02cf-4d63-b4b3-efccd603a6ca tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:43.270385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34defdc4-02cf-4d63-b4b3-efccd603a6ca tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:43.270918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34defdc4-02cf-4d63-b4b3-efccd603a6ca tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:43.271614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34defdc4-02cf-4d63-b4b3-efccd603a6ca tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:43.527039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-897af1f9-b98e-4ffd-943d-bc998532aafa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:43.540486 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-897af1f9-b98e-4ffd-943d-bc998532aafa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.695428 Sep 10 21:04:43.541793 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2015/4130] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:42 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:43.877381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:43.898995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-34defdc4-02cf-4d63-b4b3-efccd603a6ca tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:43.917197 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-34defdc4-02cf-4d63-b4b3-efccd603a6ca tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1323 microversion: 2.1 time: 0.660906 Sep 10 21:04:43.933023 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2116/4131] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:43 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1323 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:44.564198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eda89948-ec9d-4a2b-bd95-e444ad8ea9fa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:44.564846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eda89948-ec9d-4a2b-bd95-e444ad8ea9fa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:44.581297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eda89948-ec9d-4a2b-bd95-e444ad8ea9fa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:44.581859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eda89948-ec9d-4a2b-bd95-e444ad8ea9fa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:44.582319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eda89948-ec9d-4a2b-bd95-e444ad8ea9fa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:44.583081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eda89948-ec9d-4a2b-bd95-e444ad8ea9fa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:44.586423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eda89948-ec9d-4a2b-bd95-e444ad8ea9fa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:44.586934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eda89948-ec9d-4a2b-bd95-e444ad8ea9fa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:44.616648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:44.912558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eda89948-ec9d-4a2b-bd95-e444ad8ea9fa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:44.935630 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eda89948-ec9d-4a2b-bd95-e444ad8ea9fa tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.370628 Sep 10 21:04:44.938003 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2016/4132] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:44 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:44.947353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b05e18e0-74af-42bf-909c-f4c37a7f2b7d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:44.948774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b05e18e0-74af-42bf-909c-f4c37a7f2b7d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:44.967600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:44.979724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b05e18e0-74af-42bf-909c-f4c37a7f2b7d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:44.980628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b05e18e0-74af-42bf-909c-f4c37a7f2b7d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:44.982485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b05e18e0-74af-42bf-909c-f4c37a7f2b7d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:44.983505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b05e18e0-74af-42bf-909c-f4c37a7f2b7d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:44.986718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b05e18e0-74af-42bf-909c-f4c37a7f2b7d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:44.987461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b05e18e0-74af-42bf-909c-f4c37a7f2b7d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:45.773691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b05e18e0-74af-42bf-909c-f4c37a7f2b7d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:45.786438 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b05e18e0-74af-42bf-909c-f4c37a7f2b7d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1323 microversion: 2.1 time: 0.842402 Sep 10 21:04:45.806259 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2117/4133] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:44 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1323 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:45.983810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ff89de2c-77ca-4697-8b3f-5bde92d3d76a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:45.984565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ff89de2c-77ca-4697-8b3f-5bde92d3d76a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:45.996201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff89de2c-77ca-4697-8b3f-5bde92d3d76a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:45.996867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff89de2c-77ca-4697-8b3f-5bde92d3d76a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:45.997886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff89de2c-77ca-4697-8b3f-5bde92d3d76a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:45.998905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff89de2c-77ca-4697-8b3f-5bde92d3d76a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:45.999615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff89de2c-77ca-4697-8b3f-5bde92d3d76a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:46.000288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff89de2c-77ca-4697-8b3f-5bde92d3d76a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:46.470882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ff89de2c-77ca-4697-8b3f-5bde92d3d76a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:46.485009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ff89de2c-77ca-4697-8b3f-5bde92d3d76a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.528037 Sep 10 21:04:46.489159 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2017/4134] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:45 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:46.814262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3303cf7a-ae1b-4a22-8840-2e62a6c8873a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:46.815510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3303cf7a-ae1b-4a22-8840-2e62a6c8873a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:46.824294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3303cf7a-ae1b-4a22-8840-2e62a6c8873a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:46.825511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3303cf7a-ae1b-4a22-8840-2e62a6c8873a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:46.826193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3303cf7a-ae1b-4a22-8840-2e62a6c8873a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:46.827110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3303cf7a-ae1b-4a22-8840-2e62a6c8873a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:46.827741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3303cf7a-ae1b-4a22-8840-2e62a6c8873a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:46.829205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3303cf7a-ae1b-4a22-8840-2e62a6c8873a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:47.073818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3303cf7a-ae1b-4a22-8840-2e62a6c8873a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:47.083610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3303cf7a-ae1b-4a22-8840-2e62a6c8873a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1323 microversion: 2.1 time: 0.273415 Sep 10 21:04:47.084408 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2118/4135] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:46 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:47.231020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8d2b817a-91fe-4c00-a13f-7ab78a4e0cc0 tempest-ComputeTenantNetworksTest-89777539 tempest-ComputeTenantNetworksTest-89777539-project] Calling method '.version_select at 0x7f994963ad30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:47.516999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-16d63fad-7421-49af-b60d-aed538ab8f25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:47.517873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-16d63fad-7421-49af-b60d-aed538ab8f25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:47.529185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:47.532361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16d63fad-7421-49af-b60d-aed538ab8f25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:47.533203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16d63fad-7421-49af-b60d-aed538ab8f25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:47.533810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16d63fad-7421-49af-b60d-aed538ab8f25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:47.537341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16d63fad-7421-49af-b60d-aed538ab8f25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:47.538059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16d63fad-7421-49af-b60d-aed538ab8f25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:47.538683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16d63fad-7421-49af-b60d-aed538ab8f25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:47.597886 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8d2b817a-91fe-4c00-a13f-7ab78a4e0cc0 tempest-ComputeTenantNetworksTest-89777539 tempest-ComputeTenantNetworksTest-89777539-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.577798 Sep 10 21:04:47.600791 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2018/4136] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 21:04:47 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:47.615916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8c9cdaea-0b9a-4fc4-b399-dcb1a292cd02 tempest-ComputeTenantNetworksTest-89777539 tempest-ComputeTenantNetworksTest-89777539-project] Calling method '.version_select at 0x7f99440fe040>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:47.784844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-16d63fad-7421-49af-b60d-aed538ab8f25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:47.800570 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-16d63fad-7421-49af-b60d-aed538ab8f25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.287216 Sep 10 21:04:47.801929 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2119/4137] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:47 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:47.934827 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8c9cdaea-0b9a-4fc4-b399-dcb1a292cd02 tempest-ComputeTenantNetworksTest-89777539 tempest-ComputeTenantNetworksTest-89777539-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks/271ce82c-10ed-40fb-ae41-3e36b4cc1686" status: 200 len: 139 microversion: 2.1 time: 0.324756 Sep 10 21:04:47.936637 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2019/4138] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Sep 10 21:04:47 2022] GET /compute/v2.1/os-tenant-networks/271ce82c-10ed-40fb-ae41-3e36b4cc1686 => generated 139 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:48.112931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5142afeb-304c-4722-baab-5098a1a0b77b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:48.114004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5142afeb-304c-4722-baab-5098a1a0b77b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:48.126936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5142afeb-304c-4722-baab-5098a1a0b77b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:48.127900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5142afeb-304c-4722-baab-5098a1a0b77b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:48.128606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5142afeb-304c-4722-baab-5098a1a0b77b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:48.129443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5142afeb-304c-4722-baab-5098a1a0b77b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:48.130222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5142afeb-304c-4722-baab-5098a1a0b77b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:48.132809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5142afeb-304c-4722-baab-5098a1a0b77b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:48.508056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5142afeb-304c-4722-baab-5098a1a0b77b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:48.516924 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5142afeb-304c-4722-baab-5098a1a0b77b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1323 microversion: 2.1 time: 0.411147 Sep 10 21:04:48.527367 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2120/4139] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:48 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1323 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:48.831265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6aae20c2-83b7-4c79-838c-92b3503eb0da tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:48.831943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6aae20c2-83b7-4c79-838c-92b3503eb0da tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:48.851192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6aae20c2-83b7-4c79-838c-92b3503eb0da tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:48.851706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6aae20c2-83b7-4c79-838c-92b3503eb0da tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:48.852818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6aae20c2-83b7-4c79-838c-92b3503eb0da tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:48.855364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6aae20c2-83b7-4c79-838c-92b3503eb0da tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:48.857004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6aae20c2-83b7-4c79-838c-92b3503eb0da tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:48.857625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6aae20c2-83b7-4c79-838c-92b3503eb0da tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:49.335806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6aae20c2-83b7-4c79-838c-92b3503eb0da tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:49.348953 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6aae20c2-83b7-4c79-838c-92b3503eb0da tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.528187 Sep 10 21:04:49.351580 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2020/4140] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:48 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:49.557245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cbb29d2c-fb69-42c5-867c-6f41a76cab11 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:49.558118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cbb29d2c-fb69-42c5-867c-6f41a76cab11 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:49.570342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbb29d2c-fb69-42c5-867c-6f41a76cab11 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:49.570863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbb29d2c-fb69-42c5-867c-6f41a76cab11 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:49.571315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbb29d2c-fb69-42c5-867c-6f41a76cab11 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:49.576947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbb29d2c-fb69-42c5-867c-6f41a76cab11 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:49.580349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbb29d2c-fb69-42c5-867c-6f41a76cab11 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:49.580861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbb29d2c-fb69-42c5-867c-6f41a76cab11 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:49.600885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:04:49.842666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cbb29d2c-fb69-42c5-867c-6f41a76cab11 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:49.853029 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cbb29d2c-fb69-42c5-867c-6f41a76cab11 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1323 microversion: 2.1 time: 0.302848 Sep 10 21:04:49.858659 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2121/4141] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:49 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:50.039396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-905230ca-d18b-49b6-9ed0-ae0d4b182aaf req-06b329c7-87c4-48df-bcc1-0f1793899c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7791e1c9-0ea1-42b6-9732-f3088f9fee11", "name": "network-vif-plugged", "status": "completed", "tag": "9720d5e6-b71e-46dd-a1ca-700a06956155"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:50.066467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-905230ca-d18b-49b6-9ed0-ae0d4b182aaf req-06b329c7-87c4-48df-bcc1-0f1793899c55 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:50.067069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-905230ca-d18b-49b6-9ed0-ae0d4b182aaf req-06b329c7-87c4-48df-bcc1-0f1793899c55 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:50.067525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-905230ca-d18b-49b6-9ed0-ae0d4b182aaf req-06b329c7-87c4-48df-bcc1-0f1793899c55 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:50.092381 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-905230ca-d18b-49b6-9ed0-ae0d4b182aaf req-06b329c7-87c4-48df-bcc1-0f1793899c55 service nova] Creating event network-vif-plugged:9720d5e6-b71e-46dd-a1ca-700a06956155 for instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 on nch1-master-1 Sep 10 21:04:50.117731 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-905230ca-d18b-49b6-9ed0-ae0d4b182aaf req-06b329c7-87c4-48df-bcc1-0f1793899c55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079452 Sep 10 21:04:50.120520 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2021/4142] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:04:50.378431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8697c1c0-e3d6-4d3c-b532-82d27a118e1e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:50.379553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8697c1c0-e3d6-4d3c-b532-82d27a118e1e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:50.394832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8697c1c0-e3d6-4d3c-b532-82d27a118e1e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:50.396606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8697c1c0-e3d6-4d3c-b532-82d27a118e1e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:50.398100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8697c1c0-e3d6-4d3c-b532-82d27a118e1e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:50.399565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8697c1c0-e3d6-4d3c-b532-82d27a118e1e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:50.402655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8697c1c0-e3d6-4d3c-b532-82d27a118e1e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:50.410906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8697c1c0-e3d6-4d3c-b532-82d27a118e1e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:50.824995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8697c1c0-e3d6-4d3c-b532-82d27a118e1e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:50.841966 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8697c1c0-e3d6-4d3c-b532-82d27a118e1e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.466153 Sep 10 21:04:50.843505 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2122/4143] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:50 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:50.882543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-228da605-9c6e-4c54-b983-655ffd493665 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:50.883279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-228da605-9c6e-4c54-b983-655ffd493665 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:50.897496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-228da605-9c6e-4c54-b983-655ffd493665 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:50.898126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-228da605-9c6e-4c54-b983-655ffd493665 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:50.898733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-228da605-9c6e-4c54-b983-655ffd493665 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:50.899560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-228da605-9c6e-4c54-b983-655ffd493665 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:50.912926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-228da605-9c6e-4c54-b983-655ffd493665 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:50.913590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-228da605-9c6e-4c54-b983-655ffd493665 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:51.319081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-228da605-9c6e-4c54-b983-655ffd493665 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:51.328799 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-228da605-9c6e-4c54-b983-655ffd493665 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1323 microversion: 2.1 time: 0.450787 Sep 10 21:04:51.329401 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2022/4144] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:50 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:51.872077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d26524f5-7c97-48ef-99c1-78e011bf4ca8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:51.873153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d26524f5-7c97-48ef-99c1-78e011bf4ca8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:51.894141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d26524f5-7c97-48ef-99c1-78e011bf4ca8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:51.894767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d26524f5-7c97-48ef-99c1-78e011bf4ca8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:51.896723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d26524f5-7c97-48ef-99c1-78e011bf4ca8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:51.899896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d26524f5-7c97-48ef-99c1-78e011bf4ca8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:51.902449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d26524f5-7c97-48ef-99c1-78e011bf4ca8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:51.904205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d26524f5-7c97-48ef-99c1-78e011bf4ca8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:52.031417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cede8774-6ed5-4312-a22a-ca0fd84910d2 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Action: 'create', calling method: .version_select at 0x7f9944142310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-628372239", "metadata": {"Type": "work"}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cede8774-6ed5-4312-a22a-ca0fd84910d2 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Request method failure captured: Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 121 Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPvzt5z58w_dLj8VTnh5zd0n3GgYhmwjLcpFqKK8953VllNORQBQ1sgDw3S9DA9giKO3omlIw6k0JciplygZqYeFuCuRvpUN4IWkCxPold2Pokt5pI6mGVg95njGSH1kAw3XDOKQjNmizvxXZSodKeRRzQxbJ1KX7WPfAFlWOfEnIQk Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a744bcf5d894f408c32e4f691be4bc3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a744bcf5d894f408c32e4f691be4bc3"}]}] Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: fee2190c31e347c5926d9762d95d8dc8 Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-628372239", "metadata": {"Type": "work"}}} Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-628372239', 'metadata': {'Type': 'work'}}}} Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi '#$%' Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:04:52.048868 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 21:04:52.055119 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.058004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cede8774-6ed5-4312-a22a-ca0fd84910d2 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:52.062830 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cede8774-6ed5-4312-a22a-ca0fd84910d2 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.363072 Sep 10 21:04:52.068862 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2123/4145] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Sep 10 21:04:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 370 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 21:04:52.083679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f99c6c64-ff0d-4fe2-89c0-cbd32ec76500 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Action: 'create', calling method: .version_select at 0x7f99441c89d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1613356527", "metadata": {"Type": "work"}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f99c6c64-ff0d-4fe2-89c0-cbd32ec76500 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Request method failure captured: Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 120 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPvzt5z58w_dLj8VTnh5zd0n3GgYhmwjLcpFqKK8953VllNORQBQ1sgDw3S9DA9giKO3omlIw6k0JciplygZqYeFuCuRvpUN4IWkCxPold2Pokt5pI6mGVg95njGSH1kAw3XDOKQjNmizvxXZSodKeRRzQxbJ1KX7WPfAFlWOfEnIQk Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a744bcf5d894f408c32e4f691be4bc3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a744bcf5d894f408c32e4f691be4bc3"}]}] Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: fee2190c31e347c5926d9762d95d8dc8 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1613356527", "metadata": {"Type": "work"}}} Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1613356527', 'metadata': {'Type': 'work'}}}} Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi '0' Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:04:52.104994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 21:04:52.112178 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.115145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f99c6c64-ff0d-4fe2-89c0-cbd32ec76500 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:52.118212 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f99c6c64-ff0d-4fe2-89c0-cbd32ec76500 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.043058 Sep 10 21:04:52.123047 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2124/4146] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Sep 10 21:04:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:04:52.129343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d272b55d-5083-40ff-ad42-4cb7fea88340 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Action: 'create', calling method: .version_select at 0x7f994415f550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1759125243", "metadata": {"Type": "work"}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d272b55d-5083-40ff-ad42-4cb7fea88340 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Request method failure captured: Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 119 Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPvzt5z58w_dLj8VTnh5zd0n3GgYhmwjLcpFqKK8953VllNORQBQ1sgDw3S9DA9giKO3omlIw6k0JciplygZqYeFuCuRvpUN4IWkCxPold2Pokt5pI6mGVg95njGSH1kAw3XDOKQjNmizvxXZSodKeRRzQxbJ1KX7WPfAFlWOfEnIQk Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a744bcf5d894f408c32e4f691be4bc3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a744bcf5d894f408c32e4f691be4bc3"}]}] Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: fee2190c31e347c5926d9762d95d8dc8 Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1759125243", "metadata": {"Type": "work"}}} Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1759125243', 'metadata': {'Type': 'work'}}}} Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi '' Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:04:52.148060 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 21:04:52.154426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.159687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d272b55d-5083-40ff-ad42-4cb7fea88340 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:52.162272 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d272b55d-5083-40ff-ad42-4cb7fea88340 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.036743 Sep 10 21:04:52.167802 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2125/4147] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Sep 10 21:04:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:04:52.195099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0c51e98f-d447-46e3-8d1a-03e460d61211 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Calling method '.version_select at 0x7f99496c81f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:52.258712 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0c51e98f-d447-46e3-8d1a-03e460d61211 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] HTTP exception thrown: Volume tempest-invalid-1377322555 could not be found. Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0c51e98f-d447-46e3-8d1a-03e460d61211 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Request method failure captured: Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1377322555 HTTP/1.1 Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPvzt5z58w_dLj8VTnh5zd0n3GgYhmwjLcpFqKK8953VllNORQBQ1sgDw3S9DA9giKO3omlIw6k0JciplygZqYeFuCuRvpUN4IWkCxPold2Pokt5pI6mGVg95njGSH1kAw3XDOKQjNmizvxXZSodKeRRzQxbJ1KX7WPfAFlWOfEnIQk Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a744bcf5d894f408c32e4f691be4bc3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a744bcf5d894f408c32e4f691be4bc3"}]}] Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: fee2190c31e347c5926d9762d95d8dc8 Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: exception: Volume tempest-invalid-1377322555 could not be found. Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'tempest-invalid-1377322555'} Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1377322555 could not be found. (HTTP 404) (Request-ID: req-31903840-7959-4419-84e5-25adc8eb21de) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 21:04:52.262303 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1377322555 could not be found. Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1377322555 could not be found. Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1377322555 could not be found. Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.267882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0c51e98f-d447-46e3-8d1a-03e460d61211 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Returning 404 to user: Volume tempest-invalid-1377322555 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:52.272729 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0c51e98f-d447-46e3-8d1a-03e460d61211 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1377322555" status: 404 len: 99 microversion: 2.1 time: 0.102288 Sep 10 21:04:52.273864 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2126/4148] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 21:04:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1377322555 => generated 99 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 21:04:52.294431 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e2d659aa-9f59-41ad-b60c-2ff2981fd2c4 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008741 Sep 10 21:04:52.298645 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2127/4149] 10.222.0.33 () {58 vars in 1140 bytes} [Sat Sep 10 21:04:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 21:04:52.310951 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b5ba09b7-c6cf-4a2a-9c7d-b57ba76efb4b tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006847 Sep 10 21:04:52.312120 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2128/4150] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 21:04:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 21:04:52.328225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-25f44956-7bfc-473c-9320-1eb899e4c601 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Calling method '.version_select at 0x7f9944d0e0d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:52.387083 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-25f44956-7bfc-473c-9320-1eb899e4c601 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] HTTP exception thrown: Volume 5a61713b-d00d-4fb2-9cb1-53adfc7ec52e could not be found. Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-25f44956-7bfc-473c-9320-1eb899e4c601 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Request method failure captured: Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-volumes/5a61713b-d00d-4fb2-9cb1-53adfc7ec52e HTTP/1.1 Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPvzt5z58w_dLj8VTnh5zd0n3GgYhmwjLcpFqKK8953VllNORQBQ1sgDw3S9DA9giKO3omlIw6k0JciplygZqYeFuCuRvpUN4IWkCxPold2Pokt5pI6mGVg95njGSH1kAw3XDOKQjNmizvxXZSodKeRRzQxbJ1KX7WPfAFlWOfEnIQk Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a744bcf5d894f408c32e4f691be4bc3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a744bcf5d894f408c32e4f691be4bc3"}]}] Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: fee2190c31e347c5926d9762d95d8dc8 Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: exception: Volume 5a61713b-d00d-4fb2-9cb1-53adfc7ec52e could not be found. Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5a61713b-d00d-4fb2-9cb1-53adfc7ec52e'} Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a61713b-d00d-4fb2-9cb1-53adfc7ec52e could not be found. (HTTP 404) (Request-ID: req-d90661c3-f113-4f5d-8114-cde20684eaf7) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 21:04:52.389305 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a61713b-d00d-4fb2-9cb1-53adfc7ec52e could not be found. Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a61713b-d00d-4fb2-9cb1-53adfc7ec52e could not be found. Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a61713b-d00d-4fb2-9cb1-53adfc7ec52e could not be found. Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-25f44956-7bfc-473c-9320-1eb899e4c601 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Returning 404 to user: Volume 5a61713b-d00d-4fb2-9cb1-53adfc7ec52e could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-25f44956-7bfc-473c-9320-1eb899e4c601 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/5a61713b-d00d-4fb2-9cb1-53adfc7ec52e" status: 404 len: 109 microversion: 2.1 time: 0.072891 Sep 10 21:04:52.395316 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2129/4151] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:04:52 2022] DELETE /compute/v2.1/os-volumes/5a61713b-d00d-4fb2-9cb1-53adfc7ec52e => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:04:52.407671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2c2d98a4-4e54-4456-8087-8edd5beda113 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:52.410401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2c2d98a4-4e54-4456-8087-8edd5beda113 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:52.435948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c2d98a4-4e54-4456-8087-8edd5beda113 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:52.436462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c2d98a4-4e54-4456-8087-8edd5beda113 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:52.436913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c2d98a4-4e54-4456-8087-8edd5beda113 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:52.437650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c2d98a4-4e54-4456-8087-8edd5beda113 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:52.438159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c2d98a4-4e54-4456-8087-8edd5beda113 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:52.438653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c2d98a4-4e54-4456-8087-8edd5beda113 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:52.626126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d26524f5-7c97-48ef-99c1-78e011bf4ca8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:52.642205 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d26524f5-7c97-48ef-99c1-78e011bf4ca8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.771727 Sep 10 21:04:52.643847 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2023/4152] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:51 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:52.667820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7596e550-988b-42e9-a647-45b2556e0bb6 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Calling method '.version_select at 0x7f99440b1ca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:52.730469 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-7596e550-988b-42e9-a647-45b2556e0bb6 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] HTTP exception thrown: Volume 95113695-4d6a-4cff-a7ea-ad04a633e6d0 could not be found. Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7596e550-988b-42e9-a647-45b2556e0bb6 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Request method failure captured: Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/os-volumes/95113695-4d6a-4cff-a7ea-ad04a633e6d0 HTTP/1.1 Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPvzt5z58w_dLj8VTnh5zd0n3GgYhmwjLcpFqKK8953VllNORQBQ1sgDw3S9DA9giKO3omlIw6k0JciplygZqYeFuCuRvpUN4IWkCxPold2Pokt5pI6mGVg95njGSH1kAw3XDOKQjNmizvxXZSodKeRRzQxbJ1KX7WPfAFlWOfEnIQk Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a744bcf5d894f408c32e4f691be4bc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a744bcf5d894f408c32e4f691be4bc3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a744bcf5d894f408c32e4f691be4bc3"}]}] Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 1a744bcf5d894f408c32e4f691be4bc3 Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-VolumesNegativeTest-1256046566 Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: fee2190c31e347c5926d9762d95d8dc8 Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-VolumesNegativeTest-1256046566-project Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: exception: Volume 95113695-4d6a-4cff-a7ea-ad04a633e6d0 could not be found. Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '95113695-4d6a-4cff-a7ea-ad04a633e6d0'} Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95113695-4d6a-4cff-a7ea-ad04a633e6d0 could not be found. (HTTP 404) (Request-ID: req-e801ef27-7402-4115-81a0-d60b3fc9028d) Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 21:04:52.734371 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95113695-4d6a-4cff-a7ea-ad04a633e6d0 could not be found. Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95113695-4d6a-4cff-a7ea-ad04a633e6d0 could not be found. Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95113695-4d6a-4cff-a7ea-ad04a633e6d0 could not be found. Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7596e550-988b-42e9-a647-45b2556e0bb6 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] Returning 404 to user: Volume 95113695-4d6a-4cff-a7ea-ad04a633e6d0 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7596e550-988b-42e9-a647-45b2556e0bb6 tempest-VolumesNegativeTest-1256046566 tempest-VolumesNegativeTest-1256046566-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/95113695-4d6a-4cff-a7ea-ad04a633e6d0" status: 404 len: 109 microversion: 2.1 time: 0.090948 Sep 10 21:04:52.738997 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2024/4153] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:04:52 2022] GET /compute/v2.1/os-volumes/95113695-4d6a-4cff-a7ea-ad04a633e6d0 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:04:52.802019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2c2d98a4-4e54-4456-8087-8edd5beda113 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:52.813604 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2c2d98a4-4e54-4456-8087-8edd5beda113 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1518 microversion: 2.1 time: 0.416911 Sep 10 21:04:52.820262 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2130/4154] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:52 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1518 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:52.854219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3c876b9-2f21-4277-8d5d-20b6095a2f31 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:04:52.859696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e3c876b9-2f21-4277-8d5d-20b6095a2f31 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:52.875469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3c876b9-2f21-4277-8d5d-20b6095a2f31 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:52.879092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3c876b9-2f21-4277-8d5d-20b6095a2f31 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:52.880447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3c876b9-2f21-4277-8d5d-20b6095a2f31 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:52.884021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3c876b9-2f21-4277-8d5d-20b6095a2f31 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:52.889028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3c876b9-2f21-4277-8d5d-20b6095a2f31 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:52.889862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3c876b9-2f21-4277-8d5d-20b6095a2f31 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:52.972967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-e3c876b9-2f21-4277-8d5d-20b6095a2f31 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lazy-loading 'flavor' on Instance uuid 7791e1c9-0ea1-42b6-9732-f3088f9fee11 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:04:53.202969 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3c876b9-2f21-4277-8d5d-20b6095a2f31 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "POST /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11/action" status: 200 len: 32 microversion: 2.1 time: 0.354513 Sep 10 21:04:53.208978 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2025/4155] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:04:52 2022] POST /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:04:53.217314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e94c2db-8a1a-4be1-bd43-a495a1465406 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:53.218047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e94c2db-8a1a-4be1-bd43-a495a1465406 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:53.241481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e94c2db-8a1a-4be1-bd43-a495a1465406 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:53.243294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e94c2db-8a1a-4be1-bd43-a495a1465406 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:53.244952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e94c2db-8a1a-4be1-bd43-a495a1465406 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:53.260306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e94c2db-8a1a-4be1-bd43-a495a1465406 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:53.260925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e94c2db-8a1a-4be1-bd43-a495a1465406 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:53.261387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e94c2db-8a1a-4be1-bd43-a495a1465406 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:53.674255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-95a9e713-a744-40f2-8b3a-f1dbf61e1d4f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:53.676585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-95a9e713-a744-40f2-8b3a-f1dbf61e1d4f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:53.690127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95a9e713-a744-40f2-8b3a-f1dbf61e1d4f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:53.727073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95a9e713-a744-40f2-8b3a-f1dbf61e1d4f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:53.730444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95a9e713-a744-40f2-8b3a-f1dbf61e1d4f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:53.732470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95a9e713-a744-40f2-8b3a-f1dbf61e1d4f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:53.747199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95a9e713-a744-40f2-8b3a-f1dbf61e1d4f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:53.749346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95a9e713-a744-40f2-8b3a-f1dbf61e1d4f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:54.146725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8e94c2db-8a1a-4be1-bd43-a495a1465406 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:54.164231 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e94c2db-8a1a-4be1-bd43-a495a1465406 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.953147 Sep 10 21:04:54.170243 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2131/4156] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:53 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:54.422261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-95a9e713-a744-40f2-8b3a-f1dbf61e1d4f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:54.438501 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-95a9e713-a744-40f2-8b3a-f1dbf61e1d4f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.763471 Sep 10 21:04:54.450208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2026/4157] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:53 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:55.191969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-58af76de-db02-4b42-b70c-08b5d984f7ff tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:55.192641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-58af76de-db02-4b42-b70c-08b5d984f7ff tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:55.222997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58af76de-db02-4b42-b70c-08b5d984f7ff tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:55.227139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58af76de-db02-4b42-b70c-08b5d984f7ff tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:55.231902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58af76de-db02-4b42-b70c-08b5d984f7ff tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:55.233003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58af76de-db02-4b42-b70c-08b5d984f7ff tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:55.234321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58af76de-db02-4b42-b70c-08b5d984f7ff tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:55.236222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58af76de-db02-4b42-b70c-08b5d984f7ff tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:55.472374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b96dc49e-1a9d-4202-94a7-a1c5d26f87b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:55.472921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b96dc49e-1a9d-4202-94a7-a1c5d26f87b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:55.484948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b96dc49e-1a9d-4202-94a7-a1c5d26f87b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:55.485455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b96dc49e-1a9d-4202-94a7-a1c5d26f87b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:55.494364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b96dc49e-1a9d-4202-94a7-a1c5d26f87b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:55.495340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b96dc49e-1a9d-4202-94a7-a1c5d26f87b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:55.498504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b96dc49e-1a9d-4202-94a7-a1c5d26f87b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:55.499135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b96dc49e-1a9d-4202-94a7-a1c5d26f87b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:55.593372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58af76de-db02-4b42-b70c-08b5d984f7ff tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:55.632448 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-58af76de-db02-4b42-b70c-08b5d984f7ff tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.444511 Sep 10 21:04:55.633464 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2132/4158] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:55 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:56.376658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b96dc49e-1a9d-4202-94a7-a1c5d26f87b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:56.386845 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b96dc49e-1a9d-4202-94a7-a1c5d26f87b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.918335 Sep 10 21:04:56.398506 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2027/4159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:55 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:56.659730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-44e96986-d511-4ecc-bd6b-31e4a5f0de6e tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:56.660901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-44e96986-d511-4ecc-bd6b-31e4a5f0de6e tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:56.676797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44e96986-d511-4ecc-bd6b-31e4a5f0de6e tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:56.678062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44e96986-d511-4ecc-bd6b-31e4a5f0de6e tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:56.679753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44e96986-d511-4ecc-bd6b-31e4a5f0de6e tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:56.681047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44e96986-d511-4ecc-bd6b-31e4a5f0de6e tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:56.682463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44e96986-d511-4ecc-bd6b-31e4a5f0de6e tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:56.683022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44e96986-d511-4ecc-bd6b-31e4a5f0de6e tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:56.926625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-44e96986-d511-4ecc-bd6b-31e4a5f0de6e tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:56.936119 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-44e96986-d511-4ecc-bd6b-31e4a5f0de6e tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.280695 Sep 10 21:04:56.937026 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2133/4160] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:56 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:57.413733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-56ba7779-7c79-4981-a7dc-af94629332b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:57.415353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-56ba7779-7c79-4981-a7dc-af94629332b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:57.429485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56ba7779-7c79-4981-a7dc-af94629332b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:57.434856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56ba7779-7c79-4981-a7dc-af94629332b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:57.435495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56ba7779-7c79-4981-a7dc-af94629332b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:57.437973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56ba7779-7c79-4981-a7dc-af94629332b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:57.439311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56ba7779-7c79-4981-a7dc-af94629332b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:57.441762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-56ba7779-7c79-4981-a7dc-af94629332b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:57.960529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7cd488fc-df9a-4be2-af69-c6fc0dc8ee63 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:57.961691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7cd488fc-df9a-4be2-af69-c6fc0dc8ee63 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:57.978474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cd488fc-df9a-4be2-af69-c6fc0dc8ee63 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:57.983858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cd488fc-df9a-4be2-af69-c6fc0dc8ee63 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:57.986274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cd488fc-df9a-4be2-af69-c6fc0dc8ee63 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:57.987218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cd488fc-df9a-4be2-af69-c6fc0dc8ee63 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:57.989074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cd488fc-df9a-4be2-af69-c6fc0dc8ee63 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:57.998602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cd488fc-df9a-4be2-af69-c6fc0dc8ee63 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:58.062976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-56ba7779-7c79-4981-a7dc-af94629332b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:58.080422 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-56ba7779-7c79-4981-a7dc-af94629332b8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.669936 Sep 10 21:04:58.083488 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2028/4161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:57 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:58.536879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7cd488fc-df9a-4be2-af69-c6fc0dc8ee63 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:58.546041 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7cd488fc-df9a-4be2-af69-c6fc0dc8ee63 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.589330 Sep 10 21:04:58.546643 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2134/4162] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:57 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:04:59.109448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-87ab2960-f3cb-4da9-893e-5af07f50d48d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:59.110760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-87ab2960-f3cb-4da9-893e-5af07f50d48d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:59.128622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87ab2960-f3cb-4da9-893e-5af07f50d48d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:59.130475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87ab2960-f3cb-4da9-893e-5af07f50d48d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:59.138557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87ab2960-f3cb-4da9-893e-5af07f50d48d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:59.143091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87ab2960-f3cb-4da9-893e-5af07f50d48d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:59.151062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87ab2960-f3cb-4da9-893e-5af07f50d48d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:59.162078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87ab2960-f3cb-4da9-893e-5af07f50d48d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:59.509098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87ab2960-f3cb-4da9-893e-5af07f50d48d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:04:59.523576 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-87ab2960-f3cb-4da9-893e-5af07f50d48d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.419216 Sep 10 21:04:59.528651 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2029/4163] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:59 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:04:59.589719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b1b7729c-3ba0-4303-8405-644fd6b6128f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:04:59.592447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b1b7729c-3ba0-4303-8405-644fd6b6128f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:04:59.616582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1b7729c-3ba0-4303-8405-644fd6b6128f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:59.617254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1b7729c-3ba0-4303-8405-644fd6b6128f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:59.617889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1b7729c-3ba0-4303-8405-644fd6b6128f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:04:59.621844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1b7729c-3ba0-4303-8405-644fd6b6128f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:04:59.623014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1b7729c-3ba0-4303-8405-644fd6b6128f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:04:59.625389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1b7729c-3ba0-4303-8405-644fd6b6128f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:00.011485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1b7729c-3ba0-4303-8405-644fd6b6128f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:00.031776 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b1b7729c-3ba0-4303-8405-644fd6b6128f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.459376 Sep 10 21:05:00.033363 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2135/4164] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:04:59 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:00.553770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-006871dc-2891-4899-aecb-6f937c1d1678 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:00.554829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-006871dc-2891-4899-aecb-6f937c1d1678 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:00.578686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-006871dc-2891-4899-aecb-6f937c1d1678 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:00.580502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-006871dc-2891-4899-aecb-6f937c1d1678 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:00.581152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-006871dc-2891-4899-aecb-6f937c1d1678 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:00.582132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-006871dc-2891-4899-aecb-6f937c1d1678 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:00.582952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-006871dc-2891-4899-aecb-6f937c1d1678 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:00.584548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-006871dc-2891-4899-aecb-6f937c1d1678 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:01.060475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40d46f56-80f1-45e4-917e-76fe65552faa tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:01.061721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-40d46f56-80f1-45e4-917e-76fe65552faa tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:01.098050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d46f56-80f1-45e4-917e-76fe65552faa tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:01.098871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d46f56-80f1-45e4-917e-76fe65552faa tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:01.099651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d46f56-80f1-45e4-917e-76fe65552faa tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:01.100793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d46f56-80f1-45e4-917e-76fe65552faa tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:01.101394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d46f56-80f1-45e4-917e-76fe65552faa tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:01.101995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d46f56-80f1-45e4-917e-76fe65552faa tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:01.143489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-006871dc-2891-4899-aecb-6f937c1d1678 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:01.198496 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-006871dc-2891-4899-aecb-6f937c1d1678 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.637174 Sep 10 21:05:01.199512 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2030/4165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:00 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:01.445003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40d46f56-80f1-45e4-917e-76fe65552faa tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:01.453944 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40d46f56-80f1-45e4-917e-76fe65552faa tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.397985 Sep 10 21:05:01.454547 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2136/4166] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:01 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:02.227061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b5b9e33-559d-4bb5-95c9-5ebbfec32d5a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:02.228819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5b5b9e33-559d-4bb5-95c9-5ebbfec32d5a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:02.243071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e33-559d-4bb5-95c9-5ebbfec32d5a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:02.245690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e33-559d-4bb5-95c9-5ebbfec32d5a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:02.248027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e33-559d-4bb5-95c9-5ebbfec32d5a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:02.251837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e33-559d-4bb5-95c9-5ebbfec32d5a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:02.252939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e33-559d-4bb5-95c9-5ebbfec32d5a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:02.253638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b5b9e33-559d-4bb5-95c9-5ebbfec32d5a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:02.480523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e8115598-5ba1-469b-ba3e-ac95ce4a7d02 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:02.482356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e8115598-5ba1-469b-ba3e-ac95ce4a7d02 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:02.493268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8115598-5ba1-469b-ba3e-ac95ce4a7d02 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:02.508219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8115598-5ba1-469b-ba3e-ac95ce4a7d02 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:02.511220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8115598-5ba1-469b-ba3e-ac95ce4a7d02 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:02.512370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8115598-5ba1-469b-ba3e-ac95ce4a7d02 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:02.513818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8115598-5ba1-469b-ba3e-ac95ce4a7d02 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:02.515730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8115598-5ba1-469b-ba3e-ac95ce4a7d02 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:02.727260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5b5b9e33-559d-4bb5-95c9-5ebbfec32d5a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:02.746874 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5b5b9e33-559d-4bb5-95c9-5ebbfec32d5a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.523029 Sep 10 21:05:02.756343 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2031/4167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:02 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:03.014527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e8115598-5ba1-469b-ba3e-ac95ce4a7d02 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:03.024013 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e8115598-5ba1-469b-ba3e-ac95ce4a7d02 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.549347 Sep 10 21:05:03.026405 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2137/4168] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:02 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:03.711821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1947929125", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "ae8ce2a8-18a1-4bc2-874e-37e0bd80fe9c"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:03.781339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5b73b8e-2df4-40fe-9a4a-d77f92769679 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:03.782761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5b73b8e-2df4-40fe-9a4a-d77f92769679 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:03.808623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b73b8e-2df4-40fe-9a4a-d77f92769679 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:03.809449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b73b8e-2df4-40fe-9a4a-d77f92769679 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:03.811207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b73b8e-2df4-40fe-9a4a-d77f92769679 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:03.817446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b73b8e-2df4-40fe-9a4a-d77f92769679 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:03.819999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b73b8e-2df4-40fe-9a4a-d77f92769679 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:03.821470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5b73b8e-2df4-40fe-9a4a-d77f92769679 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:03.860497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] validate_networks() for [('ae8ce2a8-18a1-4bc2-874e-37e0bd80fe9c', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:05:04.096379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5b73b8e-2df4-40fe-9a4a-d77f92769679 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:04.112055 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5b73b8e-2df4-40fe-9a4a-d77f92769679 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.336289 Sep 10 21:05:04.115077 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2138/4169] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:03 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:04.125912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-916433e7-9bb7-43e6-b8a8-a3ebc155ffbf tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:04.128860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-916433e7-9bb7-43e6-b8a8-a3ebc155ffbf tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:04.141990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-916433e7-9bb7-43e6-b8a8-a3ebc155ffbf tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:04.144143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-916433e7-9bb7-43e6-b8a8-a3ebc155ffbf tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:04.145029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-916433e7-9bb7-43e6-b8a8-a3ebc155ffbf tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:04.146032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-916433e7-9bb7-43e6-b8a8-a3ebc155ffbf tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:04.146697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-916433e7-9bb7-43e6-b8a8-a3ebc155ffbf tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:04.147352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-916433e7-9bb7-43e6-b8a8-a3ebc155ffbf tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:04.419787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-916433e7-9bb7-43e6-b8a8-a3ebc155ffbf tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:04.428939 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-916433e7-9bb7-43e6-b8a8-a3ebc155ffbf tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.312525 Sep 10 21:05:04.434013 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2139/4170] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:04 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:05.145179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9f633694-26e5-4443-afed-4f0ebd7e52c2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:05.149141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9f633694-26e5-4443-afed-4f0ebd7e52c2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:05.160053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:05:05.160585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:05:05.161132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:05:05.161671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:05:05.162397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:05:05.165942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f633694-26e5-4443-afed-4f0ebd7e52c2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:05.167318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f633694-26e5-4443-afed-4f0ebd7e52c2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:05.169536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f633694-26e5-4443-afed-4f0ebd7e52c2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:05.170703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f633694-26e5-4443-afed-4f0ebd7e52c2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:05.171371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f633694-26e5-4443-afed-4f0ebd7e52c2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:05.172152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f633694-26e5-4443-afed-4f0ebd7e52c2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:05.186972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:05.189096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:05.189794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:05.191609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:05.194679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:05.195917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:05.255320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Getting quotas for project a31cdf32235d44b1bbd691ebea38663b. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:05:05.272421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Getting quotas for user b766ab7d168745a4bb8b07fb8e5df3ed and project a31cdf32235d44b1bbd691ebea38663b. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:05:05.311160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:05:05.315687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:05:05.410319 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7bd0fdbc-7ebc-45e0-bb2e-de6749189094 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.337327 Sep 10 21:05:05.414918 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2032/4171] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:05:05.468089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6fc4b5a7-9dd6-4ec9-84d4-bb201d71bb89 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:05.470610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6fc4b5a7-9dd6-4ec9-84d4-bb201d71bb89 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:05.530683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9f633694-26e5-4443-afed-4f0ebd7e52c2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:05.545070 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9f633694-26e5-4443-afed-4f0ebd7e52c2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.405278 Sep 10 21:05:05.545940 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2140/4172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:05 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:05.559598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-827b6680-4209-4cea-91b7-20802be91b99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:05.560434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-827b6680-4209-4cea-91b7-20802be91b99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:05.579564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-827b6680-4209-4cea-91b7-20802be91b99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:05.580451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-827b6680-4209-4cea-91b7-20802be91b99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:05.581027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-827b6680-4209-4cea-91b7-20802be91b99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:05.582081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-827b6680-4209-4cea-91b7-20802be91b99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:05.588356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-827b6680-4209-4cea-91b7-20802be91b99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:05.589118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-827b6680-4209-4cea-91b7-20802be91b99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:05.801311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6fc4b5a7-9dd6-4ec9-84d4-bb201d71bb89 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:05.813863 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6fc4b5a7-9dd6-4ec9-84d4-bb201d71bb89 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1228 microversion: 2.1 time: 0.390152 Sep 10 21:05:05.814516 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2033/4173] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:05 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1228 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:05.990374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-827b6680-4209-4cea-91b7-20802be91b99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:06.003010 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-827b6680-4209-4cea-91b7-20802be91b99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.454345 Sep 10 21:05:06.004211 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2141/4174] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:05 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:06.578133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be08aed7-72a9-403e-98e3-12629e248240 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:06.579477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-be08aed7-72a9-403e-98e3-12629e248240 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:06.597289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be08aed7-72a9-403e-98e3-12629e248240 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:06.598073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be08aed7-72a9-403e-98e3-12629e248240 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:06.598728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be08aed7-72a9-403e-98e3-12629e248240 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:06.599702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be08aed7-72a9-403e-98e3-12629e248240 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:06.600626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be08aed7-72a9-403e-98e3-12629e248240 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:06.601251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be08aed7-72a9-403e-98e3-12629e248240 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:06.842277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dab00ae0-2e2a-4083-a054-7de78fdb6ee2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:06.843756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dab00ae0-2e2a-4083-a054-7de78fdb6ee2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:06.854926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dab00ae0-2e2a-4083-a054-7de78fdb6ee2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:06.855688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dab00ae0-2e2a-4083-a054-7de78fdb6ee2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:06.856316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dab00ae0-2e2a-4083-a054-7de78fdb6ee2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:06.857200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dab00ae0-2e2a-4083-a054-7de78fdb6ee2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:06.857892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dab00ae0-2e2a-4083-a054-7de78fdb6ee2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:06.858837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dab00ae0-2e2a-4083-a054-7de78fdb6ee2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:07.070148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dab00ae0-2e2a-4083-a054-7de78fdb6ee2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:07.083523 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dab00ae0-2e2a-4083-a054-7de78fdb6ee2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1280 microversion: 2.1 time: 0.247886 Sep 10 21:05:07.088871 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2142/4175] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:06 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1280 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:07.099045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ced46737-9bec-40bb-a0e1-568f77717558 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:07.100597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ced46737-9bec-40bb-a0e1-568f77717558 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:07.101752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-be08aed7-72a9-403e-98e3-12629e248240 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:07.115611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced46737-9bec-40bb-a0e1-568f77717558 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:07.117601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced46737-9bec-40bb-a0e1-568f77717558 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:07.118341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced46737-9bec-40bb-a0e1-568f77717558 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:07.120906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced46737-9bec-40bb-a0e1-568f77717558 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:07.122098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced46737-9bec-40bb-a0e1-568f77717558 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:07.122214 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be08aed7-72a9-403e-98e3-12629e248240 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1506 microversion: 2.1 time: 0.543613 Sep 10 21:05:07.125556 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2034/4176] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:06 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:07.136355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ced46737-9bec-40bb-a0e1-568f77717558 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:07.383857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ced46737-9bec-40bb-a0e1-568f77717558 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:07.395346 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ced46737-9bec-40bb-a0e1-568f77717558 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.305024 Sep 10 21:05:07.404283 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2143/4177] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:07 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:08.116005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-87023144-c359-4ff8-999d-2dc7cf891cfd tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:08.117208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-87023144-c359-4ff8-999d-2dc7cf891cfd tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:08.137317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87023144-c359-4ff8-999d-2dc7cf891cfd tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:08.143158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87023144-c359-4ff8-999d-2dc7cf891cfd tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:08.144088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87023144-c359-4ff8-999d-2dc7cf891cfd tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:08.145467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87023144-c359-4ff8-999d-2dc7cf891cfd tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:08.148625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-23c15bf6-f1f4-4fc0-8c38-3c74ff2e2cea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:08.149390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-23c15bf6-f1f4-4fc0-8c38-3c74ff2e2cea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:08.151068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87023144-c359-4ff8-999d-2dc7cf891cfd tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:08.152069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87023144-c359-4ff8-999d-2dc7cf891cfd tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:08.171784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23c15bf6-f1f4-4fc0-8c38-3c74ff2e2cea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:08.172545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23c15bf6-f1f4-4fc0-8c38-3c74ff2e2cea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:08.173065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23c15bf6-f1f4-4fc0-8c38-3c74ff2e2cea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:08.188535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23c15bf6-f1f4-4fc0-8c38-3c74ff2e2cea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:08.189327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23c15bf6-f1f4-4fc0-8c38-3c74ff2e2cea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:08.189742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23c15bf6-f1f4-4fc0-8c38-3c74ff2e2cea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:08.359360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87023144-c359-4ff8-999d-2dc7cf891cfd tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:08.374894 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-87023144-c359-4ff8-999d-2dc7cf891cfd tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1286 microversion: 2.1 time: 0.257762 Sep 10 21:05:08.378903 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2035/4178] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:08 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1286 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:08.432604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5bccbd34-aa9b-46e0-ac42-1c161d11dcab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:08.433595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5bccbd34-aa9b-46e0-ac42-1c161d11dcab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:08.458838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bccbd34-aa9b-46e0-ac42-1c161d11dcab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:08.462236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bccbd34-aa9b-46e0-ac42-1c161d11dcab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:08.465636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bccbd34-aa9b-46e0-ac42-1c161d11dcab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:08.480415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bccbd34-aa9b-46e0-ac42-1c161d11dcab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:08.486119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bccbd34-aa9b-46e0-ac42-1c161d11dcab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:08.486926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bccbd34-aa9b-46e0-ac42-1c161d11dcab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:08.504250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:08.837650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-23c15bf6-f1f4-4fc0-8c38-3c74ff2e2cea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:08.867339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:08.870516 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-23c15bf6-f1f4-4fc0-8c38-3c74ff2e2cea tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1527 microversion: 2.1 time: 0.727027 Sep 10 21:05:08.894348 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2144/4179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:08 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1527 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:09.180603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5bccbd34-aa9b-46e0-ac42-1c161d11dcab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:09.204067 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5bccbd34-aa9b-46e0-ac42-1c161d11dcab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.776356 Sep 10 21:05:09.208234 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2036/4180] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:08 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:09.409587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e23b8ac-6779-49da-8534-a05703286f54 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:09.412587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e23b8ac-6779-49da-8534-a05703286f54 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:09.429230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e23b8ac-6779-49da-8534-a05703286f54 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:09.432425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e23b8ac-6779-49da-8534-a05703286f54 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:09.433386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e23b8ac-6779-49da-8534-a05703286f54 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:09.436900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e23b8ac-6779-49da-8534-a05703286f54 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:09.437603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e23b8ac-6779-49da-8534-a05703286f54 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:09.438846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e23b8ac-6779-49da-8534-a05703286f54 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:09.646227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6e23b8ac-6779-49da-8534-a05703286f54 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:09.674473 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e23b8ac-6779-49da-8534-a05703286f54 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1286 microversion: 2.1 time: 0.258696 Sep 10 21:05:09.675273 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2145/4181] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:09 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1286 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:09.904145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-acd2089f-93a2-42c0-b0c1-81533ec4ac05 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:09.905926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-acd2089f-93a2-42c0-b0c1-81533ec4ac05 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:09.924652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acd2089f-93a2-42c0-b0c1-81533ec4ac05 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:09.931539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acd2089f-93a2-42c0-b0c1-81533ec4ac05 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:09.932276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acd2089f-93a2-42c0-b0c1-81533ec4ac05 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:09.934949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acd2089f-93a2-42c0-b0c1-81533ec4ac05 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:09.935716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acd2089f-93a2-42c0-b0c1-81533ec4ac05 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:09.936354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acd2089f-93a2-42c0-b0c1-81533ec4ac05 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:10.240365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-64bbae3c-1498-49ef-a2f0-69a6c9ab168d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:10.243633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-64bbae3c-1498-49ef-a2f0-69a6c9ab168d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:10.284309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64bbae3c-1498-49ef-a2f0-69a6c9ab168d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:10.285727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64bbae3c-1498-49ef-a2f0-69a6c9ab168d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:10.286883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64bbae3c-1498-49ef-a2f0-69a6c9ab168d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:10.288538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64bbae3c-1498-49ef-a2f0-69a6c9ab168d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:10.289324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64bbae3c-1498-49ef-a2f0-69a6c9ab168d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:10.290027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64bbae3c-1498-49ef-a2f0-69a6c9ab168d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:10.761747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-64bbae3c-1498-49ef-a2f0-69a6c9ab168d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:10.773913 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-64bbae3c-1498-49ef-a2f0-69a6c9ab168d tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.544010 Sep 10 21:05:10.778856 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2146/4182] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:10 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:10.792438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2bf7d22b-16bf-4e99-acb3-6c1104a00707 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:10.793402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2bf7d22b-16bf-4e99-acb3-6c1104a00707 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:10.809446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bf7d22b-16bf-4e99-acb3-6c1104a00707 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:10.810402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bf7d22b-16bf-4e99-acb3-6c1104a00707 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:10.814503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bf7d22b-16bf-4e99-acb3-6c1104a00707 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:10.815673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bf7d22b-16bf-4e99-acb3-6c1104a00707 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:10.816223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bf7d22b-16bf-4e99-acb3-6c1104a00707 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:10.816732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bf7d22b-16bf-4e99-acb3-6c1104a00707 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:10.913335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-acd2089f-93a2-42c0-b0c1-81533ec4ac05 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:10.944015 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-acd2089f-93a2-42c0-b0c1-81533ec4ac05 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 1.049371 Sep 10 21:05:10.944989 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2037/4183] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:09 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:11.283702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2bf7d22b-16bf-4e99-acb3-6c1104a00707 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:11.293726 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2bf7d22b-16bf-4e99-acb3-6c1104a00707 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1328 microversion: 2.1 time: 0.512167 Sep 10 21:05:11.300814 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2147/4184] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:10 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1328 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:11.810431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0fa8ac79-f5d3-464b-be5a-12fe6e9a0530 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:11.811095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0fa8ac79-f5d3-464b-be5a-12fe6e9a0530 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:11.833614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa8ac79-f5d3-464b-be5a-12fe6e9a0530 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:11.838221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa8ac79-f5d3-464b-be5a-12fe6e9a0530 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:11.838693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa8ac79-f5d3-464b-be5a-12fe6e9a0530 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:11.839463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa8ac79-f5d3-464b-be5a-12fe6e9a0530 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:11.839935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa8ac79-f5d3-464b-be5a-12fe6e9a0530 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:11.840366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fa8ac79-f5d3-464b-be5a-12fe6e9a0530 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:11.979042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-91bacb16-038d-4749-b074-f6b50f638ba4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:11.980292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-91bacb16-038d-4749-b074-f6b50f638ba4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:12.004084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91bacb16-038d-4749-b074-f6b50f638ba4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:12.005526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91bacb16-038d-4749-b074-f6b50f638ba4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:12.006031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91bacb16-038d-4749-b074-f6b50f638ba4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:12.006803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91bacb16-038d-4749-b074-f6b50f638ba4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:12.007276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91bacb16-038d-4749-b074-f6b50f638ba4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:12.012159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91bacb16-038d-4749-b074-f6b50f638ba4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:12.464928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0fa8ac79-f5d3-464b-be5a-12fe6e9a0530 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:12.502759 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0fa8ac79-f5d3-464b-be5a-12fe6e9a0530 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.700508 Sep 10 21:05:12.503356 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2038/4185] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:11 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:12.520976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-46970b03-53df-40d3-aaf2-7c1d188dde5d req-2effc026-59b9-4d00-9074-a522612a9dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dee3a0f-33be-4437-8d46-8c0340b47350", "tag": "3e556bab-457f-4906-a332-d6b3e1342942"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:12.543121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:12.546711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-46970b03-53df-40d3-aaf2-7c1d188dde5d req-2effc026-59b9-4d00-9074-a522612a9dff service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:12.550139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-46970b03-53df-40d3-aaf2-7c1d188dde5d req-2effc026-59b9-4d00-9074-a522612a9dff service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:12.550808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-46970b03-53df-40d3-aaf2-7c1d188dde5d req-2effc026-59b9-4d00-9074-a522612a9dff service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:12.593723 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-46970b03-53df-40d3-aaf2-7c1d188dde5d req-2effc026-59b9-4d00-9074-a522612a9dff service nova] Creating event network-changed:3e556bab-457f-4906-a332-d6b3e1342942 for instance 5dee3a0f-33be-4437-8d46-8c0340b47350 on nch2-master-1 Sep 10 21:05:12.609741 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-46970b03-53df-40d3-aaf2-7c1d188dde5d req-2effc026-59b9-4d00-9074-a522612a9dff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104592 Sep 10 21:05:12.611001 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2039/4186] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:12.617394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1b9222fe-00bd-4133-ad9c-abefa4bb7fd5 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:12.619716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1b9222fe-00bd-4133-ad9c-abefa4bb7fd5 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:12.631315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b9222fe-00bd-4133-ad9c-abefa4bb7fd5 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:12.638079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b9222fe-00bd-4133-ad9c-abefa4bb7fd5 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:12.645716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b9222fe-00bd-4133-ad9c-abefa4bb7fd5 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:12.649911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b9222fe-00bd-4133-ad9c-abefa4bb7fd5 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:12.652914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b9222fe-00bd-4133-ad9c-abefa4bb7fd5 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:12.656601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b9222fe-00bd-4133-ad9c-abefa4bb7fd5 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:13.333430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-91bacb16-038d-4749-b074-f6b50f638ba4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:13.354681 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-91bacb16-038d-4749-b074-f6b50f638ba4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 1.384064 Sep 10 21:05:13.372162 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2148/4187] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:11 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:13.535465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-703d29c9-ba40-4782-9314-808f05cb3a09 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:13.536459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-703d29c9-ba40-4782-9314-808f05cb3a09 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:13.544414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-703d29c9-ba40-4782-9314-808f05cb3a09 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:13.545090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-703d29c9-ba40-4782-9314-808f05cb3a09 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:13.545693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-703d29c9-ba40-4782-9314-808f05cb3a09 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:13.546792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-703d29c9-ba40-4782-9314-808f05cb3a09 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:13.547447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-703d29c9-ba40-4782-9314-808f05cb3a09 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:13.548383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-703d29c9-ba40-4782-9314-808f05cb3a09 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:13.685243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1b9222fe-00bd-4133-ad9c-abefa4bb7fd5 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:13.711640 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1b9222fe-00bd-4133-ad9c-abefa4bb7fd5 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1328 microversion: 2.1 time: 1.098621 Sep 10 21:05:13.715046 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2040/4188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:12 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1328 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:13.898813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-703d29c9-ba40-4782-9314-808f05cb3a09 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:13.923405 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-703d29c9-ba40-4782-9314-808f05cb3a09 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.395339 Sep 10 21:05:13.924085 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2149/4189] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:13 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:14.383647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bfffd055-592e-4de4-ab9f-5d56a79d3d01 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:14.384830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bfffd055-592e-4de4-ab9f-5d56a79d3d01 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:14.406797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfffd055-592e-4de4-ab9f-5d56a79d3d01 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:14.410236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfffd055-592e-4de4-ab9f-5d56a79d3d01 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:14.412016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfffd055-592e-4de4-ab9f-5d56a79d3d01 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:14.416752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfffd055-592e-4de4-ab9f-5d56a79d3d01 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:14.417747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfffd055-592e-4de4-ab9f-5d56a79d3d01 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:14.421160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bfffd055-592e-4de4-ab9f-5d56a79d3d01 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:14.562529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-cb48136d-3f0c-4d94-b07f-eb95449d2cf8 req-685978aa-b00d-433b-85ed-2b469e0736e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73", "name": "network-vif-plugged", "status": "completed", "tag": "b1b3e948-57a8-4218-844e-44d056f25995"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:14.597755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-cb48136d-3f0c-4d94-b07f-eb95449d2cf8 req-685978aa-b00d-433b-85ed-2b469e0736e8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:14.599116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-cb48136d-3f0c-4d94-b07f-eb95449d2cf8 req-685978aa-b00d-433b-85ed-2b469e0736e8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:14.600703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-cb48136d-3f0c-4d94-b07f-eb95449d2cf8 req-685978aa-b00d-433b-85ed-2b469e0736e8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:14.653157 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-cb48136d-3f0c-4d94-b07f-eb95449d2cf8 req-685978aa-b00d-433b-85ed-2b469e0736e8 service nova] Creating event network-vif-plugged:b1b3e948-57a8-4218-844e-44d056f25995 for instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 on nch2-master-1 Sep 10 21:05:14.681264 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-cb48136d-3f0c-4d94-b07f-eb95449d2cf8 req-685978aa-b00d-433b-85ed-2b469e0736e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125722 Sep 10 21:05:14.691755 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2150/4190] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:14.737862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fd53b579-58c5-4cf2-aeb8-c73a8ee3c2f8 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:14.739849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fd53b579-58c5-4cf2-aeb8-c73a8ee3c2f8 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:14.756336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd53b579-58c5-4cf2-aeb8-c73a8ee3c2f8 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:14.758289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd53b579-58c5-4cf2-aeb8-c73a8ee3c2f8 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:14.760732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd53b579-58c5-4cf2-aeb8-c73a8ee3c2f8 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:14.763037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd53b579-58c5-4cf2-aeb8-c73a8ee3c2f8 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:14.764979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd53b579-58c5-4cf2-aeb8-c73a8ee3c2f8 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:14.765586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd53b579-58c5-4cf2-aeb8-c73a8ee3c2f8 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:14.897477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bfffd055-592e-4de4-ab9f-5d56a79d3d01 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:14.910980 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bfffd055-592e-4de4-ab9f-5d56a79d3d01 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 0.534061 Sep 10 21:05:14.921879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2041/4191] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:14 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:14.951318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bab1362d-d04d-4ea5-99f9-5be0ea500081 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:14.952090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bab1362d-d04d-4ea5-99f9-5be0ea500081 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:14.970176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bab1362d-d04d-4ea5-99f9-5be0ea500081 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:14.971029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bab1362d-d04d-4ea5-99f9-5be0ea500081 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:14.971659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bab1362d-d04d-4ea5-99f9-5be0ea500081 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:14.972616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bab1362d-d04d-4ea5-99f9-5be0ea500081 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:14.973275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bab1362d-d04d-4ea5-99f9-5be0ea500081 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:14.973916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bab1362d-d04d-4ea5-99f9-5be0ea500081 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:15.224428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:15.253842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fd53b579-58c5-4cf2-aeb8-c73a8ee3c2f8 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:15.271248 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fd53b579-58c5-4cf2-aeb8-c73a8ee3c2f8 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1328 microversion: 2.1 time: 0.534572 Sep 10 21:05:15.275288 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2151/4192] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:14 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1328 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:15.331451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bab1362d-d04d-4ea5-99f9-5be0ea500081 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:15.345183 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bab1362d-d04d-4ea5-99f9-5be0ea500081 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.396946 Sep 10 21:05:15.347170 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2042/4193] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:14 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:15.940333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4aade6e9-7663-4102-af87-048cdfae83ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:15.942093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4aade6e9-7663-4102-af87-048cdfae83ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:15.959130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aade6e9-7663-4102-af87-048cdfae83ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:15.959638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aade6e9-7663-4102-af87-048cdfae83ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:15.998141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aade6e9-7663-4102-af87-048cdfae83ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:16.005770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aade6e9-7663-4102-af87-048cdfae83ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:16.006616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aade6e9-7663-4102-af87-048cdfae83ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:16.007341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4aade6e9-7663-4102-af87-048cdfae83ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:16.307924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8a80ee1f-53a4-493a-9627-9be920676a6a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:16.309080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8a80ee1f-53a4-493a-9627-9be920676a6a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:16.327301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:16.335294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a80ee1f-53a4-493a-9627-9be920676a6a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:16.336028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a80ee1f-53a4-493a-9627-9be920676a6a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:16.339483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a80ee1f-53a4-493a-9627-9be920676a6a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:16.340608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a80ee1f-53a4-493a-9627-9be920676a6a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:16.342047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a80ee1f-53a4-493a-9627-9be920676a6a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:16.345167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a80ee1f-53a4-493a-9627-9be920676a6a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:16.945035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4aade6e9-7663-4102-af87-048cdfae83ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:16.966067 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4aade6e9-7663-4102-af87-048cdfae83ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 1.030182 Sep 10 21:05:16.986581 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2152/4194] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:15 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:17.001105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5928eb85-6050-4834-a5f6-010a01c57bc0 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:17.003404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5928eb85-6050-4834-a5f6-010a01c57bc0 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:17.025232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8a80ee1f-53a4-493a-9627-9be920676a6a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:17.031500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5928eb85-6050-4834-a5f6-010a01c57bc0 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:17.032765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5928eb85-6050-4834-a5f6-010a01c57bc0 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:17.033910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5928eb85-6050-4834-a5f6-010a01c57bc0 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:17.035690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5928eb85-6050-4834-a5f6-010a01c57bc0 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:17.037983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5928eb85-6050-4834-a5f6-010a01c57bc0 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:17.039312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5928eb85-6050-4834-a5f6-010a01c57bc0 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:17.041774 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8a80ee1f-53a4-493a-9627-9be920676a6a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1328 microversion: 2.1 time: 0.734946 Sep 10 21:05:17.047026 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2043/4195] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:16 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1328 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:17.787136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5928eb85-6050-4834-a5f6-010a01c57bc0 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:17.802295 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5928eb85-6050-4834-a5f6-010a01c57bc0 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.810996 Sep 10 21:05:17.807587 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2153/4196] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:16 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:17.997129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0d856a57-f64e-4582-8f0d-f9c65a4d97cd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:17.998492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0d856a57-f64e-4582-8f0d-f9c65a4d97cd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:18.022597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d856a57-f64e-4582-8f0d-f9c65a4d97cd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:18.025938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d856a57-f64e-4582-8f0d-f9c65a4d97cd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:18.026932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d856a57-f64e-4582-8f0d-f9c65a4d97cd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:18.028525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d856a57-f64e-4582-8f0d-f9c65a4d97cd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:18.042508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d856a57-f64e-4582-8f0d-f9c65a4d97cd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:18.046125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d856a57-f64e-4582-8f0d-f9c65a4d97cd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:18.078244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3d581601-1d37-427a-a305-7d6ab68b21a7 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:18.079578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3d581601-1d37-427a-a305-7d6ab68b21a7 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:18.092467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=56 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:18.094866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d581601-1d37-427a-a305-7d6ab68b21a7 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:18.098143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d581601-1d37-427a-a305-7d6ab68b21a7 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:18.099395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d581601-1d37-427a-a305-7d6ab68b21a7 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:18.100700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d581601-1d37-427a-a305-7d6ab68b21a7 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:18.103189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d581601-1d37-427a-a305-7d6ab68b21a7 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:18.106068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d581601-1d37-427a-a305-7d6ab68b21a7 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:18.341091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0d856a57-f64e-4582-8f0d-f9c65a4d97cd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:18.380211 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0d856a57-f64e-4582-8f0d-f9c65a4d97cd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 0.368299 Sep 10 21:05:18.380896 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2044/4197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:17 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:18.834259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-210ed0b9-d9b9-4b65-ac15-05268be06102 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:18.834909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-210ed0b9-d9b9-4b65-ac15-05268be06102 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:18.850700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-210ed0b9-d9b9-4b65-ac15-05268be06102 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:18.851247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-210ed0b9-d9b9-4b65-ac15-05268be06102 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:18.851699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-210ed0b9-d9b9-4b65-ac15-05268be06102 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:18.853042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-210ed0b9-d9b9-4b65-ac15-05268be06102 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:18.853676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-210ed0b9-d9b9-4b65-ac15-05268be06102 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:18.854166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-210ed0b9-d9b9-4b65-ac15-05268be06102 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:19.003427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3d581601-1d37-427a-a305-7d6ab68b21a7 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:19.028432 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3d581601-1d37-427a-a305-7d6ab68b21a7 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1328 microversion: 2.1 time: 0.955146 Sep 10 21:05:19.032932 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2154/4198] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:18 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1328 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:19.176479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-210ed0b9-d9b9-4b65-ac15-05268be06102 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:19.190654 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-210ed0b9-d9b9-4b65-ac15-05268be06102 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.365843 Sep 10 21:05:19.205896 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2045/4199] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:18 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:19.406755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cb9254ab-8888-4712-b066-4074695c8608 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:19.407884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cb9254ab-8888-4712-b066-4074695c8608 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:19.419638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb9254ab-8888-4712-b066-4074695c8608 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:19.424629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb9254ab-8888-4712-b066-4074695c8608 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:19.427517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb9254ab-8888-4712-b066-4074695c8608 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:19.430207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb9254ab-8888-4712-b066-4074695c8608 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:19.431564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb9254ab-8888-4712-b066-4074695c8608 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:19.434264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb9254ab-8888-4712-b066-4074695c8608 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:20.032721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cb9254ab-8888-4712-b066-4074695c8608 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:20.058572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-94e6027d-058b-4b25-9f29-4f08c08b68e2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:20.059688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-94e6027d-058b-4b25-9f29-4f08c08b68e2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:20.108622 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cb9254ab-8888-4712-b066-4074695c8608 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 0.705736 Sep 10 21:05:20.118501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94e6027d-058b-4b25-9f29-4f08c08b68e2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:20.119607 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2155/4200] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:19 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:20.119726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94e6027d-058b-4b25-9f29-4f08c08b68e2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:20.128054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94e6027d-058b-4b25-9f29-4f08c08b68e2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:20.128054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94e6027d-058b-4b25-9f29-4f08c08b68e2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:20.128054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94e6027d-058b-4b25-9f29-4f08c08b68e2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:20.128054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94e6027d-058b-4b25-9f29-4f08c08b68e2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:20.227920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7613c23c-6c29-411c-8f41-24f5e1236a99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:20.232197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7613c23c-6c29-411c-8f41-24f5e1236a99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:20.248887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7613c23c-6c29-411c-8f41-24f5e1236a99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:20.252078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7613c23c-6c29-411c-8f41-24f5e1236a99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:20.254181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7613c23c-6c29-411c-8f41-24f5e1236a99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:20.257251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7613c23c-6c29-411c-8f41-24f5e1236a99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:20.258387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7613c23c-6c29-411c-8f41-24f5e1236a99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:20.260936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7613c23c-6c29-411c-8f41-24f5e1236a99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:20.448838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-94e6027d-058b-4b25-9f29-4f08c08b68e2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:20.470139 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-94e6027d-058b-4b25-9f29-4f08c08b68e2 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1328 microversion: 2.1 time: 0.417562 Sep 10 21:05:20.471326 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2046/4201] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:20 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1328 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:20.711237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7613c23c-6c29-411c-8f41-24f5e1236a99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:20.732898 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7613c23c-6c29-411c-8f41-24f5e1236a99 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.513948 Sep 10 21:05:20.745853 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2156/4202] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:20 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:20.872295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-9fc9c1b2-80ff-4400-83b1-0c6c4c78ef72 req-def4cb1f-0589-4fe6-9ba8-305f4f12fcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dee3a0f-33be-4437-8d46-8c0340b47350", "name": "network-vif-plugged", "status": "completed", "tag": "3e556bab-457f-4906-a332-d6b3e1342942"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:20.898204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9fc9c1b2-80ff-4400-83b1-0c6c4c78ef72 req-def4cb1f-0589-4fe6-9ba8-305f4f12fcd8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:20.906542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9fc9c1b2-80ff-4400-83b1-0c6c4c78ef72 req-def4cb1f-0589-4fe6-9ba8-305f4f12fcd8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:20.907204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9fc9c1b2-80ff-4400-83b1-0c6c4c78ef72 req-def4cb1f-0589-4fe6-9ba8-305f4f12fcd8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:20.950568 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-9fc9c1b2-80ff-4400-83b1-0c6c4c78ef72 req-def4cb1f-0589-4fe6-9ba8-305f4f12fcd8 service nova] Creating event network-vif-plugged:3e556bab-457f-4906-a332-d6b3e1342942 for instance 5dee3a0f-33be-4437-8d46-8c0340b47350 on nch2-master-1 Sep 10 21:05:20.965364 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-9fc9c1b2-80ff-4400-83b1-0c6c4c78ef72 req-def4cb1f-0589-4fe6-9ba8-305f4f12fcd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097210 Sep 10 21:05:20.985457 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2047/4203] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:21.137051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-632fa39a-c6d0-4844-aef2-acccf1a3a01b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:21.138120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-632fa39a-c6d0-4844-aef2-acccf1a3a01b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:21.153957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-632fa39a-c6d0-4844-aef2-acccf1a3a01b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:21.154811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-632fa39a-c6d0-4844-aef2-acccf1a3a01b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:21.158412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-632fa39a-c6d0-4844-aef2-acccf1a3a01b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:21.159411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-632fa39a-c6d0-4844-aef2-acccf1a3a01b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:21.160110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-632fa39a-c6d0-4844-aef2-acccf1a3a01b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:21.161092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-632fa39a-c6d0-4844-aef2-acccf1a3a01b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:21.501277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fa7fbbc6-2e67-4546-8e02-413647886200 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:21.502830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fa7fbbc6-2e67-4546-8e02-413647886200 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:21.531095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7fbbc6-2e67-4546-8e02-413647886200 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:21.533204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7fbbc6-2e67-4546-8e02-413647886200 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:21.533780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7fbbc6-2e67-4546-8e02-413647886200 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:21.537065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7fbbc6-2e67-4546-8e02-413647886200 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:21.547031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7fbbc6-2e67-4546-8e02-413647886200 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:21.547759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7fbbc6-2e67-4546-8e02-413647886200 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:21.620405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-632fa39a-c6d0-4844-aef2-acccf1a3a01b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:21.633573 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-632fa39a-c6d0-4844-aef2-acccf1a3a01b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 0.500383 Sep 10 21:05:21.635534 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2157/4204] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:21 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:21.760321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59567591-85df-4af5-a123-21c9246cce9a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:21.762249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59567591-85df-4af5-a123-21c9246cce9a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:21.785521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59567591-85df-4af5-a123-21c9246cce9a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:21.795530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59567591-85df-4af5-a123-21c9246cce9a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:21.801786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59567591-85df-4af5-a123-21c9246cce9a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:21.808275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59567591-85df-4af5-a123-21c9246cce9a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:21.809716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59567591-85df-4af5-a123-21c9246cce9a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:21.813727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59567591-85df-4af5-a123-21c9246cce9a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:21.825627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fa7fbbc6-2e67-4546-8e02-413647886200 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:21.840306 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fa7fbbc6-2e67-4546-8e02-413647886200 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1328 microversion: 2.1 time: 0.345855 Sep 10 21:05:21.861034 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2048/4205] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:21 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1328 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:22.243086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-59567591-85df-4af5-a123-21c9246cce9a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:22.251679 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59567591-85df-4af5-a123-21c9246cce9a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.497096 Sep 10 21:05:22.263904 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2158/4206] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:21 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:22.661429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f75f488-8850-498d-90ec-bbb0136807a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:22.664785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2f75f488-8850-498d-90ec-bbb0136807a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:22.689804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f75f488-8850-498d-90ec-bbb0136807a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:22.691584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f75f488-8850-498d-90ec-bbb0136807a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:22.694518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f75f488-8850-498d-90ec-bbb0136807a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:22.699136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f75f488-8850-498d-90ec-bbb0136807a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:22.700648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f75f488-8850-498d-90ec-bbb0136807a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:22.704861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f75f488-8850-498d-90ec-bbb0136807a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:22.872074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-df4086cb-03df-4e33-a890-41471d00e95e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:22.872778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-df4086cb-03df-4e33-a890-41471d00e95e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:22.887218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df4086cb-03df-4e33-a890-41471d00e95e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:22.890269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df4086cb-03df-4e33-a890-41471d00e95e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:22.891528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df4086cb-03df-4e33-a890-41471d00e95e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:22.892519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df4086cb-03df-4e33-a890-41471d00e95e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:22.898314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df4086cb-03df-4e33-a890-41471d00e95e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:22.899186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df4086cb-03df-4e33-a890-41471d00e95e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:23.028176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2f75f488-8850-498d-90ec-bbb0136807a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:23.041156 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f75f488-8850-498d-90ec-bbb0136807a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 0.385425 Sep 10 21:05:23.045070 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2049/4207] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:22 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:23.287278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-546fe1b0-cb85-4606-b3ce-1ca765a87041 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:23.289734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-546fe1b0-cb85-4606-b3ce-1ca765a87041 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:23.304092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-546fe1b0-cb85-4606-b3ce-1ca765a87041 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:23.306065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-546fe1b0-cb85-4606-b3ce-1ca765a87041 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:23.306739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-546fe1b0-cb85-4606-b3ce-1ca765a87041 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:23.308390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-546fe1b0-cb85-4606-b3ce-1ca765a87041 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:23.315919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-546fe1b0-cb85-4606-b3ce-1ca765a87041 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:23.320343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-546fe1b0-cb85-4606-b3ce-1ca765a87041 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:23.648546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df4086cb-03df-4e33-a890-41471d00e95e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:23.658434 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-df4086cb-03df-4e33-a890-41471d00e95e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1528 microversion: 2.1 time: 0.793306 Sep 10 21:05:23.659041 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2159/4208] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:22 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1528 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:23.685258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1de5f851-9614-42c3-9da9-854744e1122e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:23.685796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1de5f851-9614-42c3-9da9-854744e1122e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:23.704147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1de5f851-9614-42c3-9da9-854744e1122e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:23.704645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1de5f851-9614-42c3-9da9-854744e1122e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:23.715487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1de5f851-9614-42c3-9da9-854744e1122e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:23.721341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-546fe1b0-cb85-4606-b3ce-1ca765a87041 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:23.732106 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-546fe1b0-cb85-4606-b3ce-1ca765a87041 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1524 microversion: 2.1 time: 0.451205 Sep 10 21:05:23.732983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1de5f851-9614-42c3-9da9-854744e1122e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:23.733613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1de5f851-9614-42c3-9da9-854744e1122e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:23.734110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1de5f851-9614-42c3-9da9-854744e1122e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:23.734745 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2050/4209] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:23 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1524 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:24.072565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-26600eef-22f2-40fb-80a3-79bae535871d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:24.072738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-26600eef-22f2-40fb-80a3-79bae535871d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:24.093150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26600eef-22f2-40fb-80a3-79bae535871d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:24.093682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26600eef-22f2-40fb-80a3-79bae535871d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:24.094130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26600eef-22f2-40fb-80a3-79bae535871d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:24.094862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26600eef-22f2-40fb-80a3-79bae535871d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:24.095324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26600eef-22f2-40fb-80a3-79bae535871d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:24.095756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26600eef-22f2-40fb-80a3-79bae535871d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:24.141634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1de5f851-9614-42c3-9da9-854744e1122e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:24.158405 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1de5f851-9614-42c3-9da9-854744e1122e tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1528 microversion: 2.1 time: 0.478005 Sep 10 21:05:24.159337 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2160/4210] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:23 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1528 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:24.570440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:24.571019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:24.585422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:24.585700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:24.587377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:24.587676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:24.588153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:24.588586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:24.592452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-26600eef-22f2-40fb-80a3-79bae535871d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:24.605179 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-26600eef-22f2-40fb-80a3-79bae535871d tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 0.534974 Sep 10 21:05:24.608587 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2051/4211] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:24 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:24.616059 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] HTTP exception thrown: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Request method failure captured: Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 HTTP/1.1 Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPv-fb4yhXCbp95u-OoeuHHwUORyeH-ubQmwmvN5HegN03pUY7ibdhs8RiFff_zlLn8zWfG-THaurwKN0pyuiiz_-RO-iG9-NoXIWrzdIC1O03ZAKzZg_LxHFbDALo01zpAGxIIR8pa1sxq3LI5NlBxZTG6U3w6NjyqA8IyvG8fgmvk Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 385194bd6b1143edb0d72548ec736c88 Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1108352969 Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/385194bd6b1143edb0d72548ec736c88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/385194bd6b1143edb0d72548ec736c88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_385194bd6b1143edb0d72548ec736c88", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/385194bd6b1143edb0d72548ec736c88"}]}] Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1108352969 Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 385194bd6b1143edb0d72548ec736c88 Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1108352969 Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1108352969-project Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 173f60c866c8453a97d2701fee66bfb5 Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1108352969-project Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5dee3a0f-33be-4437-8d46-8c0340b47350'} Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:05:24.618379 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Returning 404 to user: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:05:24.621632 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1a403e61-f02d-49ee-929b-64351aa628a4 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 404 len: 111 microversion: 2.1 time: 0.439797 Sep 10 21:05:24.627405 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2161/4212] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:05:24 2022] DELETE /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 111 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:05:24.632965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d02fdae4-2f46-44d8-bb41-571ea6595f4a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:24.634833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d02fdae4-2f46-44d8-bb41-571ea6595f4a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:24.641936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d02fdae4-2f46-44d8-bb41-571ea6595f4a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:24.642797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d02fdae4-2f46-44d8-bb41-571ea6595f4a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:24.643739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d02fdae4-2f46-44d8-bb41-571ea6595f4a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:24.644840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d02fdae4-2f46-44d8-bb41-571ea6595f4a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:24.645515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d02fdae4-2f46-44d8-bb41-571ea6595f4a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:24.646240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d02fdae4-2f46-44d8-bb41-571ea6595f4a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:24.762089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-55647b06-3d36-4509-94c1-b5d2382baba4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:24.762718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-55647b06-3d36-4509-94c1-b5d2382baba4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:24.793339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55647b06-3d36-4509-94c1-b5d2382baba4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:24.800070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55647b06-3d36-4509-94c1-b5d2382baba4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:24.800956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55647b06-3d36-4509-94c1-b5d2382baba4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:24.802247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55647b06-3d36-4509-94c1-b5d2382baba4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:24.803197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55647b06-3d36-4509-94c1-b5d2382baba4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:24.809945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55647b06-3d36-4509-94c1-b5d2382baba4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:25.060723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d02fdae4-2f46-44d8-bb41-571ea6595f4a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:25.072211 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d02fdae4-2f46-44d8-bb41-571ea6595f4a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1528 microversion: 2.1 time: 0.443912 Sep 10 21:05:25.073676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2052/4213] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:24 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1528 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:25.099795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Action: 'update', calling method: >, body: {"server": {"name": "5dee3a0f-33be-4437-8d46-8c0340b47350_new"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:25.104462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:25.111935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:25.112699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:25.113451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:25.114405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:25.115203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:25.115956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:25.183179 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] HTTP exception thrown: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Request method failure captured: Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: request: PUT /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 HTTP/1.1 Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 64 Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPv-fb4yhXCbp95u-OoeuHHwUORyeH-ubQmwmvN5HegN03pUY7ibdhs8RiFff_zlLn8zWfG-THaurwKN0pyuiiz_-RO-iG9-NoXIWrzdIC1O03ZAKzZg_LxHFbDALo01zpAGxIIR8pa1sxq3LI5NlBxZTG6U3w6NjyqA8IyvG8fgmvk Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 385194bd6b1143edb0d72548ec736c88 Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1108352969 Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/385194bd6b1143edb0d72548ec736c88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/385194bd6b1143edb0d72548ec736c88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_385194bd6b1143edb0d72548ec736c88", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/385194bd6b1143edb0d72548ec736c88"}]}] Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1108352969 Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 385194bd6b1143edb0d72548ec736c88 Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1108352969 Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1108352969-project Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 173f60c866c8453a97d2701fee66bfb5 Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1108352969-project Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: {"server": {"name": "5dee3a0f-33be-4437-8d46-8c0340b47350_new"}} Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5dee3a0f-33be-4437-8d46-8c0340b47350', 'body': {'server': {'name': '5dee3a0f-33be-4437-8d46-8c0340b47350_new'}}} Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:05:25.186097 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:25.189919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:25.191904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] Returning 404 to user: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:05:25.193986 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3342d268-e653-40de-ba6a-57647367a710 tempest-ServersNegativeTestMultiTenantJSON-1108352969 tempest-ServersNegativeTestMultiTenantJSON-1108352969-project] 10.222.0.33 "PUT /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 404 len: 111 microversion: 2.1 time: 0.098780 Sep 10 21:05:25.196744 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2053/4214] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Sep 10 21:05:25 2022] PUT /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:05:25.215603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-43d89d55-5bf0-425c-a36e-6100e0dcec32 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:25.217728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-43d89d55-5bf0-425c-a36e-6100e0dcec32 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:25.237542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43d89d55-5bf0-425c-a36e-6100e0dcec32 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:25.238828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43d89d55-5bf0-425c-a36e-6100e0dcec32 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:25.241778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43d89d55-5bf0-425c-a36e-6100e0dcec32 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:25.242851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43d89d55-5bf0-425c-a36e-6100e0dcec32 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:25.243468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43d89d55-5bf0-425c-a36e-6100e0dcec32 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:25.244048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43d89d55-5bf0-425c-a36e-6100e0dcec32 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:25.326693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-43d89d55-5bf0-425c-a36e-6100e0dcec32 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:05:25.344465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:25.587456 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-43d89d55-5bf0-425c-a36e-6100e0dcec32 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 204 len: 0 microversion: 2.1 time: 0.382165 Sep 10 21:05:25.589867 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2054/4215] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:05:25 2022] DELETE /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:05:25.619113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-30e5607c-929a-4ff8-a112-83f2e85f530a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:25.622920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-30e5607c-929a-4ff8-a112-83f2e85f530a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:25.638911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30e5607c-929a-4ff8-a112-83f2e85f530a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:25.641326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30e5607c-929a-4ff8-a112-83f2e85f530a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:25.642009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30e5607c-929a-4ff8-a112-83f2e85f530a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:25.643029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30e5607c-929a-4ff8-a112-83f2e85f530a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:25.646202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30e5607c-929a-4ff8-a112-83f2e85f530a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:25.647083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30e5607c-929a-4ff8-a112-83f2e85f530a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:25.684830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-55647b06-3d36-4509-94c1-b5d2382baba4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:25.692623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:25.706156 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-55647b06-3d36-4509-94c1-b5d2382baba4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1504 microversion: 2.1 time: 0.945193 Sep 10 21:05:25.710843 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2162/4216] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:24 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1504 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:25.740559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1ec7282-4ec3-4e7e-b9bd-baee1ce5b211 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:25.750190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e1ec7282-4ec3-4e7e-b9bd-baee1ce5b211 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:25.761740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1ec7282-4ec3-4e7e-b9bd-baee1ce5b211 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:25.764453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1ec7282-4ec3-4e7e-b9bd-baee1ce5b211 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:25.766573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1ec7282-4ec3-4e7e-b9bd-baee1ce5b211 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:25.767448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1ec7282-4ec3-4e7e-b9bd-baee1ce5b211 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:25.768956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1ec7282-4ec3-4e7e-b9bd-baee1ce5b211 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:25.770777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1ec7282-4ec3-4e7e-b9bd-baee1ce5b211 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:26.136098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-30e5607c-929a-4ff8-a112-83f2e85f530a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:26.150716 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-30e5607c-929a-4ff8-a112-83f2e85f530a tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1534 microversion: 2.1 time: 0.550413 Sep 10 21:05:26.152407 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2055/4217] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:25 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1534 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:26.160601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-128b79b6-e968-486d-9e39-eb2d8c1741bc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Action: 'create', calling method: .version_select at 0x7f9944bdd9d0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-97941785", "description": "tempest-description-603419454"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:26.327657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1ec7282-4ec3-4e7e-b9bd-baee1ce5b211 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:26.340695 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1ec7282-4ec3-4e7e-b9bd-baee1ce5b211 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 0.624354 Sep 10 21:05:26.345290 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2163/4218] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:25 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:26.624429 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-128b79b6-e968-486d-9e39-eb2d8c1741bc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.471289 Sep 10 21:05:26.625935 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2056/4219] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Sep 10 21:05:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:26.643708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5db6daf8-9639-497f-9636-c6527625d1d7 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-97941785"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:26.644635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5db6daf8-9639-497f-9636-c6527625d1d7 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:26.652328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5db6daf8-9639-497f-9636-c6527625d1d7 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:26.653151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5db6daf8-9639-497f-9636-c6527625d1d7 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:26.653813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5db6daf8-9639-497f-9636-c6527625d1d7 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:26.654788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5db6daf8-9639-497f-9636-c6527625d1d7 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:26.655484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5db6daf8-9639-497f-9636-c6527625d1d7 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:26.656134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5db6daf8-9639-497f-9636-c6527625d1d7 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:27.024590 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.network.security_group_api [None req-5db6daf8-9639-497f-9636-c6527625d1d7 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Adding security group 7fde90df-4a0b-4418-9fa4-f3c65c0ca395 to port 9720d5e6-b71e-46dd-a1ca-700a06956155 Sep 10 21:05:27.183145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-11574751-f618-45f7-98be-217a23867b40 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:27.184381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-11574751-f618-45f7-98be-217a23867b40 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:27.198533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11574751-f618-45f7-98be-217a23867b40 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:27.203274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11574751-f618-45f7-98be-217a23867b40 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:27.205563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11574751-f618-45f7-98be-217a23867b40 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:27.206510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11574751-f618-45f7-98be-217a23867b40 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:27.207144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11574751-f618-45f7-98be-217a23867b40 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:27.211863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11574751-f618-45f7-98be-217a23867b40 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:27.662262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-11574751-f618-45f7-98be-217a23867b40 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:27.677681 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-11574751-f618-45f7-98be-217a23867b40 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1534 microversion: 2.1 time: 0.501224 Sep 10 21:05:27.689233 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2057/4220] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:27 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1534 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:27.702210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f01a6b83-e511-4b8f-a601-aec3f0f3af0e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:27.703741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f01a6b83-e511-4b8f-a601-aec3f0f3af0e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:27.727850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f01a6b83-e511-4b8f-a601-aec3f0f3af0e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:27.728737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f01a6b83-e511-4b8f-a601-aec3f0f3af0e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:27.729393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f01a6b83-e511-4b8f-a601-aec3f0f3af0e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:27.732436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f01a6b83-e511-4b8f-a601-aec3f0f3af0e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:27.733324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f01a6b83-e511-4b8f-a601-aec3f0f3af0e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:27.734134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f01a6b83-e511-4b8f-a601-aec3f0f3af0e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:28.886324 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5db6daf8-9639-497f-9636-c6527625d1d7 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "POST /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11/action" status: 202 len: 0 microversion: 2.1 time: 2.244498 Sep 10 21:05:28.887307 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2164/4221] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:05:26 2022] POST /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11/action => generated 0 bytes in 2249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:05:28.893786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-64320740-4d2b-4930-bfd3-292f3d6f5de9 req-59892b3d-92cc-4324-bce9-f7d6b6f49a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dee3a0f-33be-4437-8d46-8c0340b47350", "name": "network-vif-deleted", "tag": "3e556bab-457f-4906-a332-d6b3e1342942"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:28.920371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-64320740-4d2b-4930-bfd3-292f3d6f5de9 req-59892b3d-92cc-4324-bce9-f7d6b6f49a71 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:28.921143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-64320740-4d2b-4930-bfd3-292f3d6f5de9 req-59892b3d-92cc-4324-bce9-f7d6b6f49a71 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:28.923608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-64320740-4d2b-4930-bfd3-292f3d6f5de9 req-59892b3d-92cc-4324-bce9-f7d6b6f49a71 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:28.960455 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-64320740-4d2b-4930-bfd3-292f3d6f5de9 req-59892b3d-92cc-4324-bce9-f7d6b6f49a71 service nova] Creating event network-vif-deleted:3e556bab-457f-4906-a332-d6b3e1342942 for instance 5dee3a0f-33be-4437-8d46-8c0340b47350 on nch2-master-1 Sep 10 21:05:28.986020 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-64320740-4d2b-4930-bfd3-292f3d6f5de9 req-59892b3d-92cc-4324-bce9-f7d6b6f49a71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097339 Sep 10 21:05:28.989146 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2165/4222] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:29.033138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:29.034284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:29.059244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:29.060282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:29.061800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:29.068655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:29.069483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:29.071461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:29.169109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:29.177252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:29.177863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:29.178465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lazy-loading 'fault' on Instance uuid 5dee3a0f-33be-4437-8d46-8c0340b47350 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:05:29.365764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b766ab7d168745a4bb8b07fb8e5df3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31cdf32235d44b1bbd691ebea38663b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:29.373630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f01a6b83-e511-4b8f-a601-aec3f0f3af0e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:29.374171 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-03f23cab-a933-4f63-8c90-45d404687b06 tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 200 len: 1318 microversion: 2.1 time: 0.381959 Sep 10 21:05:29.387040 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f01a6b83-e511-4b8f-a601-aec3f0f3af0e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 1.696312 Sep 10 21:05:29.389566 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2058/4223] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:27 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:29.390528 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2166/4224] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:28 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:29.414436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-32de8aed-2d2d-4d48-9514-f71681c56884 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-97941785"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:29.415544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-32de8aed-2d2d-4d48-9514-f71681c56884 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:29.443512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32de8aed-2d2d-4d48-9514-f71681c56884 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:29.444389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32de8aed-2d2d-4d48-9514-f71681c56884 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:29.445082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32de8aed-2d2d-4d48-9514-f71681c56884 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:29.446758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32de8aed-2d2d-4d48-9514-f71681c56884 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:29.447430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32de8aed-2d2d-4d48-9514-f71681c56884 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:29.448381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32de8aed-2d2d-4d48-9514-f71681c56884 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:29.521109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db3cadd2-73f5-4ad9-be5b-b5744d14a46c tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5559cf6-8834-4c82-80bc-48f005cd235a"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:29.525890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-db3cadd2-73f5-4ad9-be5b-b5744d14a46c tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:29.533247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3cadd2-73f5-4ad9-be5b-b5744d14a46c tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:29.533957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3cadd2-73f5-4ad9-be5b-b5744d14a46c tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:29.534543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3cadd2-73f5-4ad9-be5b-b5744d14a46c tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:29.535395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3cadd2-73f5-4ad9-be5b-b5744d14a46c tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:29.536015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3cadd2-73f5-4ad9-be5b-b5744d14a46c tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:29.536587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db3cadd2-73f5-4ad9-be5b-b5744d14a46c tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:29.829092 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.network.security_group_api [None req-32de8aed-2d2d-4d48-9514-f71681c56884 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Removing security group 7fde90df-4a0b-4418-9fa4-f3c65c0ca395 from port 9720d5e6-b71e-46dd-a1ca-700a06956155 Sep 10 21:05:30.071941 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-db3cadd2-73f5-4ad9-be5b-b5744d14a46c tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "POST /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555012 Sep 10 21:05:30.082273 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2059/4225] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:05:29 2022] POST /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-volume_attachments => generated 194 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:05:30.417485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:30.418273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] [instance: 5dee3a0f-33be-4437-8d46-8c0340b47350] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:30.437986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:30.439457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:30.442433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:30.443668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:30.454102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:30.454621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:30.495641 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] HTTP exception thrown: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Request method failure captured: Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 HTTP/1.1 Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPvyDF3c4jHxFpvVpckEzEgL7WCnSJHIRXPu3M23aH3KhqGPg6AoctvI_BAohsuNjecHnKun6LacaqGkCe_o73h773CfA_wiRz93jbACQprp0TvP5Hg52nvJgrmwJIf21V0aGmfgEuL9sQF5hB4NVQZTQmDb2sBkC3e8SzMq1rrTTIo Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a31cdf32235d44b1bbd691ebea38663b Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1857641689 Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a31cdf32235d44b1bbd691ebea38663b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a31cdf32235d44b1bbd691ebea38663b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a31cdf32235d44b1bbd691ebea38663b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a31cdf32235d44b1bbd691ebea38663b"}]}] Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1857641689 Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a31cdf32235d44b1bbd691ebea38663b Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1857641689 Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1857641689-project Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: b766ab7d168745a4bb8b07fb8e5df3ed Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1857641689-project Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5dee3a0f-33be-4437-8d46-8c0340b47350'} Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:30.498520 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:30.502263 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:30.502263 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:30.502263 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:30.502263 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:30.502263 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:30.502263 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:05:30.502263 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:05:30.502263 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. Sep 10 21:05:30.502263 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:30.502263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] Returning 404 to user: Instance 5dee3a0f-33be-4437-8d46-8c0340b47350 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:05:30.502962 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fb7a3246-9be4-49b9-8d8b-46ffca22f64f tempest-ServersNegativeTestMultiTenantJSON-1857641689 tempest-ServersNegativeTestMultiTenantJSON-1857641689-project] 10.222.0.33 "GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350" status: 404 len: 111 microversion: 2.1 time: 0.089742 Sep 10 21:05:30.504052 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2060/4226] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:30 2022] GET /compute/v2.1/servers/5dee3a0f-33be-4437-8d46-8c0340b47350 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:05:30.513559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-32b6b710-b3dd-4c73-9648-70354d3364fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:30.514222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-32b6b710-b3dd-4c73-9648-70354d3364fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:30.527530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32b6b710-b3dd-4c73-9648-70354d3364fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:30.528276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32b6b710-b3dd-4c73-9648-70354d3364fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:30.528876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32b6b710-b3dd-4c73-9648-70354d3364fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:30.529780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32b6b710-b3dd-4c73-9648-70354d3364fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:30.530495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32b6b710-b3dd-4c73-9648-70354d3364fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:30.531161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32b6b710-b3dd-4c73-9648-70354d3364fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:30.745342 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-32de8aed-2d2d-4d48-9514-f71681c56884 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "POST /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11/action" status: 202 len: 0 microversion: 2.1 time: 1.352879 Sep 10 21:05:30.752173 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2167/4227] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:05:29 2022] POST /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11/action => generated 0 bytes in 1360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:05:30.758917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2699c100-b4d6-4598-acbc-e9dcad094aef tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Action: 'create', calling method: .version_select at 0x7f9944ad8d30>, body: {"pool": null} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:31.134315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-32b6b710-b3dd-4c73-9648-70354d3364fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:31.144564 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-32b6b710-b3dd-4c73-9648-70354d3364fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 0.638803 Sep 10 21:05:31.149309 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2061/4228] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:30 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:31.173786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-32941212-b125-4581-8d5f-4a786e88f8d7 req-6b85af3e-c930-4b39-8938-a28f43c2235c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7791e1c9-0ea1-42b6-9732-f3088f9fee11", "tag": "9720d5e6-b71e-46dd-a1ca-700a06956155"}, {"name": "network-changed", "server_uuid": "7791e1c9-0ea1-42b6-9732-f3088f9fee11", "tag": "9720d5e6-b71e-46dd-a1ca-700a06956155"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:31.193330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-32941212-b125-4581-8d5f-4a786e88f8d7 req-6b85af3e-c930-4b39-8938-a28f43c2235c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:31.194136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-32941212-b125-4581-8d5f-4a786e88f8d7 req-6b85af3e-c930-4b39-8938-a28f43c2235c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:31.197272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-32941212-b125-4581-8d5f-4a786e88f8d7 req-6b85af3e-c930-4b39-8938-a28f43c2235c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:31.223400 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-32941212-b125-4581-8d5f-4a786e88f8d7 req-6b85af3e-c930-4b39-8938-a28f43c2235c service nova] Creating event network-changed:9720d5e6-b71e-46dd-a1ca-700a06956155 for instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 on nch1-master-1 Sep 10 21:05:31.223945 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-32941212-b125-4581-8d5f-4a786e88f8d7 req-6b85af3e-c930-4b39-8938-a28f43c2235c service nova] Creating event network-changed:9720d5e6-b71e-46dd-a1ca-700a06956155 for instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 on nch1-master-1 Sep 10 21:05:31.236798 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-32941212-b125-4581-8d5f-4a786e88f8d7 req-6b85af3e-c930-4b39-8938-a28f43c2235c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.067066 Sep 10 21:05:31.240872 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2062/4229] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:32.176550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-736c851c-2f62-4b8c-82c7-0473e19960a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:32.177261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-736c851c-2f62-4b8c-82c7-0473e19960a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:32.192197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-736c851c-2f62-4b8c-82c7-0473e19960a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:32.192672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-736c851c-2f62-4b8c-82c7-0473e19960a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:32.197776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-736c851c-2f62-4b8c-82c7-0473e19960a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:32.208720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-736c851c-2f62-4b8c-82c7-0473e19960a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:32.209544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-736c851c-2f62-4b8c-82c7-0473e19960a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:32.210225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-736c851c-2f62-4b8c-82c7-0473e19960a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:32.815980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-736c851c-2f62-4b8c-82c7-0473e19960a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:32.839642 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-736c851c-2f62-4b8c-82c7-0473e19960a3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 0.667285 Sep 10 21:05:32.856294 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2063/4230] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:32 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:33.869345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c39cd89d-2e89-41b5-be20-85768a66ad9e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:33.870849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c39cd89d-2e89-41b5-be20-85768a66ad9e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:33.882677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c39cd89d-2e89-41b5-be20-85768a66ad9e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:33.883889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c39cd89d-2e89-41b5-be20-85768a66ad9e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:33.889081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c39cd89d-2e89-41b5-be20-85768a66ad9e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:33.904766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c39cd89d-2e89-41b5-be20-85768a66ad9e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:33.905547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c39cd89d-2e89-41b5-be20-85768a66ad9e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:33.906231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c39cd89d-2e89-41b5-be20-85768a66ad9e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:34.894859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c39cd89d-2e89-41b5-be20-85768a66ad9e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:34.907516 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c39cd89d-2e89-41b5-be20-85768a66ad9e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 1.042969 Sep 10 21:05:34.922647 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2064/4231] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:33 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:35.151989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ed7eb6c-0e90-49f7-8c57-4079a77dd911 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:35.156346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0ed7eb6c-0e90-49f7-8c57-4079a77dd911 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:35.197188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ed7eb6c-0e90-49f7-8c57-4079a77dd911 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:35.199490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ed7eb6c-0e90-49f7-8c57-4079a77dd911 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:35.206614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ed7eb6c-0e90-49f7-8c57-4079a77dd911 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:35.212165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ed7eb6c-0e90-49f7-8c57-4079a77dd911 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:35.212868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ed7eb6c-0e90-49f7-8c57-4079a77dd911 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:35.213471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ed7eb6c-0e90-49f7-8c57-4079a77dd911 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:35.277197 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0ed7eb6c-0e90-49f7-8c57-4079a77dd911 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130701 Sep 10 21:05:35.278388 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2065/4232] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:05:35 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:35.292058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-431e36c8-e679-4c3a-8547-2c75df666a7a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:35.292859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-431e36c8-e679-4c3a-8547-2c75df666a7a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:35.300477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-431e36c8-e679-4c3a-8547-2c75df666a7a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:35.301208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-431e36c8-e679-4c3a-8547-2c75df666a7a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:35.302284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-431e36c8-e679-4c3a-8547-2c75df666a7a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:35.303186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-431e36c8-e679-4c3a-8547-2c75df666a7a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:35.305612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-431e36c8-e679-4c3a-8547-2c75df666a7a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:35.306544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-431e36c8-e679-4c3a-8547-2c75df666a7a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:35.497577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-431e36c8-e679-4c3a-8547-2c75df666a7a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lazy-loading 'services' on Instance uuid d690d87c-2883-4181-8552-01f2be84e93c {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:05:35.612249 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-431e36c8-e679-4c3a-8547-2c75df666a7a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-volume_attachments/d5559cf6-8834-4c82-80bc-48f005cd235a" status: 202 len: 0 microversion: 2.1 time: 0.325609 Sep 10 21:05:35.616035 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2066/4233] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 21:05:35 2022] DELETE /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-volume_attachments/d5559cf6-8834-4c82-80bc-48f005cd235a => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:05:35.937287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1fd82d5e-d958-4470-b2ec-ada8a0ce3aee tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:35.938050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1fd82d5e-d958-4470-b2ec-ada8a0ce3aee tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:35.959473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fd82d5e-d958-4470-b2ec-ada8a0ce3aee tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:35.959968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fd82d5e-d958-4470-b2ec-ada8a0ce3aee tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:35.960411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fd82d5e-d958-4470-b2ec-ada8a0ce3aee tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:35.962617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fd82d5e-d958-4470-b2ec-ada8a0ce3aee tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:35.963396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fd82d5e-d958-4470-b2ec-ada8a0ce3aee tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:35.980451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1fd82d5e-d958-4470-b2ec-ada8a0ce3aee tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:36.173235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1fd82d5e-d958-4470-b2ec-ada8a0ce3aee tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:36.186777 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1fd82d5e-d958-4470-b2ec-ada8a0ce3aee tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1522 microversion: 2.1 time: 0.253552 Sep 10 21:05:36.207070 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2067/4234] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:35 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:36.881757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f1fe563-736e-4e6d-ad1c-3f73cf818eb6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:36.894506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2f1fe563-736e-4e6d-ad1c-3f73cf818eb6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:36.921185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f1fe563-736e-4e6d-ad1c-3f73cf818eb6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:36.923161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f1fe563-736e-4e6d-ad1c-3f73cf818eb6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:36.924372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f1fe563-736e-4e6d-ad1c-3f73cf818eb6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:36.926312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f1fe563-736e-4e6d-ad1c-3f73cf818eb6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:36.931161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f1fe563-736e-4e6d-ad1c-3f73cf818eb6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:36.931872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f1fe563-736e-4e6d-ad1c-3f73cf818eb6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:37.035136 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f1fe563-736e-4e6d-ad1c-3f73cf818eb6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157306 Sep 10 21:05:37.041328 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2068/4235] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:05:36 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-volume_attachments => generated 25 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 21:05:37.134512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f9d9197-8728-4828-9046-27053d8e75fa tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:37.137533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2f9d9197-8728-4828-9046-27053d8e75fa tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:37.148718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9d9197-8728-4828-9046-27053d8e75fa tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:37.150758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9d9197-8728-4828-9046-27053d8e75fa tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:37.151359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9d9197-8728-4828-9046-27053d8e75fa tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:37.155988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9d9197-8728-4828-9046-27053d8e75fa tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:37.156682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9d9197-8728-4828-9046-27053d8e75fa tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:37.157278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f9d9197-8728-4828-9046-27053d8e75fa tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:37.238858 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f9d9197-8728-4828-9046-27053d8e75fa tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105908 Sep 10 21:05:37.239683 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2069/4236] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:05:37 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:05:37.249773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-86dff3f0-f8ac-42b0-9aa9-c05b6aed90ad tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:37.254597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-86dff3f0-f8ac-42b0-9aa9-c05b6aed90ad tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:37.270911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86dff3f0-f8ac-42b0-9aa9-c05b6aed90ad tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:37.271783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86dff3f0-f8ac-42b0-9aa9-c05b6aed90ad tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:37.274887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86dff3f0-f8ac-42b0-9aa9-c05b6aed90ad tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:37.275919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86dff3f0-f8ac-42b0-9aa9-c05b6aed90ad tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:37.276554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86dff3f0-f8ac-42b0-9aa9-c05b6aed90ad tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:37.277133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86dff3f0-f8ac-42b0-9aa9-c05b6aed90ad tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:37.280618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:37.809576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-86dff3f0-f8ac-42b0-9aa9-c05b6aed90ad tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:37.825470 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-86dff3f0-f8ac-42b0-9aa9-c05b6aed90ad tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1504 microversion: 2.1 time: 0.584070 Sep 10 21:05:37.826923 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2070/4237] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:37 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1504 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:37.842751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6dcb8571-e04b-40e3-b152-ee3e7552d792 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:37.843656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6dcb8571-e04b-40e3-b152-ee3e7552d792 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:37.869394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcb8571-e04b-40e3-b152-ee3e7552d792 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:37.870421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcb8571-e04b-40e3-b152-ee3e7552d792 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:37.871114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcb8571-e04b-40e3-b152-ee3e7552d792 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:37.872119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcb8571-e04b-40e3-b152-ee3e7552d792 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:37.872821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcb8571-e04b-40e3-b152-ee3e7552d792 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:37.875378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcb8571-e04b-40e3-b152-ee3e7552d792 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:37.936998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6dcb8571-e04b-40e3-b152-ee3e7552d792 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:05:38.127800 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6dcb8571-e04b-40e3-b152-ee3e7552d792 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 204 len: 0 microversion: 2.1 time: 0.297528 Sep 10 21:05:38.131681 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2071/4238] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:05:37 2022] DELETE /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:05:38.139401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bb1afd9d-94c8-4480-b91c-0bea1c4171b6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:38.140230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bb1afd9d-94c8-4480-b91c-0bea1c4171b6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:38.154800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1afd9d-94c8-4480-b91c-0bea1c4171b6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:38.155425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1afd9d-94c8-4480-b91c-0bea1c4171b6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:38.155957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1afd9d-94c8-4480-b91c-0bea1c4171b6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:38.156896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1afd9d-94c8-4480-b91c-0bea1c4171b6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:38.158451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1afd9d-94c8-4480-b91c-0bea1c4171b6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:38.158999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1afd9d-94c8-4480-b91c-0bea1c4171b6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:38.187805 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2699c100-b4d6-4598-acbc-e9dcad094aef tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.434124 Sep 10 21:05:38.189079 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2168/4239] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 21:05:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:38.205358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.165"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:38.217254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:38.225877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:38.227781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:38.228781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:38.229852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:38.230479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:38.230983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:38.259648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "refresh_cache-7791e1c9-0ea1-42b6-9732-f3088f9fee11" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 21:05:38.260373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquired lock "refresh_cache-7791e1c9-0ea1-42b6-9732-f3088f9fee11" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 21:05:39.012870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bb1afd9d-94c8-4480-b91c-0bea1c4171b6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:39.033002 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bb1afd9d-94c8-4480-b91c-0bea1c4171b6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1680 microversion: 2.1 time: 0.899792 Sep 10 21:05:39.035003 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2072/4240] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:38 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1680 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:39.040949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bf4eebe8-11fa-4768-859f-9016818ad10b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:39.042472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bf4eebe8-11fa-4768-859f-9016818ad10b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:39.058100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf4eebe8-11fa-4768-859f-9016818ad10b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:39.059605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf4eebe8-11fa-4768-859f-9016818ad10b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:39.060365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf4eebe8-11fa-4768-859f-9016818ad10b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:39.061874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf4eebe8-11fa-4768-859f-9016818ad10b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:39.064688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf4eebe8-11fa-4768-859f-9016818ad10b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:39.065541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf4eebe8-11fa-4768-859f-9016818ad10b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:39.379437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bf4eebe8-11fa-4768-859f-9016818ad10b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:39.393938 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bf4eebe8-11fa-4768-859f-9016818ad10b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1504 microversion: 2.1 time: 0.356627 Sep 10 21:05:39.395098 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2073/4241] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:39 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:40.059756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e7166e6-8f36-4018-9c61-7bfdf9c9d25d tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:40.060521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e7166e6-8f36-4018-9c61-7bfdf9c9d25d tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:40.072625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e7166e6-8f36-4018-9c61-7bfdf9c9d25d tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:40.073689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e7166e6-8f36-4018-9c61-7bfdf9c9d25d tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:40.074421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e7166e6-8f36-4018-9c61-7bfdf9c9d25d tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:40.076114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e7166e6-8f36-4018-9c61-7bfdf9c9d25d tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:40.077104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e7166e6-8f36-4018-9c61-7bfdf9c9d25d tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:40.078036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e7166e6-8f36-4018-9c61-7bfdf9c9d25d tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:40.351345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e7166e6-8f36-4018-9c61-7bfdf9c9d25d tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:40.366643 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e7166e6-8f36-4018-9c61-7bfdf9c9d25d tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1680 microversion: 2.1 time: 0.310859 Sep 10 21:05:40.367577 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2074/4242] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:40 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1680 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:40.422907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4da4f8b8-3099-4b07-bb5e-e64c94584f97 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:40.424540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4da4f8b8-3099-4b07-bb5e-e64c94584f97 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:40.433735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da4f8b8-3099-4b07-bb5e-e64c94584f97 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:40.434747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da4f8b8-3099-4b07-bb5e-e64c94584f97 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:40.435401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da4f8b8-3099-4b07-bb5e-e64c94584f97 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:40.436576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da4f8b8-3099-4b07-bb5e-e64c94584f97 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:40.437400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da4f8b8-3099-4b07-bb5e-e64c94584f97 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:40.438150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da4f8b8-3099-4b07-bb5e-e64c94584f97 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:40.778482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4da4f8b8-3099-4b07-bb5e-e64c94584f97 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:40.795507 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4da4f8b8-3099-4b07-bb5e-e64c94584f97 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1504 microversion: 2.1 time: 0.377399 Sep 10 21:05:40.796150 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2075/4243] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:40 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:40.826217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-68a578f2-6b79-4f06-b09b-accad71fa68b req-9aa7bfdf-265d-4eb4-8cf4-5aafd2e19837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73", "name": "network-vif-unplugged", "status": "completed", "tag": "b1b3e948-57a8-4218-844e-44d056f25995"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:40.839702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-68a578f2-6b79-4f06-b09b-accad71fa68b req-9aa7bfdf-265d-4eb4-8cf4-5aafd2e19837 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:40.840229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-68a578f2-6b79-4f06-b09b-accad71fa68b req-9aa7bfdf-265d-4eb4-8cf4-5aafd2e19837 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:40.840858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-68a578f2-6b79-4f06-b09b-accad71fa68b req-9aa7bfdf-265d-4eb4-8cf4-5aafd2e19837 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:40.855106 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-68a578f2-6b79-4f06-b09b-accad71fa68b req-9aa7bfdf-265d-4eb4-8cf4-5aafd2e19837 service nova] Creating event network-vif-unplugged:b1b3e948-57a8-4218-844e-44d056f25995 for instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 on nch2-master-1 Sep 10 21:05:40.869404 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-68a578f2-6b79-4f06-b09b-accad71fa68b req-9aa7bfdf-265d-4eb4-8cf4-5aafd2e19837 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051574 Sep 10 21:05:40.870619 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2076/4244] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:41.393453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-88bc68d9-f880-48a8-8d97-771dfebe0a9a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:41.394753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-88bc68d9-f880-48a8-8d97-771dfebe0a9a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:41.419148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88bc68d9-f880-48a8-8d97-771dfebe0a9a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:41.419519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88bc68d9-f880-48a8-8d97-771dfebe0a9a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:41.426464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88bc68d9-f880-48a8-8d97-771dfebe0a9a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:41.427279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88bc68d9-f880-48a8-8d97-771dfebe0a9a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:41.428088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88bc68d9-f880-48a8-8d97-771dfebe0a9a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:41.430140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88bc68d9-f880-48a8-8d97-771dfebe0a9a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:41.985869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-88bc68d9-f880-48a8-8d97-771dfebe0a9a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96372af27d29482491d613b5a783a0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da09fdc751e406f9c3bad4bf0e1b067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:41.997727 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-88bc68d9-f880-48a8-8d97-771dfebe0a9a tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 200 len: 1680 microversion: 2.1 time: 0.609601 Sep 10 21:05:42.007151 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2077/4245] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:41 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 1680 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:05:42.012151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d655b5f0-5a93-4e88-b467-e8d6c14a8723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:42.012782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d655b5f0-5a93-4e88-b467-e8d6c14a8723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:42.037672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d655b5f0-5a93-4e88-b467-e8d6c14a8723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:42.038367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d655b5f0-5a93-4e88-b467-e8d6c14a8723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:42.038968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d655b5f0-5a93-4e88-b467-e8d6c14a8723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:42.040585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d655b5f0-5a93-4e88-b467-e8d6c14a8723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:42.045189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d655b5f0-5a93-4e88-b467-e8d6c14a8723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:42.045861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d655b5f0-5a93-4e88-b467-e8d6c14a8723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:42.470782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d655b5f0-5a93-4e88-b467-e8d6c14a8723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:42.484362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Building network info cache for instance {{(pid=145772) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 21:05:42.491064 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d655b5f0-5a93-4e88-b467-e8d6c14a8723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 200 len: 1507 microversion: 2.1 time: 0.482707 Sep 10 21:05:42.493187 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2078/4246] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:42 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:42.519953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:42.520865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:42.529042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:42.529716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:42.530552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:42.531719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:42.532510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:42.533386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:42.574508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:05:42.590198 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.compute.api [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Working on deleting snapshot 84d1356d-54df-49b0-9189-3ae55220405c from shelved instance... Sep 10 21:05:44.142658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:44.146095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Doing local delete in cell 2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) {{(pid=145771) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 10 21:05:44.147133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:44.147913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:44.149235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:44.150453 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.compute.api [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 10 21:05:44.159185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] deallocate_for_instance() {{(pid=145771) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 10 21:05:44.881980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Updating instance_info_cache with network_info: [{"id": "9720d5e6-b71e-46dd-a1ca-700a06956155", "address": "fa:16:3e:e7:cc:18", "network": {"id": "18913022-e91e-4b19-b334-3a8712f3ce66", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1450224242-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e9df0b572a1844bda38471874d2afe92", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9720d5e6-b7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=145772) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 21:05:44.913267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Releasing lock "refresh_cache-7791e1c9-0ea1-42b6-9732-f3088f9fee11" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 21:05:44.914674 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-147e9553-eb7d-4991-a071-d730d1f9db1b tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "POST /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11/action" status: 202 len: 0 microversion: 2.1 time: 6.716144 Sep 10 21:05:44.916727 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2169/4247] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:05:38 2022] POST /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11/action => generated 0 bytes in 6719 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 21:05:44.921738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4066fe2b-4833-4f60-be7e-35340b47c4d8 req-476efd67-79f9-4c25-9abe-c9a2eacb85b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7791e1c9-0ea1-42b6-9732-f3088f9fee11", "tag": "9720d5e6-b71e-46dd-a1ca-700a06956155"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:44.944998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4066fe2b-4833-4f60-be7e-35340b47c4d8 req-476efd67-79f9-4c25-9abe-c9a2eacb85b7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:44.947998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4066fe2b-4833-4f60-be7e-35340b47c4d8 req-476efd67-79f9-4c25-9abe-c9a2eacb85b7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:44.948473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4066fe2b-4833-4f60-be7e-35340b47c4d8 req-476efd67-79f9-4c25-9abe-c9a2eacb85b7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:45.002626 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4066fe2b-4833-4f60-be7e-35340b47c4d8 req-476efd67-79f9-4c25-9abe-c9a2eacb85b7 service nova] Creating event network-changed:9720d5e6-b71e-46dd-a1ca-700a06956155 for instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 on nch1-master-1 Sep 10 21:05:45.010827 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4066fe2b-4833-4f60-be7e-35340b47c4d8 req-476efd67-79f9-4c25-9abe-c9a2eacb85b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092677 Sep 10 21:05:45.011464 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2170/4248] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:45.020858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:45.025946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:45.040822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:45.045155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:45.045845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:45.046735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:45.047341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:45.049534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:45.079233 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] HTTP exception thrown: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Request method failure captured: Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c HTTP/1.1 Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtwse8HS_-zYwzw-yrCLzw2H2AdH5CM067YpOhC2lUE4MYSCmnPPa514xXfYHJvlZYQKoGBRJOKDoqpDvvrtc8d7k0HycL0ggh7mrKt8FANafIahnpiMHQVpWwcmWE9d0QjavLl3NwsA0leSwVB8pA2DNoL9d39yRqY1ufNjlKddkA Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 1da09fdc751e406f9c3bad4bf0e1b067 Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-17434564 Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1da09fdc751e406f9c3bad4bf0e1b067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1da09fdc751e406f9c3bad4bf0e1b067"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1da09fdc751e406f9c3bad4bf0e1b067", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1da09fdc751e406f9c3bad4bf0e1b067"}]}] Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-17434564 Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 1da09fdc751e406f9c3bad4bf0e1b067 Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-17434564 Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachSCSIVolumeTestJSON-17434564-project Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 96372af27d29482491d613b5a783a0d1 Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-17434564-project Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'd690d87c-2883-4181-8552-01f2be84e93c'} Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:45.091333 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:45.094705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:45.094705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:45.094705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:45.094705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:05:45.094705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:05:45.094705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:45.094705 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:45.096558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Returning 404 to user: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:05:45.098400 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-906a28f5-7d95-4854-ae15-4aed96531ea6 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 404 len: 111 microversion: 2.1 time: 0.085583 Sep 10 21:05:45.099179 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2171/4249] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:45 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:05:45.106310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.165"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:45.419851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:45.442529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:45.444692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:45.446149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:45.447107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:45.448687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:45.449930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:46.033162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "refresh_cache-7791e1c9-0ea1-42b6-9732-f3088f9fee11" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 21:05:46.034407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquired lock "refresh_cache-7791e1c9-0ea1-42b6-9732-f3088f9fee11" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 21:05:46.328657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Updating instance_info_cache with network_info: [] {{(pid=145771) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 21:05:47.009884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=16,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:47.022729 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-96c1222e-4d8f-4f88-b5ec-d623f6ca3723 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 204 len: 0 microversion: 2.1 time: 4.507960 Sep 10 21:05:47.027502 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2079/4250] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:05:42 2022] DELETE /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 0 bytes in 4510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:05:47.033701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c141752e-e08c-4f45-947e-704532249d89 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '.version_select at 0x7f9944259790>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:47.063613 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c141752e-e08c-4f45-947e-704532249d89 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-108942855" status: 202 len: 0 microversion: 2.1 time: 0.034920 Sep 10 21:05:47.064540 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2080/4251] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 21:05:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-108942855 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:05:47.072188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b2c06186-ddbd-44bf-97bb-b309d46fc959 req-c49facc2-7041-4e2c-8310-b49fccae7f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73", "name": "network-vif-deleted", "tag": "b1b3e948-57a8-4218-844e-44d056f25995"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:47.094488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b2c06186-ddbd-44bf-97bb-b309d46fc959 req-c49facc2-7041-4e2c-8310-b49fccae7f71 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:47.095361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b2c06186-ddbd-44bf-97bb-b309d46fc959 req-c49facc2-7041-4e2c-8310-b49fccae7f71 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:47.096042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b2c06186-ddbd-44bf-97bb-b309d46fc959 req-c49facc2-7041-4e2c-8310-b49fccae7f71 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:47.115073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.compute.server_external_events [req-b2c06186-ddbd-44bf-97bb-b309d46fc959 req-c49facc2-7041-4e2c-8310-b49fccae7f71 service nova] Unable to find a host for instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73. Dropping event network-vif-deleted {{(pid=145771) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 21:05:47.116490 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b2c06186-ddbd-44bf-97bb-b309d46fc959 req-c49facc2-7041-4e2c-8310-b49fccae7f71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.050985 Sep 10 21:05:47.118522 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2081/4252] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 21:05:47.126480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:47.128069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:47.137609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:47.139319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:47.139962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:47.140881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:47.141740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:47.142433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:47.165839 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 HTTP/1.1 Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73'} Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:47.167621 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:47.172225 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:47.172225 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:47.172225 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:47.172225 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:05:47.172225 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:05:47.172225 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:05:47.172225 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:47.172225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:05:47.173372 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-50c73f14-73e0-49e1-b390-1c636b360683 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 404 len: 111 microversion: 2.1 time: 0.051013 Sep 10 21:05:47.174116 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2082/4253] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:47 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:05:47.194708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-fdc21a2c-e4cd-45d8-836f-2296120c4222 req-56c7d412-59c5-4df2-8af5-25330fab2c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d690d87c-2883-4181-8552-01f2be84e93c", "name": "network-vif-deleted", "tag": "c9e1a782-f90c-4541-ba9a-c993f5ef1b41"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:47.211718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fdc21a2c-e4cd-45d8-836f-2296120c4222 req-56c7d412-59c5-4df2-8af5-25330fab2c8a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:47.212685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fdc21a2c-e4cd-45d8-836f-2296120c4222 req-56c7d412-59c5-4df2-8af5-25330fab2c8a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:47.213347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fdc21a2c-e4cd-45d8-836f-2296120c4222 req-56c7d412-59c5-4df2-8af5-25330fab2c8a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:47.228426 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-fdc21a2c-e4cd-45d8-836f-2296120c4222 req-56c7d412-59c5-4df2-8af5-25330fab2c8a service nova] Creating event network-vif-deleted:c9e1a782-f90c-4541-ba9a-c993f5ef1b41 for instance d690d87c-2883-4181-8552-01f2be84e93c on nch1-master-1 Sep 10 21:05:47.235155 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-fdc21a2c-e4cd-45d8-836f-2296120c4222 req-56c7d412-59c5-4df2-8af5-25330fab2c8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044532 Sep 10 21:05:47.236487 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2083/4254] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:47.401268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1005115918", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f5a2cd59-1be7-47bd-82a5-e6307d510b6e"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:47.518676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] validate_networks() for [('f5a2cd59-1be7-47bd-82a5-e6307d510b6e', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:05:47.931078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Building network info cache for instance {{(pid=145772) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 21:05:48.790556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:05:48.791727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:05:48.792350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:05:48.792914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:05:48.793496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:05:48.813652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:48.814202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:48.814641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:48.815372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:48.815825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:48.816247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:48.908608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:05:48.941293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for user 4faa458c158141efaf707317411cd544 and project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:05:48.959173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:05:48.965158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:05:49.096134 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55f2f9df-70dc-4085-802f-fdede0d0c461 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.701122 Sep 10 21:05:49.101124 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2084/4255] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:05:49.112355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8425017-d570-4c66-9953-895ebc5b3f41 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:49.116287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8425017-d570-4c66-9953-895ebc5b3f41 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:49.376716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8425017-d570-4c66-9953-895ebc5b3f41 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:49.390239 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8425017-d570-4c66-9953-895ebc5b3f41 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1215 microversion: 2.1 time: 0.282021 Sep 10 21:05:49.391169 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2085/4256] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:49 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1215 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:49.395998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-dc1f103e-b597-4866-ac5f-e6e6034b49b1 req-69f02b21-aeec-48f2-b098-4219b21c060a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7791e1c9-0ea1-42b6-9732-f3088f9fee11", "tag": "9720d5e6-b71e-46dd-a1ca-700a06956155"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:49.458796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dc1f103e-b597-4866-ac5f-e6e6034b49b1 req-69f02b21-aeec-48f2-b098-4219b21c060a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:49.459420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dc1f103e-b597-4866-ac5f-e6e6034b49b1 req-69f02b21-aeec-48f2-b098-4219b21c060a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:49.461605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dc1f103e-b597-4866-ac5f-e6e6034b49b1 req-69f02b21-aeec-48f2-b098-4219b21c060a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:49.491950 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-dc1f103e-b597-4866-ac5f-e6e6034b49b1 req-69f02b21-aeec-48f2-b098-4219b21c060a service nova] Creating event network-changed:9720d5e6-b71e-46dd-a1ca-700a06956155 for instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 on nch1-master-1 Sep 10 21:05:49.511095 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-dc1f103e-b597-4866-ac5f-e6e6034b49b1 req-69f02b21-aeec-48f2-b098-4219b21c060a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118306 Sep 10 21:05:49.511713 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2086/4257] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:49.984580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Updating instance_info_cache with network_info: [{"id": "9720d5e6-b71e-46dd-a1ca-700a06956155", "address": "fa:16:3e:e7:cc:18", "network": {"id": "18913022-e91e-4b19-b334-3a8712f3ce66", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1450224242-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e9df0b572a1844bda38471874d2afe92", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9720d5e6-b7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=145772) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 21:05:50.001928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Releasing lock "refresh_cache-7791e1c9-0ea1-42b6-9732-f3088f9fee11" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 21:05:50.004535 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c4177409-8cc5-4b1a-8e3f-a96cf4163dab tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "POST /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11/action" status: 202 len: 0 microversion: 2.1 time: 4.903397 Sep 10 21:05:50.008468 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2172/4258] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:05:45 2022] POST /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11/action => generated 0 bytes in 4908 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 21:05:50.015999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-af7b7a96-876c-40e4-9952-1b2ea21d92ed tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '.version_select at 0x7f993fa64280>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:50.417293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-252de2c3-61c8-4423-9fde-ea1222805715 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:50.418104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-252de2c3-61c8-4423-9fde-ea1222805715 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:50.420668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=38 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:50.437430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-252de2c3-61c8-4423-9fde-ea1222805715 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:50.441816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-252de2c3-61c8-4423-9fde-ea1222805715 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:50.443676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-252de2c3-61c8-4423-9fde-ea1222805715 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:50.447261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-252de2c3-61c8-4423-9fde-ea1222805715 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:50.450221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-252de2c3-61c8-4423-9fde-ea1222805715 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:50.453140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-252de2c3-61c8-4423-9fde-ea1222805715 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:50.775498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-252de2c3-61c8-4423-9fde-ea1222805715 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:50.794354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-252de2c3-61c8-4423-9fde-ea1222805715 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1211 microversion: 2.1 time: 0.373018 Sep 10 21:05:50.795365 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2173/4259] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:50 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1211 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:52.196734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c0570d7b-c58a-4b90-95cb-b05af8b1613e tempest-ExtensionsTest-924110414 tempest-ExtensionsTest-924110414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:52.200222 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-af7b7a96-876c-40e4-9952-1b2ea21d92ed tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/9bdc93cb-aa2a-4c7d-af4a-ba84be769261" status: 202 len: 0 microversion: 2.1 time: 2.188740 Sep 10 21:05:52.200814 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2087/4260] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 21:05:50 2022] DELETE /compute/v2.1/os-floating-ips/9bdc93cb-aa2a-4c7d-af4a-ba84be769261 => generated 0 bytes in 2190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:05:52.207937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aaf4ff72-6767-45ac-82d7-579de9856ded tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:52.208820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aaf4ff72-6767-45ac-82d7-579de9856ded tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:52.210499 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c0570d7b-c58a-4b90-95cb-b05af8b1613e tempest-ExtensionsTest-924110414 tempest-ExtensionsTest-924110414-project] 10.222.0.33 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.489707 Sep 10 21:05:52.211773 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2174/4261] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Sep 10 21:05:51 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:52.233312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7e61e89-3c02-49ac-9be0-8d29acf85fa4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '.version_select at 0x7f99440959d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:52.244412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaf4ff72-6767-45ac-82d7-579de9856ded tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:52.245360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaf4ff72-6767-45ac-82d7-579de9856ded tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:52.246050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaf4ff72-6767-45ac-82d7-579de9856ded tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:52.248009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaf4ff72-6767-45ac-82d7-579de9856ded tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:52.249987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaf4ff72-6767-45ac-82d7-579de9856ded tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:52.250745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaf4ff72-6767-45ac-82d7-579de9856ded tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:52.344444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aaf4ff72-6767-45ac-82d7-579de9856ded tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:52.355871 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aaf4ff72-6767-45ac-82d7-579de9856ded tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1273 microversion: 2.1 time: 0.153800 Sep 10 21:05:52.356769 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2088/4262] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:52 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:52.371455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2b441852-ea7a-4397-a6b6-64f15ec56a79 tempest-ExtensionsTest-924110414 tempest-ExtensionsTest-924110414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:52.380169 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2b441852-ea7a-4397-a6b6-64f15ec56a79 tempest-ExtensionsTest-924110414 tempest-ExtensionsTest-924110414-project] 10.222.0.33 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.022320 Sep 10 21:05:52.396659 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2089/4263] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Sep 10 21:05:52 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:05:53.392679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ffe2fc5-62cf-4fb8-94f9-d2175cb24335 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:53.395746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7ffe2fc5-62cf-4fb8-94f9-d2175cb24335 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:53.415640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ffe2fc5-62cf-4fb8-94f9-d2175cb24335 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:53.416650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ffe2fc5-62cf-4fb8-94f9-d2175cb24335 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:53.417272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ffe2fc5-62cf-4fb8-94f9-d2175cb24335 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:53.420031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ffe2fc5-62cf-4fb8-94f9-d2175cb24335 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:53.420507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ffe2fc5-62cf-4fb8-94f9-d2175cb24335 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:53.422115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ffe2fc5-62cf-4fb8-94f9-d2175cb24335 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:53.574980 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f7e61e89-3c02-49ac-9be0-8d29acf85fa4 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/7fde90df-4a0b-4418-9fa4-f3c65c0ca395" status: 202 len: 0 microversion: 2.1 time: 1.362032 Sep 10 21:05:53.578543 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2175/4264] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:05:52 2022] DELETE /compute/v2.1/os-security-groups/7fde90df-4a0b-4418-9fa4-f3c65c0ca395 => generated 0 bytes in 1363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:05:53.585392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-859d4949-b77e-4d0c-806a-e2fcc170746a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:53.585968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-859d4949-b77e-4d0c-806a-e2fcc170746a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:53.597815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-859d4949-b77e-4d0c-806a-e2fcc170746a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:53.598354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-859d4949-b77e-4d0c-806a-e2fcc170746a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:53.601197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-859d4949-b77e-4d0c-806a-e2fcc170746a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:53.602548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-859d4949-b77e-4d0c-806a-e2fcc170746a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:53.603092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-859d4949-b77e-4d0c-806a-e2fcc170746a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:53.603680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-859d4949-b77e-4d0c-806a-e2fcc170746a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:53.713992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-859d4949-b77e-4d0c-806a-e2fcc170746a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:05:53.869619 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-859d4949-b77e-4d0c-806a-e2fcc170746a tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 204 len: 0 microversion: 2.1 time: 0.288849 Sep 10 21:05:53.873951 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2176/4265] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:05:53 2022] DELETE /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:05:53.888102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:53.889978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:53.897111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:53.898015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:53.899514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:53.900532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:53.901252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:53.902080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:53.920124 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] HTTP exception thrown: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Request method failure captured: Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c HTTP/1.1 Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtwse8HS_-zYwzw-yrCLzw2H2AdH5CM067YpOhC2lUE4MYSCmnPPa514xXfYHJvlZYQKoGBRJOKDoqpDvvrtc8d7k0HycL0ggh7mrKt8FANafIahnpiMHQVpWwcmWE9d0QjavLl3NwsA0leSwVB8pA2DNoL9d39yRqY1ufNjlKddkA Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 1da09fdc751e406f9c3bad4bf0e1b067 Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-17434564 Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1da09fdc751e406f9c3bad4bf0e1b067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1da09fdc751e406f9c3bad4bf0e1b067"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1da09fdc751e406f9c3bad4bf0e1b067", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1da09fdc751e406f9c3bad4bf0e1b067"}]}] Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-17434564 Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 1da09fdc751e406f9c3bad4bf0e1b067 Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-17434564 Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachSCSIVolumeTestJSON-17434564-project Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 96372af27d29482491d613b5a783a0d1 Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-17434564-project Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'd690d87c-2883-4181-8552-01f2be84e93c'} Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:05:53.923669 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Returning 404 to user: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:05:53.927344 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-44fd4321-d923-4baf-b86c-f2d97e7fdbc4 tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 404 len: 111 microversion: 2.1 time: 0.049721 Sep 10 21:05:53.930848 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2177/4266] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:05:53 2022] DELETE /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:05:53.939981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6923a00e-ff6c-4883-863a-319e832bfe9f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:53.940614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6923a00e-ff6c-4883-863a-319e832bfe9f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:53.948941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6923a00e-ff6c-4883-863a-319e832bfe9f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:53.949677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6923a00e-ff6c-4883-863a-319e832bfe9f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:53.950337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6923a00e-ff6c-4883-863a-319e832bfe9f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:53.951881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6923a00e-ff6c-4883-863a-319e832bfe9f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:53.952751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6923a00e-ff6c-4883-863a-319e832bfe9f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:53.953380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6923a00e-ff6c-4883-863a-319e832bfe9f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:54.034823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7ffe2fc5-62cf-4fb8-94f9-d2175cb24335 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:54.044057 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ffe2fc5-62cf-4fb8-94f9-d2175cb24335 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1315 microversion: 2.1 time: 0.664563 Sep 10 21:05:54.044981 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2090/4267] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:53 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:54.063553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:54.064159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] [instance: d690d87c-2883-4181-8552-01f2be84e93c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:54.077449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:54.077988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:54.078437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:54.079159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:54.080350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:54.080350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:54.119256 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] HTTP exception thrown: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Request method failure captured: Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c HTTP/1.1 Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtwse8HS_-zYwzw-yrCLzw2H2AdH5CM067YpOhC2lUE4MYSCmnPPa514xXfYHJvlZYQKoGBRJOKDoqpDvvrtc8d7k0HycL0ggh7mrKt8FANafIahnpiMHQVpWwcmWE9d0QjavLl3NwsA0leSwVB8pA2DNoL9d39yRqY1ufNjlKddkA Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 1da09fdc751e406f9c3bad4bf0e1b067 Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-17434564 Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1da09fdc751e406f9c3bad4bf0e1b067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1da09fdc751e406f9c3bad4bf0e1b067"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1da09fdc751e406f9c3bad4bf0e1b067", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1da09fdc751e406f9c3bad4bf0e1b067"}]}] Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-17434564 Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 1da09fdc751e406f9c3bad4bf0e1b067 Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-17434564 Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachSCSIVolumeTestJSON-17434564-project Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 96372af27d29482491d613b5a783a0d1 Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-17434564-project Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'd690d87c-2883-4181-8552-01f2be84e93c'} Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:54.120978 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:54.124566 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:54.124566 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:54.124566 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:54.124566 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:05:54.124566 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:05:54.124566 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. Sep 10 21:05:54.124566 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:05:54.124566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] Returning 404 to user: Instance d690d87c-2883-4181-8552-01f2be84e93c could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:05:54.124566 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-efa95966-1246-4e28-80a5-eea9f9df3ace tempest-AttachSCSIVolumeTestJSON-17434564 tempest-AttachSCSIVolumeTestJSON-17434564-project] 10.222.0.33 "GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c" status: 404 len: 111 microversion: 2.1 time: 0.077246 Sep 10 21:05:54.124566 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2091/4268] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:54 2022] GET /compute/v2.1/servers/d690d87c-2883-4181-8552-01f2be84e93c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:05:54.318773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6923a00e-ff6c-4883-863a-319e832bfe9f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:54.329306 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6923a00e-ff6c-4883-863a-319e832bfe9f tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1510 microversion: 2.1 time: 0.394296 Sep 10 21:05:54.329960 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2178/4269] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:53 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1510 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:55.068415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8c417fbc-6c4e-4167-8e10-f28605b8008e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:55.069895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8c417fbc-6c4e-4167-8e10-f28605b8008e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:55.082699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c417fbc-6c4e-4167-8e10-f28605b8008e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:55.083728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c417fbc-6c4e-4167-8e10-f28605b8008e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:55.088633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c417fbc-6c4e-4167-8e10-f28605b8008e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:55.090180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c417fbc-6c4e-4167-8e10-f28605b8008e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:55.091799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c417fbc-6c4e-4167-8e10-f28605b8008e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:55.096473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c417fbc-6c4e-4167-8e10-f28605b8008e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:55.232922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0ecd8630-ee5f-407a-a890-02b36e1fce3c req-00bddef4-b5ad-4de4-b67d-708f7e16cff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cfef807-88b4-4765-8d02-4091096a419b", "tag": "6a633460-edd7-47d1-b6ee-d2080b5ea02c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:55.260834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0ecd8630-ee5f-407a-a890-02b36e1fce3c req-00bddef4-b5ad-4de4-b67d-708f7e16cff3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:55.261320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0ecd8630-ee5f-407a-a890-02b36e1fce3c req-00bddef4-b5ad-4de4-b67d-708f7e16cff3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:55.261753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0ecd8630-ee5f-407a-a890-02b36e1fce3c req-00bddef4-b5ad-4de4-b67d-708f7e16cff3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:55.282735 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0ecd8630-ee5f-407a-a890-02b36e1fce3c req-00bddef4-b5ad-4de4-b67d-708f7e16cff3 service nova] Creating event network-changed:6a633460-edd7-47d1-b6ee-d2080b5ea02c for instance 1cfef807-88b4-4765-8d02-4091096a419b on nch2-master-1 Sep 10 21:05:55.289381 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0ecd8630-ee5f-407a-a890-02b36e1fce3c req-00bddef4-b5ad-4de4-b67d-708f7e16cff3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060353 Sep 10 21:05:55.290572 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2179/4270] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:05:55.363029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e06c5d0-7df7-468e-8e55-0986d02b4876 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:55.363999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e06c5d0-7df7-468e-8e55-0986d02b4876 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:55.372513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e06c5d0-7df7-468e-8e55-0986d02b4876 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:55.373237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e06c5d0-7df7-468e-8e55-0986d02b4876 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:55.373981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e06c5d0-7df7-468e-8e55-0986d02b4876 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:55.375126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e06c5d0-7df7-468e-8e55-0986d02b4876 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:55.375764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e06c5d0-7df7-468e-8e55-0986d02b4876 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:55.376993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e06c5d0-7df7-468e-8e55-0986d02b4876 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:55.809704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8c417fbc-6c4e-4167-8e10-f28605b8008e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:55.839057 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8c417fbc-6c4e-4167-8e10-f28605b8008e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1315 microversion: 2.1 time: 0.774799 Sep 10 21:05:55.843746 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2092/4271] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:55 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:56.088997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e06c5d0-7df7-468e-8e55-0986d02b4876 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:56.091848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=80,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:56.099637 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e06c5d0-7df7-468e-8e55-0986d02b4876 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1510 microversion: 2.1 time: 0.747963 Sep 10 21:05:56.115313 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2180/4272] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:55 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1510 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:56.869012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cbf2a425-dcf2-4720-b28a-84fa89810d06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:56.870719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cbf2a425-dcf2-4720-b28a-84fa89810d06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:56.878765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbf2a425-dcf2-4720-b28a-84fa89810d06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:56.879598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbf2a425-dcf2-4720-b28a-84fa89810d06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:56.880273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbf2a425-dcf2-4720-b28a-84fa89810d06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:56.881207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbf2a425-dcf2-4720-b28a-84fa89810d06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:56.881897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbf2a425-dcf2-4720-b28a-84fa89810d06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:56.883300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cbf2a425-dcf2-4720-b28a-84fa89810d06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:57.126555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-69034c20-2fbd-45df-a824-5b51029d0da6 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:57.127211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-69034c20-2fbd-45df-a824-5b51029d0da6 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:57.136261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69034c20-2fbd-45df-a824-5b51029d0da6 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:57.136759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69034c20-2fbd-45df-a824-5b51029d0da6 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:57.137198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69034c20-2fbd-45df-a824-5b51029d0da6 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:57.145911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69034c20-2fbd-45df-a824-5b51029d0da6 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:57.146902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69034c20-2fbd-45df-a824-5b51029d0da6 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:57.147574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69034c20-2fbd-45df-a824-5b51029d0da6 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:57.648885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cbf2a425-dcf2-4720-b28a-84fa89810d06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:57.657946 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cbf2a425-dcf2-4720-b28a-84fa89810d06 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1315 microversion: 2.1 time: 0.793815 Sep 10 21:05:57.659167 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2093/4273] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:56 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:57.773291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-58ce2626-e49d-4dce-a15d-f91c4e4b325e req-667e8cd1-6015-40b2-8ad1-211f1c756ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7791e1c9-0ea1-42b6-9732-f3088f9fee11", "name": "network-vif-deleted", "tag": "9720d5e6-b71e-46dd-a1ca-700a06956155"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:05:57.786091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-58ce2626-e49d-4dce-a15d-f91c4e4b325e req-667e8cd1-6015-40b2-8ad1-211f1c756ae9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:57.786889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-58ce2626-e49d-4dce-a15d-f91c4e4b325e req-667e8cd1-6015-40b2-8ad1-211f1c756ae9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:57.787737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-58ce2626-e49d-4dce-a15d-f91c4e4b325e req-667e8cd1-6015-40b2-8ad1-211f1c756ae9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:57.805230 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-58ce2626-e49d-4dce-a15d-f91c4e4b325e req-667e8cd1-6015-40b2-8ad1-211f1c756ae9 service nova] Creating event network-vif-deleted:9720d5e6-b71e-46dd-a1ca-700a06956155 for instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 on nch1-master-1 Sep 10 21:05:57.810846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-69034c20-2fbd-45df-a824-5b51029d0da6 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb72cf13347ce901cad42460e7dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9df0b572a1844bda38471874d2afe92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:57.814391 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-58ce2626-e49d-4dce-a15d-f91c4e4b325e req-667e8cd1-6015-40b2-8ad1-211f1c756ae9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047190 Sep 10 21:05:57.816021 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2094/4274] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:05:57.824454 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-69034c20-2fbd-45df-a824-5b51029d0da6 tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 200 len: 1510 microversion: 2.1 time: 0.702298 Sep 10 21:05:57.825058 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2181/4275] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:57 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 1510 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:05:58.684875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-99246d6b-d212-4f14-978f-9127f097799c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:58.685371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99246d6b-d212-4f14-978f-9127f097799c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:58.707642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99246d6b-d212-4f14-978f-9127f097799c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:58.708458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99246d6b-d212-4f14-978f-9127f097799c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:58.729375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99246d6b-d212-4f14-978f-9127f097799c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:58.730974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99246d6b-d212-4f14-978f-9127f097799c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:58.731472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99246d6b-d212-4f14-978f-9127f097799c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:58.731911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99246d6b-d212-4f14-978f-9127f097799c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:58.848736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:05:58.849330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] [instance: 7791e1c9-0ea1-42b6-9732-f3088f9fee11] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:05:58.864029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:58.865916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:58.869393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:58.874113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:05:58.874835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:05:58.876972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:05:58.878867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:58.933283 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] HTTP exception thrown: Instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 could not be found. Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Request method failure captured: Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 HTTP/1.1 Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPvgVNfAqmg9fdl1TEztTYWWfaavkl8qQVUt3wM7LU3lHbi28WTHmWhptGplqTefW18XkX8xnNmmEfo73TceSqtwoHNG28_Q1NuH1hr6SShPvaGi85wmwkc9xklSesA-8rS6QaO4w8mgIyXVxoQLAO1MBEmjftxA5-8gwF7Bo52V3UU Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e9df0b572a1844bda38471874d2afe92 Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-196913320 Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e9df0b572a1844bda38471874d2afe92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e9df0b572a1844bda38471874d2afe92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e9df0b572a1844bda38471874d2afe92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e9df0b572a1844bda38471874d2afe92"}]}] Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-196913320 Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e9df0b572a1844bda38471874d2afe92 Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-196913320 Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerRescueTestJSONUnderV235-196913320-project Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: bbbfb72cf13347ce901cad42460e7dce Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-196913320-project Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 could not be found. Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '7791e1c9-0ea1-42b6-9732-f3088f9fee11'} Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 could not be found. Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 could not be found. Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:58.942043 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:05:58.947520 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:58.947520 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:05:58.947520 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:05:58.947520 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:05:58.947520 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:05:58.947520 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:05:58.947520 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 could not be found. Sep 10 21:05:58.947520 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:05:58.951689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] Returning 404 to user: Instance 7791e1c9-0ea1-42b6-9732-f3088f9fee11 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:05:58.952760 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fa5e081f-695a-49ea-9ea5-74acd0c893dc tempest-ServerRescueTestJSONUnderV235-196913320 tempest-ServerRescueTestJSONUnderV235-196913320-project] 10.222.0.33 "GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11" status: 404 len: 111 microversion: 2.1 time: 0.108369 Sep 10 21:05:58.957637 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2182/4276] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:58 2022] GET /compute/v2.1/servers/7791e1c9-0ea1-42b6-9732-f3088f9fee11 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:05:59.382041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:05:59.388656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99246d6b-d212-4f14-978f-9127f097799c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:05:59.405058 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-99246d6b-d212-4f14-978f-9127f097799c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1315 microversion: 2.1 time: 0.725775 Sep 10 21:05:59.407670 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2095/4277] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:05:58 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:00.434783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-75e422bd-7fb7-43fe-ba48-bdbf7bf54477 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:00.436060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-75e422bd-7fb7-43fe-ba48-bdbf7bf54477 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:00.464103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75e422bd-7fb7-43fe-ba48-bdbf7bf54477 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:00.468142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75e422bd-7fb7-43fe-ba48-bdbf7bf54477 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:00.468810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75e422bd-7fb7-43fe-ba48-bdbf7bf54477 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:00.470660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75e422bd-7fb7-43fe-ba48-bdbf7bf54477 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:00.472154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75e422bd-7fb7-43fe-ba48-bdbf7bf54477 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:00.473586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75e422bd-7fb7-43fe-ba48-bdbf7bf54477 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:01.336054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-75e422bd-7fb7-43fe-ba48-bdbf7bf54477 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:01.355726 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-75e422bd-7fb7-43fe-ba48-bdbf7bf54477 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1315 microversion: 2.1 time: 0.928535 Sep 10 21:06:01.358982 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2183/4278] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:00 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1315 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:02.383424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0e0c3093-7cee-43b2-8b0e-1f34fd056eb3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:02.384046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0e0c3093-7cee-43b2-8b0e-1f34fd056eb3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:02.402651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e0c3093-7cee-43b2-8b0e-1f34fd056eb3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:02.403372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e0c3093-7cee-43b2-8b0e-1f34fd056eb3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:02.403965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e0c3093-7cee-43b2-8b0e-1f34fd056eb3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:02.404842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e0c3093-7cee-43b2-8b0e-1f34fd056eb3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:02.406574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e0c3093-7cee-43b2-8b0e-1f34fd056eb3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:02.410650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0e0c3093-7cee-43b2-8b0e-1f34fd056eb3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:03.153693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0e0c3093-7cee-43b2-8b0e-1f34fd056eb3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:03.177517 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0e0c3093-7cee-43b2-8b0e-1f34fd056eb3 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1315 microversion: 2.1 time: 0.798982 Sep 10 21:06:03.180553 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2096/4279] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:02 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:04.207334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-802ee51d-7076-4c34-af15-43140d8a5a54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:04.208859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-802ee51d-7076-4c34-af15-43140d8a5a54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:04.220256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802ee51d-7076-4c34-af15-43140d8a5a54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:04.220844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802ee51d-7076-4c34-af15-43140d8a5a54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:04.221382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802ee51d-7076-4c34-af15-43140d8a5a54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:04.223134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802ee51d-7076-4c34-af15-43140d8a5a54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:04.224137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802ee51d-7076-4c34-af15-43140d8a5a54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:04.225089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802ee51d-7076-4c34-af15-43140d8a5a54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:04.721736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-802ee51d-7076-4c34-af15-43140d8a5a54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:04.751150 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-802ee51d-7076-4c34-af15-43140d8a5a54 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1315 microversion: 2.1 time: 0.549510 Sep 10 21:06:04.756954 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2184/4280] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:04 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:05.028655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-dd1e21a1-9f59-4da4-a662-92956f53c75b req-31514e58-6cd6-4eb6-9639-5f0db302963f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfef807-88b4-4765-8d02-4091096a419b", "name": "network-vif-plugged", "status": "completed", "tag": "6a633460-edd7-47d1-b6ee-d2080b5ea02c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:05.053711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dd1e21a1-9f59-4da4-a662-92956f53c75b req-31514e58-6cd6-4eb6-9639-5f0db302963f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:05.055959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dd1e21a1-9f59-4da4-a662-92956f53c75b req-31514e58-6cd6-4eb6-9639-5f0db302963f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:05.056559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dd1e21a1-9f59-4da4-a662-92956f53c75b req-31514e58-6cd6-4eb6-9639-5f0db302963f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:05.074612 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-dd1e21a1-9f59-4da4-a662-92956f53c75b req-31514e58-6cd6-4eb6-9639-5f0db302963f service nova] Creating event network-vif-plugged:6a633460-edd7-47d1-b6ee-d2080b5ea02c for instance 1cfef807-88b4-4765-8d02-4091096a419b on nch2-master-1 Sep 10 21:06:05.082536 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-dd1e21a1-9f59-4da4-a662-92956f53c75b req-31514e58-6cd6-4eb6-9639-5f0db302963f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058279 Sep 10 21:06:05.084685 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2097/4281] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:05.794783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e89e7868-b2fb-48ec-8fa2-39500c22da87 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:05.796009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e89e7868-b2fb-48ec-8fa2-39500c22da87 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:05.811626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e89e7868-b2fb-48ec-8fa2-39500c22da87 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:05.812524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e89e7868-b2fb-48ec-8fa2-39500c22da87 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:05.813115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e89e7868-b2fb-48ec-8fa2-39500c22da87 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:05.814427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e89e7868-b2fb-48ec-8fa2-39500c22da87 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:05.815785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e89e7868-b2fb-48ec-8fa2-39500c22da87 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:05.816397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e89e7868-b2fb-48ec-8fa2-39500c22da87 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:06.279165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e89e7868-b2fb-48ec-8fa2-39500c22da87 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:06.306176 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e89e7868-b2fb-48ec-8fa2-39500c22da87 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1315 microversion: 2.1 time: 0.524807 Sep 10 21:06:06.307066 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2185/4282] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:05 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:06.382763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bae4542d-9504-4cd0-bbf5-baa34bbb8f8d tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:06.384569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bae4542d-9504-4cd0-bbf5-baa34bbb8f8d tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:06.396243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bae4542d-9504-4cd0-bbf5-baa34bbb8f8d tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:06.397250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bae4542d-9504-4cd0-bbf5-baa34bbb8f8d tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:06.398227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bae4542d-9504-4cd0-bbf5-baa34bbb8f8d tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:06.400013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bae4542d-9504-4cd0-bbf5-baa34bbb8f8d tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:06.401961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bae4542d-9504-4cd0-bbf5-baa34bbb8f8d tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:06.402713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bae4542d-9504-4cd0-bbf5-baa34bbb8f8d tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:06.439971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bae4542d-9504-4cd0-bbf5-baa34bbb8f8d tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:06:06.615913 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bae4542d-9504-4cd0-bbf5-baa34bbb8f8d tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 204 len: 0 microversion: 2.32 time: 0.624898 Sep 10 21:06:06.641031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:06.641853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:06.645284 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2098/4283] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:06:05 2022] DELETE /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 21:06:06.655989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:06.658315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:06.662393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:06.663404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:06.664113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:06.665152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:07.346630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-963670bf-f651-4d77-bd8f-40dde6b768ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:07.347558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-963670bf-f651-4d77-bd8f-40dde6b768ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:07.368844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963670bf-f651-4d77-bd8f-40dde6b768ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:07.369415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963670bf-f651-4d77-bd8f-40dde6b768ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:07.370003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963670bf-f651-4d77-bd8f-40dde6b768ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:07.372441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963670bf-f651-4d77-bd8f-40dde6b768ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:07.374216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963670bf-f651-4d77-bd8f-40dde6b768ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:07.374803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963670bf-f651-4d77-bd8f-40dde6b768ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:07.481924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:07.498578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:07.503045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:07.506788 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3899e65b-2ac5-4495-a336-9596b1a798de tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2951 microversion: 2.32 time: 0.879506 Sep 10 21:06:07.507461 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2186/4284] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:06 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2951 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:06:07.750921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-963670bf-f651-4d77-bd8f-40dde6b768ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:07.762976 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-963670bf-f651-4d77-bd8f-40dde6b768ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1315 microversion: 2.1 time: 0.426077 Sep 10 21:06:07.775529 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2099/4285] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:07 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:08.537199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:08.537842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:08.554276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:08.555389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:08.555923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:08.556857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:08.560730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:08.561294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:08.800084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc41ae2b-cd28-49c0-ac3b-4cc2312f22b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:08.801399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cc41ae2b-cd28-49c0-ac3b-4cc2312f22b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:08.815263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc41ae2b-cd28-49c0-ac3b-4cc2312f22b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:08.817692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc41ae2b-cd28-49c0-ac3b-4cc2312f22b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:08.819865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc41ae2b-cd28-49c0-ac3b-4cc2312f22b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:08.826320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc41ae2b-cd28-49c0-ac3b-4cc2312f22b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:08.827348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc41ae2b-cd28-49c0-ac3b-4cc2312f22b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:08.828014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc41ae2b-cd28-49c0-ac3b-4cc2312f22b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:09.315919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cc41ae2b-cd28-49c0-ac3b-4cc2312f22b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:09.340178 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cc41ae2b-cd28-49c0-ac3b-4cc2312f22b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1315 microversion: 2.1 time: 0.544409 Sep 10 21:06:09.341571 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2100/4286] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:08 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:10.150770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:10.182683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:10.200471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:10.205575 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5c50108a-96f4-4f07-b805-6a07bdd3ded3 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2951 microversion: 2.32 time: 1.672282 Sep 10 21:06:10.211543 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2187/4287] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:08 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2951 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:06:10.368020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c9d227df-78b4-42dd-9f78-228935c70c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:10.368832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c9d227df-78b4-42dd-9f78-228935c70c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:10.378869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d227df-78b4-42dd-9f78-228935c70c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:10.379476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d227df-78b4-42dd-9f78-228935c70c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:10.379992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d227df-78b4-42dd-9f78-228935c70c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:10.380721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d227df-78b4-42dd-9f78-228935c70c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:10.381225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d227df-78b4-42dd-9f78-228935c70c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:10.382677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d227df-78b4-42dd-9f78-228935c70c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:10.779707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c9d227df-78b4-42dd-9f78-228935c70c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:10.791595 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c9d227df-78b4-42dd-9f78-228935c70c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1501 microversion: 2.1 time: 0.429106 Sep 10 21:06:10.807500 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2101/4288] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:10 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1501 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:10.817186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-94ae2fa9-92de-493b-b87c-03c8ad687117 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:10.827237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94ae2fa9-92de-493b-b87c-03c8ad687117 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:10.828122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94ae2fa9-92de-493b-b87c-03c8ad687117 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:10.829053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94ae2fa9-92de-493b-b87c-03c8ad687117 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:10.858895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-94ae2fa9-92de-493b-b87c-03c8ad687117 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Going to try to stop instance {{(pid=145772) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 21:06:10.946706 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-94ae2fa9-92de-493b-b87c-03c8ad687117 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b/action" status: 202 len: 0 microversion: 2.1 time: 0.133565 Sep 10 21:06:10.951743 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2188/4289] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:06:10 2022] POST /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:06:10.991280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f774d182-5dad-4c1c-9edb-915b380bcb6b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:10.994155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f774d182-5dad-4c1c-9edb-915b380bcb6b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:11.051233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f774d182-5dad-4c1c-9edb-915b380bcb6b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:11.064445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f774d182-5dad-4c1c-9edb-915b380bcb6b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:11.064445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f774d182-5dad-4c1c-9edb-915b380bcb6b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:11.072350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f774d182-5dad-4c1c-9edb-915b380bcb6b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:11.075806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f774d182-5dad-4c1c-9edb-915b380bcb6b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:11.078982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f774d182-5dad-4c1c-9edb-915b380bcb6b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:11.255903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:11.256675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:11.269795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:11.294836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:11.295848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:11.302907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:11.306583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:11.312567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:11.573198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f774d182-5dad-4c1c-9edb-915b380bcb6b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:11.587379 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f774d182-5dad-4c1c-9edb-915b380bcb6b tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.630441 Sep 10 21:06:11.590968 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2102/4290] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:10 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:12.494281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:12.509045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:12.523599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:12.525192 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a780448c-d55e-47f9-8efe-b0db648f2829 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2951 microversion: 2.32 time: 1.275302 Sep 10 21:06:12.534427 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2189/4291] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:11 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2951 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:06:12.615230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09394e3a-a8a3-477a-afbb-7108eeca8265 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:12.615933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09394e3a-a8a3-477a-afbb-7108eeca8265 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:12.626420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09394e3a-a8a3-477a-afbb-7108eeca8265 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:12.635583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09394e3a-a8a3-477a-afbb-7108eeca8265 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:12.636237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09394e3a-a8a3-477a-afbb-7108eeca8265 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:12.637134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09394e3a-a8a3-477a-afbb-7108eeca8265 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:12.637739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09394e3a-a8a3-477a-afbb-7108eeca8265 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:12.638298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09394e3a-a8a3-477a-afbb-7108eeca8265 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:12.891805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8030c2a1-c660-4269-a911-fb0b808b123f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'create', calling method: .version_select at 0x7f993fa2bc10>, body: {"keypair": {"name": "tempest-keypair-1969145086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZyhLCGoGawNY9mWCtYXN9/c85N7bCvKIZJBPw/2tFHqcV5eQovDug4FiAgTn/oEuBOtC2oNJB0bTnI//WGgDj+DQvjNF5tzkoPA4dNGUZVYtKGPpkGjb5HpyFs6Xz/2w=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:12.934496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-8030c2a1-c660-4269-a911-fb0b808b123f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Getting quotas for project 9b196d42c2d6416c81818922af07b8a3. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:06:12.951106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-8030c2a1-c660-4269-a911-fb0b808b123f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Getting quotas for user 13e5077421c44eb7abcda40582c7ea9a and project 9b196d42c2d6416c81818922af07b8a3. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:06:13.017460 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8030c2a1-c660-4269-a911-fb0b808b123f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.441277 Sep 10 21:06:13.019701 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2103/4292] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:06:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:13.267986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09394e3a-a8a3-477a-afbb-7108eeca8265 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:13.278105 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09394e3a-a8a3-477a-afbb-7108eeca8265 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.667245 Sep 10 21:06:13.282018 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2190/4293] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:12 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:13.387768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3c4dcef2-84cc-4826-96f3-0384adc8b222 req-735397b6-4040-4b07-9916-b42b03f2838d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "eb53acdc-dda5-4628-9875-8c05fd7b949f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:13.410239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3c4dcef2-84cc-4826-96f3-0384adc8b222 req-735397b6-4040-4b07-9916-b42b03f2838d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:13.411067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3c4dcef2-84cc-4826-96f3-0384adc8b222 req-735397b6-4040-4b07-9916-b42b03f2838d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:13.412356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3c4dcef2-84cc-4826-96f3-0384adc8b222 req-735397b6-4040-4b07-9916-b42b03f2838d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:13.442763 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3c4dcef2-84cc-4826-96f3-0384adc8b222 req-735397b6-4040-4b07-9916-b42b03f2838d service nova] Creating event network-vif-unplugged:eb53acdc-dda5-4628-9875-8c05fd7b949f for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:13.458244 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3c4dcef2-84cc-4826-96f3-0384adc8b222 req-735397b6-4040-4b07-9916-b42b03f2838d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074559 Sep 10 21:06:13.459500 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2104/4294] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:13.567207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:13.568175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:13.585895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:13.587181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:13.589123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:13.590100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:13.592962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:13.593721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:14.305281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e2b48c24-13b3-4f58-8c57-86823648081e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:14.307132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e2b48c24-13b3-4f58-8c57-86823648081e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:14.310414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:14.325139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2b48c24-13b3-4f58-8c57-86823648081e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:14.326047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2b48c24-13b3-4f58-8c57-86823648081e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:14.327276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2b48c24-13b3-4f58-8c57-86823648081e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:14.332378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2b48c24-13b3-4f58-8c57-86823648081e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:14.334032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2b48c24-13b3-4f58-8c57-86823648081e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:14.337566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2b48c24-13b3-4f58-8c57-86823648081e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:14.439085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:DELETE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:14.474861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:14.489176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:14.496889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:14.501748 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bdab43d4-e926-4fc0-9a23-421a1e051cba tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2930 microversion: 2.32 time: 0.939728 Sep 10 21:06:14.505582 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2191/4295] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:13 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2930 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:06:15.236387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e2b48c24-13b3-4f58-8c57-86823648081e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:15.262753 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e2b48c24-13b3-4f58-8c57-86823648081e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.950872 Sep 10 21:06:15.266072 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2105/4296] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:14 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:15.536258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:15.537343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:15.558984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-ff330619-d33a-4882-8b78-26b6d62e990a req-5dc069c1-c116-4a05-b9c8-7e76f5863862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "4619895f-8d16-490c-8f4a-a6d5aa999a89"}, {"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "591c086f-46ef-4794-bd82-3e7775206b42"}, {"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "31ec25a2-b534-4f40-ae04-3216ce7462b4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:15.580886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:15.584643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:15.587099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:15.590652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:15.594247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:15.595926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:15.597799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ff330619-d33a-4882-8b78-26b6d62e990a req-5dc069c1-c116-4a05-b9c8-7e76f5863862 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:15.599692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ff330619-d33a-4882-8b78-26b6d62e990a req-5dc069c1-c116-4a05-b9c8-7e76f5863862 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:15.601964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ff330619-d33a-4882-8b78-26b6d62e990a req-5dc069c1-c116-4a05-b9c8-7e76f5863862 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:15.637772 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-ff330619-d33a-4882-8b78-26b6d62e990a req-5dc069c1-c116-4a05-b9c8-7e76f5863862 service nova] Creating event network-vif-unplugged:4619895f-8d16-490c-8f4a-a6d5aa999a89 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:15.642031 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-ff330619-d33a-4882-8b78-26b6d62e990a req-5dc069c1-c116-4a05-b9c8-7e76f5863862 service nova] Creating event network-vif-unplugged:591c086f-46ef-4794-bd82-3e7775206b42 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:15.643774 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-ff330619-d33a-4882-8b78-26b6d62e990a req-5dc069c1-c116-4a05-b9c8-7e76f5863862 service nova] Creating event network-vif-unplugged:31ec25a2-b534-4f40-ae04-3216ce7462b4 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:15.667319 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-ff330619-d33a-4882-8b78-26b6d62e990a req-5dc069c1-c116-4a05-b9c8-7e76f5863862 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.117291 Sep 10 21:06:15.669488 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2106/4297] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 10 21:06:16.300691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0cd022dc-1835-4f2d-a9a9-d73f99939c10 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:16.311302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0cd022dc-1835-4f2d-a9a9-d73f99939c10 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:16.333699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd022dc-1835-4f2d-a9a9-d73f99939c10 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:16.340937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd022dc-1835-4f2d-a9a9-d73f99939c10 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:16.341642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd022dc-1835-4f2d-a9a9-d73f99939c10 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:16.342911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd022dc-1835-4f2d-a9a9-d73f99939c10 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:16.343840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd022dc-1835-4f2d-a9a9-d73f99939c10 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:16.344466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0cd022dc-1835-4f2d-a9a9-d73f99939c10 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:16.591817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:16.614748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:16.620235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:16.637730 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3b11f693-5507-4832-b613-619070c73e6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2930 microversion: 2.32 time: 1.100287 Sep 10 21:06:16.638774 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2192/4298] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:15 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2930 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:06:16.865331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0cd022dc-1835-4f2d-a9a9-d73f99939c10 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:16.884767 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0cd022dc-1835-4f2d-a9a9-d73f99939c10 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.593156 Sep 10 21:06:16.888789 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2107/4299] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:16 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:17.666882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:17.668213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:17.677632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:17.681264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:17.681733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:17.682534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:17.682973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:17.683413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:17.788140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2b5108e5-9a7d-4a16-9e75-155f076b69fd req-229cf414-a1d6-4d07-9311-4f6e8aeba39f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "927c985e-c5fa-49ba-ad56-493d19eca859"}, {"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "99a05956-b818-4d1e-9f19-c00ce1c706e3"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:17.817035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2b5108e5-9a7d-4a16-9e75-155f076b69fd req-229cf414-a1d6-4d07-9311-4f6e8aeba39f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:17.817752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2b5108e5-9a7d-4a16-9e75-155f076b69fd req-229cf414-a1d6-4d07-9311-4f6e8aeba39f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:17.818411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2b5108e5-9a7d-4a16-9e75-155f076b69fd req-229cf414-a1d6-4d07-9311-4f6e8aeba39f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:17.848814 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2b5108e5-9a7d-4a16-9e75-155f076b69fd req-229cf414-a1d6-4d07-9311-4f6e8aeba39f service nova] Creating event network-vif-unplugged:927c985e-c5fa-49ba-ad56-493d19eca859 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:17.850854 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2b5108e5-9a7d-4a16-9e75-155f076b69fd req-229cf414-a1d6-4d07-9311-4f6e8aeba39f service nova] Creating event network-vif-unplugged:99a05956-b818-4d1e-9f19-c00ce1c706e3 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:17.865089 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2b5108e5-9a7d-4a16-9e75-155f076b69fd req-229cf414-a1d6-4d07-9311-4f6e8aeba39f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.085055 Sep 10 21:06:17.867551 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2108/4300] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:06:17.915218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a7728fa-cabf-4e9b-98cb-1c3e8a4dde03 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:17.916156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7a7728fa-cabf-4e9b-98cb-1c3e8a4dde03 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:17.931339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7728fa-cabf-4e9b-98cb-1c3e8a4dde03 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:17.932173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7728fa-cabf-4e9b-98cb-1c3e8a4dde03 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:17.932615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7728fa-cabf-4e9b-98cb-1c3e8a4dde03 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:17.938919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7728fa-cabf-4e9b-98cb-1c3e8a4dde03 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:17.939415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7728fa-cabf-4e9b-98cb-1c3e8a4dde03 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:17.939863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a7728fa-cabf-4e9b-98cb-1c3e8a4dde03 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:18.301784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:18.319868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:18.331893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:18.333246 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9a7ab059-baeb-44b9-b711-e40e9b68b096 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2909 microversion: 2.32 time: 0.670631 Sep 10 21:06:18.335479 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2193/4301] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:17 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2909 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:06:18.402377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7a7728fa-cabf-4e9b-98cb-1c3e8a4dde03 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:18.422752 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7a7728fa-cabf-4e9b-98cb-1c3e8a4dde03 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.511879 Sep 10 21:06:18.431906 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2109/4302] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:17 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:19.369361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:19.373668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:19.394491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:19.395122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:19.395997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:19.398719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:19.399401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:19.400322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:19.457111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10c670db-d510-49cf-86a1-9efc51cae2d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:19.458027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10c670db-d510-49cf-86a1-9efc51cae2d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:19.475782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10c670db-d510-49cf-86a1-9efc51cae2d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:19.476311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10c670db-d510-49cf-86a1-9efc51cae2d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:19.483856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10c670db-d510-49cf-86a1-9efc51cae2d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:19.484666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10c670db-d510-49cf-86a1-9efc51cae2d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:19.485281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10c670db-d510-49cf-86a1-9efc51cae2d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:19.485814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10c670db-d510-49cf-86a1-9efc51cae2d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:19.982021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:20.000204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:20.004532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:20.006562 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-754b4db5-67ab-4872-b345-a4db4a19f81c tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2863 microversion: 2.32 time: 0.646361 Sep 10 21:06:20.011832 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2194/4303] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:19 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2863 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:06:20.021600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-dd3179af-b145-4a5b-b9eb-732090865a6b req-93e0a3c0-f198-4ca9-96ed-98f9e9d0da17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-deleted", "tag": "927c985e-c5fa-49ba-ad56-493d19eca859"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:20.050376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-dd3179af-b145-4a5b-b9eb-732090865a6b req-93e0a3c0-f198-4ca9-96ed-98f9e9d0da17 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:20.051252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-dd3179af-b145-4a5b-b9eb-732090865a6b req-93e0a3c0-f198-4ca9-96ed-98f9e9d0da17 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:20.052001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-dd3179af-b145-4a5b-b9eb-732090865a6b req-93e0a3c0-f198-4ca9-96ed-98f9e9d0da17 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:20.068729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10c670db-d510-49cf-86a1-9efc51cae2d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:20.082983 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-10c670db-d510-49cf-86a1-9efc51cae2d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.631203 Sep 10 21:06:20.084154 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2110/4304] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:19 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:20.126314 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-dd3179af-b145-4a5b-b9eb-732090865a6b req-93e0a3c0-f198-4ca9-96ed-98f9e9d0da17 service nova] Creating event network-vif-deleted:927c985e-c5fa-49ba-ad56-493d19eca859 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:20.142669 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-dd3179af-b145-4a5b-b9eb-732090865a6b req-93e0a3c0-f198-4ca9-96ed-98f9e9d0da17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127471 Sep 10 21:06:20.143387 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2195/4305] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:20.375610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1532124851", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e62036f-d417-4f91-bd8f-784bd88ed67c"}], "security_groups": [{"name": "tempest-securitygroup--670698822"}], "key_name": "tempest-keypair-1969145086", "user_data": "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:20.710776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] validate_networks() for [('3e62036f-d417-4f91-bd8f-784bd88ed67c', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:06:21.045904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:21.046615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:21.061675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:21.069295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:21.069866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:21.071539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:21.072291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:21.072758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:21.073194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:21.709541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:06:21.710856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:06:21.712845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:06:21.713858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:06:21.715074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:06:21.733088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:21.737505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:21.738272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:21.739279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:21.742529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:21.743273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:21.808908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Getting quotas for project 9b196d42c2d6416c81818922af07b8a3. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:06:21.823328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Getting quotas for user 13e5077421c44eb7abcda40582c7ea9a and project 9b196d42c2d6416c81818922af07b8a3. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:06:21.851921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:06:21.855482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:06:21.970105 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c00fb0d2-c39d-4d22-a1ef-0c09a78c02d8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.598914 Sep 10 21:06:21.973568 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2111/4306] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:06:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:06:21.981412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dff16a8e-34af-4844-b302-251e23164d46 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:21.982628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dff16a8e-34af-4844-b302-251e23164d46 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:21.990779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dff16a8e-34af-4844-b302-251e23164d46 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:21.992123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dff16a8e-34af-4844-b302-251e23164d46 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:21.992795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dff16a8e-34af-4844-b302-251e23164d46 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:21.994662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dff16a8e-34af-4844-b302-251e23164d46 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:21.995779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dff16a8e-34af-4844-b302-251e23164d46 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:21.996604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dff16a8e-34af-4844-b302-251e23164d46 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:22.340744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dff16a8e-34af-4844-b302-251e23164d46 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:22.351411 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dff16a8e-34af-4844-b302-251e23164d46 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.376212 Sep 10 21:06:22.352026 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2112/4307] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:21 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:22.377943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3733cd6-cbc6-47c8-8448-c03f46a02d60 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:22.383126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e3733cd6-cbc6-47c8-8448-c03f46a02d60 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:22.540624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e3733cd6-cbc6-47c8-8448-c03f46a02d60 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:22.587697 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3733cd6-cbc6-47c8-8448-c03f46a02d60 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1238 microversion: 2.1 time: 0.218840 Sep 10 21:06:22.593537 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2113/4308] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:22 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1238 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:22.643805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:22.656990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b19cda74-f2a1-4153-b7fa-bbd4b78be209 req-67c572b7-7fe5-4f9f-b48e-3301705f5b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-deleted", "tag": "591c086f-46ef-4794-bd82-3e7775206b42"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:22.690716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:22.693455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:22.696798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b19cda74-f2a1-4153-b7fa-bbd4b78be209 req-67c572b7-7fe5-4f9f-b48e-3301705f5b63 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:22.697538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b19cda74-f2a1-4153-b7fa-bbd4b78be209 req-67c572b7-7fe5-4f9f-b48e-3301705f5b63 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:22.699481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b19cda74-f2a1-4153-b7fa-bbd4b78be209 req-67c572b7-7fe5-4f9f-b48e-3301705f5b63 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:22.703694 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93857273-b1a2-4489-b2f0-da8b5cc5d650 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2530 microversion: 2.32 time: 1.662680 Sep 10 21:06:22.705942 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2196/4309] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:21 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2530 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:06:22.738880 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b19cda74-f2a1-4153-b7fa-bbd4b78be209 req-67c572b7-7fe5-4f9f-b48e-3301705f5b63 service nova] Creating event network-vif-deleted:591c086f-46ef-4794-bd82-3e7775206b42 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:22.753348 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b19cda74-f2a1-4153-b7fa-bbd4b78be209 req-67c572b7-7fe5-4f9f-b48e-3301705f5b63 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100771 Sep 10 21:06:22.754589 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2114/4310] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:23.378192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5768b81a-0821-45b4-a755-5bc572d499b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:23.379389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5768b81a-0821-45b4-a755-5bc572d499b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:23.413712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5768b81a-0821-45b4-a755-5bc572d499b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:23.414121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5768b81a-0821-45b4-a755-5bc572d499b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:23.416513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5768b81a-0821-45b4-a755-5bc572d499b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:23.418353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5768b81a-0821-45b4-a755-5bc572d499b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:23.423155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5768b81a-0821-45b4-a755-5bc572d499b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:23.424048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5768b81a-0821-45b4-a755-5bc572d499b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:23.630010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f5a893eb-33c9-4e53-a0b2-fe2bf0088cb5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:23.633868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f5a893eb-33c9-4e53-a0b2-fe2bf0088cb5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:23.663948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5a893eb-33c9-4e53-a0b2-fe2bf0088cb5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:23.667756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5a893eb-33c9-4e53-a0b2-fe2bf0088cb5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:23.670469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5a893eb-33c9-4e53-a0b2-fe2bf0088cb5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:23.684756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5a893eb-33c9-4e53-a0b2-fe2bf0088cb5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:23.688885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5a893eb-33c9-4e53-a0b2-fe2bf0088cb5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:23.689366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5a893eb-33c9-4e53-a0b2-fe2bf0088cb5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:23.950693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5768b81a-0821-45b4-a755-5bc572d499b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:23.979596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:23.988462 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5768b81a-0821-45b4-a755-5bc572d499b6 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.614241 Sep 10 21:06:23.989441 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2197/4311] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:23 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:23.996204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:23.997443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:24.005165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:24.006740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:24.008193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:24.014359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:24.016903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:24.017650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:24.036879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f5a893eb-33c9-4e53-a0b2-fe2bf0088cb5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:24.074560 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f5a893eb-33c9-4e53-a0b2-fe2bf0088cb5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1290 microversion: 2.1 time: 0.458218 Sep 10 21:06:24.092364 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2115/4312] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:23 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1290 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:24.909819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:24.924418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:24.927486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:24.929429 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d3c9aa86-e9b8-4caf-ad40-d09bca0edb66 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2416 microversion: 2.32 time: 0.938409 Sep 10 21:06:24.931960 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2198/4313] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:23 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2416 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:06:24.990723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-122dba6e-fc64-42a8-a2a3-db1e04c754ef req-70d5b4db-84e7-4502-8de7-04cc8ae5b94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-deleted", "tag": "4619895f-8d16-490c-8f4a-a6d5aa999a89"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:25.013871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fcb48281-7fe5-4a8b-b3fa-f15cc9a79cef tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:25.015176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fcb48281-7fe5-4a8b-b3fa-f15cc9a79cef tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:25.015767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-122dba6e-fc64-42a8-a2a3-db1e04c754ef req-70d5b4db-84e7-4502-8de7-04cc8ae5b94e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:25.016266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-122dba6e-fc64-42a8-a2a3-db1e04c754ef req-70d5b4db-84e7-4502-8de7-04cc8ae5b94e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:25.016709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-122dba6e-fc64-42a8-a2a3-db1e04c754ef req-70d5b4db-84e7-4502-8de7-04cc8ae5b94e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:25.036327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb48281-7fe5-4a8b-b3fa-f15cc9a79cef tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:25.037111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb48281-7fe5-4a8b-b3fa-f15cc9a79cef tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:25.038833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb48281-7fe5-4a8b-b3fa-f15cc9a79cef tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:25.040311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb48281-7fe5-4a8b-b3fa-f15cc9a79cef tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:25.044792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb48281-7fe5-4a8b-b3fa-f15cc9a79cef tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:25.050194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fcb48281-7fe5-4a8b-b3fa-f15cc9a79cef tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:25.056710 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-122dba6e-fc64-42a8-a2a3-db1e04c754ef req-70d5b4db-84e7-4502-8de7-04cc8ae5b94e service nova] Creating event network-vif-deleted:4619895f-8d16-490c-8f4a-a6d5aa999a89 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:25.066980 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-122dba6e-fc64-42a8-a2a3-db1e04c754ef req-70d5b4db-84e7-4502-8de7-04cc8ae5b94e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080291 Sep 10 21:06:25.067943 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2116/4314] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:25.107775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cdfcd6c0-0472-4c86-8e14-d629acb209e8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:25.109535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cdfcd6c0-0472-4c86-8e14-d629acb209e8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:25.119961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfcd6c0-0472-4c86-8e14-d629acb209e8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:25.120468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfcd6c0-0472-4c86-8e14-d629acb209e8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:25.120908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfcd6c0-0472-4c86-8e14-d629acb209e8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:25.126389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfcd6c0-0472-4c86-8e14-d629acb209e8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:25.127047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfcd6c0-0472-4c86-8e14-d629acb209e8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:25.127491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdfcd6c0-0472-4c86-8e14-d629acb209e8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:25.297942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cdfcd6c0-0472-4c86-8e14-d629acb209e8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:25.310021 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cdfcd6c0-0472-4c86-8e14-d629acb209e8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1296 microversion: 2.1 time: 0.205679 Sep 10 21:06:25.314238 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2117/4315] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:25 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1296 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:25.650387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fcb48281-7fe5-4a8b-b3fa-f15cc9a79cef tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:25.669248 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fcb48281-7fe5-4a8b-b3fa-f15cc9a79cef tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.654433 Sep 10 21:06:25.669356 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2199/4316] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:25 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:25.996536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:25.998148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:26.044807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:26.045455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:26.047987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:26.051645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:26.052496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:26.055028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:26.336812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86baf9f4-b51a-4b2f-83d1-7f802d7197a0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:26.338034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-86baf9f4-b51a-4b2f-83d1-7f802d7197a0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:26.353733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86baf9f4-b51a-4b2f-83d1-7f802d7197a0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:26.354320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86baf9f4-b51a-4b2f-83d1-7f802d7197a0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:26.354779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86baf9f4-b51a-4b2f-83d1-7f802d7197a0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:26.355584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86baf9f4-b51a-4b2f-83d1-7f802d7197a0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:26.356053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86baf9f4-b51a-4b2f-83d1-7f802d7197a0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:26.356539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86baf9f4-b51a-4b2f-83d1-7f802d7197a0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:26.522043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:26.535170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:26.537150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:26.539190 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-490f634f-13db-407d-a281-903e2255de00 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2256 microversion: 2.32 time: 0.554607 Sep 10 21:06:26.540354 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2118/4317] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:25 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2256 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:06:26.625486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-86baf9f4-b51a-4b2f-83d1-7f802d7197a0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:26.644495 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-86baf9f4-b51a-4b2f-83d1-7f802d7197a0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1296 microversion: 2.1 time: 0.311360 Sep 10 21:06:26.645608 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2200/4318] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:26 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1296 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:26.693468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bd7643d3-f4cc-43bb-b4be-5b8e700a6c96 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:26.695146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bd7643d3-f4cc-43bb-b4be-5b8e700a6c96 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:26.713306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd7643d3-f4cc-43bb-b4be-5b8e700a6c96 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:26.714188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd7643d3-f4cc-43bb-b4be-5b8e700a6c96 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:26.714790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd7643d3-f4cc-43bb-b4be-5b8e700a6c96 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:26.715680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd7643d3-f4cc-43bb-b4be-5b8e700a6c96 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:26.716322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd7643d3-f4cc-43bb-b4be-5b8e700a6c96 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:26.717783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bd7643d3-f4cc-43bb-b4be-5b8e700a6c96 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:27.135915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bd7643d3-f4cc-43bb-b4be-5b8e700a6c96 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:27.149363 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bd7643d3-f4cc-43bb-b4be-5b8e700a6c96 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.461076 Sep 10 21:06:27.168808 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2119/4319] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:26 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:27.491893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c9d783bf-f385-4653-8e64-baa6a46a8e09 req-345808af-9b9b-403f-a3ca-ac43a8f38cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-deleted", "tag": "99a05956-b818-4d1e-9f19-c00ce1c706e3"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:27.514832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c9d783bf-f385-4653-8e64-baa6a46a8e09 req-345808af-9b9b-403f-a3ca-ac43a8f38cf2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:27.515335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c9d783bf-f385-4653-8e64-baa6a46a8e09 req-345808af-9b9b-403f-a3ca-ac43a8f38cf2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:27.515782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c9d783bf-f385-4653-8e64-baa6a46a8e09 req-345808af-9b9b-403f-a3ca-ac43a8f38cf2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:27.543921 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c9d783bf-f385-4653-8e64-baa6a46a8e09 req-345808af-9b9b-403f-a3ca-ac43a8f38cf2 service nova] Creating event network-vif-deleted:99a05956-b818-4d1e-9f19-c00ce1c706e3 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:27.550255 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c9d783bf-f385-4653-8e64-baa6a46a8e09 req-345808af-9b9b-403f-a3ca-ac43a8f38cf2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062420 Sep 10 21:06:27.551785 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2201/4320] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:27.569267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:27.570801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:27.578332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:27.579416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:27.580209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:27.581251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:27.586998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:27.592938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:27.669147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa63a325-9343-4d60-9fa8-0871d799b865 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:27.670176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aa63a325-9343-4d60-9fa8-0871d799b865 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:27.683819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa63a325-9343-4d60-9fa8-0871d799b865 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:27.684334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa63a325-9343-4d60-9fa8-0871d799b865 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:27.684778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa63a325-9343-4d60-9fa8-0871d799b865 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:27.685503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa63a325-9343-4d60-9fa8-0871d799b865 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:27.685994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa63a325-9343-4d60-9fa8-0871d799b865 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:27.686425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa63a325-9343-4d60-9fa8-0871d799b865 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:27.904748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aa63a325-9343-4d60-9fa8-0871d799b865 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:27.917405 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aa63a325-9343-4d60-9fa8-0871d799b865 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1296 microversion: 2.1 time: 0.252081 Sep 10 21:06:27.919145 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2202/4321] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:27 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1296 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:28.179983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-130ae6a3-92c2-47c9-a52b-661b3b7c1f6f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:28.181121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-130ae6a3-92c2-47c9-a52b-661b3b7c1f6f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:28.188950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130ae6a3-92c2-47c9-a52b-661b3b7c1f6f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:28.189604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130ae6a3-92c2-47c9-a52b-661b3b7c1f6f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:28.190632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130ae6a3-92c2-47c9-a52b-661b3b7c1f6f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:28.191543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130ae6a3-92c2-47c9-a52b-661b3b7c1f6f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:28.192275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130ae6a3-92c2-47c9-a52b-661b3b7c1f6f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:28.192915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-130ae6a3-92c2-47c9-a52b-661b3b7c1f6f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:28.235789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:28.252049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:28.253948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:28.255440 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d0070402-e82d-4be4-a1d6-45c99964a290 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 2096 microversion: 2.32 time: 0.690354 Sep 10 21:06:28.270292 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2120/4322] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:27 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 2096 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:06:28.569947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-130ae6a3-92c2-47c9-a52b-661b3b7c1f6f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:28.579833 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-130ae6a3-92c2-47c9-a52b-661b3b7c1f6f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.407184 Sep 10 21:06:28.582910 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2203/4323] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:28 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:28.946857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab461c5c-b69d-43bd-ba0e-4027af9121b7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:28.948093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ab461c5c-b69d-43bd-ba0e-4027af9121b7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:28.958295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab461c5c-b69d-43bd-ba0e-4027af9121b7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:28.959002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab461c5c-b69d-43bd-ba0e-4027af9121b7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:28.961725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab461c5c-b69d-43bd-ba0e-4027af9121b7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:28.962736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab461c5c-b69d-43bd-ba0e-4027af9121b7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:28.963373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab461c5c-b69d-43bd-ba0e-4027af9121b7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:28.965314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab461c5c-b69d-43bd-ba0e-4027af9121b7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:29.285438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:29.286208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:29.308780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:29.312615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:29.313240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:29.314152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:29.314914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:29.327153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:29.775447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab461c5c-b69d-43bd-ba0e-4027af9121b7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:29.792665 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab461c5c-b69d-43bd-ba0e-4027af9121b7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1363 microversion: 2.1 time: 0.850387 Sep 10 21:06:29.793295 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2121/4324] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:28 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1363 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:29.796789 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 21:06:29.797270 ncdv-master-1 devstack@n-api.service[145772]: Sat Sep 10 21:06:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f (ip 10.222.0.33) !!! Sep 10 21:06:29.809982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-818b1df8-7e53-4b4d-b80d-d448328c3cb7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:29.811240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-818b1df8-7e53-4b4d-b80d-d448328c3cb7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:29.827386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-818b1df8-7e53-4b4d-b80d-d448328c3cb7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:29.829626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-818b1df8-7e53-4b4d-b80d-d448328c3cb7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:29.832368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-818b1df8-7e53-4b4d-b80d-d448328c3cb7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:29.833283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-818b1df8-7e53-4b4d-b80d-d448328c3cb7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:29.836118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-818b1df8-7e53-4b4d-b80d-d448328c3cb7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:29.844086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-818b1df8-7e53-4b4d-b80d-d448328c3cb7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:30.159205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:30.186215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:30.190830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd57829f24d3841eb9c1d6f5c6a5ea7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd696ed7cdc3945b78d638693a83ac081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:30.193469 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e72a0271-22a8-4e91-8d81-7c79fd972b6e tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 200 len: 1603 microversion: 2.32 time: 0.912915 Sep 10 21:06:30.198123 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2204/4325] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:29 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 1603 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:06:30.214426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-72f87740-8032-468d-a6f2-f8e7bddab0d3 req-b816a807-99af-4d74-ad6c-54dfc7583645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b885d91-158f-4d1e-bea8-3b6e27599f0f", "name": "network-vif-deleted", "tag": "31ec25a2-b534-4f40-ae04-3216ce7462b4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:30.259226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-72f87740-8032-468d-a6f2-f8e7bddab0d3 req-b816a807-99af-4d74-ad6c-54dfc7583645 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:30.260073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-72f87740-8032-468d-a6f2-f8e7bddab0d3 req-b816a807-99af-4d74-ad6c-54dfc7583645 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:30.263313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-72f87740-8032-468d-a6f2-f8e7bddab0d3 req-b816a807-99af-4d74-ad6c-54dfc7583645 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:30.305346 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-72f87740-8032-468d-a6f2-f8e7bddab0d3 req-b816a807-99af-4d74-ad6c-54dfc7583645 service nova] Creating event network-vif-deleted:31ec25a2-b534-4f40-ae04-3216ce7462b4 for instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f on nch2-master-1 Sep 10 21:06:30.316823 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-72f87740-8032-468d-a6f2-f8e7bddab0d3 req-b816a807-99af-4d74-ad6c-54dfc7583645 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112868 Sep 10 21:06:30.318052 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2205/4326] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:30.708768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-818b1df8-7e53-4b4d-b80d-d448328c3cb7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:30.720673 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-818b1df8-7e53-4b4d-b80d-d448328c3cb7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.925413 Sep 10 21:06:30.724443 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2122/4327] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:29 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:30.821739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1539760d-a3ef-4436-ae7b-641740e530bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:30.822760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1539760d-a3ef-4436-ae7b-641740e530bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:30.836615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1539760d-a3ef-4436-ae7b-641740e530bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:30.838373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1539760d-a3ef-4436-ae7b-641740e530bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:30.838992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1539760d-a3ef-4436-ae7b-641740e530bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:30.839832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1539760d-a3ef-4436-ae7b-641740e530bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:30.843014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1539760d-a3ef-4436-ae7b-641740e530bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:30.843755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1539760d-a3ef-4436-ae7b-641740e530bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:31.228373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:31.229300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:31.248452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:31.261980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:31.263633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:31.264428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:31.265049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:31.265643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:31.315329 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] HTTP exception thrown: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Request method failure captured: Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f HTTP/1.1 Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPrN2FWYHZNwQf2tRHO2Q-qHDS-JdrDrP6deiPQAXgDd1r-VjfDyzIlaaQ-ZzVxGiROndUoDFZ8TgeQP2DK0roqqQuYwPZxxGoDG0Uw_oSqasdP6g5OMQwJ1GHRS9iS7Bf_Pr7XP__TLFs0JjLUZNqEOn-gA0dxF0X18tGpny32RAjs Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.32 Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d696ed7cdc3945b78d638693a83ac081 Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TaggedBootDevicesTest-137977825 Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d696ed7cdc3945b78d638693a83ac081"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d696ed7cdc3945b78d638693a83ac081"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d696ed7cdc3945b78d638693a83ac081", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d696ed7cdc3945b78d638693a83ac081"}]}] Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TaggedBootDevicesTest-137977825 Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d696ed7cdc3945b78d638693a83ac081 Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TaggedBootDevicesTest-137977825 Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TaggedBootDevicesTest-137977825-project Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d57829f24d3841eb9c1d6f5c6a5ea7ee Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TaggedBootDevicesTest-137977825-project Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '6b885d91-158f-4d1e-bea8-3b6e27599f0f'} Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:06:31.322202 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:06:31.327107 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:31.327107 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:06:31.327107 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:06:31.327107 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:06:31.327107 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:06:31.327107 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:31.327107 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:06:31.332183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Returning 404 to user: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:06:31.333887 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1576d745-ac42-4536-a0c9-cf8c10971918 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 404 len: 111 microversion: 2.32 time: 0.112694 Sep 10 21:06:31.338470 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2123/4328] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:31 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 10 21:06:31.352638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d25099e3-3021-41a9-b478-e9f504125291 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '.version_select at 0x7f993fab5b80>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:31.377281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1539760d-a3ef-4436-ae7b-641740e530bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:31.387658 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1539760d-a3ef-4436-ae7b-641740e530bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1363 microversion: 2.1 time: 0.570620 Sep 10 21:06:31.395992 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2206/4329] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:30 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:31.428984 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d25099e3-3021-41a9-b478-e9f504125291 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-997383356" status: 204 len: 0 microversion: 2.32 time: 0.087091 Sep 10 21:06:31.430237 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2124/4330] 10.222.0.33 () {60 vars in 1259 bytes} [Sat Sep 10 21:06:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-997383356 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 21:06:31.749813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a7be3fa2-2f4a-4b5c-91c7-7a225e95bca4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:31.750826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a7be3fa2-2f4a-4b5c-91c7-7a225e95bca4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:31.766221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7be3fa2-2f4a-4b5c-91c7-7a225e95bca4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:31.767738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7be3fa2-2f4a-4b5c-91c7-7a225e95bca4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:31.768348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7be3fa2-2f4a-4b5c-91c7-7a225e95bca4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:31.773580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7be3fa2-2f4a-4b5c-91c7-7a225e95bca4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:31.779672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7be3fa2-2f4a-4b5c-91c7-7a225e95bca4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:31.780296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a7be3fa2-2f4a-4b5c-91c7-7a225e95bca4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:32.341473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a7be3fa2-2f4a-4b5c-91c7-7a225e95bca4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:32.360034 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a7be3fa2-2f4a-4b5c-91c7-7a225e95bca4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.615660 Sep 10 21:06:32.361740 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2207/4331] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:31 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:32.409931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d14ae370-4aa7-4458-9688-3e45b9b54622 req-6af7eaf2-e6ec-446a-a93e-13958bafa20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06501f8-3bc9-4240-b2ca-514d8d6fdacb", "tag": "c83fb9d1-1d5c-4b9d-97ca-d0502fd7f74d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:32.420095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5798ffe-1067-4766-b8f4-3d144718e695 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:32.420989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5798ffe-1067-4766-b8f4-3d144718e695 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:32.432515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:32.440101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5798ffe-1067-4766-b8f4-3d144718e695 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:32.440729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5798ffe-1067-4766-b8f4-3d144718e695 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:32.441183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5798ffe-1067-4766-b8f4-3d144718e695 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:32.448377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5798ffe-1067-4766-b8f4-3d144718e695 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:32.448377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5798ffe-1067-4766-b8f4-3d144718e695 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:32.448377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5798ffe-1067-4766-b8f4-3d144718e695 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:32.487501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d14ae370-4aa7-4458-9688-3e45b9b54622 req-6af7eaf2-e6ec-446a-a93e-13958bafa20b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:32.488007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d14ae370-4aa7-4458-9688-3e45b9b54622 req-6af7eaf2-e6ec-446a-a93e-13958bafa20b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:32.490073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d14ae370-4aa7-4458-9688-3e45b9b54622 req-6af7eaf2-e6ec-446a-a93e-13958bafa20b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:32.510868 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d14ae370-4aa7-4458-9688-3e45b9b54622 req-6af7eaf2-e6ec-446a-a93e-13958bafa20b service nova] Creating event network-changed:c83fb9d1-1d5c-4b9d-97ca-d0502fd7f74d for instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb on nch1-master-1 Sep 10 21:06:32.529908 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d14ae370-4aa7-4458-9688-3e45b9b54622 req-6af7eaf2-e6ec-446a-a93e-13958bafa20b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123654 Sep 10 21:06:32.536736 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2125/4332] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:32.791193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a5798ffe-1067-4766-b8f4-3d144718e695 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:32.817975 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5798ffe-1067-4766-b8f4-3d144718e695 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1363 microversion: 2.1 time: 0.400250 Sep 10 21:06:32.820426 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2208/4333] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:32 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1363 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:33.392437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=12 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:33.403117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ce5f288-70b5-4140-8046-3364243f6d88 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:33.405038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ce5f288-70b5-4140-8046-3364243f6d88 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:33.425182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce5f288-70b5-4140-8046-3364243f6d88 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:33.425697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce5f288-70b5-4140-8046-3364243f6d88 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:33.426179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce5f288-70b5-4140-8046-3364243f6d88 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:33.430423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce5f288-70b5-4140-8046-3364243f6d88 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:33.431541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce5f288-70b5-4140-8046-3364243f6d88 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:33.432224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce5f288-70b5-4140-8046-3364243f6d88 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:33.845711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1f6db6c7-af4b-4c03-8354-6c2c5a039a83 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:33.846952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1f6db6c7-af4b-4c03-8354-6c2c5a039a83 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:33.856102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6db6c7-af4b-4c03-8354-6c2c5a039a83 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:33.862714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6db6c7-af4b-4c03-8354-6c2c5a039a83 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:33.863519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6db6c7-af4b-4c03-8354-6c2c5a039a83 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:33.865498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6db6c7-af4b-4c03-8354-6c2c5a039a83 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:33.870479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6db6c7-af4b-4c03-8354-6c2c5a039a83 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:33.871699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6db6c7-af4b-4c03-8354-6c2c5a039a83 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:34.073465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1ce5f288-70b5-4140-8046-3364243f6d88 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:34.106610 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ce5f288-70b5-4140-8046-3364243f6d88 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.715270 Sep 10 21:06:34.111815 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2126/4334] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:33 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:34.524874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1f6db6c7-af4b-4c03-8354-6c2c5a039a83 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:34.545759 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1f6db6c7-af4b-4c03-8354-6c2c5a039a83 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1363 microversion: 2.1 time: 0.703606 Sep 10 21:06:34.561361 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2209/4335] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:33 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1363 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:35.140950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e9c9d13e-f880-47a7-b250-af30ea13a2f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:35.142004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e9c9d13e-f880-47a7-b250-af30ea13a2f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:35.154891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9c9d13e-f880-47a7-b250-af30ea13a2f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:35.157510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9c9d13e-f880-47a7-b250-af30ea13a2f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:35.158849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9c9d13e-f880-47a7-b250-af30ea13a2f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:35.160653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9c9d13e-f880-47a7-b250-af30ea13a2f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:35.161139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9c9d13e-f880-47a7-b250-af30ea13a2f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:35.161582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9c9d13e-f880-47a7-b250-af30ea13a2f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:35.573033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-46904a9e-82da-48ba-8539-fd5923b8a54a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:35.573627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-46904a9e-82da-48ba-8539-fd5923b8a54a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:35.595960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46904a9e-82da-48ba-8539-fd5923b8a54a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:35.596740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46904a9e-82da-48ba-8539-fd5923b8a54a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:35.599687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46904a9e-82da-48ba-8539-fd5923b8a54a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:35.617650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46904a9e-82da-48ba-8539-fd5923b8a54a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:35.623924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46904a9e-82da-48ba-8539-fd5923b8a54a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:35.624705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-46904a9e-82da-48ba-8539-fd5923b8a54a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:35.707619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e9c9d13e-f880-47a7-b250-af30ea13a2f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:35.719775 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e9c9d13e-f880-47a7-b250-af30ea13a2f4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1511 microversion: 2.1 time: 0.583805 Sep 10 21:06:35.720736 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2127/4336] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:35 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1511 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:36.523307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-46904a9e-82da-48ba-8539-fd5923b8a54a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:36.532226 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-46904a9e-82da-48ba-8539-fd5923b8a54a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1363 microversion: 2.1 time: 0.963681 Sep 10 21:06:36.536918 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2210/4337] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:35 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1363 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:36.748942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b6841d32-da29-4d83-8dc7-fc80f8ea8bba tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:36.749684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b6841d32-da29-4d83-8dc7-fc80f8ea8bba tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:36.767408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6841d32-da29-4d83-8dc7-fc80f8ea8bba tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:36.768530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6841d32-da29-4d83-8dc7-fc80f8ea8bba tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:36.770814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6841d32-da29-4d83-8dc7-fc80f8ea8bba tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:36.774750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6841d32-da29-4d83-8dc7-fc80f8ea8bba tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:36.775412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6841d32-da29-4d83-8dc7-fc80f8ea8bba tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:36.776866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6841d32-da29-4d83-8dc7-fc80f8ea8bba tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:37.093634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b6841d32-da29-4d83-8dc7-fc80f8ea8bba tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:37.096124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:37.106164 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b6841d32-da29-4d83-8dc7-fc80f8ea8bba tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1488 microversion: 2.1 time: 0.362689 Sep 10 21:06:37.130619 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2128/4338] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:36 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1488 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:37.141753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c5e7fc1f-256e-4dfd-92f3-9698ec5724b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:37.142576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c5e7fc1f-256e-4dfd-92f3-9698ec5724b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:37.158459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5e7fc1f-256e-4dfd-92f3-9698ec5724b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:37.159784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5e7fc1f-256e-4dfd-92f3-9698ec5724b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:37.160220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5e7fc1f-256e-4dfd-92f3-9698ec5724b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:37.165198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5e7fc1f-256e-4dfd-92f3-9698ec5724b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:37.165719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5e7fc1f-256e-4dfd-92f3-9698ec5724b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:37.167928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5e7fc1f-256e-4dfd-92f3-9698ec5724b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:37.233917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c5e7fc1f-256e-4dfd-92f3-9698ec5724b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:06:37.434432 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c5e7fc1f-256e-4dfd-92f3-9698ec5724b7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 204 len: 0 microversion: 2.1 time: 0.297312 Sep 10 21:06:37.435614 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2211/4339] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:06:37 2022] DELETE /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:06:37.453215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-331d48d6-77a5-40f1-9d04-ea8498d1b865 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:37.456127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-331d48d6-77a5-40f1-9d04-ea8498d1b865 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:37.481324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-331d48d6-77a5-40f1-9d04-ea8498d1b865 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:37.481943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-331d48d6-77a5-40f1-9d04-ea8498d1b865 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:37.482404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-331d48d6-77a5-40f1-9d04-ea8498d1b865 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:37.483152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-331d48d6-77a5-40f1-9d04-ea8498d1b865 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:37.483621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-331d48d6-77a5-40f1-9d04-ea8498d1b865 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:37.484057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-331d48d6-77a5-40f1-9d04-ea8498d1b865 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:37.783809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-499387403", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "a53f27f3-ecaa-4250-a852-1d8a7bb068e9"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:37.796971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-331d48d6-77a5-40f1-9d04-ea8498d1b865 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:37.813022 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-331d48d6-77a5-40f1-9d04-ea8498d1b865 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1494 microversion: 2.1 time: 0.372344 Sep 10 21:06:37.827545 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2212/4340] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:37 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1494 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:37.902454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] validate_networks() for [('a53f27f3-ecaa-4250-a852-1d8a7bb068e9', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:06:38.686234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1744652866", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "75842dc4-d668-416f-9bad-afa9ac1ec517"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:38.774100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] validate_networks() for [('75842dc4-d668-416f-9bad-afa9ac1ec517', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:06:39.544941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:06:39.545422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:06:39.545841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:06:39.546434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:06:39.547005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:06:39.565354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:39.566124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:39.566737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:39.568277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:39.569344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:39.571548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:39.684384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Getting quotas for project ceebf89c39014750ae279e0741a0bb79. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:06:39.705518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Getting quotas for user 9546792be5a640e2a59fb2e8481c6c4b and project ceebf89c39014750ae279e0741a0bb79. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:06:39.748275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:06:39.764146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:06:39.923427 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3c730ae7-a6ef-4719-92f5-1ae4554eade6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.582945 Sep 10 21:06:39.927632 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2129/4341] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:06:39.941645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-07b13380-a950-4ad8-8a48-9027936a3f50 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:39.947941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-07b13380-a950-4ad8-8a48-9027936a3f50 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:39.982122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b13380-a950-4ad8-8a48-9027936a3f50 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:40.003912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b13380-a950-4ad8-8a48-9027936a3f50 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:40.004965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b13380-a950-4ad8-8a48-9027936a3f50 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:40.006704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b13380-a950-4ad8-8a48-9027936a3f50 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:40.007902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b13380-a950-4ad8-8a48-9027936a3f50 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:40.008687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07b13380-a950-4ad8-8a48-9027936a3f50 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:40.633499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-07b13380-a950-4ad8-8a48-9027936a3f50 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:40.643700 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-07b13380-a950-4ad8-8a48-9027936a3f50 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1363 microversion: 2.1 time: 0.713693 Sep 10 21:06:40.649403 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2130/4342] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:39 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1363 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:40.658589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ebdfee67-8008-4e86-832f-40a0ec630f34 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:40.666793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ebdfee67-8008-4e86-832f-40a0ec630f34 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:40.697897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebdfee67-8008-4e86-832f-40a0ec630f34 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:40.710972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebdfee67-8008-4e86-832f-40a0ec630f34 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:40.712825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebdfee67-8008-4e86-832f-40a0ec630f34 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:40.714871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebdfee67-8008-4e86-832f-40a0ec630f34 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:40.718124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebdfee67-8008-4e86-832f-40a0ec630f34 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:40.718956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebdfee67-8008-4e86-832f-40a0ec630f34 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:40.892577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ebdfee67-8008-4e86-832f-40a0ec630f34 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:40.906356 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ebdfee67-8008-4e86-832f-40a0ec630f34 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 200 len: 1452 microversion: 2.1 time: 0.255557 Sep 10 21:06:40.909530 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2131/4343] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:40 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 1452 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:40.932133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-323bd2aa-4c3d-4f34-a66a-7a17eed25c39 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:40.944108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-323bd2aa-4c3d-4f34-a66a-7a17eed25c39 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:40.999369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:06:41.000615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:06:41.001452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:06:41.002741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:06:41.003695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:06:41.028626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:41.029992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:41.031052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:41.033698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:41.035268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:41.036072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:41.076739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:06:41.086766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for user 6bfa3af0a7284bc6854f2c9c58392935 and project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:06:41.118766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:06:41.123725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:06:41.180176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-323bd2aa-4c3d-4f34-a66a-7a17eed25c39 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:41.195155 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-323bd2aa-4c3d-4f34-a66a-7a17eed25c39 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1223 microversion: 2.1 time: 0.280366 Sep 10 21:06:41.215841 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2132/4344] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:40 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1223 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:41.235522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f787f282-454b-4b53-83a7-297aa9856059 req-6364259f-a895-4bb2-9987-c2a863180533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfef807-88b4-4765-8d02-4091096a419b", "name": "network-vif-deleted", "tag": "6a633460-edd7-47d1-b6ee-d2080b5ea02c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:41.274291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f787f282-454b-4b53-83a7-297aa9856059 req-6364259f-a895-4bb2-9987-c2a863180533 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:41.274784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f787f282-454b-4b53-83a7-297aa9856059 req-6364259f-a895-4bb2-9987-c2a863180533 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:41.275221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f787f282-454b-4b53-83a7-297aa9856059 req-6364259f-a895-4bb2-9987-c2a863180533 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:41.305408 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f787f282-454b-4b53-83a7-297aa9856059 req-6364259f-a895-4bb2-9987-c2a863180533 service nova] Creating event network-vif-deleted:6a633460-edd7-47d1-b6ee-d2080b5ea02c for instance 1cfef807-88b4-4765-8d02-4091096a419b on nch2-master-1 Sep 10 21:06:41.313797 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5a46265e-d959-4833-9e0d-90dd0925bacf tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.484929 Sep 10 21:06:41.314684 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2213/4345] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:06:41.322021 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f787f282-454b-4b53-83a7-297aa9856059 req-6364259f-a895-4bb2-9987-c2a863180533 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104473 Sep 10 21:06:41.326227 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2133/4346] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:41.333109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eae2d3b8-9dc7-4161-9fa7-5d8ba4a9792c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:41.333929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eae2d3b8-9dc7-4161-9fa7-5d8ba4a9792c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:41.472555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eae2d3b8-9dc7-4161-9fa7-5d8ba4a9792c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:41.483818 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eae2d3b8-9dc7-4161-9fa7-5d8ba4a9792c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1193 microversion: 2.1 time: 0.157663 Sep 10 21:06:41.485060 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2214/4347] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:41 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1193 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:41.677307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dedd43db-3451-4a68-a9cb-60b730c80ed5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:41.680962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dedd43db-3451-4a68-a9cb-60b730c80ed5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:41.702814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dedd43db-3451-4a68-a9cb-60b730c80ed5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:41.703913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dedd43db-3451-4a68-a9cb-60b730c80ed5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:41.706555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dedd43db-3451-4a68-a9cb-60b730c80ed5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:41.707540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dedd43db-3451-4a68-a9cb-60b730c80ed5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:41.708171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dedd43db-3451-4a68-a9cb-60b730c80ed5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:41.709130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dedd43db-3451-4a68-a9cb-60b730c80ed5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:41.949477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:41.953102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:41.997345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:41.998222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:41.999544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:42.001659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:42.002549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:42.005309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:42.059559 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b HTTP/1.1 Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '1cfef807-88b4-4765-8d02-4091096a419b'} Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:06:42.061298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:42.066404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:42.066404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:06:42.066404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:06:42.066404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:06:42.066404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:06:42.066404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:06:42.066404 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:42.066404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:06:42.066404 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ed97d348-6185-4702-ad44-5f33fc08f7d0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 404 len: 111 microversion: 2.1 time: 0.126021 Sep 10 21:06:42.089195 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2215/4348] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:41 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:06:42.231029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c376ed95-c59b-4e4c-81ea-56e420d6cc37 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:42.231957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c376ed95-c59b-4e4c-81ea-56e420d6cc37 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:42.253469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c376ed95-c59b-4e4c-81ea-56e420d6cc37 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:42.259569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c376ed95-c59b-4e4c-81ea-56e420d6cc37 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:42.260683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c376ed95-c59b-4e4c-81ea-56e420d6cc37 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:42.265117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c376ed95-c59b-4e4c-81ea-56e420d6cc37 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:42.267632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c376ed95-c59b-4e4c-81ea-56e420d6cc37 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:42.268774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c376ed95-c59b-4e4c-81ea-56e420d6cc37 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:42.329646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:42.349154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dedd43db-3451-4a68-a9cb-60b730c80ed5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:42.375897 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dedd43db-3451-4a68-a9cb-60b730c80ed5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1363 microversion: 2.1 time: 0.705982 Sep 10 21:06:42.377452 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2134/4349] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:41 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1363 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:42.391933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-616810665", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f5a2cd59-1be7-47bd-82a5-e6307d510b6e"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:42.468167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] validate_networks() for [('f5a2cd59-1be7-47bd-82a5-e6307d510b6e', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:06:42.582006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c376ed95-c59b-4e4c-81ea-56e420d6cc37 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:42.598792 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c376ed95-c59b-4e4c-81ea-56e420d6cc37 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1275 microversion: 2.1 time: 0.377639 Sep 10 21:06:42.603040 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2216/4350] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:42 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1275 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:42.612444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3f965ba9-c580-42f0-b537-5939cc3e4147 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:42.614458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3f965ba9-c580-42f0-b537-5939cc3e4147 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:42.636992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f965ba9-c580-42f0-b537-5939cc3e4147 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:42.641123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f965ba9-c580-42f0-b537-5939cc3e4147 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:42.644057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f965ba9-c580-42f0-b537-5939cc3e4147 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:42.645233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f965ba9-c580-42f0-b537-5939cc3e4147 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:42.647245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f965ba9-c580-42f0-b537-5939cc3e4147 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:42.649023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f965ba9-c580-42f0-b537-5939cc3e4147 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:43.464759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:06:43.465413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:06:43.465645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:06:43.466831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:06:43.467269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:06:43.483930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:43.484439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:43.484884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:43.485622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:43.488073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:43.488525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:43.515918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3f965ba9-c580-42f0-b537-5939cc3e4147 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:43.529609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:43.540015 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3f965ba9-c580-42f0-b537-5939cc3e4147 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1197 microversion: 2.1 time: 0.935335 Sep 10 21:06:43.541360 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2217/4351] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:42 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1197 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:43.547244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-09608778-d094-4915-8860-356b0dd7bb74 req-95bfad08-88bc-4302-a661-1f6cc466b6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06501f8-3bc9-4240-b2ca-514d8d6fdacb", "name": "network-vif-plugged", "status": "completed", "tag": "c83fb9d1-1d5c-4b9d-97ca-d0502fd7f74d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:43.574341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:06:43.596882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Getting quotas for user 4faa458c158141efaf707317411cd544 and project a58f02659fe74b70a8657691faaad6c9. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:06:43.628482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-09608778-d094-4915-8860-356b0dd7bb74 req-95bfad08-88bc-4302-a661-1f6cc466b6c7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:43.628987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-09608778-d094-4915-8860-356b0dd7bb74 req-95bfad08-88bc-4302-a661-1f6cc466b6c7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:43.629426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-09608778-d094-4915-8860-356b0dd7bb74 req-95bfad08-88bc-4302-a661-1f6cc466b6c7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:43.648591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:06:43.653214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:06:43.658059 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-09608778-d094-4915-8860-356b0dd7bb74 req-95bfad08-88bc-4302-a661-1f6cc466b6c7 service nova] Creating event network-vif-plugged:c83fb9d1-1d5c-4b9d-97ca-d0502fd7f74d for instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb on nch1-master-1 Sep 10 21:06:43.671145 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-09608778-d094-4915-8860-356b0dd7bb74 req-95bfad08-88bc-4302-a661-1f6cc466b6c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127322 Sep 10 21:06:43.672363 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2218/4352] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:43.710528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8a8b544-3d92-4d22-b6aa-f28ce2f7aad0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:43.711800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8a8b544-3d92-4d22-b6aa-f28ce2f7aad0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:43.734903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a8b544-3d92-4d22-b6aa-f28ce2f7aad0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:43.736199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a8b544-3d92-4d22-b6aa-f28ce2f7aad0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:43.739403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a8b544-3d92-4d22-b6aa-f28ce2f7aad0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:43.741116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a8b544-3d92-4d22-b6aa-f28ce2f7aad0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:43.742603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a8b544-3d92-4d22-b6aa-f28ce2f7aad0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:43.743296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8a8b544-3d92-4d22-b6aa-f28ce2f7aad0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:43.763656 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ac80bde-b8bd-4797-bbc5-78bfa4117ff7 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380738 Sep 10 21:06:43.777548 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2135/4353] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:06:43.794812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b44ef8b9-641a-48eb-894b-84c3bb9c5337 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:43.796284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b44ef8b9-641a-48eb-894b-84c3bb9c5337 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:43.807108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44ef8b9-641a-48eb-894b-84c3bb9c5337 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:43.808262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44ef8b9-641a-48eb-894b-84c3bb9c5337 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:43.809621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44ef8b9-641a-48eb-894b-84c3bb9c5337 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:43.812000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44ef8b9-641a-48eb-894b-84c3bb9c5337 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:43.812719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44ef8b9-641a-48eb-894b-84c3bb9c5337 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:43.813437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b44ef8b9-641a-48eb-894b-84c3bb9c5337 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:43.928035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b44ef8b9-641a-48eb-894b-84c3bb9c5337 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:43.955882 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b44ef8b9-641a-48eb-894b-84c3bb9c5337 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1281 microversion: 2.1 time: 0.171906 Sep 10 21:06:43.969980 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2136/4354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:43 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:44.005642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3eaab5e8-7bcf-4039-8ec6-c2937a21a4f8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:44.015078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3eaab5e8-7bcf-4039-8ec6-c2937a21a4f8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:44.373415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3eaab5e8-7bcf-4039-8ec6-c2937a21a4f8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:44.388241 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3eaab5e8-7bcf-4039-8ec6-c2937a21a4f8 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1214 microversion: 2.1 time: 0.414627 Sep 10 21:06:44.389876 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2137/4355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:43 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1214 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:44.570971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bf982c9f-d3ff-4b48-a74d-cffc5aeceb47 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:44.571672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bf982c9f-d3ff-4b48-a74d-cffc5aeceb47 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:44.581227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf982c9f-d3ff-4b48-a74d-cffc5aeceb47 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:44.581732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf982c9f-d3ff-4b48-a74d-cffc5aeceb47 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:44.582213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf982c9f-d3ff-4b48-a74d-cffc5aeceb47 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:44.602022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf982c9f-d3ff-4b48-a74d-cffc5aeceb47 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:44.602678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf982c9f-d3ff-4b48-a74d-cffc5aeceb47 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:44.603144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf982c9f-d3ff-4b48-a74d-cffc5aeceb47 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:44.642108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8a8b544-3d92-4d22-b6aa-f28ce2f7aad0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:44.653156 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8a8b544-3d92-4d22-b6aa-f28ce2f7aad0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1363 microversion: 2.1 time: 0.978885 Sep 10 21:06:44.658742 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2219/4356] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:43 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1363 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:44.828118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bf982c9f-d3ff-4b48-a74d-cffc5aeceb47 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:44.842009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bf982c9f-d3ff-4b48-a74d-cffc5aeceb47 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1251 microversion: 2.1 time: 0.274788 Sep 10 21:06:44.843656 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2138/4357] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:44 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1251 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:44.996534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7b9451a6-7df8-420a-9894-427273b85e30 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:44.997547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7b9451a6-7df8-420a-9894-427273b85e30 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:45.012049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b9451a6-7df8-420a-9894-427273b85e30 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.012920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b9451a6-7df8-420a-9894-427273b85e30 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.015778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b9451a6-7df8-420a-9894-427273b85e30 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.016816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b9451a6-7df8-420a-9894-427273b85e30 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.018302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b9451a6-7df8-420a-9894-427273b85e30 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.019973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b9451a6-7df8-420a-9894-427273b85e30 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.413530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-161b20b7-3832-46e7-aa73-d60a02392b1a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:45.414692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-161b20b7-3832-46e7-aa73-d60a02392b1a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:45.429478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7b9451a6-7df8-420a-9894-427273b85e30 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:45.431954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-161b20b7-3832-46e7-aa73-d60a02392b1a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.432455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-161b20b7-3832-46e7-aa73-d60a02392b1a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.432896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-161b20b7-3832-46e7-aa73-d60a02392b1a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.433609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-161b20b7-3832-46e7-aa73-d60a02392b1a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.439603 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7b9451a6-7df8-420a-9894-427273b85e30 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1281 microversion: 2.1 time: 0.447536 Sep 10 21:06:45.441019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-161b20b7-3832-46e7-aa73-d60a02392b1a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.441602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-161b20b7-3832-46e7-aa73-d60a02392b1a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.444967 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2220/4358] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:44 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1281 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:45.563091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:45.564200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:45.579020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.581685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.582362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.586024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.587896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.588545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.614288 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] HTTP exception thrown: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Request method failure captured: Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f HTTP/1.1 Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPrN2FWYHZNwQf2tRHO2Q-qHDS-JdrDrP6deiPQAXgDd1r-VjfDyzIlaaQ-ZzVxGiROndUoDFZ8TgeQP2DK0roqqQuYwPZxxGoDG0Uw_oSqasdP6g5OMQwJ1GHRS9iS7Bf_Pr7XP__TLFs0JjLUZNqEOn-gA0dxF0X18tGpny32RAjs Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.32 Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d696ed7cdc3945b78d638693a83ac081 Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TaggedBootDevicesTest-137977825 Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d696ed7cdc3945b78d638693a83ac081"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d696ed7cdc3945b78d638693a83ac081"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d696ed7cdc3945b78d638693a83ac081", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d696ed7cdc3945b78d638693a83ac081"}]}] Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TaggedBootDevicesTest-137977825 Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d696ed7cdc3945b78d638693a83ac081 Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TaggedBootDevicesTest-137977825 Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TaggedBootDevicesTest-137977825-project Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d57829f24d3841eb9c1d6f5c6a5ea7ee Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TaggedBootDevicesTest-137977825-project Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '6b885d91-158f-4d1e-bea8-3b6e27599f0f'} Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:06:45.621403 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:45.624892 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:45.627208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Returning 404 to user: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:06:45.628409 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0de735c7-66a6-423f-babc-bf80c0aefeed tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 404 len: 111 microversion: 2.32 time: 0.072106 Sep 10 21:06:45.631923 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2221/4359] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:06:45 2022] DELETE /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:06:45.658680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:45.659649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] [instance: 6b885d91-158f-4d1e-bea8-3b6e27599f0f] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:45.671405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.672237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.672754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.675016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.675102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.675625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.694916 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] HTTP exception thrown: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Request method failure captured: Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f HTTP/1.1 Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPrN2FWYHZNwQf2tRHO2Q-qHDS-JdrDrP6deiPQAXgDd1r-VjfDyzIlaaQ-ZzVxGiROndUoDFZ8TgeQP2DK0roqqQuYwPZxxGoDG0Uw_oSqasdP6g5OMQwJ1GHRS9iS7Bf_Pr7XP__TLFs0JjLUZNqEOn-gA0dxF0X18tGpny32RAjs Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.32 Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d696ed7cdc3945b78d638693a83ac081 Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TaggedBootDevicesTest-137977825 Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d696ed7cdc3945b78d638693a83ac081"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d696ed7cdc3945b78d638693a83ac081"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d696ed7cdc3945b78d638693a83ac081", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d696ed7cdc3945b78d638693a83ac081"}]}] Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TaggedBootDevicesTest-137977825 Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d696ed7cdc3945b78d638693a83ac081 Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TaggedBootDevicesTest-137977825 Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TaggedBootDevicesTest-137977825-project Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d57829f24d3841eb9c1d6f5c6a5ea7ee Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TaggedBootDevicesTest-137977825-project Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '6b885d91-158f-4d1e-bea8-3b6e27599f0f'} Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:06:45.696787 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:45.701611 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:06:45.701611 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:06:45.701611 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:06:45.701611 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:06:45.701611 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:06:45.701611 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. Sep 10 21:06:45.701611 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:06:45.701611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] Returning 404 to user: Instance 6b885d91-158f-4d1e-bea8-3b6e27599f0f could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:06:45.701611 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-af2dda79-d386-433f-8414-d239fbd56b13 tempest-TaggedBootDevicesTest-137977825 tempest-TaggedBootDevicesTest-137977825-project] 10.222.0.33 "GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f" status: 404 len: 111 microversion: 2.32 time: 0.060375 Sep 10 21:06:45.707128 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2222/4360] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:06:45 2022] GET /compute/v2.1/servers/6b885d91-158f-4d1e-bea8-3b6e27599f0f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:06:45.719770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-df3d4380-9091-4631-b179-b2324d6cb42a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:45.720645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-df3d4380-9091-4631-b179-b2324d6cb42a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:45.737070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d4380-9091-4631-b179-b2324d6cb42a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.737550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d4380-9091-4631-b179-b2324d6cb42a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.738168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d4380-9091-4631-b179-b2324d6cb42a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.738918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d4380-9091-4631-b179-b2324d6cb42a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.739385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d4380-9091-4631-b179-b2324d6cb42a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.739814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d4380-9091-4631-b179-b2324d6cb42a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.810597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-161b20b7-3832-46e7-aa73-d60a02392b1a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:45.835718 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-161b20b7-3832-46e7-aa73-d60a02392b1a tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1218 microversion: 2.1 time: 0.427088 Sep 10 21:06:45.839418 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2139/4361] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:45 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1218 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:45.868936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-43b8a9e0-ebec-435c-8103-195180eafd48 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:45.869704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-43b8a9e0-ebec-435c-8103-195180eafd48 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:45.880268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43b8a9e0-ebec-435c-8103-195180eafd48 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.883167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43b8a9e0-ebec-435c-8103-195180eafd48 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.883869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43b8a9e0-ebec-435c-8103-195180eafd48 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:45.884810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43b8a9e0-ebec-435c-8103-195180eafd48 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:45.886963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43b8a9e0-ebec-435c-8103-195180eafd48 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:45.887676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-43b8a9e0-ebec-435c-8103-195180eafd48 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:46.101428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-43b8a9e0-ebec-435c-8103-195180eafd48 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:46.128834 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-43b8a9e0-ebec-435c-8103-195180eafd48 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1251 microversion: 2.1 time: 0.263860 Sep 10 21:06:46.132666 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2140/4362] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:45 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1251 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:46.248420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df3d4380-9091-4631-b179-b2324d6cb42a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:46.259771 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-df3d4380-9091-4631-b179-b2324d6cb42a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1363 microversion: 2.1 time: 0.555721 Sep 10 21:06:46.260368 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2223/4363] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:45 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1363 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:46.478917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-383a8fe4-b792-4817-8b24-6b9022b86f9a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:46.479542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-383a8fe4-b792-4817-8b24-6b9022b86f9a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:46.498416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383a8fe4-b792-4817-8b24-6b9022b86f9a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:46.508326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383a8fe4-b792-4817-8b24-6b9022b86f9a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:46.508795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383a8fe4-b792-4817-8b24-6b9022b86f9a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:46.510114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383a8fe4-b792-4817-8b24-6b9022b86f9a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:46.511272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383a8fe4-b792-4817-8b24-6b9022b86f9a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:46.512623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-383a8fe4-b792-4817-8b24-6b9022b86f9a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:46.870780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-171fb11c-4529-41c1-96d3-23bbc5beae9f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:46.871223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-171fb11c-4529-41c1-96d3-23bbc5beae9f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:46.879507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-171fb11c-4529-41c1-96d3-23bbc5beae9f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:46.880002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-171fb11c-4529-41c1-96d3-23bbc5beae9f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:46.890730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-171fb11c-4529-41c1-96d3-23bbc5beae9f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:46.891706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-171fb11c-4529-41c1-96d3-23bbc5beae9f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:46.892425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-171fb11c-4529-41c1-96d3-23bbc5beae9f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:46.893018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-171fb11c-4529-41c1-96d3-23bbc5beae9f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:47.159210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-171fb11c-4529-41c1-96d3-23bbc5beae9f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:47.178896 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-171fb11c-4529-41c1-96d3-23bbc5beae9f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1266 microversion: 2.1 time: 0.306066 Sep 10 21:06:47.191752 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2224/4364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:46 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:47.221459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a259d1ca-e80f-4ac3-9f0c-0c9461e24b6b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:47.223498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a259d1ca-e80f-4ac3-9f0c-0c9461e24b6b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:47.249331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a259d1ca-e80f-4ac3-9f0c-0c9461e24b6b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:47.251595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a259d1ca-e80f-4ac3-9f0c-0c9461e24b6b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:47.253423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a259d1ca-e80f-4ac3-9f0c-0c9461e24b6b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:47.256802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a259d1ca-e80f-4ac3-9f0c-0c9461e24b6b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:47.258378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a259d1ca-e80f-4ac3-9f0c-0c9461e24b6b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:47.259037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a259d1ca-e80f-4ac3-9f0c-0c9461e24b6b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:47.341765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-383a8fe4-b792-4817-8b24-6b9022b86f9a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:47.358244 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-383a8fe4-b792-4817-8b24-6b9022b86f9a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1323 microversion: 2.1 time: 0.888011 Sep 10 21:06:47.364304 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2141/4365] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:46 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1323 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:47.377375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9e9009e4-b90c-4a30-86e2-a626f9193e24 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:47.391339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9e9009e4-b90c-4a30-86e2-a626f9193e24 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:47.423444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e9009e4-b90c-4a30-86e2-a626f9193e24 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:47.423953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e9009e4-b90c-4a30-86e2-a626f9193e24 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:47.424398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e9009e4-b90c-4a30-86e2-a626f9193e24 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:47.425152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e9009e4-b90c-4a30-86e2-a626f9193e24 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:47.425611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e9009e4-b90c-4a30-86e2-a626f9193e24 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:47.426068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e9009e4-b90c-4a30-86e2-a626f9193e24 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:47.935313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a259d1ca-e80f-4ac3-9f0c-0c9461e24b6b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:47.943637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e9009e4-b90c-4a30-86e2-a626f9193e24 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:47.950253 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a259d1ca-e80f-4ac3-9f0c-0c9461e24b6b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1293 microversion: 2.1 time: 0.751976 Sep 10 21:06:47.950791 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2225/4366] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:47 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1293 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:47.975991 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9e9009e4-b90c-4a30-86e2-a626f9193e24 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1549 microversion: 2.1 time: 0.607020 Sep 10 21:06:47.981242 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2142/4367] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:47 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1549 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:48.002403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eb8fcbe4-45e5-4b4a-a190-dbe28e84004f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:48.003966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eb8fcbe4-45e5-4b4a-a190-dbe28e84004f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:48.021299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb8fcbe4-45e5-4b4a-a190-dbe28e84004f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:48.022939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb8fcbe4-45e5-4b4a-a190-dbe28e84004f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:48.024181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb8fcbe4-45e5-4b4a-a190-dbe28e84004f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:48.027510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb8fcbe4-45e5-4b4a-a190-dbe28e84004f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:48.028623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb8fcbe4-45e5-4b4a-a190-dbe28e84004f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:48.030471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb8fcbe4-45e5-4b4a-a190-dbe28e84004f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:48.207053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0085ea0-7eff-480b-8268-1c83e67e80a4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:48.208364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0085ea0-7eff-480b-8268-1c83e67e80a4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:48.216380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0085ea0-7eff-480b-8268-1c83e67e80a4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:48.222167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0085ea0-7eff-480b-8268-1c83e67e80a4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:48.222973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0085ea0-7eff-480b-8268-1c83e67e80a4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:48.224001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0085ea0-7eff-480b-8268-1c83e67e80a4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:48.227978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0085ea0-7eff-480b-8268-1c83e67e80a4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:48.228356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0085ea0-7eff-480b-8268-1c83e67e80a4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:48.327881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c0085ea0-7eff-480b-8268-1c83e67e80a4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:48.339285 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0085ea0-7eff-480b-8268-1c83e67e80a4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1272 microversion: 2.1 time: 0.137207 Sep 10 21:06:48.354539 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2143/4368] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:48 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:48.385031 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eb8fcbe4-45e5-4b4a-a190-dbe28e84004f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.386891 Sep 10 21:06:48.386556 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2226/4369] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:06:47 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/os-interface => generated 285 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:48.396433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8efbb76b-b38f-413e-93f4-43da91e83721 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:48.397778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8efbb76b-b38f-413e-93f4-43da91e83721 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:48.404786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8efbb76b-b38f-413e-93f4-43da91e83721 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:48.405316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8efbb76b-b38f-413e-93f4-43da91e83721 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:48.405996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8efbb76b-b38f-413e-93f4-43da91e83721 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:48.406868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8efbb76b-b38f-413e-93f4-43da91e83721 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:48.407547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8efbb76b-b38f-413e-93f4-43da91e83721 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:48.408165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8efbb76b-b38f-413e-93f4-43da91e83721 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:48.860274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8efbb76b-b38f-413e-93f4-43da91e83721 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:48.889031 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8efbb76b-b38f-413e-93f4-43da91e83721 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1323 microversion: 2.1 time: 0.509526 Sep 10 21:06:48.892132 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2144/4370] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:48 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1323 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:48.990881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b46db2e8-8394-4a69-a13f-001194c4dfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:48.994317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b46db2e8-8394-4a69-a13f-001194c4dfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:49.008263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b46db2e8-8394-4a69-a13f-001194c4dfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:49.012350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b46db2e8-8394-4a69-a13f-001194c4dfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:49.013848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b46db2e8-8394-4a69-a13f-001194c4dfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:49.015922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b46db2e8-8394-4a69-a13f-001194c4dfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:49.016865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b46db2e8-8394-4a69-a13f-001194c4dfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:49.016865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b46db2e8-8394-4a69-a13f-001194c4dfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:49.366866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d66f12d-2d6d-4223-9b08-acc6db8c253e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:49.368404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d66f12d-2d6d-4223-9b08-acc6db8c253e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:49.382605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d66f12d-2d6d-4223-9b08-acc6db8c253e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:49.385485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d66f12d-2d6d-4223-9b08-acc6db8c253e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:49.386459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d66f12d-2d6d-4223-9b08-acc6db8c253e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:49.387819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d66f12d-2d6d-4223-9b08-acc6db8c253e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:49.391648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d66f12d-2d6d-4223-9b08-acc6db8c253e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:49.393045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d66f12d-2d6d-4223-9b08-acc6db8c253e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:49.795439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b46db2e8-8394-4a69-a13f-001194c4dfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:49.797913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9d66f12d-2d6d-4223-9b08-acc6db8c253e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:49.808876 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d66f12d-2d6d-4223-9b08-acc6db8c253e tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1272 microversion: 2.1 time: 0.446843 Sep 10 21:06:49.810004 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2145/4371] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:49 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1272 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:49.828368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e4f89429-3017-4a1a-b5fc-e85d90580efb req-16c76246-8329-4b54-a920-66a524111635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73c36f9-4016-4ac2-ab6e-d56b10d6ad92", "tag": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:49.828739 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b46db2e8-8394-4a69-a13f-001194c4dfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1293 microversion: 2.1 time: 0.846606 Sep 10 21:06:49.831036 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2227/4372] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:48 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1293 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:49.845396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e4f89429-3017-4a1a-b5fc-e85d90580efb req-16c76246-8329-4b54-a920-66a524111635 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:49.848671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e4f89429-3017-4a1a-b5fc-e85d90580efb req-16c76246-8329-4b54-a920-66a524111635 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:49.849390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e4f89429-3017-4a1a-b5fc-e85d90580efb req-16c76246-8329-4b54-a920-66a524111635 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:49.878332 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e4f89429-3017-4a1a-b5fc-e85d90580efb req-16c76246-8329-4b54-a920-66a524111635 service nova] Creating event network-changed:8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22 for instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 on nch2-master-1 Sep 10 21:06:49.885117 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e4f89429-3017-4a1a-b5fc-e85d90580efb req-16c76246-8329-4b54-a920-66a524111635 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073616 Sep 10 21:06:49.886016 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2146/4373] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:49.917627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-852c8990-48df-4d4d-a7d0-7556bff6a7a7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:49.918303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-852c8990-48df-4d4d-a7d0-7556bff6a7a7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:49.931588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-852c8990-48df-4d4d-a7d0-7556bff6a7a7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:49.932087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-852c8990-48df-4d4d-a7d0-7556bff6a7a7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:49.932593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-852c8990-48df-4d4d-a7d0-7556bff6a7a7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:49.933699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-852c8990-48df-4d4d-a7d0-7556bff6a7a7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:49.934141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-852c8990-48df-4d4d-a7d0-7556bff6a7a7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:49.934572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-852c8990-48df-4d4d-a7d0-7556bff6a7a7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:50.323895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-91de742b-ad26-4bb5-b05a-b8e06a3e0f02 req-91fbdd26-85c2-4869-bafe-0a65e2d7634b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168c6843-f1e2-49ce-98ab-c49fb021e486", "tag": "c6c69f20-700c-4c4b-ae38-84570280a8c1"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:50.351773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-91de742b-ad26-4bb5-b05a-b8e06a3e0f02 req-91fbdd26-85c2-4869-bafe-0a65e2d7634b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:50.353776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-91de742b-ad26-4bb5-b05a-b8e06a3e0f02 req-91fbdd26-85c2-4869-bafe-0a65e2d7634b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:50.354624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-91de742b-ad26-4bb5-b05a-b8e06a3e0f02 req-91fbdd26-85c2-4869-bafe-0a65e2d7634b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:50.378611 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-91de742b-ad26-4bb5-b05a-b8e06a3e0f02 req-91fbdd26-85c2-4869-bafe-0a65e2d7634b service nova] Creating event network-changed:c6c69f20-700c-4c4b-ae38-84570280a8c1 for instance 168c6843-f1e2-49ce-98ab-c49fb021e486 on nch2-master-1 Sep 10 21:06:50.390347 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-91de742b-ad26-4bb5-b05a-b8e06a3e0f02 req-91fbdd26-85c2-4869-bafe-0a65e2d7634b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074479 Sep 10 21:06:50.392544 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2147/4374] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:50.833550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f3ea3bc8-d246-4c2c-96cf-c79cd99c8d53 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:50.835014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f3ea3bc8-d246-4c2c-96cf-c79cd99c8d53 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:50.857184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3ea3bc8-d246-4c2c-96cf-c79cd99c8d53 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:50.857952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3ea3bc8-d246-4c2c-96cf-c79cd99c8d53 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:50.860057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3ea3bc8-d246-4c2c-96cf-c79cd99c8d53 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:50.862061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3ea3bc8-d246-4c2c-96cf-c79cd99c8d53 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:50.864105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3ea3bc8-d246-4c2c-96cf-c79cd99c8d53 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:50.864741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3ea3bc8-d246-4c2c-96cf-c79cd99c8d53 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:50.900814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-852c8990-48df-4d4d-a7d0-7556bff6a7a7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:50.909722 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-852c8990-48df-4d4d-a7d0-7556bff6a7a7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1323 microversion: 2.1 time: 0.995997 Sep 10 21:06:50.918920 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2228/4375] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:49 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1323 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:50.924074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9aa4466d-adfe-4597-9248-27cef7921445 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:50.928892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9aa4466d-adfe-4597-9248-27cef7921445 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:50.950391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9aa4466d-adfe-4597-9248-27cef7921445 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:50.951225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9aa4466d-adfe-4597-9248-27cef7921445 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:50.951872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9aa4466d-adfe-4597-9248-27cef7921445 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:50.952851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9aa4466d-adfe-4597-9248-27cef7921445 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:50.953482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9aa4466d-adfe-4597-9248-27cef7921445 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:50.954131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9aa4466d-adfe-4597-9248-27cef7921445 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:51.069901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:51.479208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:51.496672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f3ea3bc8-d246-4c2c-96cf-c79cd99c8d53 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:51.506381 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f3ea3bc8-d246-4c2c-96cf-c79cd99c8d53 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1314 microversion: 2.1 time: 0.678232 Sep 10 21:06:51.508993 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2148/4376] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:50 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:51.788127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9aa4466d-adfe-4597-9248-27cef7921445 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:51.803704 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9aa4466d-adfe-4597-9248-27cef7921445 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1293 microversion: 2.1 time: 0.880908 Sep 10 21:06:51.803704 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2229/4377] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:50 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1293 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:51.947085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b54f3804-77b8-44fd-a2e3-508183bb9f90 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:51.948421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b54f3804-77b8-44fd-a2e3-508183bb9f90 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:51.969674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54f3804-77b8-44fd-a2e3-508183bb9f90 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:51.970944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54f3804-77b8-44fd-a2e3-508183bb9f90 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:51.971855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54f3804-77b8-44fd-a2e3-508183bb9f90 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:51.972747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54f3804-77b8-44fd-a2e3-508183bb9f90 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:51.973367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54f3804-77b8-44fd-a2e3-508183bb9f90 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:51.974143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b54f3804-77b8-44fd-a2e3-508183bb9f90 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:52.202116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b54f3804-77b8-44fd-a2e3-508183bb9f90 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:52.212973 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b54f3804-77b8-44fd-a2e3-508183bb9f90 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1323 microversion: 2.1 time: 0.273508 Sep 10 21:06:52.214075 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2149/4378] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:51 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:52.532827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12c215e1-226c-4e0b-9ae4-0b72dd5e190f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:52.534633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-12c215e1-226c-4e0b-9ae4-0b72dd5e190f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:52.540557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:52.563820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c215e1-226c-4e0b-9ae4-0b72dd5e190f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:52.564721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c215e1-226c-4e0b-9ae4-0b72dd5e190f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:52.566058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c215e1-226c-4e0b-9ae4-0b72dd5e190f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:52.567582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c215e1-226c-4e0b-9ae4-0b72dd5e190f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:52.568235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c215e1-226c-4e0b-9ae4-0b72dd5e190f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:52.570755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c215e1-226c-4e0b-9ae4-0b72dd5e190f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:52.681330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-654f6953-6005-4e4d-bed7-958718628ed8 req-6c89d660-9638-406f-a395-6d489d013b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06501f8-3bc9-4240-b2ca-514d8d6fdacb", "tag": "c83fb9d1-1d5c-4b9d-97ca-d0502fd7f74d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:52.715737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-654f6953-6005-4e4d-bed7-958718628ed8 req-6c89d660-9638-406f-a395-6d489d013b49 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:52.723297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-654f6953-6005-4e4d-bed7-958718628ed8 req-6c89d660-9638-406f-a395-6d489d013b49 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:52.724126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-654f6953-6005-4e4d-bed7-958718628ed8 req-6c89d660-9638-406f-a395-6d489d013b49 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:52.776662 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-654f6953-6005-4e4d-bed7-958718628ed8 req-6c89d660-9638-406f-a395-6d489d013b49 service nova] Creating event network-changed:c83fb9d1-1d5c-4b9d-97ca-d0502fd7f74d for instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb on nch1-master-1 Sep 10 21:06:52.788540 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-654f6953-6005-4e4d-bed7-958718628ed8 req-6c89d660-9638-406f-a395-6d489d013b49 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118173 Sep 10 21:06:52.793233 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2150/4379] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:52.830968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d51f2d99-54f0-4a0d-8ad2-c19927b7598e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:52.832978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d51f2d99-54f0-4a0d-8ad2-c19927b7598e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:52.851359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51f2d99-54f0-4a0d-8ad2-c19927b7598e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:52.853271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51f2d99-54f0-4a0d-8ad2-c19927b7598e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:52.855032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51f2d99-54f0-4a0d-8ad2-c19927b7598e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:52.856476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51f2d99-54f0-4a0d-8ad2-c19927b7598e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:52.858195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51f2d99-54f0-4a0d-8ad2-c19927b7598e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:52.859556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d51f2d99-54f0-4a0d-8ad2-c19927b7598e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:52.913597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:53.057618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-12c215e1-226c-4e0b-9ae4-0b72dd5e190f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:53.075003 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-12c215e1-226c-4e0b-9ae4-0b72dd5e190f tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1314 microversion: 2.1 time: 0.548591 Sep 10 21:06:53.092981 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2230/4380] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:52 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:53.242966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3a79fa0-96a4-44a8-8583-025e51ef14e6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:53.244460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3a79fa0-96a4-44a8-8583-025e51ef14e6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:53.259212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a79fa0-96a4-44a8-8583-025e51ef14e6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:53.264560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a79fa0-96a4-44a8-8583-025e51ef14e6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:53.265392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a79fa0-96a4-44a8-8583-025e51ef14e6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:53.266279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a79fa0-96a4-44a8-8583-025e51ef14e6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:53.266990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a79fa0-96a4-44a8-8583-025e51ef14e6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:53.267525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3a79fa0-96a4-44a8-8583-025e51ef14e6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:53.353605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d51f2d99-54f0-4a0d-8ad2-c19927b7598e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:53.366010 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d51f2d99-54f0-4a0d-8ad2-c19927b7598e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1293 microversion: 2.1 time: 0.540781 Sep 10 21:06:53.383754 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2151/4381] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:52 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1293 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:53.677553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-4e76d577-b5ba-40f4-ac07-134e2948ad26 req-fe367cbf-69a0-4e77-91c4-24fbe43e720a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb20b95-a30b-441f-8044-31e2ec39c2d0", "tag": "e4a50595-76cb-4c3a-9c35-8ec819a3846c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:53.689314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:53.726441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4e76d577-b5ba-40f4-ac07-134e2948ad26 req-fe367cbf-69a0-4e77-91c4-24fbe43e720a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:53.727292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4e76d577-b5ba-40f4-ac07-134e2948ad26 req-fe367cbf-69a0-4e77-91c4-24fbe43e720a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:53.728783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4e76d577-b5ba-40f4-ac07-134e2948ad26 req-fe367cbf-69a0-4e77-91c4-24fbe43e720a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:53.749330 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-4e76d577-b5ba-40f4-ac07-134e2948ad26 req-fe367cbf-69a0-4e77-91c4-24fbe43e720a service nova] Creating event network-changed:e4a50595-76cb-4c3a-9c35-8ec819a3846c for instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 on nch1-master-1 Sep 10 21:06:53.755620 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-4e76d577-b5ba-40f4-ac07-134e2948ad26 req-fe367cbf-69a0-4e77-91c4-24fbe43e720a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086966 Sep 10 21:06:53.757374 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2152/4382] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:54.103879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79cd6a07-6c4b-40c4-813b-fba73bc6df27 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:54.105087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-79cd6a07-6c4b-40c4-813b-fba73bc6df27 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:54.113016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79cd6a07-6c4b-40c4-813b-fba73bc6df27 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:54.113850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79cd6a07-6c4b-40c4-813b-fba73bc6df27 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:54.114797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79cd6a07-6c4b-40c4-813b-fba73bc6df27 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:54.116666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79cd6a07-6c4b-40c4-813b-fba73bc6df27 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:54.117176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79cd6a07-6c4b-40c4-813b-fba73bc6df27 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:54.117941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79cd6a07-6c4b-40c4-813b-fba73bc6df27 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:54.280041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-79cd6a07-6c4b-40c4-813b-fba73bc6df27 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:54.290161 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-79cd6a07-6c4b-40c4-813b-fba73bc6df27 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1314 microversion: 2.1 time: 0.193046 Sep 10 21:06:54.306322 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2153/4383] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:54 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:54.404194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-47462b30-e5d0-40fb-93e7-e36b421db486 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:54.405235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-47462b30-e5d0-40fb-93e7-e36b421db486 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:54.408159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=16 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:54.417013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47462b30-e5d0-40fb-93e7-e36b421db486 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:54.417816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47462b30-e5d0-40fb-93e7-e36b421db486 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:54.418484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47462b30-e5d0-40fb-93e7-e36b421db486 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:54.419387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47462b30-e5d0-40fb-93e7-e36b421db486 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:54.420054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47462b30-e5d0-40fb-93e7-e36b421db486 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:54.420691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47462b30-e5d0-40fb-93e7-e36b421db486 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:54.448078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f3a79fa0-96a4-44a8-8583-025e51ef14e6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:54.465707 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3a79fa0-96a4-44a8-8583-025e51ef14e6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1323 microversion: 2.1 time: 1.229693 Sep 10 21:06:54.488418 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2231/4384] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:53 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1323 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:54.589334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-47462b30-e5d0-40fb-93e7-e36b421db486 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:54.597621 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-47462b30-e5d0-40fb-93e7-e36b421db486 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1293 microversion: 2.1 time: 0.197472 Sep 10 21:06:54.598440 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2154/4385] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:54 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1293 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:55.327635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-767e4574-4c74-433b-9f9b-adfef3419518 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:55.328228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-767e4574-4c74-433b-9f9b-adfef3419518 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:55.337724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-767e4574-4c74-433b-9f9b-adfef3419518 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:55.338255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-767e4574-4c74-433b-9f9b-adfef3419518 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:55.339161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-767e4574-4c74-433b-9f9b-adfef3419518 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:55.339747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-767e4574-4c74-433b-9f9b-adfef3419518 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:55.340984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-767e4574-4c74-433b-9f9b-adfef3419518 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:55.341686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-767e4574-4c74-433b-9f9b-adfef3419518 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:55.497741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-60a7907d-4204-4771-81df-6339908fea2e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:55.499073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-60a7907d-4204-4771-81df-6339908fea2e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:55.515991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60a7907d-4204-4771-81df-6339908fea2e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:55.516825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60a7907d-4204-4771-81df-6339908fea2e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:55.520088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60a7907d-4204-4771-81df-6339908fea2e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:55.522214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60a7907d-4204-4771-81df-6339908fea2e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:55.524317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60a7907d-4204-4771-81df-6339908fea2e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:55.525772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60a7907d-4204-4771-81df-6339908fea2e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:55.753055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-60a7907d-4204-4771-81df-6339908fea2e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:55.765699 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-60a7907d-4204-4771-81df-6339908fea2e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1323 microversion: 2.1 time: 0.272763 Sep 10 21:06:55.779701 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2155/4386] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:55 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1323 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:06:55.790814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1198f820-d0ce-4601-8824-d7afd38c1ff0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:55.791738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1198f820-d0ce-4601-8824-d7afd38c1ff0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:55.799206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1198f820-d0ce-4601-8824-d7afd38c1ff0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:55.799998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1198f820-d0ce-4601-8824-d7afd38c1ff0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:55.800647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1198f820-d0ce-4601-8824-d7afd38c1ff0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:55.801857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1198f820-d0ce-4601-8824-d7afd38c1ff0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:55.802856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1198f820-d0ce-4601-8824-d7afd38c1ff0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:55.803558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1198f820-d0ce-4601-8824-d7afd38c1ff0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:55.842390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-767e4574-4c74-433b-9f9b-adfef3419518 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:55.858202 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-767e4574-4c74-433b-9f9b-adfef3419518 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1314 microversion: 2.1 time: 0.543098 Sep 10 21:06:55.859421 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2232/4387] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:55 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:56.156998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1198f820-d0ce-4601-8824-d7afd38c1ff0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:56.169800 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1198f820-d0ce-4601-8824-d7afd38c1ff0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1293 microversion: 2.1 time: 0.388618 Sep 10 21:06:56.171085 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2156/4388] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:55 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1293 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:56.794542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e962c36c-f09f-4571-8c6d-a075083f292f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:56.795708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e962c36c-f09f-4571-8c6d-a075083f292f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:56.816017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e962c36c-f09f-4571-8c6d-a075083f292f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:56.817779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e962c36c-f09f-4571-8c6d-a075083f292f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:56.818313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e962c36c-f09f-4571-8c6d-a075083f292f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:56.823100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e962c36c-f09f-4571-8c6d-a075083f292f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:56.823594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e962c36c-f09f-4571-8c6d-a075083f292f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:56.827068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e962c36c-f09f-4571-8c6d-a075083f292f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:56.886392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2c1901a-28fc-4400-81f1-93453eb142b0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:56.888410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c2c1901a-28fc-4400-81f1-93453eb142b0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:56.905517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2c1901a-28fc-4400-81f1-93453eb142b0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:56.908462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2c1901a-28fc-4400-81f1-93453eb142b0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:56.909195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2c1901a-28fc-4400-81f1-93453eb142b0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:56.911743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2c1901a-28fc-4400-81f1-93453eb142b0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:56.914328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2c1901a-28fc-4400-81f1-93453eb142b0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:56.915190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2c1901a-28fc-4400-81f1-93453eb142b0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:57.234108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c2c1901a-28fc-4400-81f1-93453eb142b0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:57.246879 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c2c1901a-28fc-4400-81f1-93453eb142b0 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1314 microversion: 2.1 time: 0.368511 Sep 10 21:06:57.247486 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2157/4389] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:56 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:57.255002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8123c2ea-6f42-4a23-a2f8-1b9f4e51d3a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:57.256381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8123c2ea-6f42-4a23-a2f8-1b9f4e51d3a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:57.282331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8123c2ea-6f42-4a23-a2f8-1b9f4e51d3a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:57.283215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8123c2ea-6f42-4a23-a2f8-1b9f4e51d3a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:57.283863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8123c2ea-6f42-4a23-a2f8-1b9f4e51d3a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:57.284803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8123c2ea-6f42-4a23-a2f8-1b9f4e51d3a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:57.285455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8123c2ea-6f42-4a23-a2f8-1b9f4e51d3a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:57.286284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8123c2ea-6f42-4a23-a2f8-1b9f4e51d3a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:57.294014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e962c36c-f09f-4571-8c6d-a075083f292f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:57.309168 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e962c36c-f09f-4571-8c6d-a075083f292f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1323 microversion: 2.1 time: 0.517249 Sep 10 21:06:57.310333 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2233/4390] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:56 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1323 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:57.385333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-737f17d4-5a35-48aa-a5ca-1245fd4b56ce req-193127cb-7ee8-4db8-888e-ce6bb8e2f11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73c36f9-4016-4ac2-ab6e-d56b10d6ad92", "name": "network-vif-plugged", "status": "completed", "tag": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:57.402057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-737f17d4-5a35-48aa-a5ca-1245fd4b56ce req-193127cb-7ee8-4db8-888e-ce6bb8e2f11d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:57.404229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-737f17d4-5a35-48aa-a5ca-1245fd4b56ce req-193127cb-7ee8-4db8-888e-ce6bb8e2f11d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:57.404909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-737f17d4-5a35-48aa-a5ca-1245fd4b56ce req-193127cb-7ee8-4db8-888e-ce6bb8e2f11d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:57.440547 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-737f17d4-5a35-48aa-a5ca-1245fd4b56ce req-193127cb-7ee8-4db8-888e-ce6bb8e2f11d service nova] Creating event network-vif-plugged:8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22 for instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 on nch2-master-1 Sep 10 21:06:57.450682 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-737f17d4-5a35-48aa-a5ca-1245fd4b56ce req-193127cb-7ee8-4db8-888e-ce6bb8e2f11d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068332 Sep 10 21:06:57.451313 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2234/4391] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:06:57.645425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8123c2ea-6f42-4a23-a2f8-1b9f4e51d3a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:57.656746 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8123c2ea-6f42-4a23-a2f8-1b9f4e51d3a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1293 microversion: 2.1 time: 0.408001 Sep 10 21:06:57.660711 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2158/4392] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:57 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1293 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:58.274989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-97c337c0-e4d8-49b9-b8e7-85e2e88075d4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:58.275917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-97c337c0-e4d8-49b9-b8e7-85e2e88075d4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:58.285769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c337c0-e4d8-49b9-b8e7-85e2e88075d4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:58.286848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c337c0-e4d8-49b9-b8e7-85e2e88075d4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:58.287761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c337c0-e4d8-49b9-b8e7-85e2e88075d4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:58.288728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c337c0-e4d8-49b9-b8e7-85e2e88075d4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:58.290733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c337c0-e4d8-49b9-b8e7-85e2e88075d4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:58.299224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97c337c0-e4d8-49b9-b8e7-85e2e88075d4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:58.336293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91ef4731-673d-41df-98b0-2ab93e5dfae4 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:58.337448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-91ef4731-673d-41df-98b0-2ab93e5dfae4 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:58.383108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ef4731-673d-41df-98b0-2ab93e5dfae4 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:58.384664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ef4731-673d-41df-98b0-2ab93e5dfae4 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:58.386443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ef4731-673d-41df-98b0-2ab93e5dfae4 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:58.387341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ef4731-673d-41df-98b0-2ab93e5dfae4 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:58.388760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ef4731-673d-41df-98b0-2ab93e5dfae4 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:58.391802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ef4731-673d-41df-98b0-2ab93e5dfae4 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:58.719888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-91ef4731-673d-41df-98b0-2ab93e5dfae4 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:58.728962 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91ef4731-673d-41df-98b0-2ab93e5dfae4 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1323 microversion: 2.1 time: 0.399829 Sep 10 21:06:58.729556 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2159/4393] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:58 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1323 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:58.742310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-95000c02-64c7-49f4-91d8-e5d7302b9043 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:58.745289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-95000c02-64c7-49f4-91d8-e5d7302b9043 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:58.748682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-97c337c0-e4d8-49b9-b8e7-85e2e88075d4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:58.762029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95000c02-64c7-49f4-91d8-e5d7302b9043 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:58.762969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95000c02-64c7-49f4-91d8-e5d7302b9043 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:58.763750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95000c02-64c7-49f4-91d8-e5d7302b9043 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:58.764703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95000c02-64c7-49f4-91d8-e5d7302b9043 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:58.766405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95000c02-64c7-49f4-91d8-e5d7302b9043 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:58.769313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95000c02-64c7-49f4-91d8-e5d7302b9043 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:58.774741 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-97c337c0-e4d8-49b9-b8e7-85e2e88075d4 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1314 microversion: 2.1 time: 0.502188 Sep 10 21:06:58.775977 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2235/4394] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:58 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:59.171097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-95000c02-64c7-49f4-91d8-e5d7302b9043 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:06:59.183311 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-95000c02-64c7-49f4-91d8-e5d7302b9043 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1293 microversion: 2.1 time: 0.449500 Sep 10 21:06:59.189969 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2160/4395] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:58 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1293 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:06:59.480990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d152a7f0-8880-4c30-93c4-de11cfa18c8a req-6123f55e-756c-42cd-8fbe-830f3bfa9f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168c6843-f1e2-49ce-98ab-c49fb021e486", "name": "network-vif-plugged", "status": "completed", "tag": "c6c69f20-700c-4c4b-ae38-84570280a8c1"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:06:59.503205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d152a7f0-8880-4c30-93c4-de11cfa18c8a req-6123f55e-756c-42cd-8fbe-830f3bfa9f80 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:59.505776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d152a7f0-8880-4c30-93c4-de11cfa18c8a req-6123f55e-756c-42cd-8fbe-830f3bfa9f80 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:59.507355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d152a7f0-8880-4c30-93c4-de11cfa18c8a req-6123f55e-756c-42cd-8fbe-830f3bfa9f80 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:59.513302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:06:59.540989 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d152a7f0-8880-4c30-93c4-de11cfa18c8a req-6123f55e-756c-42cd-8fbe-830f3bfa9f80 service nova] Creating event network-vif-plugged:c6c69f20-700c-4c4b-ae38-84570280a8c1 for instance 168c6843-f1e2-49ce-98ab-c49fb021e486 on nch2-master-1 Sep 10 21:06:59.546948 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d152a7f0-8880-4c30-93c4-de11cfa18c8a req-6123f55e-756c-42cd-8fbe-830f3bfa9f80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069583 Sep 10 21:06:59.548542 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2236/4396] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:06:59.759903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79a1240d-3a96-43a1-afb2-35fe3bcd4efd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:59.769110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-79a1240d-3a96-43a1-afb2-35fe3bcd4efd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:59.793414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79a1240d-3a96-43a1-afb2-35fe3bcd4efd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:59.795997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79a1240d-3a96-43a1-afb2-35fe3bcd4efd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:59.796764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79a1240d-3a96-43a1-afb2-35fe3bcd4efd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:59.799035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79a1240d-3a96-43a1-afb2-35fe3bcd4efd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:59.810359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6f0bdbd-193a-4828-9fba-3fe08cf5db25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:06:59.811714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f6f0bdbd-193a-4828-9fba-3fe08cf5db25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:06:59.815774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79a1240d-3a96-43a1-afb2-35fe3bcd4efd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:59.817673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79a1240d-3a96-43a1-afb2-35fe3bcd4efd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:59.848560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6f0bdbd-193a-4828-9fba-3fe08cf5db25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:59.849080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6f0bdbd-193a-4828-9fba-3fe08cf5db25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:59.853294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6f0bdbd-193a-4828-9fba-3fe08cf5db25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:06:59.859163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6f0bdbd-193a-4828-9fba-3fe08cf5db25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:06:59.860012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6f0bdbd-193a-4828-9fba-3fe08cf5db25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:06:59.860616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6f0bdbd-193a-4828-9fba-3fe08cf5db25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:00.309579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f6f0bdbd-193a-4828-9fba-3fe08cf5db25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:00.319899 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f6f0bdbd-193a-4828-9fba-3fe08cf5db25 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1314 microversion: 2.1 time: 0.517737 Sep 10 21:07:00.324654 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2237/4397] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:59 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:00.332223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ccded3fa-6d89-4cfe-a2da-a0ebe1e05e36 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:00.337612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ccded3fa-6d89-4cfe-a2da-a0ebe1e05e36 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:00.351506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccded3fa-6d89-4cfe-a2da-a0ebe1e05e36 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:00.355126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccded3fa-6d89-4cfe-a2da-a0ebe1e05e36 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:00.355766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccded3fa-6d89-4cfe-a2da-a0ebe1e05e36 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:00.358113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccded3fa-6d89-4cfe-a2da-a0ebe1e05e36 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:00.358753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccded3fa-6d89-4cfe-a2da-a0ebe1e05e36 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:00.361029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccded3fa-6d89-4cfe-a2da-a0ebe1e05e36 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:00.645606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-79a1240d-3a96-43a1-afb2-35fe3bcd4efd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:00.670243 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-79a1240d-3a96-43a1-afb2-35fe3bcd4efd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1518 microversion: 2.1 time: 0.917156 Sep 10 21:07:00.682149 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2161/4398] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:06:59 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1518 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:00.708278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ff3b06dc-80f8-44f4-a145-7bd91a0713b7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Action: 'create', calling method: .version_select at 0x7f993fa13af0>, body: {"pool": null} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:00.732061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ccded3fa-6d89-4cfe-a2da-a0ebe1e05e36 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:00.747737 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ccded3fa-6d89-4cfe-a2da-a0ebe1e05e36 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1293 microversion: 2.1 time: 0.419929 Sep 10 21:07:00.748599 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2238/4399] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:00 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1293 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:01.348403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-348323fb-5bd7-4723-a8a1-b8506290f4a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:01.350005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-348323fb-5bd7-4723-a8a1-b8506290f4a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:01.367584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-348323fb-5bd7-4723-a8a1-b8506290f4a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:01.368263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-348323fb-5bd7-4723-a8a1-b8506290f4a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:01.368717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-348323fb-5bd7-4723-a8a1-b8506290f4a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:01.369466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-348323fb-5bd7-4723-a8a1-b8506290f4a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:01.370088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-348323fb-5bd7-4723-a8a1-b8506290f4a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:01.370818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-348323fb-5bd7-4723-a8a1-b8506290f4a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:01.825964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-348323fb-5bd7-4723-a8a1-b8506290f4a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:01.840354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-348323fb-5bd7-4723-a8a1-b8506290f4a1 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1314 microversion: 2.1 time: 0.496431 Sep 10 21:07:01.856588 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2239/4400] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:01 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:01.856588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0dd25b27-bee2-4ae0-bf52-d55f67649305 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:01.856588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0dd25b27-bee2-4ae0-bf52-d55f67649305 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:01.877142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd25b27-bee2-4ae0-bf52-d55f67649305 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:01.877739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd25b27-bee2-4ae0-bf52-d55f67649305 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:01.878494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd25b27-bee2-4ae0-bf52-d55f67649305 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:01.880031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd25b27-bee2-4ae0-bf52-d55f67649305 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:01.881310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd25b27-bee2-4ae0-bf52-d55f67649305 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:01.881955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0dd25b27-bee2-4ae0-bf52-d55f67649305 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:02.137570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0dd25b27-bee2-4ae0-bf52-d55f67649305 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:02.185288 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0dd25b27-bee2-4ae0-bf52-d55f67649305 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1473 microversion: 2.1 time: 0.340920 Sep 10 21:07:02.188767 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2240/4401] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:01 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1473 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:02.373199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8e087900-b805-40c4-b5fe-6183f2567901 req-5934bf6b-305e-499d-a96a-487f3ea5da46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb20b95-a30b-441f-8044-31e2ec39c2d0", "name": "network-vif-plugged", "status": "completed", "tag": "e4a50595-76cb-4c3a-9c35-8ec819a3846c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:02.400225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8e087900-b805-40c4-b5fe-6183f2567901 req-5934bf6b-305e-499d-a96a-487f3ea5da46 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:02.403315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8e087900-b805-40c4-b5fe-6183f2567901 req-5934bf6b-305e-499d-a96a-487f3ea5da46 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:02.403716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8e087900-b805-40c4-b5fe-6183f2567901 req-5934bf6b-305e-499d-a96a-487f3ea5da46 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:02.440626 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8e087900-b805-40c4-b5fe-6183f2567901 req-5934bf6b-305e-499d-a96a-487f3ea5da46 service nova] Creating event network-vif-plugged:e4a50595-76cb-4c3a-9c35-8ec819a3846c for instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 on nch1-master-1 Sep 10 21:07:02.451825 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8e087900-b805-40c4-b5fe-6183f2567901 req-5934bf6b-305e-499d-a96a-487f3ea5da46 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080865 Sep 10 21:07:02.453367 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2241/4402] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:07:02.465559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-370364568", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:02.562717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] validate_networks() for [('75842dc4-d668-416f-9bad-afa9ac1ec517', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:07:03.700757 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ff3b06dc-80f8-44f4-a145-7bd91a0713b7 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.996176 Sep 10 21:07:03.701566 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2162/4403] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Sep 10 21:07:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:07:03.706904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0458ab14-80c5-4fa7-a59b-acc4abc85e15 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:03.707528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0458ab14-80c5-4fa7-a59b-acc4abc85e15 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:03.715488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0458ab14-80c5-4fa7-a59b-acc4abc85e15 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:03.731671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0458ab14-80c5-4fa7-a59b-acc4abc85e15 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:03.732910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0458ab14-80c5-4fa7-a59b-acc4abc85e15 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:03.734621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0458ab14-80c5-4fa7-a59b-acc4abc85e15 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:03.737295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0458ab14-80c5-4fa7-a59b-acc4abc85e15 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:03.737598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0458ab14-80c5-4fa7-a59b-acc4abc85e15 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:03.738600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:07:03.739105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:07:03.739490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:07:03.740837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:07:03.741221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:07:03.759526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:03.760027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:03.760769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:03.761207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:03.765172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:03.766169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:03.809157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:07:03.820486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for user 6bfa3af0a7284bc6854f2c9c58392935 and project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:07:03.849155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:07:03.853571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5c347df6-deac-46b3-8a61-13f2ef0604d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:07:03.954546 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59f13a0c-97cb-45c1-9d93-e37aa35ed414 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499801 Sep 10 21:07:03.955514 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2242/4404] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:07:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:07:03.968659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1609045446", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "a53f27f3-ecaa-4250-a852-1d8a7bb068e9"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:03.999325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0458ab14-80c5-4fa7-a59b-acc4abc85e15 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:04.018780 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0458ab14-80c5-4fa7-a59b-acc4abc85e15 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1314 microversion: 2.1 time: 0.315879 Sep 10 21:07:04.022333 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2163/4405] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:03 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:04.036146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d9c4181b-aa55-4294-9d10-26c34018d3d6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:04.042379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d9c4181b-aa55-4294-9d10-26c34018d3d6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5c347df6-deac-46b3-8a61-13f2ef0604d7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:04.075453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d9c4181b-aa55-4294-9d10-26c34018d3d6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5c347df6-deac-46b3-8a61-13f2ef0604d7] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:07:04.125900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] validate_networks() for [('a53f27f3-ecaa-4250-a852-1d8a7bb068e9', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:07:04.423646 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d9c4181b-aa55-4294-9d10-26c34018d3d6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7" status: 204 len: 0 microversion: 2.1 time: 0.398259 Sep 10 21:07:04.429606 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2164/4406] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:04 2022] DELETE /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:07:04.444126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4320a5ae-88fd-41a8-8c4b-c901eaec5a88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:04.444937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4320a5ae-88fd-41a8-8c4b-c901eaec5a88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5c347df6-deac-46b3-8a61-13f2ef0604d7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:04.517718 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-4320a5ae-88fd-41a8-8c4b-c901eaec5a88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4320a5ae-88fd-41a8-8c4b-c901eaec5a88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7 HTTP/1.1 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5c347df6-deac-46b3-8a61-13f2ef0604d7'} Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:04.520801 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:07:04.526639 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:04.529220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4320a5ae-88fd-41a8-8c4b-c901eaec5a88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:04.542520 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4320a5ae-88fd-41a8-8c4b-c901eaec5a88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7" status: 404 len: 111 microversion: 2.1 time: 0.097462 Sep 10 21:07:04.543378 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2165/4407] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:04 2022] GET /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:04.829010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1128054353", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "75842dc4-d668-416f-9bad-afa9ac1ec517"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:04.925945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] validate_networks() for [('75842dc4-d668-416f-9bad-afa9ac1ec517', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:07:05.413605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:07:05.415485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:07:05.416108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:07:05.417665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:07:05.418236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:07:05.432723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:05.433786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:05.434903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:05.436082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:05.437243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:05.438250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:05.486049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Getting quotas for project ceebf89c39014750ae279e0741a0bb79. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:07:05.494478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Getting quotas for user 9546792be5a640e2a59fb2e8481c6c4b and project ceebf89c39014750ae279e0741a0bb79. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:07:05.512639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:07:05.526034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:07:05.632771 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2cd3cc9d-35fa-40d0-bb00-766824e7e2d0 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.668887 Sep 10 21:07:05.641668 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2243/4408] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:07:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:07:05.650015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-320e926a-9ddd-4130-8a24-87f8588497ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:05.650724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-320e926a-9ddd-4130-8a24-87f8588497ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:05.658838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-320e926a-9ddd-4130-8a24-87f8588497ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:05.659527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-320e926a-9ddd-4130-8a24-87f8588497ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:05.660226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-320e926a-9ddd-4130-8a24-87f8588497ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:05.661219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-320e926a-9ddd-4130-8a24-87f8588497ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:05.662873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-320e926a-9ddd-4130-8a24-87f8588497ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:05.663776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-320e926a-9ddd-4130-8a24-87f8588497ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:05.810610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:07:05.812267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:07:05.813182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:07:05.814556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:07:05.816371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:07:05.854704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:05.858565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:05.859022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:05.865255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:05.867159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:05.870315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:05.920329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:07:05.937182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for user 6bfa3af0a7284bc6854f2c9c58392935 and project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:07:05.971125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:05.973438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:07:05.978369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:07:06.085851 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4108f0a1-cdaa-453d-a74e-51803bade908 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.259162 Sep 10 21:07:06.086524 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2166/4409] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:07:06.099785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fc14895c-dee9-41ad-9402-334c1ce22087 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:06.102825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fc14895c-dee9-41ad-9402-334c1ce22087 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:06.209731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fc14895c-dee9-41ad-9402-334c1ce22087 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:06.218449 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fc14895c-dee9-41ad-9402-334c1ce22087 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1224 microversion: 2.1 time: 0.130870 Sep 10 21:07:06.219676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2167/4410] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:06 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1224 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:06.226946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8288bb9d-3877-414f-8a87-34ee4ed01948 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:06.229297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8288bb9d-3877-414f-8a87-34ee4ed01948 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:06.406550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-320e926a-9ddd-4130-8a24-87f8588497ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:06.432348 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-320e926a-9ddd-4130-8a24-87f8588497ed tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1500 microversion: 2.1 time: 0.789536 Sep 10 21:07:06.434433 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2244/4411] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:05 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1500 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:06.437849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8288bb9d-3877-414f-8a87-34ee4ed01948 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:06.464181 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8288bb9d-3877-414f-8a87-34ee4ed01948 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1221 microversion: 2.1 time: 0.242958 Sep 10 21:07:06.470141 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2168/4412] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:06 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1221 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:06.476140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1b19125b-29f8-4642-98c6-eaccb5241223 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:06.479994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1b19125b-29f8-4642-98c6-eaccb5241223 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:06.494618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b19125b-29f8-4642-98c6-eaccb5241223 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:06.498143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b19125b-29f8-4642-98c6-eaccb5241223 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:06.498790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b19125b-29f8-4642-98c6-eaccb5241223 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:06.499725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b19125b-29f8-4642-98c6-eaccb5241223 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:06.502912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b19125b-29f8-4642-98c6-eaccb5241223 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:06.503616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b19125b-29f8-4642-98c6-eaccb5241223 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:06.569688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-1b19125b-29f8-4642-98c6-eaccb5241223 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lazy-loading 'flavor' on Instance uuid 4cb20b95-a30b-441f-8044-31e2ec39c2d0 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:07:06.711181 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1b19125b-29f8-4642-98c6-eaccb5241223 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "POST /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0/action" status: 202 len: 0 microversion: 2.1 time: 0.249663 Sep 10 21:07:06.713792 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2245/4413] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:07:06 2022] POST /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:07:06.722806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-21ae691a-e129-46be-88a6-7798230abf86 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:06.723999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-21ae691a-e129-46be-88a6-7798230abf86 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:06.736227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21ae691a-e129-46be-88a6-7798230abf86 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:06.736696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21ae691a-e129-46be-88a6-7798230abf86 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:06.737149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21ae691a-e129-46be-88a6-7798230abf86 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:06.737897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21ae691a-e129-46be-88a6-7798230abf86 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:06.738374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21ae691a-e129-46be-88a6-7798230abf86 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:06.748813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21ae691a-e129-46be-88a6-7798230abf86 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:07.161213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-21ae691a-e129-46be-88a6-7798230abf86 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:07.172476 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-21ae691a-e129-46be-88a6-7798230abf86 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1508 microversion: 2.1 time: 0.456053 Sep 10 21:07:07.176827 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2169/4414] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:06 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:07.249162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a6e2f8cf-9016-493b-9e14-0cb0a1d56135 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:07.250415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a6e2f8cf-9016-493b-9e14-0cb0a1d56135 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:07.260505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6e2f8cf-9016-493b-9e14-0cb0a1d56135 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:07.261047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6e2f8cf-9016-493b-9e14-0cb0a1d56135 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:07.261500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6e2f8cf-9016-493b-9e14-0cb0a1d56135 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:07.262970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6e2f8cf-9016-493b-9e14-0cb0a1d56135 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:07.263418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6e2f8cf-9016-493b-9e14-0cb0a1d56135 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:07.263941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6e2f8cf-9016-493b-9e14-0cb0a1d56135 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:07.446322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a6e2f8cf-9016-493b-9e14-0cb0a1d56135 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:07.465249 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a6e2f8cf-9016-493b-9e14-0cb0a1d56135 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1276 microversion: 2.1 time: 0.221580 Sep 10 21:07:07.466036 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2246/4415] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:07 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:07.498877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-febee55b-e8b2-4f74-a7d5-6920d7460524 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:07.499508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-febee55b-e8b2-4f74-a7d5-6920d7460524 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:07.506686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-febee55b-e8b2-4f74-a7d5-6920d7460524 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:07.508107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-febee55b-e8b2-4f74-a7d5-6920d7460524 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:07.514667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-febee55b-e8b2-4f74-a7d5-6920d7460524 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:07.515428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-febee55b-e8b2-4f74-a7d5-6920d7460524 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:07.516015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-febee55b-e8b2-4f74-a7d5-6920d7460524 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:07.516318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-febee55b-e8b2-4f74-a7d5-6920d7460524 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:07.664526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-febee55b-e8b2-4f74-a7d5-6920d7460524 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:07.688968 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-febee55b-e8b2-4f74-a7d5-6920d7460524 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1217 microversion: 2.1 time: 0.194486 Sep 10 21:07:07.704954 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2170/4416] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:07 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:08.203254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f09f97d6-0917-4bce-9bea-2081ab0679ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:08.204395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f09f97d6-0917-4bce-9bea-2081ab0679ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:08.253021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f09f97d6-0917-4bce-9bea-2081ab0679ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:08.253734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f09f97d6-0917-4bce-9bea-2081ab0679ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:08.261011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f09f97d6-0917-4bce-9bea-2081ab0679ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:08.267140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f09f97d6-0917-4bce-9bea-2081ab0679ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:08.273257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f09f97d6-0917-4bce-9bea-2081ab0679ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:08.275835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f09f97d6-0917-4bce-9bea-2081ab0679ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:08.494014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9ef46cf-9724-476c-a3f5-46bb2cdad4cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:08.494606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9ef46cf-9724-476c-a3f5-46bb2cdad4cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:08.503887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ef46cf-9724-476c-a3f5-46bb2cdad4cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:08.504378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ef46cf-9724-476c-a3f5-46bb2cdad4cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:08.504816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ef46cf-9724-476c-a3f5-46bb2cdad4cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:08.514167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ef46cf-9724-476c-a3f5-46bb2cdad4cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:08.514855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ef46cf-9724-476c-a3f5-46bb2cdad4cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:08.515304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ef46cf-9724-476c-a3f5-46bb2cdad4cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:08.733609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f09f97d6-0917-4bce-9bea-2081ab0679ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:08.734954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a9ef46cf-9724-476c-a3f5-46bb2cdad4cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:08.750771 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f09f97d6-0917-4bce-9bea-2081ab0679ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1491 microversion: 2.1 time: 0.553907 Sep 10 21:07:08.751366 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2247/4417] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:08 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1491 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:08.777316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5b530eb3-db2d-48f1-aa97-f66ff1a381a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:08.778603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5b530eb3-db2d-48f1-aa97-f66ff1a381a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:08.788500 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9ef46cf-9724-476c-a3f5-46bb2cdad4cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1282 microversion: 2.1 time: 0.298977 Sep 10 21:07:08.796171 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2171/4418] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:08 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1282 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:08.798590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b530eb3-db2d-48f1-aa97-f66ff1a381a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:08.802698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b530eb3-db2d-48f1-aa97-f66ff1a381a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:08.808425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b530eb3-db2d-48f1-aa97-f66ff1a381a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:08.823059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-12d45430-e707-4006-8373-272357d54bc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:08.830231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b530eb3-db2d-48f1-aa97-f66ff1a381a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:08.830835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b530eb3-db2d-48f1-aa97-f66ff1a381a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:08.831376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b530eb3-db2d-48f1-aa97-f66ff1a381a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:08.836679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-12d45430-e707-4006-8373-272357d54bc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:08.855942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12d45430-e707-4006-8373-272357d54bc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:08.856855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12d45430-e707-4006-8373-272357d54bc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:08.866266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12d45430-e707-4006-8373-272357d54bc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:08.867507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12d45430-e707-4006-8373-272357d54bc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:08.868022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12d45430-e707-4006-8373-272357d54bc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:08.868578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-12d45430-e707-4006-8373-272357d54bc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:08.940348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-12d45430-e707-4006-8373-272357d54bc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:07:09.047419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5b530eb3-db2d-48f1-aa97-f66ff1a381a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:09.071763 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5b530eb3-db2d-48f1-aa97-f66ff1a381a0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1273 microversion: 2.1 time: 0.318187 Sep 10 21:07:09.094916 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2248/4419] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:08 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:09.106293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:09.185310 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-12d45430-e707-4006-8373-272357d54bc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 204 len: 0 microversion: 2.1 time: 0.387464 Sep 10 21:07:09.187167 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2172/4420] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:08 2022] DELETE /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:07:09.199790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3d091718-5623-405c-8f9c-f27cdccae275 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:09.200526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3d091718-5623-405c-8f9c-f27cdccae275 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:09.209983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d091718-5623-405c-8f9c-f27cdccae275 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:09.210667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d091718-5623-405c-8f9c-f27cdccae275 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:09.211207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d091718-5623-405c-8f9c-f27cdccae275 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:09.212964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d091718-5623-405c-8f9c-f27cdccae275 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:09.214436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d091718-5623-405c-8f9c-f27cdccae275 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:09.215004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d091718-5623-405c-8f9c-f27cdccae275 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:09.665342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3d091718-5623-405c-8f9c-f27cdccae275 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:09.680273 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3d091718-5623-405c-8f9c-f27cdccae275 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1497 microversion: 2.1 time: 0.486939 Sep 10 21:07:09.681257 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2249/4421] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:09 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1497 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:09.823274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-de04e45b-f16a-48f1-82f7-77c7014eaa77 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:09.824598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-de04e45b-f16a-48f1-82f7-77c7014eaa77 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:09.842154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de04e45b-f16a-48f1-82f7-77c7014eaa77 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:09.843031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de04e45b-f16a-48f1-82f7-77c7014eaa77 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:09.843706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de04e45b-f16a-48f1-82f7-77c7014eaa77 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:09.844649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de04e45b-f16a-48f1-82f7-77c7014eaa77 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:09.845478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de04e45b-f16a-48f1-82f7-77c7014eaa77 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:09.846291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-de04e45b-f16a-48f1-82f7-77c7014eaa77 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:10.098936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d87a8025-4caa-4296-982b-2aadfe418bdc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:10.101578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d87a8025-4caa-4296-982b-2aadfe418bdc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:10.134259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d87a8025-4caa-4296-982b-2aadfe418bdc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:10.135087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d87a8025-4caa-4296-982b-2aadfe418bdc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:10.135731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d87a8025-4caa-4296-982b-2aadfe418bdc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:10.136630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d87a8025-4caa-4296-982b-2aadfe418bdc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:10.137249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d87a8025-4caa-4296-982b-2aadfe418bdc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:10.137901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d87a8025-4caa-4296-982b-2aadfe418bdc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:10.365945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d87a8025-4caa-4296-982b-2aadfe418bdc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:10.380871 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d87a8025-4caa-4296-982b-2aadfe418bdc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1279 microversion: 2.1 time: 0.286778 Sep 10 21:07:10.381724 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2250/4422] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:10 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1279 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:10.650874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-de04e45b-f16a-48f1-82f7-77c7014eaa77 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:10.662717 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-de04e45b-f16a-48f1-82f7-77c7014eaa77 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1324 microversion: 2.1 time: 0.845074 Sep 10 21:07:10.664502 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2173/4423] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:09 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1324 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:10.708522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-89b4c038-6062-44eb-baec-0a63dae818c5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:10.709245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-89b4c038-6062-44eb-baec-0a63dae818c5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:10.724471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b4c038-6062-44eb-baec-0a63dae818c5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:10.725049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b4c038-6062-44eb-baec-0a63dae818c5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:10.726108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b4c038-6062-44eb-baec-0a63dae818c5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:10.726983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b4c038-6062-44eb-baec-0a63dae818c5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:10.727614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b4c038-6062-44eb-baec-0a63dae818c5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:10.728049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b4c038-6062-44eb-baec-0a63dae818c5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:11.405413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1722099b-fb1a-4369-988e-5326ed1a352c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:11.406347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1722099b-fb1a-4369-988e-5326ed1a352c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:11.416785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1722099b-fb1a-4369-988e-5326ed1a352c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:11.417730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1722099b-fb1a-4369-988e-5326ed1a352c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:11.423373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1722099b-fb1a-4369-988e-5326ed1a352c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:11.424625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1722099b-fb1a-4369-988e-5326ed1a352c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:11.425312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1722099b-fb1a-4369-988e-5326ed1a352c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:11.425983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1722099b-fb1a-4369-988e-5326ed1a352c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:11.519222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-89b4c038-6062-44eb-baec-0a63dae818c5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:11.532458 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-89b4c038-6062-44eb-baec-0a63dae818c5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1497 microversion: 2.1 time: 0.827770 Sep 10 21:07:11.547538 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2251/4424] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:10 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1497 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:11.697864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-76260c8d-f924-4e08-89a9-643211359d7e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:11.703133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-76260c8d-f924-4e08-89a9-643211359d7e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:11.717661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76260c8d-f924-4e08-89a9-643211359d7e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:11.718801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76260c8d-f924-4e08-89a9-643211359d7e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:11.719782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76260c8d-f924-4e08-89a9-643211359d7e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:11.721234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76260c8d-f924-4e08-89a9-643211359d7e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:11.722398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76260c8d-f924-4e08-89a9-643211359d7e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:11.723299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76260c8d-f924-4e08-89a9-643211359d7e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:11.864036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1722099b-fb1a-4369-988e-5326ed1a352c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:11.883746 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1722099b-fb1a-4369-988e-5326ed1a352c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 0.482944 Sep 10 21:07:11.884924 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2174/4425] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:11 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:12.570943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9027452b-a027-4911-879b-6ea17a2adeb5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:12.571687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-76260c8d-f924-4e08-89a9-643211359d7e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:12.577056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9027452b-a027-4911-879b-6ea17a2adeb5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:12.582215 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-76260c8d-f924-4e08-89a9-643211359d7e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1324 microversion: 2.1 time: 0.893410 Sep 10 21:07:12.596361 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2252/4426] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:11 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1324 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:12.601768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9027452b-a027-4911-879b-6ea17a2adeb5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:12.602563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9027452b-a027-4911-879b-6ea17a2adeb5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:12.603103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9027452b-a027-4911-879b-6ea17a2adeb5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:12.603912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9027452b-a027-4911-879b-6ea17a2adeb5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:12.604446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9027452b-a027-4911-879b-6ea17a2adeb5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:12.604961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9027452b-a027-4911-879b-6ea17a2adeb5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:12.848587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9027452b-a027-4911-879b-6ea17a2adeb5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:12.879531 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9027452b-a027-4911-879b-6ea17a2adeb5 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1497 microversion: 2.1 time: 0.319161 Sep 10 21:07:12.885649 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2175/4427] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:12 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1497 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:12.913291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-20c5a369-409d-4441-aae6-caaee3876281 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:12.914148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-20c5a369-409d-4441-aae6-caaee3876281 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:12.920726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20c5a369-409d-4441-aae6-caaee3876281 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:12.921600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20c5a369-409d-4441-aae6-caaee3876281 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:12.922239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20c5a369-409d-4441-aae6-caaee3876281 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:12.923187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20c5a369-409d-4441-aae6-caaee3876281 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:12.924397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20c5a369-409d-4441-aae6-caaee3876281 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:12.925549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20c5a369-409d-4441-aae6-caaee3876281 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:13.555783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-20c5a369-409d-4441-aae6-caaee3876281 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:13.564211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:13.572190 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-20c5a369-409d-4441-aae6-caaee3876281 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 0.662843 Sep 10 21:07:13.573278 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2253/4428] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:12 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:13.609242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f52e4468-1699-4397-b6d0-b640a05afbb8 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:13.611154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f52e4468-1699-4397-b6d0-b640a05afbb8 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:13.626383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f52e4468-1699-4397-b6d0-b640a05afbb8 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:13.626942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f52e4468-1699-4397-b6d0-b640a05afbb8 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:13.627676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f52e4468-1699-4397-b6d0-b640a05afbb8 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:13.629289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f52e4468-1699-4397-b6d0-b640a05afbb8 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:13.630009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f52e4468-1699-4397-b6d0-b640a05afbb8 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:13.644848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f52e4468-1699-4397-b6d0-b640a05afbb8 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:13.694703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-098f295a-dbe5-4daa-b96a-af11897cbc09 req-4ffb8551-1c8f-4d6c-a143-b42ab7ff4751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb20b95-a30b-441f-8044-31e2ec39c2d0", "name": "network-vif-deleted", "tag": "e4a50595-76cb-4c3a-9c35-8ec819a3846c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:13.728565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-098f295a-dbe5-4daa-b96a-af11897cbc09 req-4ffb8551-1c8f-4d6c-a143-b42ab7ff4751 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:13.732319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-098f295a-dbe5-4daa-b96a-af11897cbc09 req-4ffb8551-1c8f-4d6c-a143-b42ab7ff4751 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:13.732893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-098f295a-dbe5-4daa-b96a-af11897cbc09 req-4ffb8551-1c8f-4d6c-a143-b42ab7ff4751 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:13.798423 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-098f295a-dbe5-4daa-b96a-af11897cbc09 req-4ffb8551-1c8f-4d6c-a143-b42ab7ff4751 service nova] Creating event network-vif-deleted:e4a50595-76cb-4c3a-9c35-8ec819a3846c for instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 on nch1-master-1 Sep 10 21:07:13.808491 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-098f295a-dbe5-4daa-b96a-af11897cbc09 req-4ffb8551-1c8f-4d6c-a143-b42ab7ff4751 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120230 Sep 10 21:07:13.809652 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2254/4429] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:13.914580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:13.915689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:13.925016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:13.925805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:13.926447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:13.927612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:13.928394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:13.929069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:14.000100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:14.000614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:14.001320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:14.002084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lazy-loading 'fault' on Instance uuid 4cb20b95-a30b-441f-8044-31e2ec39c2d0 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:07:14.071037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f52e4468-1699-4397-b6d0-b640a05afbb8 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:14.081532 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f52e4468-1699-4397-b6d0-b640a05afbb8 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1324 microversion: 2.1 time: 0.478313 Sep 10 21:07:14.098952 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2176/4430] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:13 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1324 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:14.267925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faa458c158141efaf707317411cd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f02659fe74b70a8657691faaad6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:14.276135 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9b9143af-acfe-43ad-a9ac-0b9589082856 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 200 len: 1304 microversion: 2.1 time: 0.371274 Sep 10 21:07:14.280564 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2255/4431] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:13 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 1304 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:14.602343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8dadcf72-8d10-4122-a994-856033e3d360 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:14.603951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8dadcf72-8d10-4122-a994-856033e3d360 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:14.612247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8dadcf72-8d10-4122-a994-856033e3d360 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:14.613614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8dadcf72-8d10-4122-a994-856033e3d360 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:14.614382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8dadcf72-8d10-4122-a994-856033e3d360 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:14.615752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8dadcf72-8d10-4122-a994-856033e3d360 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:14.616658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8dadcf72-8d10-4122-a994-856033e3d360 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:14.617315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8dadcf72-8d10-4122-a994-856033e3d360 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:14.801263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8dadcf72-8d10-4122-a994-856033e3d360 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:14.814193 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8dadcf72-8d10-4122-a994-856033e3d360 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 0.218117 Sep 10 21:07:14.816105 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2177/4432] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:14 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:15.108052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-51af4736-d209-4b5d-bef4-5b160e4e0718 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.108659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-51af4736-d209-4b5d-bef4-5b160e4e0718 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.119266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51af4736-d209-4b5d-bef4-5b160e4e0718 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.120676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51af4736-d209-4b5d-bef4-5b160e4e0718 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.123155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51af4736-d209-4b5d-bef4-5b160e4e0718 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.124541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51af4736-d209-4b5d-bef4-5b160e4e0718 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.131694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51af4736-d209-4b5d-bef4-5b160e4e0718 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.133528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51af4736-d209-4b5d-bef4-5b160e4e0718 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.308149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.308774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.323026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.332070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.332863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.334186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.336828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.337746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.366738 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 HTTP/1.1 Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '4cb20b95-a30b-441f-8044-31e2ec39c2d0'} Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.368404 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.373948 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.373948 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.373948 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.373948 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:15.373948 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:15.373948 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.373948 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.376732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:15.377938 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f2299545-8ae2-4276-a89f-934863004c5c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 404 len: 111 microversion: 2.1 time: 0.075815 Sep 10 21:07:15.378845 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2178/4433] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:15 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:07:15.393536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.396800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.416280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.420692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.421456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.422217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.426243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.426583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.457374 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 HTTP/1.1 Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '4cb20b95-a30b-441f-8044-31e2ec39c2d0'} Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:15.459245 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b546dc38-6bf3-4aa6-9e2b-40bcab9f0eb9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 404 len: 111 microversion: 2.1 time: 0.074568 Sep 10 21:07:15.462976 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2179/4434] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:15 2022] DELETE /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:15.463875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:15.472416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.473055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 4cb20b95-a30b-441f-8044-31e2ec39c2d0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.486370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.486874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.487324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.488061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.488469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.493537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.507494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:15.514393 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 HTTP/1.1 Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '4cb20b95-a30b-441f-8044-31e2ec39c2d0'} Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.517100 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.521987 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.521987 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.521987 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.521987 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:15.521987 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:15.521987 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. Sep 10 21:07:15.521987 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.524537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 4cb20b95-a30b-441f-8044-31e2ec39c2d0 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:15.526054 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ac8e1282-6cda-4e4d-9b14-e25da5954257 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0" status: 404 len: 111 microversion: 2.1 time: 0.057516 Sep 10 21:07:15.528880 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2180/4435] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:15 2022] GET /compute/v2.1/servers/4cb20b95-a30b-441f-8044-31e2ec39c2d0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:15.551703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.552807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.561353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.561982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.562492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.563272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.563877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.564462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.592681 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b HTTP/1.1 Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '1cfef807-88b4-4765-8d02-4091096a419b'} Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:15.594485 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:07:15.598291 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.601557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:15.602246 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fd026002-7426-4d43-be6d-586d7cfe7793 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 404 len: 111 microversion: 2.1 time: 0.069542 Sep 10 21:07:15.603289 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2181/4436] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:15 2022] DELETE /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:15.622110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.623833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 1cfef807-88b4-4765-8d02-4091096a419b] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.632928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.634889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.635942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.637731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.639034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.639710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.653703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-51af4736-d209-4b5d-bef4-5b160e4e0718 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:15.670112 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b HTTP/1.1 Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '1cfef807-88b4-4765-8d02-4091096a419b'} Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.673589 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.682576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.682576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.682576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.682576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:15.682576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:15.682576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. Sep 10 21:07:15.682576 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.682576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 1cfef807-88b4-4765-8d02-4091096a419b could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:15.685062 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-51af4736-d209-4b5d-bef4-5b160e4e0718 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1324 microversion: 2.1 time: 0.578376 Sep 10 21:07:15.687530 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2a8d4ade-78ed-48e0-9124-c77f6f47c07c tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b" status: 404 len: 111 microversion: 2.1 time: 0.078193 Sep 10 21:07:15.688454 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2182/4437] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:15 2022] GET /compute/v2.1/servers/1cfef807-88b4-4765-8d02-4091096a419b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:15.699452 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2256/4438] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:15 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1324 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:15.710328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.710900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.726453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.727326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.730015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.735211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.735965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.736667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.754448 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 HTTP/1.1 Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73'} Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:15.756832 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:15.760541 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-040d8395-e33d-416d-93ee-a26e788df643 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 404 len: 111 microversion: 2.1 time: 0.062757 Sep 10 21:07:15.762310 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2183/4439] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:15 2022] DELETE /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:15.767830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.768630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.780112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.780815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.781409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.784698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.785605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.786319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.825165 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 HTTP/1.1 Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73'} Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.826994 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.832073 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.832073 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.832073 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.832073 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:15.832073 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:15.832073 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. Sep 10 21:07:15.832073 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.832073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:15.832073 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d590ed29-caa8-46b7-9e28-aa4ba62712fb tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73" status: 404 len: 111 microversion: 2.1 time: 0.065099 Sep 10 21:07:15.832073 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2257/4440] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:15 2022] GET /compute/v2.1/servers/9b2a2d7b-c93e-4e3e-ac29-7ad1b7f06f73 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:07:15.846709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.847668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.858299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09cbbcff-8f77-415f-b7ab-d2e7e40c95d4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.859225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.860303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.860764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.862073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09cbbcff-8f77-415f-b7ab-d2e7e40c95d4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.862268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.862268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.862409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.889667 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:07:15.890165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09cbbcff-8f77-415f-b7ab-d2e7e40c95d4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.891284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09cbbcff-8f77-415f-b7ab-d2e7e40c95d4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.891747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09cbbcff-8f77-415f-b7ab-d2e7e40c95d4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 HTTP/1.1 Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7a5f777c-02bd-4bbb-aad0-b79d88257152'} Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:15.892279 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:07:15.895998 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.896723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09cbbcff-8f77-415f-b7ab-d2e7e40c95d4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.896723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09cbbcff-8f77-415f-b7ab-d2e7e40c95d4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.896723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09cbbcff-8f77-415f-b7ab-d2e7e40c95d4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.898971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:15.900023 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2c25196c-b0e1-4e8c-92ab-fa037cd658bd tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 404 len: 111 microversion: 2.1 time: 0.065199 Sep 10 21:07:15.905276 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2184/4441] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:15 2022] DELETE /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:15.916204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:15.920551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 7a5f777c-02bd-4bbb-aad0-b79d88257152] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:15.929416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:15.933373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.934072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.934806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.935896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:15.937357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:15.938043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:15.987995 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 HTTP/1.1 Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7a5f777c-02bd-4bbb-aad0-b79d88257152'} Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:15.990890 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.995179 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:15.995179 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:15.995179 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:15.995179 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:15.995179 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:15.995179 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. Sep 10 21:07:15.995179 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:15.996085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 7a5f777c-02bd-4bbb-aad0-b79d88257152 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:15.996085 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fcef2745-6478-4308-a573-0b15baa91879 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152" status: 404 len: 111 microversion: 2.1 time: 0.089560 Sep 10 21:07:16.001783 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2185/4442] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:15 2022] GET /compute/v2.1/servers/7a5f777c-02bd-4bbb-aad0-b79d88257152 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:16.011205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3485f4a-e7c5-4a68-9ff4-3cc27cf49c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:16.011927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e3485f4a-e7c5-4a68-9ff4-3cc27cf49c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: c4d95754-df07-4eaa-be1f-13ec791344e6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:16.021355 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-e3485f4a-e7c5-4a68-9ff4-3cc27cf49c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3485f4a-e7c5-4a68-9ff4-3cc27cf49c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6 HTTP/1.1 Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'c4d95754-df07-4eaa-be1f-13ec791344e6'} Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:16.023265 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:16.028327 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:16.028327 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:16.028327 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:16.028327 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:16.028327 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:16.028327 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:07:16.028327 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:16.028327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3485f4a-e7c5-4a68-9ff4-3cc27cf49c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:16.028327 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3485f4a-e7c5-4a68-9ff4-3cc27cf49c73 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6" status: 404 len: 111 microversion: 2.1 time: 0.020017 Sep 10 21:07:16.029194 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2186/4443] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:16 2022] DELETE /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:16.043075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0385cefd-4aa1-4bfa-bdab-5a58d6267657 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:16.043900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0385cefd-4aa1-4bfa-bdab-5a58d6267657 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: c4d95754-df07-4eaa-be1f-13ec791344e6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:16.055973 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-0385cefd-4aa1-4bfa-bdab-5a58d6267657 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0385cefd-4aa1-4bfa-bdab-5a58d6267657 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6 HTTP/1.1 Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'c4d95754-df07-4eaa-be1f-13ec791344e6'} Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:16.057638 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:16.061365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:16.061365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:16.061365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:16.061365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. Sep 10 21:07:16.061365 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:16.062656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0385cefd-4aa1-4bfa-bdab-5a58d6267657 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance c4d95754-df07-4eaa-be1f-13ec791344e6 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:16.064586 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0385cefd-4aa1-4bfa-bdab-5a58d6267657 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6" status: 404 len: 111 microversion: 2.1 time: 0.029920 Sep 10 21:07:16.065933 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2187/4444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:16 2022] GET /compute/v2.1/servers/c4d95754-df07-4eaa-be1f-13ec791344e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:16.178665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-26885392-7ba5-437d-bfc7-6472a8daabd7 req-688d46a4-df13-45a0-8c52-b2e6affd9068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75fc6946-4e0d-44f3-9f89-e8c7ab602d45", "tag": "e079308a-fb28-4e94-a415-5209149ba84c"}, {"name": "network-changed", "server_uuid": "b994bffb-4ed7-4c2f-a528-e25cde273d31", "tag": "13a6b007-4bb0-4e37-8692-64763cd5fa75"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:16.201343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-26885392-7ba5-437d-bfc7-6472a8daabd7 req-688d46a4-df13-45a0-8c52-b2e6affd9068 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:16.203899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-26885392-7ba5-437d-bfc7-6472a8daabd7 req-688d46a4-df13-45a0-8c52-b2e6affd9068 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:16.216474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-26885392-7ba5-437d-bfc7-6472a8daabd7 req-688d46a4-df13-45a0-8c52-b2e6affd9068 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:16.250890 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-26885392-7ba5-437d-bfc7-6472a8daabd7 req-688d46a4-df13-45a0-8c52-b2e6affd9068 service nova] Creating event network-changed:e079308a-fb28-4e94-a415-5209149ba84c for instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 on nch2-master-1 Sep 10 21:07:16.253234 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-26885392-7ba5-437d-bfc7-6472a8daabd7 req-688d46a4-df13-45a0-8c52-b2e6affd9068 service nova] Creating event network-changed:13a6b007-4bb0-4e37-8692-64763cd5fa75 for instance b994bffb-4ed7-4c2f-a528-e25cde273d31 on nch2-master-1 Sep 10 21:07:16.260074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09cbbcff-8f77-415f-b7ab-d2e7e40c95d4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:16.274582 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09cbbcff-8f77-415f-b7ab-d2e7e40c95d4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 0.426465 Sep 10 21:07:16.278199 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2258/4445] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:15 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:16.293622 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-26885392-7ba5-437d-bfc7-6472a8daabd7 req-688d46a4-df13-45a0-8c52-b2e6affd9068 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118974 Sep 10 21:07:16.299470 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2188/4446] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:16.711084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a85c820d-fbfd-4118-acb5-43537650bc8b tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:16.712347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a85c820d-fbfd-4118-acb5-43537650bc8b tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:16.722123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85c820d-fbfd-4118-acb5-43537650bc8b tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:16.722945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85c820d-fbfd-4118-acb5-43537650bc8b tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:16.724546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85c820d-fbfd-4118-acb5-43537650bc8b tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:16.725729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85c820d-fbfd-4118-acb5-43537650bc8b tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:16.726780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85c820d-fbfd-4118-acb5-43537650bc8b tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:16.727494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85c820d-fbfd-4118-acb5-43537650bc8b tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.303027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=12 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:17.309438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4479d2d2-8a6f-4352-9f43-d57b1b487c8a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:17.310416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4479d2d2-8a6f-4352-9f43-d57b1b487c8a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:17.341306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4479d2d2-8a6f-4352-9f43-d57b1b487c8a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:17.342552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4479d2d2-8a6f-4352-9f43-d57b1b487c8a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:17.344075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4479d2d2-8a6f-4352-9f43-d57b1b487c8a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.346565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4479d2d2-8a6f-4352-9f43-d57b1b487c8a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:17.347194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4479d2d2-8a6f-4352-9f43-d57b1b487c8a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:17.348392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4479d2d2-8a6f-4352-9f43-d57b1b487c8a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.592605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a85c820d-fbfd-4118-acb5-43537650bc8b tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:17.602873 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a85c820d-fbfd-4118-acb5-43537650bc8b tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1324 microversion: 2.1 time: 0.897711 Sep 10 21:07:17.607505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4479d2d2-8a6f-4352-9f43-d57b1b487c8a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:17.618808 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2259/4447] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:16 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1324 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:17.618808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:17.618808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:17.631954 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4479d2d2-8a6f-4352-9f43-d57b1b487c8a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 0.329311 Sep 10 21:07:17.632760 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2189/4448] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:17 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:17.634345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:17.635027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:17.635480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.636202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:17.636662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:17.637277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.671433 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 HTTP/1.1 Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b075e8a7-4b8d-41c4-876b-6c7e6efa95f3'} Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:17.674129 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9ca53498-6160-4174-a8a0-0c45fe9f59a9 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 404 len: 111 microversion: 2.1 time: 0.063998 Sep 10 21:07:17.677942 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2260/4449] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:17 2022] DELETE /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:17.684715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:17.685395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: b075e8a7-4b8d-41c4-876b-6c7e6efa95f3] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:17.691741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:17.693027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:17.693663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.694918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:17.695536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:17.696124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.713525 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 HTTP/1.1 Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b075e8a7-4b8d-41c4-876b-6c7e6efa95f3'} Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:17.715441 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.723208 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.723208 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:17.723208 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:17.723208 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:17.723208 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:17.723208 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. Sep 10 21:07:17.723208 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.723208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:17.723208 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4da1d1d9-ffa3-46d4-8022-cc550e27dfc2 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3" status: 404 len: 111 microversion: 2.1 time: 0.036374 Sep 10 21:07:17.723208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2190/4450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:17 2022] GET /compute/v2.1/servers/b075e8a7-4b8d-41c4-876b-6c7e6efa95f3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:17.729281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:17.730039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:17.736470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:17.737126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:17.737745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.738843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:17.739513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:17.740106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.758741 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e HTTP/1.1 Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '96eb8dae-5750-4fc2-b074-1fff3a5de31e'} Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:17.760537 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:07:17.764885 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.768240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:17.770226 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e46b33ab-1ba5-4e28-98c3-0a1d6cf785ca tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "DELETE /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 404 len: 111 microversion: 2.1 time: 0.044642 Sep 10 21:07:17.772332 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2261/4451] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:17 2022] DELETE /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:17.781921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:17.782628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] [instance: 96eb8dae-5750-4fc2-b074-1fff3a5de31e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:17.791781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:17.792323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:17.792954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.794076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:17.794556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:17.794976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:17.815013 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] HTTP exception thrown: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Request method failure captured: Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e HTTP/1.1 Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPtdoybnAb60yuLNxWA-6ct13_dq-Kdnb9s9rSE7IuEoZd72BRb-t3vlB23gAziS3MH47_9kWOgstRsJRag6p0JuFtx1nyVPwI4D0O5kF8oVxqlQ3npY0k-dYoiaBRdvbISF-ThTD3B8m5P3X8qpDC57TBXJ7Efi4hXO9D208DF-k2Q Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58f02659fe74b70a8657691faaad6c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58f02659fe74b70a8657691faaad6c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58f02659fe74b70a8657691faaad6c9"}]}] Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: a58f02659fe74b70a8657691faaad6c9 Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-156130929 Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4faa458c158141efaf707317411cd544 Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-156130929-project Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '96eb8dae-5750-4fc2-b074-1fff3a5de31e'} Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:17.816796 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.821411 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:17.821411 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:17.821411 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:17.821411 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:17.821411 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:17.821411 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. Sep 10 21:07:17.821411 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:07:17.821411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] Returning 404 to user: Instance 96eb8dae-5750-4fc2-b074-1fff3a5de31e could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:17.821411 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-72e0ac56-c329-470b-8dc6-1011ea3bce82 tempest-DeleteServersTestJSON-156130929 tempest-DeleteServersTestJSON-156130929-project] 10.222.0.33 "GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e" status: 404 len: 111 microversion: 2.1 time: 0.042234 Sep 10 21:07:17.823650 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2191/4452] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:17 2022] GET /compute/v2.1/servers/96eb8dae-5750-4fc2-b074-1fff3a5de31e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:07:18.636326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa98b7fc-89c9-4f98-bdc4-cf2efc13c4f6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:18.637098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fa98b7fc-89c9-4f98-bdc4-cf2efc13c4f6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:18.656651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9fc1bd4b-033a-421b-b8b1-177ed1b2e0a4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:18.657441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9fc1bd4b-033a-421b-b8b1-177ed1b2e0a4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:18.665462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa98b7fc-89c9-4f98-bdc4-cf2efc13c4f6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:18.666582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa98b7fc-89c9-4f98-bdc4-cf2efc13c4f6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:18.668118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa98b7fc-89c9-4f98-bdc4-cf2efc13c4f6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:18.671856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa98b7fc-89c9-4f98-bdc4-cf2efc13c4f6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:18.672090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa98b7fc-89c9-4f98-bdc4-cf2efc13c4f6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:18.678175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa98b7fc-89c9-4f98-bdc4-cf2efc13c4f6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:18.681651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fc1bd4b-033a-421b-b8b1-177ed1b2e0a4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:18.684210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fc1bd4b-033a-421b-b8b1-177ed1b2e0a4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:18.684679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fc1bd4b-033a-421b-b8b1-177ed1b2e0a4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:18.705659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fc1bd4b-033a-421b-b8b1-177ed1b2e0a4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:18.706243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fc1bd4b-033a-421b-b8b1-177ed1b2e0a4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:18.706700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fc1bd4b-033a-421b-b8b1-177ed1b2e0a4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:19.160596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9fc1bd4b-033a-421b-b8b1-177ed1b2e0a4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:19.179067 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9fc1bd4b-033a-421b-b8b1-177ed1b2e0a4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 0.526398 Sep 10 21:07:19.182149 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2192/4453] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:18 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:19.802687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fa98b7fc-89c9-4f98-bdc4-cf2efc13c4f6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:19.817128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fa98b7fc-89c9-4f98-bdc4-cf2efc13c4f6 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1324 microversion: 2.1 time: 1.185894 Sep 10 21:07:19.818700 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2262/4454] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:18 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1324 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:20.206566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4092e3da-b658-437d-9355-eae8c83a749f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:20.207859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4092e3da-b658-437d-9355-eae8c83a749f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:20.229748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4092e3da-b658-437d-9355-eae8c83a749f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:20.231119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4092e3da-b658-437d-9355-eae8c83a749f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:20.234577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4092e3da-b658-437d-9355-eae8c83a749f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:20.237710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4092e3da-b658-437d-9355-eae8c83a749f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:20.241072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4092e3da-b658-437d-9355-eae8c83a749f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:20.241717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4092e3da-b658-437d-9355-eae8c83a749f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:20.844831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ddc0f408-0174-4c5f-a494-0b62804b6804 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:20.846622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ddc0f408-0174-4c5f-a494-0b62804b6804 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:20.855120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddc0f408-0174-4c5f-a494-0b62804b6804 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:20.856441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddc0f408-0174-4c5f-a494-0b62804b6804 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:20.857165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddc0f408-0174-4c5f-a494-0b62804b6804 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:20.858272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddc0f408-0174-4c5f-a494-0b62804b6804 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:20.858980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddc0f408-0174-4c5f-a494-0b62804b6804 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:20.859632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddc0f408-0174-4c5f-a494-0b62804b6804 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:21.193542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4092e3da-b658-437d-9355-eae8c83a749f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:21.205096 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4092e3da-b658-437d-9355-eae8c83a749f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 1.004592 Sep 10 21:07:21.206464 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2193/4455] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:20 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:21.991815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ddc0f408-0174-4c5f-a494-0b62804b6804 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:22.003947 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ddc0f408-0174-4c5f-a494-0b62804b6804 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1324 microversion: 2.1 time: 1.161675 Sep 10 21:07:22.008905 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2263/4456] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:20 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1324 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:22.233891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-32d34f00-8446-4bad-bebc-27f34223eb67 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:22.234943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-32d34f00-8446-4bad-bebc-27f34223eb67 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:22.262092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32d34f00-8446-4bad-bebc-27f34223eb67 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:22.262502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32d34f00-8446-4bad-bebc-27f34223eb67 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:22.267641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32d34f00-8446-4bad-bebc-27f34223eb67 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:22.268825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32d34f00-8446-4bad-bebc-27f34223eb67 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:22.270860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32d34f00-8446-4bad-bebc-27f34223eb67 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:22.273351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32d34f00-8446-4bad-bebc-27f34223eb67 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:22.718821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-32d34f00-8446-4bad-bebc-27f34223eb67 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:22.742751 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-32d34f00-8446-4bad-bebc-27f34223eb67 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 0.513278 Sep 10 21:07:22.751165 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2194/4457] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:22 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:23.034667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be157fdf-910b-4cc1-a207-e7a5fca32d8e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:23.035843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-be157fdf-910b-4cc1-a207-e7a5fca32d8e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:23.049371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:23.057267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be157fdf-910b-4cc1-a207-e7a5fca32d8e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:23.058228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be157fdf-910b-4cc1-a207-e7a5fca32d8e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:23.059030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be157fdf-910b-4cc1-a207-e7a5fca32d8e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:23.068433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be157fdf-910b-4cc1-a207-e7a5fca32d8e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:23.072200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be157fdf-910b-4cc1-a207-e7a5fca32d8e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:23.072873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be157fdf-910b-4cc1-a207-e7a5fca32d8e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:23.539618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-be157fdf-910b-4cc1-a207-e7a5fca32d8e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:23.552611 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be157fdf-910b-4cc1-a207-e7a5fca32d8e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1324 microversion: 2.1 time: 0.520846 Sep 10 21:07:23.579675 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2264/4458] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:23 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:23.775732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a4f243f6-c72e-4f1e-a337-673cd657fa73 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:23.776512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a4f243f6-c72e-4f1e-a337-673cd657fa73 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:23.792044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4f243f6-c72e-4f1e-a337-673cd657fa73 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:23.792561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4f243f6-c72e-4f1e-a337-673cd657fa73 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:23.793012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4f243f6-c72e-4f1e-a337-673cd657fa73 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:23.800065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4f243f6-c72e-4f1e-a337-673cd657fa73 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:23.800770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4f243f6-c72e-4f1e-a337-673cd657fa73 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:23.801235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4f243f6-c72e-4f1e-a337-673cd657fa73 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:23.896293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-33cc6721-220d-4114-9036-553e0b3699e0 req-1c76d966-14a7-44eb-a58c-b1126560de76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fc6946-4e0d-44f3-9f89-e8c7ab602d45", "name": "network-vif-plugged", "status": "completed", "tag": "e079308a-fb28-4e94-a415-5209149ba84c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:23.912670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33cc6721-220d-4114-9036-553e0b3699e0 req-1c76d966-14a7-44eb-a58c-b1126560de76 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:23.914452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33cc6721-220d-4114-9036-553e0b3699e0 req-1c76d966-14a7-44eb-a58c-b1126560de76 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:23.918436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33cc6721-220d-4114-9036-553e0b3699e0 req-1c76d966-14a7-44eb-a58c-b1126560de76 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:23.939511 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-33cc6721-220d-4114-9036-553e0b3699e0 req-1c76d966-14a7-44eb-a58c-b1126560de76 service nova] Creating event network-vif-plugged:e079308a-fb28-4e94-a415-5209149ba84c for instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 on nch2-master-1 Sep 10 21:07:23.956234 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-33cc6721-220d-4114-9036-553e0b3699e0 req-1c76d966-14a7-44eb-a58c-b1126560de76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065159 Sep 10 21:07:23.957201 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2265/4459] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:07:24.389903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a4f243f6-c72e-4f1e-a337-673cd657fa73 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:24.405789 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a4f243f6-c72e-4f1e-a337-673cd657fa73 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 0.633713 Sep 10 21:07:24.417992 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2195/4460] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:23 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:24.587540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a17eb2ec-5185-4646-9a72-4a8adc438b76 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:24.588315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a17eb2ec-5185-4646-9a72-4a8adc438b76 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:24.599893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a17eb2ec-5185-4646-9a72-4a8adc438b76 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:24.600402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a17eb2ec-5185-4646-9a72-4a8adc438b76 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:24.601102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a17eb2ec-5185-4646-9a72-4a8adc438b76 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:24.601857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a17eb2ec-5185-4646-9a72-4a8adc438b76 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:24.602358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a17eb2ec-5185-4646-9a72-4a8adc438b76 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:24.602895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a17eb2ec-5185-4646-9a72-4a8adc438b76 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:25.334393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a17eb2ec-5185-4646-9a72-4a8adc438b76 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:25.351450 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a17eb2ec-5185-4646-9a72-4a8adc438b76 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1324 microversion: 2.1 time: 0.767385 Sep 10 21:07:25.352398 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2266/4461] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:24 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1324 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:25.434075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8566dd90-8d91-4dce-98e9-e7fc2ceffe4a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:25.434975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8566dd90-8d91-4dce-98e9-e7fc2ceffe4a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:25.459749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8566dd90-8d91-4dce-98e9-e7fc2ceffe4a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:25.460268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8566dd90-8d91-4dce-98e9-e7fc2ceffe4a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:25.460717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8566dd90-8d91-4dce-98e9-e7fc2ceffe4a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:25.461440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8566dd90-8d91-4dce-98e9-e7fc2ceffe4a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:25.461941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8566dd90-8d91-4dce-98e9-e7fc2ceffe4a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:25.462385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8566dd90-8d91-4dce-98e9-e7fc2ceffe4a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:26.382309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2a160c5f-39bf-49bd-ba2a-3c243f1bde02 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:26.383066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2a160c5f-39bf-49bd-ba2a-3c243f1bde02 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:26.397970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a160c5f-39bf-49bd-ba2a-3c243f1bde02 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:26.401442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a160c5f-39bf-49bd-ba2a-3c243f1bde02 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:26.402867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a160c5f-39bf-49bd-ba2a-3c243f1bde02 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:26.404711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a160c5f-39bf-49bd-ba2a-3c243f1bde02 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:26.407551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a160c5f-39bf-49bd-ba2a-3c243f1bde02 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:26.408133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a160c5f-39bf-49bd-ba2a-3c243f1bde02 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:26.453654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8566dd90-8d91-4dce-98e9-e7fc2ceffe4a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:26.479863 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8566dd90-8d91-4dce-98e9-e7fc2ceffe4a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 1.043597 Sep 10 21:07:26.481297 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2196/4462] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:25 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:26.711011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c5c7a388-7674-454e-9089-59c7f64e11ee req-d772b363-57e0-45c5-94fe-38328d9f49d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b994bffb-4ed7-4c2f-a528-e25cde273d31", "name": "network-vif-plugged", "status": "completed", "tag": "13a6b007-4bb0-4e37-8692-64763cd5fa75"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:26.732713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c5c7a388-7674-454e-9089-59c7f64e11ee req-d772b363-57e0-45c5-94fe-38328d9f49d9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:26.733188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c5c7a388-7674-454e-9089-59c7f64e11ee req-d772b363-57e0-45c5-94fe-38328d9f49d9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:26.746151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c5c7a388-7674-454e-9089-59c7f64e11ee req-d772b363-57e0-45c5-94fe-38328d9f49d9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:26.760938 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c5c7a388-7674-454e-9089-59c7f64e11ee req-d772b363-57e0-45c5-94fe-38328d9f49d9 service nova] Creating event network-vif-plugged:13a6b007-4bb0-4e37-8692-64763cd5fa75 for instance b994bffb-4ed7-4c2f-a528-e25cde273d31 on nch2-master-1 Sep 10 21:07:26.776920 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c5c7a388-7674-454e-9089-59c7f64e11ee req-d772b363-57e0-45c5-94fe-38328d9f49d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069309 Sep 10 21:07:26.780757 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2197/4463] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:07:26.881071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2a160c5f-39bf-49bd-ba2a-3c243f1bde02 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:26.902341 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2a160c5f-39bf-49bd-ba2a-3c243f1bde02 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 200 len: 1520 microversion: 2.1 time: 0.527131 Sep 10 21:07:26.906990 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2267/4464] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:26 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 1520 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:26.939000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.136"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:26.950621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:26.961288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:26.962072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:26.962930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:26.964461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:26.965147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:26.965808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:27.010474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "refresh_cache-a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 21:07:27.010888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquired lock "refresh_cache-a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 21:07:27.507214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-58b3dd27-93b6-4ae7-bf0f-13a8cbfae310 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:27.507833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-58b3dd27-93b6-4ae7-bf0f-13a8cbfae310 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:27.521118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58b3dd27-93b6-4ae7-bf0f-13a8cbfae310 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:27.523255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58b3dd27-93b6-4ae7-bf0f-13a8cbfae310 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:27.523729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58b3dd27-93b6-4ae7-bf0f-13a8cbfae310 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:27.526630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58b3dd27-93b6-4ae7-bf0f-13a8cbfae310 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:27.527282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58b3dd27-93b6-4ae7-bf0f-13a8cbfae310 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:27.527734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58b3dd27-93b6-4ae7-bf0f-13a8cbfae310 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:28.539309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58b3dd27-93b6-4ae7-bf0f-13a8cbfae310 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:28.564562 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-58b3dd27-93b6-4ae7-bf0f-13a8cbfae310 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1321 microversion: 2.1 time: 1.064182 Sep 10 21:07:28.582369 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2268/4465] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:27 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1321 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:29.608429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-11be8eb7-0efa-456f-8dce-3e61d9c5d9b9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:29.609751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-11be8eb7-0efa-456f-8dce-3e61d9c5d9b9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:29.660900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11be8eb7-0efa-456f-8dce-3e61d9c5d9b9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:29.661465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11be8eb7-0efa-456f-8dce-3e61d9c5d9b9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:29.661950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11be8eb7-0efa-456f-8dce-3e61d9c5d9b9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:29.669986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11be8eb7-0efa-456f-8dce-3e61d9c5d9b9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:29.670497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11be8eb7-0efa-456f-8dce-3e61d9c5d9b9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:29.670930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11be8eb7-0efa-456f-8dce-3e61d9c5d9b9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:30.025633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Building network info cache for instance {{(pid=145771) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 21:07:30.149232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-11be8eb7-0efa-456f-8dce-3e61d9c5d9b9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:30.166589 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-11be8eb7-0efa-456f-8dce-3e61d9c5d9b9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1501 microversion: 2.1 time: 0.563941 Sep 10 21:07:30.169890 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2269/4466] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:29 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1501 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:30.180201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-28eadca3-42f5-4e5b-8e17-e69deb5f482f req-209614d3-084b-4f5e-b494-642e371b6625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73c36f9-4016-4ac2-ab6e-d56b10d6ad92", "tag": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:30.214903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-28eadca3-42f5-4e5b-8e17-e69deb5f482f req-209614d3-084b-4f5e-b494-642e371b6625 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:30.217019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-28eadca3-42f5-4e5b-8e17-e69deb5f482f req-209614d3-084b-4f5e-b494-642e371b6625 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:30.217696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-28eadca3-42f5-4e5b-8e17-e69deb5f482f req-209614d3-084b-4f5e-b494-642e371b6625 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:30.238900 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-28eadca3-42f5-4e5b-8e17-e69deb5f482f req-209614d3-084b-4f5e-b494-642e371b6625 service nova] Creating event network-changed:8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22 for instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 on nch2-master-1 Sep 10 21:07:30.261123 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-28eadca3-42f5-4e5b-8e17-e69deb5f482f req-209614d3-084b-4f5e-b494-642e371b6625 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087797 Sep 10 21:07:30.262599 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2270/4467] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:30.283610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8af4205-30b6-437c-b881-1cd3088085d2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:30.285239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c8af4205-30b6-437c-b881-1cd3088085d2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:30.296515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8af4205-30b6-437c-b881-1cd3088085d2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:30.297935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8af4205-30b6-437c-b881-1cd3088085d2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:30.299559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8af4205-30b6-437c-b881-1cd3088085d2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:30.300496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8af4205-30b6-437c-b881-1cd3088085d2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:30.301122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8af4205-30b6-437c-b881-1cd3088085d2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:30.302121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8af4205-30b6-437c-b881-1cd3088085d2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:31.236689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c8af4205-30b6-437c-b881-1cd3088085d2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:31.248069 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c8af4205-30b6-437c-b881-1cd3088085d2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1501 microversion: 2.1 time: 0.983396 Sep 10 21:07:31.248682 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2271/4468] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:30 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1501 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:31.305109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Updating instance_info_cache with network_info: [{"id": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22", "address": "fa:16:3e:5a:e3:84", "network": {"id": "a53f27f3-ecaa-4250-a852-1d8a7bb068e9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-384757171-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ceebf89c39014750ae279e0741a0bb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8c0d0ec6-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=145771) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 21:07:31.316707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:31.325398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Releasing lock "refresh_cache-a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 21:07:31.326500 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bf57d1bd-2b17-436a-84f1-6958afb61aff tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "POST /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92/action" status: 202 len: 0 microversion: 2.1 time: 4.396698 Sep 10 21:07:31.329353 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2198/4469] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:07:26 2022] POST /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92/action => generated 0 bytes in 4400 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 21:07:31.340967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-58dd1634-bc46-444d-83ee-853f1ec34609 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:31.343281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-58dd1634-bc46-444d-83ee-853f1ec34609 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:31.360382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58dd1634-bc46-444d-83ee-853f1ec34609 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:31.362610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58dd1634-bc46-444d-83ee-853f1ec34609 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:31.365000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58dd1634-bc46-444d-83ee-853f1ec34609 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:31.367033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58dd1634-bc46-444d-83ee-853f1ec34609 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:31.368638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58dd1634-bc46-444d-83ee-853f1ec34609 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:31.369440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58dd1634-bc46-444d-83ee-853f1ec34609 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:31.441950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-58dd1634-bc46-444d-83ee-853f1ec34609 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:07:31.617435 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-58dd1634-bc46-444d-83ee-853f1ec34609 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 204 len: 0 microversion: 2.1 time: 0.286032 Sep 10 21:07:31.618424 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2199/4470] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:31 2022] DELETE /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:07:31.629885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.136"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:31.635814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:31.660202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:31.661156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:31.663539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:31.666176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:31.667164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:31.667989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:31.710297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "refresh_cache-75fc6946-4e0d-44f3-9f89-e8c7ab602d45" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 21:07:31.711060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquired lock "refresh_cache-75fc6946-4e0d-44f3-9f89-e8c7ab602d45" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 21:07:31.785128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1997905466", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "dbba119d-8b53-4850-97fb-d26ddd0d16fc"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:31.920203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] validate_networks() for [('dbba119d-8b53-4850-97fb-d26ddd0d16fc', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:07:33.700510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:07:33.701144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:07:33.701409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:07:33.701887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:07:33.702303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:07:33.728334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:33.728829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:33.729275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:33.736829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:33.737327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:33.737777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:33.825633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Getting quotas for project e2d0a21cdb7149ca9b72a502c7eb84fa. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:07:33.854343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Getting quotas for user 5d9931925a544aa894cf2b08cad10ea2 and project e2d0a21cdb7149ca9b72a502c7eb84fa. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:07:33.890277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:07:33.898266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:07:34.025870 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0f464038-26b2-442f-b5b5-c03aba2e4579 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.774012 Sep 10 21:07:34.030019 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2272/4471] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:07:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:07:34.036815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be12c1f7-53cb-4f38-94b9-1b2c4cdad00f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:34.065806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-be12c1f7-53cb-4f38-94b9-1b2c4cdad00f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:34.079384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be12c1f7-53cb-4f38-94b9-1b2c4cdad00f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:34.079801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be12c1f7-53cb-4f38-94b9-1b2c4cdad00f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:34.086592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be12c1f7-53cb-4f38-94b9-1b2c4cdad00f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:34.087388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be12c1f7-53cb-4f38-94b9-1b2c4cdad00f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:34.087883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be12c1f7-53cb-4f38-94b9-1b2c4cdad00f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:34.088314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be12c1f7-53cb-4f38-94b9-1b2c4cdad00f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:34.524300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-be12c1f7-53cb-4f38-94b9-1b2c4cdad00f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:34.542677 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be12c1f7-53cb-4f38-94b9-1b2c4cdad00f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1507 microversion: 2.1 time: 0.510029 Sep 10 21:07:34.545540 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2273/4472] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:34 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1507 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:34.563604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-03a170f1-f75e-4e4c-b9a0-024d2674cd8f tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:34.564841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-03a170f1-f75e-4e4c-b9a0-024d2674cd8f tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:34.859241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-03a170f1-f75e-4e4c-b9a0-024d2674cd8f tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:34.868601 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-03a170f1-f75e-4e4c-b9a0-024d2674cd8f tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1217 microversion: 2.1 time: 0.321748 Sep 10 21:07:34.872388 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2274/4473] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:34 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1217 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:34.994886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-301bf4e4-48f4-4758-a586-abe58a789cc7 req-ee811a12-2eb6-4214-8b0d-70b5d53015e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b994bffb-4ed7-4c2f-a528-e25cde273d31", "name": "network-vif-deleted", "tag": "13a6b007-4bb0-4e37-8692-64763cd5fa75"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:35.015752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-301bf4e4-48f4-4758-a586-abe58a789cc7 req-ee811a12-2eb6-4214-8b0d-70b5d53015e5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:35.019406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-301bf4e4-48f4-4758-a586-abe58a789cc7 req-ee811a12-2eb6-4214-8b0d-70b5d53015e5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:35.020071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-301bf4e4-48f4-4758-a586-abe58a789cc7 req-ee811a12-2eb6-4214-8b0d-70b5d53015e5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:35.044165 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-301bf4e4-48f4-4758-a586-abe58a789cc7 req-ee811a12-2eb6-4214-8b0d-70b5d53015e5 service nova] Creating event network-vif-deleted:13a6b007-4bb0-4e37-8692-64763cd5fa75 for instance b994bffb-4ed7-4c2f-a528-e25cde273d31 on nch2-master-1 Sep 10 21:07:35.081139 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-301bf4e4-48f4-4758-a586-abe58a789cc7 req-ee811a12-2eb6-4214-8b0d-70b5d53015e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089823 Sep 10 21:07:35.095862 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2275/4474] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:35.576724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:35.578260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:35.613196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:35.615713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:35.616375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:35.617573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:35.619958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:35.622531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:35.690141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:35.738754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:35.746251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:35.747139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:35.748257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lazy-loading 'fault' on Instance uuid b994bffb-4ed7-4c2f-a528-e25cde273d31 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:07:35.923676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:35.946813 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dc17a4f9-109b-46a8-9031-3f1926390b9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 200 len: 1311 microversion: 2.1 time: 0.374871 Sep 10 21:07:35.950141 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2276/4475] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:35 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 1311 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:35.959925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-19290d2d-5852-4890-858e-6ffa6dc3d184 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:35.970791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-19290d2d-5852-4890-858e-6ffa6dc3d184 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:35.994060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19290d2d-5852-4890-858e-6ffa6dc3d184 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:35.994835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19290d2d-5852-4890-858e-6ffa6dc3d184 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:35.997852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19290d2d-5852-4890-858e-6ffa6dc3d184 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:35.999508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19290d2d-5852-4890-858e-6ffa6dc3d184 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:36.000317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19290d2d-5852-4890-858e-6ffa6dc3d184 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:36.002272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-19290d2d-5852-4890-858e-6ffa6dc3d184 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:36.117164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-19290d2d-5852-4890-858e-6ffa6dc3d184 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:36.128710 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-19290d2d-5852-4890-858e-6ffa6dc3d184 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1269 microversion: 2.1 time: 0.177128 Sep 10 21:07:36.135009 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2277/4476] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:35 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:36.975141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:36.977734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:36.995102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:37.001318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:37.002639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:37.004442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:37.010083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:37.011039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:37.076579 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 HTTP/1.1 Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b994bffb-4ed7-4c2f-a528-e25cde273d31'} Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:37.081238 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:37.085547 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:37.085547 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:37.085547 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:37.085547 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:37.085547 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:07:37.085547 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:37.085547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:37.085547 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-512b9a09-defa-40d9-8e1d-fd31e12c88a6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 404 len: 111 microversion: 2.1 time: 0.117635 Sep 10 21:07:37.094115 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2278/4477] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:36 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:07:37.115412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bdf64cd6-284e-432c-96db-9d58743a6863 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'create', calling method: .version_select at 0x7f99495d7160>, body: {"keypair": {"name": "tempest-key-1358894292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4J+1jEQ5GZYM8Aww9Z0+f9HdsUPL8AjdkUZvyTaXUsCyA5di9rasB0aH+6WrTQ1QvozfoE0By+138ZhPYosfi2ZDjYPYzqILJjRptQknyK7btTgmxFS5fIpBnUPd3RQg=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:37.191469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bdf64cd6-284e-432c-96db-9d58743a6863 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:07:37.222487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bdf64cd6-284e-432c-96db-9d58743a6863 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for user 6bfa3af0a7284bc6854f2c9c58392935 and project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:07:37.306429 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bdf64cd6-284e-432c-96db-9d58743a6863 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.204359 Sep 10 21:07:37.307355 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2279/4478] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:07:37 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:37.313342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fbd12992-d60b-4993-a801-8d3bd41ca1c8 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:37.315846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fbd12992-d60b-4993-a801-8d3bd41ca1c8 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:37.325230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd12992-d60b-4993-a801-8d3bd41ca1c8 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:37.325799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd12992-d60b-4993-a801-8d3bd41ca1c8 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:37.326216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd12992-d60b-4993-a801-8d3bd41ca1c8 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:37.326929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd12992-d60b-4993-a801-8d3bd41ca1c8 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:37.327644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd12992-d60b-4993-a801-8d3bd41ca1c8 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:37.327810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbd12992-d60b-4993-a801-8d3bd41ca1c8 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:37.485859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fbd12992-d60b-4993-a801-8d3bd41ca1c8 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:37.506834 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fbd12992-d60b-4993-a801-8d3bd41ca1c8 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1275 microversion: 2.1 time: 0.198049 Sep 10 21:07:37.507462 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2280/4479] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:37 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:37.522647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e7753609-a091-4971-8da5-70e649518538 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '.version_select at 0x7f993feda8b0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:37.527529 ncdv-master-1 devstack@n-api.service[145772]: WARNING oslo_db.sqlalchemy.utils [None req-e7753609-a091-4971-8da5-70e649518538 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 21:07:37.541603 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e7753609-a091-4971-8da5-70e649518538 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.033050 Sep 10 21:07:37.542248 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2281/4480] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 21:07:37 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:37.826887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1032911539", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "key_name": "tempest-key-1358894292", "networks": [{"uuid": "75842dc4-d668-416f-9bad-afa9ac1ec517"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:37.976337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] validate_networks() for [('75842dc4-d668-416f-9bad-afa9ac1ec517', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:07:39.588864 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.network.neutron [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] re-assign floating IP 172.35.7.136 from instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 Sep 10 21:07:39.692593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Building network info cache for instance {{(pid=145771) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 21:07:40.966513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:07:40.966973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:07:40.967697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:07:40.968121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:07:40.968595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:07:41.005207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:41.006027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:41.007267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:41.009234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:41.014078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:41.014750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:41.067702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:07:41.076850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for user 6bfa3af0a7284bc6854f2c9c58392935 and project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:07:41.106399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:07:41.109707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:07:41.198095 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d21da556-26b5-45f5-9d12-47c240d5b81e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.375734 Sep 10 21:07:41.199336 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2282/4481] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:07:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:07:41.211435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e530f2f-890c-4308-af57-1bc505aaca63 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:41.212509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e530f2f-890c-4308-af57-1bc505aaca63 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:41.222216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e530f2f-890c-4308-af57-1bc505aaca63 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:41.223808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e530f2f-890c-4308-af57-1bc505aaca63 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:41.224557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e530f2f-890c-4308-af57-1bc505aaca63 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:41.225667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e530f2f-890c-4308-af57-1bc505aaca63 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:41.226856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e530f2f-890c-4308-af57-1bc505aaca63 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:41.227874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e530f2f-890c-4308-af57-1bc505aaca63 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:41.648063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:41.747637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1e530f2f-890c-4308-af57-1bc505aaca63 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:41.765684 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e530f2f-890c-4308-af57-1bc505aaca63 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1317 microversion: 2.1 time: 0.564992 Sep 10 21:07:41.766330 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2283/4482] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:41 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:41.777332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ee019265-a365-4a56-a320-420532af4d8b req-3008fe42-8367-41bc-a14e-4e47b8439f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73c36f9-4016-4ac2-ab6e-d56b10d6ad92", "tag": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:41.791112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Updating instance_info_cache with network_info: [{"id": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22", "address": "fa:16:3e:5a:e3:84", "network": {"id": "a53f27f3-ecaa-4250-a852-1d8a7bb068e9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-384757171-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ceebf89c39014750ae279e0741a0bb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8c0d0ec6-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=145771) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 21:07:41.807620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Building network info cache for instance {{(pid=145771) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 21:07:41.827594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ee019265-a365-4a56-a320-420532af4d8b req-3008fe42-8367-41bc-a14e-4e47b8439f38 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:41.828085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ee019265-a365-4a56-a320-420532af4d8b req-3008fe42-8367-41bc-a14e-4e47b8439f38 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:41.828525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ee019265-a365-4a56-a320-420532af4d8b req-3008fe42-8367-41bc-a14e-4e47b8439f38 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:41.853761 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ee019265-a365-4a56-a320-420532af4d8b req-3008fe42-8367-41bc-a14e-4e47b8439f38 service nova] Creating event network-changed:8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22 for instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 on nch2-master-1 Sep 10 21:07:41.888855 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ee019265-a365-4a56-a320-420532af4d8b req-3008fe42-8367-41bc-a14e-4e47b8439f38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121259 Sep 10 21:07:41.889475 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2284/4483] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:41.894777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9d3177af-b0e8-450b-bf89-f44ad2e63807 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:41.896237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9d3177af-b0e8-450b-bf89-f44ad2e63807 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:42.188521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9d3177af-b0e8-450b-bf89-f44ad2e63807 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:42.201635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9d3177af-b0e8-450b-bf89-f44ad2e63807 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1229 microversion: 2.1 time: 0.310703 Sep 10 21:07:42.205364 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2285/4484] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:41 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1229 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:42.791032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-553b38b1-378d-4e6a-96c3-bf89dc532b96 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:42.791773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-553b38b1-378d-4e6a-96c3-bf89dc532b96 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:42.813703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-553b38b1-378d-4e6a-96c3-bf89dc532b96 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:42.814494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-553b38b1-378d-4e6a-96c3-bf89dc532b96 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:42.815126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-553b38b1-378d-4e6a-96c3-bf89dc532b96 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:42.816027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-553b38b1-378d-4e6a-96c3-bf89dc532b96 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:42.816640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-553b38b1-378d-4e6a-96c3-bf89dc532b96 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:42.817533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-553b38b1-378d-4e6a-96c3-bf89dc532b96 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:43.233397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-553b38b1-378d-4e6a-96c3-bf89dc532b96 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:43.247049 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-553b38b1-378d-4e6a-96c3-bf89dc532b96 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1317 microversion: 2.1 time: 0.460012 Sep 10 21:07:43.248792 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2286/4485] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:42 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:43.280218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e27c069d-2641-4251-9500-cf993b53bc81 req-2db0b228-7dfb-4670-8734-f5b04dd427b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41cc68a6-4400-4205-8c85-ad55a8f3c6ae", "tag": "42286044-fd28-4abf-9c52-c49844413f37"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:43.312423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e27c069d-2641-4251-9500-cf993b53bc81 req-2db0b228-7dfb-4670-8734-f5b04dd427b4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:43.313145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e27c069d-2641-4251-9500-cf993b53bc81 req-2db0b228-7dfb-4670-8734-f5b04dd427b4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:43.313852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e27c069d-2641-4251-9500-cf993b53bc81 req-2db0b228-7dfb-4670-8734-f5b04dd427b4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:43.332974 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e27c069d-2641-4251-9500-cf993b53bc81 req-2db0b228-7dfb-4670-8734-f5b04dd427b4 service nova] Creating event network-changed:42286044-fd28-4abf-9c52-c49844413f37 for instance 41cc68a6-4400-4205-8c85-ad55a8f3c6ae on nch1-master-1 Sep 10 21:07:43.340726 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e27c069d-2641-4251-9500-cf993b53bc81 req-2db0b228-7dfb-4670-8734-f5b04dd427b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089378 Sep 10 21:07:43.342344 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2287/4486] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:43.382377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f1670982-926f-4243-a9b4-7bc17129a70b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:43.384881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f1670982-926f-4243-a9b4-7bc17129a70b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:43.406078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1670982-926f-4243-a9b4-7bc17129a70b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:43.412551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1670982-926f-4243-a9b4-7bc17129a70b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:43.413682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1670982-926f-4243-a9b4-7bc17129a70b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:43.418254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1670982-926f-4243-a9b4-7bc17129a70b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:43.419151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1670982-926f-4243-a9b4-7bc17129a70b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:43.420597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1670982-926f-4243-a9b4-7bc17129a70b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:43.655237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f1670982-926f-4243-a9b4-7bc17129a70b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:43.669251 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f1670982-926f-4243-a9b4-7bc17129a70b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1289 microversion: 2.1 time: 0.324837 Sep 10 21:07:43.671034 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2288/4487] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:43 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1289 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:44.003364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-91c5bd97-e35e-435f-bad3-23f50f144e47 req-decc506d-a7c3-4938-b611-1405c561cc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75fc6946-4e0d-44f3-9f89-e8c7ab602d45", "tag": "e079308a-fb28-4e94-a415-5209149ba84c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:44.049335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-91c5bd97-e35e-435f-bad3-23f50f144e47 req-decc506d-a7c3-4938-b611-1405c561cc31 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:44.050078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-91c5bd97-e35e-435f-bad3-23f50f144e47 req-decc506d-a7c3-4938-b611-1405c561cc31 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:44.052042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-91c5bd97-e35e-435f-bad3-23f50f144e47 req-decc506d-a7c3-4938-b611-1405c561cc31 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:44.094511 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-91c5bd97-e35e-435f-bad3-23f50f144e47 req-decc506d-a7c3-4938-b611-1405c561cc31 service nova] Creating event network-changed:e079308a-fb28-4e94-a415-5209149ba84c for instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 on nch2-master-1 Sep 10 21:07:44.122077 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-91c5bd97-e35e-435f-bad3-23f50f144e47 req-decc506d-a7c3-4938-b611-1405c561cc31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117267 Sep 10 21:07:44.123296 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2289/4488] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:44.191379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Updating instance_info_cache with network_info: [{"id": "e079308a-fb28-4e94-a415-5209149ba84c", "address": "fa:16:3e:49:2a:d8", "network": {"id": "a53f27f3-ecaa-4250-a852-1d8a7bb068e9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-384757171-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ceebf89c39014750ae279e0741a0bb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape079308a-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=145771) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 21:07:44.210104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Releasing lock "refresh_cache-75fc6946-4e0d-44f3-9f89-e8c7ab602d45" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 21:07:44.211117 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d3e3cd4e-4c0e-43c0-9a13-290a302a035e tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "POST /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45/action" status: 202 len: 0 microversion: 2.1 time: 12.590182 Sep 10 21:07:44.211964 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2200/4489] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:07:31 2022] POST /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45/action => generated 0 bytes in 12593 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 21:07:44.221633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.136"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:44.278916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c29b75bd-8f83-420a-9aab-bf15018cf05d tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:44.279541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c29b75bd-8f83-420a-9aab-bf15018cf05d tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:44.293931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c29b75bd-8f83-420a-9aab-bf15018cf05d tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:44.294520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c29b75bd-8f83-420a-9aab-bf15018cf05d tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:44.295180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c29b75bd-8f83-420a-9aab-bf15018cf05d tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:44.296097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c29b75bd-8f83-420a-9aab-bf15018cf05d tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:44.296888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c29b75bd-8f83-420a-9aab-bf15018cf05d tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:44.297524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c29b75bd-8f83-420a-9aab-bf15018cf05d tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:44.882278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c29b75bd-8f83-420a-9aab-bf15018cf05d tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:44.903407 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c29b75bd-8f83-420a-9aab-bf15018cf05d tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1317 microversion: 2.1 time: 0.628342 Sep 10 21:07:44.906395 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2201/4490] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:44 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:44.919757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a6bbb90e-a692-4b73-a002-bb3e0f0d1838 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:44.922065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a6bbb90e-a692-4b73-a002-bb3e0f0d1838 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:44.937622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6bbb90e-a692-4b73-a002-bb3e0f0d1838 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:44.941526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6bbb90e-a692-4b73-a002-bb3e0f0d1838 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:44.942720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6bbb90e-a692-4b73-a002-bb3e0f0d1838 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:44.944358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6bbb90e-a692-4b73-a002-bb3e0f0d1838 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:44.945125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6bbb90e-a692-4b73-a002-bb3e0f0d1838 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:44.946381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6bbb90e-a692-4b73-a002-bb3e0f0d1838 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:44.986773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:44.998779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:45.000340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:45.002343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:45.004997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:45.005870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:45.006791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:45.118319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a6bbb90e-a692-4b73-a002-bb3e0f0d1838 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:45.134576 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a6bbb90e-a692-4b73-a002-bb3e0f0d1838 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1287 microversion: 2.1 time: 0.225165 Sep 10 21:07:45.135719 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2202/4491] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:44 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1287 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:45.570723 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] HTTP exception thrown: Floating IP 172.35.7.136 is not associated with instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92. Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Request method failure captured: Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92/action HTTP/1.1 Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 49 Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxcJyrrfve3ZZT1xctzW-cKv6zksHo6eMxm1efxTE4XXqi0_TdQiuR3HFWcAcQWSFUYPXPomZiZ5BxTWKs2mJJ5hZryfHulAwlqc5JPoTJKv7XrlPgflYrx9TdeNdZg0WzdRleFoDmLoeMT6r80vjLMrL48A9beUNswcCtBnOkpXWc Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: ceebf89c39014750ae279e0741a0bb79 Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ceebf89c39014750ae279e0741a0bb79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ceebf89c39014750ae279e0741a0bb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ceebf89c39014750ae279e0741a0bb79", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ceebf89c39014750ae279e0741a0bb79"}]}] Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: ceebf89c39014750ae279e0741a0bb79 Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-FloatingIPsAssociationTestJSON-1702847205-project Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9546792be5a640e2a59fb2e8481c6c4b Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1702847205-project Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: {"removeFloatingIp": {"address": "172.35.7.136"}} Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: method: Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: exception: Floating IP 172.35.7.136 is not associated with instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92. Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a73c36f9-4016-4ac2-ab6e-d56b10d6ad92', 'body': {'removeFloatingIp': {'address': '172.35.7.136'}}} Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.7.136 is not associated with instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92. Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.7.136 is not associated with instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92. Sep 10 21:07:45.573482 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:07:45.579393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Returning 409 to user: Floating IP 172.35.7.136 is not associated with instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:07:45.583378 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6759e9c8-6d7e-4d1a-aab8-f247a74bac79 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "POST /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92/action" status: 409 len: 146 microversion: 2.1 time: 1.363208 Sep 10 21:07:45.587277 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2290/4492] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:07:44 2022] POST /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92/action => generated 146 bytes in 1368 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 21:07:45.592669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.136"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:45.936314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0182c277-0cdb-4250-b986-00d95cfcc96e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:45.937390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0182c277-0cdb-4250-b986-00d95cfcc96e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:45.944834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:45.958688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0182c277-0cdb-4250-b986-00d95cfcc96e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:45.962345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0182c277-0cdb-4250-b986-00d95cfcc96e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:45.963127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0182c277-0cdb-4250-b986-00d95cfcc96e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:45.964198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0182c277-0cdb-4250-b986-00d95cfcc96e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:45.964900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0182c277-0cdb-4250-b986-00d95cfcc96e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:45.965556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0182c277-0cdb-4250-b986-00d95cfcc96e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:46.121674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:46.132439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:46.133484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:46.134154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:46.135320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:46.136833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:46.139460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:46.486719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0182c277-0cdb-4250-b986-00d95cfcc96e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:46.495107 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0182c277-0cdb-4250-b986-00d95cfcc96e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1317 microversion: 2.1 time: 0.570042 Sep 10 21:07:46.505067 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2291/4493] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:45 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:46.510122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b3fae56a-297d-4c8a-8b99-02d113db3602 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:46.511067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b3fae56a-297d-4c8a-8b99-02d113db3602 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:46.528538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3fae56a-297d-4c8a-8b99-02d113db3602 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:46.529330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3fae56a-297d-4c8a-8b99-02d113db3602 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:46.529957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3fae56a-297d-4c8a-8b99-02d113db3602 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:46.530837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3fae56a-297d-4c8a-8b99-02d113db3602 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:46.531459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3fae56a-297d-4c8a-8b99-02d113db3602 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:46.532049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3fae56a-297d-4c8a-8b99-02d113db3602 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:46.888007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b3fae56a-297d-4c8a-8b99-02d113db3602 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:46.897864 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b3fae56a-297d-4c8a-8b99-02d113db3602 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1329 microversion: 2.1 time: 0.389882 Sep 10 21:07:46.898488 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2292/4494] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:46 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1329 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:47.309759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "refresh_cache-75fc6946-4e0d-44f3-9f89-e8c7ab602d45" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 21:07:47.310300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquired lock "refresh_cache-75fc6946-4e0d-44f3-9f89-e8c7ab602d45" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 21:07:47.518791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b0e208a7-8ecd-4e72-892d-68cf4999f29c tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:47.519443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b0e208a7-8ecd-4e72-892d-68cf4999f29c tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:47.538551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e208a7-8ecd-4e72-892d-68cf4999f29c tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:47.539304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e208a7-8ecd-4e72-892d-68cf4999f29c tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:47.539911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e208a7-8ecd-4e72-892d-68cf4999f29c tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:47.540807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e208a7-8ecd-4e72-892d-68cf4999f29c tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:47.541444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e208a7-8ecd-4e72-892d-68cf4999f29c tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:47.542066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b0e208a7-8ecd-4e72-892d-68cf4999f29c tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:47.775598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b0e208a7-8ecd-4e72-892d-68cf4999f29c tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:47.787685 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b0e208a7-8ecd-4e72-892d-68cf4999f29c tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1317 microversion: 2.1 time: 0.272670 Sep 10 21:07:47.795486 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2293/4495] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:47 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:47.922153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0d457211-b1e3-4c0d-8a66-9dd3a59cac05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:47.923439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0d457211-b1e3-4c0d-8a66-9dd3a59cac05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:47.935862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d457211-b1e3-4c0d-8a66-9dd3a59cac05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:47.936666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d457211-b1e3-4c0d-8a66-9dd3a59cac05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:47.937859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d457211-b1e3-4c0d-8a66-9dd3a59cac05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:47.938806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d457211-b1e3-4c0d-8a66-9dd3a59cac05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:47.941397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d457211-b1e3-4c0d-8a66-9dd3a59cac05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:47.942707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d457211-b1e3-4c0d-8a66-9dd3a59cac05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:48.275153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0d457211-b1e3-4c0d-8a66-9dd3a59cac05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:48.301320 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0d457211-b1e3-4c0d-8a66-9dd3a59cac05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1329 microversion: 2.1 time: 0.383798 Sep 10 21:07:48.302819 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2294/4496] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:47 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1329 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:48.820300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9655818-1e5f-47ff-a2ba-598277273791 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:48.821399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f9655818-1e5f-47ff-a2ba-598277273791 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:48.850355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9655818-1e5f-47ff-a2ba-598277273791 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:48.851470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9655818-1e5f-47ff-a2ba-598277273791 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:48.852242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9655818-1e5f-47ff-a2ba-598277273791 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:48.853486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9655818-1e5f-47ff-a2ba-598277273791 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:48.867663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9655818-1e5f-47ff-a2ba-598277273791 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:48.868457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9655818-1e5f-47ff-a2ba-598277273791 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:49.276761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f9655818-1e5f-47ff-a2ba-598277273791 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:49.286195 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f9655818-1e5f-47ff-a2ba-598277273791 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1317 microversion: 2.1 time: 0.476930 Sep 10 21:07:49.288487 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2295/4497] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:48 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:49.641248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-178138018", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "9d511630-8d55-4793-abab-d34f58a87bab"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:49.725430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] validate_networks() for [('9d511630-8d55-4793-abab-d34f58a87bab', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:07:50.029660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Building network info cache for instance {{(pid=145771) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 21:07:50.847514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:07:50.848183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:07:50.848877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:07:50.849610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:07:50.850906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:07:50.885647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:50.888622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:50.889105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:50.892047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:50.895630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:50.896155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:50.922825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Getting quotas for project 8f28fa6f3f1a47c69fb5931ad9803148. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:07:50.939181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Getting quotas for user 500d8f7d16c74678a8eb62e76d262692 and project 8f28fa6f3f1a47c69fb5931ad9803148. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:07:50.962285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:07:50.965261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:07:51.032314 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f942f508-0cc5-4871-9769-bb5460977008 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741638 Sep 10 21:07:51.045228 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2296/4498] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:07:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:07:51.066556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-36a37c5b-6549-44fd-adb7-7b63f930cfbd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:51.068508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-36a37c5b-6549-44fd-adb7-7b63f930cfbd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:51.075655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36a37c5b-6549-44fd-adb7-7b63f930cfbd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:51.076417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36a37c5b-6549-44fd-adb7-7b63f930cfbd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:51.077035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36a37c5b-6549-44fd-adb7-7b63f930cfbd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:51.078101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36a37c5b-6549-44fd-adb7-7b63f930cfbd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:51.078718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36a37c5b-6549-44fd-adb7-7b63f930cfbd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:51.079304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36a37c5b-6549-44fd-adb7-7b63f930cfbd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:51.478262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-36a37c5b-6549-44fd-adb7-7b63f930cfbd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:51.497802 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-36a37c5b-6549-44fd-adb7-7b63f930cfbd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1329 microversion: 2.1 time: 0.454860 Sep 10 21:07:51.500961 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2297/4499] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:51 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1329 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:51.532287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-39255667-01f5-4d39-8716-bcb2d8bec036 req-3192c56c-c3fe-48ed-8f25-86a014426a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18b42dd4-4dd0-451e-826f-7dab0944ba02", "tag": "fe16acf8-da85-4ab7-b926-194e2f6b4467"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:51.551589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-39255667-01f5-4d39-8716-bcb2d8bec036 req-3192c56c-c3fe-48ed-8f25-86a014426a52 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:51.552375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-39255667-01f5-4d39-8716-bcb2d8bec036 req-3192c56c-c3fe-48ed-8f25-86a014426a52 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:51.553155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-39255667-01f5-4d39-8716-bcb2d8bec036 req-3192c56c-c3fe-48ed-8f25-86a014426a52 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:51.580649 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-39255667-01f5-4d39-8716-bcb2d8bec036 req-3192c56c-c3fe-48ed-8f25-86a014426a52 service nova] Creating event network-changed:fe16acf8-da85-4ab7-b926-194e2f6b4467 for instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 on nch1-master-1 Sep 10 21:07:51.586923 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-39255667-01f5-4d39-8716-bcb2d8bec036 req-3192c56c-c3fe-48ed-8f25-86a014426a52 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066813 Sep 10 21:07:51.588272 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2298/4500] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:51.596317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-444e331e-bfcc-4b7d-a634-852ce41808bb tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:51.597397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-444e331e-bfcc-4b7d-a634-852ce41808bb tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:51.607828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-444e331e-bfcc-4b7d-a634-852ce41808bb tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:51.609887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-444e331e-bfcc-4b7d-a634-852ce41808bb tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:51.610792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-444e331e-bfcc-4b7d-a634-852ce41808bb tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:51.611798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-444e331e-bfcc-4b7d-a634-852ce41808bb tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:51.612468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-444e331e-bfcc-4b7d-a634-852ce41808bb tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:51.613140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-444e331e-bfcc-4b7d-a634-852ce41808bb tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:51.815698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Updating instance_info_cache with network_info: [{"id": "e079308a-fb28-4e94-a415-5209149ba84c", "address": "fa:16:3e:49:2a:d8", "network": {"id": "a53f27f3-ecaa-4250-a852-1d8a7bb068e9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-384757171-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ceebf89c39014750ae279e0741a0bb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape079308a-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=145771) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 21:07:51.835307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Releasing lock "refresh_cache-75fc6946-4e0d-44f3-9f89-e8c7ab602d45" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 21:07:51.836217 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-06310439-a397-4649-8652-4f3f095f05ee tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "POST /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45/action" status: 202 len: 0 microversion: 2.1 time: 6.247714 Sep 10 21:07:51.838265 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2203/4501] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:07:45 2022] POST /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45/action => generated 0 bytes in 6250 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 21:07:51.847034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5038c007-5188-4ec2-9e54-477ec0642378 req-020b1372-aa39-4bf2-92c0-03c9c9352e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cc68a6-4400-4205-8c85-ad55a8f3c6ae", "name": "network-vif-plugged", "status": "completed", "tag": "42286044-fd28-4abf-9c52-c49844413f37"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:51.880488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5038c007-5188-4ec2-9e54-477ec0642378 req-020b1372-aa39-4bf2-92c0-03c9c9352e73 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:51.880977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5038c007-5188-4ec2-9e54-477ec0642378 req-020b1372-aa39-4bf2-92c0-03c9c9352e73 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:51.881411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5038c007-5188-4ec2-9e54-477ec0642378 req-020b1372-aa39-4bf2-92c0-03c9c9352e73 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:51.923401 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5038c007-5188-4ec2-9e54-477ec0642378 req-020b1372-aa39-4bf2-92c0-03c9c9352e73 service nova] Creating event network-vif-plugged:42286044-fd28-4abf-9c52-c49844413f37 for instance 41cc68a6-4400-4205-8c85-ad55a8f3c6ae on nch1-master-1 Sep 10 21:07:51.944524 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5038c007-5188-4ec2-9e54-477ec0642378 req-020b1372-aa39-4bf2-92c0-03c9c9352e73 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103753 Sep 10 21:07:51.951223 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2204/4502] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:51.977585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a30f4758-21ba-40d5-9c78-33941029c936 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:51.979811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a30f4758-21ba-40d5-9c78-33941029c936 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:51.997580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a30f4758-21ba-40d5-9c78-33941029c936 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:52.000205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a30f4758-21ba-40d5-9c78-33941029c936 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:52.000894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a30f4758-21ba-40d5-9c78-33941029c936 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:52.001661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a30f4758-21ba-40d5-9c78-33941029c936 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:52.007221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a30f4758-21ba-40d5-9c78-33941029c936 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:52.011608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a30f4758-21ba-40d5-9c78-33941029c936 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:52.162173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-444e331e-bfcc-4b7d-a634-852ce41808bb tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:52.176066 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-444e331e-bfcc-4b7d-a634-852ce41808bb tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1317 microversion: 2.1 time: 0.584657 Sep 10 21:07:52.179537 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2299/4503] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:51 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:52.188859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35f01457-28c3-4cd2-8141-7d077a9bcc44 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:52.189914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35f01457-28c3-4cd2-8141-7d077a9bcc44 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:52.208945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a30f4758-21ba-40d5-9c78-33941029c936 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:52.219959 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a30f4758-21ba-40d5-9c78-33941029c936 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1217 microversion: 2.1 time: 0.262818 Sep 10 21:07:52.235906 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2205/4504] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:51 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1217 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:52.237002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35f01457-28c3-4cd2-8141-7d077a9bcc44 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:52.239705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35f01457-28c3-4cd2-8141-7d077a9bcc44 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:52.248715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35f01457-28c3-4cd2-8141-7d077a9bcc44 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:52.252173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35f01457-28c3-4cd2-8141-7d077a9bcc44 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:52.253013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35f01457-28c3-4cd2-8141-7d077a9bcc44 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:52.256669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35f01457-28c3-4cd2-8141-7d077a9bcc44 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:52.335560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35f01457-28c3-4cd2-8141-7d077a9bcc44 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:07:52.339268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:52.528218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3fd33dd-07e9-4190-8523-39c148768a9c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:52.529170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b3fd33dd-07e9-4190-8523-39c148768a9c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:52.548010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3fd33dd-07e9-4190-8523-39c148768a9c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:52.549287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3fd33dd-07e9-4190-8523-39c148768a9c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:52.550719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3fd33dd-07e9-4190-8523-39c148768a9c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:52.553035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3fd33dd-07e9-4190-8523-39c148768a9c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:52.554357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3fd33dd-07e9-4190-8523-39c148768a9c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:52.557690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3fd33dd-07e9-4190-8523-39c148768a9c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:52.569288 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35f01457-28c3-4cd2-8141-7d077a9bcc44 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 204 len: 0 microversion: 2.1 time: 0.387637 Sep 10 21:07:52.573982 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2300/4505] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:07:52 2022] DELETE /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:07:52.591363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.136"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:52.594160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:52.609254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:52.609752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:52.610243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:52.610950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:52.611402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:52.611823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:52.680841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "refresh_cache-a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 21:07:52.681660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquired lock "refresh_cache-a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 21:07:52.867477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b3fd33dd-07e9-4190-8523-39c148768a9c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:52.876643 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b3fd33dd-07e9-4190-8523-39c148768a9c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1329 microversion: 2.1 time: 0.353315 Sep 10 21:07:52.890628 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2206/4506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:52 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1329 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:52.946074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b63f4e79-ebf4-4301-8fc8-b657cbf0f221 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:52.947135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b63f4e79-ebf4-4301-8fc8-b657cbf0f221 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:52.959539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b63f4e79-ebf4-4301-8fc8-b657cbf0f221 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:52.960579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b63f4e79-ebf4-4301-8fc8-b657cbf0f221 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:52.962681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b63f4e79-ebf4-4301-8fc8-b657cbf0f221 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:52.964025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b63f4e79-ebf4-4301-8fc8-b657cbf0f221 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:52.964841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b63f4e79-ebf4-4301-8fc8-b657cbf0f221 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:52.966002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b63f4e79-ebf4-4301-8fc8-b657cbf0f221 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:53.088661 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b63f4e79-ebf4-4301-8fc8-b657cbf0f221 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/ips" status: 200 len: 146 microversion: 2.1 time: 0.148414 Sep 10 21:07:53.100189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2207/4507] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:07:52 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/ips => generated 146 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:53.204058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a2819d7-a6a7-476b-b934-a276d2604166 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:53.204911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3a2819d7-a6a7-476b-b934-a276d2604166 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:53.219816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a2819d7-a6a7-476b-b934-a276d2604166 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:53.220442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a2819d7-a6a7-476b-b934-a276d2604166 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:53.221026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a2819d7-a6a7-476b-b934-a276d2604166 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:53.221878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a2819d7-a6a7-476b-b934-a276d2604166 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:53.222452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a2819d7-a6a7-476b-b934-a276d2604166 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:53.223275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a2819d7-a6a7-476b-b934-a276d2604166 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:53.735529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a2819d7-a6a7-476b-b934-a276d2604166 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:53.746392 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3a2819d7-a6a7-476b-b934-a276d2604166 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1317 microversion: 2.1 time: 0.546324 Sep 10 21:07:53.767515 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2208/4508] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:53 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:07:53.773732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0819e54d-cf1f-4410-94cd-3499c4d3fa68 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:53.774819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0819e54d-cf1f-4410-94cd-3499c4d3fa68 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:53.787985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0819e54d-cf1f-4410-94cd-3499c4d3fa68 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:53.788811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0819e54d-cf1f-4410-94cd-3499c4d3fa68 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:53.789495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0819e54d-cf1f-4410-94cd-3499c4d3fa68 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:53.790474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0819e54d-cf1f-4410-94cd-3499c4d3fa68 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:53.791154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0819e54d-cf1f-4410-94cd-3499c4d3fa68 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:53.791818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0819e54d-cf1f-4410-94cd-3499c4d3fa68 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:53.902824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0819e54d-cf1f-4410-94cd-3499c4d3fa68 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:53.914177 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0819e54d-cf1f-4410-94cd-3499c4d3fa68 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1265 microversion: 2.1 time: 0.144939 Sep 10 21:07:53.926383 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2209/4509] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:53 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:53.932905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-db128715-db73-40bf-825d-5ef24a07a9b0 req-cf4735a8-c783-47d6-8fba-201f7d74cf66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75fc6946-4e0d-44f3-9f89-e8c7ab602d45", "tag": "e079308a-fb28-4e94-a415-5209149ba84c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:53.946519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-db128715-db73-40bf-825d-5ef24a07a9b0 req-cf4735a8-c783-47d6-8fba-201f7d74cf66 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:53.947629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-db128715-db73-40bf-825d-5ef24a07a9b0 req-cf4735a8-c783-47d6-8fba-201f7d74cf66 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:53.948446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-db128715-db73-40bf-825d-5ef24a07a9b0 req-cf4735a8-c783-47d6-8fba-201f7d74cf66 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:53.967298 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-db128715-db73-40bf-825d-5ef24a07a9b0 req-cf4735a8-c783-47d6-8fba-201f7d74cf66 service nova] Creating event network-changed:e079308a-fb28-4e94-a415-5209149ba84c for instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 on nch2-master-1 Sep 10 21:07:53.974843 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-db128715-db73-40bf-825d-5ef24a07a9b0 req-cf4735a8-c783-47d6-8fba-201f7d74cf66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058178 Sep 10 21:07:53.976017 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2210/4510] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:53.984825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-246037a5-56eb-43c2-9cdc-84f1a8b8bfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:53.985704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-246037a5-56eb-43c2-9cdc-84f1a8b8bfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:53.993386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246037a5-56eb-43c2-9cdc-84f1a8b8bfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:53.994618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246037a5-56eb-43c2-9cdc-84f1a8b8bfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:53.995241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246037a5-56eb-43c2-9cdc-84f1a8b8bfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:53.996128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246037a5-56eb-43c2-9cdc-84f1a8b8bfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:53.996745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246037a5-56eb-43c2-9cdc-84f1a8b8bfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:53.997336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246037a5-56eb-43c2-9cdc-84f1a8b8bfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:54.623840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-246037a5-56eb-43c2-9cdc-84f1a8b8bfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:54.657535 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-246037a5-56eb-43c2-9cdc-84f1a8b8bfe0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1329 microversion: 2.1 time: 0.679861 Sep 10 21:07:54.660383 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2211/4511] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:53 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1329 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:54.776353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80982403-9107-405b-9d23-baec06938eb4 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:54.777432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-80982403-9107-405b-9d23-baec06938eb4 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:54.793805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80982403-9107-405b-9d23-baec06938eb4 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:54.795916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80982403-9107-405b-9d23-baec06938eb4 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:54.801424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80982403-9107-405b-9d23-baec06938eb4 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:54.803370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80982403-9107-405b-9d23-baec06938eb4 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:54.806530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80982403-9107-405b-9d23-baec06938eb4 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:54.807196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80982403-9107-405b-9d23-baec06938eb4 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:54.871741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:RELEASE=4,nova_cell1:SELECT=87,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:07:56.005814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-80982403-9107-405b-9d23-baec06938eb4 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:56.014987 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-80982403-9107-405b-9d23-baec06938eb4 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1317 microversion: 2.1 time: 1.243947 Sep 10 21:07:56.020558 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2212/4512] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:54 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1317 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:56.025450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ebcfb822-fe5f-4f27-a71b-734509712d17 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:56.030604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ebcfb822-fe5f-4f27-a71b-734509712d17 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:56.044647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebcfb822-fe5f-4f27-a71b-734509712d17 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:56.048624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebcfb822-fe5f-4f27-a71b-734509712d17 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:56.049431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebcfb822-fe5f-4f27-a71b-734509712d17 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:56.053104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebcfb822-fe5f-4f27-a71b-734509712d17 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:56.054043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebcfb822-fe5f-4f27-a71b-734509712d17 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:56.056133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebcfb822-fe5f-4f27-a71b-734509712d17 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:56.325594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ebcfb822-fe5f-4f27-a71b-734509712d17 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:56.342204 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ebcfb822-fe5f-4f27-a71b-734509712d17 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1271 microversion: 2.1 time: 0.320117 Sep 10 21:07:56.342994 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2213/4513] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:56 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1271 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:56.358967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-49708016-2ce6-49dd-a500-e402ece13968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:56.361177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-49708016-2ce6-49dd-a500-e402ece13968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:56.375680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49708016-2ce6-49dd-a500-e402ece13968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:56.376190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49708016-2ce6-49dd-a500-e402ece13968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:56.376632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49708016-2ce6-49dd-a500-e402ece13968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:56.377336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49708016-2ce6-49dd-a500-e402ece13968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:56.377856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49708016-2ce6-49dd-a500-e402ece13968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:56.391849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49708016-2ce6-49dd-a500-e402ece13968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:57.164630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Building network info cache for instance {{(pid=145772) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 21:07:57.186249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-49708016-2ce6-49dd-a500-e402ece13968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:57.206676 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-49708016-2ce6-49dd-a500-e402ece13968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1329 microversion: 2.1 time: 0.862435 Sep 10 21:07:57.208408 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2214/4514] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:56 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1329 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:57.214874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1c751d12-c5e2-44a7-b5e8-b56e955b3f75 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "939d11dd-0156-46c3-817b-2b0abd931e5b"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:57.217652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1c751d12-c5e2-44a7-b5e8-b56e955b3f75 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:57.227665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c751d12-c5e2-44a7-b5e8-b56e955b3f75 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:57.229096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c751d12-c5e2-44a7-b5e8-b56e955b3f75 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:57.229777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c751d12-c5e2-44a7-b5e8-b56e955b3f75 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:57.230789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c751d12-c5e2-44a7-b5e8-b56e955b3f75 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:57.231539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c751d12-c5e2-44a7-b5e8-b56e955b3f75 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:57.232287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c751d12-c5e2-44a7-b5e8-b56e955b3f75 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:57.840221 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1c751d12-c5e2-44a7-b5e8-b56e955b3f75 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629978 Sep 10 21:07:57.841638 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2215/4515] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:07:57 2022] POST /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:57.893993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f635439c-2f5a-4e0e-8ecd-77318b511783 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:57.898801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f635439c-2f5a-4e0e-8ecd-77318b511783 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:57.922276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f635439c-2f5a-4e0e-8ecd-77318b511783 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:57.925736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f635439c-2f5a-4e0e-8ecd-77318b511783 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:57.928010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f635439c-2f5a-4e0e-8ecd-77318b511783 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:57.933558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f635439c-2f5a-4e0e-8ecd-77318b511783 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:57.934114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f635439c-2f5a-4e0e-8ecd-77318b511783 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:57.935792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f635439c-2f5a-4e0e-8ecd-77318b511783 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:59.433087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f635439c-2f5a-4e0e-8ecd-77318b511783 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:07:59.450711 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f635439c-2f5a-4e0e-8ecd-77318b511783 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1506 microversion: 2.1 time: 1.606170 Sep 10 21:07:59.456197 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2216/4516] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:57 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1506 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:07:59.467926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0c9c6977-c5cb-4873-bad3-505c461295e2 req-e09593bd-252a-4f71-8c5a-285828d2fbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73c36f9-4016-4ac2-ab6e-d56b10d6ad92", "tag": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:07:59.506487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0c9c6977-c5cb-4873-bad3-505c461295e2 req-e09593bd-252a-4f71-8c5a-285828d2fbc6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:59.507446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0c9c6977-c5cb-4873-bad3-505c461295e2 req-e09593bd-252a-4f71-8c5a-285828d2fbc6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:59.508033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0c9c6977-c5cb-4873-bad3-505c461295e2 req-e09593bd-252a-4f71-8c5a-285828d2fbc6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:59.524576 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0c9c6977-c5cb-4873-bad3-505c461295e2 req-e09593bd-252a-4f71-8c5a-285828d2fbc6 service nova] Creating event network-changed:8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22 for instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 on nch2-master-1 Sep 10 21:07:59.531295 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0c9c6977-c5cb-4873-bad3-505c461295e2 req-e09593bd-252a-4f71-8c5a-285828d2fbc6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073285 Sep 10 21:07:59.532347 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2217/4517] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:07:59.542640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98e8b4cb-fe06-49ec-a0d5-e7b0560189d5 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:07:59.543722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-98e8b4cb-fe06-49ec-a0d5-e7b0560189d5 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:07:59.552445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e8b4cb-fe06-49ec-a0d5-e7b0560189d5 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:59.553316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e8b4cb-fe06-49ec-a0d5-e7b0560189d5 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:59.553947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e8b4cb-fe06-49ec-a0d5-e7b0560189d5 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:07:59.554814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e8b4cb-fe06-49ec-a0d5-e7b0560189d5 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:07:59.555471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e8b4cb-fe06-49ec-a0d5-e7b0560189d5 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:07:59.556047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e8b4cb-fe06-49ec-a0d5-e7b0560189d5 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:00.395845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-98e8b4cb-fe06-49ec-a0d5-e7b0560189d5 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:00.403893 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-98e8b4cb-fe06-49ec-a0d5-e7b0560189d5 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1313 microversion: 2.1 time: 0.869862 Sep 10 21:08:00.424525 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2218/4518] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:07:59 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1313 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:00.429954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-9c2da8d9-88ad-41d6-859a-d3ca4f86ed4e req-69fc519f-6f6e-4cad-a8b6-7fdacb3e0e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fc6946-4e0d-44f3-9f89-e8c7ab602d45", "name": "network-vif-unplugged", "status": "completed", "tag": "e079308a-fb28-4e94-a415-5209149ba84c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:00.462553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9c2da8d9-88ad-41d6-859a-d3ca4f86ed4e req-69fc519f-6f6e-4cad-a8b6-7fdacb3e0e58 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:00.463155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9c2da8d9-88ad-41d6-859a-d3ca4f86ed4e req-69fc519f-6f6e-4cad-a8b6-7fdacb3e0e58 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:00.463843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9c2da8d9-88ad-41d6-859a-d3ca4f86ed4e req-69fc519f-6f6e-4cad-a8b6-7fdacb3e0e58 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:00.477448 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-9c2da8d9-88ad-41d6-859a-d3ca4f86ed4e req-69fc519f-6f6e-4cad-a8b6-7fdacb3e0e58 service nova] Creating event network-vif-unplugged:e079308a-fb28-4e94-a415-5209149ba84c for instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 on nch2-master-1 Sep 10 21:08:00.484620 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-9c2da8d9-88ad-41d6-859a-d3ca4f86ed4e req-69fc519f-6f6e-4cad-a8b6-7fdacb3e0e58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057609 Sep 10 21:08:00.489367 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2219/4519] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:00.507910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4f22dd88-9a99-4d9a-9884-e1b10f2f616a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:00.508476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4f22dd88-9a99-4d9a-9884-e1b10f2f616a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:00.522346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f22dd88-9a99-4d9a-9884-e1b10f2f616a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:00.523132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f22dd88-9a99-4d9a-9884-e1b10f2f616a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:00.523577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f22dd88-9a99-4d9a-9884-e1b10f2f616a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:00.524278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f22dd88-9a99-4d9a-9884-e1b10f2f616a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:00.524883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f22dd88-9a99-4d9a-9884-e1b10f2f616a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:00.525461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f22dd88-9a99-4d9a-9884-e1b10f2f616a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:00.699072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Updating instance_info_cache with network_info: [{"id": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22", "address": "fa:16:3e:5a:e3:84", "network": {"id": "a53f27f3-ecaa-4250-a852-1d8a7bb068e9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-384757171-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ceebf89c39014750ae279e0741a0bb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8c0d0ec6-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=145772) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 21:08:00.724105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Releasing lock "refresh_cache-a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" {{(pid=145772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 21:08:00.726663 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-057f8721-1284-4bb8-91f3-3de5059d2783 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "POST /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92/action" status: 202 len: 0 microversion: 2.1 time: 8.146374 Sep 10 21:08:00.727411 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2301/4520] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:07:52 2022] POST /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92/action => generated 0 bytes in 8148 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 21:08:00.748844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d694a96-0515-4947-adf7-6e49cc8406df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:00.748844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d694a96-0515-4947-adf7-6e49cc8406df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:00.759113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d694a96-0515-4947-adf7-6e49cc8406df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:00.760014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d694a96-0515-4947-adf7-6e49cc8406df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:00.760816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d694a96-0515-4947-adf7-6e49cc8406df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:00.761911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d694a96-0515-4947-adf7-6e49cc8406df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:00.763211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d694a96-0515-4947-adf7-6e49cc8406df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:00.764346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d694a96-0515-4947-adf7-6e49cc8406df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:00.816518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d694a96-0515-4947-adf7-6e49cc8406df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:00.818445 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d694a96-0515-4947-adf7-6e49cc8406df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae/os-instance-actions/req-0f464038-26b2-442f-b5b5-c03aba2e4579" status: 200 len: 313 microversion: 2.1 time: 0.085642 Sep 10 21:08:00.820181 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2302/4521] 10.222.0.33 () {58 vars in 1419 bytes} [Sat Sep 10 21:08:00 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae/os-instance-actions/req-0f464038-26b2-442f-b5b5-c03aba2e4579 => generated 313 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:00.827223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3478393f-c222-47bb-8281-84937610f977 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '.version_select at 0x7f993fbe81f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:00.871373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4f22dd88-9a99-4d9a-9884-e1b10f2f616a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:00.889703 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4f22dd88-9a99-4d9a-9884-e1b10f2f616a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1329 microversion: 2.1 time: 0.398956 Sep 10 21:08:00.890883 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2220/4522] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:00 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1329 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:00.902716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-692c4b7a-a8bd-49b4-bb72-7a1b88dc3213 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:00.910654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-692c4b7a-a8bd-49b4-bb72-7a1b88dc3213 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:00.910940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:00.928225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-692c4b7a-a8bd-49b4-bb72-7a1b88dc3213 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:00.928776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-692c4b7a-a8bd-49b4-bb72-7a1b88dc3213 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:00.932541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-692c4b7a-a8bd-49b4-bb72-7a1b88dc3213 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:00.934589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-692c4b7a-a8bd-49b4-bb72-7a1b88dc3213 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:00.939462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-692c4b7a-a8bd-49b4-bb72-7a1b88dc3213 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:00.940557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-692c4b7a-a8bd-49b4-bb72-7a1b88dc3213 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:00.950838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=26 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:01.196932 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-692c4b7a-a8bd-49b4-bb72-7a1b88dc3213 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "POST /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae/action" status: 202 len: 0 microversion: 2.1 time: 0.304359 Sep 10 21:08:01.201246 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2221/4523] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:08:00 2022] POST /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:08:01.216051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-afad4d1e-03a2-403e-b677-dd41d697aac7 req-40463f50-9ce0-4212-a559-25cf1e499c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f701cef-e0ea-43a4-9524-ce37ebc25806", "tag": "cc864348-2ed1-4211-a206-99461f3af0f2"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:01.244020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-afad4d1e-03a2-403e-b677-dd41d697aac7 req-40463f50-9ce0-4212-a559-25cf1e499c9d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:01.244782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-afad4d1e-03a2-403e-b677-dd41d697aac7 req-40463f50-9ce0-4212-a559-25cf1e499c9d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:01.245378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-afad4d1e-03a2-403e-b677-dd41d697aac7 req-40463f50-9ce0-4212-a559-25cf1e499c9d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:01.289182 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-afad4d1e-03a2-403e-b677-dd41d697aac7 req-40463f50-9ce0-4212-a559-25cf1e499c9d service nova] Creating event network-changed:cc864348-2ed1-4211-a206-99461f3af0f2 for instance 7f701cef-e0ea-43a4-9524-ce37ebc25806 on nch2-master-1 Sep 10 21:08:01.298230 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-afad4d1e-03a2-403e-b677-dd41d697aac7 req-40463f50-9ce0-4212-a559-25cf1e499c9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094024 Sep 10 21:08:01.302465 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2222/4524] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:01.311946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5fee66d-2af1-4313-b19d-1a75b02e1e4e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:01.313311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e5fee66d-2af1-4313-b19d-1a75b02e1e4e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:01.327590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5fee66d-2af1-4313-b19d-1a75b02e1e4e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:01.328579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5fee66d-2af1-4313-b19d-1a75b02e1e4e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:01.329970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5fee66d-2af1-4313-b19d-1a75b02e1e4e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:01.330919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5fee66d-2af1-4313-b19d-1a75b02e1e4e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:01.331540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5fee66d-2af1-4313-b19d-1a75b02e1e4e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:01.333197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5fee66d-2af1-4313-b19d-1a75b02e1e4e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:01.612456 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3478393f-c222-47bb-8281-84937610f977 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/38dbce09-1962-4d58-aff8-a11cdc11ac52" status: 200 len: 184 microversion: 2.1 time: 0.787897 Sep 10 21:08:01.614754 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2303/4525] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 21:08:00 2022] GET /compute/v2.1/os-floating-ips/38dbce09-1962-4d58-aff8-a11cdc11ac52 => generated 184 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:01.629603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8429f673-6b91-47a7-ae93-73fe43e0550e tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:01.631216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8429f673-6b91-47a7-ae93-73fe43e0550e tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:01.646290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8429f673-6b91-47a7-ae93-73fe43e0550e tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:01.648383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8429f673-6b91-47a7-ae93-73fe43e0550e tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:01.649041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8429f673-6b91-47a7-ae93-73fe43e0550e tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:01.650009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8429f673-6b91-47a7-ae93-73fe43e0550e tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:01.650803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8429f673-6b91-47a7-ae93-73fe43e0550e tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:01.651400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8429f673-6b91-47a7-ae93-73fe43e0550e tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:02.006232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e5fee66d-2af1-4313-b19d-1a75b02e1e4e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:02.023392 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5fee66d-2af1-4313-b19d-1a75b02e1e4e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1508 microversion: 2.1 time: 0.718430 Sep 10 21:08:02.024470 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2223/4526] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:01 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1508 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:02.030536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-25d34ad2-80e4-4f29-954f-90547bd49bdb req-badf8dc7-4a81-4e38-93f1-4b2da8960c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fc6946-4e0d-44f3-9f89-e8c7ab602d45", "name": "network-vif-deleted", "tag": "e079308a-fb28-4e94-a415-5209149ba84c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:02.060302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-25d34ad2-80e4-4f29-954f-90547bd49bdb req-badf8dc7-4a81-4e38-93f1-4b2da8960c51 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:02.061051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-25d34ad2-80e4-4f29-954f-90547bd49bdb req-badf8dc7-4a81-4e38-93f1-4b2da8960c51 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:02.061482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-25d34ad2-80e4-4f29-954f-90547bd49bdb req-badf8dc7-4a81-4e38-93f1-4b2da8960c51 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:02.087561 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-25d34ad2-80e4-4f29-954f-90547bd49bdb req-badf8dc7-4a81-4e38-93f1-4b2da8960c51 service nova] Creating event network-vif-deleted:e079308a-fb28-4e94-a415-5209149ba84c for instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 on nch2-master-1 Sep 10 21:08:02.103039 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-25d34ad2-80e4-4f29-954f-90547bd49bdb req-badf8dc7-4a81-4e38-93f1-4b2da8960c51 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077114 Sep 10 21:08:02.103680 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2224/4527] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:02.117642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.136"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:02.236588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8429f673-6b91-47a7-ae93-73fe43e0550e tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:02.246581 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8429f673-6b91-47a7-ae93-73fe43e0550e tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1313 microversion: 2.1 time: 0.629322 Sep 10 21:08:02.247442 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2304/4528] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:01 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:02.252358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81d7b223-ec75-4b9c-b53e-1b675a178968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:02.253085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81d7b223-ec75-4b9c-b53e-1b675a178968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:02.259996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81d7b223-ec75-4b9c-b53e-1b675a178968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:02.260509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81d7b223-ec75-4b9c-b53e-1b675a178968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:02.261184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81d7b223-ec75-4b9c-b53e-1b675a178968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:02.262278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81d7b223-ec75-4b9c-b53e-1b675a178968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:02.262734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81d7b223-ec75-4b9c-b53e-1b675a178968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:02.263361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81d7b223-ec75-4b9c-b53e-1b675a178968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:02.531724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-81d7b223-ec75-4b9c-b53e-1b675a178968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:02.543177 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81d7b223-ec75-4b9c-b53e-1b675a178968 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1329 microversion: 2.1 time: 0.294218 Sep 10 21:08:02.544721 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2305/4529] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:02 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1329 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:02.549623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8fe9f89f-8610-47ca-bb33-8391967306c9 req-47b07749-540a-4f79-aac4-370f311f2242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b42dd4-4dd0-451e-826f-7dab0944ba02", "name": "network-vif-plugged", "status": "completed", "tag": "fe16acf8-da85-4ab7-b926-194e2f6b4467"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:02.567536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8fe9f89f-8610-47ca-bb33-8391967306c9 req-47b07749-540a-4f79-aac4-370f311f2242 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:02.569021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8fe9f89f-8610-47ca-bb33-8391967306c9 req-47b07749-540a-4f79-aac4-370f311f2242 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:02.570163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8fe9f89f-8610-47ca-bb33-8391967306c9 req-47b07749-540a-4f79-aac4-370f311f2242 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:02.590352 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8fe9f89f-8610-47ca-bb33-8391967306c9 req-47b07749-540a-4f79-aac4-370f311f2242 service nova] Creating event network-vif-plugged:fe16acf8-da85-4ab7-b926-194e2f6b4467 for instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 on nch1-master-1 Sep 10 21:08:02.608213 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8fe9f89f-8610-47ca-bb33-8391967306c9 req-47b07749-540a-4f79-aac4-370f311f2242 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061908 Sep 10 21:08:02.610226 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2306/4530] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:02.618877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96dc0553-269c-48dc-b579-6d111a5e545e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:02.625105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96dc0553-269c-48dc-b579-6d111a5e545e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:02.625592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96dc0553-269c-48dc-b579-6d111a5e545e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:02.626054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96dc0553-269c-48dc-b579-6d111a5e545e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:02.650877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96dc0553-269c-48dc-b579-6d111a5e545e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Going to try to stop instance {{(pid=145772) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 21:08:02.707883 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96dc0553-269c-48dc-b579-6d111a5e545e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/action" status: 202 len: 0 microversion: 2.1 time: 0.095204 Sep 10 21:08:02.708581 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2307/4531] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:08:02 2022] POST /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:08:02.719091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5925b597-6563-4a90-be01-682e981a54bb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:02.721045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5925b597-6563-4a90-be01-682e981a54bb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:02.731461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5925b597-6563-4a90-be01-682e981a54bb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:02.731970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5925b597-6563-4a90-be01-682e981a54bb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:02.732421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5925b597-6563-4a90-be01-682e981a54bb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:02.733147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5925b597-6563-4a90-be01-682e981a54bb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:02.733616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5925b597-6563-4a90-be01-682e981a54bb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:02.734076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5925b597-6563-4a90-be01-682e981a54bb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:02.743276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:02.750044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:02.750743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:02.751584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:02.752596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:02.753291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:02.754446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:03.045454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5925b597-6563-4a90-be01-682e981a54bb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:03.059950 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5925b597-6563-4a90-be01-682e981a54bb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1724 microversion: 2.1 time: 0.346259 Sep 10 21:08:03.060991 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2308/4532] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:02 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:03.068506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-76a68bc7-d22a-4534-b4ce-5e63af95ecc9 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:03.069289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-76a68bc7-d22a-4534-b4ce-5e63af95ecc9 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:03.077601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76a68bc7-d22a-4534-b4ce-5e63af95ecc9 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:03.079246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76a68bc7-d22a-4534-b4ce-5e63af95ecc9 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:03.080383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76a68bc7-d22a-4534-b4ce-5e63af95ecc9 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:03.081155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76a68bc7-d22a-4534-b4ce-5e63af95ecc9 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:03.081613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76a68bc7-d22a-4534-b4ce-5e63af95ecc9 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:03.084056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76a68bc7-d22a-4534-b4ce-5e63af95ecc9 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:03.250323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "refresh_cache-a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 21:08:03.251288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquired lock "refresh_cache-a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 21:08:03.497187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-76a68bc7-d22a-4534-b4ce-5e63af95ecc9 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:03.506026 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-76a68bc7-d22a-4534-b4ce-5e63af95ecc9 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1508 microversion: 2.1 time: 0.443169 Sep 10 21:08:03.518192 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2309/4533] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:03 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:03.523374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2dd17ed1-01fc-4f89-9214-fa056b323c88 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:03.523984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2dd17ed1-01fc-4f89-9214-fa056b323c88 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:03.539357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2dd17ed1-01fc-4f89-9214-fa056b323c88 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:03.540373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2dd17ed1-01fc-4f89-9214-fa056b323c88 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:03.541070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2dd17ed1-01fc-4f89-9214-fa056b323c88 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:03.546736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2dd17ed1-01fc-4f89-9214-fa056b323c88 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:03.547212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2dd17ed1-01fc-4f89-9214-fa056b323c88 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:03.547827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2dd17ed1-01fc-4f89-9214-fa056b323c88 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:04.171501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2dd17ed1-01fc-4f89-9214-fa056b323c88 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:04.201275 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2dd17ed1-01fc-4f89-9214-fa056b323c88 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1313 microversion: 2.1 time: 0.678006 Sep 10 21:08:04.203286 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2310/4534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:03 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:04.211758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7bc92a38-56d6-4599-b48d-9b72acd0069f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:04.212406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7bc92a38-56d6-4599-b48d-9b72acd0069f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:04.221489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bc92a38-56d6-4599-b48d-9b72acd0069f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:04.222030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bc92a38-56d6-4599-b48d-9b72acd0069f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:04.223066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bc92a38-56d6-4599-b48d-9b72acd0069f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:04.224174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bc92a38-56d6-4599-b48d-9b72acd0069f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:04.225153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bc92a38-56d6-4599-b48d-9b72acd0069f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:04.225762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bc92a38-56d6-4599-b48d-9b72acd0069f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:04.539913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7bc92a38-56d6-4599-b48d-9b72acd0069f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:04.552954 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7bc92a38-56d6-4599-b48d-9b72acd0069f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1329 microversion: 2.1 time: 0.348400 Sep 10 21:08:04.591545 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2311/4535] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:04 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1329 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:04.617130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-20deca0a-fe87-4747-8745-4f2de1fc3ff0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:04.617811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-20deca0a-fe87-4747-8745-4f2de1fc3ff0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:04.641189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20deca0a-fe87-4747-8745-4f2de1fc3ff0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:04.641705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20deca0a-fe87-4747-8745-4f2de1fc3ff0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:04.642175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20deca0a-fe87-4747-8745-4f2de1fc3ff0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:04.642904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20deca0a-fe87-4747-8745-4f2de1fc3ff0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:04.643363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20deca0a-fe87-4747-8745-4f2de1fc3ff0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:04.648105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20deca0a-fe87-4747-8745-4f2de1fc3ff0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:04.951177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Building network info cache for instance {{(pid=145771) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 21:08:05.064385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-20deca0a-fe87-4747-8745-4f2de1fc3ff0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:05.079980 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-20deca0a-fe87-4747-8745-4f2de1fc3ff0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1724 microversion: 2.1 time: 0.480664 Sep 10 21:08:05.086523 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2312/4536] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:04 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1724 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:05.099297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-178a85c2-7feb-4576-be0e-b84831ac0da2 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:05.100337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-178a85c2-7feb-4576-be0e-b84831ac0da2 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:05.113635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-178a85c2-7feb-4576-be0e-b84831ac0da2 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:05.114874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-178a85c2-7feb-4576-be0e-b84831ac0da2 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:05.115655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-178a85c2-7feb-4576-be0e-b84831ac0da2 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:05.116714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-178a85c2-7feb-4576-be0e-b84831ac0da2 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:05.118094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-178a85c2-7feb-4576-be0e-b84831ac0da2 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:05.119446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-178a85c2-7feb-4576-be0e-b84831ac0da2 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:05.878535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-178a85c2-7feb-4576-be0e-b84831ac0da2 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:05.894833 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-178a85c2-7feb-4576-be0e-b84831ac0da2 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1513 microversion: 2.1 time: 0.805961 Sep 10 21:08:05.903193 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2313/4537] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:05 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1513 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:05.910720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-027db151-9ecc-4790-807e-b3f9890445aa req-1a50578a-80ea-464c-a0f9-44d7b1714780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73c36f9-4016-4ac2-ab6e-d56b10d6ad92", "tag": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:05.940961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-027db151-9ecc-4790-807e-b3f9890445aa req-1a50578a-80ea-464c-a0f9-44d7b1714780 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:05.942506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-027db151-9ecc-4790-807e-b3f9890445aa req-1a50578a-80ea-464c-a0f9-44d7b1714780 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:05.944647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-027db151-9ecc-4790-807e-b3f9890445aa req-1a50578a-80ea-464c-a0f9-44d7b1714780 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:05.968769 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-027db151-9ecc-4790-807e-b3f9890445aa req-1a50578a-80ea-464c-a0f9-44d7b1714780 service nova] Creating event network-changed:8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22 for instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 on nch2-master-1 Sep 10 21:08:05.990151 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-027db151-9ecc-4790-807e-b3f9890445aa req-1a50578a-80ea-464c-a0f9-44d7b1714780 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077961 Sep 10 21:08:05.993705 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2314/4538] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:06.010248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-74e49a77-f759-40c1-b393-b6894eadd40b tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:06.015920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-74e49a77-f759-40c1-b393-b6894eadd40b tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:06.027778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74e49a77-f759-40c1-b393-b6894eadd40b tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:06.029460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74e49a77-f759-40c1-b393-b6894eadd40b tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:06.032215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74e49a77-f759-40c1-b393-b6894eadd40b tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:06.035443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74e49a77-f759-40c1-b393-b6894eadd40b tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:06.036550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74e49a77-f759-40c1-b393-b6894eadd40b tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:06.037161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74e49a77-f759-40c1-b393-b6894eadd40b tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:06.765308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-74e49a77-f759-40c1-b393-b6894eadd40b tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:06.775386 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-74e49a77-f759-40c1-b393-b6894eadd40b tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1313 microversion: 2.1 time: 0.781669 Sep 10 21:08:06.777068 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2315/4539] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:05 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:06.790053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-390d5525-7c45-46b2-86dc-84faa82c3a78 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:06.790053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-390d5525-7c45-46b2-86dc-84faa82c3a78 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:06.790053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-390d5525-7c45-46b2-86dc-84faa82c3a78 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:06.790053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-390d5525-7c45-46b2-86dc-84faa82c3a78 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:06.790602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-390d5525-7c45-46b2-86dc-84faa82c3a78 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:06.792183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-390d5525-7c45-46b2-86dc-84faa82c3a78 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:06.792858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-390d5525-7c45-46b2-86dc-84faa82c3a78 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:06.793495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-390d5525-7c45-46b2-86dc-84faa82c3a78 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:06.798536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:06.844902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Updating instance_info_cache with network_info: [{"id": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22", "address": "fa:16:3e:5a:e3:84", "network": {"id": "a53f27f3-ecaa-4250-a852-1d8a7bb068e9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-384757171-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ceebf89c39014750ae279e0741a0bb79", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8c0d0ec6-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=145771) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 21:08:06.866583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Releasing lock "refresh_cache-a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" {{(pid=145771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 21:08:06.868497 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5062c1bb-9630-4c8c-8257-7494f84688ce tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "POST /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92/action" status: 202 len: 0 microversion: 2.1 time: 4.763709 Sep 10 21:08:06.870295 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2225/4540] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:08:02 2022] POST /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92/action => generated 0 bytes in 4766 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 21:08:06.877577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d1c5f1fd-4657-4dbf-82f4-35de1dae075e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:06.878464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d1c5f1fd-4657-4dbf-82f4-35de1dae075e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:06.885493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1c5f1fd-4657-4dbf-82f4-35de1dae075e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:06.887086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1c5f1fd-4657-4dbf-82f4-35de1dae075e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:06.887903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1c5f1fd-4657-4dbf-82f4-35de1dae075e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:06.889374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1c5f1fd-4657-4dbf-82f4-35de1dae075e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:06.890164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1c5f1fd-4657-4dbf-82f4-35de1dae075e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:06.890678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1c5f1fd-4657-4dbf-82f4-35de1dae075e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:07.112131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d1c5f1fd-4657-4dbf-82f4-35de1dae075e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:07.124869 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d1c5f1fd-4657-4dbf-82f4-35de1dae075e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1724 microversion: 2.1 time: 0.253162 Sep 10 21:08:07.144641 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2226/4541] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:06 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:07.152322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:07.153080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:07.161015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:07.161923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:07.162533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:07.163435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:07.164209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:07.165361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:07.194015 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] HTTP exception thrown: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Request method failure captured: Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 HTTP/1.1 Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxcJyrrfve3ZZT1xctzW-cKv6zksHo6eMxm1efxTE4XXqi0_TdQiuR3HFWcAcQWSFUYPXPomZiZ5BxTWKs2mJJ5hZryfHulAwlqc5JPoTJKv7XrlPgflYrx9TdeNdZg0WzdRleFoDmLoeMT6r80vjLMrL48A9beUNswcCtBnOkpXWc Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: ceebf89c39014750ae279e0741a0bb79 Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ceebf89c39014750ae279e0741a0bb79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ceebf89c39014750ae279e0741a0bb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ceebf89c39014750ae279e0741a0bb79", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ceebf89c39014750ae279e0741a0bb79"}]}] Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: ceebf89c39014750ae279e0741a0bb79 Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-FloatingIPsAssociationTestJSON-1702847205-project Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 9546792be5a640e2a59fb2e8481c6c4b Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1702847205-project Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '75fc6946-4e0d-44f3-9f89-e8c7ab602d45'} Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:08:07.196388 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. Sep 10 21:08:07.200276 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:07.202593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Returning 404 to user: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:08:07.203708 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-253488a8-5664-406e-ae10-63ebead6f26a tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 404 len: 111 microversion: 2.1 time: 0.057611 Sep 10 21:08:07.207987 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2227/4542] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:08:07 2022] DELETE /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:08:07.212954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d8f76c3c-7a90-421c-a770-e67eb855d196 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:07.213854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d8f76c3c-7a90-421c-a770-e67eb855d196 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:07.220298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8f76c3c-7a90-421c-a770-e67eb855d196 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:07.220859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8f76c3c-7a90-421c-a770-e67eb855d196 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:07.221362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8f76c3c-7a90-421c-a770-e67eb855d196 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:07.222172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8f76c3c-7a90-421c-a770-e67eb855d196 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:07.222978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8f76c3c-7a90-421c-a770-e67eb855d196 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:07.223491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8f76c3c-7a90-421c-a770-e67eb855d196 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:07.321882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-390d5525-7c45-46b2-86dc-84faa82c3a78 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:07.333128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-390d5525-7c45-46b2-86dc-84faa82c3a78 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1509 microversion: 2.1 time: 0.554668 Sep 10 21:08:07.334176 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2316/4543] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:06 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1509 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:07.339426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:07.340240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: 75fc6946-4e0d-44f3-9f89-e8c7ab602d45] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:07.346996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:07.347890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:07.348704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:07.349650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:07.350375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:07.351028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:07.387393 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] HTTP exception thrown: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Request method failure captured: Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 HTTP/1.1 Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxcJyrrfve3ZZT1xctzW-cKv6zksHo6eMxm1efxTE4XXqi0_TdQiuR3HFWcAcQWSFUYPXPomZiZ5BxTWKs2mJJ5hZryfHulAwlqc5JPoTJKv7XrlPgflYrx9TdeNdZg0WzdRleFoDmLoeMT6r80vjLMrL48A9beUNswcCtBnOkpXWc Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: ceebf89c39014750ae279e0741a0bb79 Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ceebf89c39014750ae279e0741a0bb79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ceebf89c39014750ae279e0741a0bb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ceebf89c39014750ae279e0741a0bb79", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ceebf89c39014750ae279e0741a0bb79"}]}] Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: ceebf89c39014750ae279e0741a0bb79 Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-FloatingIPsAssociationTestJSON-1702847205-project Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9546792be5a640e2a59fb2e8481c6c4b Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1702847205-project Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '75fc6946-4e0d-44f3-9f89-e8c7ab602d45'} Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:07.390582 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:07.400097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:07.400097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:07.400097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:07.400097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:07.400097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:08:07.400097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:08:07.400097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. Sep 10 21:08:07.400097 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:07.402504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d8f76c3c-7a90-421c-a770-e67eb855d196 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:07.402740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Returning 404 to user: Instance 75fc6946-4e0d-44f3-9f89-e8c7ab602d45 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:08:07.402740 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-07868abb-8547-426c-8251-d6a9f931730d tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45" status: 404 len: 111 microversion: 2.1 time: 0.056611 Sep 10 21:08:07.402740 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2317/4544] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:07 2022] GET /compute/v2.1/servers/75fc6946-4e0d-44f3-9f89-e8c7ab602d45 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:08:07.404797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:07.407143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d6fa95cc-d249-4df6-bc76-5fbd1b6b0a90 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:07.408114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d6fa95cc-d249-4df6-bc76-5fbd1b6b0a90 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:07.416853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6fa95cc-d249-4df6-bc76-5fbd1b6b0a90 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:07.417285 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d8f76c3c-7a90-421c-a770-e67eb855d196 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1506 microversion: 2.1 time: 0.207719 Sep 10 21:08:07.417477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6fa95cc-d249-4df6-bc76-5fbd1b6b0a90 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:07.417792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6fa95cc-d249-4df6-bc76-5fbd1b6b0a90 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:07.418540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6fa95cc-d249-4df6-bc76-5fbd1b6b0a90 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:07.419010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6fa95cc-d249-4df6-bc76-5fbd1b6b0a90 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:07.419482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d6fa95cc-d249-4df6-bc76-5fbd1b6b0a90 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:07.421162 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2228/4545] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:07 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:07.432387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9ac2cb1c-7334-48f2-89aa-5a437ffcac39 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '.version_select at 0x7f993f963670>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:08.316529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d6fa95cc-d249-4df6-bc76-5fbd1b6b0a90 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:08.334354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d6fa95cc-d249-4df6-bc76-5fbd1b6b0a90 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1509 microversion: 2.1 time: 0.939950 Sep 10 21:08:08.350619 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2318/4546] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:07 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1509 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:08.358361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9f65339e-63be-4c80-b021-953824084992 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '.version_select at 0x7f993f984dc0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:08.359203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9f65339e-63be-4c80-b021-953824084992 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:08.365728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f65339e-63be-4c80-b021-953824084992 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:08.366598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f65339e-63be-4c80-b021-953824084992 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:08.367489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f65339e-63be-4c80-b021-953824084992 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:08.368662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f65339e-63be-4c80-b021-953824084992 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:08.369421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f65339e-63be-4c80-b021-953824084992 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:08.370149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f65339e-63be-4c80-b021-953824084992 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:08.405350 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9f65339e-63be-4c80-b021-953824084992 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.053558 Sep 10 21:08:08.415998 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2319/4547] 10.222.0.33 () {58 vars in 1296 bytes} [Sat Sep 10 21:08:08 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae/os-instance-actions => generated 611 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:08.422564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7b278eca-30de-45f6-9a0a-73e5b8432b1a tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:08.423636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7b278eca-30de-45f6-9a0a-73e5b8432b1a tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:08.432126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b278eca-30de-45f6-9a0a-73e5b8432b1a tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:08.432864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b278eca-30de-45f6-9a0a-73e5b8432b1a tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:08.433681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b278eca-30de-45f6-9a0a-73e5b8432b1a tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:08.434893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b278eca-30de-45f6-9a0a-73e5b8432b1a tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:08.435989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b278eca-30de-45f6-9a0a-73e5b8432b1a tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:08.437305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b278eca-30de-45f6-9a0a-73e5b8432b1a tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:08.819019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7b278eca-30de-45f6-9a0a-73e5b8432b1a tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:08.836295 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7b278eca-30de-45f6-9a0a-73e5b8432b1a tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1313 microversion: 2.1 time: 0.418208 Sep 10 21:08:08.853973 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2320/4548] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:08 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:08.859789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-056acc8f-77fc-409d-b114-42fc7a37db04 req-9e0c0273-79bd-451c-9379-e1172e0107ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f701cef-e0ea-43a4-9524-ce37ebc25806", "name": "network-vif-plugged", "status": "completed", "tag": "cc864348-2ed1-4211-a206-99461f3af0f2"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:08.870183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-056acc8f-77fc-409d-b114-42fc7a37db04 req-9e0c0273-79bd-451c-9379-e1172e0107ae service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:08.870902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-056acc8f-77fc-409d-b114-42fc7a37db04 req-9e0c0273-79bd-451c-9379-e1172e0107ae service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:08.871490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-056acc8f-77fc-409d-b114-42fc7a37db04 req-9e0c0273-79bd-451c-9379-e1172e0107ae service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:08.887186 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-056acc8f-77fc-409d-b114-42fc7a37db04 req-9e0c0273-79bd-451c-9379-e1172e0107ae service nova] Creating event network-vif-plugged:cc864348-2ed1-4211-a206-99461f3af0f2 for instance 7f701cef-e0ea-43a4-9524-ce37ebc25806 on nch2-master-1 Sep 10 21:08:08.892410 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-056acc8f-77fc-409d-b114-42fc7a37db04 req-9e0c0273-79bd-451c-9379-e1172e0107ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036899 Sep 10 21:08:08.893679 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2321/4549] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:08.901421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92a79c8a-9bf9-4a28-a0ce-04f7124d26ed tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:08.902346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-92a79c8a-9bf9-4a28-a0ce-04f7124d26ed tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:08.908875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92a79c8a-9bf9-4a28-a0ce-04f7124d26ed tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:08.909579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92a79c8a-9bf9-4a28-a0ce-04f7124d26ed tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:08.920265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92a79c8a-9bf9-4a28-a0ce-04f7124d26ed tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:08.921945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92a79c8a-9bf9-4a28-a0ce-04f7124d26ed tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:08.922636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92a79c8a-9bf9-4a28-a0ce-04f7124d26ed tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:08.923234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92a79c8a-9bf9-4a28-a0ce-04f7124d26ed tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:09.204652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-92a79c8a-9bf9-4a28-a0ce-04f7124d26ed tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:09.240070 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-92a79c8a-9bf9-4a28-a0ce-04f7124d26ed tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1724 microversion: 2.1 time: 0.343802 Sep 10 21:08:09.245560 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2322/4550] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:08 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:09.267320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5e25d54c-a2b6-41c0-8cae-fe13d9911a06 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:09.267825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5e25d54c-a2b6-41c0-8cae-fe13d9911a06 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:09.298110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e25d54c-a2b6-41c0-8cae-fe13d9911a06 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:09.302707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e25d54c-a2b6-41c0-8cae-fe13d9911a06 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:09.305250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e25d54c-a2b6-41c0-8cae-fe13d9911a06 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:09.306043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e25d54c-a2b6-41c0-8cae-fe13d9911a06 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:09.306522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e25d54c-a2b6-41c0-8cae-fe13d9911a06 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:09.306948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e25d54c-a2b6-41c0-8cae-fe13d9911a06 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:09.343416 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9ac2cb1c-7334-48f2-89aa-5a437ffcac39 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/38dbce09-1962-4d58-aff8-a11cdc11ac52" status: 202 len: 0 microversion: 2.1 time: 1.920201 Sep 10 21:08:09.344596 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2229/4551] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Sep 10 21:08:07 2022] DELETE /compute/v2.1/os-floating-ips/38dbce09-1962-4d58-aff8-a11cdc11ac52 => generated 0 bytes in 1923 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:08:09.362813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc49dfb8-7a62-42e0-9d17-8602e076c30e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:09.363614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cc49dfb8-7a62-42e0-9d17-8602e076c30e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:09.366661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5e25d54c-a2b6-41c0-8cae-fe13d9911a06 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:08:09.376412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc49dfb8-7a62-42e0-9d17-8602e076c30e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:09.376950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc49dfb8-7a62-42e0-9d17-8602e076c30e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:09.377351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc49dfb8-7a62-42e0-9d17-8602e076c30e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:09.378096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc49dfb8-7a62-42e0-9d17-8602e076c30e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:09.379093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc49dfb8-7a62-42e0-9d17-8602e076c30e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:09.379640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc49dfb8-7a62-42e0-9d17-8602e076c30e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:09.448155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cc49dfb8-7a62-42e0-9d17-8602e076c30e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:08:09.501598 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5e25d54c-a2b6-41c0-8cae-fe13d9911a06 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 204 len: 0 microversion: 2.1 time: 0.252260 Sep 10 21:08:09.507404 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2323/4552] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:08:09 2022] DELETE /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:08:09.516532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-379d726a-2785-4cad-a0ec-c18cfd551f3f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:09.518446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-379d726a-2785-4cad-a0ec-c18cfd551f3f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:09.527307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379d726a-2785-4cad-a0ec-c18cfd551f3f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:09.528555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379d726a-2785-4cad-a0ec-c18cfd551f3f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:09.529630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379d726a-2785-4cad-a0ec-c18cfd551f3f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:09.530734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379d726a-2785-4cad-a0ec-c18cfd551f3f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:09.531461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379d726a-2785-4cad-a0ec-c18cfd551f3f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:09.532209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-379d726a-2785-4cad-a0ec-c18cfd551f3f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:09.563969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-379d726a-2785-4cad-a0ec-c18cfd551f3f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:08:09.636212 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cc49dfb8-7a62-42e0-9d17-8602e076c30e tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "DELETE /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 204 len: 0 microversion: 2.1 time: 0.281990 Sep 10 21:08:09.638048 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2230/4553] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:08:09 2022] DELETE /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:08:09.651762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-52a87826-9390-4899-b4ce-a4d01f939ef4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:09.652488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-52a87826-9390-4899-b4ce-a4d01f939ef4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:09.670929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52a87826-9390-4899-b4ce-a4d01f939ef4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:09.672426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52a87826-9390-4899-b4ce-a4d01f939ef4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:09.673910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52a87826-9390-4899-b4ce-a4d01f939ef4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:09.676715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52a87826-9390-4899-b4ce-a4d01f939ef4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:09.678570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52a87826-9390-4899-b4ce-a4d01f939ef4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:09.680326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52a87826-9390-4899-b4ce-a4d01f939ef4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:09.716870 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-379d726a-2785-4cad-a0ec-c18cfd551f3f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 204 len: 0 microversion: 2.1 time: 0.205790 Sep 10 21:08:09.717787 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2324/4554] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:08:09 2022] DELETE /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:08:09.726146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-547158ca-8907-4426-8736-ae7a7c4719dd tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:09.730216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-547158ca-8907-4426-8736-ae7a7c4719dd tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:09.744650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-547158ca-8907-4426-8736-ae7a7c4719dd tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:09.745559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-547158ca-8907-4426-8736-ae7a7c4719dd tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:09.746308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-547158ca-8907-4426-8736-ae7a7c4719dd tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:09.747179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-547158ca-8907-4426-8736-ae7a7c4719dd tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:09.747793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-547158ca-8907-4426-8736-ae7a7c4719dd tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:09.748377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-547158ca-8907-4426-8736-ae7a7c4719dd tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:10.026661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-52a87826-9390-4899-b4ce-a4d01f939ef4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:10.041004 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-52a87826-9390-4899-b4ce-a4d01f939ef4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1515 microversion: 2.1 time: 0.401151 Sep 10 21:08:10.041607 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2231/4555] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:09 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:10.049236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b32f89e9-2911-4aa4-902d-4df49fc15933 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:10.049871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b32f89e9-2911-4aa4-902d-4df49fc15933 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:10.065534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b32f89e9-2911-4aa4-902d-4df49fc15933 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:10.066810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b32f89e9-2911-4aa4-902d-4df49fc15933 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:10.067437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b32f89e9-2911-4aa4-902d-4df49fc15933 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:10.071353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b32f89e9-2911-4aa4-902d-4df49fc15933 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:10.073321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b32f89e9-2911-4aa4-902d-4df49fc15933 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:10.073908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b32f89e9-2911-4aa4-902d-4df49fc15933 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:10.368793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b32f89e9-2911-4aa4-902d-4df49fc15933 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:10.377796 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b32f89e9-2911-4aa4-902d-4df49fc15933 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1524 microversion: 2.1 time: 0.332716 Sep 10 21:08:10.378429 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2232/4556] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:10 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1524 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:10.388201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e8971e58-94d7-4116-a043-27149983e833 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:10.399401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e8971e58-94d7-4116-a043-27149983e833 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:10.406530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8971e58-94d7-4116-a043-27149983e833 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:10.407218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8971e58-94d7-4116-a043-27149983e833 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:10.408944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8971e58-94d7-4116-a043-27149983e833 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:10.411079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8971e58-94d7-4116-a043-27149983e833 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:10.415502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8971e58-94d7-4116-a043-27149983e833 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:10.416118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8971e58-94d7-4116-a043-27149983e833 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:10.497028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-547158ca-8907-4426-8736-ae7a7c4719dd tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:10.511922 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-547158ca-8907-4426-8736-ae7a7c4719dd tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1512 microversion: 2.1 time: 0.792694 Sep 10 21:08:10.516751 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2325/4557] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:09 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1512 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:10.528318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f1658f3a-e6de-4451-ba9a-71af88b73710 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:10.532947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f1658f3a-e6de-4451-ba9a-71af88b73710 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:10.540334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:10.549550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1658f3a-e6de-4451-ba9a-71af88b73710 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:10.550021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1658f3a-e6de-4451-ba9a-71af88b73710 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:10.550985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1658f3a-e6de-4451-ba9a-71af88b73710 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:10.566220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1658f3a-e6de-4451-ba9a-71af88b73710 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:10.567206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1658f3a-e6de-4451-ba9a-71af88b73710 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:10.571158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1658f3a-e6de-4451-ba9a-71af88b73710 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:10.746948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e8971e58-94d7-4116-a043-27149983e833 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:10.758541 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e8971e58-94d7-4116-a043-27149983e833 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1313 microversion: 2.1 time: 0.378611 Sep 10 21:08:10.759136 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2233/4558] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:10 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:10.935884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f1658f3a-e6de-4451-ba9a-71af88b73710 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:10.945583 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f1658f3a-e6de-4451-ba9a-71af88b73710 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1724 microversion: 2.1 time: 0.427619 Sep 10 21:08:10.964151 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2326/4559] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:10 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1724 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:11.065728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10969ada-e70e-44a8-b3ea-6137f7c09607 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:11.066720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10969ada-e70e-44a8-b3ea-6137f7c09607 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:11.078892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10969ada-e70e-44a8-b3ea-6137f7c09607 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:11.079399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10969ada-e70e-44a8-b3ea-6137f7c09607 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:11.079841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10969ada-e70e-44a8-b3ea-6137f7c09607 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:11.080562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10969ada-e70e-44a8-b3ea-6137f7c09607 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:11.081020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10969ada-e70e-44a8-b3ea-6137f7c09607 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:11.081452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10969ada-e70e-44a8-b3ea-6137f7c09607 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:11.309117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10969ada-e70e-44a8-b3ea-6137f7c09607 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:11.320373 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-10969ada-e70e-44a8-b3ea-6137f7c09607 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1515 microversion: 2.1 time: 0.258166 Sep 10 21:08:11.321420 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2234/4560] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:11 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:11.403285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f1c22c0f-c69f-4f09-bfcc-480db633554f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:11.405236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f1c22c0f-c69f-4f09-bfcc-480db633554f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:11.414186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1c22c0f-c69f-4f09-bfcc-480db633554f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:11.415155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1c22c0f-c69f-4f09-bfcc-480db633554f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:11.415905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1c22c0f-c69f-4f09-bfcc-480db633554f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:11.417010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1c22c0f-c69f-4f09-bfcc-480db633554f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:11.417737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1c22c0f-c69f-4f09-bfcc-480db633554f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:11.418630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1c22c0f-c69f-4f09-bfcc-480db633554f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:11.538882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f1d79954-568a-4993-afb0-882174f93a23 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:11.539581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f1d79954-568a-4993-afb0-882174f93a23 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:11.547843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1d79954-568a-4993-afb0-882174f93a23 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:11.548651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1d79954-568a-4993-afb0-882174f93a23 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:11.549665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1d79954-568a-4993-afb0-882174f93a23 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:11.551708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1d79954-568a-4993-afb0-882174f93a23 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:11.552412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1d79954-568a-4993-afb0-882174f93a23 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:11.553390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1d79954-568a-4993-afb0-882174f93a23 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:11.762012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f1d79954-568a-4993-afb0-882174f93a23 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:11.771654 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f1d79954-568a-4993-afb0-882174f93a23 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1512 microversion: 2.1 time: 0.237990 Sep 10 21:08:11.772524 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2235/4561] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:11 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:11.784604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b91aa3dc-6ac4-425c-81fb-4c722fc3f823 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:11.786438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b91aa3dc-6ac4-425c-81fb-4c722fc3f823 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:11.793092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:11.811567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91aa3dc-6ac4-425c-81fb-4c722fc3f823 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:11.812234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91aa3dc-6ac4-425c-81fb-4c722fc3f823 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:11.812707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91aa3dc-6ac4-425c-81fb-4c722fc3f823 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:11.814442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91aa3dc-6ac4-425c-81fb-4c722fc3f823 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:11.815279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91aa3dc-6ac4-425c-81fb-4c722fc3f823 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:11.817073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b91aa3dc-6ac4-425c-81fb-4c722fc3f823 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:11.861232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f1c22c0f-c69f-4f09-bfcc-480db633554f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:11.874347 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f1c22c0f-c69f-4f09-bfcc-480db633554f tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1524 microversion: 2.1 time: 0.476754 Sep 10 21:08:11.875499 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2327/4562] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:11 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1524 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:11.977066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1f7052ed-0d91-43f9-8638-4156ea6ae9db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:11.977870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1f7052ed-0d91-43f9-8638-4156ea6ae9db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:11.992794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f7052ed-0d91-43f9-8638-4156ea6ae9db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:11.993936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f7052ed-0d91-43f9-8638-4156ea6ae9db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:11.994994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f7052ed-0d91-43f9-8638-4156ea6ae9db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:11.997384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f7052ed-0d91-43f9-8638-4156ea6ae9db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:11.998556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f7052ed-0d91-43f9-8638-4156ea6ae9db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:12.000434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f7052ed-0d91-43f9-8638-4156ea6ae9db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:12.146174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b91aa3dc-6ac4-425c-81fb-4c722fc3f823 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:12.154868 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b91aa3dc-6ac4-425c-81fb-4c722fc3f823 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1498 microversion: 2.1 time: 0.374176 Sep 10 21:08:12.170777 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2236/4563] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:11 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1498 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:12.352992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dd115341-bfda-44a3-b0af-79053a27e277 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:12.354483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dd115341-bfda-44a3-b0af-79053a27e277 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:12.374380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd115341-bfda-44a3-b0af-79053a27e277 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:12.376268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd115341-bfda-44a3-b0af-79053a27e277 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:12.378005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd115341-bfda-44a3-b0af-79053a27e277 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:12.384718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd115341-bfda-44a3-b0af-79053a27e277 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:12.386523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd115341-bfda-44a3-b0af-79053a27e277 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:12.387217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd115341-bfda-44a3-b0af-79053a27e277 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:12.559461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1f7052ed-0d91-43f9-8638-4156ea6ae9db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:12.570133 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1f7052ed-0d91-43f9-8638-4156ea6ae9db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1724 microversion: 2.1 time: 0.599141 Sep 10 21:08:12.573344 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2328/4564] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:11 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1724 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:12.798984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59e3e005-d91c-4d33-b42c-fa6654c61438 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:12.803152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59e3e005-d91c-4d33-b42c-fa6654c61438 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:12.816985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3e005-d91c-4d33-b42c-fa6654c61438 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:12.818198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3e005-d91c-4d33-b42c-fa6654c61438 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:12.819258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3e005-d91c-4d33-b42c-fa6654c61438 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:12.823334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3e005-d91c-4d33-b42c-fa6654c61438 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:12.824184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3e005-d91c-4d33-b42c-fa6654c61438 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:12.825021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59e3e005-d91c-4d33-b42c-fa6654c61438 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:12.928131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dd115341-bfda-44a3-b0af-79053a27e277 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:12.956067 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dd115341-bfda-44a3-b0af-79053a27e277 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1515 microversion: 2.1 time: 0.608613 Sep 10 21:08:12.979157 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2237/4565] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:12 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1515 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:12.994326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-167f0220-5e47-41ee-83ff-1ee3cee6dea9 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:13.001183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-167f0220-5e47-41ee-83ff-1ee3cee6dea9 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:13.016547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-167f0220-5e47-41ee-83ff-1ee3cee6dea9 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:13.017359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-167f0220-5e47-41ee-83ff-1ee3cee6dea9 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:13.018009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-167f0220-5e47-41ee-83ff-1ee3cee6dea9 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:13.019009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-167f0220-5e47-41ee-83ff-1ee3cee6dea9 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:13.019865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-167f0220-5e47-41ee-83ff-1ee3cee6dea9 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:13.023839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-167f0220-5e47-41ee-83ff-1ee3cee6dea9 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:13.506641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-167f0220-5e47-41ee-83ff-1ee3cee6dea9 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:13.519636 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-167f0220-5e47-41ee-83ff-1ee3cee6dea9 tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1524 microversion: 2.1 time: 0.529166 Sep 10 21:08:13.520842 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2238/4566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:12 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1524 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:13.599483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-61b6de38-e6ae-457a-b8ec-5d155bb7c163 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:13.600116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-61b6de38-e6ae-457a-b8ec-5d155bb7c163 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:13.611842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61b6de38-e6ae-457a-b8ec-5d155bb7c163 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:13.611842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61b6de38-e6ae-457a-b8ec-5d155bb7c163 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:13.612141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61b6de38-e6ae-457a-b8ec-5d155bb7c163 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:13.614118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61b6de38-e6ae-457a-b8ec-5d155bb7c163 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:13.616633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61b6de38-e6ae-457a-b8ec-5d155bb7c163 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:13.616915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61b6de38-e6ae-457a-b8ec-5d155bb7c163 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:13.922794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-61b6de38-e6ae-457a-b8ec-5d155bb7c163 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:13.937379 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-61b6de38-e6ae-457a-b8ec-5d155bb7c163 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1724 microversion: 2.1 time: 0.342090 Sep 10 21:08:13.939946 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2239/4567] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:13 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:13.947197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-68d9a35b-a7e8-4275-8461-63a0cb5fbcc9 req-ba1ed8f3-9ced-423e-aa1c-b361466a4bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b42dd4-4dd0-451e-826f-7dab0944ba02", "name": "network-vif-deleted", "tag": "fe16acf8-da85-4ab7-b926-194e2f6b4467"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:13.962103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-68d9a35b-a7e8-4275-8461-63a0cb5fbcc9 req-ba1ed8f3-9ced-423e-aa1c-b361466a4bff service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:13.962592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-68d9a35b-a7e8-4275-8461-63a0cb5fbcc9 req-ba1ed8f3-9ced-423e-aa1c-b361466a4bff service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:13.963248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-68d9a35b-a7e8-4275-8461-63a0cb5fbcc9 req-ba1ed8f3-9ced-423e-aa1c-b361466a4bff service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:13.982935 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-68d9a35b-a7e8-4275-8461-63a0cb5fbcc9 req-ba1ed8f3-9ced-423e-aa1c-b361466a4bff service nova] Creating event network-vif-deleted:fe16acf8-da85-4ab7-b926-194e2f6b4467 for instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 on nch1-master-1 Sep 10 21:08:13.989051 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-68d9a35b-a7e8-4275-8461-63a0cb5fbcc9 req-ba1ed8f3-9ced-423e-aa1c-b361466a4bff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046111 Sep 10 21:08:13.992697 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2240/4568] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:14.006898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:14.008086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:14.020757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:14.021553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:14.022312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:14.023193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:14.023815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:14.024409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:14.064781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:14.066926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:14.067567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:14.068419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lazy-loading 'fault' on Instance uuid 18b42dd4-4dd0-451e-826f-7dab0944ba02 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:08:14.112066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-59e3e005-d91c-4d33-b42c-fa6654c61438 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:14.122096 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59e3e005-d91c-4d33-b42c-fa6654c61438 tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1512 microversion: 2.1 time: 1.329072 Sep 10 21:08:14.125949 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2329/4569] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:12 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1512 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:14.135619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7262b204-1e3d-44dc-8558-9dd6e9a4f159 req-1d4d34b8-8f46-481d-9d25-83805d4ae01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73c36f9-4016-4ac2-ab6e-d56b10d6ad92", "name": "network-vif-deleted", "tag": "8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:14.158164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:14.158419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7262b204-1e3d-44dc-8558-9dd6e9a4f159 req-1d4d34b8-8f46-481d-9d25-83805d4ae01a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:14.158645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7262b204-1e3d-44dc-8558-9dd6e9a4f159 req-1d4d34b8-8f46-481d-9d25-83805d4ae01a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:14.164930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7262b204-1e3d-44dc-8558-9dd6e9a4f159 req-1d4d34b8-8f46-481d-9d25-83805d4ae01a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:14.173305 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e4f31fe8-1b99-4896-a08d-2494359b09d7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 200 len: 1319 microversion: 2.1 time: 0.172399 Sep 10 21:08:14.174040 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2241/4570] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:13 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:14.183820 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7262b204-1e3d-44dc-8558-9dd6e9a4f159 req-1d4d34b8-8f46-481d-9d25-83805d4ae01a service nova] Creating event network-vif-deleted:8c0d0ec6-b8d2-4ed3-9703-35ea624f8b22 for instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 on nch2-master-1 Sep 10 21:08:14.198974 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7262b204-1e3d-44dc-8558-9dd6e9a4f159 req-1d4d34b8-8f46-481d-9d25-83805d4ae01a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070922 Sep 10 21:08:14.202421 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2330/4571] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:14.548712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:14.549631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:14.564198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:14.564466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:14.582098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:14.584610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:14.587785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:14.590692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:14.745049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:14.749571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:14.750363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:14.751118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lazy-loading 'fault' on Instance uuid a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:08:14.965381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-989c4559-8e59-4cb9-b6a0-09f27141eaae tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:14.966369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-989c4559-8e59-4cb9-b6a0-09f27141eaae tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:15.002224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-989c4559-8e59-4cb9-b6a0-09f27141eaae tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:15.002731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-989c4559-8e59-4cb9-b6a0-09f27141eaae tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:15.003183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-989c4559-8e59-4cb9-b6a0-09f27141eaae tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:15.004720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-989c4559-8e59-4cb9-b6a0-09f27141eaae tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:15.005189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-989c4559-8e59-4cb9-b6a0-09f27141eaae tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:15.005623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-989c4559-8e59-4cb9-b6a0-09f27141eaae tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:15.063459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:15.086426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9546792be5a640e2a59fb2e8481c6c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceebf89c39014750ae279e0741a0bb79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:15.108068 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-82d5b4b4-ee91-49f9-b07e-7631dd85f9ef tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 200 len: 1313 microversion: 2.1 time: 0.564103 Sep 10 21:08:15.114018 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2242/4572] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:14 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:15.150293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:15.150910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:15.162494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:15.163002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:15.178921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:15.187263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:15.187653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:15.190219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:15.275899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:15.276852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:15.277697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:15.278434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lazy-loading 'fault' on Instance uuid 41cc68a6-4400-4205-8c85-ad55a8f3c6ae {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:08:15.331109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9931925a544aa894cf2b08cad10ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d0a21cdb7149ca9b72a502c7eb84fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:15.340104 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-05649b91-bd63-4772-a8cf-caf0b76501ba tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 200 len: 1307 microversion: 2.1 time: 0.194585 Sep 10 21:08:15.353289 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2243/4573] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:15 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 1307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:15.353289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:15.353289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:15.357667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:15.357667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:15.357667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:15.357667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:15.358302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:15.359163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:15.375186 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 HTTP/1.1 Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '18b42dd4-4dd0-451e-826f-7dab0944ba02'} Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:15.376923 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:15.381324 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:15.381324 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:15.381324 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:08:15.381324 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:08:15.381324 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:08:15.381324 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:15.381324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:08:15.381324 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a1c437e4-4a10-466b-b5f8-377a14da0593 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 404 len: 111 microversion: 2.1 time: 0.036457 Sep 10 21:08:15.382399 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2244/4574] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:15 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:08:15.388039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1feb23bf-0a2f-412f-8f4a-8677605e3d25 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '.version_select at 0x7f993fab08b0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:15.423840 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1feb23bf-0a2f-412f-8f4a-8677605e3d25 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-key-1358894292" status: 202 len: 0 microversion: 2.1 time: 0.036871 Sep 10 21:08:15.428296 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2245/4575] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Sep 10 21:08:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1358894292 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:08:15.540368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-989c4559-8e59-4cb9-b6a0-09f27141eaae tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:15.554879 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-989c4559-8e59-4cb9-b6a0-09f27141eaae tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1724 microversion: 2.1 time: 0.594156 Sep 10 21:08:15.555382 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2331/4576] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:14 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1724 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:15.609701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-974464559", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "75842dc4-d668-416f-9bad-afa9ac1ec517"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:15.702660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] validate_networks() for [('75842dc4-d668-416f-9bad-afa9ac1ec517', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:08:16.135065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:16.136749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] [instance: a73c36f9-4016-4ac2-ab6e-d56b10d6ad92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:16.145930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.148816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.149448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.150615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.151098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.151536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.172635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] HTTP exception thrown: Instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 could not be found. Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Request method failure captured: Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 HTTP/1.1 Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxcJyrrfve3ZZT1xctzW-cKv6zksHo6eMxm1efxTE4XXqi0_TdQiuR3HFWcAcQWSFUYPXPomZiZ5BxTWKs2mJJ5hZryfHulAwlqc5JPoTJKv7XrlPgflYrx9TdeNdZg0WzdRleFoDmLoeMT6r80vjLMrL48A9beUNswcCtBnOkpXWc Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: ceebf89c39014750ae279e0741a0bb79 Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ceebf89c39014750ae279e0741a0bb79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ceebf89c39014750ae279e0741a0bb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ceebf89c39014750ae279e0741a0bb79", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ceebf89c39014750ae279e0741a0bb79"}]}] Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: ceebf89c39014750ae279e0741a0bb79 Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1702847205 Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-FloatingIPsAssociationTestJSON-1702847205-project Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9546792be5a640e2a59fb2e8481c6c4b Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1702847205-project Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 could not be found. Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a73c36f9-4016-4ac2-ab6e-d56b10d6ad92'} Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 could not be found. Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 could not be found. Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:16.175042 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:16.180234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:16.180234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:16.180234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:16.180234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:16.180234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:08:16.180234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:08:16.180234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 could not be found. Sep 10 21:08:16.180234 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:16.180234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] Returning 404 to user: Instance a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:08:16.180234 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9526e73f-a26a-4354-a64e-813f55aba0cd tempest-FloatingIPsAssociationTestJSON-1702847205 tempest-FloatingIPsAssociationTestJSON-1702847205-project] 10.222.0.33 "GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92" status: 404 len: 111 microversion: 2.1 time: 0.045865 Sep 10 21:08:16.181596 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2332/4577] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:16 2022] GET /compute/v2.1/servers/a73c36f9-4016-4ac2-ab6e-d56b10d6ad92 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:08:16.238764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-32db9554-bd6a-40c1-a2d1-69a61a983aaa req-9a29709b-b6c3-4808-b64e-c948b6146fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cc68a6-4400-4205-8c85-ad55a8f3c6ae", "name": "network-vif-deleted", "tag": "42286044-fd28-4abf-9c52-c49844413f37"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:16.254348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-32db9554-bd6a-40c1-a2d1-69a61a983aaa req-9a29709b-b6c3-4808-b64e-c948b6146fea service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.255094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-32db9554-bd6a-40c1-a2d1-69a61a983aaa req-9a29709b-b6c3-4808-b64e-c948b6146fea service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.255728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-32db9554-bd6a-40c1-a2d1-69a61a983aaa req-9a29709b-b6c3-4808-b64e-c948b6146fea service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.269072 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-32db9554-bd6a-40c1-a2d1-69a61a983aaa req-9a29709b-b6c3-4808-b64e-c948b6146fea service nova] Creating event network-vif-deleted:42286044-fd28-4abf-9c52-c49844413f37 for instance 41cc68a6-4400-4205-8c85-ad55a8f3c6ae on nch1-master-1 Sep 10 21:08:16.274609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:08:16.275085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:08:16.275314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:08:16.275916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:08:16.276887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:08:16.280222 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-32db9554-bd6a-40c1-a2d1-69a61a983aaa req-9a29709b-b6c3-4808-b64e-c948b6146fea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043168 Sep 10 21:08:16.281638 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2333/4578] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:08:16.288655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.289141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.289775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.290538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.291046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.292395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.303355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:16.334162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:08:16.343309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for user 6bfa3af0a7284bc6854f2c9c58392935 and project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:08:16.363193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:08:16.366055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:08:16.366661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:16.367439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] [instance: 41cc68a6-4400-4205-8c85-ad55a8f3c6ae] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:16.374998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.375858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.376441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.377389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.378040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.378662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.396157 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] HTTP exception thrown: Instance 41cc68a6-4400-4205-8c85-ad55a8f3c6ae could not be found. Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Request method failure captured: Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae HTTP/1.1 Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPyRajUNu17s50FwPPezgEmmUx8k_tvkUCO1xiodLzymMS1-XLXZEFYJkz_0fJk17mGzq9AJSnMjni0Mr04eu8erQXUsDdTzwQ1xM0YEZF4ltmCulNre293Kn0zrsRfTraSGvWGbzPD0l_FnIa9RQJV94O4ncYFC7JhYGiHPSw3mReg Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e2d0a21cdb7149ca9b72a502c7eb84fa Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-InstanceActionsTestJSON-1815897529 Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e2d0a21cdb7149ca9b72a502c7eb84fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e2d0a21cdb7149ca9b72a502c7eb84fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e2d0a21cdb7149ca9b72a502c7eb84fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e2d0a21cdb7149ca9b72a502c7eb84fa"}]}] Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-InstanceActionsTestJSON-1815897529 Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e2d0a21cdb7149ca9b72a502c7eb84fa Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1815897529 Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-InstanceActionsTestJSON-1815897529-project Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5d9931925a544aa894cf2b08cad10ea2 Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-InstanceActionsTestJSON-1815897529-project Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 41cc68a6-4400-4205-8c85-ad55a8f3c6ae could not be found. Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '41cc68a6-4400-4205-8c85-ad55a8f3c6ae'} Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41cc68a6-4400-4205-8c85-ad55a8f3c6ae could not be found. Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41cc68a6-4400-4205-8c85-ad55a8f3c6ae could not be found. Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:16.398786 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:16.402760 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:16.402760 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:16.402760 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:16.402760 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:08:16.402760 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:08:16.402760 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41cc68a6-4400-4205-8c85-ad55a8f3c6ae could not be found. Sep 10 21:08:16.402760 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:16.405065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] Returning 404 to user: Instance 41cc68a6-4400-4205-8c85-ad55a8f3c6ae could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:08:16.406424 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1634b205-b381-43bb-b5d6-f03f9a3366df tempest-InstanceActionsTestJSON-1815897529 tempest-InstanceActionsTestJSON-1815897529-project] 10.222.0.33 "GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae" status: 404 len: 111 microversion: 2.1 time: 0.044731 Sep 10 21:08:16.407211 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2334/4579] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:16 2022] GET /compute/v2.1/servers/41cc68a6-4400-4205-8c85-ad55a8f3c6ae => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:08:16.413111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2fe850c9-7fcb-4bd4-8db7-13e34444753d tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:16.413950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2fe850c9-7fcb-4bd4-8db7-13e34444753d tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:16.422624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fe850c9-7fcb-4bd4-8db7-13e34444753d tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.423200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fe850c9-7fcb-4bd4-8db7-13e34444753d tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.423756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fe850c9-7fcb-4bd4-8db7-13e34444753d tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.425063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fe850c9-7fcb-4bd4-8db7-13e34444753d tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.425531 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-657e9ce5-85cf-4ffe-bc20-a348e8cda8ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820034 Sep 10 21:08:16.425750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fe850c9-7fcb-4bd4-8db7-13e34444753d tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.426381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fe850c9-7fcb-4bd4-8db7-13e34444753d tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.427054 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2246/4580] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:08:16.442986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-efcd2c7f-73cd-47dd-b667-f88470b7bb33 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:16.443902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-efcd2c7f-73cd-47dd-b667-f88470b7bb33 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:16.466540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2fe850c9-7fcb-4bd4-8db7-13e34444753d tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:08:16.609382 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2fe850c9-7fcb-4bd4-8db7-13e34444753d tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 204 len: 0 microversion: 2.1 time: 0.200670 Sep 10 21:08:16.610814 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2335/4581] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:08:16 2022] DELETE /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:08:16.645413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9f704b97-0f50-45b7-9e6c-b466a1740e31 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:16.646581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9f704b97-0f50-45b7-9e6c-b466a1740e31 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:16.653920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f704b97-0f50-45b7-9e6c-b466a1740e31 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.654611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f704b97-0f50-45b7-9e6c-b466a1740e31 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.655223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f704b97-0f50-45b7-9e6c-b466a1740e31 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.656487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f704b97-0f50-45b7-9e6c-b466a1740e31 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.657114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f704b97-0f50-45b7-9e6c-b466a1740e31 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.657701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f704b97-0f50-45b7-9e6c-b466a1740e31 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.681060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-efcd2c7f-73cd-47dd-b667-f88470b7bb33 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:16.692319 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-efcd2c7f-73cd-47dd-b667-f88470b7bb33 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1208 microversion: 2.1 time: 0.258227 Sep 10 21:08:16.710573 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2247/4582] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:16 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1208 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:16.719661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-efd1d2f3-0f6b-4237-905b-31f60181bd82 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:16.720676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-efd1d2f3-0f6b-4237-905b-31f60181bd82 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:16.733682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efd1d2f3-0f6b-4237-905b-31f60181bd82 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.734429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efd1d2f3-0f6b-4237-905b-31f60181bd82 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.734936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efd1d2f3-0f6b-4237-905b-31f60181bd82 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:16.735711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efd1d2f3-0f6b-4237-905b-31f60181bd82 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:16.743935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efd1d2f3-0f6b-4237-905b-31f60181bd82 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:16.745679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-efd1d2f3-0f6b-4237-905b-31f60181bd82 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:17.064188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-efd1d2f3-0f6b-4237-905b-31f60181bd82 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:17.076638 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-efd1d2f3-0f6b-4237-905b-31f60181bd82 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1504 microversion: 2.1 time: 0.364547 Sep 10 21:08:17.102458 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2248/4583] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:16 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1504 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:17.107263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9f704b97-0f50-45b7-9e6c-b466a1740e31 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:17.124417 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9f704b97-0f50-45b7-9e6c-b466a1740e31 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1724 microversion: 2.1 time: 0.501247 Sep 10 21:08:17.125256 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2336/4584] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:16 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1724 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:17.717642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8b6ed75f-2847-4272-a352-0fb0c61fc4da tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:17.718329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8b6ed75f-2847-4272-a352-0fb0c61fc4da tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:17.726651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b6ed75f-2847-4272-a352-0fb0c61fc4da tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:17.727592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b6ed75f-2847-4272-a352-0fb0c61fc4da tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:17.728236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b6ed75f-2847-4272-a352-0fb0c61fc4da tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:17.729270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b6ed75f-2847-4272-a352-0fb0c61fc4da tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:17.729658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b6ed75f-2847-4272-a352-0fb0c61fc4da tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:17.730552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b6ed75f-2847-4272-a352-0fb0c61fc4da tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:17.882201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8b6ed75f-2847-4272-a352-0fb0c61fc4da tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:17.895525 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8b6ed75f-2847-4272-a352-0fb0c61fc4da tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1260 microversion: 2.1 time: 0.181534 Sep 10 21:08:17.896226 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2249/4585] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:17 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:18.105404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d3d033a5-0593-4a5a-bd91-f6c9144780be tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:18.106042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d3d033a5-0593-4a5a-bd91-f6c9144780be tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:18.114331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3d033a5-0593-4a5a-bd91-f6c9144780be tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:18.115333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3d033a5-0593-4a5a-bd91-f6c9144780be tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:18.115943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3d033a5-0593-4a5a-bd91-f6c9144780be tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:18.116855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3d033a5-0593-4a5a-bd91-f6c9144780be tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:18.117482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3d033a5-0593-4a5a-bd91-f6c9144780be tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:18.118104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3d033a5-0593-4a5a-bd91-f6c9144780be tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:18.149317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d69f7adb-1f74-482e-8803-f604f542a595 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:18.149961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d69f7adb-1f74-482e-8803-f604f542a595 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:18.171608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d69f7adb-1f74-482e-8803-f604f542a595 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:18.172175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d69f7adb-1f74-482e-8803-f604f542a595 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:18.172806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d69f7adb-1f74-482e-8803-f604f542a595 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:18.173716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d69f7adb-1f74-482e-8803-f604f542a595 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:18.174468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d69f7adb-1f74-482e-8803-f604f542a595 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:18.175161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d69f7adb-1f74-482e-8803-f604f542a595 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:18.929299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d69f7adb-1f74-482e-8803-f604f542a595 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:18.939416 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d69f7adb-1f74-482e-8803-f604f542a595 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1701 microversion: 2.1 time: 0.793877 Sep 10 21:08:18.940591 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2250/4586] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:18 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1701 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:18.945688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8a98f2a8-60c6-4392-9edd-e4234a82c18e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:18.946536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8a98f2a8-60c6-4392-9edd-e4234a82c18e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:18.953370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a98f2a8-60c6-4392-9edd-e4234a82c18e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:18.957465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a98f2a8-60c6-4392-9edd-e4234a82c18e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:18.958200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a98f2a8-60c6-4392-9edd-e4234a82c18e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:18.959120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a98f2a8-60c6-4392-9edd-e4234a82c18e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:18.960417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a98f2a8-60c6-4392-9edd-e4234a82c18e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:18.961023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a98f2a8-60c6-4392-9edd-e4234a82c18e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:19.166747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3d033a5-0593-4a5a-bd91-f6c9144780be tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:19.190557 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d3d033a5-0593-4a5a-bd91-f6c9144780be tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1504 microversion: 2.1 time: 1.081372 Sep 10 21:08:19.190557 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2337/4587] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:18 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1504 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:19.190557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6581f1bd-b71d-4467-91b1-3f44d25b34fa tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:19.200645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8a98f2a8-60c6-4392-9edd-e4234a82c18e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:19.201943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6581f1bd-b71d-4467-91b1-3f44d25b34fa tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:19.204847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6581f1bd-b71d-4467-91b1-3f44d25b34fa tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:19.206233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6581f1bd-b71d-4467-91b1-3f44d25b34fa tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:19.209642 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8a98f2a8-60c6-4392-9edd-e4234a82c18e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1266 microversion: 2.1 time: 0.267509 Sep 10 21:08:19.211647 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2251/4588] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:18 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:19.283766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6581f1bd-b71d-4467-91b1-3f44d25b34fa tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Going to try to start instance {{(pid=145772) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 21:08:19.340279 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6581f1bd-b71d-4467-91b1-3f44d25b34fa tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/action" status: 202 len: 0 microversion: 2.1 time: 0.154801 Sep 10 21:08:19.341167 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2338/4589] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:08:19 2022] POST /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:08:19.356105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-87372ffb-a673-4194-9451-fd26b634ad65 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:19.364524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-87372ffb-a673-4194-9451-fd26b634ad65 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:19.383151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87372ffb-a673-4194-9451-fd26b634ad65 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:19.384250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87372ffb-a673-4194-9451-fd26b634ad65 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:19.386097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87372ffb-a673-4194-9451-fd26b634ad65 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:19.387458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87372ffb-a673-4194-9451-fd26b634ad65 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:19.389474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87372ffb-a673-4194-9451-fd26b634ad65 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:19.390744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87372ffb-a673-4194-9451-fd26b634ad65 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:19.997567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-85b0ad52-3c37-4b7b-8838-0cd82be11bdd req-e8c37ca4-99ad-4f8d-91a5-e3444e46e363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f701cef-e0ea-43a4-9524-ce37ebc25806", "name": "network-vif-deleted", "tag": "cc864348-2ed1-4211-a206-99461f3af0f2"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:20.045349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-85b0ad52-3c37-4b7b-8838-0cd82be11bdd req-e8c37ca4-99ad-4f8d-91a5-e3444e46e363 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:20.045925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-85b0ad52-3c37-4b7b-8838-0cd82be11bdd req-e8c37ca4-99ad-4f8d-91a5-e3444e46e363 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:20.046532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-85b0ad52-3c37-4b7b-8838-0cd82be11bdd req-e8c37ca4-99ad-4f8d-91a5-e3444e46e363 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:20.079566 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-85b0ad52-3c37-4b7b-8838-0cd82be11bdd req-e8c37ca4-99ad-4f8d-91a5-e3444e46e363 service nova] Creating event network-vif-deleted:cc864348-2ed1-4211-a206-99461f3af0f2 for instance 7f701cef-e0ea-43a4-9524-ce37ebc25806 on nch2-master-1 Sep 10 21:08:20.094725 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-85b0ad52-3c37-4b7b-8838-0cd82be11bdd req-e8c37ca4-99ad-4f8d-91a5-e3444e46e363 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103858 Sep 10 21:08:20.097240 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2339/4590] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:20.210103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:20.211474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:20.231388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:20.232256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:20.233305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:20.236195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:20.239573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:20.240208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:20.326515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:20.327010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:20.327452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:20.327914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lazy-loading 'fault' on Instance uuid 7f701cef-e0ea-43a4-9524-ce37ebc25806 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:08:20.446682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '500d8f7d16c74678a8eb62e76d262692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28fa6f3f1a47c69fb5931ad9803148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:20.459111 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-172f0e98-c17e-47a0-9e5b-a94df11ded87 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 200 len: 1303 microversion: 2.1 time: 0.254213 Sep 10 21:08:20.474797 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2340/4591] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:20 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 1303 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:20.489183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6cfc91d9-0a3e-478a-a4d3-711d3d5fae6d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:20.490068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6cfc91d9-0a3e-478a-a4d3-711d3d5fae6d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:20.506486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfc91d9-0a3e-478a-a4d3-711d3d5fae6d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:20.507329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfc91d9-0a3e-478a-a4d3-711d3d5fae6d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:20.507964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfc91d9-0a3e-478a-a4d3-711d3d5fae6d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:20.508930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfc91d9-0a3e-478a-a4d3-711d3d5fae6d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:20.509603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfc91d9-0a3e-478a-a4d3-711d3d5fae6d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:20.514175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfc91d9-0a3e-478a-a4d3-711d3d5fae6d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:20.664483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87372ffb-a673-4194-9451-fd26b634ad65 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:20.727583 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-87372ffb-a673-4194-9451-fd26b634ad65 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1710 microversion: 2.1 time: 1.376170 Sep 10 21:08:20.754186 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2252/4592] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:19 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1710 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:21.018394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6cfc91d9-0a3e-478a-a4d3-711d3d5fae6d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:21.031559 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6cfc91d9-0a3e-478a-a4d3-711d3d5fae6d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1308 microversion: 2.1 time: 0.555063 Sep 10 21:08:21.047518 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2341/4593] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:20 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1308 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:21.486107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:21.490606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] [instance: 7f701cef-e0ea-43a4-9524-ce37ebc25806] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:21.504170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:21.505202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:21.505917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:21.506885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:21.507951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:21.508688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:21.552662 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] HTTP exception thrown: Instance 7f701cef-e0ea-43a4-9524-ce37ebc25806 could not be found. Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Request method failure captured: Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 HTTP/1.1 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPyfU_ES6w0bC_rGT4oLW5tE6DQUvsPZ-_hTpNC-y9AHW8Um9I5wotjRt8cj06eT2mFB1kw5xm1jMCbpJJFQpnCNxrIFz8VJ1CCh1ABEgWFUfThiXtPyjfp8JoKbc-QS4qA6EJ0ZwpglxgAzeDg1WSoJrIZFGZdcGOAUSS_rDLgjT00 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 8f28fa6f3f1a47c69fb5931ad9803148 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-VolumesActionsTest-55035846 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28fa6f3f1a47c69fb5931ad9803148"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28fa6f3f1a47c69fb5931ad9803148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f28fa6f3f1a47c69fb5931ad9803148", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f28fa6f3f1a47c69fb5931ad9803148"}]}] Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-VolumesActionsTest-55035846 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 8f28fa6f3f1a47c69fb5931ad9803148 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-VolumesActionsTest-55035846 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-VolumesActionsTest-55035846-project Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 500d8f7d16c74678a8eb62e76d262692 Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-VolumesActionsTest-55035846-project Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 7f701cef-e0ea-43a4-9524-ce37ebc25806 could not be found. Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7f701cef-e0ea-43a4-9524-ce37ebc25806'} Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f701cef-e0ea-43a4-9524-ce37ebc25806 could not be found. Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f701cef-e0ea-43a4-9524-ce37ebc25806 could not be found. Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:21.555783 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:21.560567 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:21.560567 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:21.560567 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:21.560567 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:08:21.560567 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:08:21.560567 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f701cef-e0ea-43a4-9524-ce37ebc25806 could not be found. Sep 10 21:08:21.560567 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:08:21.560567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] Returning 404 to user: Instance 7f701cef-e0ea-43a4-9524-ce37ebc25806 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:08:21.560567 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9188bc48-b5d8-4cce-a92a-f2e24fcfca47 tempest-VolumesActionsTest-55035846 tempest-VolumesActionsTest-55035846-project] 10.222.0.33 "GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806" status: 404 len: 111 microversion: 2.1 time: 0.075973 Sep 10 21:08:21.560567 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2253/4594] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:21 2022] GET /compute/v2.1/servers/7f701cef-e0ea-43a4-9524-ce37ebc25806 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:08:21.759069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b9403ab1-55c6-4ff1-84ca-905e65ee27b2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:21.760518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b9403ab1-55c6-4ff1-84ca-905e65ee27b2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:21.776471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9403ab1-55c6-4ff1-84ca-905e65ee27b2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:21.777234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9403ab1-55c6-4ff1-84ca-905e65ee27b2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:21.777972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9403ab1-55c6-4ff1-84ca-905e65ee27b2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:21.780135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9403ab1-55c6-4ff1-84ca-905e65ee27b2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:21.782970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9403ab1-55c6-4ff1-84ca-905e65ee27b2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:21.783793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9403ab1-55c6-4ff1-84ca-905e65ee27b2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:22.058162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2bc910cf-1dd6-44e5-82f5-a0642f0a3ead tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:22.058799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2bc910cf-1dd6-44e5-82f5-a0642f0a3ead tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:22.069411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bc910cf-1dd6-44e5-82f5-a0642f0a3ead tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:22.070344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bc910cf-1dd6-44e5-82f5-a0642f0a3ead tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:22.077775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bc910cf-1dd6-44e5-82f5-a0642f0a3ead tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:22.078986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bc910cf-1dd6-44e5-82f5-a0642f0a3ead tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:22.080258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bc910cf-1dd6-44e5-82f5-a0642f0a3ead tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:22.080870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bc910cf-1dd6-44e5-82f5-a0642f0a3ead tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:22.500027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b9403ab1-55c6-4ff1-84ca-905e65ee27b2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:22.521509 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b9403ab1-55c6-4ff1-84ca-905e65ee27b2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1710 microversion: 2.1 time: 0.766257 Sep 10 21:08:22.523142 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2342/4595] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:21 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1710 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:22.718281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2bc910cf-1dd6-44e5-82f5-a0642f0a3ead tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:22.747645 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2bc910cf-1dd6-44e5-82f5-a0642f0a3ead tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1308 microversion: 2.1 time: 0.686281 Sep 10 21:08:22.749105 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2254/4596] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:22 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1308 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:23.566127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-15a7edf7-63e0-4b8e-a3ce-2a595b96878f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:23.569262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-15a7edf7-63e0-4b8e-a3ce-2a595b96878f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:23.646711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15a7edf7-63e0-4b8e-a3ce-2a595b96878f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:23.652024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15a7edf7-63e0-4b8e-a3ce-2a595b96878f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:23.653888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15a7edf7-63e0-4b8e-a3ce-2a595b96878f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:23.654672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15a7edf7-63e0-4b8e-a3ce-2a595b96878f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:23.664574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15a7edf7-63e0-4b8e-a3ce-2a595b96878f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:23.666169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15a7edf7-63e0-4b8e-a3ce-2a595b96878f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:23.790430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-adfa4cab-993c-4250-91ec-8e08be132437 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:23.791059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-adfa4cab-993c-4250-91ec-8e08be132437 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:23.808229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adfa4cab-993c-4250-91ec-8e08be132437 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:23.808769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adfa4cab-993c-4250-91ec-8e08be132437 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:23.809200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adfa4cab-993c-4250-91ec-8e08be132437 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:23.809963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adfa4cab-993c-4250-91ec-8e08be132437 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:23.815439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adfa4cab-993c-4250-91ec-8e08be132437 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:23.816138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adfa4cab-993c-4250-91ec-8e08be132437 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:24.728658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-15a7edf7-63e0-4b8e-a3ce-2a595b96878f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:24.745521 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-15a7edf7-63e0-4b8e-a3ce-2a595b96878f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1710 microversion: 2.1 time: 1.190988 Sep 10 21:08:24.746435 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2343/4597] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:23 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1710 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:24.900687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-cb73d9e2-cca9-4063-8516-1976a27af642 req-e78c10ec-295d-4971-993e-4dc3792cc370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf19196-a3f8-43b1-95b5-4842aac6ac78", "tag": "e979de0f-105f-4af2-9b7d-971b42d05c01"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:24.921674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-cb73d9e2-cca9-4063-8516-1976a27af642 req-e78c10ec-295d-4971-993e-4dc3792cc370 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:24.922981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-cb73d9e2-cca9-4063-8516-1976a27af642 req-e78c10ec-295d-4971-993e-4dc3792cc370 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:24.923673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-cb73d9e2-cca9-4063-8516-1976a27af642 req-e78c10ec-295d-4971-993e-4dc3792cc370 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:24.941026 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-cb73d9e2-cca9-4063-8516-1976a27af642 req-e78c10ec-295d-4971-993e-4dc3792cc370 service nova] Creating event network-changed:e979de0f-105f-4af2-9b7d-971b42d05c01 for instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 on nch1-master-1 Sep 10 21:08:24.948490 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-cb73d9e2-cca9-4063-8516-1976a27af642 req-e78c10ec-295d-4971-993e-4dc3792cc370 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052446 Sep 10 21:08:24.949368 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2344/4598] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:08:25.043531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-adfa4cab-993c-4250-91ec-8e08be132437 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:25.056224 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-adfa4cab-993c-4250-91ec-8e08be132437 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1308 microversion: 2.1 time: 1.287341 Sep 10 21:08:25.056836 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2255/4599] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:23 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1308 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:25.776882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9812b4c5-dcaa-427f-9b9c-c038dc558675 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:25.777598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9812b4c5-dcaa-427f-9b9c-c038dc558675 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:25.797773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9812b4c5-dcaa-427f-9b9c-c038dc558675 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:25.798702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9812b4c5-dcaa-427f-9b9c-c038dc558675 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:25.799651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9812b4c5-dcaa-427f-9b9c-c038dc558675 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:25.802715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9812b4c5-dcaa-427f-9b9c-c038dc558675 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:25.804641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9812b4c5-dcaa-427f-9b9c-c038dc558675 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:25.805561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9812b4c5-dcaa-427f-9b9c-c038dc558675 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:26.083224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-87c3b15b-a99c-4efd-98f1-19d5062c67b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:26.084663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-87c3b15b-a99c-4efd-98f1-19d5062c67b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:26.103937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87c3b15b-a99c-4efd-98f1-19d5062c67b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:26.104711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87c3b15b-a99c-4efd-98f1-19d5062c67b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:26.105352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87c3b15b-a99c-4efd-98f1-19d5062c67b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:26.107461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87c3b15b-a99c-4efd-98f1-19d5062c67b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:26.108717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87c3b15b-a99c-4efd-98f1-19d5062c67b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:26.109187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87c3b15b-a99c-4efd-98f1-19d5062c67b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:26.304427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:26.691175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:26.783649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9812b4c5-dcaa-427f-9b9c-c038dc558675 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:26.803448 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9812b4c5-dcaa-427f-9b9c-c038dc558675 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1714 microversion: 2.1 time: 1.025229 Sep 10 21:08:26.819831 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2345/4600] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:25 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1714 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:27.208064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87c3b15b-a99c-4efd-98f1-19d5062c67b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:27.220708 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-87c3b15b-a99c-4efd-98f1-19d5062c67b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1308 microversion: 2.1 time: 1.143584 Sep 10 21:08:27.235285 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2256/4601] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:26 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1308 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:28.018292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d1d38d17-b202-4917-91e0-04b4302b5ec5 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Action: 'create', calling method: .version_select at 0x7f993f9684c0>, body: {"keypair": {"name": "tempest-keypair-946532115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5mtN10UNK1wbOBkMlu26f+VlDECI/CTMU4qQdTLgIq8ldYN5XkkSAvARKDYdP8tLeYseHewyIM+MlaDQHSSDxm3VmsSn8Tgwvar/oj6V5kPaj8OP5IOkf9ARvo2cQERw=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:28.045477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d1d38d17-b202-4917-91e0-04b4302b5ec5 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Getting quotas for project 861e58c5bee84a44be5045e10b4594a1. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:08:28.053819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d1d38d17-b202-4917-91e0-04b4302b5ec5 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Getting quotas for user 86fa572828244998b44eb39d9330da7e and project 861e58c5bee84a44be5045e10b4594a1. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:08:28.090374 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d1d38d17-b202-4917-91e0-04b4302b5ec5 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.076463 Sep 10 21:08:28.091175 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2346/4602] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Sep 10 21:08:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 21:08:28.248890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-acadabe8-ded2-4cdf-b104-6a8d1a87b661 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:28.249522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-acadabe8-ded2-4cdf-b104-6a8d1a87b661 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:28.264600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acadabe8-ded2-4cdf-b104-6a8d1a87b661 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:28.265105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acadabe8-ded2-4cdf-b104-6a8d1a87b661 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:28.265548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acadabe8-ded2-4cdf-b104-6a8d1a87b661 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:28.266322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acadabe8-ded2-4cdf-b104-6a8d1a87b661 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:28.266787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acadabe8-ded2-4cdf-b104-6a8d1a87b661 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:28.267484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acadabe8-ded2-4cdf-b104-6a8d1a87b661 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:28.594304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-acadabe8-ded2-4cdf-b104-6a8d1a87b661 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:28.606489 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-acadabe8-ded2-4cdf-b104-6a8d1a87b661 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1308 microversion: 2.1 time: 0.361336 Sep 10 21:08:28.607866 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2257/4603] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:28 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:29.632721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c0ad2c04-318a-41c6-92a0-d0dc3f516bc2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:29.634049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c0ad2c04-318a-41c6-92a0-d0dc3f516bc2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:29.643865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c04-318a-41c6-92a0-d0dc3f516bc2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:29.652643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c04-318a-41c6-92a0-d0dc3f516bc2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:29.653391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c04-318a-41c6-92a0-d0dc3f516bc2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:29.654257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c04-318a-41c6-92a0-d0dc3f516bc2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:29.654945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c04-318a-41c6-92a0-d0dc3f516bc2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:29.659770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c04-318a-41c6-92a0-d0dc3f516bc2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:30.333139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c0ad2c04-318a-41c6-92a0-d0dc3f516bc2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:30.363781 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c0ad2c04-318a-41c6-92a0-d0dc3f516bc2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1308 microversion: 2.1 time: 0.733987 Sep 10 21:08:30.365218 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2347/4604] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:29 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1308 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:31.391960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-055247a9-fb2f-4f35-83cb-805355dc90df tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:31.392647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-055247a9-fb2f-4f35-83cb-805355dc90df tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:31.426702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055247a9-fb2f-4f35-83cb-805355dc90df tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:31.429077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055247a9-fb2f-4f35-83cb-805355dc90df tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:31.430718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055247a9-fb2f-4f35-83cb-805355dc90df tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:31.431853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055247a9-fb2f-4f35-83cb-805355dc90df tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:31.432598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055247a9-fb2f-4f35-83cb-805355dc90df tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:31.433318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-055247a9-fb2f-4f35-83cb-805355dc90df tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:32.024349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-055247a9-fb2f-4f35-83cb-805355dc90df tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:32.046478 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-055247a9-fb2f-4f35-83cb-805355dc90df tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1308 microversion: 2.1 time: 0.658606 Sep 10 21:08:32.051288 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2258/4605] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:31 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1308 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:33.080291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-884ef97a-5f27-4c0c-89a0-85bceb0a3779 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:33.082871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-884ef97a-5f27-4c0c-89a0-85bceb0a3779 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:33.103051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-884ef97a-5f27-4c0c-89a0-85bceb0a3779 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:33.106632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-884ef97a-5f27-4c0c-89a0-85bceb0a3779 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:33.107352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-884ef97a-5f27-4c0c-89a0-85bceb0a3779 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:33.110640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-884ef97a-5f27-4c0c-89a0-85bceb0a3779 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:33.112840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-884ef97a-5f27-4c0c-89a0-85bceb0a3779 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:33.119662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-884ef97a-5f27-4c0c-89a0-85bceb0a3779 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:33.461694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1646871062", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cd7f1dfd-7d20-47b4-beef-0cc3b272e6c5"}, {"port": "979ff401-ab19-408f-9537-0454ae9bef50", "tag": "port-1"}, {"port": "1a88291c-d6d6-40cf-ab43-36feb25243a8", "tag": "port-2"}, {"uuid": "aee41728-a261-4836-98dc-a35f8e1bf32b", "tag": "net-1"}, {"uuid": "aee41728-a261-4836-98dc-a35f8e1bf32b"}, {"uuid": "7d7bef61-6824-4306-ab72-3a75d87d30e1", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7d7bef61-6824-4306-ab72-3a75d87d30e1", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ba5ff2db-d7ce-47c0-854c-f921f9963e43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "641ff9cc-82cb-4df5-8061-99cc5b7914c3", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ce92f796-659a-43e4-b232-63fe5f748173", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1183947697"}], "key_name": "tempest-keypair-946532115", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:33.668659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-884ef97a-5f27-4c0c-89a0-85bceb0a3779 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:33.684707 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-884ef97a-5f27-4c0c-89a0-85bceb0a3779 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1308 microversion: 2.1 time: 0.609512 Sep 10 21:08:33.685853 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2348/4606] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:33 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1308 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:33.702994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-03775b8e-c594-4db8-8fce-e31e6d86cd59 req-08ac2df1-f48b-43fa-9e0e-9e064db06154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf19196-a3f8-43b1-95b5-4842aac6ac78", "name": "network-vif-plugged", "status": "completed", "tag": "e979de0f-105f-4af2-9b7d-971b42d05c01"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:33.758490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-03775b8e-c594-4db8-8fce-e31e6d86cd59 req-08ac2df1-f48b-43fa-9e0e-9e064db06154 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:33.762067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-03775b8e-c594-4db8-8fce-e31e6d86cd59 req-08ac2df1-f48b-43fa-9e0e-9e064db06154 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:33.766256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-03775b8e-c594-4db8-8fce-e31e6d86cd59 req-08ac2df1-f48b-43fa-9e0e-9e064db06154 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:33.809533 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-03775b8e-c594-4db8-8fce-e31e6d86cd59 req-08ac2df1-f48b-43fa-9e0e-9e064db06154 service nova] Creating event network-vif-plugged:e979de0f-105f-4af2-9b7d-971b42d05c01 for instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 on nch1-master-1 Sep 10 21:08:33.833393 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-03775b8e-c594-4db8-8fce-e31e6d86cd59 req-08ac2df1-f48b-43fa-9e0e-9e064db06154 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146051 Sep 10 21:08:33.835026 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2349/4607] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:34.036791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] validate_networks() for [('cd7f1dfd-7d20-47b4-beef-0cc3b272e6c5', None, None, None, None, None), (None, None, '979ff401-ab19-408f-9537-0454ae9bef50', None, None, None), (None, None, '1a88291c-d6d6-40cf-ab43-36feb25243a8', None, None, None), ('aee41728-a261-4836-98dc-a35f8e1bf32b', None, None, None, None, None), ('aee41728-a261-4836-98dc-a35f8e1bf32b', None, None, None, None, None), ('7d7bef61-6824-4306-ab72-3a75d87d30e1', '10.2.2.100', None, None, None, None), ('7d7bef61-6824-4306-ab72-3a75d87d30e1', '10.2.2.200', None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:08:34.711081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9ebfc186-cd59-42db-803f-500500fee26d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:34.711699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9ebfc186-cd59-42db-803f-500500fee26d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:34.720190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebfc186-cd59-42db-803f-500500fee26d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:34.726775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebfc186-cd59-42db-803f-500500fee26d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:34.727487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebfc186-cd59-42db-803f-500500fee26d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:34.729143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebfc186-cd59-42db-803f-500500fee26d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:34.730132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebfc186-cd59-42db-803f-500500fee26d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:34.731878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebfc186-cd59-42db-803f-500500fee26d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:34.740628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:35.149019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9ebfc186-cd59-42db-803f-500500fee26d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:35.165263 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9ebfc186-cd59-42db-803f-500500fee26d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1308 microversion: 2.1 time: 0.458396 Sep 10 21:08:35.170655 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2350/4608] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:34 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:36.203375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a6b3c3ff-1438-4807-8fcb-7882c42e7de5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:36.204177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a6b3c3ff-1438-4807-8fcb-7882c42e7de5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:36.216806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6b3c3ff-1438-4807-8fcb-7882c42e7de5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:36.218191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6b3c3ff-1438-4807-8fcb-7882c42e7de5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:36.218866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6b3c3ff-1438-4807-8fcb-7882c42e7de5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:36.219769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6b3c3ff-1438-4807-8fcb-7882c42e7de5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:36.220396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6b3c3ff-1438-4807-8fcb-7882c42e7de5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:36.221102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a6b3c3ff-1438-4807-8fcb-7882c42e7de5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:36.584492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a6b3c3ff-1438-4807-8fcb-7882c42e7de5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:36.610966 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a6b3c3ff-1438-4807-8fcb-7882c42e7de5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1489 microversion: 2.1 time: 0.417646 Sep 10 21:08:36.611592 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2351/4609] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:36 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1489 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:36.899885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-974464559", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "75842dc4-d668-416f-9bad-afa9ac1ec517"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:37.036551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] validate_networks() for [('75842dc4-d668-416f-9bad-afa9ac1ec517', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:08:38.070375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:38.653932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:08:38.654366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:08:38.654846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:08:38.655266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:08:38.655741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:08:38.678522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:38.679015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:38.701041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:38.702113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:38.702599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:38.709680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:38.805971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:08:38.826433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for user 6bfa3af0a7284bc6854f2c9c58392935 and project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:08:38.845482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:08:38.849470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:08:39.081435 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e9cd2575-d8e0-46ee-a234-dca6e3e050c4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.186846 Sep 10 21:08:39.084566 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2352/4610] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:08:39.105045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f7c11f1-57f0-4896-bab1-1e552248baf4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:39.105583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5f7c11f1-57f0-4896-bab1-1e552248baf4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:39.581365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5f7c11f1-57f0-4896-bab1-1e552248baf4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:39.592357 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f7c11f1-57f0-4896-bab1-1e552248baf4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1208 microversion: 2.1 time: 0.500606 Sep 10 21:08:39.598547 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2353/4611] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:39 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1208 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:40.624428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b52a5bd9-c5fa-4550-b8cc-765c3e93548b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:40.625148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b52a5bd9-c5fa-4550-b8cc-765c3e93548b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:40.630702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:41.156040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:08:41.156040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:08:41.156040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:08:41.156040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:08:41.156887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:08:41.179156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:41.179549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:41.180001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:41.180749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:41.181212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:41.191978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:41.276363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Getting quotas for project 861e58c5bee84a44be5045e10b4594a1. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:08:41.293229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Getting quotas for user 86fa572828244998b44eb39d9330da7e and project 861e58c5bee84a44be5045e10b4594a1. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:08:41.411312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b52a5bd9-c5fa-4550-b8cc-765c3e93548b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:41.449591 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b52a5bd9-c5fa-4550-b8cc-765c3e93548b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1208 microversion: 2.1 time: 0.830565 Sep 10 21:08:41.465844 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2354/4612] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:40 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1208 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:41.794343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:08:41.798566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ba5ff2db-d7ce-47c0-854c-f921f9963e43',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='641ff9cc-82cb-4df5-8061-99cc5b7914c3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce92f796-659a-43e4-b232-63fe5f748173',volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:08:42.480663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-99dde27e-7f73-4ce3-8700-1805f935f83e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:42.481234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-99dde27e-7f73-4ce3-8700-1805f935f83e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:42.512314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99dde27e-7f73-4ce3-8700-1805f935f83e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:42.512943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99dde27e-7f73-4ce3-8700-1805f935f83e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:42.515351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99dde27e-7f73-4ce3-8700-1805f935f83e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:42.521689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99dde27e-7f73-4ce3-8700-1805f935f83e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:42.526438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99dde27e-7f73-4ce3-8700-1805f935f83e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:42.527209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99dde27e-7f73-4ce3-8700-1805f935f83e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:42.620330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:42.692588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-99dde27e-7f73-4ce3-8700-1805f935f83e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:42.703321 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-99dde27e-7f73-4ce3-8700-1805f935f83e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1266 microversion: 2.1 time: 0.228624 Sep 10 21:08:42.722491 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2355/4613] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:42 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:42.803517 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eec3e721-7625-4168-8e76-4b941da5689e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.347661 Sep 10 21:08:42.804189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2259/4614] 10.222.0.33 () {62 vars in 1189 bytes} [Sat Sep 10 21:08:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 9349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 21:08:42.815866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10a46f05-604b-4078-a03b-540726a2c806 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:42.817574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10a46f05-604b-4078-a03b-540726a2c806 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:42.952562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10a46f05-604b-4078-a03b-540726a2c806 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:42.962011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10a46f05-604b-4078-a03b-540726a2c806 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:42.972220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10a46f05-604b-4078-a03b-540726a2c806 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:42.977311 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10a46f05-604b-4078-a03b-540726a2c806 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1285 microversion: 2.42 time: 0.165460 Sep 10 21:08:42.981551 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2356/4615] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:42 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:08:43.745150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bf18bbe5-95c0-4b26-9b53-94b867d77d3a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:43.747102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bf18bbe5-95c0-4b26-9b53-94b867d77d3a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:43.758349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf18bbe5-95c0-4b26-9b53-94b867d77d3a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:43.759189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf18bbe5-95c0-4b26-9b53-94b867d77d3a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:43.759849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf18bbe5-95c0-4b26-9b53-94b867d77d3a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:43.760826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf18bbe5-95c0-4b26-9b53-94b867d77d3a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:43.761594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf18bbe5-95c0-4b26-9b53-94b867d77d3a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:43.762248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf18bbe5-95c0-4b26-9b53-94b867d77d3a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:43.921713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bf18bbe5-95c0-4b26-9b53-94b867d77d3a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:43.938574 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bf18bbe5-95c0-4b26-9b53-94b867d77d3a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1266 microversion: 2.1 time: 0.199684 Sep 10 21:08:43.961532 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2260/4616] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:43 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:44.018932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-90a82977-dd42-42c3-8e31-21e0e9d816b8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:44.018932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-90a82977-dd42-42c3-8e31-21e0e9d816b8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:44.205301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-90a82977-dd42-42c3-8e31-21e0e9d816b8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:44.229380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-90a82977-dd42-42c3-8e31-21e0e9d816b8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:44.229380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-90a82977-dd42-42c3-8e31-21e0e9d816b8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:44.229380 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-90a82977-dd42-42c3-8e31-21e0e9d816b8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1285 microversion: 2.42 time: 0.217647 Sep 10 21:08:44.230236 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2357/4617] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:44 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:08:44.980320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1f57ba8f-49e7-4da3-a106-a949b423ae88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:44.982316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1f57ba8f-49e7-4da3-a106-a949b423ae88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:45.019958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f57ba8f-49e7-4da3-a106-a949b423ae88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:45.020802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f57ba8f-49e7-4da3-a106-a949b423ae88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:45.021463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f57ba8f-49e7-4da3-a106-a949b423ae88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:45.023845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f57ba8f-49e7-4da3-a106-a949b423ae88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:45.025409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f57ba8f-49e7-4da3-a106-a949b423ae88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:45.035018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f57ba8f-49e7-4da3-a106-a949b423ae88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:45.256249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:45.256860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:45.278329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:45.279091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:45.279713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:45.281256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:45.284691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:45.285483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:45.599887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:45.615525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:45.622279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:45.623810 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3745db2b-bb02-4f8c-8978-cd13e344d49a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1519 microversion: 2.42 time: 0.373150 Sep 10 21:08:45.627114 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2358/4618] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:45 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1519 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:08:45.701081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1f57ba8f-49e7-4da3-a106-a949b423ae88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:45.717142 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1f57ba8f-49e7-4da3-a106-a949b423ae88 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1266 microversion: 2.1 time: 0.752700 Sep 10 21:08:45.719677 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2261/4619] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:44 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1266 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:46.656684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:46.658227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:46.670748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:46.671397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:46.672004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:46.673200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:46.673751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:46.674944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:46.749481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c8f278e4-0f9d-43c3-936b-986c61794b32 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:46.750475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c8f278e4-0f9d-43c3-936b-986c61794b32 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:46.772856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8f278e4-0f9d-43c3-936b-986c61794b32 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:46.773546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8f278e4-0f9d-43c3-936b-986c61794b32 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:46.775236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8f278e4-0f9d-43c3-936b-986c61794b32 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:46.776002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8f278e4-0f9d-43c3-936b-986c61794b32 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:46.786580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8f278e4-0f9d-43c3-936b-986c61794b32 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:46.787028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8f278e4-0f9d-43c3-936b-986c61794b32 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:46.849383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=77 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:46.943519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:46.981221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:46.984393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:46.990667 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b60c56e6-eed4-4301-aed2-6c241417f898 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1593 microversion: 2.42 time: 0.337822 Sep 10 21:08:47.003117 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2359/4620] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:46 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1593 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:08:47.412141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c8f278e4-0f9d-43c3-936b-986c61794b32 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:47.422434 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c8f278e4-0f9d-43c3-936b-986c61794b32 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1308 microversion: 2.1 time: 0.685637 Sep 10 21:08:47.435130 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2262/4621] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:46 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1308 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:48.026148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:48.026765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:48.036054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:48.036542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:48.036994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:48.045340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:48.046511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:48.047260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:48.200216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:48.227085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:48.228798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:48.230269 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-82e2ea54-a3b2-4539-9afc-8cc981394e72 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1593 microversion: 2.42 time: 0.208879 Sep 10 21:08:48.231155 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2360/4622] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:48 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1593 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:08:48.448538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db1bb908-13f1-4d25-aeeb-cc5fedf8b2c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:48.449049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-db1bb908-13f1-4d25-aeeb-cc5fedf8b2c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:48.461258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db1bb908-13f1-4d25-aeeb-cc5fedf8b2c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:48.463386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db1bb908-13f1-4d25-aeeb-cc5fedf8b2c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:48.464024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db1bb908-13f1-4d25-aeeb-cc5fedf8b2c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:48.464955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db1bb908-13f1-4d25-aeeb-cc5fedf8b2c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:48.465679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db1bb908-13f1-4d25-aeeb-cc5fedf8b2c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:48.466521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db1bb908-13f1-4d25-aeeb-cc5fedf8b2c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:48.840209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:48.971526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0a9289c6-9bf2-4bb3-82ae-0b6f6423de0a tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Action: 'create', calling method: .version_select at 0x7f993f914940>, body: {"keypair": {"name": "tempest-keypair-2048952760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhyzh1IhMdussNX6siKpOg8aJ1zycJowWTTzCHfX/ycCcsAW2VkYIy4WQi3TK7UhTr09PEkWe1m3QRTCAjP3JH47NZk10FqtfPWnAxCKKz3623X5Dz+/6UnF+i5zynfRg=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:49.005709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-0a9289c6-9bf2-4bb3-82ae-0b6f6423de0a tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Getting quotas for project 7f09210a6e9f45cc9619b180628ba208. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:08:49.030051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-0a9289c6-9bf2-4bb3-82ae-0b6f6423de0a tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Getting quotas for user 1147de803ef34d16b39e96720b2f638b and project 7f09210a6e9f45cc9619b180628ba208. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:08:49.125130 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0a9289c6-9bf2-4bb3-82ae-0b6f6423de0a tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.287721 Sep 10 21:08:49.126368 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2361/4623] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:08:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:49.284300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e6a112e3-e0da-429a-ae41-632fa78ee246 req-80e39eab-1ff6-4eac-aa46-e60fe986d87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4188cfb-0c94-419a-b1c2-1c5d635b02c4", "tag": "9586bb16-bde3-4db3-879b-28c42c2526b1"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:49.320824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e6a112e3-e0da-429a-ae41-632fa78ee246 req-80e39eab-1ff6-4eac-aa46-e60fe986d87c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:49.321553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e6a112e3-e0da-429a-ae41-632fa78ee246 req-80e39eab-1ff6-4eac-aa46-e60fe986d87c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:49.322135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e6a112e3-e0da-429a-ae41-632fa78ee246 req-80e39eab-1ff6-4eac-aa46-e60fe986d87c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:49.352376 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e6a112e3-e0da-429a-ae41-632fa78ee246 req-80e39eab-1ff6-4eac-aa46-e60fe986d87c service nova] Creating event network-changed:9586bb16-bde3-4db3-879b-28c42c2526b1 for instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 on nch2-master-1 Sep 10 21:08:49.367179 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e6a112e3-e0da-429a-ae41-632fa78ee246 req-80e39eab-1ff6-4eac-aa46-e60fe986d87c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236031 Sep 10 21:08:49.367991 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2362/4624] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:49.388530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:49.389274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:49.416801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:49.417421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:49.419259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:49.420020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:49.420486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:49.420924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:49.477455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-db1bb908-13f1-4d25-aeeb-cc5fedf8b2c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:49.495970 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-db1bb908-13f1-4d25-aeeb-cc5fedf8b2c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1308 microversion: 2.1 time: 1.052150 Sep 10 21:08:49.496604 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2263/4625] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:48 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1308 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:49.742450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:49.757434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:49.760271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:49.764065 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5b03c271-3261-4ccf-9f0f-421bff644f89 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1593 microversion: 2.42 time: 0.388826 Sep 10 21:08:49.767118 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2363/4626] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:49 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1593 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:08:50.377339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-709458199", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "7a8fdb28-6d9b-45ed-bd69-2ed1221658f3"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:50.522317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-545cdd1f-1160-4c63-873b-c0d910cbb748 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:50.523052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-545cdd1f-1160-4c63-873b-c0d910cbb748 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:50.548307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545cdd1f-1160-4c63-873b-c0d910cbb748 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:50.550969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545cdd1f-1160-4c63-873b-c0d910cbb748 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:50.552102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] validate_networks() for [('7a8fdb28-6d9b-45ed-bd69-2ed1221658f3', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:08:50.553212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545cdd1f-1160-4c63-873b-c0d910cbb748 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:50.554084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545cdd1f-1160-4c63-873b-c0d910cbb748 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:50.555819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545cdd1f-1160-4c63-873b-c0d910cbb748 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:50.558882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-545cdd1f-1160-4c63-873b-c0d910cbb748 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:51.235779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:51.314100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:51.595760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-545cdd1f-1160-4c63-873b-c0d910cbb748 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:51.630798 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-545cdd1f-1160-4c63-873b-c0d910cbb748 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1308 microversion: 2.1 time: 1.113527 Sep 10 21:08:51.632988 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2364/4627] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:50 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1308 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:51.711869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5a9369b-e935-467a-b474-f9faf27c3351 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Action: 'create', calling method: .version_select at 0x7f993f90b790>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:51.774209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-a5a9369b-e935-467a-b474-f9faf27c3351 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Getting quotas for project 862a718cd74e4668a4fc9559c9d9d470. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:08:51.802104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-a5a9369b-e935-467a-b474-f9faf27c3351 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Getting quotas for user c882de4b1ee547e79f86dc21a4a01b6d and project 862a718cd74e4668a4fc9559c9d9d470. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:08:51.931852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-a5a9369b-e935-467a-b474-f9faf27c3351 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Getting quotas for project 862a718cd74e4668a4fc9559c9d9d470. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:08:51.938504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-a5a9369b-e935-467a-b474-f9faf27c3351 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Getting quotas for user c882de4b1ee547e79f86dc21a4a01b6d and project 862a718cd74e4668a4fc9559c9d9d470. Resources: {'server_groups'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:08:51.982573 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5a9369b-e935-467a-b474-f9faf27c3351 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.345626 Sep 10 21:08:51.984684 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2365/4628] 10.222.0.33 () {62 vars in 1214 bytes} [Sat Sep 10 21:08:51 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:08:51.998326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:52.000996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:52.030383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:52.042128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:52.042703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:52.043670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:52.046964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:52.047637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:52.633122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:52.646061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:08:52.646607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:08:52.647199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:08:52.647866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:08:52.648487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:08:52.669789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:52.674235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:52.676111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:52.677336 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b498475-0f25-40f2-8f14-d0bd5b709550 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1661 microversion: 2.42 time: 0.691655 Sep 10 21:08:52.677967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:52.679820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:52.680802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:52.682689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:52.683468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:52.683880 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2366/4629] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:51 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1661 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:08:52.698168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92902126-6e16-4195-963d-0585d3e19087 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:52.739963 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-92902126-6e16-4195-963d-0585d3e19087 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.054753 Sep 10 21:08:52.748745 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2367/4630] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Sep 10 21:08:52 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:08:52.762079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Getting quotas for project e82a0bb2cc874614b0061f4c71ce082d. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:08:52.765999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-29364d1e-d5fd-4b9f-8bbc-593a7f3c46ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:52.768664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-29364d1e-d5fd-4b9f-8bbc-593a7f3c46ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:52.785604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Getting quotas for user 2c96909ab4eb449d81769b4c1a52ec88 and project e82a0bb2cc874614b0061f4c71ce082d. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:08:52.791078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29364d1e-d5fd-4b9f-8bbc-593a7f3c46ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:52.794796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29364d1e-d5fd-4b9f-8bbc-593a7f3c46ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:52.795707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29364d1e-d5fd-4b9f-8bbc-593a7f3c46ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:52.801699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29364d1e-d5fd-4b9f-8bbc-593a7f3c46ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:52.805608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29364d1e-d5fd-4b9f-8bbc-593a7f3c46ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:52.807051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29364d1e-d5fd-4b9f-8bbc-593a7f3c46ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:52.836310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:08:52.842928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:08:53.018579 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ddb9abb7-34f4-4e17-8836-b4d369a148b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.647074 Sep 10 21:08:53.019614 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2264/4631] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:08:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:08:53.039034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-707a58a0-8778-408d-9db6-7e3ca0b7626e tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:53.082539 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-707a58a0-8778-408d-9db6-7e3ca0b7626e tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/c1330446-2527-4189-97fd-ea0ba8ab01b2" status: 200 len: 235 microversion: 2.64 time: 0.060651 Sep 10 21:08:53.085101 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2265/4632] 10.222.0.33 () {60 vars in 1304 bytes} [Sat Sep 10 21:08:53 2022] GET /compute/v2.1/os-server-groups/c1330446-2527-4189-97fd-ea0ba8ab01b2 => generated 235 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:08:53.107344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0767b84b-95fd-4476-b599-fb5b272ab84d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:53.112676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0767b84b-95fd-4476-b599-fb5b272ab84d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:53.608708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-29364d1e-d5fd-4b9f-8bbc-593a7f3c46ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:53.620413 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-29364d1e-d5fd-4b9f-8bbc-593a7f3c46ae tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1308 microversion: 2.1 time: 0.867724 Sep 10 21:08:53.620413 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2368/4633] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:52 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1308 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:53.636874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-af92acb3-0243-47ae-a425-40fddeb9967c tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:53.643754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0767b84b-95fd-4476-b599-fb5b272ab84d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:53.653925 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0767b84b-95fd-4476-b599-fb5b272ab84d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1218 microversion: 2.1 time: 0.566171 Sep 10 21:08:53.656648 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2266/4634] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:53 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1218 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:53.712601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:53.713488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:53.725407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:53.728651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:53.730888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:53.731955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:53.736917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:53.738887 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-af92acb3-0243-47ae-a425-40fddeb9967c tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/c1330446-2527-4189-97fd-ea0ba8ab01b2" status: 204 len: 0 microversion: 2.64 time: 0.119293 Sep 10 21:08:53.739229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:53.740669 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2369/4635] 10.222.0.33 () {60 vars in 1307 bytes} [Sat Sep 10 21:08:53 2022] DELETE /compute/v2.1/os-server-groups/c1330446-2527-4189-97fd-ea0ba8ab01b2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 21:08:53.758164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f3d790c-83f9-4e23-b007-c2d2940d3a66 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:53.776218 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-2f3d790c-83f9-4e23-b007-c2d2940d3a66 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] HTTP exception thrown: Instance group c1330446-2527-4189-97fd-ea0ba8ab01b2 could not be found. Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f3d790c-83f9-4e23-b007-c2d2940d3a66 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Request method failure captured: Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/os-server-groups/c1330446-2527-4189-97fd-ea0ba8ab01b2 HTTP/1.1 Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPziGZiJYD1-VL_KnkGxIHTxOkgdQMp7IEcXuN-tIEbxwxGQHsA8MXriSIQnxr0rp0gDHFInh9Nq6JdztC8ff03YB6wNrrBOp7bhAq6xL_Afc82jfEjSDkc12gkeNqgG1rtXcooLLf6Fjlp5IBoBp3AjJWrCyemB_rqA-N909xzi4Rk Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.64 Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 862a718cd74e4668a4fc9559c9d9d470 Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerGroup264TestJSON-1116326817 Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/862a718cd74e4668a4fc9559c9d9d470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/862a718cd74e4668a4fc9559c9d9d470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_862a718cd74e4668a4fc9559c9d9d470", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/862a718cd74e4668a4fc9559c9d9d470"}]}] Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerGroup264TestJSON-1116326817 Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 862a718cd74e4668a4fc9559c9d9d470 Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1116326817 Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerGroup264TestJSON-1116326817-project Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: c882de4b1ee547e79f86dc21a4a01b6d Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerGroup264TestJSON-1116326817-project Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance group c1330446-2527-4189-97fd-ea0ba8ab01b2 could not be found. Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c1330446-2527-4189-97fd-ea0ba8ab01b2'} Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c1330446-2527-4189-97fd-ea0ba8ab01b2 could not be found. Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c1330446-2527-4189-97fd-ea0ba8ab01b2 could not be found. Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:53.782237 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:08:53.787866 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:08:53.787866 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:08:53.787866 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:08:53.787866 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:08:53.787866 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c1330446-2527-4189-97fd-ea0ba8ab01b2 could not be found. Sep 10 21:08:53.787866 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:08:53.791998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f3d790c-83f9-4e23-b007-c2d2940d3a66 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] Returning 404 to user: Instance group c1330446-2527-4189-97fd-ea0ba8ab01b2 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:08:53.795944 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f3d790c-83f9-4e23-b007-c2d2940d3a66 tempest-ServerGroup264TestJSON-1116326817 tempest-ServerGroup264TestJSON-1116326817-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/c1330446-2527-4189-97fd-ea0ba8ab01b2" status: 404 len: 117 microversion: 2.64 time: 0.043119 Sep 10 21:08:53.798391 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2370/4636] 10.222.0.33 () {60 vars in 1307 bytes} [Sat Sep 10 21:08:53 2022] DELETE /compute/v2.1/os-server-groups/c1330446-2527-4189-97fd-ea0ba8ab01b2 => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:08:54.653499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-22d62572-5955-4824-926f-9cc4d98b5195 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:54.654217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-22d62572-5955-4824-926f-9cc4d98b5195 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:54.665693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22d62572-5955-4824-926f-9cc4d98b5195 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:54.666487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22d62572-5955-4824-926f-9cc4d98b5195 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:54.672468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22d62572-5955-4824-926f-9cc4d98b5195 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:54.675962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22d62572-5955-4824-926f-9cc4d98b5195 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:54.676664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22d62572-5955-4824-926f-9cc4d98b5195 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:54.677298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22d62572-5955-4824-926f-9cc4d98b5195 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:54.848894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:54.914923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:54.919856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:54.922484 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8583696-035d-4207-86ee-75fd8acad166 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1696 microversion: 2.42 time: 1.214259 Sep 10 21:08:54.926959 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2267/4637] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:53 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1696 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:08:54.937322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ad7337f-75a0-4190-b0c4-61e3605b3a7c tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:54.942577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7ad7337f-75a0-4190-b0c4-61e3605b3a7c tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:54.954275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ad7337f-75a0-4190-b0c4-61e3605b3a7c tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:54.956038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ad7337f-75a0-4190-b0c4-61e3605b3a7c tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:54.957335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ad7337f-75a0-4190-b0c4-61e3605b3a7c tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:54.959434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ad7337f-75a0-4190-b0c4-61e3605b3a7c tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:54.970017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ad7337f-75a0-4190-b0c4-61e3605b3a7c tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:54.979977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ad7337f-75a0-4190-b0c4-61e3605b3a7c tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:55.328104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-22d62572-5955-4824-926f-9cc4d98b5195 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:55.350154 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-22d62572-5955-4824-926f-9cc4d98b5195 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1308 microversion: 2.1 time: 0.694361 Sep 10 21:08:55.355058 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2371/4638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:54 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1308 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:55.380376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7ad7337f-75a0-4190-b0c4-61e3605b3a7c tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:55.405432 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ad7337f-75a0-4190-b0c4-61e3605b3a7c tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1270 microversion: 2.1 time: 0.475409 Sep 10 21:08:55.407639 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2268/4639] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:54 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1270 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:55.957477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:55.958168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:55.981667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:55.982423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:55.983085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:55.984700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:55.985991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:55.988420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:56.381180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-331b1b9b-b415-4faf-9a3c-13ee1dfc84eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:56.381903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-331b1b9b-b415-4faf-9a3c-13ee1dfc84eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:56.401334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-331b1b9b-b415-4faf-9a3c-13ee1dfc84eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:56.401915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-331b1b9b-b415-4faf-9a3c-13ee1dfc84eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:56.402380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-331b1b9b-b415-4faf-9a3c-13ee1dfc84eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:56.405521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-331b1b9b-b415-4faf-9a3c-13ee1dfc84eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:56.407565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-331b1b9b-b415-4faf-9a3c-13ee1dfc84eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:56.409242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-331b1b9b-b415-4faf-9a3c-13ee1dfc84eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:56.578551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:56.590312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:56.598601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:56.604123 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8c33a9f-340c-4ffd-a066-afc2bcf9c4d1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1696 microversion: 2.42 time: 0.650216 Sep 10 21:08:56.604852 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2372/4640] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:55 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1696 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:08:56.614918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ed0d9f5e-6b69-4237-ac70-8cc91360ce9f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:56.626673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ed0d9f5e-6b69-4237-ac70-8cc91360ce9f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:56.650123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0d9f5e-6b69-4237-ac70-8cc91360ce9f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:56.652303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0d9f5e-6b69-4237-ac70-8cc91360ce9f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:56.654231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0d9f5e-6b69-4237-ac70-8cc91360ce9f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:56.655718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0d9f5e-6b69-4237-ac70-8cc91360ce9f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:56.656418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0d9f5e-6b69-4237-ac70-8cc91360ce9f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:56.657096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed0d9f5e-6b69-4237-ac70-8cc91360ce9f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:56.744014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ed0d9f5e-6b69-4237-ac70-8cc91360ce9f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:56.756940 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ed0d9f5e-6b69-4237-ac70-8cc91360ce9f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1276 microversion: 2.1 time: 0.150361 Sep 10 21:08:56.758227 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2373/4641] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:56 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:56.774030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-903334148", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a5cf349c-4003-4ae6-9ddc-1f5c640250df"}], "security_groups": [{"name": "tempest-securitygroup--265617485"}], "key_name": "tempest-keypair-2048952760", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:57.045153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] validate_networks() for [('a5cf349c-4003-4ae6-9ddc-1f5c640250df', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:08:57.290629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-331b1b9b-b415-4faf-9a3c-13ee1dfc84eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:57.304324 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-331b1b9b-b415-4faf-9a3c-13ee1dfc84eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1308 microversion: 2.1 time: 0.927575 Sep 10 21:08:57.305249 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2269/4642] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:56 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1308 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:08:57.633689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:57.634488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:57.643587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:57.644529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:57.645229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:57.646218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:57.646996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:57.649884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:58.042779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:58.067937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:58.071630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:58.074441 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-80e0911d-0be9-4673-b197-dbb1966ce018 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1743 microversion: 2.42 time: 0.445417 Sep 10 21:08:58.077556 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2270/4643] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:57 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1743 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:08:58.083572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab2d79d5-314e-4e47-9172-7457042ccb61 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:58.084408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ab2d79d5-314e-4e47-9172-7457042ccb61 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:58.094101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab2d79d5-314e-4e47-9172-7457042ccb61 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:58.096334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab2d79d5-314e-4e47-9172-7457042ccb61 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:58.098432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab2d79d5-314e-4e47-9172-7457042ccb61 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:58.100618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab2d79d5-314e-4e47-9172-7457042ccb61 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:58.102107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab2d79d5-314e-4e47-9172-7457042ccb61 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:58.102910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab2d79d5-314e-4e47-9172-7457042ccb61 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:58.488333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab2d79d5-314e-4e47-9172-7457042ccb61 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:58.504629 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab2d79d5-314e-4e47-9172-7457042ccb61 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1318 microversion: 2.1 time: 0.425604 Sep 10 21:08:58.505660 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2271/4644] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:58 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:58.512646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-df20058b-7837-4458-82e2-35569663071f req-bc299ed2-2de4-498f-966d-873b042cc1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4188cfb-0c94-419a-b1c2-1c5d635b02c4", "name": "network-vif-plugged", "status": "completed", "tag": "9586bb16-bde3-4db3-879b-28c42c2526b1"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:58.539403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-df20058b-7837-4458-82e2-35569663071f req-bc299ed2-2de4-498f-966d-873b042cc1ce service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:58.541034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-df20058b-7837-4458-82e2-35569663071f req-bc299ed2-2de4-498f-966d-873b042cc1ce service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:58.544681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-df20058b-7837-4458-82e2-35569663071f req-bc299ed2-2de4-498f-966d-873b042cc1ce service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:58.551844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Getting quotas for project 7f09210a6e9f45cc9619b180628ba208. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:08:58.570832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Getting quotas for user 1147de803ef34d16b39e96720b2f638b and project 7f09210a6e9f45cc9619b180628ba208. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:08:58.584412 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-df20058b-7837-4458-82e2-35569663071f req-bc299ed2-2de4-498f-966d-873b042cc1ce service nova] Creating event network-vif-plugged:9586bb16-bde3-4db3-879b-28c42c2526b1 for instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 on nch2-master-1 Sep 10 21:08:58.601317 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-df20058b-7837-4458-82e2-35569663071f req-bc299ed2-2de4-498f-966d-873b042cc1ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094122 Sep 10 21:08:58.602185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:08:58.606130 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2272/4645] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:58.607662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:08:58.609150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:08:58.609472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:08:58.610201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:08:58.623410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:08:58.633681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7106410a-6ca8-4118-b0ea-67b410d23ae1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:58.634896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7106410a-6ca8-4118-b0ea-67b410d23ae1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:58.644047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:58.644899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:58.646308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:58.649044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:58.652040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:58.654972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:58.669849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7106410a-6ca8-4118-b0ea-67b410d23ae1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:58.675705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7106410a-6ca8-4118-b0ea-67b410d23ae1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:58.676515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7106410a-6ca8-4118-b0ea-67b410d23ae1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:58.682520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7106410a-6ca8-4118-b0ea-67b410d23ae1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:58.684286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7106410a-6ca8-4118-b0ea-67b410d23ae1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:58.685520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7106410a-6ca8-4118-b0ea-67b410d23ae1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:58.715606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Getting quotas for project 7f09210a6e9f45cc9619b180628ba208. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:08:58.730594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Getting quotas for user 1147de803ef34d16b39e96720b2f638b and project 7f09210a6e9f45cc9619b180628ba208. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:08:58.771930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:08:58.774757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:08:58.881010 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d554bb06-2d35-42ea-be6b-dc7f8201f84b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.121354 Sep 10 21:08:58.882188 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2374/4646] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:08:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 2123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:08:58.905238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0bf0c6c3-81b1-4211-82d0-9050ca452a87 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:58.905984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0bf0c6c3-81b1-4211-82d0-9050ca452a87 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:59.051474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0bf0c6c3-81b1-4211-82d0-9050ca452a87 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:59.069259 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0bf0c6c3-81b1-4211-82d0-9050ca452a87 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1269 microversion: 2.1 time: 0.179482 Sep 10 21:08:59.072581 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2375/4647] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:58 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:59.109197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7106410a-6ca8-4118-b0ea-67b410d23ae1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:59.114549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:59.121216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:59.124816 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7106410a-6ca8-4118-b0ea-67b410d23ae1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1308 microversion: 2.1 time: 0.516848 Sep 10 21:08:59.130109 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2273/4648] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:58 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1308 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:08:59.142570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:59.144845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:59.148422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:59.149478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:59.150061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:59.150549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:59.528697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a38b6b6e-4b71-440f-af43-3a3fdb54985b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:08:59.529348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a38b6b6e-4b71-440f-af43-3a3fdb54985b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:08:59.542475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38b6b6e-4b71-440f-af43-3a3fdb54985b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:59.542996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38b6b6e-4b71-440f-af43-3a3fdb54985b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:59.543442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38b6b6e-4b71-440f-af43-3a3fdb54985b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:59.547383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38b6b6e-4b71-440f-af43-3a3fdb54985b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:59.548927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38b6b6e-4b71-440f-af43-3a3fdb54985b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:59.550732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38b6b6e-4b71-440f-af43-3a3fdb54985b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:59.559021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:59.602486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:59.612751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:59.615178 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8914b301-7c53-4d66-9e2f-e3efdc0a4e55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1743 microversion: 2.42 time: 0.515701 Sep 10 21:08:59.639794 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2376/4649] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:08:59 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1743 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:08:59.658752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-dc3600b2-4c20-4526-ae0f-1831ce5c6d4f req-fe3c01f9-5029-4b55-acc3-08de7e246b6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c63541-628c-4ce4-9f01-692098a47a8a", "tag": "eb658c5c-4d51-4734-bb8b-cfed61b26aee"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:08:59.694806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-dc3600b2-4c20-4526-ae0f-1831ce5c6d4f req-fe3c01f9-5029-4b55-acc3-08de7e246b6f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:08:59.702826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-dc3600b2-4c20-4526-ae0f-1831ce5c6d4f req-fe3c01f9-5029-4b55-acc3-08de7e246b6f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:08:59.704401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-dc3600b2-4c20-4526-ae0f-1831ce5c6d4f req-fe3c01f9-5029-4b55-acc3-08de7e246b6f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:08:59.747973 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-dc3600b2-4c20-4526-ae0f-1831ce5c6d4f req-fe3c01f9-5029-4b55-acc3-08de7e246b6f service nova] Creating event network-changed:eb658c5c-4d51-4734-bb8b-cfed61b26aee for instance c3c63541-628c-4ce4-9f01-692098a47a8a on nch1-master-1 Sep 10 21:08:59.763223 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-dc3600b2-4c20-4526-ae0f-1831ce5c6d4f req-fe3c01f9-5029-4b55-acc3-08de7e246b6f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105800 Sep 10 21:08:59.764619 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2377/4650] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:08:59.904487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a38b6b6e-4b71-440f-af43-3a3fdb54985b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:08:59.930269 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a38b6b6e-4b71-440f-af43-3a3fdb54985b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1318 microversion: 2.1 time: 0.405328 Sep 10 21:08:59.952428 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2274/4651] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:08:59 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:00.104784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-329f6d30-ee8f-486a-aac3-41fbd17e99b6 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:00.106996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-329f6d30-ee8f-486a-aac3-41fbd17e99b6 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:00.130405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-329f6d30-ee8f-486a-aac3-41fbd17e99b6 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:00.132228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-329f6d30-ee8f-486a-aac3-41fbd17e99b6 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:00.133555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-329f6d30-ee8f-486a-aac3-41fbd17e99b6 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:00.134782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-329f6d30-ee8f-486a-aac3-41fbd17e99b6 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:00.136742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-329f6d30-ee8f-486a-aac3-41fbd17e99b6 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:00.137894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-329f6d30-ee8f-486a-aac3-41fbd17e99b6 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:00.162105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bc29f991-b9ac-4f80-94e8-8a1a2c80b37a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:00.165362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bc29f991-b9ac-4f80-94e8-8a1a2c80b37a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:00.218220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc29f991-b9ac-4f80-94e8-8a1a2c80b37a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:00.219117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc29f991-b9ac-4f80-94e8-8a1a2c80b37a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:00.226013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc29f991-b9ac-4f80-94e8-8a1a2c80b37a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:00.229652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc29f991-b9ac-4f80-94e8-8a1a2c80b37a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:00.230572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc29f991-b9ac-4f80-94e8-8a1a2c80b37a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:00.231274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc29f991-b9ac-4f80-94e8-8a1a2c80b37a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:00.443682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-329f6d30-ee8f-486a-aac3-41fbd17e99b6 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:00.467352 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-329f6d30-ee8f-486a-aac3-41fbd17e99b6 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1265 microversion: 2.1 time: 0.373568 Sep 10 21:09:00.473213 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2378/4652] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:00 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:00.650241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:00.652261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:00.661629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:00.662168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:00.662622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:00.663400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:00.664113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:00.679145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:00.736155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:01.199744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:01.233185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:01.240035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:01.244527 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fca9ab83-1de8-41f6-b3d8-c8c9fdadc082 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1790 microversion: 2.42 time: 0.601649 Sep 10 21:09:01.250815 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2379/4653] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:00 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1790 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:01.268087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42a5f991-ce53-411c-9cc2-15cbd39ecf50 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:01.269025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-42a5f991-ce53-411c-9cc2-15cbd39ecf50 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:01.290779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a5f991-ce53-411c-9cc2-15cbd39ecf50 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:01.297568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a5f991-ce53-411c-9cc2-15cbd39ecf50 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:01.298272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a5f991-ce53-411c-9cc2-15cbd39ecf50 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:01.300390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a5f991-ce53-411c-9cc2-15cbd39ecf50 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:01.301022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a5f991-ce53-411c-9cc2-15cbd39ecf50 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:01.301613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a5f991-ce53-411c-9cc2-15cbd39ecf50 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:01.395251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc29f991-b9ac-4f80-94e8-8a1a2c80b37a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:01.413776 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bc29f991-b9ac-4f80-94e8-8a1a2c80b37a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1308 microversion: 2.1 time: 1.255658 Sep 10 21:09:01.418173 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2275/4654] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:00 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1308 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:01.516405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4e95a262-5711-405d-9a30-d13f161c23a7 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:01.517340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4e95a262-5711-405d-9a30-d13f161c23a7 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:01.536867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e95a262-5711-405d-9a30-d13f161c23a7 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:01.539788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e95a262-5711-405d-9a30-d13f161c23a7 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:01.545155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e95a262-5711-405d-9a30-d13f161c23a7 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:01.546612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e95a262-5711-405d-9a30-d13f161c23a7 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:01.548446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e95a262-5711-405d-9a30-d13f161c23a7 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:01.550990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e95a262-5711-405d-9a30-d13f161c23a7 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:01.781466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e95a262-5711-405d-9a30-d13f161c23a7 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:01.795827 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4e95a262-5711-405d-9a30-d13f161c23a7 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1339 microversion: 2.1 time: 0.284537 Sep 10 21:09:01.799496 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2276/4655] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:01 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1339 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:01.843886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-42a5f991-ce53-411c-9cc2-15cbd39ecf50 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:01.856466 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-42a5f991-ce53-411c-9cc2-15cbd39ecf50 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1318 microversion: 2.1 time: 0.604481 Sep 10 21:09:01.873406 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2380/4656] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:01 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:02.283083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:02.283885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:02.296064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:02.297206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:02.301075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:02.303064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:02.305026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:02.307301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:02.440680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f14cfe15-9269-4324-9b27-5f68941a9e5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:02.441303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f14cfe15-9269-4324-9b27-5f68941a9e5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:02.468794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f14cfe15-9269-4324-9b27-5f68941a9e5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:02.469323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f14cfe15-9269-4324-9b27-5f68941a9e5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:02.469776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f14cfe15-9269-4324-9b27-5f68941a9e5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:02.470533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f14cfe15-9269-4324-9b27-5f68941a9e5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:02.471560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f14cfe15-9269-4324-9b27-5f68941a9e5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:02.471952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f14cfe15-9269-4324-9b27-5f68941a9e5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:02.724155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:02.913780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:02.924191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:02.925767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:02.934170 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0a45e6d2-0e8a-4755-b582-6c4e44bc8c60 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1790 microversion: 2.42 time: 0.657175 Sep 10 21:09:02.934824 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2277/4657] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:02 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1790 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:02.948195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-90c7248f-d92c-4345-90fc-0efd9fd2792b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:02.948946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-90c7248f-d92c-4345-90fc-0efd9fd2792b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:02.958011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90c7248f-d92c-4345-90fc-0efd9fd2792b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:02.958850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90c7248f-d92c-4345-90fc-0efd9fd2792b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:02.959589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90c7248f-d92c-4345-90fc-0efd9fd2792b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:02.967449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f14cfe15-9269-4324-9b27-5f68941a9e5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:02.985467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90c7248f-d92c-4345-90fc-0efd9fd2792b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:02.986067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90c7248f-d92c-4345-90fc-0efd9fd2792b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:02.986953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-90c7248f-d92c-4345-90fc-0efd9fd2792b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:02.991646 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f14cfe15-9269-4324-9b27-5f68941a9e5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1488 microversion: 2.1 time: 0.554913 Sep 10 21:09:02.995898 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2381/4658] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:02 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1488 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:03.020815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ca0931a7-709f-4fd7-bf15-343a86673a19 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:03.021489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ca0931a7-709f-4fd7-bf15-343a86673a19 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:03.055830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca0931a7-709f-4fd7-bf15-343a86673a19 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:03.056810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca0931a7-709f-4fd7-bf15-343a86673a19 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:03.057338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca0931a7-709f-4fd7-bf15-343a86673a19 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:03.060176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca0931a7-709f-4fd7-bf15-343a86673a19 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:03.060786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca0931a7-709f-4fd7-bf15-343a86673a19 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:03.063803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca0931a7-709f-4fd7-bf15-343a86673a19 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:03.336608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-90c7248f-d92c-4345-90fc-0efd9fd2792b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:03.350180 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-90c7248f-d92c-4345-90fc-0efd9fd2792b tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1394 microversion: 2.1 time: 0.409751 Sep 10 21:09:03.351431 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2278/4659] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:02 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1394 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:03.367397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e98b457d-e5e3-4534-afa4-b9b4cf8b1ee1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:03.369551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e98b457d-e5e3-4534-afa4-b9b4cf8b1ee1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:03.415700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e98b457d-e5e3-4534-afa4-b9b4cf8b1ee1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:03.416203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e98b457d-e5e3-4534-afa4-b9b4cf8b1ee1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:03.416643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e98b457d-e5e3-4534-afa4-b9b4cf8b1ee1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:03.426253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e98b457d-e5e3-4534-afa4-b9b4cf8b1ee1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:03.432896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e98b457d-e5e3-4534-afa4-b9b4cf8b1ee1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:03.433919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e98b457d-e5e3-4534-afa4-b9b4cf8b1ee1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:03.649481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:03.691291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e98b457d-e5e3-4534-afa4-b9b4cf8b1ee1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:03.704214 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e98b457d-e5e3-4534-afa4-b9b4cf8b1ee1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1489 microversion: 2.1 time: 0.349176 Sep 10 21:09:03.711667 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2279/4660] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:03 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1489 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:03.734386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3cd343ac-ff20-45f0-af5b-1eebf9b64e17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:03.734993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3cd343ac-ff20-45f0-af5b-1eebf9b64e17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:03.742102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd343ac-ff20-45f0-af5b-1eebf9b64e17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:03.742600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd343ac-ff20-45f0-af5b-1eebf9b64e17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:03.743096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd343ac-ff20-45f0-af5b-1eebf9b64e17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:03.743828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd343ac-ff20-45f0-af5b-1eebf9b64e17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:03.744755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd343ac-ff20-45f0-af5b-1eebf9b64e17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:03.745199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd343ac-ff20-45f0-af5b-1eebf9b64e17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:03.847797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ca0931a7-709f-4fd7-bf15-343a86673a19 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:03.866260 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ca0931a7-709f-4fd7-bf15-343a86673a19 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1318 microversion: 2.1 time: 0.868010 Sep 10 21:09:03.888646 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2382/4661] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:02 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1318 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:03.967959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:03.974077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:03.984725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:03.985343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:03.986755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:03.987826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:03.988294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:03.988828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:04.074448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3cd343ac-ff20-45f0-af5b-1eebf9b64e17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:04.091617 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3cd343ac-ff20-45f0-af5b-1eebf9b64e17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1488 microversion: 2.1 time: 0.361579 Sep 10 21:09:04.103379 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2280/4662] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:03 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1488 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:04.119889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2b1efc90-846e-4100-a519-48b407e016ad tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:04.120388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2b1efc90-846e-4100-a519-48b407e016ad tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:04.128784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1efc90-846e-4100-a519-48b407e016ad tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:04.129628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1efc90-846e-4100-a519-48b407e016ad tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:04.130315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1efc90-846e-4100-a519-48b407e016ad tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:04.132629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1efc90-846e-4100-a519-48b407e016ad tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:04.133839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1efc90-846e-4100-a519-48b407e016ad tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:04.134504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1efc90-846e-4100-a519-48b407e016ad tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:04.170507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2b1efc90-846e-4100-a519-48b407e016ad tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:09:04.216114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:04.286212 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2b1efc90-846e-4100-a519-48b407e016ad tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 204 len: 0 microversion: 2.1 time: 0.170776 Sep 10 21:09:04.292849 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2281/4663] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:09:04 2022] DELETE /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:09:04.301369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a2094921-8f2d-467d-9380-93d6b6c253ab tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:04.302109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a2094921-8f2d-467d-9380-93d6b6c253ab tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:04.317619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2094921-8f2d-467d-9380-93d6b6c253ab tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:04.319358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2094921-8f2d-467d-9380-93d6b6c253ab tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:04.319813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2094921-8f2d-467d-9380-93d6b6c253ab tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:04.320538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2094921-8f2d-467d-9380-93d6b6c253ab tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:04.321000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2094921-8f2d-467d-9380-93d6b6c253ab tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:04.323627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2094921-8f2d-467d-9380-93d6b6c253ab tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:04.603725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:04.622747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:04.624860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:04.626454 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c82c136-8314-47dd-94e1-f0624231662f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1837 microversion: 2.42 time: 0.664581 Sep 10 21:09:04.630194 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2383/4664] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:03 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1837 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:04.636735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2abd9daa-f7e4-4c05-b957-132612a975bf tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:04.639095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2abd9daa-f7e4-4c05-b957-132612a975bf tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:04.660128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2abd9daa-f7e4-4c05-b957-132612a975bf tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:04.660634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2abd9daa-f7e4-4c05-b957-132612a975bf tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:04.668965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2abd9daa-f7e4-4c05-b957-132612a975bf tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:04.668965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2abd9daa-f7e4-4c05-b957-132612a975bf tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:04.680044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a2094921-8f2d-467d-9380-93d6b6c253ab tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:04.687569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2abd9daa-f7e4-4c05-b957-132612a975bf tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:04.688073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2abd9daa-f7e4-4c05-b957-132612a975bf tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:04.688853 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a2094921-8f2d-467d-9380-93d6b6c253ab tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1494 microversion: 2.1 time: 0.394766 Sep 10 21:09:04.699208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2282/4665] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:04 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1494 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:04.902360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1472a78e-b102-4bf2-b241-6704577b842f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:04.902917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1472a78e-b102-4bf2-b241-6704577b842f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:04.915236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1472a78e-b102-4bf2-b241-6704577b842f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:04.915692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1472a78e-b102-4bf2-b241-6704577b842f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:04.916223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1472a78e-b102-4bf2-b241-6704577b842f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:04.919351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1472a78e-b102-4bf2-b241-6704577b842f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:04.919828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1472a78e-b102-4bf2-b241-6704577b842f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:04.920283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1472a78e-b102-4bf2-b241-6704577b842f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:05.193398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2abd9daa-f7e4-4c05-b957-132612a975bf tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:05.212651 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2abd9daa-f7e4-4c05-b957-132612a975bf tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1394 microversion: 2.1 time: 0.580615 Sep 10 21:09:05.215513 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2384/4666] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:04 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1394 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:05.298374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6e1bc1e6-3474-4d19-9b81-21438cd30f53 req-67704e70-5117-43fd-b987-10d9f0d31028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "tag": "d889b597-182a-4d75-a4d9-b8e48cc0efb8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:05.316527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1472a78e-b102-4bf2-b241-6704577b842f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:05.333078 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1472a78e-b102-4bf2-b241-6704577b842f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1318 microversion: 2.1 time: 0.437894 Sep 10 21:09:05.338237 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2283/4667] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:04 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:05.362732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6e1bc1e6-3474-4d19-9b81-21438cd30f53 req-67704e70-5117-43fd-b987-10d9f0d31028 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:05.363566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6e1bc1e6-3474-4d19-9b81-21438cd30f53 req-67704e70-5117-43fd-b987-10d9f0d31028 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:05.366056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6e1bc1e6-3474-4d19-9b81-21438cd30f53 req-67704e70-5117-43fd-b987-10d9f0d31028 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:05.399466 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6e1bc1e6-3474-4d19-9b81-21438cd30f53 req-67704e70-5117-43fd-b987-10d9f0d31028 service nova] Creating event network-changed:d889b597-182a-4d75-a4d9-b8e48cc0efb8 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:05.422022 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6e1bc1e6-3474-4d19-9b81-21438cd30f53 req-67704e70-5117-43fd-b987-10d9f0d31028 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124974 Sep 10 21:09:05.435545 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2385/4668] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:09:05.659908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:05.660785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:05.668198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:05.668918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:05.669514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:05.670458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:05.671073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:05.671663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:05.720047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d3c1389c-2360-462d-93ea-19f17785c139 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:05.722976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d3c1389c-2360-462d-93ea-19f17785c139 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:05.735719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c1389c-2360-462d-93ea-19f17785c139 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:05.736415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c1389c-2360-462d-93ea-19f17785c139 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:05.737000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c1389c-2360-462d-93ea-19f17785c139 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:05.738226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c1389c-2360-462d-93ea-19f17785c139 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:05.739205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c1389c-2360-462d-93ea-19f17785c139 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:05.740219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c1389c-2360-462d-93ea-19f17785c139 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:06.248269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:06.260280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:06.261982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:06.263282 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7257ece8-ad1a-452f-a850-efb5d3f764e3 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1837 microversion: 2.42 time: 0.608344 Sep 10 21:09:06.278179 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2284/4669] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:05 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1837 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:06.288519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-11c79574-d2fc-430c-956b-c7a7960bcf0f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:06.289150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-11c79574-d2fc-430c-956b-c7a7960bcf0f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:06.296315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11c79574-d2fc-430c-956b-c7a7960bcf0f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:06.297297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11c79574-d2fc-430c-956b-c7a7960bcf0f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:06.298381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11c79574-d2fc-430c-956b-c7a7960bcf0f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:06.299303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11c79574-d2fc-430c-956b-c7a7960bcf0f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:06.299933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11c79574-d2fc-430c-956b-c7a7960bcf0f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:06.300523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11c79574-d2fc-430c-956b-c7a7960bcf0f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:06.708149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3c1389c-2360-462d-93ea-19f17785c139 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:06.718387 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d3c1389c-2360-462d-93ea-19f17785c139 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1494 microversion: 2.1 time: 1.005446 Sep 10 21:09:06.718973 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2386/4670] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:05 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1494 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:06.724255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-94ebc6f7-65b7-4d39-b243-4534f4c26e32 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:06.725038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-94ebc6f7-65b7-4d39-b243-4534f4c26e32 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:06.736002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94ebc6f7-65b7-4d39-b243-4534f4c26e32 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:06.737278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94ebc6f7-65b7-4d39-b243-4534f4c26e32 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:06.738116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94ebc6f7-65b7-4d39-b243-4534f4c26e32 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:06.738834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94ebc6f7-65b7-4d39-b243-4534f4c26e32 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:06.739347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94ebc6f7-65b7-4d39-b243-4534f4c26e32 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:06.739932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94ebc6f7-65b7-4d39-b243-4534f4c26e32 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:06.789120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-11c79574-d2fc-430c-956b-c7a7960bcf0f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:06.797599 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-11c79574-d2fc-430c-956b-c7a7960bcf0f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1394 microversion: 2.1 time: 0.517968 Sep 10 21:09:06.799533 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2285/4671] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:06 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1394 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:07.173400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-6da93885-14f7-4926-9f87-b5981cd26b11 req-674a8ba2-cb19-4b35-878b-5562e48f5594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1776376b-c1ed-4cbf-8081-67594fb9fe3d", "tag": "b2cab9b6-2001-4850-8ae6-6171d194916f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:07.193321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6da93885-14f7-4926-9f87-b5981cd26b11 req-674a8ba2-cb19-4b35-878b-5562e48f5594 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:07.199952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6da93885-14f7-4926-9f87-b5981cd26b11 req-674a8ba2-cb19-4b35-878b-5562e48f5594 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:07.200602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6da93885-14f7-4926-9f87-b5981cd26b11 req-674a8ba2-cb19-4b35-878b-5562e48f5594 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:07.238471 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-6da93885-14f7-4926-9f87-b5981cd26b11 req-674a8ba2-cb19-4b35-878b-5562e48f5594 service nova] Creating event network-changed:b2cab9b6-2001-4850-8ae6-6171d194916f for instance 1776376b-c1ed-4cbf-8081-67594fb9fe3d on nch2-master-1 Sep 10 21:09:07.259981 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-6da93885-14f7-4926-9f87-b5981cd26b11 req-674a8ba2-cb19-4b35-878b-5562e48f5594 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082180 Sep 10 21:09:07.262579 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2286/4672] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:07.298477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:07.300103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:07.327051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:07.328265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:07.331781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:07.333405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:07.335818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:07.336480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:07.414170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-94ebc6f7-65b7-4d39-b243-4534f4c26e32 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:07.431059 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-94ebc6f7-65b7-4d39-b243-4534f4c26e32 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1318 microversion: 2.1 time: 0.709355 Sep 10 21:09:07.435676 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2387/4673] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:06 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1318 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:07.746525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f438a340-cc43-4591-bbf5-fa6c319e5e74 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:07.747329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f438a340-cc43-4591-bbf5-fa6c319e5e74 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:07.758833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f438a340-cc43-4591-bbf5-fa6c319e5e74 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:07.761046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f438a340-cc43-4591-bbf5-fa6c319e5e74 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:07.763725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f438a340-cc43-4591-bbf5-fa6c319e5e74 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:07.765002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f438a340-cc43-4591-bbf5-fa6c319e5e74 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:07.765771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f438a340-cc43-4591-bbf5-fa6c319e5e74 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:07.766980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f438a340-cc43-4591-bbf5-fa6c319e5e74 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:08.088186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:08.101601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:08.103879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:08.111041 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-65a61b2d-f934-4429-830c-a91bbb59571e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1858 microversion: 2.42 time: 0.814165 Sep 10 21:09:08.113032 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2287/4674] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:07 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1858 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:08.132544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7e3db242-3311-4b80-87b5-da24fe7a0f94 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:08.134299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7e3db242-3311-4b80-87b5-da24fe7a0f94 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:08.149225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e3db242-3311-4b80-87b5-da24fe7a0f94 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:08.157909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e3db242-3311-4b80-87b5-da24fe7a0f94 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:08.159021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e3db242-3311-4b80-87b5-da24fe7a0f94 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:08.160773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e3db242-3311-4b80-87b5-da24fe7a0f94 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:08.164372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e3db242-3311-4b80-87b5-da24fe7a0f94 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:08.180511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e3db242-3311-4b80-87b5-da24fe7a0f94 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:08.222287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f438a340-cc43-4591-bbf5-fa6c319e5e74 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:08.242146 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f438a340-cc43-4591-bbf5-fa6c319e5e74 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1452 microversion: 2.1 time: 0.500578 Sep 10 21:09:08.276668 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2388/4675] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:07 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1452 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:08.604795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-30dab1dd-233d-479f-816c-d5b30c64396c req-432c0a7e-c6e0-4e7a-9349-635234d6231f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4188cfb-0c94-419a-b1c2-1c5d635b02c4", "name": "network-vif-deleted", "tag": "9586bb16-bde3-4db3-879b-28c42c2526b1"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:08.609262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7e3db242-3311-4b80-87b5-da24fe7a0f94 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:08.622583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-30dab1dd-233d-479f-816c-d5b30c64396c req-432c0a7e-c6e0-4e7a-9349-635234d6231f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:08.625186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-30dab1dd-233d-479f-816c-d5b30c64396c req-432c0a7e-c6e0-4e7a-9349-635234d6231f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:08.625883 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7e3db242-3311-4b80-87b5-da24fe7a0f94 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1394 microversion: 2.1 time: 0.510534 Sep 10 21:09:08.626018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-30dab1dd-233d-479f-816c-d5b30c64396c req-432c0a7e-c6e0-4e7a-9349-635234d6231f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:08.627666 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2288/4676] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:08 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1394 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:08.648529 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-30dab1dd-233d-479f-816c-d5b30c64396c req-432c0a7e-c6e0-4e7a-9349-635234d6231f service nova] Creating event network-vif-deleted:9586bb16-bde3-4db3-879b-28c42c2526b1 for instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 on nch2-master-1 Sep 10 21:09:08.655398 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-30dab1dd-233d-479f-816c-d5b30c64396c req-432c0a7e-c6e0-4e7a-9349-635234d6231f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376670 Sep 10 21:09:08.656255 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2389/4677] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:08.661577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fdd7ae63-d1e8-44b9-a8ec-9f4abff52544 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:08.662353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fdd7ae63-d1e8-44b9-a8ec-9f4abff52544 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:08.669980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdd7ae63-d1e8-44b9-a8ec-9f4abff52544 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:08.671193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdd7ae63-d1e8-44b9-a8ec-9f4abff52544 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:08.671800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdd7ae63-d1e8-44b9-a8ec-9f4abff52544 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:08.672826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdd7ae63-d1e8-44b9-a8ec-9f4abff52544 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:08.673492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdd7ae63-d1e8-44b9-a8ec-9f4abff52544 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:08.674150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fdd7ae63-d1e8-44b9-a8ec-9f4abff52544 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:08.691970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:08.866202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fdd7ae63-d1e8-44b9-a8ec-9f4abff52544 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:08.879712 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fdd7ae63-d1e8-44b9-a8ec-9f4abff52544 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1318 microversion: 2.1 time: 0.221536 Sep 10 21:09:08.881601 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2390/4678] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:08 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:08.929356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a9c32689-3a69-43b5-93f1-6194ac7f5261 req-daa8218b-1fb5-4d94-9596-a7e20f8dda2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c63541-628c-4ce4-9f01-692098a47a8a", "name": "network-vif-plugged", "status": "completed", "tag": "eb658c5c-4d51-4734-bb8b-cfed61b26aee"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:08.944890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a9c32689-3a69-43b5-93f1-6194ac7f5261 req-daa8218b-1fb5-4d94-9596-a7e20f8dda2f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:08.946652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a9c32689-3a69-43b5-93f1-6194ac7f5261 req-daa8218b-1fb5-4d94-9596-a7e20f8dda2f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:08.947317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a9c32689-3a69-43b5-93f1-6194ac7f5261 req-daa8218b-1fb5-4d94-9596-a7e20f8dda2f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:08.991409 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a9c32689-3a69-43b5-93f1-6194ac7f5261 req-daa8218b-1fb5-4d94-9596-a7e20f8dda2f service nova] Creating event network-vif-plugged:eb658c5c-4d51-4734-bb8b-cfed61b26aee for instance c3c63541-628c-4ce4-9f01-692098a47a8a on nch1-master-1 Sep 10 21:09:09.005129 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a9c32689-3a69-43b5-93f1-6194ac7f5261 req-daa8218b-1fb5-4d94-9596-a7e20f8dda2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375276 Sep 10 21:09:09.008890 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2289/4679] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:09.140937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:09.141554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:09.144502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=38 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:09.154488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:09.154627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:09.154982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:09.155705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:09.156175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:09.156613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:09.271157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:09.271157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:09.284131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:09.284639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:09.285088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:09.285803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:09.286287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:09.286718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:09.379268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:09.380660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:09.381333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:09.382127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lazy-loading 'fault' on Instance uuid b4188cfb-0c94-419a-b1c2-1c5d635b02c4 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:09:09.465183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:09.480704 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a57a66d8-0c33-41be-8851-6b97f793acb4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 200 len: 1298 microversion: 2.1 time: 0.215640 Sep 10 21:09:09.482291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:09.496590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:09.498071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:09.499298 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5889fa57-746e-4bc8-b1f6-55b4a59e5c4f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.362314 Sep 10 21:09:09.503151 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2290/4680] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:09 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 1298 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:09.504654 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2391/4681] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:09 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:09.650829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b0cd95fc-38d4-4224-b1e9-0b95bf247675 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:09.651572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b0cd95fc-38d4-4224-b1e9-0b95bf247675 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:09.659929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0cd95fc-38d4-4224-b1e9-0b95bf247675 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:09.660431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0cd95fc-38d4-4224-b1e9-0b95bf247675 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:09.660878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0cd95fc-38d4-4224-b1e9-0b95bf247675 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:09.661639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0cd95fc-38d4-4224-b1e9-0b95bf247675 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:09.662127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0cd95fc-38d4-4224-b1e9-0b95bf247675 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:09.662560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b0cd95fc-38d4-4224-b1e9-0b95bf247675 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:09.905870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9eb1e44b-cb6a-4456-9607-665710d95a90 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:09.906507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9eb1e44b-cb6a-4456-9607-665710d95a90 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:09.929810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eb1e44b-cb6a-4456-9607-665710d95a90 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:09.930644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eb1e44b-cb6a-4456-9607-665710d95a90 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:09.931102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eb1e44b-cb6a-4456-9607-665710d95a90 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:09.931839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eb1e44b-cb6a-4456-9607-665710d95a90 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:09.932310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eb1e44b-cb6a-4456-9607-665710d95a90 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:09.932787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9eb1e44b-cb6a-4456-9607-665710d95a90 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:10.209953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9eb1e44b-cb6a-4456-9607-665710d95a90 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:10.212166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b0cd95fc-38d4-4224-b1e9-0b95bf247675 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:10.220213 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b0cd95fc-38d4-4224-b1e9-0b95bf247675 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1394 microversion: 2.1 time: 0.573333 Sep 10 21:09:10.232077 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9eb1e44b-cb6a-4456-9607-665710d95a90 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1318 microversion: 2.1 time: 0.330632 Sep 10 21:09:10.235018 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2291/4682] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:09 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1394 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:10.247506 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2392/4683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:09 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:10.507559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:10.508340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:10.514888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:10.515469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:10.515978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:10.516740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:10.517878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:10.518382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:10.527709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:10.528714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:10.535365 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:09:10.537775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:10.538422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 HTTP/1.1 Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b4188cfb-0c94-419a-b1c2-1c5d635b02c4'} Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:09:10.539001 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:09:10.543120 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:09:10.543120 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:09:10.543120 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:09:10.543120 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:09:10.543120 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:09:10.543120 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:09:10.543120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:09:10.543120 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-89dd3aac-ab09-4a73-8339-d1e7b764dc44 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 404 len: 111 microversion: 2.1 time: 0.037014 Sep 10 21:09:10.543120 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2292/4684] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:10 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:09:10.545915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:10.546994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:10.547695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:10.548371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:10.553461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d4c487ed-206d-49f6-8b5d-e270fc2b54ef tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:10.553931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4c487ed-206d-49f6-8b5d-e270fc2b54ef tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:10.561178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c487ed-206d-49f6-8b5d-e270fc2b54ef tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:10.561740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c487ed-206d-49f6-8b5d-e270fc2b54ef tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:10.562283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c487ed-206d-49f6-8b5d-e270fc2b54ef tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:10.563594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c487ed-206d-49f6-8b5d-e270fc2b54ef tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:10.564058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c487ed-206d-49f6-8b5d-e270fc2b54ef tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:10.565316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4c487ed-206d-49f6-8b5d-e270fc2b54ef tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:10.606108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4c487ed-206d-49f6-8b5d-e270fc2b54ef tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:09:10.685967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:10.692732 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d4c487ed-206d-49f6-8b5d-e270fc2b54ef tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 204 len: 0 microversion: 2.1 time: 0.143595 Sep 10 21:09:10.694292 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2293/4685] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:09:10 2022] DELETE /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:09:10.706295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-429ee6d3-baa5-40a7-a31e-f6aa9d9edb0a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:10.707565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-429ee6d3-baa5-40a7-a31e-f6aa9d9edb0a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:10.714990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-429ee6d3-baa5-40a7-a31e-f6aa9d9edb0a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:10.715660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-429ee6d3-baa5-40a7-a31e-f6aa9d9edb0a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:10.716221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-429ee6d3-baa5-40a7-a31e-f6aa9d9edb0a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:10.717034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-429ee6d3-baa5-40a7-a31e-f6aa9d9edb0a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:10.717734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-429ee6d3-baa5-40a7-a31e-f6aa9d9edb0a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:10.718287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-429ee6d3-baa5-40a7-a31e-f6aa9d9edb0a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:10.770170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:10.780505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:10.782228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:10.783687 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ec3865d8-da9b-40c6-92d9-e2497c3ca048 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.260202 Sep 10 21:09:10.803698 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2393/4686] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:10 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:10.809206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-33548f8c-85ed-422f-b475-9d776fa02880 req-d0067002-c19f-4e70-af9c-d035a7efcf2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "tag": "979ff401-ab19-408f-9537-0454ae9bef50"}, {"name": "network-changed", "server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "tag": "1a88291c-d6d6-40cf-ab43-36feb25243a8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:10.822509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33548f8c-85ed-422f-b475-9d776fa02880 req-d0067002-c19f-4e70-af9c-d035a7efcf2b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:10.823360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33548f8c-85ed-422f-b475-9d776fa02880 req-d0067002-c19f-4e70-af9c-d035a7efcf2b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:10.823865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33548f8c-85ed-422f-b475-9d776fa02880 req-d0067002-c19f-4e70-af9c-d035a7efcf2b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:10.837411 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-33548f8c-85ed-422f-b475-9d776fa02880 req-d0067002-c19f-4e70-af9c-d035a7efcf2b service nova] Creating event network-changed:979ff401-ab19-408f-9537-0454ae9bef50 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:10.837953 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-33548f8c-85ed-422f-b475-9d776fa02880 req-d0067002-c19f-4e70-af9c-d035a7efcf2b service nova] Creating event network-changed:1a88291c-d6d6-40cf-ab43-36feb25243a8 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:10.843663 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-33548f8c-85ed-422f-b475-9d776fa02880 req-d0067002-c19f-4e70-af9c-d035a7efcf2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038444 Sep 10 21:09:10.844291 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2394/4687] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:11.254048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fd5dffe0-5a45-42d2-b86b-7a582e223b72 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:11.255173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fd5dffe0-5a45-42d2-b86b-7a582e223b72 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:11.271295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd5dffe0-5a45-42d2-b86b-7a582e223b72 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:11.272031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd5dffe0-5a45-42d2-b86b-7a582e223b72 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:11.272553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd5dffe0-5a45-42d2-b86b-7a582e223b72 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:11.273355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd5dffe0-5a45-42d2-b86b-7a582e223b72 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:11.274394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd5dffe0-5a45-42d2-b86b-7a582e223b72 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:11.275127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd5dffe0-5a45-42d2-b86b-7a582e223b72 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:11.279259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-429ee6d3-baa5-40a7-a31e-f6aa9d9edb0a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:11.324218 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-429ee6d3-baa5-40a7-a31e-f6aa9d9edb0a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1495 microversion: 2.1 time: 0.625948 Sep 10 21:09:11.325487 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2294/4688] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:10 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1495 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:11.331656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ed7b85b3-1a99-4f91-9774-ac6dbae8e438 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:11.332520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ed7b85b3-1a99-4f91-9774-ac6dbae8e438 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:11.341282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed7b85b3-1a99-4f91-9774-ac6dbae8e438 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:11.342018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed7b85b3-1a99-4f91-9774-ac6dbae8e438 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:11.342888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed7b85b3-1a99-4f91-9774-ac6dbae8e438 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:11.343550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed7b85b3-1a99-4f91-9774-ac6dbae8e438 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:11.344189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed7b85b3-1a99-4f91-9774-ac6dbae8e438 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:11.344757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed7b85b3-1a99-4f91-9774-ac6dbae8e438 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:11.576066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fd5dffe0-5a45-42d2-b86b-7a582e223b72 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:11.589256 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fd5dffe0-5a45-42d2-b86b-7a582e223b72 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1394 microversion: 2.1 time: 0.344145 Sep 10 21:09:11.607887 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2395/4689] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:11 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1394 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:11.810691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:11.811516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:11.820299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:11.820741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:11.821688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:11.822589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:11.823206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:11.823800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:11.891620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed7b85b3-1a99-4f91-9774-ac6dbae8e438 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:11.906311 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ed7b85b3-1a99-4f91-9774-ac6dbae8e438 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1507 microversion: 2.1 time: 0.579057 Sep 10 21:09:11.920400 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2295/4690] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:11 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1507 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:12.350438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-33f02f52-8c16-4d6b-8ba8-4417a7e48259 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:12.352134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-33f02f52-8c16-4d6b-8ba8-4417a7e48259 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:12.363570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33f02f52-8c16-4d6b-8ba8-4417a7e48259 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:12.364524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33f02f52-8c16-4d6b-8ba8-4417a7e48259 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:12.365177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33f02f52-8c16-4d6b-8ba8-4417a7e48259 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:12.367908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33f02f52-8c16-4d6b-8ba8-4417a7e48259 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:12.368556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33f02f52-8c16-4d6b-8ba8-4417a7e48259 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:12.369207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33f02f52-8c16-4d6b-8ba8-4417a7e48259 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:12.497738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:12.534659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:12.542580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:12.545925 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-940990c0-7b9a-4273-b607-5b072894be9c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.738306 Sep 10 21:09:12.546615 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2396/4691] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:11 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:12.622498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ff79e65f-6bdb-4bec-8f3e-947c3d23ec02 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:12.624968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ff79e65f-6bdb-4bec-8f3e-947c3d23ec02 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:12.643324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff79e65f-6bdb-4bec-8f3e-947c3d23ec02 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:12.644314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff79e65f-6bdb-4bec-8f3e-947c3d23ec02 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:12.645662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff79e65f-6bdb-4bec-8f3e-947c3d23ec02 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:12.646688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff79e65f-6bdb-4bec-8f3e-947c3d23ec02 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:12.647434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff79e65f-6bdb-4bec-8f3e-947c3d23ec02 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:12.648069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff79e65f-6bdb-4bec-8f3e-947c3d23ec02 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:12.690485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-33f02f52-8c16-4d6b-8ba8-4417a7e48259 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:12.709320 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-33f02f52-8c16-4d6b-8ba8-4417a7e48259 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1495 microversion: 2.1 time: 0.362836 Sep 10 21:09:12.710068 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2296/4692] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:12 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1495 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:12.903940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a58d5163-81cd-4a6c-b0de-1830fd211e7f req-9287194f-f20e-4fcf-b075-55b4ca4fa088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "tag": "9769a59b-2ba7-4bea-9c47-8429bd368de3"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:12.930326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a58d5163-81cd-4a6c-b0de-1830fd211e7f req-9287194f-f20e-4fcf-b075-55b4ca4fa088 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:12.931275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a58d5163-81cd-4a6c-b0de-1830fd211e7f req-9287194f-f20e-4fcf-b075-55b4ca4fa088 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:12.932876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a58d5163-81cd-4a6c-b0de-1830fd211e7f req-9287194f-f20e-4fcf-b075-55b4ca4fa088 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:12.959980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:12.963613 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a58d5163-81cd-4a6c-b0de-1830fd211e7f req-9287194f-f20e-4fcf-b075-55b4ca4fa088 service nova] Creating event network-changed:9769a59b-2ba7-4bea-9c47-8429bd368de3 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:12.970266 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a58d5163-81cd-4a6c-b0de-1830fd211e7f req-9287194f-f20e-4fcf-b075-55b4ca4fa088 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072855 Sep 10 21:09:12.973879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2297/4693] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:13.578252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:13.581980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:13.594803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:13.596282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:13.597083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:13.598019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:13.598643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:13.599260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:14.328478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ff79e65f-6bdb-4bec-8f3e-947c3d23ec02 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:14.350930 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ff79e65f-6bdb-4bec-8f3e-947c3d23ec02 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1394 microversion: 2.1 time: 1.740856 Sep 10 21:09:14.365853 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2397/4694] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:12 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1394 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:14.365853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9d080b64-e5ea-45dd-b008-13dac043ed38 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:14.365853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9d080b64-e5ea-45dd-b008-13dac043ed38 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:14.373336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d080b64-e5ea-45dd-b008-13dac043ed38 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:14.373977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d080b64-e5ea-45dd-b008-13dac043ed38 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:14.374399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d080b64-e5ea-45dd-b008-13dac043ed38 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:14.375213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d080b64-e5ea-45dd-b008-13dac043ed38 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:14.376384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d080b64-e5ea-45dd-b008-13dac043ed38 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:14.377600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d080b64-e5ea-45dd-b008-13dac043ed38 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:14.391546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:14.682274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:14.715878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:14.724657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:14.731356 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2cd7de23-7f92-4963-a797-4336661f7bd8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 1.157711 Sep 10 21:09:14.732288 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2298/4695] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:13 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:14.740749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e5acd226-6d2a-4594-a05b-fc22f315c233 req-911ea317-5623-4ab9-a8be-0cc659db9fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1776376b-c1ed-4cbf-8081-67594fb9fe3d", "name": "network-vif-plugged", "status": "completed", "tag": "b2cab9b6-2001-4850-8ae6-6171d194916f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:14.775119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e5acd226-6d2a-4594-a05b-fc22f315c233 req-911ea317-5623-4ab9-a8be-0cc659db9fad service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:14.777583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e5acd226-6d2a-4594-a05b-fc22f315c233 req-911ea317-5623-4ab9-a8be-0cc659db9fad service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:14.778988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e5acd226-6d2a-4594-a05b-fc22f315c233 req-911ea317-5623-4ab9-a8be-0cc659db9fad service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:14.796442 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e5acd226-6d2a-4594-a05b-fc22f315c233 req-911ea317-5623-4ab9-a8be-0cc659db9fad service nova] Creating event network-vif-plugged:b2cab9b6-2001-4850-8ae6-6171d194916f for instance 1776376b-c1ed-4cbf-8081-67594fb9fe3d on nch2-master-1 Sep 10 21:09:14.803068 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e5acd226-6d2a-4594-a05b-fc22f315c233 req-911ea317-5623-4ab9-a8be-0cc659db9fad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069413 Sep 10 21:09:14.807200 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2299/4696] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:15.019247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-75a55ae6-244e-4ed5-936c-1bdc6a0b89e7 req-082c9402-219c-4af6-9d14-de70a1f5b905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "tag": "f5fb4882-1873-4d19-b174-8c22dc2b8ff7"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:15.035042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-75a55ae6-244e-4ed5-936c-1bdc6a0b89e7 req-082c9402-219c-4af6-9d14-de70a1f5b905 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:15.035831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-75a55ae6-244e-4ed5-936c-1bdc6a0b89e7 req-082c9402-219c-4af6-9d14-de70a1f5b905 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:15.036592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-75a55ae6-244e-4ed5-936c-1bdc6a0b89e7 req-082c9402-219c-4af6-9d14-de70a1f5b905 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:15.061753 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-75a55ae6-244e-4ed5-936c-1bdc6a0b89e7 req-082c9402-219c-4af6-9d14-de70a1f5b905 service nova] Creating event network-changed:f5fb4882-1873-4d19-b174-8c22dc2b8ff7 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:15.108235 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-75a55ae6-244e-4ed5-936c-1bdc6a0b89e7 req-082c9402-219c-4af6-9d14-de70a1f5b905 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079388 Sep 10 21:09:15.112220 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2300/4697] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:15.133101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9ad6a02d-4546-47d6-84a7-8eb7c7563dc9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9700a70-feeb-4768-a297-e5cc27b3c3fe", "device": "/dev/sdb"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:15.135696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9ad6a02d-4546-47d6-84a7-8eb7c7563dc9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:15.152918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ad6a02d-4546-47d6-84a7-8eb7c7563dc9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:15.153427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ad6a02d-4546-47d6-84a7-8eb7c7563dc9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:15.154062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ad6a02d-4546-47d6-84a7-8eb7c7563dc9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:15.154783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ad6a02d-4546-47d6-84a7-8eb7c7563dc9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:15.155453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ad6a02d-4546-47d6-84a7-8eb7c7563dc9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:15.156046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ad6a02d-4546-47d6-84a7-8eb7c7563dc9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:15.342203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9d080b64-e5ea-45dd-b008-13dac043ed38 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:15.352567 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9d080b64-e5ea-45dd-b008-13dac043ed38 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1495 microversion: 2.1 time: 0.998854 Sep 10 21:09:15.374172 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2398/4698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:14 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1495 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:15.383197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f700aa4-de75-46fe-a026-73a5181512b2 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:15.390525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2f700aa4-de75-46fe-a026-73a5181512b2 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:15.407084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f700aa4-de75-46fe-a026-73a5181512b2 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:15.407737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f700aa4-de75-46fe-a026-73a5181512b2 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:15.408118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f700aa4-de75-46fe-a026-73a5181512b2 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:15.409041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f700aa4-de75-46fe-a026-73a5181512b2 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:15.409455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f700aa4-de75-46fe-a026-73a5181512b2 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:15.409901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f700aa4-de75-46fe-a026-73a5181512b2 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:15.563684 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9ad6a02d-4546-47d6-84a7-8eb7c7563dc9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "POST /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449129 Sep 10 21:09:15.565974 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2301/4699] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:09:15 2022] POST /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:15.773894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:15.776248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:15.853589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:15.856861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:15.858076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:15.859416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:15.860583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:15.862218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:16.188625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2f700aa4-de75-46fe-a026-73a5181512b2 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:16.199244 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f700aa4-de75-46fe-a026-73a5181512b2 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1394 microversion: 2.1 time: 0.823543 Sep 10 21:09:16.224070 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2399/4700] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:15 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1394 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:16.231791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8200418c-0bac-4e17-b82b-017123998bae req-4954e413-1247-41eb-a333-cca459df56ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf19196-a3f8-43b1-95b5-4842aac6ac78", "name": "network-vif-deleted", "tag": "e979de0f-105f-4af2-9b7d-971b42d05c01"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:16.259774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8200418c-0bac-4e17-b82b-017123998bae req-4954e413-1247-41eb-a333-cca459df56ab service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:16.262064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8200418c-0bac-4e17-b82b-017123998bae req-4954e413-1247-41eb-a333-cca459df56ab service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:16.262727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8200418c-0bac-4e17-b82b-017123998bae req-4954e413-1247-41eb-a333-cca459df56ab service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:16.294166 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8200418c-0bac-4e17-b82b-017123998bae req-4954e413-1247-41eb-a333-cca459df56ab service nova] Creating event network-vif-deleted:e979de0f-105f-4af2-9b7d-971b42d05c01 for instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 on nch1-master-1 Sep 10 21:09:16.304472 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8200418c-0bac-4e17-b82b-017123998bae req-4954e413-1247-41eb-a333-cca459df56ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078995 Sep 10 21:09:16.305244 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2400/4701] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:16.399168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:16.400868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:16.410208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:16.410708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:16.411148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:16.411862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:16.412315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:16.412740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:16.451683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:16.465800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:16.467314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:16.472269 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a99f2b53-0f52-461e-bb34-6e0d5e796cc9 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.708501 Sep 10 21:09:16.473071 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2302/4702] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:15 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:16.511342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:16.511833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:16.512451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:16.513073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lazy-loading 'fault' on Instance uuid 3cf19196-a3f8-43b1-95b5-4842aac6ac78 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:09:16.584024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:16.602641 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d2f3e5b6-36d8-4bef-acbe-4c97b5a9aa17 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 200 len: 1298 microversion: 2.1 time: 0.207055 Sep 10 21:09:16.603397 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2401/4703] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:16 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 1298 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:17.237808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4504ea91-8670-4e54-ac6a-d8582fd95e05 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:17.239030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4504ea91-8670-4e54-ac6a-d8582fd95e05 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:17.260508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4504ea91-8670-4e54-ac6a-d8582fd95e05 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:17.261318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4504ea91-8670-4e54-ac6a-d8582fd95e05 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:17.262006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4504ea91-8670-4e54-ac6a-d8582fd95e05 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:17.262930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4504ea91-8670-4e54-ac6a-d8582fd95e05 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:17.265611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4504ea91-8670-4e54-ac6a-d8582fd95e05 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:17.266178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4504ea91-8670-4e54-ac6a-d8582fd95e05 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:17.500681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:17.501293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:17.515543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:17.516378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:17.518791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:17.520349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:17.522199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:17.524223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:17.752759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4504ea91-8670-4e54-ac6a-d8582fd95e05 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:17.763391 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4504ea91-8670-4e54-ac6a-d8582fd95e05 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1576 microversion: 2.1 time: 0.530287 Sep 10 21:09:17.764370 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2303/4704] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:17 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1576 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:17.770780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:17.771529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:17.778824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:17.779636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:17.780949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:17.782958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:17.785047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:17.785544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:17.806991 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 HTTP/1.1 Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '3cf19196-a3f8-43b1-95b5-4842aac6ac78'} Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:09:17.809101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:09:17.813686 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:09:17.813686 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:09:17.813686 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:09:17.813686 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:09:17.813686 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:09:17.813686 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:09:17.816434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:09:17.817315 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f93b19b0-8101-42ed-9076-d346ed3bd074 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 404 len: 111 microversion: 2.1 time: 0.051677 Sep 10 21:09:17.819926 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2304/4705] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:17 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:09:17.824138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-01e58f6d-cf50-44c8-acd7-08f0b38bb238 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:17.824920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-01e58f6d-cf50-44c8-acd7-08f0b38bb238 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:17.832753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01e58f6d-cf50-44c8-acd7-08f0b38bb238 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:17.833462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01e58f6d-cf50-44c8-acd7-08f0b38bb238 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:17.834131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01e58f6d-cf50-44c8-acd7-08f0b38bb238 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:17.835252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01e58f6d-cf50-44c8-acd7-08f0b38bb238 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:17.836747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01e58f6d-cf50-44c8-acd7-08f0b38bb238 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:17.837363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-01e58f6d-cf50-44c8-acd7-08f0b38bb238 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:17.890458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:17.905457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:17.906983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:17.910878 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-358769fb-0b39-4ac3-aeee-3c52fb9318ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.414488 Sep 10 21:09:17.911471 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2402/4706] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:17 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:17.994479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1769502110", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "75842dc4-d668-416f-9bad-afa9ac1ec517"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:18.019893 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-01e58f6d-cf50-44c8-acd7-08f0b38bb238 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200253 Sep 10 21:09:18.020489 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2305/4707] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:09:17 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d/os-interface => generated 285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:18.068869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] validate_networks() for [('75842dc4-d668-416f-9bad-afa9ac1ec517', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:09:18.139306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-4a4654e5-9a1f-4eec-92ce-87f73f6a1a4f req-af5795f6-1075-4d02-98a2-3706d15ecb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "tag": "dad0bc97-94ef-450b-bb75-2b4c63e2b9eb"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:18.157884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4a4654e5-9a1f-4eec-92ce-87f73f6a1a4f req-af5795f6-1075-4d02-98a2-3706d15ecb4c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:18.159712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4a4654e5-9a1f-4eec-92ce-87f73f6a1a4f req-af5795f6-1075-4d02-98a2-3706d15ecb4c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:18.160380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4a4654e5-9a1f-4eec-92ce-87f73f6a1a4f req-af5795f6-1075-4d02-98a2-3706d15ecb4c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:18.175534 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-4a4654e5-9a1f-4eec-92ce-87f73f6a1a4f req-af5795f6-1075-4d02-98a2-3706d15ecb4c service nova] Creating event network-changed:dad0bc97-94ef-450b-bb75-2b4c63e2b9eb for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:18.182132 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-4a4654e5-9a1f-4eec-92ce-87f73f6a1a4f req-af5795f6-1075-4d02-98a2-3706d15ecb4c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046313 Sep 10 21:09:18.183150 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2306/4708] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:09:18.942039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:18.943497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:18.950707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:18.951210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:18.951850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:18.953346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:18.966794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:18.967421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:19.150182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:09:19.152078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:09:19.153282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:09:19.156104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:09:19.157245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:09:19.225241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:19.232218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:19.232967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:19.233933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:19.235559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:19.236605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:19.277921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:09:19.284763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for user 6bfa3af0a7284bc6854f2c9c58392935 and project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:09:19.299013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:09:19.301677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:09:19.352832 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3229bf48-d50c-4458-8ba4-4ad1beb7266a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.362366 Sep 10 21:09:19.354200 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2403/4709] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:09:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:09:19.373870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b06c4459-7c11-4bc1-9e43-babdfe10ef1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:19.376226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b06c4459-7c11-4bc1-9e43-babdfe10ef1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:19.550756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b06c4459-7c11-4bc1-9e43-babdfe10ef1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:19.564068 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b06c4459-7c11-4bc1-9e43-babdfe10ef1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1209 microversion: 2.1 time: 0.201374 Sep 10 21:09:19.585748 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2404/4710] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:19 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1209 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:19.775755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:19.790030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:19.792029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:19.794093 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1453602b-67c6-4c4e-a66a-0af3792da0c1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.859000 Sep 10 21:09:19.808453 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2307/4711] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:18 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:20.595625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cc3fb52c-d595-4162-861c-07cc249cc561 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:20.597613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cc3fb52c-d595-4162-861c-07cc249cc561 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:20.606690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc3fb52c-d595-4162-861c-07cc249cc561 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:20.607533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc3fb52c-d595-4162-861c-07cc249cc561 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:20.608177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc3fb52c-d595-4162-861c-07cc249cc561 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:20.609114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc3fb52c-d595-4162-861c-07cc249cc561 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:20.609918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc3fb52c-d595-4162-861c-07cc249cc561 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:20.610730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc3fb52c-d595-4162-861c-07cc249cc561 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:20.759818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cc3fb52c-d595-4162-861c-07cc249cc561 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:20.775835 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cc3fb52c-d595-4162-861c-07cc249cc561 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1261 microversion: 2.1 time: 0.184735 Sep 10 21:09:20.794302 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2405/4712] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:20 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:20.828854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:20.829612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:20.840005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:20.840798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:20.842059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:20.844828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:20.845771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:20.846442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:21.478573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8e8c87b2-b743-40a0-8d94-0b5d26c09569 req-d6bc838a-0262-4711-9a98-5eaedf5306d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "tag": "2a244a93-1742-44b5-9cca-49760a0090a8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:21.513219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8e8c87b2-b743-40a0-8d94-0b5d26c09569 req-d6bc838a-0262-4711-9a98-5eaedf5306d4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:21.513700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8e8c87b2-b743-40a0-8d94-0b5d26c09569 req-d6bc838a-0262-4711-9a98-5eaedf5306d4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:21.514192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8e8c87b2-b743-40a0-8d94-0b5d26c09569 req-d6bc838a-0262-4711-9a98-5eaedf5306d4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:21.565287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:21.565544 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8e8c87b2-b743-40a0-8d94-0b5d26c09569 req-d6bc838a-0262-4711-9a98-5eaedf5306d4 service nova] Creating event network-changed:2a244a93-1742-44b5-9cca-49760a0090a8 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:21.565633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:21.565633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:21.565633 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5a006d4f-4467-4529-a56d-8a12c2704e48 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.739260 Sep 10 21:09:21.565633 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2308/4713] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:20 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:21.566218 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8e8c87b2-b743-40a0-8d94-0b5d26c09569 req-d6bc838a-0262-4711-9a98-5eaedf5306d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090801 Sep 10 21:09:21.568124 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2406/4714] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:09:21.804669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-246ce43e-b5d1-4430-9e29-f9b55b33f7fa tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:21.805568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-246ce43e-b5d1-4430-9e29-f9b55b33f7fa tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:21.818338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246ce43e-b5d1-4430-9e29-f9b55b33f7fa tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:21.819933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246ce43e-b5d1-4430-9e29-f9b55b33f7fa tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:21.820393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246ce43e-b5d1-4430-9e29-f9b55b33f7fa tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:21.822345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246ce43e-b5d1-4430-9e29-f9b55b33f7fa tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:21.825791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246ce43e-b5d1-4430-9e29-f9b55b33f7fa tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:21.826349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-246ce43e-b5d1-4430-9e29-f9b55b33f7fa tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:21.867909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a81de104-1e6e-496c-9955-5923f8e33948 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:21.868778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a81de104-1e6e-496c-9955-5923f8e33948 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:21.886403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a81de104-1e6e-496c-9955-5923f8e33948 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:21.886907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a81de104-1e6e-496c-9955-5923f8e33948 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:21.894411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a81de104-1e6e-496c-9955-5923f8e33948 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:21.895785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a81de104-1e6e-496c-9955-5923f8e33948 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:21.896295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a81de104-1e6e-496c-9955-5923f8e33948 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:21.896728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a81de104-1e6e-496c-9955-5923f8e33948 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:22.639585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a81de104-1e6e-496c-9955-5923f8e33948 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:22.665660 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a81de104-1e6e-496c-9955-5923f8e33948 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1576 microversion: 2.1 time: 0.803161 Sep 10 21:09:22.674960 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2407/4715] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:21 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1576 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:22.710225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92f9fb4f-16de-4391-a87e-ae9965ccf362 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:22.711648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-92f9fb4f-16de-4391-a87e-ae9965ccf362 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:22.733197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:22.739617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f9fb4f-16de-4391-a87e-ae9965ccf362 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:22.756905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f9fb4f-16de-4391-a87e-ae9965ccf362 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:22.759002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f9fb4f-16de-4391-a87e-ae9965ccf362 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:22.762741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f9fb4f-16de-4391-a87e-ae9965ccf362 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:22.763489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f9fb4f-16de-4391-a87e-ae9965ccf362 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:22.764104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f9fb4f-16de-4391-a87e-ae9965ccf362 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:23.084532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-92f9fb4f-16de-4391-a87e-ae9965ccf362 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lazy-loading 'services' on Instance uuid e06501f8-3bc9-4240-b2ca-514d8d6fdacb {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:09:23.207639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-246ce43e-b5d1-4430-9e29-f9b55b33f7fa tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:23.239241 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-92f9fb4f-16de-4391-a87e-ae9965ccf362 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/os-volume_attachments/939d11dd-0156-46c3-817b-2b0abd931e5b" status: 202 len: 0 microversion: 2.1 time: 0.536369 Sep 10 21:09:23.239241 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2408/4716] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 21:09:22 2022] DELETE /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/os-volume_attachments/939d11dd-0156-46c3-817b-2b0abd931e5b => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:09:23.255625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:23.256672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:23.260713 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-246ce43e-b5d1-4430-9e29-f9b55b33f7fa tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1267 microversion: 2.1 time: 1.459676 Sep 10 21:09:23.262508 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2309/4717] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:21 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1267 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:23.283790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:23.286476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:23.287519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:23.288295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:23.288764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:23.289304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:23.827325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:23.840848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:23.842551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:23.844053 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d10005ff-40eb-487d-9074-5169ccee03c8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.608903 Sep 10 21:09:23.844818 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2409/4718] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:23 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:23.867486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-ae477a7f-9b81-4a26-90ee-6675e2ee9647 req-aed0868d-9529-4373-9b42-2d32c93d7f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1776376b-c1ed-4cbf-8081-67594fb9fe3d", "tag": "b2cab9b6-2001-4850-8ae6-6171d194916f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:23.891635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ae477a7f-9b81-4a26-90ee-6675e2ee9647 req-aed0868d-9529-4373-9b42-2d32c93d7f2f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:23.892377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ae477a7f-9b81-4a26-90ee-6675e2ee9647 req-aed0868d-9529-4373-9b42-2d32c93d7f2f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:23.893811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ae477a7f-9b81-4a26-90ee-6675e2ee9647 req-aed0868d-9529-4373-9b42-2d32c93d7f2f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:23.931126 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-ae477a7f-9b81-4a26-90ee-6675e2ee9647 req-aed0868d-9529-4373-9b42-2d32c93d7f2f service nova] Creating event network-changed:b2cab9b6-2001-4850-8ae6-6171d194916f for instance 1776376b-c1ed-4cbf-8081-67594fb9fe3d on nch2-master-1 Sep 10 21:09:23.943119 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-ae477a7f-9b81-4a26-90ee-6675e2ee9647 req-aed0868d-9529-4373-9b42-2d32c93d7f2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078730 Sep 10 21:09:23.947420 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2310/4719] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:24.294968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d0708715-acbf-4496-bf38-78b42ed1b9bb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:24.299502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d0708715-acbf-4496-bf38-78b42ed1b9bb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:24.315275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0708715-acbf-4496-bf38-78b42ed1b9bb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:24.316168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0708715-acbf-4496-bf38-78b42ed1b9bb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:24.317492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0708715-acbf-4496-bf38-78b42ed1b9bb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:24.320680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0708715-acbf-4496-bf38-78b42ed1b9bb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:24.321361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0708715-acbf-4496-bf38-78b42ed1b9bb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:24.322567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0708715-acbf-4496-bf38-78b42ed1b9bb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:24.623344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-48b8dfe0-9d7f-427c-857b-70c663823d8d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:24.634797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48b8dfe0-9d7f-427c-857b-70c663823d8d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:24.635229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48b8dfe0-9d7f-427c-857b-70c663823d8d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:24.635669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48b8dfe0-9d7f-427c-857b-70c663823d8d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:24.983468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-48b8dfe0-9d7f-427c-857b-70c663823d8d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Going to try to stop instance {{(pid=145771) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 21:09:25.127119 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-48b8dfe0-9d7f-427c-857b-70c663823d8d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/action" status: 202 len: 0 microversion: 2.1 time: 0.504686 Sep 10 21:09:25.128186 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2311/4720] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:09:24 2022] POST /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:09:25.134420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:25.135446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:25.144223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:25.145065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:25.145678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:25.147463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:25.148090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:25.148903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:25.585012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d0708715-acbf-4496-bf38-78b42ed1b9bb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:25.603421 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d0708715-acbf-4496-bf38-78b42ed1b9bb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1267 microversion: 2.1 time: 1.312347 Sep 10 21:09:25.605388 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2410/4721] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:24 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1267 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:25.626061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3560196c-c513-463f-9835-a0bdf4ddbb01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:25.628061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3560196c-c513-463f-9835-a0bdf4ddbb01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:25.655855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3560196c-c513-463f-9835-a0bdf4ddbb01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:25.656746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3560196c-c513-463f-9835-a0bdf4ddbb01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:25.657410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3560196c-c513-463f-9835-a0bdf4ddbb01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:25.660082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3560196c-c513-463f-9835-a0bdf4ddbb01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:25.663960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3560196c-c513-463f-9835-a0bdf4ddbb01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:25.666527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3560196c-c513-463f-9835-a0bdf4ddbb01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:26.223582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3560196c-c513-463f-9835-a0bdf4ddbb01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:26.234428 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3560196c-c513-463f-9835-a0bdf4ddbb01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1678 microversion: 2.1 time: 0.627187 Sep 10 21:09:26.235366 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2411/4722] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:25 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1678 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:26.350339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:26.360302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:26.362374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:26.371377 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-450af7f4-e11f-45e5-8847-730b849fa84d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 1.241577 Sep 10 21:09:26.372214 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2312/4723] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:25 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:26.651097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8a9e801-75a8-4ca9-b329-32c3e3a065d5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:26.652469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c8a9e801-75a8-4ca9-b329-32c3e3a065d5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:26.672841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8a9e801-75a8-4ca9-b329-32c3e3a065d5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:26.673687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8a9e801-75a8-4ca9-b329-32c3e3a065d5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:26.680447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8a9e801-75a8-4ca9-b329-32c3e3a065d5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:26.681489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8a9e801-75a8-4ca9-b329-32c3e3a065d5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:26.682195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8a9e801-75a8-4ca9-b329-32c3e3a065d5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:26.683095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8a9e801-75a8-4ca9-b329-32c3e3a065d5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:27.222372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c8a9e801-75a8-4ca9-b329-32c3e3a065d5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:27.230759 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c8a9e801-75a8-4ca9-b329-32c3e3a065d5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1309 microversion: 2.1 time: 0.586375 Sep 10 21:09:27.236637 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2412/4724] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:26 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1309 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:27.259731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e08ec9eb-346f-4685-af6c-b9968e057805 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:27.260443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e08ec9eb-346f-4685-af6c-b9968e057805 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:27.270918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e08ec9eb-346f-4685-af6c-b9968e057805 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:27.271624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e08ec9eb-346f-4685-af6c-b9968e057805 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:27.272248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e08ec9eb-346f-4685-af6c-b9968e057805 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:27.272964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e08ec9eb-346f-4685-af6c-b9968e057805 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:27.273423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e08ec9eb-346f-4685-af6c-b9968e057805 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:27.276538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e08ec9eb-346f-4685-af6c-b9968e057805 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:27.400470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:27.401405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:27.420107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:27.420499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:27.421056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:27.421857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:27.422501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:27.423278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:27.744473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:27.770748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:27.773125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:27.775482 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ebce7c8-d1d6-4622-80bc-7d789257bd9b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.379333 Sep 10 21:09:27.793966 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2413/4725] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:27 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:27.915309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e08ec9eb-346f-4685-af6c-b9968e057805 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:27.930953 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e08ec9eb-346f-4685-af6c-b9968e057805 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1678 microversion: 2.1 time: 0.674874 Sep 10 21:09:27.931576 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2313/4726] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:27 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1678 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:28.265796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea6fb263-ae73-45fa-a28e-488785889b3d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:28.266823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ea6fb263-ae73-45fa-a28e-488785889b3d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:28.274502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea6fb263-ae73-45fa-a28e-488785889b3d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:28.275006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea6fb263-ae73-45fa-a28e-488785889b3d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:28.275452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea6fb263-ae73-45fa-a28e-488785889b3d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:28.276176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea6fb263-ae73-45fa-a28e-488785889b3d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:28.276634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea6fb263-ae73-45fa-a28e-488785889b3d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:28.277067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ea6fb263-ae73-45fa-a28e-488785889b3d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:28.440243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ea6fb263-ae73-45fa-a28e-488785889b3d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:28.448565 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea6fb263-ae73-45fa-a28e-488785889b3d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1309 microversion: 2.1 time: 0.186942 Sep 10 21:09:28.449427 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2414/4727] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:28 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1309 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:28.810756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:28.811678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:28.830497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:28.833805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:28.839853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:28.840640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:28.841119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:28.848727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:28.961693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-72f6123e-b233-4b83-b863-380938cfd116 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:28.962644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-72f6123e-b233-4b83-b863-380938cfd116 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:28.982403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72f6123e-b233-4b83-b863-380938cfd116 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:28.990242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72f6123e-b233-4b83-b863-380938cfd116 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:28.993957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72f6123e-b233-4b83-b863-380938cfd116 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:28.995001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72f6123e-b233-4b83-b863-380938cfd116 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:28.996973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72f6123e-b233-4b83-b863-380938cfd116 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:28.998275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72f6123e-b233-4b83-b863-380938cfd116 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:29.270919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:29.322565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-72f6123e-b233-4b83-b863-380938cfd116 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:29.333860 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-72f6123e-b233-4b83-b863-380938cfd116 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1678 microversion: 2.1 time: 0.378307 Sep 10 21:09:29.345862 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2415/4728] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:28 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1678 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:29.523486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:29.551341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:29.555428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:29.555879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:29.559691 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-10d10159-fff6-402d-abde-c0913f2f982c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.756273 Sep 10 21:09:29.563720 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2314/4729] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:28 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:29.579374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dcffdfad-a0b9-403b-a952-a6bbbd17b9ec tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:29.580167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dcffdfad-a0b9-403b-a952-a6bbbd17b9ec tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:29.582338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bc5a3be3-97da-4007-ab20-9cc98abb62b2 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: .version_select at 0x7f993f9b6670>, body: {"keypair": {"name": "tempest-keypair-183368343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArJMMDvo+L8xuhPrxH3FRKaeB02IacY4qELi2HgsMrTpMwo9oza3auge7AQdbaeLnK5Y+M3LCEXqfnI55OEM5nrpoiai/aIvlFeWWGO7qoKT1YX7yqdHuucH7H17goM3w=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:29.592836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcffdfad-a0b9-403b-a952-a6bbbd17b9ec tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:29.593682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcffdfad-a0b9-403b-a952-a6bbbd17b9ec tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:29.594320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcffdfad-a0b9-403b-a952-a6bbbd17b9ec tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:29.596132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcffdfad-a0b9-403b-a952-a6bbbd17b9ec tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:29.597234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcffdfad-a0b9-403b-a952-a6bbbd17b9ec tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:29.597859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcffdfad-a0b9-403b-a952-a6bbbd17b9ec tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:29.612773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bc5a3be3-97da-4007-ab20-9cc98abb62b2 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:09:29.622310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bc5a3be3-97da-4007-ab20-9cc98abb62b2 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for user 54dcc78ee39c4119b08023d3cc692d6b and project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:09:29.679491 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bc5a3be3-97da-4007-ab20-9cc98abb62b2 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.342325 Sep 10 21:09:29.681184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2416/4730] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:09:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:30.194185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dcffdfad-a0b9-403b-a952-a6bbbd17b9ec tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:30.196531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:30.216032 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dcffdfad-a0b9-403b-a952-a6bbbd17b9ec tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1309 microversion: 2.1 time: 0.650774 Sep 10 21:09:30.223119 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2315/4731] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:29 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1309 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:30.363318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9fd74187-4e67-4869-a443-45373d024b57 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:30.364050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9fd74187-4e67-4869-a443-45373d024b57 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:30.384064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fd74187-4e67-4869-a443-45373d024b57 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:30.384652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fd74187-4e67-4869-a443-45373d024b57 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:30.386094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fd74187-4e67-4869-a443-45373d024b57 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:30.386976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fd74187-4e67-4869-a443-45373d024b57 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:30.387543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fd74187-4e67-4869-a443-45373d024b57 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:30.390467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fd74187-4e67-4869-a443-45373d024b57 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:30.598866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:30.600631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:30.617964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:30.621376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:30.624233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:30.625410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:30.627506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:30.629751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:30.905274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9fd74187-4e67-4869-a443-45373d024b57 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:30.910489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:30.928373 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9fd74187-4e67-4869-a443-45373d024b57 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1678 microversion: 2.1 time: 0.558858 Sep 10 21:09:30.932430 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2417/4732] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:30 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1678 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:30.945394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-316ccf2c-96e1-468f-8d09-2a39a7823f66 req-235b09d1-fb49-4d49-8ef9-b07cca08a338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "655a20ea-1e07-43d1-9e43-f68fe3ba3473", "tag": "ea1fa814-846c-4364-87da-7ba82cb5674b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:30.975151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-316ccf2c-96e1-468f-8d09-2a39a7823f66 req-235b09d1-fb49-4d49-8ef9-b07cca08a338 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:30.976154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-316ccf2c-96e1-468f-8d09-2a39a7823f66 req-235b09d1-fb49-4d49-8ef9-b07cca08a338 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:30.976792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-316ccf2c-96e1-468f-8d09-2a39a7823f66 req-235b09d1-fb49-4d49-8ef9-b07cca08a338 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:31.041211 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-316ccf2c-96e1-468f-8d09-2a39a7823f66 req-235b09d1-fb49-4d49-8ef9-b07cca08a338 service nova] Creating event network-changed:ea1fa814-846c-4364-87da-7ba82cb5674b for instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 on nch1-master-1 Sep 10 21:09:31.056270 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-316ccf2c-96e1-468f-8d09-2a39a7823f66 req-235b09d1-fb49-4d49-8ef9-b07cca08a338 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121786 Sep 10 21:09:31.057414 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2418/4733] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:31.256794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c2613023-c72e-416d-b387-bd430be4fbfd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:31.272481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c2613023-c72e-416d-b387-bd430be4fbfd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:31.316534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2613023-c72e-416d-b387-bd430be4fbfd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:31.316837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2613023-c72e-416d-b387-bd430be4fbfd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:31.317454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2613023-c72e-416d-b387-bd430be4fbfd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:31.318987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2613023-c72e-416d-b387-bd430be4fbfd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:31.319420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2613023-c72e-416d-b387-bd430be4fbfd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:31.325306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2613023-c72e-416d-b387-bd430be4fbfd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:31.423289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:31.440676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:31.442482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:31.444306 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ed16a4e7-8e61-4633-a62f-959f6192bd5d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.853657 Sep 10 21:09:31.445440 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2316/4734] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:30 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:31.671481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c2613023-c72e-416d-b387-bd430be4fbfd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:31.710459 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c2613023-c72e-416d-b387-bd430be4fbfd tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1309 microversion: 2.1 time: 0.458804 Sep 10 21:09:31.723654 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2419/4735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:31 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1309 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:31.958028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d46636b-9ade-4dce-99ce-5016dceeb101 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:31.958613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d46636b-9ade-4dce-99ce-5016dceeb101 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:31.974276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d46636b-9ade-4dce-99ce-5016dceeb101 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:31.974562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d46636b-9ade-4dce-99ce-5016dceeb101 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:31.977731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d46636b-9ade-4dce-99ce-5016dceeb101 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:31.979971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d46636b-9ade-4dce-99ce-5016dceeb101 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:31.982487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d46636b-9ade-4dce-99ce-5016dceeb101 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:31.983594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d46636b-9ade-4dce-99ce-5016dceeb101 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:32.476747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:32.482843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:32.495676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:32.496187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:32.496821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:32.497350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:32.497817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:32.498285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:32.823581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:32.858000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:32.859974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:32.862406 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7cb40faf-e8d8-4341-bdc7-4a995c17a18c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.393347 Sep 10 21:09:32.863507 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2420/4736] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:32 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:32.874012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-68af099e-1598-45a3-a0b7-be0ed4f61051 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:32.875134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-68af099e-1598-45a3-a0b7-be0ed4f61051 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:32.886264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68af099e-1598-45a3-a0b7-be0ed4f61051 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:32.886767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68af099e-1598-45a3-a0b7-be0ed4f61051 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:32.887755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68af099e-1598-45a3-a0b7-be0ed4f61051 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:32.888753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68af099e-1598-45a3-a0b7-be0ed4f61051 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:32.889377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68af099e-1598-45a3-a0b7-be0ed4f61051 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:32.890721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68af099e-1598-45a3-a0b7-be0ed4f61051 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:33.163076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3d46636b-9ade-4dce-99ce-5016dceeb101 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:33.183798 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d46636b-9ade-4dce-99ce-5016dceeb101 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1678 microversion: 2.1 time: 1.228776 Sep 10 21:09:33.187651 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2317/4737] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:31 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1678 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:33.285316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-68af099e-1598-45a3-a0b7-be0ed4f61051 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:33.296785 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-68af099e-1598-45a3-a0b7-be0ed4f61051 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1309 microversion: 2.1 time: 0.431749 Sep 10 21:09:33.298456 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2421/4738] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:32 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1309 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:33.896141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:33.897380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:33.911578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:33.914452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:33.918815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:33.919716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:33.920292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:33.920989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:34.215841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-03a7534d-931f-4321-aadb-701109fc2703 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:34.216465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-03a7534d-931f-4321-aadb-701109fc2703 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:34.224664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03a7534d-931f-4321-aadb-701109fc2703 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:34.225163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03a7534d-931f-4321-aadb-701109fc2703 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:34.225804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03a7534d-931f-4321-aadb-701109fc2703 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:34.227130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03a7534d-931f-4321-aadb-701109fc2703 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:34.228421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03a7534d-931f-4321-aadb-701109fc2703 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:34.229199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03a7534d-931f-4321-aadb-701109fc2703 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:34.375195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:34.394518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:34.399624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:34.401776 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-114c5805-c569-485d-b6b2-1d3c36a758f2 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.511513 Sep 10 21:09:34.404524 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2318/4739] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:33 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:34.420013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-937db654-8ba5-4247-b389-287086deb265 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:34.420724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-937db654-8ba5-4247-b389-287086deb265 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:34.444137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937db654-8ba5-4247-b389-287086deb265 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:34.446662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937db654-8ba5-4247-b389-287086deb265 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:34.448075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937db654-8ba5-4247-b389-287086deb265 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:34.450474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937db654-8ba5-4247-b389-287086deb265 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:34.451370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937db654-8ba5-4247-b389-287086deb265 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:34.455567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937db654-8ba5-4247-b389-287086deb265 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:34.718219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-03a7534d-931f-4321-aadb-701109fc2703 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:34.737441 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-03a7534d-931f-4321-aadb-701109fc2703 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1678 microversion: 2.1 time: 0.522905 Sep 10 21:09:34.743562 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2422/4740] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:34 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1678 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:34.760107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1755154605", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05daa8b2-a600-4c08-8c3a-78652e8f4ca4"}], "security_groups": [{"name": "tempest-securitygroup--864172932"}], "key_name": "tempest-keypair-183368343", "user_data": "}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:34.953955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] validate_networks() for [('05daa8b2-a600-4c08-8c3a-78652e8f4ca4', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:09:34.986351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-937db654-8ba5-4247-b389-287086deb265 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:34.996027 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-937db654-8ba5-4247-b389-287086deb265 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1309 microversion: 2.1 time: 0.588986 Sep 10 21:09:35.002126 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2319/4741] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:34 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1309 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:35.436645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:35.438156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:35.446752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:35.447857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:35.448526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:35.449471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:35.450182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:35.450876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:35.873173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:35.891279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:35.893234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:35.894664 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9a051744-8fd8-4d22-8b16-5ef995b8d38f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.462529 Sep 10 21:09:35.895406 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2320/4742] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:35 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:35.900669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2470f8b-64b4-468b-be12-805b8cde991f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:35.901609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c2470f8b-64b4-468b-be12-805b8cde991f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:35.908259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2470f8b-64b4-468b-be12-805b8cde991f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:35.908761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2470f8b-64b4-468b-be12-805b8cde991f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:35.909202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2470f8b-64b4-468b-be12-805b8cde991f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:35.910445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2470f8b-64b4-468b-be12-805b8cde991f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:35.911131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2470f8b-64b4-468b-be12-805b8cde991f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:35.911728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2470f8b-64b4-468b-be12-805b8cde991f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:36.089906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c2470f8b-64b4-468b-be12-805b8cde991f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:36.103986 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c2470f8b-64b4-468b-be12-805b8cde991f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1678 microversion: 2.1 time: 0.207125 Sep 10 21:09:36.104822 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2321/4743] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:35 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:36.127053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-68effb04-b30b-4d4e-a89e-25360fe851ba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:36.127857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-68effb04-b30b-4d4e-a89e-25360fe851ba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:36.134983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68effb04-b30b-4d4e-a89e-25360fe851ba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:36.136407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68effb04-b30b-4d4e-a89e-25360fe851ba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:36.137213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68effb04-b30b-4d4e-a89e-25360fe851ba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:36.138031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68effb04-b30b-4d4e-a89e-25360fe851ba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:36.138565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68effb04-b30b-4d4e-a89e-25360fe851ba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:36.139065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68effb04-b30b-4d4e-a89e-25360fe851ba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:36.219373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:09:36.220541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:09:36.221448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:09:36.222018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:09:36.222673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:09:36.240341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:36.242679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:36.243563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:36.254284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:36.255162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:36.255844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:36.308779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:09:36.318281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for user 54dcc78ee39c4119b08023d3cc692d6b and project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:09:36.342302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:09:36.345981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:09:36.407162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-68effb04-b30b-4d4e-a89e-25360fe851ba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:36.417051 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-68effb04-b30b-4d4e-a89e-25360fe851ba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1309 microversion: 2.1 time: 0.301844 Sep 10 21:09:36.418279 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2322/4744] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:36 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:36.429066 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2183a4d0-41af-4b82-bbbd-89ec60d54c0e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.682673 Sep 10 21:09:36.437147 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2423/4745] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:09:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:09:36.457918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c9b99ad0-0d7b-4d58-819b-e5ff17f8c8cc tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:36.459966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c9b99ad0-0d7b-4d58-819b-e5ff17f8c8cc tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:36.552627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c9b99ad0-0d7b-4d58-819b-e5ff17f8c8cc tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:36.561276 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c9b99ad0-0d7b-4d58-819b-e5ff17f8c8cc tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1241 microversion: 2.1 time: 0.116598 Sep 10 21:09:36.562669 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2323/4746] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:36 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:36.925956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:36.926576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:36.934562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:36.941895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:36.942439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:36.944627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:36.945543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:36.947419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:37.134831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-36d62c0d-244f-449b-8bb4-e143c802d92a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:37.135735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-36d62c0d-244f-449b-8bb4-e143c802d92a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:37.156737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36d62c0d-244f-449b-8bb4-e143c802d92a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:37.157465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36d62c0d-244f-449b-8bb4-e143c802d92a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:37.158384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36d62c0d-244f-449b-8bb4-e143c802d92a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:37.159473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36d62c0d-244f-449b-8bb4-e143c802d92a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:37.160022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36d62c0d-244f-449b-8bb4-e143c802d92a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:37.160723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-36d62c0d-244f-449b-8bb4-e143c802d92a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:37.389298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:37.399892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:37.401403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:37.402626 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8a336f18-b848-49e6-8258-6b528e0ed1ec tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.482278 Sep 10 21:09:37.403200 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2424/4747] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:36 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:37.438125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-36d62c0d-244f-449b-8bb4-e143c802d92a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:37.440662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7ddd3e66-20f5-4e31-8357-e5d58032821e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:37.440662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7ddd3e66-20f5-4e31-8357-e5d58032821e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:37.448593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ddd3e66-20f5-4e31-8357-e5d58032821e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:37.449094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ddd3e66-20f5-4e31-8357-e5d58032821e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:37.449382 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-36d62c0d-244f-449b-8bb4-e143c802d92a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1678 microversion: 2.1 time: 0.322513 Sep 10 21:09:37.449533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ddd3e66-20f5-4e31-8357-e5d58032821e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:37.450274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ddd3e66-20f5-4e31-8357-e5d58032821e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:37.450867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ddd3e66-20f5-4e31-8357-e5d58032821e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:37.451165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ddd3e66-20f5-4e31-8357-e5d58032821e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:37.451663 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2324/4748] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:37 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1678 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:37.587281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9f1031e5-68b7-437e-8df1-e95365a15afe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:37.588641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9f1031e5-68b7-437e-8df1-e95365a15afe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:37.604790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f1031e5-68b7-437e-8df1-e95365a15afe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:37.605564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f1031e5-68b7-437e-8df1-e95365a15afe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:37.607698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f1031e5-68b7-437e-8df1-e95365a15afe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:37.608653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f1031e5-68b7-437e-8df1-e95365a15afe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:37.611606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f1031e5-68b7-437e-8df1-e95365a15afe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:37.613381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f1031e5-68b7-437e-8df1-e95365a15afe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:37.793085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7ddd3e66-20f5-4e31-8357-e5d58032821e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:37.807361 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7ddd3e66-20f5-4e31-8357-e5d58032821e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1309 microversion: 2.1 time: 0.371235 Sep 10 21:09:37.819688 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2425/4749] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:37 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:37.841771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-aa3265a0-7fb5-4c06-b0ff-f3b6cf618024 req-4a49959a-0f4c-4ff2-8a59-d5b89524be31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655a20ea-1e07-43d1-9e43-f68fe3ba3473", "name": "network-vif-plugged", "status": "completed", "tag": "ea1fa814-846c-4364-87da-7ba82cb5674b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:37.850627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9f1031e5-68b7-437e-8df1-e95365a15afe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:37.862495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa3265a0-7fb5-4c06-b0ff-f3b6cf618024 req-4a49959a-0f4c-4ff2-8a59-d5b89524be31 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:37.863292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa3265a0-7fb5-4c06-b0ff-f3b6cf618024 req-4a49959a-0f4c-4ff2-8a59-d5b89524be31 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:37.863965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-aa3265a0-7fb5-4c06-b0ff-f3b6cf618024 req-4a49959a-0f4c-4ff2-8a59-d5b89524be31 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:37.864131 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9f1031e5-68b7-437e-8df1-e95365a15afe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1237 microversion: 2.1 time: 0.281812 Sep 10 21:09:37.866142 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2325/4750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:37 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1237 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:37.904324 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-aa3265a0-7fb5-4c06-b0ff-f3b6cf618024 req-4a49959a-0f4c-4ff2-8a59-d5b89524be31 service nova] Creating event network-vif-plugged:ea1fa814-846c-4364-87da-7ba82cb5674b for instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 on nch1-master-1 Sep 10 21:09:37.911009 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-aa3265a0-7fb5-4c06-b0ff-f3b6cf618024 req-4a49959a-0f4c-4ff2-8a59-d5b89524be31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088920 Sep 10 21:09:37.911997 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2426/4751] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:38.430838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:38.431764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:38.448731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:38.449247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:38.456006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:38.457002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:38.457685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:38.458320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:38.476349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9cc81700-3827-4ab4-a344-596f9cbcdf53 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:38.477312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9cc81700-3827-4ab4-a344-596f9cbcdf53 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:38.492257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cc81700-3827-4ab4-a344-596f9cbcdf53 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:38.492828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cc81700-3827-4ab4-a344-596f9cbcdf53 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:38.495750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cc81700-3827-4ab4-a344-596f9cbcdf53 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:38.499205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cc81700-3827-4ab4-a344-596f9cbcdf53 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:38.499711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cc81700-3827-4ab4-a344-596f9cbcdf53 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:38.503606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cc81700-3827-4ab4-a344-596f9cbcdf53 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:38.793112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:38.807268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:38.808732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:38.810047 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-87b76d4b-1c92-4189-b511-16f56671e87a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.383221 Sep 10 21:09:38.810624 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2326/4752] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:38 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:38.841932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9cc81700-3827-4ab4-a344-596f9cbcdf53 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:38.857712 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9cc81700-3827-4ab4-a344-596f9cbcdf53 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1678 microversion: 2.1 time: 0.384204 Sep 10 21:09:38.861990 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2427/4753] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:38 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1678 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:38.863388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6ece7b38-1dee-456d-b97e-854e101c187d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:38.864524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6ece7b38-1dee-456d-b97e-854e101c187d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:38.873096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ece7b38-1dee-456d-b97e-854e101c187d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:38.874208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ece7b38-1dee-456d-b97e-854e101c187d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:38.874978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ece7b38-1dee-456d-b97e-854e101c187d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:38.877910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ece7b38-1dee-456d-b97e-854e101c187d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:38.878945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ece7b38-1dee-456d-b97e-854e101c187d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:38.879615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ece7b38-1dee-456d-b97e-854e101c187d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:38.892122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc3db783-0073-4160-a7c4-9a1de964f7d6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:38.893250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fc3db783-0073-4160-a7c4-9a1de964f7d6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:38.903759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc3db783-0073-4160-a7c4-9a1de964f7d6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:38.909127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc3db783-0073-4160-a7c4-9a1de964f7d6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:38.910014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc3db783-0073-4160-a7c4-9a1de964f7d6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:38.911495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc3db783-0073-4160-a7c4-9a1de964f7d6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:38.912210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc3db783-0073-4160-a7c4-9a1de964f7d6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:38.912866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc3db783-0073-4160-a7c4-9a1de964f7d6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:39.043066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fc3db783-0073-4160-a7c4-9a1de964f7d6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:39.053369 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc3db783-0073-4160-a7c4-9a1de964f7d6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1301 microversion: 2.1 time: 0.165631 Sep 10 21:09:39.057506 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2428/4754] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:38 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1301 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:39.497064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6ece7b38-1dee-456d-b97e-854e101c187d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:39.507610 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6ece7b38-1dee-456d-b97e-854e101c187d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1309 microversion: 2.1 time: 0.655545 Sep 10 21:09:39.508227 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2327/4755] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:38 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1309 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:39.836949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:39.837572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:39.854453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:39.856018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:39.857141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:39.858776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:39.859432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:39.860038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:39.884706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4526208d-181c-4f03-bf4a-2cdad7fc45bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:39.885987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4526208d-181c-4f03-bf4a-2cdad7fc45bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:39.902650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4526208d-181c-4f03-bf4a-2cdad7fc45bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:39.903523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4526208d-181c-4f03-bf4a-2cdad7fc45bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:39.904133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4526208d-181c-4f03-bf4a-2cdad7fc45bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:39.905151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4526208d-181c-4f03-bf4a-2cdad7fc45bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:39.906783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4526208d-181c-4f03-bf4a-2cdad7fc45bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:39.910248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4526208d-181c-4f03-bf4a-2cdad7fc45bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:40.169138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4526208d-181c-4f03-bf4a-2cdad7fc45bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:40.181433 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4526208d-181c-4f03-bf4a-2cdad7fc45bd tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1678 microversion: 2.1 time: 0.300533 Sep 10 21:09:40.182708 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2328/4756] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:39 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1678 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:40.192756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d412f49c-e476-4710-9071-0b6fe657ae40 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:40.193743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d412f49c-e476-4710-9071-0b6fe657ae40 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:40.201878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d412f49c-e476-4710-9071-0b6fe657ae40 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:40.202503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d412f49c-e476-4710-9071-0b6fe657ae40 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:40.203046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d412f49c-e476-4710-9071-0b6fe657ae40 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:40.203858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d412f49c-e476-4710-9071-0b6fe657ae40 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:40.205213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d412f49c-e476-4710-9071-0b6fe657ae40 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:40.206023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d412f49c-e476-4710-9071-0b6fe657ae40 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:40.308964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:40.337015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:40.342324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:40.344066 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-993d35f9-427a-4155-9b9b-fe21d5180be6 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.511790 Sep 10 21:09:40.346287 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2429/4757] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:39 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:40.403038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d412f49c-e476-4710-9071-0b6fe657ae40 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:40.425912 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d412f49c-e476-4710-9071-0b6fe657ae40 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1299 microversion: 2.1 time: 0.234309 Sep 10 21:09:40.427357 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2329/4758] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:40 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:40.532711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-140a86f5-626e-45be-95e5-8b99501ed60f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:40.533262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-140a86f5-626e-45be-95e5-8b99501ed60f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:40.551791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140a86f5-626e-45be-95e5-8b99501ed60f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:40.553432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140a86f5-626e-45be-95e5-8b99501ed60f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:40.554264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140a86f5-626e-45be-95e5-8b99501ed60f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:40.555373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140a86f5-626e-45be-95e5-8b99501ed60f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:40.556606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140a86f5-626e-45be-95e5-8b99501ed60f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:40.557742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-140a86f5-626e-45be-95e5-8b99501ed60f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:41.207367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bbe445e3-39a5-4c39-b38d-c5d016a1d242 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:41.211786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bbe445e3-39a5-4c39-b38d-c5d016a1d242 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:41.214626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=76 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:41.225404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bbe445e3-39a5-4c39-b38d-c5d016a1d242 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:41.225978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bbe445e3-39a5-4c39-b38d-c5d016a1d242 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:41.226604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bbe445e3-39a5-4c39-b38d-c5d016a1d242 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:41.227884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bbe445e3-39a5-4c39-b38d-c5d016a1d242 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:41.228631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bbe445e3-39a5-4c39-b38d-c5d016a1d242 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:41.229290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bbe445e3-39a5-4c39-b38d-c5d016a1d242 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:41.527110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-140a86f5-626e-45be-95e5-8b99501ed60f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:41.539221 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-140a86f5-626e-45be-95e5-8b99501ed60f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1489 microversion: 2.1 time: 1.010288 Sep 10 21:09:41.539876 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2430/4759] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:40 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1489 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:41.561813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:41.562906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:41.572720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:41.573591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:41.574295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:41.575387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:41.576226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:41.576896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:41.888164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bbe445e3-39a5-4c39-b38d-c5d016a1d242 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:41.906727 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bbe445e3-39a5-4c39-b38d-c5d016a1d242 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1655 microversion: 2.1 time: 0.703496 Sep 10 21:09:41.908098 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2330/4760] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:41 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1655 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:41.917618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4e1d17ab-701e-4ced-975f-c972c3633c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:41.919613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4e1d17ab-701e-4ced-975f-c972c3633c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:41.932533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e1d17ab-701e-4ced-975f-c972c3633c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:41.933457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e1d17ab-701e-4ced-975f-c972c3633c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:41.934253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e1d17ab-701e-4ced-975f-c972c3633c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:41.935718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e1d17ab-701e-4ced-975f-c972c3633c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:41.936340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e1d17ab-701e-4ced-975f-c972c3633c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:41.936926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e1d17ab-701e-4ced-975f-c972c3633c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:42.026602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:42.039150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:42.040764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:42.042001 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-74ba1ff4-9553-4a46-9d6c-cbf281d40fac tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.500194 Sep 10 21:09:42.043225 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2431/4761] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:41 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:42.050279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-31765f16-6772-4f1f-899f-8e43899e0f05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:42.054835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-31765f16-6772-4f1f-899f-8e43899e0f05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:42.065274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31765f16-6772-4f1f-899f-8e43899e0f05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:42.066327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31765f16-6772-4f1f-899f-8e43899e0f05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:42.071685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31765f16-6772-4f1f-899f-8e43899e0f05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:42.072574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31765f16-6772-4f1f-899f-8e43899e0f05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:42.073040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31765f16-6772-4f1f-899f-8e43899e0f05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:42.073482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31765f16-6772-4f1f-899f-8e43899e0f05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:42.215352 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-31765f16-6772-4f1f-899f-8e43899e0f05 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "PUT /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1084 microversion: 2.1 time: 0.171086 Sep 10 21:09:42.221876 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2432/4762] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Sep 10 21:09:42 2022] PUT /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1084 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:42.234957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-30f2050b-6f49-45d7-b496-01bcb5aa5337 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:42.241402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30f2050b-6f49-45d7-b496-01bcb5aa5337 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:42.241942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30f2050b-6f49-45d7-b496-01bcb5aa5337 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:42.242777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30f2050b-6f49-45d7-b496-01bcb5aa5337 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:42.275331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-30f2050b-6f49-45d7-b496-01bcb5aa5337 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Going to try to start instance {{(pid=145772) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 21:09:42.359722 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-30f2050b-6f49-45d7-b496-01bcb5aa5337 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/action" status: 202 len: 0 microversion: 2.1 time: 0.127962 Sep 10 21:09:42.364905 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2433/4763] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:09:42 2022] POST /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:09:42.373051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-74051c3f-f44b-4588-a479-ff65819523d0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:42.375549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-74051c3f-f44b-4588-a479-ff65819523d0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:42.386629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74051c3f-f44b-4588-a479-ff65819523d0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:42.387430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74051c3f-f44b-4588-a479-ff65819523d0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:42.388694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74051c3f-f44b-4588-a479-ff65819523d0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:42.390140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74051c3f-f44b-4588-a479-ff65819523d0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:42.390902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74051c3f-f44b-4588-a479-ff65819523d0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:42.392134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74051c3f-f44b-4588-a479-ff65819523d0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:42.472982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e1d17ab-701e-4ced-975f-c972c3633c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:42.491735 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4e1d17ab-701e-4ced-975f-c972c3633c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.576286 Sep 10 21:09:42.492520 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2331/4764] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:41 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:42.506487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b5ed10f3-f957-434f-88c9-e7fbb0f93a0c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:42.507232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b5ed10f3-f957-434f-88c9-e7fbb0f93a0c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:42.519734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ed10f3-f957-434f-88c9-e7fbb0f93a0c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:42.520252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ed10f3-f957-434f-88c9-e7fbb0f93a0c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:42.520700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ed10f3-f957-434f-88c9-e7fbb0f93a0c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:42.521421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ed10f3-f957-434f-88c9-e7fbb0f93a0c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:42.529118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ed10f3-f957-434f-88c9-e7fbb0f93a0c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:42.529664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5ed10f3-f957-434f-88c9-e7fbb0f93a0c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:42.831545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b5ed10f3-f957-434f-88c9-e7fbb0f93a0c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:42.847017 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b5ed10f3-f957-434f-88c9-e7fbb0f93a0c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1664 microversion: 2.1 time: 0.353240 Sep 10 21:09:42.847866 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2332/4765] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:42 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1664 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:42.922001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-74051c3f-f44b-4588-a479-ff65819523d0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:42.929593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:42.942706 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-74051c3f-f44b-4588-a479-ff65819523d0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1510 microversion: 2.1 time: 0.567308 Sep 10 21:09:42.957892 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2434/4766] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:42 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1510 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:42.976590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4cdab139-94f3-45b4-b15a-38c11c2bfa1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:42.978102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4cdab139-94f3-45b4-b15a-38c11c2bfa1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:42.998281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cdab139-94f3-45b4-b15a-38c11c2bfa1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:42.998799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cdab139-94f3-45b4-b15a-38c11c2bfa1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:43.001786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cdab139-94f3-45b4-b15a-38c11c2bfa1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:43.003558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cdab139-94f3-45b4-b15a-38c11c2bfa1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:43.008510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cdab139-94f3-45b4-b15a-38c11c2bfa1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:43.009025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cdab139-94f3-45b4-b15a-38c11c2bfa1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:43.058660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:43.076505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:43.077202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:43.090658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:43.093955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:43.095862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:43.097739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:43.099730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:43.100393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:43.463706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4cdab139-94f3-45b4-b15a-38c11c2bfa1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:43.478145 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4cdab139-94f3-45b4-b15a-38c11c2bfa1e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1510 microversion: 2.1 time: 0.508791 Sep 10 21:09:43.479059 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2333/4767] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:42 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1510 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:43.487472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-7d5ade5a-05e7-4ba8-acc2-37d187c24126 req-1d262b67-64fa-419c-b47f-04d1d20c8d79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7693b5b-858c-4224-93a8-e07f29b30646", "tag": "498021c7-c910-46d0-97a2-7bd480886623"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:43.508102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7d5ade5a-05e7-4ba8-acc2-37d187c24126 req-1d262b67-64fa-419c-b47f-04d1d20c8d79 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:43.508603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7d5ade5a-05e7-4ba8-acc2-37d187c24126 req-1d262b67-64fa-419c-b47f-04d1d20c8d79 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:43.509036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7d5ade5a-05e7-4ba8-acc2-37d187c24126 req-1d262b67-64fa-419c-b47f-04d1d20c8d79 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:43.560581 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7d5ade5a-05e7-4ba8-acc2-37d187c24126 req-1d262b67-64fa-419c-b47f-04d1d20c8d79 service nova] Creating event network-changed:498021c7-c910-46d0-97a2-7bd480886623 for instance d7693b5b-858c-4224-93a8-e07f29b30646 on nch1-master-1 Sep 10 21:09:43.583321 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-7d5ade5a-05e7-4ba8-acc2-37d187c24126 req-1d262b67-64fa-419c-b47f-04d1d20c8d79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102779 Sep 10 21:09:43.583788 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2334/4768] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:43.610860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f9bac10-9de6-4c12-9ccd-197a945007b0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:43.613108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f9bac10-9de6-4c12-9ccd-197a945007b0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:43.628142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f9bac10-9de6-4c12-9ccd-197a945007b0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:43.630244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f9bac10-9de6-4c12-9ccd-197a945007b0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:43.632261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f9bac10-9de6-4c12-9ccd-197a945007b0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:43.633717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f9bac10-9de6-4c12-9ccd-197a945007b0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:43.636113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f9bac10-9de6-4c12-9ccd-197a945007b0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:43.637235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f9bac10-9de6-4c12-9ccd-197a945007b0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:43.714800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f9bac10-9de6-4c12-9ccd-197a945007b0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:09:43.796595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:43.814206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:43.819306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:43.822223 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-219a8a32-a446-4562-9a81-fca52071961a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.752094 Sep 10 21:09:43.825780 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2435/4769] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:43 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:43.843090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f33d8231-fcaf-4fa4-b757-9c3c0b36326e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:43.844035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f33d8231-fcaf-4fa4-b757-9c3c0b36326e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:43.859937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f33d8231-fcaf-4fa4-b757-9c3c0b36326e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:43.860703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f33d8231-fcaf-4fa4-b757-9c3c0b36326e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:43.861405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f33d8231-fcaf-4fa4-b757-9c3c0b36326e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:43.863419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f33d8231-fcaf-4fa4-b757-9c3c0b36326e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:43.864113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f33d8231-fcaf-4fa4-b757-9c3c0b36326e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:43.864710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f33d8231-fcaf-4fa4-b757-9c3c0b36326e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:44.396539 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f9bac10-9de6-4c12-9ccd-197a945007b0 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 204 len: 0 microversion: 2.1 time: 0.801419 Sep 10 21:09:44.398391 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2335/4770] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:09:43 2022] DELETE /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:09:44.406717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-69089e5b-2702-4f2e-a3cb-70b93402c4df tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:44.408176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-69089e5b-2702-4f2e-a3cb-70b93402c4df tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:44.416697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69089e5b-2702-4f2e-a3cb-70b93402c4df tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:44.417275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69089e5b-2702-4f2e-a3cb-70b93402c4df tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:44.419156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69089e5b-2702-4f2e-a3cb-70b93402c4df tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:44.419916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69089e5b-2702-4f2e-a3cb-70b93402c4df tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:44.420437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69089e5b-2702-4f2e-a3cb-70b93402c4df tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:44.421174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69089e5b-2702-4f2e-a3cb-70b93402c4df tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:44.544780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f33d8231-fcaf-4fa4-b757-9c3c0b36326e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:44.556159 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f33d8231-fcaf-4fa4-b757-9c3c0b36326e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.727135 Sep 10 21:09:44.560382 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2436/4771] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:43 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:44.571398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6f0d0047-a805-4667-acad-4834c214a15e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:44.572028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6f0d0047-a805-4667-acad-4834c214a15e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:44.590921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f0d0047-a805-4667-acad-4834c214a15e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:44.591442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f0d0047-a805-4667-acad-4834c214a15e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:44.591898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f0d0047-a805-4667-acad-4834c214a15e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:44.594196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f0d0047-a805-4667-acad-4834c214a15e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:44.596960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f0d0047-a805-4667-acad-4834c214a15e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:44.597890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f0d0047-a805-4667-acad-4834c214a15e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:44.828124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-69089e5b-2702-4f2e-a3cb-70b93402c4df tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:44.837109 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-69089e5b-2702-4f2e-a3cb-70b93402c4df tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1664 microversion: 2.1 time: 0.437364 Sep 10 21:09:44.840658 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2336/4772] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:44 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1664 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:44.855511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:44.856970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:44.874558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:44.875303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:44.876490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:44.878878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:44.880521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:44.882028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:45.287802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6f0d0047-a805-4667-acad-4834c214a15e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:45.288172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:45.302484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:45.303224 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6f0d0047-a805-4667-acad-4834c214a15e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1516 microversion: 2.1 time: 0.739834 Sep 10 21:09:45.303995 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2437/4773] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:44 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1516 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:45.304987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:45.324030 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae5017c6-6d3b-44c0-801b-16622d6b67c4 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.472926 Sep 10 21:09:45.325282 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2337/4774] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:44 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:45.588492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c416c9cd-0c8a-4ddc-a363-1c84a80172ec tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:45.590173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c416c9cd-0c8a-4ddc-a363-1c84a80172ec tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:45.619519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c416c9cd-0c8a-4ddc-a363-1c84a80172ec tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:45.620074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c416c9cd-0c8a-4ddc-a363-1c84a80172ec tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:45.620828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c416c9cd-0c8a-4ddc-a363-1c84a80172ec tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:45.621752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c416c9cd-0c8a-4ddc-a363-1c84a80172ec tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:45.622301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c416c9cd-0c8a-4ddc-a363-1c84a80172ec tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:45.623217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c416c9cd-0c8a-4ddc-a363-1c84a80172ec tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:45.863167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-adbec7e7-e6c7-4ddd-ac31-2798b77ecad1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:45.863922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-adbec7e7-e6c7-4ddd-ac31-2798b77ecad1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:45.879892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adbec7e7-e6c7-4ddd-ac31-2798b77ecad1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:45.880799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adbec7e7-e6c7-4ddd-ac31-2798b77ecad1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:45.881418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adbec7e7-e6c7-4ddd-ac31-2798b77ecad1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:45.882185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adbec7e7-e6c7-4ddd-ac31-2798b77ecad1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:45.882816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adbec7e7-e6c7-4ddd-ac31-2798b77ecad1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:45.883249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adbec7e7-e6c7-4ddd-ac31-2798b77ecad1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:45.983108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c416c9cd-0c8a-4ddc-a363-1c84a80172ec tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:45.991890 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c416c9cd-0c8a-4ddc-a363-1c84a80172ec tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.410397 Sep 10 21:09:45.992486 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2438/4775] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:45 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:46.206883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-adbec7e7-e6c7-4ddd-ac31-2798b77ecad1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:46.220172 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-adbec7e7-e6c7-4ddd-ac31-2798b77ecad1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1664 microversion: 2.1 time: 0.360209 Sep 10 21:09:46.222144 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2338/4776] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:45 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1664 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:46.334308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21cb787e-7655-4e46-a0c3-4480ada5f358 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:46.335248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21cb787e-7655-4e46-a0c3-4480ada5f358 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:46.355009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:46.355978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:46.365020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:46.371876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=10 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:46.378765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21cb787e-7655-4e46-a0c3-4480ada5f358 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:46.379588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21cb787e-7655-4e46-a0c3-4480ada5f358 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:46.380247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21cb787e-7655-4e46-a0c3-4480ada5f358 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:46.380593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:46.381659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:46.382502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21cb787e-7655-4e46-a0c3-4480ada5f358 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:46.383801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21cb787e-7655-4e46-a0c3-4480ada5f358 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:46.384580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:46.385529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:46.386324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21cb787e-7655-4e46-a0c3-4480ada5f358 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:46.387768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:46.389313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:46.561449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:46.790244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-21cb787e-7655-4e46-a0c3-4480ada5f358 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:46.798810 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21cb787e-7655-4e46-a0c3-4480ada5f358 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1516 microversion: 2.1 time: 0.471820 Sep 10 21:09:46.801957 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2439/4777] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:46 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1516 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:46.874803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:46.885295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:46.888870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:46.890315 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-569d6613-c8ca-4efc-8dcd-5b72b471dedc tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.540421 Sep 10 21:09:46.905850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2339/4778] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:46 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:47.021968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-66dffe06-4a80-4b1d-8485-4cef7fefaf93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:47.022750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-66dffe06-4a80-4b1d-8485-4cef7fefaf93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:47.035407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66dffe06-4a80-4b1d-8485-4cef7fefaf93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:47.036437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66dffe06-4a80-4b1d-8485-4cef7fefaf93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:47.037462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66dffe06-4a80-4b1d-8485-4cef7fefaf93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:47.039304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66dffe06-4a80-4b1d-8485-4cef7fefaf93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:47.039982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66dffe06-4a80-4b1d-8485-4cef7fefaf93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:47.040511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66dffe06-4a80-4b1d-8485-4cef7fefaf93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:47.249422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-48062f61-71d2-40dc-a5a3-bd1785914468 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:47.250390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-48062f61-71d2-40dc-a5a3-bd1785914468 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:47.268834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48062f61-71d2-40dc-a5a3-bd1785914468 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:47.273118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48062f61-71d2-40dc-a5a3-bd1785914468 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:47.273575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48062f61-71d2-40dc-a5a3-bd1785914468 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:47.274632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48062f61-71d2-40dc-a5a3-bd1785914468 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:47.276463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48062f61-71d2-40dc-a5a3-bd1785914468 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:47.277069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48062f61-71d2-40dc-a5a3-bd1785914468 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:47.316411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-66dffe06-4a80-4b1d-8485-4cef7fefaf93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:47.327590 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-66dffe06-4a80-4b1d-8485-4cef7fefaf93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.313350 Sep 10 21:09:47.329552 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2440/4779] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:47 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:47.475940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-48062f61-71d2-40dc-a5a3-bd1785914468 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:47.488655 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-48062f61-71d2-40dc-a5a3-bd1785914468 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1664 microversion: 2.1 time: 0.246235 Sep 10 21:09:47.489659 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2340/4780] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:47 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1664 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:47.826809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e34e2eb2-0be3-4f52-8fc5-5a73e21a5724 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:47.827721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e34e2eb2-0be3-4f52-8fc5-5a73e21a5724 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:47.835567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34e2eb2-0be3-4f52-8fc5-5a73e21a5724 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:47.836174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34e2eb2-0be3-4f52-8fc5-5a73e21a5724 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:47.836717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34e2eb2-0be3-4f52-8fc5-5a73e21a5724 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:47.837564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34e2eb2-0be3-4f52-8fc5-5a73e21a5724 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:47.838152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34e2eb2-0be3-4f52-8fc5-5a73e21a5724 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:47.838700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e34e2eb2-0be3-4f52-8fc5-5a73e21a5724 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:47.918614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:47.920056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:47.937593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:47.938321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:47.938862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:47.939762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:47.940235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:47.940674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:48.373603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:48.389263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:48.390779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:48.392605 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2b3ee847-207f-4f6e-9b3a-69a9e699f22b tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.479338 Sep 10 21:09:48.417882 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2341/4781] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:47 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:48.417882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e9a1198f-ad72-45cf-8f3d-c5ea73dbb0e0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:48.417882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e9a1198f-ad72-45cf-8f3d-c5ea73dbb0e0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:48.440052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a1198f-ad72-45cf-8f3d-c5ea73dbb0e0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:48.440488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a1198f-ad72-45cf-8f3d-c5ea73dbb0e0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:48.440937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a1198f-ad72-45cf-8f3d-c5ea73dbb0e0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:48.441669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a1198f-ad72-45cf-8f3d-c5ea73dbb0e0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:48.442176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a1198f-ad72-45cf-8f3d-c5ea73dbb0e0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:48.442609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9a1198f-ad72-45cf-8f3d-c5ea73dbb0e0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:48.733905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e9a1198f-ad72-45cf-8f3d-c5ea73dbb0e0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:48.750475 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e9a1198f-ad72-45cf-8f3d-c5ea73dbb0e0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.338561 Sep 10 21:09:48.752323 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2342/4782] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:48 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:48.757374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6cbc3d75-c574-4b24-bc5b-e8f539180aa5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:48.758025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6cbc3d75-c574-4b24-bc5b-e8f539180aa5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:48.763148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e34e2eb2-0be3-4f52-8fc5-5a73e21a5724 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:48.811929 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e34e2eb2-0be3-4f52-8fc5-5a73e21a5724 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1516 microversion: 2.1 time: 0.957471 Sep 10 21:09:48.815259 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2441/4783] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:47 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1516 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:48.817171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cbc3d75-c574-4b24-bc5b-e8f539180aa5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:48.817967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cbc3d75-c574-4b24-bc5b-e8f539180aa5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:48.818580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cbc3d75-c574-4b24-bc5b-e8f539180aa5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:48.819470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cbc3d75-c574-4b24-bc5b-e8f539180aa5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:48.820155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cbc3d75-c574-4b24-bc5b-e8f539180aa5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:48.820740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cbc3d75-c574-4b24-bc5b-e8f539180aa5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:49.038604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6cbc3d75-c574-4b24-bc5b-e8f539180aa5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:49.046607 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6cbc3d75-c574-4b24-bc5b-e8f539180aa5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1668 microversion: 2.1 time: 0.293078 Sep 10 21:09:49.047212 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2343/4784] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:48 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1668 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:49.421232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:49.421963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:49.437236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:49.438271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:49.439045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:49.439980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:49.440646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:49.441243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:49.780197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-005e9f67-81f6-4d8a-b652-3a1098d50285 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:49.781000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-005e9f67-81f6-4d8a-b652-3a1098d50285 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:49.792513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-005e9f67-81f6-4d8a-b652-3a1098d50285 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:49.793315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-005e9f67-81f6-4d8a-b652-3a1098d50285 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:49.794047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-005e9f67-81f6-4d8a-b652-3a1098d50285 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:49.795066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-005e9f67-81f6-4d8a-b652-3a1098d50285 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:49.795770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-005e9f67-81f6-4d8a-b652-3a1098d50285 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:49.797472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-005e9f67-81f6-4d8a-b652-3a1098d50285 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:50.046002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:50.059467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:50.062867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:50.067846 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6b692e90-932c-4e33-935b-ae6b45a9a7aa tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.649667 Sep 10 21:09:50.070191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-005e9f67-81f6-4d8a-b652-3a1098d50285 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:50.081049 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-005e9f67-81f6-4d8a-b652-3a1098d50285 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.304972 Sep 10 21:09:50.082205 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2344/4785] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:49 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:50.087609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:50.088432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:50.094226 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2442/4786] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:49 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:50.097173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:50.097914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:50.098605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:50.099531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:50.100321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:50.101034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:50.107877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c1d518c1-02e3-4c3f-b8d7-8aa881c387f4 req-4a65f286-aa43-4958-870e-8571b835a307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655a20ea-1e07-43d1-9e43-f68fe3ba3473", "name": "network-vif-deleted", "tag": "ea1fa814-846c-4364-87da-7ba82cb5674b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:50.132036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c1d518c1-02e3-4c3f-b8d7-8aa881c387f4 req-4a65f286-aa43-4958-870e-8571b835a307 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:50.133147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c1d518c1-02e3-4c3f-b8d7-8aa881c387f4 req-4a65f286-aa43-4958-870e-8571b835a307 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:50.134009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c1d518c1-02e3-4c3f-b8d7-8aa881c387f4 req-4a65f286-aa43-4958-870e-8571b835a307 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:50.145856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:50.146645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:50.147447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:50.148073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lazy-loading 'fault' on Instance uuid 655a20ea-1e07-43d1-9e43-f68fe3ba3473 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:09:50.158516 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c1d518c1-02e3-4c3f-b8d7-8aa881c387f4 req-4a65f286-aa43-4958-870e-8571b835a307 service nova] Creating event network-vif-deleted:ea1fa814-846c-4364-87da-7ba82cb5674b for instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 on nch1-master-1 Sep 10 21:09:50.173772 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c1d518c1-02e3-4c3f-b8d7-8aa881c387f4 req-4a65f286-aa43-4958-870e-8571b835a307 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077097 Sep 10 21:09:50.175614 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2443/4787] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:50.286244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:50.295963 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9aaf330c-0034-4a40-b73a-4aa64cefdc69 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 200 len: 1320 microversion: 2.1 time: 0.212307 Sep 10 21:09:50.304787 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2345/4788] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:50 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:51.108824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be5e2776-75a7-4a34-8718-edc790d1a089 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:51.110826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-be5e2776-75a7-4a34-8718-edc790d1a089 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:51.114907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:51.116538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:51.129072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:51.130791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be5e2776-75a7-4a34-8718-edc790d1a089 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:51.131501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:51.132126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:51.132861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:51.133536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be5e2776-75a7-4a34-8718-edc790d1a089 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:51.134212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be5e2776-75a7-4a34-8718-edc790d1a089 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:51.135117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be5e2776-75a7-4a34-8718-edc790d1a089 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:51.135799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:51.136228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:51.136879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be5e2776-75a7-4a34-8718-edc790d1a089 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:51.139102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be5e2776-75a7-4a34-8718-edc790d1a089 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:51.476031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:51.491964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:51.495998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:51.498323 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-56cd5c4d-d8c0-4b10-ad75-7eeb6f44045d tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.400829 Sep 10 21:09:51.498949 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2444/4789] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:51 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:51.511052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:51.514360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:51.526100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:51.530011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:51.531113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:51.533209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:51.534713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:51.535446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:51.536295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:51.560070 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 HTTP/1.1 Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '655a20ea-1e07-43d1-9e43-f68fe3ba3473'} Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:09:51.563492 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:09:51.570298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:09:51.570298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:09:51.570298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:09:51.570298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:09:51.570298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:09:51.570298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:09:51.573441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:09:51.574927 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e824c0f3-90ca-443f-aa25-31d56fa85644 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 404 len: 111 microversion: 2.1 time: 0.071611 Sep 10 21:09:51.576583 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2445/4790] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:51 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:09:51.753225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-276310177", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "75842dc4-d668-416f-9bad-afa9ac1ec517"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:51.808784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-be5e2776-75a7-4a34-8718-edc790d1a089 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:51.819430 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be5e2776-75a7-4a34-8718-edc790d1a089 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.714321 Sep 10 21:09:51.833989 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2346/4791] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:51 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:51.852251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] validate_networks() for [('75842dc4-d668-416f-9bad-afa9ac1ec517', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:09:52.327083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-04fbd2ee-6cc8-415e-a0e1-40643af9d3b1 req-01a18ac9-5202-4473-af9c-2aecc1538023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-plugged", "status": "completed", "tag": "dad0bc97-94ef-450b-bb75-2b4c63e2b9eb"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:52.348447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-04fbd2ee-6cc8-415e-a0e1-40643af9d3b1 req-01a18ac9-5202-4473-af9c-2aecc1538023 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:52.348944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-04fbd2ee-6cc8-415e-a0e1-40643af9d3b1 req-01a18ac9-5202-4473-af9c-2aecc1538023 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:52.349390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-04fbd2ee-6cc8-415e-a0e1-40643af9d3b1 req-01a18ac9-5202-4473-af9c-2aecc1538023 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:52.368652 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-04fbd2ee-6cc8-415e-a0e1-40643af9d3b1 req-01a18ac9-5202-4473-af9c-2aecc1538023 service nova] Creating event network-vif-plugged:dad0bc97-94ef-450b-bb75-2b4c63e2b9eb for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:52.379467 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-04fbd2ee-6cc8-415e-a0e1-40643af9d3b1 req-01a18ac9-5202-4473-af9c-2aecc1538023 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060740 Sep 10 21:09:52.380909 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2347/4792] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:52.526205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:52.526937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:52.535538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:52.536259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:52.536911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:52.538097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:52.538788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:52.539429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:52.644353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:09:52.644831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:09:52.645251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:09:52.645665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:09:52.646113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:09:52.671622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:52.673037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:52.673721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:52.675767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:52.676611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:52.677318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:52.707415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:09:52.714800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Getting quotas for user 6bfa3af0a7284bc6854f2c9c58392935 and project 27acb763ffd24512afe7ca5e1d06f031. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:09:52.737378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:09:52.741453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:09:52.825459 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c65257bd-ca9d-4621-a55b-51aad1f3d42e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076515 Sep 10 21:09:52.827430 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2446/4793] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:09:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:09:52.842756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-129259f6-f33e-4dbe-9734-1599114a7cea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:52.844139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-129259f6-f33e-4dbe-9734-1599114a7cea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:53.086385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:53.105854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:53.111235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:53.115661 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0807dc28-7011-4ad5-95fa-60923c999304 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.594676 Sep 10 21:09:53.123020 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2348/4794] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:52 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:09:53.133157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0fb5d4ce-3982-41d0-8405-e9b81b7a0a0c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:53.134793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0fb5d4ce-3982-41d0-8405-e9b81b7a0a0c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:53.151382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fb5d4ce-3982-41d0-8405-e9b81b7a0a0c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:53.151886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fb5d4ce-3982-41d0-8405-e9b81b7a0a0c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:53.152343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fb5d4ce-3982-41d0-8405-e9b81b7a0a0c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:53.153068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fb5d4ce-3982-41d0-8405-e9b81b7a0a0c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:53.153651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fb5d4ce-3982-41d0-8405-e9b81b7a0a0c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:53.154012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fb5d4ce-3982-41d0-8405-e9b81b7a0a0c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:53.173985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:53.481339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0fb5d4ce-3982-41d0-8405-e9b81b7a0a0c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:53.488130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-129259f6-f33e-4dbe-9734-1599114a7cea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:53.494319 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0fb5d4ce-3982-41d0-8405-e9b81b7a0a0c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.369456 Sep 10 21:09:53.496340 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-129259f6-f33e-4dbe-9734-1599114a7cea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1208 microversion: 2.1 time: 0.661478 Sep 10 21:09:53.497476 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2349/4795] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:53 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:53.501204 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2447/4796] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:52 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1208 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:54.156405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:54.163136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:54.173783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:54.174118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:54.174528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:54.175249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:54.175724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:54.176280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:54.409289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-513589e2-318e-47f5-befb-04db3ddbb7bc req-675de51b-8842-4fed-aed2-b828aca61300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-plugged", "status": "completed", "tag": "f5fb4882-1873-4d19-b174-8c22dc2b8ff7"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:54.440098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-513589e2-318e-47f5-befb-04db3ddbb7bc req-675de51b-8842-4fed-aed2-b828aca61300 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:54.440886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-513589e2-318e-47f5-befb-04db3ddbb7bc req-675de51b-8842-4fed-aed2-b828aca61300 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:54.441509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-513589e2-318e-47f5-befb-04db3ddbb7bc req-675de51b-8842-4fed-aed2-b828aca61300 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:54.465169 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-513589e2-318e-47f5-befb-04db3ddbb7bc req-675de51b-8842-4fed-aed2-b828aca61300 service nova] Creating event network-vif-plugged:f5fb4882-1873-4d19-b174-8c22dc2b8ff7 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:54.478888 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-513589e2-318e-47f5-befb-04db3ddbb7bc req-675de51b-8842-4fed-aed2-b828aca61300 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073771 Sep 10 21:09:54.480322 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2448/4797] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:54.493482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:54.510522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:54.512647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:54.517045 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d11d8ca1-3ee6-4eb9-9191-abcf7d58ed55 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.368183 Sep 10 21:09:54.520407 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2350/4798] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:54 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:54.525050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f76a05f-7348-4e65-a033-f0286eb426e3 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:54.526071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4f76a05f-7348-4e65-a033-f0286eb426e3 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:54.544567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f76a05f-7348-4e65-a033-f0286eb426e3 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:54.545185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f76a05f-7348-4e65-a033-f0286eb426e3 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:54.545704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f76a05f-7348-4e65-a033-f0286eb426e3 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:54.546545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f76a05f-7348-4e65-a033-f0286eb426e3 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:54.547097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f76a05f-7348-4e65-a033-f0286eb426e3 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:54.548192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f76a05f-7348-4e65-a033-f0286eb426e3 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:54.550712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8e512f42-ed02-4a67-9c8e-c8ee5847c054 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:54.551899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8e512f42-ed02-4a67-9c8e-c8ee5847c054 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:54.559469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e512f42-ed02-4a67-9c8e-c8ee5847c054 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:54.560233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e512f42-ed02-4a67-9c8e-c8ee5847c054 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:54.560965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e512f42-ed02-4a67-9c8e-c8ee5847c054 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:54.562463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e512f42-ed02-4a67-9c8e-c8ee5847c054 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:54.563226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e512f42-ed02-4a67-9c8e-c8ee5847c054 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:54.564278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e512f42-ed02-4a67-9c8e-c8ee5847c054 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:54.672917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8e512f42-ed02-4a67-9c8e-c8ee5847c054 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:54.687685 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8e512f42-ed02-4a67-9c8e-c8ee5847c054 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1268 microversion: 2.1 time: 0.142401 Sep 10 21:09:54.713935 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2351/4799] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:54 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:54.988361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4f76a05f-7348-4e65-a033-f0286eb426e3 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:55.003023 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f76a05f-7348-4e65-a033-f0286eb426e3 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.482244 Sep 10 21:09:55.014245 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2449/4800] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:54 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:55.553897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:55.554527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:55.584668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:55.585512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:55.587724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:55.588668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:55.589251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:55.590067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:55.718344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1d17d74d-d7e6-4c1e-9382-4621658d9c3b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:55.718957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1d17d74d-d7e6-4c1e-9382-4621658d9c3b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:55.773046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d17d74d-d7e6-4c1e-9382-4621658d9c3b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:55.773576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d17d74d-d7e6-4c1e-9382-4621658d9c3b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:55.774052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d17d74d-d7e6-4c1e-9382-4621658d9c3b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:55.775534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d17d74d-d7e6-4c1e-9382-4621658d9c3b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:55.776183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d17d74d-d7e6-4c1e-9382-4621658d9c3b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:55.776785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d17d74d-d7e6-4c1e-9382-4621658d9c3b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:56.289415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1d17d74d-d7e6-4c1e-9382-4621658d9c3b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:56.309676 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1d17d74d-d7e6-4c1e-9382-4621658d9c3b tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1308 microversion: 2.1 time: 0.595655 Sep 10 21:09:56.311090 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2450/4801] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:55 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1308 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:56.320368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5fcdc40-4c1c-47c9-aede-bd61b32c3dd4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:56.321122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e5fcdc40-4c1c-47c9-aede-bd61b32c3dd4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:56.339981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5fcdc40-4c1c-47c9-aede-bd61b32c3dd4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:56.340781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5fcdc40-4c1c-47c9-aede-bd61b32c3dd4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:56.341405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5fcdc40-4c1c-47c9-aede-bd61b32c3dd4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:56.342368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5fcdc40-4c1c-47c9-aede-bd61b32c3dd4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:56.343010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5fcdc40-4c1c-47c9-aede-bd61b32c3dd4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:56.343617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5fcdc40-4c1c-47c9-aede-bd61b32c3dd4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:56.485542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:56.505028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:56.510090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:56.511987 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da46f019-b16b-428f-8895-5ff4f4bb8e40 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.963525 Sep 10 21:09:56.512813 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2352/4802] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:55 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:56.552140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8ecbda60-dce3-44cc-a12e-b2ad4652f885 req-d65bc1fb-322a-4256-80fc-bf8f80821bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-plugged", "status": "completed", "tag": "1a88291c-d6d6-40cf-ab43-36feb25243a8"}, {"server_uuid": "d7693b5b-858c-4224-93a8-e07f29b30646", "name": "network-vif-plugged", "status": "completed", "tag": "498021c7-c910-46d0-97a2-7bd480886623"}, {"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-plugged", "status": "completed", "tag": "979ff401-ab19-408f-9537-0454ae9bef50"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:56.587981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8ecbda60-dce3-44cc-a12e-b2ad4652f885 req-d65bc1fb-322a-4256-80fc-bf8f80821bdf service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:56.588586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8ecbda60-dce3-44cc-a12e-b2ad4652f885 req-d65bc1fb-322a-4256-80fc-bf8f80821bdf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:56.588912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8ecbda60-dce3-44cc-a12e-b2ad4652f885 req-d65bc1fb-322a-4256-80fc-bf8f80821bdf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:56.625068 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8ecbda60-dce3-44cc-a12e-b2ad4652f885 req-d65bc1fb-322a-4256-80fc-bf8f80821bdf service nova] Creating event network-vif-plugged:1a88291c-d6d6-40cf-ab43-36feb25243a8 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:56.630295 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8ecbda60-dce3-44cc-a12e-b2ad4652f885 req-d65bc1fb-322a-4256-80fc-bf8f80821bdf service nova] Creating event network-vif-plugged:498021c7-c910-46d0-97a2-7bd480886623 for instance d7693b5b-858c-4224-93a8-e07f29b30646 on nch1-master-1 Sep 10 21:09:56.631125 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8ecbda60-dce3-44cc-a12e-b2ad4652f885 req-d65bc1fb-322a-4256-80fc-bf8f80821bdf service nova] Creating event network-vif-plugged:979ff401-ab19-408f-9537-0454ae9bef50 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:56.653725 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8ecbda60-dce3-44cc-a12e-b2ad4652f885 req-d65bc1fb-322a-4256-80fc-bf8f80821bdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.107460 Sep 10 21:09:56.655045 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2353/4803] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:09:56.737641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:56.745611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:56.746587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Searching by: {'deleted': False, 'project_id': '7f09210a6e9f45cc9619b180628ba208'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:09:56.760301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:56.767237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:56.768048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:56.769067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:56.773938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:56.774641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:56.834875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:09:56.895287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e5fcdc40-4c1c-47c9-aede-bd61b32c3dd4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:56.900858 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6ae59e2a-9ada-4b56-9ada-b9c809e21974 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.167409 Sep 10 21:09:56.902030 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2354/4804] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 21:09:56 2022] GET /compute/v2.1/servers => generated 333 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:09:56.914364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:56.928317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:56.929045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Searching by: {'deleted': False, 'project_id': '7f09210a6e9f45cc9619b180628ba208'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:09:56.932603 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5fcdc40-4c1c-47c9-aede-bd61b32c3dd4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.620224 Sep 10 21:09:56.933204 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2451/4805] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:56 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:56.953063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:56.954187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:56.968599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:56.969677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:56.970199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:56.970689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:57.049191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:09:57.179253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:57.202429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:57.203175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:57.210522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:57.342023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8553c4d-ec38-452a-a417-0ff4ca2ddb5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:57.343045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d8553c4d-ec38-452a-a417-0ff4ca2ddb5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:57.355626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8553c4d-ec38-452a-a417-0ff4ca2ddb5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:57.361419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8553c4d-ec38-452a-a417-0ff4ca2ddb5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:57.365104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8553c4d-ec38-452a-a417-0ff4ca2ddb5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:57.366224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8553c4d-ec38-452a-a417-0ff4ca2ddb5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:57.366981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8553c4d-ec38-452a-a417-0ff4ca2ddb5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:57.370757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8553c4d-ec38-452a-a417-0ff4ca2ddb5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:57.552431 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4b1308cd-69ca-411c-b07f-985272555261 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.641801 Sep 10 21:09:57.553027 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2355/4806] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 21:09:56 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:57.560037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:57.561064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:57.579122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:57.582181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:57.583270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:57.585839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:57.586832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:57.595283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:57.893636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:57.905577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:57.908274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:57.910192 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e0ab6812-09c4-4017-be3b-bfa4709d3b02 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.355250 Sep 10 21:09:57.910764 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2356/4807] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:57 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:57.915515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bb350943-7aaa-4a1e-97c2-606c5f0e1f81 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:57.926145 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bb350943-7aaa-4a1e-97c2-606c5f0e1f81 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013426 Sep 10 21:09:57.927239 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2357/4808] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Sep 10 21:09:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:57.961283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b84b3ec7-1844-482c-a62a-1080fdb95a38 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:57.962309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b84b3ec7-1844-482c-a62a-1080fdb95a38 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:57.970810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b84b3ec7-1844-482c-a62a-1080fdb95a38 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:57.971591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b84b3ec7-1844-482c-a62a-1080fdb95a38 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:57.972275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b84b3ec7-1844-482c-a62a-1080fdb95a38 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:57.973191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b84b3ec7-1844-482c-a62a-1080fdb95a38 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:57.973908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b84b3ec7-1844-482c-a62a-1080fdb95a38 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:57.974360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b84b3ec7-1844-482c-a62a-1080fdb95a38 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:57.988237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d8553c4d-ec38-452a-a417-0ff4ca2ddb5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:57.996716 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d8553c4d-ec38-452a-a417-0ff4ca2ddb5e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1308 microversion: 2.1 time: 0.658804 Sep 10 21:09:58.006225 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2452/4809] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:57 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1308 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:58.150594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b84b3ec7-1844-482c-a62a-1080fdb95a38 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:58.161185 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b84b3ec7-1844-482c-a62a-1080fdb95a38 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1366 microversion: 2.1 time: 0.205003 Sep 10 21:09:58.161887 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2358/4810] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:57 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:58.355195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5a32336c-e2eb-41ff-811f-110ae730b037 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:58.357045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a32336c-e2eb-41ff-811f-110ae730b037 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:58.371370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32336c-e2eb-41ff-811f-110ae730b037 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:58.372196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32336c-e2eb-41ff-811f-110ae730b037 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:58.372812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32336c-e2eb-41ff-811f-110ae730b037 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:58.373798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32336c-e2eb-41ff-811f-110ae730b037 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:58.374994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32336c-e2eb-41ff-811f-110ae730b037 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:58.376282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a32336c-e2eb-41ff-811f-110ae730b037 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:58.409713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a32336c-e2eb-41ff-811f-110ae730b037 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:09:58.465188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0b3de0db-781a-4246-8983-dcfd44eedb89 req-238824ef-7cb1-44d2-934f-7319c690369c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5", "tag": "b20200fb-f1fd-40bf-92c1-b9d46a58a873"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:58.480790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0b3de0db-781a-4246-8983-dcfd44eedb89 req-238824ef-7cb1-44d2-934f-7319c690369c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:58.481787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0b3de0db-781a-4246-8983-dcfd44eedb89 req-238824ef-7cb1-44d2-934f-7319c690369c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:58.482624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0b3de0db-781a-4246-8983-dcfd44eedb89 req-238824ef-7cb1-44d2-934f-7319c690369c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:58.495554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:09:58.499864 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0b3de0db-781a-4246-8983-dcfd44eedb89 req-238824ef-7cb1-44d2-934f-7319c690369c service nova] Creating event network-changed:b20200fb-f1fd-40bf-92c1-b9d46a58a873 for instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 on nch1-master-1 Sep 10 21:09:58.505064 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0b3de0db-781a-4246-8983-dcfd44eedb89 req-238824ef-7cb1-44d2-934f-7319c690369c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043519 Sep 10 21:09:58.505943 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2359/4811] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:58.554076 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5a32336c-e2eb-41ff-811f-110ae730b037 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 204 len: 0 microversion: 2.1 time: 0.203232 Sep 10 21:09:58.555986 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2453/4812] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:09:58 2022] DELETE /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:09:58.566031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a6edb5a7-882c-417f-b25e-ab8d425ae753 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:58.566897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a6edb5a7-882c-417f-b25e-ab8d425ae753 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:58.577017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6edb5a7-882c-417f-b25e-ab8d425ae753 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:58.577658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6edb5a7-882c-417f-b25e-ab8d425ae753 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:58.579249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6edb5a7-882c-417f-b25e-ab8d425ae753 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:58.580752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6edb5a7-882c-417f-b25e-ab8d425ae753 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:58.581578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6edb5a7-882c-417f-b25e-ab8d425ae753 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:58.582804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a6edb5a7-882c-417f-b25e-ab8d425ae753 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:58.738059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ab31efe9-e02e-4dd0-b138-e0a0e25165aa req-e27e2b6d-1e62-4bae-9700-af7bbfb549b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-plugged", "status": "completed", "tag": "9769a59b-2ba7-4bea-9c47-8429bd368de3"}, {"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-plugged", "status": "completed", "tag": "d889b597-182a-4d75-a4d9-b8e48cc0efb8"}, {"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-plugged", "status": "completed", "tag": "2a244a93-1742-44b5-9cca-49760a0090a8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:09:58.752815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ab31efe9-e02e-4dd0-b138-e0a0e25165aa req-e27e2b6d-1e62-4bae-9700-af7bbfb549b8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:58.753301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ab31efe9-e02e-4dd0-b138-e0a0e25165aa req-e27e2b6d-1e62-4bae-9700-af7bbfb549b8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:58.753732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ab31efe9-e02e-4dd0-b138-e0a0e25165aa req-e27e2b6d-1e62-4bae-9700-af7bbfb549b8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:58.767782 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ab31efe9-e02e-4dd0-b138-e0a0e25165aa req-e27e2b6d-1e62-4bae-9700-af7bbfb549b8 service nova] Creating event network-vif-plugged:9769a59b-2ba7-4bea-9c47-8429bd368de3 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:58.768291 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ab31efe9-e02e-4dd0-b138-e0a0e25165aa req-e27e2b6d-1e62-4bae-9700-af7bbfb549b8 service nova] Creating event network-vif-plugged:d889b597-182a-4d75-a4d9-b8e48cc0efb8 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:58.768997 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ab31efe9-e02e-4dd0-b138-e0a0e25165aa req-e27e2b6d-1e62-4bae-9700-af7bbfb549b8 service nova] Creating event network-vif-plugged:2a244a93-1742-44b5-9cca-49760a0090a8 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:09:58.775071 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ab31efe9-e02e-4dd0-b138-e0a0e25165aa req-e27e2b6d-1e62-4bae-9700-af7bbfb549b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043153 Sep 10 21:09:58.779991 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2454/4813] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:09:58.861779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a6edb5a7-882c-417f-b25e-ab8d425ae753 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:58.877204 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a6edb5a7-882c-417f-b25e-ab8d425ae753 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1701 microversion: 2.1 time: 0.315240 Sep 10 21:09:58.882239 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2360/4814] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:58 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1701 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:58.943585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:58.945958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:58.958148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:58.958878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:58.968346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:58.970191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:58.970847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:58.975927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:59.035026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5bf5b2ad-0981-4432-a11e-f691b1f33a82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:59.036171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5bf5b2ad-0981-4432-a11e-f691b1f33a82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:59.054914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bf5b2ad-0981-4432-a11e-f691b1f33a82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:59.058468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bf5b2ad-0981-4432-a11e-f691b1f33a82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:59.062624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bf5b2ad-0981-4432-a11e-f691b1f33a82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:59.063437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bf5b2ad-0981-4432-a11e-f691b1f33a82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:59.063917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bf5b2ad-0981-4432-a11e-f691b1f33a82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:59.066490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bf5b2ad-0981-4432-a11e-f691b1f33a82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:59.266879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5bf5b2ad-0981-4432-a11e-f691b1f33a82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:59.277270 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5bf5b2ad-0981-4432-a11e-f691b1f33a82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1308 microversion: 2.1 time: 0.256436 Sep 10 21:09:59.290073 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2361/4815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:59 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:09:59.290073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d98d3224-f4e6-4c24-b2ee-617268cb8906 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:59.290073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d98d3224-f4e6-4c24-b2ee-617268cb8906 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:59.295714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d98d3224-f4e6-4c24-b2ee-617268cb8906 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:59.296484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d98d3224-f4e6-4c24-b2ee-617268cb8906 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:59.297865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d98d3224-f4e6-4c24-b2ee-617268cb8906 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:59.299156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d98d3224-f4e6-4c24-b2ee-617268cb8906 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:59.299917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d98d3224-f4e6-4c24-b2ee-617268cb8906 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:59.300518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d98d3224-f4e6-4c24-b2ee-617268cb8906 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:59.521449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:59.530251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d98d3224-f4e6-4c24-b2ee-617268cb8906 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:59.534427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:59.535498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:09:59.539148 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d98d3224-f4e6-4c24-b2ee-617268cb8906 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1555 microversion: 2.1 time: 0.259950 Sep 10 21:09:59.540637 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2362/4816] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:59 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:09:59.540914 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0366e6d6-63ce-46da-9ca3-cf3cb4e32bed tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.606873 Sep 10 21:09:59.546626 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2455/4817] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:09:58 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:09:59.565846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8767c99a-e338-438d-8001-fcb283b5d7af tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:59.566534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8767c99a-e338-438d-8001-fcb283b5d7af tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:59.572842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8767c99a-e338-438d-8001-fcb283b5d7af tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:59.573341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8767c99a-e338-438d-8001-fcb283b5d7af tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:59.573867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8767c99a-e338-438d-8001-fcb283b5d7af tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:59.574929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8767c99a-e338-438d-8001-fcb283b5d7af tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:59.575397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8767c99a-e338-438d-8001-fcb283b5d7af tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:59.575886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8767c99a-e338-438d-8001-fcb283b5d7af tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:59.676888 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8767c99a-e338-438d-8001-fcb283b5d7af tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116341 Sep 10 21:09:59.677702 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2363/4818] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:09:59 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:09:59.904670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9f01d9e-e469-4936-9243-a59be7b4ad1f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:09:59.905294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f9f01d9e-e469-4936-9243-a59be7b4ad1f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:09:59.912124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9f01d9e-e469-4936-9243-a59be7b4ad1f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:59.912952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9f01d9e-e469-4936-9243-a59be7b4ad1f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:59.913636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9f01d9e-e469-4936-9243-a59be7b4ad1f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:09:59.914639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9f01d9e-e469-4936-9243-a59be7b4ad1f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:09:59.915333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9f01d9e-e469-4936-9243-a59be7b4ad1f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:09:59.916136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9f01d9e-e469-4936-9243-a59be7b4ad1f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:00.206468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f9f01d9e-e469-4936-9243-a59be7b4ad1f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:00.218082 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f9f01d9e-e469-4936-9243-a59be7b4ad1f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1701 microversion: 2.1 time: 0.316680 Sep 10 21:10:00.221059 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2456/4819] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:09:59 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1701 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:00.306510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9f5b15a0-3a32-4a26-acae-6084de4a6e82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:00.307769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9f5b15a0-3a32-4a26-acae-6084de4a6e82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:00.313883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f5b15a0-3a32-4a26-acae-6084de4a6e82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:00.314388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f5b15a0-3a32-4a26-acae-6084de4a6e82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:00.314839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f5b15a0-3a32-4a26-acae-6084de4a6e82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:00.315706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f5b15a0-3a32-4a26-acae-6084de4a6e82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:00.316445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f5b15a0-3a32-4a26-acae-6084de4a6e82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:00.317066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f5b15a0-3a32-4a26-acae-6084de4a6e82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:00.569467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:00.571196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:00.580233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:00.581028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:00.581628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:00.584059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:00.584697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:00.586824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:00.645956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9f5b15a0-3a32-4a26-acae-6084de4a6e82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:00.663408 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9f5b15a0-3a32-4a26-acae-6084de4a6e82 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1308 microversion: 2.1 time: 0.361047 Sep 10 21:10:00.664595 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2364/4820] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:00 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:00.942384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:00.982167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:00.984446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:00.988394 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e15d3db7-ff22-4edb-9c32-5b4cbf46ce7f tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1879 microversion: 2.42 time: 0.424129 Sep 10 21:10:01.013025 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2457/4821] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:10:00 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1879 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:10:01.245039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ee855eeb-ba62-436f-9036-dd2b71a5de35 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:01.246177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ee855eeb-ba62-436f-9036-dd2b71a5de35 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:01.260035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee855eeb-ba62-436f-9036-dd2b71a5de35 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:01.261888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee855eeb-ba62-436f-9036-dd2b71a5de35 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:01.265402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee855eeb-ba62-436f-9036-dd2b71a5de35 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:01.267025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee855eeb-ba62-436f-9036-dd2b71a5de35 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:01.267744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee855eeb-ba62-436f-9036-dd2b71a5de35 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:01.269333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee855eeb-ba62-436f-9036-dd2b71a5de35 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:01.413036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ee855eeb-ba62-436f-9036-dd2b71a5de35 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:01.426580 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ee855eeb-ba62-436f-9036-dd2b71a5de35 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1634 microversion: 2.1 time: 0.185731 Sep 10 21:10:01.427890 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2365/4822] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:01 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1634 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:01.689643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34378f13-2a29-4440-afc0-4777c4161a2d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:01.691000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-34378f13-2a29-4440-afc0-4777c4161a2d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:01.699886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34378f13-2a29-4440-afc0-4777c4161a2d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:01.700399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34378f13-2a29-4440-afc0-4777c4161a2d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:01.700851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34378f13-2a29-4440-afc0-4777c4161a2d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:01.701581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34378f13-2a29-4440-afc0-4777c4161a2d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:01.702081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34378f13-2a29-4440-afc0-4777c4161a2d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:01.703854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34378f13-2a29-4440-afc0-4777c4161a2d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:01.945659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-629c9c68-8d43-4002-a1f7-14c5b67f5770 req-1cd60c6d-d19f-41e5-875b-92710e533ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7693b5b-858c-4224-93a8-e07f29b30646", "tag": "498021c7-c910-46d0-97a2-7bd480886623"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:01.974392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-629c9c68-8d43-4002-a1f7-14c5b67f5770 req-1cd60c6d-d19f-41e5-875b-92710e533ff5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:01.975009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-629c9c68-8d43-4002-a1f7-14c5b67f5770 req-1cd60c6d-d19f-41e5-875b-92710e533ff5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:01.975456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-629c9c68-8d43-4002-a1f7-14c5b67f5770 req-1cd60c6d-d19f-41e5-875b-92710e533ff5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:02.018019 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-629c9c68-8d43-4002-a1f7-14c5b67f5770 req-1cd60c6d-d19f-41e5-875b-92710e533ff5 service nova] Creating event network-changed:498021c7-c910-46d0-97a2-7bd480886623 for instance d7693b5b-858c-4224-93a8-e07f29b30646 on nch1-master-1 Sep 10 21:10:02.036476 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-629c9c68-8d43-4002-a1f7-14c5b67f5770 req-1cd60c6d-d19f-41e5-875b-92710e533ff5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095306 Sep 10 21:10:02.037414 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2366/4823] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:10:02.047676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:02.050647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:02.074890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:02.075670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:02.076486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:02.077389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:02.078056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:02.079212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:02.548022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-34378f13-2a29-4440-afc0-4777c4161a2d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:02.561052 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-34378f13-2a29-4440-afc0-4777c4161a2d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1308 microversion: 2.1 time: 0.877274 Sep 10 21:10:02.573853 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2458/4824] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:01 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1308 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:02.574759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cf171f95-5687-4dc5-8ad4-d4f8ca3789bb tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:02.575571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cf171f95-5687-4dc5-8ad4-d4f8ca3789bb tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:02.590370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf171f95-5687-4dc5-8ad4-d4f8ca3789bb tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:02.591096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf171f95-5687-4dc5-8ad4-d4f8ca3789bb tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:02.591995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf171f95-5687-4dc5-8ad4-d4f8ca3789bb tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:02.592907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf171f95-5687-4dc5-8ad4-d4f8ca3789bb tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:02.594834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf171f95-5687-4dc5-8ad4-d4f8ca3789bb tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:02.595523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf171f95-5687-4dc5-8ad4-d4f8ca3789bb tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:02.691894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:02.802780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf171f95-5687-4dc5-8ad4-d4f8ca3789bb tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:02.813128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cf171f95-5687-4dc5-8ad4-d4f8ca3789bb tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1634 microversion: 2.1 time: 0.250026 Sep 10 21:10:02.813699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:02.814886 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2459/4825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:02 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1634 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:02.838529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:02.840680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:02.842493 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7e80332d-9cad-4b16-a8ed-5f8da309c90a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 2835 microversion: 2.42 time: 0.803887 Sep 10 21:10:02.843324 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2367/4826] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:10:02 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 2835 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:10:02.875117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28ba3a61-ac3d-4dce-8908-d66635aebd7a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:02.876490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-28ba3a61-ac3d-4dce-8908-d66635aebd7a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:02.883129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28ba3a61-ac3d-4dce-8908-d66635aebd7a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:02.883969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28ba3a61-ac3d-4dce-8908-d66635aebd7a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:02.884648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28ba3a61-ac3d-4dce-8908-d66635aebd7a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:02.885613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28ba3a61-ac3d-4dce-8908-d66635aebd7a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:02.886324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28ba3a61-ac3d-4dce-8908-d66635aebd7a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:02.887000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28ba3a61-ac3d-4dce-8908-d66635aebd7a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:03.122667 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-28ba3a61-ac3d-4dce-8908-d66635aebd7a tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.251644 Sep 10 21:10:03.123520 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2460/4827] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Sep 10 21:10:02 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c/os-interface => generated 1830 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:10:03.174944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d2807303-6282-4303-98f1-ef12e7ccbb07 req-cb614ad5-b49f-400d-8f9f-4af43e701b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1776376b-c1ed-4cbf-8081-67594fb9fe3d", "name": "network-vif-deleted", "tag": "b2cab9b6-2001-4850-8ae6-6171d194916f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:03.197718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d2807303-6282-4303-98f1-ef12e7ccbb07 req-cb614ad5-b49f-400d-8f9f-4af43e701b52 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:03.198257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d2807303-6282-4303-98f1-ef12e7ccbb07 req-cb614ad5-b49f-400d-8f9f-4af43e701b52 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:03.200428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d2807303-6282-4303-98f1-ef12e7ccbb07 req-cb614ad5-b49f-400d-8f9f-4af43e701b52 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:03.224016 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d2807303-6282-4303-98f1-ef12e7ccbb07 req-cb614ad5-b49f-400d-8f9f-4af43e701b52 service nova] Creating event network-vif-deleted:b2cab9b6-2001-4850-8ae6-6171d194916f for instance 1776376b-c1ed-4cbf-8081-67594fb9fe3d on nch2-master-1 Sep 10 21:10:03.229681 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d2807303-6282-4303-98f1-ef12e7ccbb07 req-cb614ad5-b49f-400d-8f9f-4af43e701b52 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058867 Sep 10 21:10:03.230994 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2368/4828] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:10:03.583364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:03.589177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3515f189-909a-4edf-a4cf-6b2522b3b633 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:03.589987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3515f189-909a-4edf-a4cf-6b2522b3b633 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:03.599587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3515f189-909a-4edf-a4cf-6b2522b3b633 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:03.603196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3515f189-909a-4edf-a4cf-6b2522b3b633 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:03.603854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3515f189-909a-4edf-a4cf-6b2522b3b633 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:03.609142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3515f189-909a-4edf-a4cf-6b2522b3b633 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:03.610836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3515f189-909a-4edf-a4cf-6b2522b3b633 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:03.612175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3515f189-909a-4edf-a4cf-6b2522b3b633 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:03.850847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:03.851418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:03.867787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:03.871803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:03.872595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:03.873678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:03.875342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:03.884760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:03.896316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:03.990077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:03.992356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:04.005578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:04.010377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lazy-loading 'fault' on Instance uuid 1776376b-c1ed-4cbf-8081-67594fb9fe3d {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:10:04.077583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3515f189-909a-4edf-a4cf-6b2522b3b633 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:04.089400 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3515f189-909a-4edf-a4cf-6b2522b3b633 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1308 microversion: 2.1 time: 0.506712 Sep 10 21:10:04.091771 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2461/4829] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:03 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:04.176563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1147de803ef34d16b39e96720b2f638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09210a6e9f45cc9619b180628ba208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:04.188820 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-657fdf2c-9ea4-4668-88d1-de72bed7c59d tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 200 len: 1359 microversion: 2.1 time: 0.353166 Sep 10 21:10:04.191061 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2369/4830] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:03 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 1359 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:05.116937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-efdbfa7a-f58d-4534-a096-bc1bbaf7c088 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:05.122141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-efdbfa7a-f58d-4534-a096-bc1bbaf7c088 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:05.138244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efdbfa7a-f58d-4534-a096-bc1bbaf7c088 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:05.138766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efdbfa7a-f58d-4534-a096-bc1bbaf7c088 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:05.139219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efdbfa7a-f58d-4534-a096-bc1bbaf7c088 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:05.140037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efdbfa7a-f58d-4534-a096-bc1bbaf7c088 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:05.140505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efdbfa7a-f58d-4534-a096-bc1bbaf7c088 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:05.152209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efdbfa7a-f58d-4534-a096-bc1bbaf7c088 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:05.218438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:05.219781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] [instance: 1776376b-c1ed-4cbf-8081-67594fb9fe3d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:05.242296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:05.243184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:05.244930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:05.247537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:05.248478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:05.249121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:05.268249 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] HTTP exception thrown: Instance 1776376b-c1ed-4cbf-8081-67594fb9fe3d could not be found. Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Request method failure captured: Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d HTTP/1.1 Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPzgch1z9mtz_FWOwPBFxdBb3pnzwikn7fbo0IiRKNHz5su2VvfiDk6fkpUiueW4C58cVHibrFlWy9w0DRJ7xH3xyeB8ZFk6AB2uRMp1E5P13CI1EkHP0DI1cEC-gzJaZ0ZiYfX-YAbMoNsZnC2lvbGXB1vLn5jkh9Okw_a_Kw99wSo Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 7f09210a6e9f45cc9619b180628ba208 Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-683733660 Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7f09210a6e9f45cc9619b180628ba208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7f09210a6e9f45cc9619b180628ba208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7f09210a6e9f45cc9619b180628ba208", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7f09210a6e9f45cc9619b180628ba208"}]}] Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-683733660 Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 7f09210a6e9f45cc9619b180628ba208 Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-683733660 Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-683733660-project Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 1147de803ef34d16b39e96720b2f638b Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-683733660-project Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 1776376b-c1ed-4cbf-8081-67594fb9fe3d could not be found. Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '1776376b-c1ed-4cbf-8081-67594fb9fe3d'} Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1776376b-c1ed-4cbf-8081-67594fb9fe3d could not be found. Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1776376b-c1ed-4cbf-8081-67594fb9fe3d could not be found. Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:05.272763 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:05.278150 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:05.278150 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:05.278150 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:05.278150 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:05.278150 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1776376b-c1ed-4cbf-8081-67594fb9fe3d could not be found. Sep 10 21:10:05.278150 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:05.280965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Returning 404 to user: Instance 1776376b-c1ed-4cbf-8081-67594fb9fe3d could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:05.282324 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d582a322-1ec3-43b3-b841-8544c56fc52f tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d" status: 404 len: 111 microversion: 2.1 time: 0.069617 Sep 10 21:10:05.286435 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2370/4831] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:05 2022] GET /compute/v2.1/servers/1776376b-c1ed-4cbf-8081-67594fb9fe3d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:05.297893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-522ec5d9-1e07-4a86-92f1-1b033f5ce522 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] Calling method '.version_select at 0x7f993fa13280>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:05.340448 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-522ec5d9-1e07-4a86-92f1-1b033f5ce522 tempest-ServersTestJSON-683733660 tempest-ServersTestJSON-683733660-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048952760" status: 202 len: 0 microversion: 2.1 time: 0.049750 Sep 10 21:10:05.341327 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2371/4832] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 21:10:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048952760 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:10:05.346819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2ed9b1ff-c58c-4f7b-9e3d-fa508569ba37 req-054bfe25-a664-4f13-884d-8d61673dc9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "tag": "d889b597-182a-4d75-a4d9-b8e48cc0efb8"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:05.360428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2ed9b1ff-c58c-4f7b-9e3d-fa508569ba37 req-054bfe25-a664-4f13-884d-8d61673dc9b2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:05.361305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2ed9b1ff-c58c-4f7b-9e3d-fa508569ba37 req-054bfe25-a664-4f13-884d-8d61673dc9b2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:05.361975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2ed9b1ff-c58c-4f7b-9e3d-fa508569ba37 req-054bfe25-a664-4f13-884d-8d61673dc9b2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:05.381658 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2ed9b1ff-c58c-4f7b-9e3d-fa508569ba37 req-054bfe25-a664-4f13-884d-8d61673dc9b2 service nova] Creating event network-changed:d889b597-182a-4d75-a4d9-b8e48cc0efb8 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:10:05.389330 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2ed9b1ff-c58c-4f7b-9e3d-fa508569ba37 req-054bfe25-a664-4f13-884d-8d61673dc9b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046746 Sep 10 21:10:05.390376 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2372/4833] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:10:05.433340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-efdbfa7a-f58d-4534-a096-bc1bbaf7c088 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:05.443533 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-efdbfa7a-f58d-4534-a096-bc1bbaf7c088 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1308 microversion: 2.1 time: 0.332176 Sep 10 21:10:05.447843 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2462/4834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:05 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:06.477436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-337bce32-c085-4f89-8ddb-7d51d5bac4c7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:06.478863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-337bce32-c085-4f89-8ddb-7d51d5bac4c7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:06.482335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:06.486765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-337bce32-c085-4f89-8ddb-7d51d5bac4c7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:06.487596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-337bce32-c085-4f89-8ddb-7d51d5bac4c7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:06.488107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-337bce32-c085-4f89-8ddb-7d51d5bac4c7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:06.488896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-337bce32-c085-4f89-8ddb-7d51d5bac4c7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:06.489663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-337bce32-c085-4f89-8ddb-7d51d5bac4c7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:06.489968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-337bce32-c085-4f89-8ddb-7d51d5bac4c7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:06.742222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-337bce32-c085-4f89-8ddb-7d51d5bac4c7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:06.751330 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-337bce32-c085-4f89-8ddb-7d51d5bac4c7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1308 microversion: 2.1 time: 0.279263 Sep 10 21:10:06.752261 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2373/4835] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:06 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:06.990839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d46a50c2-4f2a-41c4-8cbf-fad9ae9875ab req-806a6699-cbb0-4b65-bae2-5ce7a0b21267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5", "name": "network-vif-plugged", "status": "completed", "tag": "b20200fb-f1fd-40bf-92c1-b9d46a58a873"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:07.013544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d46a50c2-4f2a-41c4-8cbf-fad9ae9875ab req-806a6699-cbb0-4b65-bae2-5ce7a0b21267 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:07.014070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d46a50c2-4f2a-41c4-8cbf-fad9ae9875ab req-806a6699-cbb0-4b65-bae2-5ce7a0b21267 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:07.014511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d46a50c2-4f2a-41c4-8cbf-fad9ae9875ab req-806a6699-cbb0-4b65-bae2-5ce7a0b21267 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:07.030523 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d46a50c2-4f2a-41c4-8cbf-fad9ae9875ab req-806a6699-cbb0-4b65-bae2-5ce7a0b21267 service nova] Creating event network-vif-plugged:b20200fb-f1fd-40bf-92c1-b9d46a58a873 for instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 on nch1-master-1 Sep 10 21:10:07.053893 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d46a50c2-4f2a-41c4-8cbf-fad9ae9875ab req-806a6699-cbb0-4b65-bae2-5ce7a0b21267 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066511 Sep 10 21:10:07.056242 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2463/4836] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:10:07.775129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1625e29a-6465-4f64-aa99-55bd5d9f094f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:07.776817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1625e29a-6465-4f64-aa99-55bd5d9f094f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:07.783591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:07.784767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:07.793227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1625e29a-6465-4f64-aa99-55bd5d9f094f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:07.793888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1625e29a-6465-4f64-aa99-55bd5d9f094f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:07.795083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1625e29a-6465-4f64-aa99-55bd5d9f094f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:07.796241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1625e29a-6465-4f64-aa99-55bd5d9f094f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:07.796962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1625e29a-6465-4f64-aa99-55bd5d9f094f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:07.797477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1625e29a-6465-4f64-aa99-55bd5d9f094f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:08.345257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1625e29a-6465-4f64-aa99-55bd5d9f094f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:08.363557 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1625e29a-6465-4f64-aa99-55bd5d9f094f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1308 microversion: 2.1 time: 0.589908 Sep 10 21:10:08.366699 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2374/4837] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:07 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1308 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:09.393686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e0fbba94-4677-4f0e-a1aa-71e05b31759c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:09.395270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e0fbba94-4677-4f0e-a1aa-71e05b31759c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:09.404533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0fbba94-4677-4f0e-a1aa-71e05b31759c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:09.407288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0fbba94-4677-4f0e-a1aa-71e05b31759c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:09.411361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0fbba94-4677-4f0e-a1aa-71e05b31759c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:09.417110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0fbba94-4677-4f0e-a1aa-71e05b31759c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:09.417995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0fbba94-4677-4f0e-a1aa-71e05b31759c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:09.418698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0fbba94-4677-4f0e-a1aa-71e05b31759c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:09.668649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e0fbba94-4677-4f0e-a1aa-71e05b31759c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:09.682176 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e0fbba94-4677-4f0e-a1aa-71e05b31759c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1489 microversion: 2.1 time: 0.294185 Sep 10 21:10:09.683883 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2464/4838] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:09 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1489 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:09.706383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3257ee37-342f-435c-a1d8-ec067d518c1d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-828423841"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:09.710702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3257ee37-342f-435c-a1d8-ec067d518c1d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:09.718041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3257ee37-342f-435c-a1d8-ec067d518c1d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:09.719395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3257ee37-342f-435c-a1d8-ec067d518c1d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:09.720100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3257ee37-342f-435c-a1d8-ec067d518c1d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:09.720932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3257ee37-342f-435c-a1d8-ec067d518c1d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:09.721499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3257ee37-342f-435c-a1d8-ec067d518c1d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:09.722038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3257ee37-342f-435c-a1d8-ec067d518c1d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:09.803091 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3257ee37-342f-435c-a1d8-ec067d518c1d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "PUT /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1074 microversion: 2.1 time: 0.101285 Sep 10 21:10:09.816305 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2375/4839] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Sep 10 21:10:09 2022] PUT /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1074 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:09.826266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-20cedaa2-7cc1-49a5-bd16-16bd35650901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:09.826872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-20cedaa2-7cc1-49a5-bd16-16bd35650901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:09.834183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20cedaa2-7cc1-49a5-bd16-16bd35650901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:09.834998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20cedaa2-7cc1-49a5-bd16-16bd35650901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:09.835696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20cedaa2-7cc1-49a5-bd16-16bd35650901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:09.836631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20cedaa2-7cc1-49a5-bd16-16bd35650901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:09.837315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20cedaa2-7cc1-49a5-bd16-16bd35650901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:09.837805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20cedaa2-7cc1-49a5-bd16-16bd35650901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:10.075902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-20cedaa2-7cc1-49a5-bd16-16bd35650901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:10.086636 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-20cedaa2-7cc1-49a5-bd16-16bd35650901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1500 microversion: 2.1 time: 0.264010 Sep 10 21:10:10.087379 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2465/4840] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:09 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:10.110358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16721e11-24d0-4abf-b849-bd33e78b5fbc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:10.110982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-16721e11-24d0-4abf-b849-bd33e78b5fbc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:10.117406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16721e11-24d0-4abf-b849-bd33e78b5fbc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:10.117922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16721e11-24d0-4abf-b849-bd33e78b5fbc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:10.118553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16721e11-24d0-4abf-b849-bd33e78b5fbc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:10.119464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16721e11-24d0-4abf-b849-bd33e78b5fbc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:10.119924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16721e11-24d0-4abf-b849-bd33e78b5fbc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:10.120355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16721e11-24d0-4abf-b849-bd33e78b5fbc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:10.320379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-16721e11-24d0-4abf-b849-bd33e78b5fbc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:10.341291 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-16721e11-24d0-4abf-b849-bd33e78b5fbc tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1500 microversion: 2.1 time: 0.230607 Sep 10 21:10:10.358069 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2376/4841] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:10 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1500 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:10.373972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2969a05a-a06d-45b8-ba31-7625312ce56c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:10.382072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2969a05a-a06d-45b8-ba31-7625312ce56c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:10.386166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2969a05a-a06d-45b8-ba31-7625312ce56c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:10.387024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2969a05a-a06d-45b8-ba31-7625312ce56c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:10.464697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2969a05a-a06d-45b8-ba31-7625312ce56c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Going to try to stop instance {{(pid=145772) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 21:10:10.526736 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2969a05a-a06d-45b8-ba31-7625312ce56c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "POST /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5/action" status: 202 len: 0 microversion: 2.1 time: 0.161772 Sep 10 21:10:10.527743 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2466/4842] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:10:10 2022] POST /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:10:10.536155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8d5f137-e702-476f-96be-437e5d443b51 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:10.536700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8d5f137-e702-476f-96be-437e5d443b51 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:10.549012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8d5f137-e702-476f-96be-437e5d443b51 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:10.549930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8d5f137-e702-476f-96be-437e5d443b51 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:10.550206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8d5f137-e702-476f-96be-437e5d443b51 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:10.550781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8d5f137-e702-476f-96be-437e5d443b51 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:10.551190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8d5f137-e702-476f-96be-437e5d443b51 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:10.551782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8d5f137-e702-476f-96be-437e5d443b51 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:10.806606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8d5f137-e702-476f-96be-437e5d443b51 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:10.822127 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8d5f137-e702-476f-96be-437e5d443b51 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.290399 Sep 10 21:10:10.828776 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2377/4843] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:10 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:11.851647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0307c985-fbef-424b-9d61-a1143c8c55c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:11.852759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0307c985-fbef-424b-9d61-a1143c8c55c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:11.862452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0307c985-fbef-424b-9d61-a1143c8c55c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:11.863526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0307c985-fbef-424b-9d61-a1143c8c55c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:11.864430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0307c985-fbef-424b-9d61-a1143c8c55c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:11.865381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0307c985-fbef-424b-9d61-a1143c8c55c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:11.866092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0307c985-fbef-424b-9d61-a1143c8c55c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:11.866980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0307c985-fbef-424b-9d61-a1143c8c55c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:12.109572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0307c985-fbef-424b-9d61-a1143c8c55c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:12.121487 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0307c985-fbef-424b-9d61-a1143c8c55c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.275915 Sep 10 21:10:12.122150 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2467/4844] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:11 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:13.146164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-28bd1b58-a49d-4988-a291-259def7561c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:13.147007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-28bd1b58-a49d-4988-a291-259def7561c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:13.157104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28bd1b58-a49d-4988-a291-259def7561c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:13.158544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28bd1b58-a49d-4988-a291-259def7561c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:13.159718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28bd1b58-a49d-4988-a291-259def7561c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:13.162607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28bd1b58-a49d-4988-a291-259def7561c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:13.164941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28bd1b58-a49d-4988-a291-259def7561c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:13.165744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28bd1b58-a49d-4988-a291-259def7561c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:13.372468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28bd1b58-a49d-4988-a291-259def7561c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:13.385584 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-28bd1b58-a49d-4988-a291-259def7561c6 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.244804 Sep 10 21:10:13.386753 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2378/4845] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:13 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:14.414108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3a173458-146f-44b8-9a6c-60f0a3fc19b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:14.415506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3a173458-146f-44b8-9a6c-60f0a3fc19b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:14.430899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a173458-146f-44b8-9a6c-60f0a3fc19b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:14.431654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a173458-146f-44b8-9a6c-60f0a3fc19b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:14.432827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a173458-146f-44b8-9a6c-60f0a3fc19b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:14.433561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a173458-146f-44b8-9a6c-60f0a3fc19b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:14.434056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a173458-146f-44b8-9a6c-60f0a3fc19b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:14.434498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a173458-146f-44b8-9a6c-60f0a3fc19b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:14.747790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a173458-146f-44b8-9a6c-60f0a3fc19b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:14.760680 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3a173458-146f-44b8-9a6c-60f0a3fc19b2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.352386 Sep 10 21:10:14.768522 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2468/4846] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:14 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:15.807081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-41035e21-1f9c-4d54-958c-e7b7f5ca5788 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:15.808441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-41035e21-1f9c-4d54-958c-e7b7f5ca5788 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:15.822050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41035e21-1f9c-4d54-958c-e7b7f5ca5788 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:15.824618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41035e21-1f9c-4d54-958c-e7b7f5ca5788 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:15.825095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41035e21-1f9c-4d54-958c-e7b7f5ca5788 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:15.825945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41035e21-1f9c-4d54-958c-e7b7f5ca5788 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:15.827229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41035e21-1f9c-4d54-958c-e7b7f5ca5788 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:15.828330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-41035e21-1f9c-4d54-958c-e7b7f5ca5788 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:16.025344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-41035e21-1f9c-4d54-958c-e7b7f5ca5788 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:16.034365 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-41035e21-1f9c-4d54-958c-e7b7f5ca5788 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.250369 Sep 10 21:10:16.034943 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2379/4847] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:15 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:17.058132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ef32d5eb-8d5d-4a92-9df7-e4d4e18e00c9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:17.058971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ef32d5eb-8d5d-4a92-9df7-e4d4e18e00c9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:17.075007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef32d5eb-8d5d-4a92-9df7-e4d4e18e00c9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:17.080568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef32d5eb-8d5d-4a92-9df7-e4d4e18e00c9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:17.082314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef32d5eb-8d5d-4a92-9df7-e4d4e18e00c9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:17.083162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef32d5eb-8d5d-4a92-9df7-e4d4e18e00c9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:17.084455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef32d5eb-8d5d-4a92-9df7-e4d4e18e00c9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:17.086655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef32d5eb-8d5d-4a92-9df7-e4d4e18e00c9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:17.622839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ef32d5eb-8d5d-4a92-9df7-e4d4e18e00c9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:17.634375 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ef32d5eb-8d5d-4a92-9df7-e4d4e18e00c9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.580269 Sep 10 21:10:17.650572 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2469/4848] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:17 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:18.660856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-071b2e17-d9d3-48d8-873b-2b449d648c42 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:18.661472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-071b2e17-d9d3-48d8-873b-2b449d648c42 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:18.677950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071b2e17-d9d3-48d8-873b-2b449d648c42 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:18.680012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071b2e17-d9d3-48d8-873b-2b449d648c42 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:18.681615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071b2e17-d9d3-48d8-873b-2b449d648c42 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:18.682623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071b2e17-d9d3-48d8-873b-2b449d648c42 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:18.684515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071b2e17-d9d3-48d8-873b-2b449d648c42 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:18.687854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071b2e17-d9d3-48d8-873b-2b449d648c42 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:19.106004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-071b2e17-d9d3-48d8-873b-2b449d648c42 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:19.142143 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-071b2e17-d9d3-48d8-873b-2b449d648c42 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.485759 Sep 10 21:10:19.152518 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2380/4849] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:18 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:19.848629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb23454f-f9a3-4e29-9641-fedbff1e6f17 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'create', calling method: .version_select at 0x7f993ff2b8b0>, body: {"keypair": {"name": "tempest-keypair-1715849076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFFREvokU6+ylIga/55KmwQbBOKSb9Hzp8JRO+o20sGPP3NdcX3TQqiKfmkuTwjBWqiylW3pletqJN6n586/0FoX+JvEoVdAthBIghag1BdifqmI+6gXi10zvu0ziXJWw=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:19.866423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bb23454f-f9a3-4e29-9641-fedbff1e6f17 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for project 15a76a25754c42099c542fa13046f01b. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:10:19.875259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bb23454f-f9a3-4e29-9641-fedbff1e6f17 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for user d83b6ceb599746b394e379d52683b70c and project 15a76a25754c42099c542fa13046f01b. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:10:19.902764 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bb23454f-f9a3-4e29-9641-fedbff1e6f17 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.232887 Sep 10 21:10:19.903740 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2470/4850] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:10:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:10:20.168580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fcb4b5c3-51d9-4185-be3a-d9ae0e3bb6ee tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:20.169813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fcb4b5c3-51d9-4185-be3a-d9ae0e3bb6ee tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:20.178687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcb4b5c3-51d9-4185-be3a-d9ae0e3bb6ee tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:20.179597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcb4b5c3-51d9-4185-be3a-d9ae0e3bb6ee tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:20.180122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcb4b5c3-51d9-4185-be3a-d9ae0e3bb6ee tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:20.195166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcb4b5c3-51d9-4185-be3a-d9ae0e3bb6ee tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:20.196164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcb4b5c3-51d9-4185-be3a-d9ae0e3bb6ee tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:20.200379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcb4b5c3-51d9-4185-be3a-d9ae0e3bb6ee tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:20.398740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fcb4b5c3-51d9-4185-be3a-d9ae0e3bb6ee tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:20.407540 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fcb4b5c3-51d9-4185-be3a-d9ae0e3bb6ee tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.243733 Sep 10 21:10:20.424996 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2381/4851] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:20 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:21.432679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-79e1a7f7-693d-45d7-bfff-6900626feff1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:21.434055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-79e1a7f7-693d-45d7-bfff-6900626feff1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:21.447625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79e1a7f7-693d-45d7-bfff-6900626feff1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:21.450898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79e1a7f7-693d-45d7-bfff-6900626feff1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:21.451614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79e1a7f7-693d-45d7-bfff-6900626feff1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:21.453461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79e1a7f7-693d-45d7-bfff-6900626feff1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:21.455217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79e1a7f7-693d-45d7-bfff-6900626feff1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:21.459134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-79e1a7f7-693d-45d7-bfff-6900626feff1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:21.820511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-79e1a7f7-693d-45d7-bfff-6900626feff1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:21.826242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:21.835736 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-79e1a7f7-693d-45d7-bfff-6900626feff1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.407180 Sep 10 21:10:21.850662 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2471/4852] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:21 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:21.924845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1238651131", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22651555-9c52-45fb-b1cb-a14fc16f0427"}], "security_groups": [{"name": "tempest-securitygroup--356380766"}], "key_name": "tempest-keypair-1715849076", "user_data": "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:22.057679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] validate_networks() for [('22651555-9c52-45fb-b1cb-a14fc16f0427', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:10:22.610267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:10:22.610841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:10:22.611528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:10:22.612064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:10:22.612907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:10:22.624294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:22.625186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:22.625810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:22.626654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:22.627206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:22.627707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:22.646556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for project 15a76a25754c42099c542fa13046f01b. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:10:22.652156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for user d83b6ceb599746b394e379d52683b70c and project 15a76a25754c42099c542fa13046f01b. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:10:22.665601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:10:22.668346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:10:22.740840 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-273f0166-625a-46fb-b539-804aab8c6e59 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.821303 Sep 10 21:10:22.741418 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2382/4853] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:10:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:10:22.754644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a7cb71a8-dce0-4c2b-b904-4199e2abb59c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:22.755887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a7cb71a8-dce0-4c2b-b904-4199e2abb59c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:22.758915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:22.861197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-24dd5b55-bbad-4f47-a533-6554c66bf41a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:22.861840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-24dd5b55-bbad-4f47-a533-6554c66bf41a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:22.870987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24dd5b55-bbad-4f47-a533-6554c66bf41a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:22.871886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24dd5b55-bbad-4f47-a533-6554c66bf41a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:22.872681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24dd5b55-bbad-4f47-a533-6554c66bf41a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:22.873632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a7cb71a8-dce0-4c2b-b904-4199e2abb59c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:22.875304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24dd5b55-bbad-4f47-a533-6554c66bf41a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:22.877076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24dd5b55-bbad-4f47-a533-6554c66bf41a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:22.878284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24dd5b55-bbad-4f47-a533-6554c66bf41a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:22.882881 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a7cb71a8-dce0-4c2b-b904-4199e2abb59c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1239 microversion: 2.1 time: 0.134146 Sep 10 21:10:22.885683 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2472/4854] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:22 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1239 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:23.155760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-24dd5b55-bbad-4f47-a533-6554c66bf41a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:23.165581 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-24dd5b55-bbad-4f47-a533-6554c66bf41a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.308762 Sep 10 21:10:23.166738 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2383/4855] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:22 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:10:23.913418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-102b7600-906d-41d2-816e-c530b96eecad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:23.916088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-102b7600-906d-41d2-816e-c530b96eecad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:23.924607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-102b7600-906d-41d2-816e-c530b96eecad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:23.925098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-102b7600-906d-41d2-816e-c530b96eecad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:23.925567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-102b7600-906d-41d2-816e-c530b96eecad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:23.926892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-102b7600-906d-41d2-816e-c530b96eecad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:23.927352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-102b7600-906d-41d2-816e-c530b96eecad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:23.927960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-102b7600-906d-41d2-816e-c530b96eecad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:24.004407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-102b7600-906d-41d2-816e-c530b96eecad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:24.012769 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-102b7600-906d-41d2-816e-c530b96eecad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1291 microversion: 2.1 time: 0.110548 Sep 10 21:10:24.013685 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2473/4856] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:23 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1291 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:24.193391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cddf224d-3363-4837-8ae9-0969ab49437d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:24.194166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cddf224d-3363-4837-8ae9-0969ab49437d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:24.209575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cddf224d-3363-4837-8ae9-0969ab49437d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:24.210522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cddf224d-3363-4837-8ae9-0969ab49437d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:24.211158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cddf224d-3363-4837-8ae9-0969ab49437d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:24.212099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cddf224d-3363-4837-8ae9-0969ab49437d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:24.212891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cddf224d-3363-4837-8ae9-0969ab49437d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:24.213588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cddf224d-3363-4837-8ae9-0969ab49437d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:24.491171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cddf224d-3363-4837-8ae9-0969ab49437d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:24.503989 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cddf224d-3363-4837-8ae9-0969ab49437d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.314884 Sep 10 21:10:24.504790 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2384/4857] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:24 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:25.036783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7067bcc8-ae7d-467c-bcf6-cdf3f110e508 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:25.037322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7067bcc8-ae7d-467c-bcf6-cdf3f110e508 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:25.059075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7067bcc8-ae7d-467c-bcf6-cdf3f110e508 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:25.059601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7067bcc8-ae7d-467c-bcf6-cdf3f110e508 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:25.060064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7067bcc8-ae7d-467c-bcf6-cdf3f110e508 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:25.060808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7067bcc8-ae7d-467c-bcf6-cdf3f110e508 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:25.061281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7067bcc8-ae7d-467c-bcf6-cdf3f110e508 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:25.066454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7067bcc8-ae7d-467c-bcf6-cdf3f110e508 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:25.167013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7067bcc8-ae7d-467c-bcf6-cdf3f110e508 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:25.181867 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7067bcc8-ae7d-467c-bcf6-cdf3f110e508 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1297 microversion: 2.1 time: 0.146658 Sep 10 21:10:25.183270 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2474/4858] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:25 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1297 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:10:25.529594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-14eeda98-af24-4af7-a7df-c51233ecd58e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:25.530990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-14eeda98-af24-4af7-a7df-c51233ecd58e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:25.541790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14eeda98-af24-4af7-a7df-c51233ecd58e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:25.548578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14eeda98-af24-4af7-a7df-c51233ecd58e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:25.549516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14eeda98-af24-4af7-a7df-c51233ecd58e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:25.558196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14eeda98-af24-4af7-a7df-c51233ecd58e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:25.558996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14eeda98-af24-4af7-a7df-c51233ecd58e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:25.559633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14eeda98-af24-4af7-a7df-c51233ecd58e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:25.981762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-14eeda98-af24-4af7-a7df-c51233ecd58e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:25.993067 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-14eeda98-af24-4af7-a7df-c51233ecd58e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.467394 Sep 10 21:10:26.020520 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2385/4859] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:25 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:26.210868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-23ec866d-d713-438d-935d-e23b894c6f2d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:26.211478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-23ec866d-d713-438d-935d-e23b894c6f2d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:26.227906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ec866d-d713-438d-935d-e23b894c6f2d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:26.228770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ec866d-d713-438d-935d-e23b894c6f2d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:26.229544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ec866d-d713-438d-935d-e23b894c6f2d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:26.231012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ec866d-d713-438d-935d-e23b894c6f2d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:26.231758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ec866d-d713-438d-935d-e23b894c6f2d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:26.232609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-23ec866d-d713-438d-935d-e23b894c6f2d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:26.924986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-23ec866d-d713-438d-935d-e23b894c6f2d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:26.932769 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-23ec866d-d713-438d-935d-e23b894c6f2d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1364 microversion: 2.1 time: 0.725971 Sep 10 21:10:26.933360 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2475/4860] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:26 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1364 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:27.021386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-191f1892-ada1-44ea-8ab8-84456381b13f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:27.022090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-191f1892-ada1-44ea-8ab8-84456381b13f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:27.033614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-191f1892-ada1-44ea-8ab8-84456381b13f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:27.034145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-191f1892-ada1-44ea-8ab8-84456381b13f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:27.034585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-191f1892-ada1-44ea-8ab8-84456381b13f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:27.035472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-191f1892-ada1-44ea-8ab8-84456381b13f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:27.035940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-191f1892-ada1-44ea-8ab8-84456381b13f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:27.036413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-191f1892-ada1-44ea-8ab8-84456381b13f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:27.344362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-191f1892-ada1-44ea-8ab8-84456381b13f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:27.355858 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-191f1892-ada1-44ea-8ab8-84456381b13f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.338866 Sep 10 21:10:27.357685 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2386/4861] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:27 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:27.957541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-11acc9c5-6649-4b02-805f-e9e1ad386e9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:27.959855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-11acc9c5-6649-4b02-805f-e9e1ad386e9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:27.971567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acc9c5-6649-4b02-805f-e9e1ad386e9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:27.972506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acc9c5-6649-4b02-805f-e9e1ad386e9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:27.973247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acc9c5-6649-4b02-805f-e9e1ad386e9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:27.974496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acc9c5-6649-4b02-805f-e9e1ad386e9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:27.975733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acc9c5-6649-4b02-805f-e9e1ad386e9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:27.976543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acc9c5-6649-4b02-805f-e9e1ad386e9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:28.130565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-151a5c39-4dc4-4e4c-903c-80a64e157cef req-3df00c49-0460-4ae8-a71b-3ad33083d563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010766a5-73d4-43bc-8b9b-915530aac069", "tag": "b3cfb9e7-e626-4a76-b620-73dfc70c87cd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:28.151367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-151a5c39-4dc4-4e4c-903c-80a64e157cef req-3df00c49-0460-4ae8-a71b-3ad33083d563 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:28.152819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-151a5c39-4dc4-4e4c-903c-80a64e157cef req-3df00c49-0460-4ae8-a71b-3ad33083d563 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:28.153493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-151a5c39-4dc4-4e4c-903c-80a64e157cef req-3df00c49-0460-4ae8-a71b-3ad33083d563 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:28.170457 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-151a5c39-4dc4-4e4c-903c-80a64e157cef req-3df00c49-0460-4ae8-a71b-3ad33083d563 service nova] Creating event network-changed:b3cfb9e7-e626-4a76-b620-73dfc70c87cd for instance 010766a5-73d4-43bc-8b9b-915530aac069 on nch2-master-1 Sep 10 21:10:28.177761 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-151a5c39-4dc4-4e4c-903c-80a64e157cef req-3df00c49-0460-4ae8-a71b-3ad33083d563 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053118 Sep 10 21:10:28.179010 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2387/4862] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:10:28.388744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-866ccce2-8597-4fa6-8bf4-8ce93e4a0b3c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:28.391030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-866ccce2-8597-4fa6-8bf4-8ce93e4a0b3c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:28.408569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866ccce2-8597-4fa6-8bf4-8ce93e4a0b3c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:28.409959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866ccce2-8597-4fa6-8bf4-8ce93e4a0b3c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:28.411828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866ccce2-8597-4fa6-8bf4-8ce93e4a0b3c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:28.412793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866ccce2-8597-4fa6-8bf4-8ce93e4a0b3c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:28.413534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866ccce2-8597-4fa6-8bf4-8ce93e4a0b3c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:28.414196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-866ccce2-8597-4fa6-8bf4-8ce93e4a0b3c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:28.418241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-11acc9c5-6649-4b02-805f-e9e1ad386e9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:28.429966 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-11acc9c5-6649-4b02-805f-e9e1ad386e9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1364 microversion: 2.1 time: 0.476362 Sep 10 21:10:28.434885 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2476/4863] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:27 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1364 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:28.441113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:29.239275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-866ccce2-8597-4fa6-8bf4-8ce93e4a0b3c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:29.260193 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-866ccce2-8597-4fa6-8bf4-8ce93e4a0b3c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.882169 Sep 10 21:10:29.262904 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2388/4864] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:28 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:29.459807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1a7f578a-6e0d-4e27-932f-e788de926975 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:29.460653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1a7f578a-6e0d-4e27-932f-e788de926975 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:29.467825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a7f578a-6e0d-4e27-932f-e788de926975 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:29.469268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a7f578a-6e0d-4e27-932f-e788de926975 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:29.470094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a7f578a-6e0d-4e27-932f-e788de926975 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:29.471519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a7f578a-6e0d-4e27-932f-e788de926975 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:29.472150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a7f578a-6e0d-4e27-932f-e788de926975 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:29.472916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a7f578a-6e0d-4e27-932f-e788de926975 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:29.648308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1a7f578a-6e0d-4e27-932f-e788de926975 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:29.658705 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1a7f578a-6e0d-4e27-932f-e788de926975 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1364 microversion: 2.1 time: 0.203004 Sep 10 21:10:29.662980 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2477/4865] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:29 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:30.289167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09db755b-6291-4f7e-b0f2-100b7f7995eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:30.290937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-09db755b-6291-4f7e-b0f2-100b7f7995eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:30.302240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09db755b-6291-4f7e-b0f2-100b7f7995eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:30.303035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09db755b-6291-4f7e-b0f2-100b7f7995eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:30.303476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09db755b-6291-4f7e-b0f2-100b7f7995eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:30.304859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09db755b-6291-4f7e-b0f2-100b7f7995eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:30.305700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09db755b-6291-4f7e-b0f2-100b7f7995eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:30.306330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09db755b-6291-4f7e-b0f2-100b7f7995eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:30.668255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09db755b-6291-4f7e-b0f2-100b7f7995eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:30.681351 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09db755b-6291-4f7e-b0f2-100b7f7995eb tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.398464 Sep 10 21:10:30.683656 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2389/4866] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:30 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:10:30.696518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0263101-ded6-4484-91df-6abe2fd39c1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:30.697350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0263101-ded6-4484-91df-6abe2fd39c1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:30.705607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0263101-ded6-4484-91df-6abe2fd39c1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:30.710137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0263101-ded6-4484-91df-6abe2fd39c1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:30.710137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0263101-ded6-4484-91df-6abe2fd39c1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:30.710137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0263101-ded6-4484-91df-6abe2fd39c1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:30.710137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0263101-ded6-4484-91df-6abe2fd39c1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:30.710137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0263101-ded6-4484-91df-6abe2fd39c1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:31.038982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0263101-ded6-4484-91df-6abe2fd39c1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:31.054401 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0263101-ded6-4484-91df-6abe2fd39c1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1364 microversion: 2.1 time: 0.374603 Sep 10 21:10:31.057055 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2478/4867] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:30 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1364 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:31.710378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a082a646-fad5-482f-a6ea-978458221961 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:31.711806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a082a646-fad5-482f-a6ea-978458221961 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:31.720856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a082a646-fad5-482f-a6ea-978458221961 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:31.721771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a082a646-fad5-482f-a6ea-978458221961 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:31.722593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a082a646-fad5-482f-a6ea-978458221961 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:31.723546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a082a646-fad5-482f-a6ea-978458221961 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:31.724370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a082a646-fad5-482f-a6ea-978458221961 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:31.724551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a082a646-fad5-482f-a6ea-978458221961 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:32.084847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-381a8194-83a2-4d40-8788-c21c00a6736f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:32.085614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-381a8194-83a2-4d40-8788-c21c00a6736f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:32.092777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a8194-83a2-4d40-8788-c21c00a6736f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:32.093521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a8194-83a2-4d40-8788-c21c00a6736f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:32.094324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a8194-83a2-4d40-8788-c21c00a6736f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:32.095040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a8194-83a2-4d40-8788-c21c00a6736f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:32.095530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a8194-83a2-4d40-8788-c21c00a6736f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:32.095954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-381a8194-83a2-4d40-8788-c21c00a6736f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:32.249757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-381a8194-83a2-4d40-8788-c21c00a6736f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:32.258517 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-381a8194-83a2-4d40-8788-c21c00a6736f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1364 microversion: 2.1 time: 0.178577 Sep 10 21:10:32.259113 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2479/4868] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:32 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:32.350512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a082a646-fad5-482f-a6ea-978458221961 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:32.369581 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a082a646-fad5-482f-a6ea-978458221961 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.663923 Sep 10 21:10:32.370576 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2390/4869] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:31 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:33.284095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8e74ebe-a9d2-4937-b39c-751a3f632a56 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:33.285705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8e74ebe-a9d2-4937-b39c-751a3f632a56 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:33.292964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:33.297508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e74ebe-a9d2-4937-b39c-751a3f632a56 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:33.298288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e74ebe-a9d2-4937-b39c-751a3f632a56 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:33.298961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e74ebe-a9d2-4937-b39c-751a3f632a56 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:33.299959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e74ebe-a9d2-4937-b39c-751a3f632a56 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:33.300582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e74ebe-a9d2-4937-b39c-751a3f632a56 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:33.301169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e74ebe-a9d2-4937-b39c-751a3f632a56 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:33.407220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38f3be7b-c277-496f-80d6-da5ea7008d60 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:33.408722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38f3be7b-c277-496f-80d6-da5ea7008d60 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:33.416420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:33.418196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:33.421645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f3be7b-c277-496f-80d6-da5ea7008d60 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:33.422759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f3be7b-c277-496f-80d6-da5ea7008d60 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:33.423578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f3be7b-c277-496f-80d6-da5ea7008d60 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:33.425554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f3be7b-c277-496f-80d6-da5ea7008d60 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:33.427898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f3be7b-c277-496f-80d6-da5ea7008d60 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:33.428714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38f3be7b-c277-496f-80d6-da5ea7008d60 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:33.494403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8e74ebe-a9d2-4937-b39c-751a3f632a56 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:33.505998 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8e74ebe-a9d2-4937-b39c-751a3f632a56 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1364 microversion: 2.1 time: 0.226205 Sep 10 21:10:33.523542 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2480/4870] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:33 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:33.721186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38f3be7b-c277-496f-80d6-da5ea7008d60 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:33.732658 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38f3be7b-c277-496f-80d6-da5ea7008d60 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.338472 Sep 10 21:10:33.734550 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2391/4871] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:33 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:34.531454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9d972b3b-e957-4836-a4e6-da0798cad0c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:34.532762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9d972b3b-e957-4836-a4e6-da0798cad0c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:34.540041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d972b3b-e957-4836-a4e6-da0798cad0c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:34.540455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d972b3b-e957-4836-a4e6-da0798cad0c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:34.540912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d972b3b-e957-4836-a4e6-da0798cad0c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:34.541604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d972b3b-e957-4836-a4e6-da0798cad0c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:34.542096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d972b3b-e957-4836-a4e6-da0798cad0c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:34.542524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d972b3b-e957-4836-a4e6-da0798cad0c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:34.757796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-477a84e6-41b0-42d9-a183-6c597f9cc666 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:34.758682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-477a84e6-41b0-42d9-a183-6c597f9cc666 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:34.762456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9d972b3b-e957-4836-a4e6-da0798cad0c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:34.771094 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9d972b3b-e957-4836-a4e6-da0798cad0c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1364 microversion: 2.1 time: 0.244063 Sep 10 21:10:34.771709 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2481/4872] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:34 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:34.771923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-477a84e6-41b0-42d9-a183-6c597f9cc666 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:34.773660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-477a84e6-41b0-42d9-a183-6c597f9cc666 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:34.775106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-477a84e6-41b0-42d9-a183-6c597f9cc666 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:34.776083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-477a84e6-41b0-42d9-a183-6c597f9cc666 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:34.777436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-477a84e6-41b0-42d9-a183-6c597f9cc666 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:34.778359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-477a84e6-41b0-42d9-a183-6c597f9cc666 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:35.360949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c38ebf65-45c6-4b73-ab5c-c7afff706522 req-ec14a33a-bf12-47a7-966f-4aadf13129fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010766a5-73d4-43bc-8b9b-915530aac069", "name": "network-vif-plugged", "status": "completed", "tag": "b3cfb9e7-e626-4a76-b620-73dfc70c87cd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:35.371511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c38ebf65-45c6-4b73-ab5c-c7afff706522 req-ec14a33a-bf12-47a7-966f-4aadf13129fc service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:35.372206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c38ebf65-45c6-4b73-ab5c-c7afff706522 req-ec14a33a-bf12-47a7-966f-4aadf13129fc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:35.372913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c38ebf65-45c6-4b73-ab5c-c7afff706522 req-ec14a33a-bf12-47a7-966f-4aadf13129fc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:35.390362 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c38ebf65-45c6-4b73-ab5c-c7afff706522 req-ec14a33a-bf12-47a7-966f-4aadf13129fc service nova] Creating event network-vif-plugged:b3cfb9e7-e626-4a76-b620-73dfc70c87cd for instance 010766a5-73d4-43bc-8b9b-915530aac069 on nch2-master-1 Sep 10 21:10:35.400422 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c38ebf65-45c6-4b73-ab5c-c7afff706522 req-ec14a33a-bf12-47a7-966f-4aadf13129fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043181 Sep 10 21:10:35.401768 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2482/4873] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:10:35.543989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-477a84e6-41b0-42d9-a183-6c597f9cc666 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:35.553763 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-477a84e6-41b0-42d9-a183-6c597f9cc666 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.801145 Sep 10 21:10:35.554393 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2392/4874] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:34 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:35.799278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ff1bf521-2230-4045-8a79-a7907f56f74d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:35.801253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ff1bf521-2230-4045-8a79-a7907f56f74d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:35.815663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff1bf521-2230-4045-8a79-a7907f56f74d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:35.816585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff1bf521-2230-4045-8a79-a7907f56f74d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:35.817275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff1bf521-2230-4045-8a79-a7907f56f74d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:35.818592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff1bf521-2230-4045-8a79-a7907f56f74d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:35.819376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff1bf521-2230-4045-8a79-a7907f56f74d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:35.820025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff1bf521-2230-4045-8a79-a7907f56f74d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:36.064784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ff1bf521-2230-4045-8a79-a7907f56f74d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:36.073727 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ff1bf521-2230-4045-8a79-a7907f56f74d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1364 microversion: 2.1 time: 0.280666 Sep 10 21:10:36.087046 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2483/4875] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:35 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1364 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:36.583123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ebf6c2fc-87c2-4425-974c-44e22128a564 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:36.585590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ebf6c2fc-87c2-4425-974c-44e22128a564 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:36.603445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:36.615948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebf6c2fc-87c2-4425-974c-44e22128a564 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:36.616475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebf6c2fc-87c2-4425-974c-44e22128a564 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:36.617127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebf6c2fc-87c2-4425-974c-44e22128a564 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:36.621310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebf6c2fc-87c2-4425-974c-44e22128a564 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:36.622208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebf6c2fc-87c2-4425-974c-44e22128a564 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:36.622865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ebf6c2fc-87c2-4425-974c-44e22128a564 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:36.948910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ebf6c2fc-87c2-4425-974c-44e22128a564 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:36.959311 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ebf6c2fc-87c2-4425-974c-44e22128a564 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.383872 Sep 10 21:10:36.965518 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2393/4876] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:36 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:37.099802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f061669-81aa-4765-b681-b82eaa227ac4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:37.100561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2f061669-81aa-4765-b681-b82eaa227ac4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:37.114374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f061669-81aa-4765-b681-b82eaa227ac4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:37.117633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f061669-81aa-4765-b681-b82eaa227ac4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:37.118438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f061669-81aa-4765-b681-b82eaa227ac4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:37.119769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f061669-81aa-4765-b681-b82eaa227ac4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:37.122362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f061669-81aa-4765-b681-b82eaa227ac4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:37.126578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f061669-81aa-4765-b681-b82eaa227ac4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:37.483317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2f061669-81aa-4765-b681-b82eaa227ac4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:37.501411 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f061669-81aa-4765-b681-b82eaa227ac4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1364 microversion: 2.1 time: 0.405657 Sep 10 21:10:37.502653 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2484/4877] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:37 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1364 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:37.986438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f6ddb23-f05f-47d8-9913-d2eb9826e707 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:37.988025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8f6ddb23-f05f-47d8-9913-d2eb9826e707 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:37.995830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f6ddb23-f05f-47d8-9913-d2eb9826e707 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:37.996879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f6ddb23-f05f-47d8-9913-d2eb9826e707 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:37.997632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f6ddb23-f05f-47d8-9913-d2eb9826e707 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:37.998565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f6ddb23-f05f-47d8-9913-d2eb9826e707 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:37.999720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f6ddb23-f05f-47d8-9913-d2eb9826e707 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:38.000695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f6ddb23-f05f-47d8-9913-d2eb9826e707 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:38.327857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8f6ddb23-f05f-47d8-9913-d2eb9826e707 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:38.345601 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8f6ddb23-f05f-47d8-9913-d2eb9826e707 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.363418 Sep 10 21:10:38.346880 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2394/4878] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:37 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:38.525328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d5fd63d-acba-48a4-8e5b-a055ccd4083a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:38.526125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8d5fd63d-acba-48a4-8e5b-a055ccd4083a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:38.539709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d5fd63d-acba-48a4-8e5b-a055ccd4083a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:38.540234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d5fd63d-acba-48a4-8e5b-a055ccd4083a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:38.540676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d5fd63d-acba-48a4-8e5b-a055ccd4083a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:38.543730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d5fd63d-acba-48a4-8e5b-a055ccd4083a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:38.544307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d5fd63d-acba-48a4-8e5b-a055ccd4083a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:38.544767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d5fd63d-acba-48a4-8e5b-a055ccd4083a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:38.846025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8d5fd63d-acba-48a4-8e5b-a055ccd4083a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:38.860378 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8d5fd63d-acba-48a4-8e5b-a055ccd4083a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1552 microversion: 2.1 time: 0.339299 Sep 10 21:10:38.861746 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2485/4879] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:38 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1552 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:38.887754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09b218f0-77b5-4ab6-9d3e-816e8a2956ba tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:38.888562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-09b218f0-77b5-4ab6-9d3e-816e8a2956ba tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:38.901286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b218f0-77b5-4ab6-9d3e-816e8a2956ba tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:38.901892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b218f0-77b5-4ab6-9d3e-816e8a2956ba tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:38.902350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b218f0-77b5-4ab6-9d3e-816e8a2956ba tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:38.903103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b218f0-77b5-4ab6-9d3e-816e8a2956ba tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:38.903564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b218f0-77b5-4ab6-9d3e-816e8a2956ba tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:38.904001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09b218f0-77b5-4ab6-9d3e-816e8a2956ba tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:39.135143 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09b218f0-77b5-4ab6-9d3e-816e8a2956ba tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.250666 Sep 10 21:10:39.136416 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2395/4880] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:10:38 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:10:39.373560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-53bfd189-5cff-45e8-ab92-cdf038636c41 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:39.374274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-53bfd189-5cff-45e8-ab92-cdf038636c41 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:39.385154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53bfd189-5cff-45e8-ab92-cdf038636c41 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:39.389004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53bfd189-5cff-45e8-ab92-cdf038636c41 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:39.398602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53bfd189-5cff-45e8-ab92-cdf038636c41 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:39.399398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53bfd189-5cff-45e8-ab92-cdf038636c41 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:39.399875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53bfd189-5cff-45e8-ab92-cdf038636c41 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:39.400313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53bfd189-5cff-45e8-ab92-cdf038636c41 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:39.784160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-53bfd189-5cff-45e8-ab92-cdf038636c41 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:39.804551 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-53bfd189-5cff-45e8-ab92-cdf038636c41 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.425955 Sep 10 21:10:39.807667 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2486/4881] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:39 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:40.799837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3dd140a3-c6e5-422f-b0d4-2df1a0779c53 req-6df3daeb-ee7b-4b78-b46e-ba8fddb0b1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010766a5-73d4-43bc-8b9b-915530aac069", "tag": "b3cfb9e7-e626-4a76-b620-73dfc70c87cd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:40.831831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3dd140a3-c6e5-422f-b0d4-2df1a0779c53 req-6df3daeb-ee7b-4b78-b46e-ba8fddb0b1f7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:40.834705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2d34214b-003d-4d2c-8c1e-a3146cb8d86c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:40.835612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2d34214b-003d-4d2c-8c1e-a3146cb8d86c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:40.838715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3dd140a3-c6e5-422f-b0d4-2df1a0779c53 req-6df3daeb-ee7b-4b78-b46e-ba8fddb0b1f7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:40.839475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3dd140a3-c6e5-422f-b0d4-2df1a0779c53 req-6df3daeb-ee7b-4b78-b46e-ba8fddb0b1f7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:40.846459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d34214b-003d-4d2c-8c1e-a3146cb8d86c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:40.847108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d34214b-003d-4d2c-8c1e-a3146cb8d86c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:40.848465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d34214b-003d-4d2c-8c1e-a3146cb8d86c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:40.849770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d34214b-003d-4d2c-8c1e-a3146cb8d86c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:40.850619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d34214b-003d-4d2c-8c1e-a3146cb8d86c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:40.851417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d34214b-003d-4d2c-8c1e-a3146cb8d86c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:40.899610 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3dd140a3-c6e5-422f-b0d4-2df1a0779c53 req-6df3daeb-ee7b-4b78-b46e-ba8fddb0b1f7 service nova] Creating event network-changed:b3cfb9e7-e626-4a76-b620-73dfc70c87cd for instance 010766a5-73d4-43bc-8b9b-915530aac069 on nch2-master-1 Sep 10 21:10:40.920647 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3dd140a3-c6e5-422f-b0d4-2df1a0779c53 req-6df3daeb-ee7b-4b78-b46e-ba8fddb0b1f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126353 Sep 10 21:10:40.924622 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2396/4882] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:10:41.373613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2d34214b-003d-4d2c-8c1e-a3146cb8d86c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:41.395636 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2d34214b-003d-4d2c-8c1e-a3146cb8d86c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1510 microversion: 2.1 time: 0.568521 Sep 10 21:10:41.399751 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2487/4883] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:40 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1510 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:10:42.435223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d4451e4c-3136-43ab-8f88-8bef798f8901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:42.438648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4451e4c-3136-43ab-8f88-8bef798f8901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:42.448469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4451e4c-3136-43ab-8f88-8bef798f8901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:42.449382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4451e4c-3136-43ab-8f88-8bef798f8901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:42.450063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4451e4c-3136-43ab-8f88-8bef798f8901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:42.451625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4451e4c-3136-43ab-8f88-8bef798f8901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:42.453215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4451e4c-3136-43ab-8f88-8bef798f8901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:42.454455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4451e4c-3136-43ab-8f88-8bef798f8901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:42.627811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d4451e4c-3136-43ab-8f88-8bef798f8901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:42.636051 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d4451e4c-3136-43ab-8f88-8bef798f8901 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1487 microversion: 2.1 time: 0.205253 Sep 10 21:10:42.636644 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2397/4884] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:42 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1487 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:42.660767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7da85e35-c444-416b-b34f-db01467e22e4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1092867417"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:42.663244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7da85e35-c444-416b-b34f-db01467e22e4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:42.669555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7da85e35-c444-416b-b34f-db01467e22e4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:42.670363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7da85e35-c444-416b-b34f-db01467e22e4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:42.670809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7da85e35-c444-416b-b34f-db01467e22e4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:42.672687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7da85e35-c444-416b-b34f-db01467e22e4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:42.673320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7da85e35-c444-416b-b34f-db01467e22e4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:42.673745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7da85e35-c444-416b-b34f-db01467e22e4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:42.754820 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7da85e35-c444-416b-b34f-db01467e22e4 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "PUT /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1061 microversion: 2.1 time: 0.099027 Sep 10 21:10:42.755453 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2488/4885] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Sep 10 21:10:42 2022] PUT /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1061 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:42.784726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66f09e64-bceb-4c05-884d-c16aa4e51415 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:42.786387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-66f09e64-bceb-4c05-884d-c16aa4e51415 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:42.794220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66f09e64-bceb-4c05-884d-c16aa4e51415 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:42.794718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66f09e64-bceb-4c05-884d-c16aa4e51415 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:42.795178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66f09e64-bceb-4c05-884d-c16aa4e51415 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:42.796819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66f09e64-bceb-4c05-884d-c16aa4e51415 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:42.797662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66f09e64-bceb-4c05-884d-c16aa4e51415 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:42.798143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66f09e64-bceb-4c05-884d-c16aa4e51415 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:42.959476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-66f09e64-bceb-4c05-884d-c16aa4e51415 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:42.988044 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-66f09e64-bceb-4c05-884d-c16aa4e51415 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1488 microversion: 2.1 time: 0.214987 Sep 10 21:10:42.994655 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2398/4886] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:42 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1488 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:43.012981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-416c1e1f-c28d-4feb-a59b-52d8c7b24cd2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:43.013604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-416c1e1f-c28d-4feb-a59b-52d8c7b24cd2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:43.025196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-416c1e1f-c28d-4feb-a59b-52d8c7b24cd2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:43.025704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-416c1e1f-c28d-4feb-a59b-52d8c7b24cd2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:43.027167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-416c1e1f-c28d-4feb-a59b-52d8c7b24cd2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:43.027936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-416c1e1f-c28d-4feb-a59b-52d8c7b24cd2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:43.028394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-416c1e1f-c28d-4feb-a59b-52d8c7b24cd2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:43.032472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-416c1e1f-c28d-4feb-a59b-52d8c7b24cd2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:43.054360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:43.209900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-416c1e1f-c28d-4feb-a59b-52d8c7b24cd2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:43.220344 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-416c1e1f-c28d-4feb-a59b-52d8c7b24cd2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1488 microversion: 2.1 time: 0.212091 Sep 10 21:10:43.220926 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2489/4887] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:43 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1488 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:43.246348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-547b7dde-6da7-4dc1-8a61-42361ef84ee2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:43.254341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-547b7dde-6da7-4dc1-8a61-42361ef84ee2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:43.261091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-547b7dde-6da7-4dc1-8a61-42361ef84ee2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:43.261839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-547b7dde-6da7-4dc1-8a61-42361ef84ee2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:43.262453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-547b7dde-6da7-4dc1-8a61-42361ef84ee2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:43.263612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-547b7dde-6da7-4dc1-8a61-42361ef84ee2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:43.264573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-547b7dde-6da7-4dc1-8a61-42361ef84ee2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:43.265768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-547b7dde-6da7-4dc1-8a61-42361ef84ee2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:43.301203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-547b7dde-6da7-4dc1-8a61-42361ef84ee2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:10:43.403913 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-547b7dde-6da7-4dc1-8a61-42361ef84ee2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 204 len: 0 microversion: 2.1 time: 0.161812 Sep 10 21:10:43.404827 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2399/4888] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:10:43 2022] DELETE /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:10:43.416875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6cb9693b-4e0b-4d60-af19-e3d6bd6cc36d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:43.417196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6cb9693b-4e0b-4d60-af19-e3d6bd6cc36d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:43.424267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cb9693b-4e0b-4d60-af19-e3d6bd6cc36d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:43.424756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cb9693b-4e0b-4d60-af19-e3d6bd6cc36d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:43.425192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cb9693b-4e0b-4d60-af19-e3d6bd6cc36d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:43.425920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cb9693b-4e0b-4d60-af19-e3d6bd6cc36d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:43.426379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cb9693b-4e0b-4d60-af19-e3d6bd6cc36d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:43.426824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cb9693b-4e0b-4d60-af19-e3d6bd6cc36d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:43.649122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6cb9693b-4e0b-4d60-af19-e3d6bd6cc36d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:43.658912 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6cb9693b-4e0b-4d60-af19-e3d6bd6cc36d tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1494 microversion: 2.1 time: 0.248338 Sep 10 21:10:43.668316 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2490/4889] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:43 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1494 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:44.683907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-873bb736-a246-4a9e-ac17-0fdd371e91c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:44.684664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-873bb736-a246-4a9e-ac17-0fdd371e91c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:44.692234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-873bb736-a246-4a9e-ac17-0fdd371e91c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:44.692730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-873bb736-a246-4a9e-ac17-0fdd371e91c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:44.693176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-873bb736-a246-4a9e-ac17-0fdd371e91c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:44.693916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-873bb736-a246-4a9e-ac17-0fdd371e91c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:44.694997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-873bb736-a246-4a9e-ac17-0fdd371e91c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:44.694997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-873bb736-a246-4a9e-ac17-0fdd371e91c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:44.793080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-332a17b1-49f0-4c86-ae6a-ff7e098ef1f8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:44.806105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-332a17b1-49f0-4c86-ae6a-ff7e098ef1f8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:44.816223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-332a17b1-49f0-4c86-ae6a-ff7e098ef1f8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:44.816834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-332a17b1-49f0-4c86-ae6a-ff7e098ef1f8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:44.817775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-332a17b1-49f0-4c86-ae6a-ff7e098ef1f8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:44.818346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-332a17b1-49f0-4c86-ae6a-ff7e098ef1f8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:44.818809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-332a17b1-49f0-4c86-ae6a-ff7e098ef1f8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:44.819245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-332a17b1-49f0-4c86-ae6a-ff7e098ef1f8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:44.858066 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-332a17b1-49f0-4c86-ae6a-ff7e098ef1f8 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070652 Sep 10 21:10:44.860267 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2491/4890] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:10:44 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 21:10:44.864195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-873bb736-a246-4a9e-ac17-0fdd371e91c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:44.873559 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-873bb736-a246-4a9e-ac17-0fdd371e91c1 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1494 microversion: 2.1 time: 0.194801 Sep 10 21:10:44.874635 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2400/4891] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:44 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1494 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:44.936767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a45da433-a514-4933-b77d-4a4c5cb2c625 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:44.937245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a45da433-a514-4933-b77d-4a4c5cb2c625 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:44.943799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a45da433-a514-4933-b77d-4a4c5cb2c625 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:44.944292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a45da433-a514-4933-b77d-4a4c5cb2c625 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:44.944739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a45da433-a514-4933-b77d-4a4c5cb2c625 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:44.945444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a45da433-a514-4933-b77d-4a4c5cb2c625 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:44.945929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a45da433-a514-4933-b77d-4a4c5cb2c625 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:44.946358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a45da433-a514-4933-b77d-4a4c5cb2c625 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:44.990142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a45da433-a514-4933-b77d-4a4c5cb2c625 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:10:45.086154 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a45da433-a514-4933-b77d-4a4c5cb2c625 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 204 len: 0 microversion: 2.1 time: 0.153094 Sep 10 21:10:45.087161 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2492/4892] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:10:44 2022] DELETE /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:10:45.097454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3ce109f4-77f7-4577-be22-23fef5a95114 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:45.098501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3ce109f4-77f7-4577-be22-23fef5a95114 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:45.106506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce109f4-77f7-4577-be22-23fef5a95114 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:45.107016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce109f4-77f7-4577-be22-23fef5a95114 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:45.107467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce109f4-77f7-4577-be22-23fef5a95114 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:45.108608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce109f4-77f7-4577-be22-23fef5a95114 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:45.109393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce109f4-77f7-4577-be22-23fef5a95114 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:45.109857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ce109f4-77f7-4577-be22-23fef5a95114 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:45.303759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3ce109f4-77f7-4577-be22-23fef5a95114 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:45.320510 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3ce109f4-77f7-4577-be22-23fef5a95114 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1674 microversion: 2.1 time: 0.228646 Sep 10 21:10:45.321088 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2401/4893] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:45 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1674 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:45.915971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3acd7fcd-797e-483d-bc3f-c16415518cba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:45.918723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3acd7fcd-797e-483d-bc3f-c16415518cba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:45.931403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acd7fcd-797e-483d-bc3f-c16415518cba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:45.932123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acd7fcd-797e-483d-bc3f-c16415518cba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:45.932722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acd7fcd-797e-483d-bc3f-c16415518cba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:45.933594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acd7fcd-797e-483d-bc3f-c16415518cba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:45.934360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acd7fcd-797e-483d-bc3f-c16415518cba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:45.934954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3acd7fcd-797e-483d-bc3f-c16415518cba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:46.041768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3acd7fcd-797e-483d-bc3f-c16415518cba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:46.058049 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3acd7fcd-797e-483d-bc3f-c16415518cba tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1452 microversion: 2.1 time: 0.159847 Sep 10 21:10:46.058685 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2493/4894] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:45 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:46.126602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0a91efa9-9333-47cd-932a-e22598315d2f req-9a1c4909-6219-4a32-b7d3-4cb67a379d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5", "name": "network-vif-deleted", "tag": "b20200fb-f1fd-40bf-92c1-b9d46a58a873"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:46.143897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0a91efa9-9333-47cd-932a-e22598315d2f req-9a1c4909-6219-4a32-b7d3-4cb67a379d98 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:46.144340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0a91efa9-9333-47cd-932a-e22598315d2f req-9a1c4909-6219-4a32-b7d3-4cb67a379d98 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:46.144777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0a91efa9-9333-47cd-932a-e22598315d2f req-9a1c4909-6219-4a32-b7d3-4cb67a379d98 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:46.167732 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0a91efa9-9333-47cd-932a-e22598315d2f req-9a1c4909-6219-4a32-b7d3-4cb67a379d98 service nova] Creating event network-vif-deleted:b20200fb-f1fd-40bf-92c1-b9d46a58a873 for instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 on nch1-master-1 Sep 10 21:10:46.173318 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0a91efa9-9333-47cd-932a-e22598315d2f req-9a1c4909-6219-4a32-b7d3-4cb67a379d98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054036 Sep 10 21:10:46.174741 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2402/4895] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:10:46.347412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6f395b47-30af-464f-b631-05f960c1c2d2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:46.348758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6f395b47-30af-464f-b631-05f960c1c2d2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:46.360120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f395b47-30af-464f-b631-05f960c1c2d2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:46.360762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f395b47-30af-464f-b631-05f960c1c2d2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:46.362372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f395b47-30af-464f-b631-05f960c1c2d2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:46.363270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f395b47-30af-464f-b631-05f960c1c2d2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:46.363859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f395b47-30af-464f-b631-05f960c1c2d2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:46.364572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f395b47-30af-464f-b631-05f960c1c2d2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:46.508226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6f395b47-30af-464f-b631-05f960c1c2d2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:46.517923 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6f395b47-30af-464f-b631-05f960c1c2d2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1674 microversion: 2.1 time: 0.176250 Sep 10 21:10:46.518520 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2494/4896] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:46 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:47.086413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:47.087326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:47.095490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:47.096157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:47.096772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:47.097643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:47.098348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:47.098939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:47.146961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:47.147614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:47.147735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:47.148652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lazy-loading 'fault' on Instance uuid 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:10:47.229808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:47.243003 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0872bf26-e5fa-4cf5-9b6a-5b2044e573f7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 200 len: 1310 microversion: 2.1 time: 0.161021 Sep 10 21:10:47.244645 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2403/4897] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:47 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 1310 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:47.541956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6fb5cfa-675d-4da0-9b83-7e2153214677 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:47.542576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f6fb5cfa-675d-4da0-9b83-7e2153214677 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:47.550603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6fb5cfa-675d-4da0-9b83-7e2153214677 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:47.551101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6fb5cfa-675d-4da0-9b83-7e2153214677 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:47.551570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6fb5cfa-675d-4da0-9b83-7e2153214677 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:47.552282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6fb5cfa-675d-4da0-9b83-7e2153214677 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:47.552742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6fb5cfa-675d-4da0-9b83-7e2153214677 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:47.553171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6fb5cfa-675d-4da0-9b83-7e2153214677 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:47.798608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f6fb5cfa-675d-4da0-9b83-7e2153214677 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:47.814620 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f6fb5cfa-675d-4da0-9b83-7e2153214677 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1674 microversion: 2.1 time: 0.275872 Sep 10 21:10:47.823964 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2495/4898] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:47 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1674 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:48.278237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.279457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.293406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.294197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.294643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.295363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.295872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.296305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.313652 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 HTTP/1.1 Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5'} Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.316612 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.328019 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.328019 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.328019 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:48.328019 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:48.328019 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.328019 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.334745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:48.334745 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aa342317-762d-40d5-b9d2-d9309147bca8 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 404 len: 111 microversion: 2.1 time: 0.064678 Sep 10 21:10:48.334745 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2404/4899] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:48 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:48.351448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.352285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.359850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.360773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.361398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.363569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.365514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.366561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.387590 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 HTTP/1.1 Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5'} Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:48.391219 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e057f0cf-8dc2-44ed-a601-602c78eaefa9 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 404 len: 111 microversion: 2.1 time: 0.046148 Sep 10 21:10:48.396276 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2496/4900] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:10:48 2022] DELETE /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:48.406916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.408011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.417314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.418167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.418335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.419372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.420073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.420775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.441378 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 HTTP/1.1 Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5'} Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.444597 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.451757 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.451757 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.451757 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:48.451757 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:48.451757 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. Sep 10 21:10:48.451757 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.456459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:48.457903 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ac17d18-e56a-47ca-9656-9fff058f1b5c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5" status: 404 len: 111 microversion: 2.1 time: 0.057282 Sep 10 21:10:48.469380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.469380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.473901 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2405/4901] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:48 2022] GET /compute/v2.1/servers/5a7b2db7-e8e3-4e1f-ac30-e3797b7df2e5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:48.480028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.482574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.483855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.487119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.488704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.490302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.517855 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 HTTP/1.1 Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '655a20ea-1e07-43d1-9e43-f68fe3ba3473'} Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:48.519882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:10:48.525971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.525971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.525971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.525971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.525971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.525971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.525971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:48.525971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:48.525971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:10:48.525971 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.528670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:48.529785 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b03b7427-a48b-4c0c-833e-8c152ce225e7 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 404 len: 111 microversion: 2.1 time: 0.066873 Sep 10 21:10:48.532141 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2497/4902] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:10:48 2022] DELETE /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:10:48.541803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.542877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 655a20ea-1e07-43d1-9e43-f68fe3ba3473] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.551071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.552099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.552648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.553574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.554237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.555067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.558502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:48.578793 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 HTTP/1.1 Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '655a20ea-1e07-43d1-9e43-f68fe3ba3473'} Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.580760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.586135 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.586135 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.586135 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:48.586135 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:48.586135 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. Sep 10 21:10:48.586135 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.587635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 655a20ea-1e07-43d1-9e43-f68fe3ba3473 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:48.588600 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5cf6997c-1c75-4b97-8381-90abf5e1f512 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473" status: 404 len: 111 microversion: 2.1 time: 0.052120 Sep 10 21:10:48.592558 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2406/4903] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:48 2022] GET /compute/v2.1/servers/655a20ea-1e07-43d1-9e43-f68fe3ba3473 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:48.598270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.599039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.613794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.614298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.614956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.616030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.616587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.617076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.641967 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 HTTP/1.1 Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b4188cfb-0c94-419a-b1c2-1c5d635b02c4'} Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:48.644444 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:10:48.649577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.649577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.649577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.649577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.649577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.649577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.649577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:48.649577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:48.649577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:10:48.649577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.652939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:48.655974 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9e1f30ff-8db0-411e-827d-b0a7f0a3a2a2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 404 len: 111 microversion: 2.1 time: 0.061801 Sep 10 21:10:48.656840 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2498/4904] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:10:48 2022] DELETE /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:48.666918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.667709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b4188cfb-0c94-419a-b1c2-1c5d635b02c4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.676840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.681695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.681695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.681695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.681695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.681695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.698121 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 HTTP/1.1 Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b4188cfb-0c94-419a-b1c2-1c5d635b02c4'} Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.700340 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.707938 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.707938 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.707938 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:48.707938 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:48.707938 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. Sep 10 21:10:48.707938 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.710679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance b4188cfb-0c94-419a-b1c2-1c5d635b02c4 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:48.711908 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7c3f58dd-2d04-4ac4-bfc4-479ea0931664 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4" status: 404 len: 111 microversion: 2.1 time: 0.049829 Sep 10 21:10:48.717349 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2407/4905] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:48 2022] GET /compute/v2.1/servers/b4188cfb-0c94-419a-b1c2-1c5d635b02c4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:48.722565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.723078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.731105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.731521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.731970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.732686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.733143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.734756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.753006 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 HTTP/1.1 Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '3cf19196-a3f8-43b1-95b5-4842aac6ac78'} Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:48.754985 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:48.759969 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ceb55e30-1acc-432b-8ce5-97c4a6923f7a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 404 len: 111 microversion: 2.1 time: 0.039513 Sep 10 21:10:48.760768 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2499/4906] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:10:48 2022] DELETE /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:48.769387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.770187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 3cf19196-a3f8-43b1-95b5-4842aac6ac78] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.776593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.779297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.779821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.782563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.783130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.785318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.812005 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 HTTP/1.1 Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '3cf19196-a3f8-43b1-95b5-4842aac6ac78'} Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.814454 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.819386 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.819386 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.819386 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:48.819386 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:48.819386 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. Sep 10 21:10:48.819386 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.819386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 3cf19196-a3f8-43b1-95b5-4842aac6ac78 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:48.819386 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2a9619a8-a79f-4d9d-bdf2-e873db25d107 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78" status: 404 len: 111 microversion: 2.1 time: 0.052421 Sep 10 21:10:48.819386 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2408/4907] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:48 2022] GET /compute/v2.1/servers/3cf19196-a3f8-43b1-95b5-4842aac6ac78 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:48.828826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.829437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.838954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.846209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.847067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.847463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6dcaaa64-1172-48de-a88c-acbd50b8a6fc tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:48.848294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6dcaaa64-1172-48de-a88c-acbd50b8a6fc tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:48.849515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.856407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcaaa64-1172-48de-a88c-acbd50b8a6fc tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.857078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcaaa64-1172-48de-a88c-acbd50b8a6fc tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.857530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcaaa64-1172-48de-a88c-acbd50b8a6fc tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.858424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcaaa64-1172-48de-a88c-acbd50b8a6fc tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.859236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcaaa64-1172-48de-a88c-acbd50b8a6fc tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.859678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dcaaa64-1172-48de-a88c-acbd50b8a6fc tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.860251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.870417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.898862 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 HTTP/1.1 Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '18b42dd4-4dd0-451e-826f-7dab0944ba02'} Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:48.900924 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:10:48.906337 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.906337 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:48.906337 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.906337 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:48.906337 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:48.906337 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:48.906337 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:48.906337 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:48.906337 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:10:48.906337 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:48.908552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:48.909667 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8933ef35-b427-4a12-bd9b-85ea0ddd797a tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 404 len: 111 microversion: 2.1 time: 0.087498 Sep 10 21:10:48.910518 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2500/4908] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:10:48 2022] DELETE /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:48.916496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-23ce52f8-7108-41be-b5ac-8c350afada7d req-246ef761-9b12-48a2-a2d8-8487f6b7da08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06501f8-3bc9-4240-b2ca-514d8d6fdacb", "name": "network-vif-deleted", "tag": "c83fb9d1-1d5c-4b9d-97ca-d0502fd7f74d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:48.935237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-23ce52f8-7108-41be-b5ac-8c350afada7d req-246ef761-9b12-48a2-a2d8-8487f6b7da08 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:48.936165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-23ce52f8-7108-41be-b5ac-8c350afada7d req-246ef761-9b12-48a2-a2d8-8487f6b7da08 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:48.939382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-23ce52f8-7108-41be-b5ac-8c350afada7d req-246ef761-9b12-48a2-a2d8-8487f6b7da08 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:48.966322 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-23ce52f8-7108-41be-b5ac-8c350afada7d req-246ef761-9b12-48a2-a2d8-8487f6b7da08 service nova] Creating event network-vif-deleted:c83fb9d1-1d5c-4b9d-97ca-d0502fd7f74d for instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb on nch1-master-1 Sep 10 21:10:48.993096 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-23ce52f8-7108-41be-b5ac-8c350afada7d req-246ef761-9b12-48a2-a2d8-8487f6b7da08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081125 Sep 10 21:10:48.993814 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2501/4909] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:10:49.003785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:49.009125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 18b42dd4-4dd0-451e-826f-7dab0944ba02] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:49.033033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:49.037869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:49.038362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:49.039195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:49.039677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:49.040109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:49.065441 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 HTTP/1.1 Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '18b42dd4-4dd0-451e-826f-7dab0944ba02'} Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.067838 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.077732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:49.077732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:49.077732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:49.077732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:49.077732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. Sep 10 21:10:49.077732 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.077732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 18b42dd4-4dd0-451e-826f-7dab0944ba02 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:49.077732 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e2d54da5-f1a4-44bc-80ea-49d0a8566a64 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02" status: 404 len: 111 microversion: 2.1 time: 0.074538 Sep 10 21:10:49.077732 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2502/4910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:48 2022] GET /compute/v2.1/servers/18b42dd4-4dd0-451e-826f-7dab0944ba02 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:49.081204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6dcaaa64-1172-48de-a88c-acbd50b8a6fc tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:49.091178 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6dcaaa64-1172-48de-a88c-acbd50b8a6fc tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 200 len: 1607 microversion: 2.1 time: 0.250209 Sep 10 21:10:49.091720 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2409/4911] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:48 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 1607 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:49.101146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:49.101790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:49.110749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:49.140159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:49.142905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:49.143878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:49.156366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:49.157064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:49.206420 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 HTTP/1.1 Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b994bffb-4ed7-4c2f-a528-e25cde273d31'} Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:49.208602 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-904c5ff1-1f1c-47f5-b51f-cca47e7077e2 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 404 len: 111 microversion: 2.1 time: 0.121877 Sep 10 21:10:49.212780 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2503/4912] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:10:49 2022] DELETE /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:49.220108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:49.221073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: b994bffb-4ed7-4c2f-a528-e25cde273d31] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:49.227987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:49.228741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:49.229187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:49.229987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:49.230454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:49.230891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:49.247651 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 HTTP/1.1 Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b994bffb-4ed7-4c2f-a528-e25cde273d31'} Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.251517 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.255919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:49.255919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:49.255919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:49.255919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:49.255919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. Sep 10 21:10:49.255919 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.255919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance b994bffb-4ed7-4c2f-a528-e25cde273d31 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:49.255919 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d3f7f90b-53d4-4f4a-96de-7d075d03562c tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31" status: 404 len: 111 microversion: 2.1 time: 0.038317 Sep 10 21:10:49.265524 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2410/4913] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:49 2022] GET /compute/v2.1/servers/b994bffb-4ed7-4c2f-a528-e25cde273d31 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:49.273465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c0710273-95ad-4e54-affe-2b681c8895b5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:49.274011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c0710273-95ad-4e54-affe-2b681c8895b5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5c347df6-deac-46b3-8a61-13f2ef0604d7] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:49.283201 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-c0710273-95ad-4e54-affe-2b681c8895b5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c0710273-95ad-4e54-affe-2b681c8895b5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7 HTTP/1.1 Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5c347df6-deac-46b3-8a61-13f2ef0604d7'} Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:49.285302 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.289514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.289514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:49.289514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:49.289514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:49.289514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:49.289514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:10:49.289514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.289514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c0710273-95ad-4e54-affe-2b681c8895b5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:49.289514 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c0710273-95ad-4e54-affe-2b681c8895b5 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7" status: 404 len: 111 microversion: 2.1 time: 0.017109 Sep 10 21:10:49.295439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9701db07-6d42-45b0-b9f6-8cc62b97406f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:49.297128 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2504/4914] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:10:49 2022] DELETE /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:49.297621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9701db07-6d42-45b0-b9f6-8cc62b97406f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 5c347df6-deac-46b3-8a61-13f2ef0604d7] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:49.305655 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-9701db07-6d42-45b0-b9f6-8cc62b97406f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9701db07-6d42-45b0-b9f6-8cc62b97406f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7 HTTP/1.1 Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '5c347df6-deac-46b3-8a61-13f2ef0604d7'} Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:49.307321 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:49.311716 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:49.311716 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:49.311716 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. Sep 10 21:10:49.311716 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:49.311716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9701db07-6d42-45b0-b9f6-8cc62b97406f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 5c347df6-deac-46b3-8a61-13f2ef0604d7 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:49.311716 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9701db07-6d42-45b0-b9f6-8cc62b97406f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7" status: 404 len: 111 microversion: 2.1 time: 0.017337 Sep 10 21:10:49.311716 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2411/4915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:49 2022] GET /compute/v2.1/servers/5c347df6-deac-46b3-8a61-13f2ef0604d7 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:49.320935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c09cb3da-cd8b-4ce4-8c55-c59bb859d7ea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:49.323221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c09cb3da-cd8b-4ce4-8c55-c59bb859d7ea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:49.338098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c09cb3da-cd8b-4ce4-8c55-c59bb859d7ea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:49.338607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c09cb3da-cd8b-4ce4-8c55-c59bb859d7ea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:49.339060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c09cb3da-cd8b-4ce4-8c55-c59bb859d7ea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:49.339787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c09cb3da-cd8b-4ce4-8c55-c59bb859d7ea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:49.340253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c09cb3da-cd8b-4ce4-8c55-c59bb859d7ea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:49.340690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c09cb3da-cd8b-4ce4-8c55-c59bb859d7ea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:49.372461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c09cb3da-cd8b-4ce4-8c55-c59bb859d7ea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:10:49.496209 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c09cb3da-cd8b-4ce4-8c55-c59bb859d7ea tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "DELETE /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 204 len: 0 microversion: 2.1 time: 0.181169 Sep 10 21:10:49.497379 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2505/4916] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:10:49 2022] DELETE /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:10:49.510820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ac194bd3-34c5-4c38-acae-bb8ce51c6484 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:49.511684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ac194bd3-34c5-4c38-acae-bb8ce51c6484 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:49.523528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac194bd3-34c5-4c38-acae-bb8ce51c6484 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:49.524169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac194bd3-34c5-4c38-acae-bb8ce51c6484 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:49.525943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac194bd3-34c5-4c38-acae-bb8ce51c6484 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:49.541245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac194bd3-34c5-4c38-acae-bb8ce51c6484 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:49.543061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac194bd3-34c5-4c38-acae-bb8ce51c6484 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:49.544141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac194bd3-34c5-4c38-acae-bb8ce51c6484 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:49.747640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ac194bd3-34c5-4c38-acae-bb8ce51c6484 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:49.765962 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ac194bd3-34c5-4c38-acae-bb8ce51c6484 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1479 microversion: 2.1 time: 0.263439 Sep 10 21:10:49.769506 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2412/4917] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:49 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1479 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:50.119083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:50.119928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:50.146242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:50.147027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:50.148174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:50.149103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:50.150002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:50.150597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:50.174744 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] HTTP exception thrown: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Request method failure captured: Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb HTTP/1.1 Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxEV6jv3JJE-qB1TZIGEjv-scsRBkB2K5LAqiMkDVDA2v0uPyGK28D6dzqxbMFiq8bw-vG9EY9FMtKKN8amSEFZ-p3BlGaTZePzxAIftZltKXS7oXqY9BD4Ay6IC1KTDag1F3JvYSrKbL2CQeJ-F3_m9kUaLPmQTexhjxCDqooXa5k Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b196d42c2d6416c81818922af07b8a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b196d42c2d6416c81818922af07b8a3"}]}] Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 13e5077421c44eb7abcda40582c7ea9a Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e06501f8-3bc9-4240-b2ca-514d8d6fdacb'} Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:50.176412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:50.180882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:50.180882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:50.180882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:50.180882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:50.180882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:50.180882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:10:50.180882 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:10:50.180882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Returning 404 to user: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:50.180882 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ab2a5b9b-c446-48b9-a89a-d46d85bae0b9 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 404 len: 111 microversion: 2.1 time: 0.063196 Sep 10 21:10:50.180882 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2506/4918] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:50 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:50.187924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c726eb1e-1b9e-46d7-983a-c25e209d1829 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '.version_select at 0x7f993fab0310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:50.222919 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c726eb1e-1b9e-46d7-983a-c25e209d1829 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969145086" status: 202 len: 0 microversion: 2.1 time: 0.039172 Sep 10 21:10:50.223837 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2413/4919] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 21:10:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969145086 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:10:50.792912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3db10f55-b863-404e-8e06-e3771dc1143e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:50.793480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3db10f55-b863-404e-8e06-e3771dc1143e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:50.802030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db10f55-b863-404e-8e06-e3771dc1143e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:50.802542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db10f55-b863-404e-8e06-e3771dc1143e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:50.802993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db10f55-b863-404e-8e06-e3771dc1143e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:50.803714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db10f55-b863-404e-8e06-e3771dc1143e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:50.804175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db10f55-b863-404e-8e06-e3771dc1143e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:50.804604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3db10f55-b863-404e-8e06-e3771dc1143e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:51.243798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3db10f55-b863-404e-8e06-e3771dc1143e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:51.251902 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3db10f55-b863-404e-8e06-e3771dc1143e tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1479 microversion: 2.1 time: 0.463128 Sep 10 21:10:51.252458 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2507/4920] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:50 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1479 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:51.266711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-490fa328-6f41-4e00-aaee-08fb260663db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'create', calling method: .version_select at 0x7f993f7e4a60>, body: {"keypair": {"name": "tempest-keypair-2015045020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfvxjkXMYSpHo89hdKqH2e2jGLnRilZwyTYkp+NKMmojiXNf8iNKZ1vV6Mlu40QEITHme+PZ7O26B2tYstTbg895jhlwyiv+Xulr2jq9m3InW/CSQwet3Wr8dMF0sRWDA=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:51.286860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-490fa328-6f41-4e00-aaee-08fb260663db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Getting quotas for project 9b196d42c2d6416c81818922af07b8a3. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:10:51.293457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-490fa328-6f41-4e00-aaee-08fb260663db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Getting quotas for user 13e5077421c44eb7abcda40582c7ea9a and project 9b196d42c2d6416c81818922af07b8a3. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:10:51.326948 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-490fa328-6f41-4e00-aaee-08fb260663db tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065947 Sep 10 21:10:51.327848 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2414/4921] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:10:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:10:51.746433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-eb5dae3b-0657-4a44-88fd-b5411ea80fe5 req-88d78266-a1a4-47d8-abef-1be04c278f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168c6843-f1e2-49ce-98ab-c49fb021e486", "name": "network-vif-deleted", "tag": "c6c69f20-700c-4c4b-ae38-84570280a8c1"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:51.761457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-eb5dae3b-0657-4a44-88fd-b5411ea80fe5 req-88d78266-a1a4-47d8-abef-1be04c278f90 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:51.761996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-eb5dae3b-0657-4a44-88fd-b5411ea80fe5 req-88d78266-a1a4-47d8-abef-1be04c278f90 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:51.762680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-eb5dae3b-0657-4a44-88fd-b5411ea80fe5 req-88d78266-a1a4-47d8-abef-1be04c278f90 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:51.778104 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-eb5dae3b-0657-4a44-88fd-b5411ea80fe5 req-88d78266-a1a4-47d8-abef-1be04c278f90 service nova] Creating event network-vif-deleted:c6c69f20-700c-4c4b-ae38-84570280a8c1 for instance 168c6843-f1e2-49ce-98ab-c49fb021e486 on nch2-master-1 Sep 10 21:10:51.787946 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-eb5dae3b-0657-4a44-88fd-b5411ea80fe5 req-88d78266-a1a4-47d8-abef-1be04c278f90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046583 Sep 10 21:10:51.789121 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2508/4922] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:10:52.279997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:52.282323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:52.294300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:52.295253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:52.296833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:52.297844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:52.298363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:52.298806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:52.345203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:52.346172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:52.346920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:52.347822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lazy-loading 'fault' on Instance uuid 168c6843-f1e2-49ce-98ab-c49fb021e486 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:10:52.420296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bfa3af0a7284bc6854f2c9c58392935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acb763ffd24512afe7ca5e1d06f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:52.431698 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-26bd9fd8-13af-40d6-8770-3021b010cb9f tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 200 len: 1283 microversion: 2.1 time: 0.160597 Sep 10 21:10:52.432961 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2415/4923] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:52 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 1283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:53.158986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-698913519", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e62036f-d417-4f91-bd8f-784bd88ed67c"}], "security_groups": [{"name": "tempest-securitygroup--1961537790"}], "key_name": "tempest-keypair-2015045020", "user_data": "}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:10:53.169308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:53.296931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] validate_networks() for [('3e62036f-d417-4f91-bd8f-784bd88ed67c', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:10:53.460169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:53.462765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] [instance: 168c6843-f1e2-49ce-98ab-c49fb021e486] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:53.478315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:53.479593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:53.480714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:53.482351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:53.501719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:53.504083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:53.525189 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] HTTP exception thrown: Instance 168c6843-f1e2-49ce-98ab-c49fb021e486 could not be found. Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Request method failure captured: Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 HTTP/1.1 Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxc04JKhO-9K05Zy5t2UK3jkoKHdj_mR7VnHTkE3hUibXV2WGx9cfKXKBx2Z9uALw-3jUpk2eSPezKz7WbJhu8I0fv130s0wQwdYxvqM8pnpqKSQbBbSE4KJOGO6VZBxSmD6Ex9By_SarJNgmLqmQnQbuQ8WTxKtVhs9HrYy-SP5nA Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27acb763ffd24512afe7ca5e1d06f031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27acb763ffd24512afe7ca5e1d06f031", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27acb763ffd24512afe7ca5e1d06f031"}]}] Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersTestJSON-705091947 Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 27acb763ffd24512afe7ca5e1d06f031 Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersTestJSON-705091947 Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersTestJSON-705091947-project Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6bfa3af0a7284bc6854f2c9c58392935 Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersTestJSON-705091947-project Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 168c6843-f1e2-49ce-98ab-c49fb021e486 could not be found. Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '168c6843-f1e2-49ce-98ab-c49fb021e486'} Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168c6843-f1e2-49ce-98ab-c49fb021e486 could not be found. Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168c6843-f1e2-49ce-98ab-c49fb021e486 could not be found. Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:53.526767 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:10:53.533588 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:10:53.533588 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:10:53.533588 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:10:53.533588 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:10:53.533588 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168c6843-f1e2-49ce-98ab-c49fb021e486 could not be found. Sep 10 21:10:53.533588 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:10:53.533588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] Returning 404 to user: Instance 168c6843-f1e2-49ce-98ab-c49fb021e486 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:10:53.538950 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d7cb9b7d-c453-46a6-81fc-b3e9519a7386 tempest-ServersTestJSON-705091947 tempest-ServersTestJSON-705091947-project] 10.222.0.33 "GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486" status: 404 len: 111 microversion: 2.1 time: 0.083920 Sep 10 21:10:53.539564 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2416/4924] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:53 2022] GET /compute/v2.1/servers/168c6843-f1e2-49ce-98ab-c49fb021e486 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:10:53.800474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:10:53.801469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:10:53.802644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:10:53.803072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:10:53.803696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:10:53.831419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:53.833077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:53.833742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:53.837071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:53.838539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:53.840449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:53.869347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Getting quotas for project 9b196d42c2d6416c81818922af07b8a3. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:10:53.877979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Getting quotas for user 13e5077421c44eb7abcda40582c7ea9a and project 9b196d42c2d6416c81818922af07b8a3. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:10:53.900817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:10:53.906141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:10:53.980133 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-680f5e31-acca-44ba-a7fd-a39406d5cd00 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.827685 Sep 10 21:10:53.981551 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2509/4925] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:10:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:10:53.996766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-32dd349a-bc0e-4752-87e2-ad3856c72638 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:53.997791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-32dd349a-bc0e-4752-87e2-ad3856c72638 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:54.116873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-32dd349a-bc0e-4752-87e2-ad3856c72638 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:54.130110 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-32dd349a-bc0e-4752-87e2-ad3856c72638 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1237 microversion: 2.1 time: 0.139349 Sep 10 21:10:54.130893 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2417/4926] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:53 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1237 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:55.160881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1b1a1bfd-babe-4391-93d8-3911f84e347d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:55.162452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1b1a1bfd-babe-4391-93d8-3911f84e347d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:55.176355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b1a1bfd-babe-4391-93d8-3911f84e347d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:55.176899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b1a1bfd-babe-4391-93d8-3911f84e347d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:55.179657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b1a1bfd-babe-4391-93d8-3911f84e347d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:55.180668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b1a1bfd-babe-4391-93d8-3911f84e347d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:55.181162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b1a1bfd-babe-4391-93d8-3911f84e347d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:55.181665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b1a1bfd-babe-4391-93d8-3911f84e347d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:55.308502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b1a1bfd-babe-4391-93d8-3911f84e347d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:55.317442 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1b1a1bfd-babe-4391-93d8-3911f84e347d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1289 microversion: 2.1 time: 0.162283 Sep 10 21:10:55.322355 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2510/4927] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:55 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1289 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:10:56.343515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23f450bf-8ad6-40fb-8f9b-19d3d863b379 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:56.344272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23f450bf-8ad6-40fb-8f9b-19d3d863b379 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:56.368013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23f450bf-8ad6-40fb-8f9b-19d3d863b379 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:56.368563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23f450bf-8ad6-40fb-8f9b-19d3d863b379 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:56.382688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23f450bf-8ad6-40fb-8f9b-19d3d863b379 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:56.383795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23f450bf-8ad6-40fb-8f9b-19d3d863b379 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:56.384785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23f450bf-8ad6-40fb-8f9b-19d3d863b379 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:56.385395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23f450bf-8ad6-40fb-8f9b-19d3d863b379 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:56.577919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-23f450bf-8ad6-40fb-8f9b-19d3d863b379 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:56.591398 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23f450bf-8ad6-40fb-8f9b-19d3d863b379 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1295 microversion: 2.1 time: 0.247303 Sep 10 21:10:56.606456 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2418/4928] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:56 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1295 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:10:57.620368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c2b61107-a593-49f1-88fb-b429cd1837b0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:57.620927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c2b61107-a593-49f1-88fb-b429cd1837b0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:57.636661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2b61107-a593-49f1-88fb-b429cd1837b0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:57.637133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2b61107-a593-49f1-88fb-b429cd1837b0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:57.637579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2b61107-a593-49f1-88fb-b429cd1837b0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:57.638342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2b61107-a593-49f1-88fb-b429cd1837b0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:57.638807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2b61107-a593-49f1-88fb-b429cd1837b0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:57.639792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2b61107-a593-49f1-88fb-b429cd1837b0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:57.663972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:10:57.848789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c2b61107-a593-49f1-88fb-b429cd1837b0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:57.866568 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c2b61107-a593-49f1-88fb-b429cd1837b0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1295 microversion: 2.1 time: 0.246672 Sep 10 21:10:57.867956 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2511/4929] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:57 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1295 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:10:58.893037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fe9128f0-75fc-41c2-81fb-98301a99edd5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:10:58.894338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fe9128f0-75fc-41c2-81fb-98301a99edd5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:10:58.914543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe9128f0-75fc-41c2-81fb-98301a99edd5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:58.915303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe9128f0-75fc-41c2-81fb-98301a99edd5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:58.916522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe9128f0-75fc-41c2-81fb-98301a99edd5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:58.917953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe9128f0-75fc-41c2-81fb-98301a99edd5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:10:58.919247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe9128f0-75fc-41c2-81fb-98301a99edd5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:10:58.920191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe9128f0-75fc-41c2-81fb-98301a99edd5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:10:59.293010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fe9128f0-75fc-41c2-81fb-98301a99edd5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:10:59.307172 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fe9128f0-75fc-41c2-81fb-98301a99edd5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1363 microversion: 2.1 time: 0.418720 Sep 10 21:10:59.309048 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2419/4930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:10:58 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1363 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:00.305871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-32c8eb81-6b76-4a67-bcb2-95c311c7b10c req-6e5296af-f29f-498d-b46f-e44aae587e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbebf08d-97c2-43b6-848d-8665f61d8854", "tag": "843f51c3-30f6-417c-8823-56aa1ba415c8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:00.335015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-68623aa3-34f4-498f-b2ef-7ba02a3f7c27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:00.336497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-32c8eb81-6b76-4a67-bcb2-95c311c7b10c req-6e5296af-f29f-498d-b46f-e44aae587e76 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:00.337730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-32c8eb81-6b76-4a67-bcb2-95c311c7b10c req-6e5296af-f29f-498d-b46f-e44aae587e76 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:00.337730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-32c8eb81-6b76-4a67-bcb2-95c311c7b10c req-6e5296af-f29f-498d-b46f-e44aae587e76 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:00.339298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-68623aa3-34f4-498f-b2ef-7ba02a3f7c27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:00.353485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68623aa3-34f4-498f-b2ef-7ba02a3f7c27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:00.354274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68623aa3-34f4-498f-b2ef-7ba02a3f7c27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:00.354946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68623aa3-34f4-498f-b2ef-7ba02a3f7c27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:00.355897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68623aa3-34f4-498f-b2ef-7ba02a3f7c27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:00.356616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68623aa3-34f4-498f-b2ef-7ba02a3f7c27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:00.357295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68623aa3-34f4-498f-b2ef-7ba02a3f7c27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:00.371892 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-32c8eb81-6b76-4a67-bcb2-95c311c7b10c req-6e5296af-f29f-498d-b46f-e44aae587e76 service nova] Creating event network-changed:843f51c3-30f6-417c-8823-56aa1ba415c8 for instance bbebf08d-97c2-43b6-848d-8665f61d8854 on nch1-master-1 Sep 10 21:11:00.377664 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-32c8eb81-6b76-4a67-bcb2-95c311c7b10c req-6e5296af-f29f-498d-b46f-e44aae587e76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075433 Sep 10 21:11:00.378354 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2512/4931] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:00.672881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-68623aa3-34f4-498f-b2ef-7ba02a3f7c27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:00.691770 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-68623aa3-34f4-498f-b2ef-7ba02a3f7c27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1363 microversion: 2.1 time: 0.361986 Sep 10 21:11:00.692386 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2420/4932] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:00 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:01.569469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-32c8eb81-6b76-4a67-bcb2-95c311c7b10c req-6e5296af-f29f-498d-b46f-e44aae587e76 service nova] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:01.570631 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-32c8eb81-6b76-4a67-bcb2-95c311c7b10c req-6e5296af-f29f-498d-b46f-e44aae587e76 service nova] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001677 Sep 10 21:11:01.578897 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2513/4933] 10.222.0.33 () {56 vars in 886 bytes} [Sat Sep 10 21:11:01 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 21:11:01.721006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7775f9c7-b20c-45fa-a37a-e100b16f537a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:01.722345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7775f9c7-b20c-45fa-a37a-e100b16f537a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:01.740499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7775f9c7-b20c-45fa-a37a-e100b16f537a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:01.741137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7775f9c7-b20c-45fa-a37a-e100b16f537a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:01.741608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7775f9c7-b20c-45fa-a37a-e100b16f537a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:01.750303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7775f9c7-b20c-45fa-a37a-e100b16f537a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:01.750954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7775f9c7-b20c-45fa-a37a-e100b16f537a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:01.751419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7775f9c7-b20c-45fa-a37a-e100b16f537a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:02.032431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7775f9c7-b20c-45fa-a37a-e100b16f537a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:02.043140 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7775f9c7-b20c-45fa-a37a-e100b16f537a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1363 microversion: 2.1 time: 0.326514 Sep 10 21:11:02.044414 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2421/4934] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:01 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:03.075215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bebf966b-fab1-4f49-9dda-0dad6d19efe1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:03.076019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bebf966b-fab1-4f49-9dda-0dad6d19efe1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:03.099674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bebf966b-fab1-4f49-9dda-0dad6d19efe1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:03.100184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bebf966b-fab1-4f49-9dda-0dad6d19efe1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:03.100688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bebf966b-fab1-4f49-9dda-0dad6d19efe1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:03.101363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bebf966b-fab1-4f49-9dda-0dad6d19efe1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:03.101890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bebf966b-fab1-4f49-9dda-0dad6d19efe1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:03.103817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bebf966b-fab1-4f49-9dda-0dad6d19efe1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:03.345487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bebf966b-fab1-4f49-9dda-0dad6d19efe1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:03.355430 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bebf966b-fab1-4f49-9dda-0dad6d19efe1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1363 microversion: 2.1 time: 0.285284 Sep 10 21:11:03.358654 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2514/4935] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:03 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:04.386085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8844b7fe-0ab4-4332-8155-0e82c951f399 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:04.386763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8844b7fe-0ab4-4332-8155-0e82c951f399 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:04.389719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:04.403043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8844b7fe-0ab4-4332-8155-0e82c951f399 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:04.404076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8844b7fe-0ab4-4332-8155-0e82c951f399 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:04.404768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8844b7fe-0ab4-4332-8155-0e82c951f399 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:04.405936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8844b7fe-0ab4-4332-8155-0e82c951f399 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:04.406807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8844b7fe-0ab4-4332-8155-0e82c951f399 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:04.407477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8844b7fe-0ab4-4332-8155-0e82c951f399 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:04.712531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8844b7fe-0ab4-4332-8155-0e82c951f399 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:04.721308 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8844b7fe-0ab4-4332-8155-0e82c951f399 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1363 microversion: 2.1 time: 0.341716 Sep 10 21:11:04.738157 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2422/4936] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:04 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:11:05.746854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0fe8ec03-786d-4402-9045-ec3a679a410d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:05.747432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0fe8ec03-786d-4402-9045-ec3a679a410d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:05.753183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:05.757384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:05.769331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fe8ec03-786d-4402-9045-ec3a679a410d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:05.773378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fe8ec03-786d-4402-9045-ec3a679a410d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:05.778160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fe8ec03-786d-4402-9045-ec3a679a410d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:05.779469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fe8ec03-786d-4402-9045-ec3a679a410d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:05.783663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fe8ec03-786d-4402-9045-ec3a679a410d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:05.784132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fe8ec03-786d-4402-9045-ec3a679a410d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:06.265482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0fe8ec03-786d-4402-9045-ec3a679a410d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:06.298141 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0fe8ec03-786d-4402-9045-ec3a679a410d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1363 microversion: 2.1 time: 0.536738 Sep 10 21:11:06.298847 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2515/4937] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:05 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1363 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:07.321887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1bb31436-3673-4169-8851-4faed1064a8c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:07.323252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1bb31436-3673-4169-8851-4faed1064a8c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:07.335706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:07.350519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bb31436-3673-4169-8851-4faed1064a8c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:07.351034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bb31436-3673-4169-8851-4faed1064a8c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:07.353854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bb31436-3673-4169-8851-4faed1064a8c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:07.354822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bb31436-3673-4169-8851-4faed1064a8c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:07.355277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bb31436-3673-4169-8851-4faed1064a8c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:07.355717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1bb31436-3673-4169-8851-4faed1064a8c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:07.673679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1bb31436-3673-4169-8851-4faed1064a8c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:07.684578 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1bb31436-3673-4169-8851-4faed1064a8c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1363 microversion: 2.1 time: 0.367148 Sep 10 21:11:07.685678 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2423/4938] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:07 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:08.710432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1b028729-cebc-4d13-9e1c-e17c5e2a2b10 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:08.712704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1b028729-cebc-4d13-9e1c-e17c5e2a2b10 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:08.727836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b028729-cebc-4d13-9e1c-e17c5e2a2b10 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:08.728611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b028729-cebc-4d13-9e1c-e17c5e2a2b10 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:08.729343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b028729-cebc-4d13-9e1c-e17c5e2a2b10 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:08.732339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b028729-cebc-4d13-9e1c-e17c5e2a2b10 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:08.733121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b028729-cebc-4d13-9e1c-e17c5e2a2b10 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:08.738857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b028729-cebc-4d13-9e1c-e17c5e2a2b10 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:09.196843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b028729-cebc-4d13-9e1c-e17c5e2a2b10 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:09.207170 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1b028729-cebc-4d13-9e1c-e17c5e2a2b10 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1363 microversion: 2.1 time: 0.500940 Sep 10 21:11:09.208166 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2516/4939] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:08 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1363 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:09.629391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1858df27-529c-4cef-9fa3-d8799604b237 req-ef1fa08c-4bfb-4764-a90b-112e103f15a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbebf08d-97c2-43b6-848d-8665f61d8854", "name": "network-vif-plugged", "status": "completed", "tag": "843f51c3-30f6-417c-8823-56aa1ba415c8"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:09.655026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1858df27-529c-4cef-9fa3-d8799604b237 req-ef1fa08c-4bfb-4764-a90b-112e103f15a5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:09.655703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1858df27-529c-4cef-9fa3-d8799604b237 req-ef1fa08c-4bfb-4764-a90b-112e103f15a5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:09.656149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1858df27-529c-4cef-9fa3-d8799604b237 req-ef1fa08c-4bfb-4764-a90b-112e103f15a5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:09.675608 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1858df27-529c-4cef-9fa3-d8799604b237 req-ef1fa08c-4bfb-4764-a90b-112e103f15a5 service nova] Creating event network-vif-plugged:843f51c3-30f6-417c-8823-56aa1ba415c8 for instance bbebf08d-97c2-43b6-848d-8665f61d8854 on nch1-master-1 Sep 10 21:11:09.681458 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1858df27-529c-4cef-9fa3-d8799604b237 req-ef1fa08c-4bfb-4764-a90b-112e103f15a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056061 Sep 10 21:11:09.684697 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2424/4940] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:10.232214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c97e936-f9e8-4193-8e72-3a60fbaa8791 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:10.233751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9c97e936-f9e8-4193-8e72-3a60fbaa8791 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:10.247636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c97e936-f9e8-4193-8e72-3a60fbaa8791 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:10.255453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c97e936-f9e8-4193-8e72-3a60fbaa8791 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:10.256112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c97e936-f9e8-4193-8e72-3a60fbaa8791 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:10.257081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c97e936-f9e8-4193-8e72-3a60fbaa8791 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:10.257671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c97e936-f9e8-4193-8e72-3a60fbaa8791 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:10.258265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c97e936-f9e8-4193-8e72-3a60fbaa8791 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:10.656065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c97e936-f9e8-4193-8e72-3a60fbaa8791 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:10.683411 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c97e936-f9e8-4193-8e72-3a60fbaa8791 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1363 microversion: 2.1 time: 0.455286 Sep 10 21:11:10.684620 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2517/4941] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:10 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1363 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:12.133013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5667ec96-ef71-47a9-9ba0-4dcf7759fe3e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:12.134748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5667ec96-ef71-47a9-9ba0-4dcf7759fe3e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:12.147408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5667ec96-ef71-47a9-9ba0-4dcf7759fe3e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:12.148136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5667ec96-ef71-47a9-9ba0-4dcf7759fe3e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:12.149799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5667ec96-ef71-47a9-9ba0-4dcf7759fe3e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:12.151130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5667ec96-ef71-47a9-9ba0-4dcf7759fe3e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:12.151994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5667ec96-ef71-47a9-9ba0-4dcf7759fe3e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:12.152631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5667ec96-ef71-47a9-9ba0-4dcf7759fe3e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:12.452586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5667ec96-ef71-47a9-9ba0-4dcf7759fe3e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:12.462882 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5667ec96-ef71-47a9-9ba0-4dcf7759fe3e tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1548 microversion: 2.1 time: 0.751271 Sep 10 21:11:12.463485 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2425/4942] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:11 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1548 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:12.496205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-469075a2-86d7-4459-a5b9-b6ec3bebae26 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:12.497242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-469075a2-86d7-4459-a5b9-b6ec3bebae26 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:12.510660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-469075a2-86d7-4459-a5b9-b6ec3bebae26 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:12.511460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-469075a2-86d7-4459-a5b9-b6ec3bebae26 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:12.512065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-469075a2-86d7-4459-a5b9-b6ec3bebae26 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:12.513293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-469075a2-86d7-4459-a5b9-b6ec3bebae26 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:12.514674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-469075a2-86d7-4459-a5b9-b6ec3bebae26 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:12.515300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-469075a2-86d7-4459-a5b9-b6ec3bebae26 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:12.736914 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-469075a2-86d7-4459-a5b9-b6ec3bebae26 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.245916 Sep 10 21:11:12.737527 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2518/4943] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:11:12 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-interface => generated 284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:11:12.949595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dce1a764-0153-441c-8fb9-166b0593a8fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Action: 'create', calling method: .version_select at 0x7f99440b1ca0>, body: {"keypair": {"name": "tempest-keypair-266236701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMxa4qfy4b2tNhHG4PBGFrUASMO2uCRYm87kllovyIF3Fs0+0EbQfhG6vNyJ7e3HI1O+TDJX8XcensjM+UuwjjUfPMBOP64z2YCbac9NiFSrPhZB9xv1Aa2/TZRxOfe9Q=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:12.980424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-dce1a764-0153-441c-8fb9-166b0593a8fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Getting quotas for project 2d055111e2e44ed7afe3b335094df69a. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:11:12.990105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-dce1a764-0153-441c-8fb9-166b0593a8fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Getting quotas for user 3f03d688d0ee4d2b951828a3f496c914 and project 2d055111e2e44ed7afe3b335094df69a. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:11:13.020756 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dce1a764-0153-441c-8fb9-166b0593a8fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.139719 Sep 10 21:11:13.022999 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2426/4944] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Sep 10 21:11:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 21:11:15.256538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-35d725d6-7d68-442e-8d52-49f5435e9241 req-e6be89ec-425f-4ac2-bdfa-6ae184f7300c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbebf08d-97c2-43b6-848d-8665f61d8854", "tag": "843f51c3-30f6-417c-8823-56aa1ba415c8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:15.279574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-35d725d6-7d68-442e-8d52-49f5435e9241 req-e6be89ec-425f-4ac2-bdfa-6ae184f7300c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:15.283728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-35d725d6-7d68-442e-8d52-49f5435e9241 req-e6be89ec-425f-4ac2-bdfa-6ae184f7300c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:15.284539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-35d725d6-7d68-442e-8d52-49f5435e9241 req-e6be89ec-425f-4ac2-bdfa-6ae184f7300c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:15.321572 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-35d725d6-7d68-442e-8d52-49f5435e9241 req-e6be89ec-425f-4ac2-bdfa-6ae184f7300c service nova] Creating event network-changed:843f51c3-30f6-417c-8823-56aa1ba415c8 for instance bbebf08d-97c2-43b6-848d-8665f61d8854 on nch1-master-1 Sep 10 21:11:15.329725 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-35d725d6-7d68-442e-8d52-49f5435e9241 req-e6be89ec-425f-4ac2-bdfa-6ae184f7300c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078793 Sep 10 21:11:15.336160 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2519/4945] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:15.439625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7956ab34-0f91-441a-9ea8-8decc0e06520 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:15.441021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7956ab34-0f91-441a-9ea8-8decc0e06520 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:15.458028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7956ab34-0f91-441a-9ea8-8decc0e06520 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:15.459662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7956ab34-0f91-441a-9ea8-8decc0e06520 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:15.461327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7956ab34-0f91-441a-9ea8-8decc0e06520 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:15.463117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7956ab34-0f91-441a-9ea8-8decc0e06520 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:15.464661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7956ab34-0f91-441a-9ea8-8decc0e06520 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:15.466217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7956ab34-0f91-441a-9ea8-8decc0e06520 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:15.883926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7956ab34-0f91-441a-9ea8-8decc0e06520 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:15.895499 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7956ab34-0f91-441a-9ea8-8decc0e06520 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.469324 Sep 10 21:11:15.896653 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2427/4946] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:15 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:15.922465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fd90771d-58ca-4d0d-b1a5-7fda3b624e9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:15.924809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fd90771d-58ca-4d0d-b1a5-7fda3b624e9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:15.937734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd90771d-58ca-4d0d-b1a5-7fda3b624e9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:15.942721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd90771d-58ca-4d0d-b1a5-7fda3b624e9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:15.943688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd90771d-58ca-4d0d-b1a5-7fda3b624e9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:15.944911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd90771d-58ca-4d0d-b1a5-7fda3b624e9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:15.945689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd90771d-58ca-4d0d-b1a5-7fda3b624e9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:15.946397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd90771d-58ca-4d0d-b1a5-7fda3b624e9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:16.519755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fd90771d-58ca-4d0d-b1a5-7fda3b624e9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:16.533412 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fd90771d-58ca-4d0d-b1a5-7fda3b624e9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.613065 Sep 10 21:11:16.534207 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2520/4947] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:15 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:16.562135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2a5530e-888a-429f-96d5-5c1986062716 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:16.563335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c2a5530e-888a-429f-96d5-5c1986062716 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:16.579508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a5530e-888a-429f-96d5-5c1986062716 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:16.581996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a5530e-888a-429f-96d5-5c1986062716 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:16.582709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a5530e-888a-429f-96d5-5c1986062716 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:16.583478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a5530e-888a-429f-96d5-5c1986062716 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:16.584118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a5530e-888a-429f-96d5-5c1986062716 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:16.584389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e070f814-0fa2-4a44-884c-4a948d07bfe0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:16.584546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2a5530e-888a-429f-96d5-5c1986062716 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:16.584963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e070f814-0fa2-4a44-884c-4a948d07bfe0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:16.601877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e070f814-0fa2-4a44-884c-4a948d07bfe0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:16.602388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e070f814-0fa2-4a44-884c-4a948d07bfe0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:16.609593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e070f814-0fa2-4a44-884c-4a948d07bfe0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:16.610679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e070f814-0fa2-4a44-884c-4a948d07bfe0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:16.611325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e070f814-0fa2-4a44-884c-4a948d07bfe0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:16.611940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e070f814-0fa2-4a44-884c-4a948d07bfe0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:16.679974 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e070f814-0fa2-4a44-884c-4a948d07bfe0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/ips" status: 200 len: 147 microversion: 2.1 time: 0.104438 Sep 10 21:11:16.682553 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2521/4948] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:11:16 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/ips => generated 147 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:17.194401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c2a5530e-888a-429f-96d5-5c1986062716 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:17.210845 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c2a5530e-888a-429f-96d5-5c1986062716 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.652693 Sep 10 21:11:17.235998 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2428/4949] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:16 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:17.243052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-54b0223b-fdac-4d78-ad22-44f3e38e2289 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1630946221"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:17.245866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-54b0223b-fdac-4d78-ad22-44f3e38e2289 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:17.273507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54b0223b-fdac-4d78-ad22-44f3e38e2289 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:17.278591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54b0223b-fdac-4d78-ad22-44f3e38e2289 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:17.284953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54b0223b-fdac-4d78-ad22-44f3e38e2289 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:17.286194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54b0223b-fdac-4d78-ad22-44f3e38e2289 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:17.286923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54b0223b-fdac-4d78-ad22-44f3e38e2289 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:17.288897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54b0223b-fdac-4d78-ad22-44f3e38e2289 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:17.850583 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-54b0223b-fdac-4d78-ad22-44f3e38e2289 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.611521 Sep 10 21:11:17.851306 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2522/4950] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:11:17 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 10 21:11:18.080557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1153548417", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d0a4717-d4e3-4410-baaa-82d0d71c8a06"}], "security_groups": [{"name": "tempest-securitygroup--110955360"}], "key_name": "tempest-keypair-266236701", "user_data": "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:18.278895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] validate_networks() for [('8d0a4717-d4e3-4410-baaa-82d0d71c8a06', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:11:18.445780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62602637-c607-455e-8929-68a6893ad85d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "163ecddb-6bf8-4316-9386-752260cc219a"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:18.449040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-62602637-c607-455e-8929-68a6893ad85d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:18.459067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62602637-c607-455e-8929-68a6893ad85d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:18.459668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62602637-c607-455e-8929-68a6893ad85d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:18.460317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62602637-c607-455e-8929-68a6893ad85d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:18.461116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62602637-c607-455e-8929-68a6893ad85d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:18.461672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62602637-c607-455e-8929-68a6893ad85d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:18.462193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62602637-c607-455e-8929-68a6893ad85d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:18.720766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:11:18.726148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:11:18.727074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:11:18.728497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:11:18.730752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:11:18.752646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:18.753508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:18.754156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:18.755204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:18.756126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:18.756853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:18.769195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=86 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:18.779816 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-62602637-c607-455e-8929-68a6893ad85d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337093 Sep 10 21:11:18.782208 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2523/4951] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:11:18 2022] POST /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:18.791202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Getting quotas for project 2d055111e2e44ed7afe3b335094df69a. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:11:18.802364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Getting quotas for user 3f03d688d0ee4d2b951828a3f496c914 and project 2d055111e2e44ed7afe3b335094df69a. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:11:18.831520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:11:18.834216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:11:18.916333 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b170f2a8-1323-4e92-ab62-95fb88ea1675 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.841985 Sep 10 21:11:18.922142 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2429/4952] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 21:11:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 21:11:18.934725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0df3d62b-f3c7-4c9d-a848-7c50af13683c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:18.935521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0df3d62b-f3c7-4c9d-a848-7c50af13683c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:19.042099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0df3d62b-f3c7-4c9d-a848-7c50af13683c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:19.052506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0df3d62b-f3c7-4c9d-a848-7c50af13683c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:19.054030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0df3d62b-f3c7-4c9d-a848-7c50af13683c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:19.055160 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0df3d62b-f3c7-4c9d-a848-7c50af13683c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1281 microversion: 2.20 time: 0.129452 Sep 10 21:11:19.055987 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2524/4953] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:18 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1281 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:11:20.086579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:20.087392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:20.110268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:20.111023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:20.111554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:20.117249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:20.118150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:20.119443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:20.215542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:20.227266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:20.229549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:20.230952 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9410ac44-1de4-41f1-b107-8204d96a2760 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1333 microversion: 2.20 time: 0.152880 Sep 10 21:11:20.231782 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2430/4954] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:20 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1333 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:20.478967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:20.479984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:20.493485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:20.494204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:20.494736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:20.495726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:20.496184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:20.496771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:20.835555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:20.847908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:20.849383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:20.850980 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-803dd4d3-dc91-4a06-b22c-e20340471857 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 2954 microversion: 2.42 time: 0.378431 Sep 10 21:11:20.851686 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2525/4955] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:20 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 2954 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:20.882041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5a59d24-cd60-4587-9d14-2e9207738704 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:20.882575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e5a59d24-cd60-4587-9d14-2e9207738704 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:20.891961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a59d24-cd60-4587-9d14-2e9207738704 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:20.892554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a59d24-cd60-4587-9d14-2e9207738704 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:20.893609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a59d24-cd60-4587-9d14-2e9207738704 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:20.894998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a59d24-cd60-4587-9d14-2e9207738704 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:20.895979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a59d24-cd60-4587-9d14-2e9207738704 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:20.896286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a59d24-cd60-4587-9d14-2e9207738704 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:21.061119 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5a59d24-cd60-4587-9d14-2e9207738704 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.183587 Sep 10 21:11:21.064303 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2431/4956] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Sep 10 21:11:20 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c/os-interface => generated 1830 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:21.259291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:21.260049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:21.268431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:21.268963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:21.269415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:21.270162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:21.270626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:21.271091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:21.355968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:21.366917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:21.369556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:21.371200 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e4cde831-d40e-4995-8c7f-a68cddb8efae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1339 microversion: 2.20 time: 0.116746 Sep 10 21:11:21.372257 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2526/4957] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:21 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1339 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:22.308708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-183b7ba4-767b-425a-ac2b-e3ce3edb590d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: .version_select at 0x7f993f7e4430>, body: {"keypair": {"name": "tempest-keypair-1518401477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSV5OCnnFOJ6lqs567KZ68a3tndKWlG0mx/KccxYFgpPTprKaJVIvQZbvrLQBREYtTRGmpSrMrdWWQupKHmi6BXRJbPWuKeD/+pLFKMJ9KaBtz3ahj1o3CVJJ9hGgSrCg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:22.330737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-183b7ba4-767b-425a-ac2b-e3ce3edb590d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:11:22.339686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-183b7ba4-767b-425a-ac2b-e3ce3edb590d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for user 54dcc78ee39c4119b08023d3cc692d6b and project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:11:22.392684 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-183b7ba4-767b-425a-ac2b-e3ce3edb590d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087541 Sep 10 21:11:22.393341 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2432/4958] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:11:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:22.398455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:22.402673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:22.425843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:22.426443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:22.426768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:22.427480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:22.427939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:22.428364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:22.921709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:22.938651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:22.943349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:22.946979 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3de1a59f-ae11-4d26-ae6d-a0b18974df50 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1406 microversion: 2.20 time: 0.552833 Sep 10 21:11:22.948360 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2527/4959] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:22 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1406 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:23.466156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-00ce8bb7-207c-4d1d-b13b-699c3c132243 req-a35eb235-0046-43ab-af09-1bd0ba06c4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7919a6b0-623c-440c-bece-f3879f6a89ab", "tag": "07804208-07af-4af5-b975-15459b698f1d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:23.497360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-00ce8bb7-207c-4d1d-b13b-699c3c132243 req-a35eb235-0046-43ab-af09-1bd0ba06c4f7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:23.500914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-00ce8bb7-207c-4d1d-b13b-699c3c132243 req-a35eb235-0046-43ab-af09-1bd0ba06c4f7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:23.501486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-00ce8bb7-207c-4d1d-b13b-699c3c132243 req-a35eb235-0046-43ab-af09-1bd0ba06c4f7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:23.520405 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-00ce8bb7-207c-4d1d-b13b-699c3c132243 req-a35eb235-0046-43ab-af09-1bd0ba06c4f7 service nova] Creating event network-changed:07804208-07af-4af5-b975-15459b698f1d for instance 7919a6b0-623c-440c-bece-f3879f6a89ab on nch2-master-1 Sep 10 21:11:23.526644 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-00ce8bb7-207c-4d1d-b13b-699c3c132243 req-a35eb235-0046-43ab-af09-1bd0ba06c4f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066366 Sep 10 21:11:23.528204 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2433/4960] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:23.957741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0a2501f6-240f-4ec1-b4e7-b6e07c78c563 req-6bbfe71a-d6ed-4ef7-ac7a-bd0908f2ec2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010766a5-73d4-43bc-8b9b-915530aac069", "name": "network-vif-plugged", "status": "completed", "tag": "b3cfb9e7-e626-4a76-b620-73dfc70c87cd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:23.964628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:23.977513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:23.978540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:23.994457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:23.994967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:23.995499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:23.996181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:23.996748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:23.997059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:24.004655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0a2501f6-240f-4ec1-b4e7-b6e07c78c563 req-6bbfe71a-d6ed-4ef7-ac7a-bd0908f2ec2e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:24.011906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0a2501f6-240f-4ec1-b4e7-b6e07c78c563 req-6bbfe71a-d6ed-4ef7-ac7a-bd0908f2ec2e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:24.018819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0a2501f6-240f-4ec1-b4e7-b6e07c78c563 req-6bbfe71a-d6ed-4ef7-ac7a-bd0908f2ec2e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:24.058676 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0a2501f6-240f-4ec1-b4e7-b6e07c78c563 req-6bbfe71a-d6ed-4ef7-ac7a-bd0908f2ec2e service nova] Creating event network-vif-plugged:b3cfb9e7-e626-4a76-b620-73dfc70c87cd for instance 010766a5-73d4-43bc-8b9b-915530aac069 on nch2-master-1 Sep 10 21:11:24.081138 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0a2501f6-240f-4ec1-b4e7-b6e07c78c563 req-6bbfe71a-d6ed-4ef7-ac7a-bd0908f2ec2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126961 Sep 10 21:11:24.086648 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2528/4961] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:24.350872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:24.386349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:24.390754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:24.392168 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c5e4d9f8-f4fb-4fe5-a1c4-9fff4183a380 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1406 microversion: 2.20 time: 0.419348 Sep 10 21:11:24.394781 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2434/4962] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:23 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:25.424741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:25.424741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:25.448752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:25.449275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:25.449664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:25.450597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:25.451926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:25.452524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:25.852542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1524807319", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05daa8b2-a600-4c08-8c3a-78652e8f4ca4"}], "security_groups": [{"name": "tempest-securitygroup--1772109438"}], "key_name": "tempest-keypair-1518401477", "user_data": "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:25.869980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:25.874977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:25.891386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:25.892881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:25.894083 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d20fc904-3d62-4ed1-aaf8-61fabc34e9ca tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1406 microversion: 2.20 time: 0.476995 Sep 10 21:11:25.894657 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2529/4963] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:25 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:26.022563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] validate_networks() for [('05daa8b2-a600-4c08-8c3a-78652e8f4ca4', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:11:26.721374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:11:26.722469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:11:26.723261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:11:26.723823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:11:26.726949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:11:26.739346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:26.740536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:26.741279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:26.742461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:26.743514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:26.744312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:26.770531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:11:26.777691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for user 54dcc78ee39c4119b08023d3cc692d6b and project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:11:26.796729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:11:26.799863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:11:26.861507 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f0dcade3-7aca-4dd9-8d57-251f4972a9f5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.014907 Sep 10 21:11:26.874139 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2435/4964] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:11:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:11:26.882885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1d1839c-e548-4d33-9196-eb189d4f6e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:26.884374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e1d1839c-e548-4d33-9196-eb189d4f6e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:26.928240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:26.929224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:26.944384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:26.945191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:26.946042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:26.947270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:26.947993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:26.949120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:27.005199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1d1839c-e548-4d33-9196-eb189d4f6e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:27.016873 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1d1839c-e548-4d33-9196-eb189d4f6e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1242 microversion: 2.1 time: 0.140237 Sep 10 21:11:27.019006 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2530/4965] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:26 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1242 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:27.236350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:27.249361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:27.251852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:27.254172 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4feba25c-b7da-40b0-9209-d66f586bb747 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1406 microversion: 2.20 time: 0.334303 Sep 10 21:11:27.255585 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2436/4966] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:26 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:28.042973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12523717-15f5-4321-8400-fe26b9f32a4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:28.046964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-12523717-15f5-4321-8400-fe26b9f32a4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:28.072806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12523717-15f5-4321-8400-fe26b9f32a4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:28.074180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12523717-15f5-4321-8400-fe26b9f32a4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:28.076778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12523717-15f5-4321-8400-fe26b9f32a4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:28.081133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12523717-15f5-4321-8400-fe26b9f32a4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:28.083087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12523717-15f5-4321-8400-fe26b9f32a4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:28.084133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12523717-15f5-4321-8400-fe26b9f32a4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:28.249632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-12523717-15f5-4321-8400-fe26b9f32a4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:28.267614 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-12523717-15f5-4321-8400-fe26b9f32a4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1294 microversion: 2.1 time: 0.229582 Sep 10 21:11:28.274292 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2531/4967] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:28 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1294 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:28.294273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:28.297417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:28.321526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:28.322270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:28.322688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:28.344863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:28.348329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:28.350474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:28.660947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:28.674142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:28.677947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:28.682021 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-10610fd7-d579-4a5e-8886-f73c8de2eb1b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1406 microversion: 2.20 time: 0.400299 Sep 10 21:11:28.686159 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2437/4968] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:28 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:29.300037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a2c53eaf-ad0b-4af6-b00a-ab7f5be3824d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:29.301275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a2c53eaf-ad0b-4af6-b00a-ab7f5be3824d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:29.314127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c53eaf-ad0b-4af6-b00a-ab7f5be3824d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:29.316133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c53eaf-ad0b-4af6-b00a-ab7f5be3824d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:29.317036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c53eaf-ad0b-4af6-b00a-ab7f5be3824d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:29.318740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c53eaf-ad0b-4af6-b00a-ab7f5be3824d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:29.319861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c53eaf-ad0b-4af6-b00a-ab7f5be3824d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:29.320592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2c53eaf-ad0b-4af6-b00a-ab7f5be3824d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:29.601272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a2c53eaf-ad0b-4af6-b00a-ab7f5be3824d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:29.612948 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a2c53eaf-ad0b-4af6-b00a-ab7f5be3824d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1300 microversion: 2.1 time: 0.319792 Sep 10 21:11:29.613545 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2532/4969] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:29 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1300 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:29.710022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:29.710665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:29.723873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:29.728785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:29.729175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:29.730077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:29.731068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:29.732210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:29.855120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-eafa5665-79fe-481c-8582-6af9053d6781 req-adf6d77e-ad09-4c2b-a620-98cc4c1d14b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7919a6b0-623c-440c-bece-f3879f6a89ab", "name": "network-vif-plugged", "status": "completed", "tag": "07804208-07af-4af5-b975-15459b698f1d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:29.876560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-eafa5665-79fe-481c-8582-6af9053d6781 req-adf6d77e-ad09-4c2b-a620-98cc4c1d14b7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:29.877453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-eafa5665-79fe-481c-8582-6af9053d6781 req-adf6d77e-ad09-4c2b-a620-98cc4c1d14b7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:29.879582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-eafa5665-79fe-481c-8582-6af9053d6781 req-adf6d77e-ad09-4c2b-a620-98cc4c1d14b7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:29.920254 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-eafa5665-79fe-481c-8582-6af9053d6781 req-adf6d77e-ad09-4c2b-a620-98cc4c1d14b7 service nova] Creating event network-vif-plugged:07804208-07af-4af5-b975-15459b698f1d for instance 7919a6b0-623c-440c-bece-f3879f6a89ab on nch2-master-1 Sep 10 21:11:29.939314 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-eafa5665-79fe-481c-8582-6af9053d6781 req-adf6d77e-ad09-4c2b-a620-98cc4c1d14b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089632 Sep 10 21:11:29.941056 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2533/4970] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:11:29.980197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:30.022980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:30.027641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:30.031159 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-790ce932-f429-4b6d-8bd8-3f65cb8fa516 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1406 microversion: 2.20 time: 0.323613 Sep 10 21:11:30.032676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2438/4971] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:29 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:30.641379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eeb98a7d-ad8b-4f1a-b1a4-876c3c2ebad5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:30.642250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eeb98a7d-ad8b-4f1a-b1a4-876c3c2ebad5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:30.655105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb98a7d-ad8b-4f1a-b1a4-876c3c2ebad5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:30.656161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb98a7d-ad8b-4f1a-b1a4-876c3c2ebad5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:30.656934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb98a7d-ad8b-4f1a-b1a4-876c3c2ebad5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:30.658153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb98a7d-ad8b-4f1a-b1a4-876c3c2ebad5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:30.658875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb98a7d-ad8b-4f1a-b1a4-876c3c2ebad5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:30.659591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb98a7d-ad8b-4f1a-b1a4-876c3c2ebad5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:30.958018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eeb98a7d-ad8b-4f1a-b1a4-876c3c2ebad5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:30.969686 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eeb98a7d-ad8b-4f1a-b1a4-876c3c2ebad5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1368 microversion: 2.1 time: 0.333898 Sep 10 21:11:30.979932 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2534/4972] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:30 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1368 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:31.060764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:31.062055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:31.076662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:31.080209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:31.081981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:31.085004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:31.086544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:31.090761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:31.363400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:31.377579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:31.380169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:31.381622 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7204be8d-b161-4a63-8025-ae8edb1dcef9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1406 microversion: 2.20 time: 0.325927 Sep 10 21:11:31.383027 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2439/4973] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:31 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:11:31.558783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-757bba6a-c251-4695-9ccc-ed47bb819f44 req-1297e9ad-179e-4b54-9f2a-7e9354b121d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04e7926-fc3d-456a-ad4f-7099ef9811e9", "tag": "3fc57237-0038-44cd-9586-8f19f883c4f0"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:31.583144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-757bba6a-c251-4695-9ccc-ed47bb819f44 req-1297e9ad-179e-4b54-9f2a-7e9354b121d2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:31.583997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-757bba6a-c251-4695-9ccc-ed47bb819f44 req-1297e9ad-179e-4b54-9f2a-7e9354b121d2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:31.585119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-757bba6a-c251-4695-9ccc-ed47bb819f44 req-1297e9ad-179e-4b54-9f2a-7e9354b121d2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:31.643547 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-757bba6a-c251-4695-9ccc-ed47bb819f44 req-1297e9ad-179e-4b54-9f2a-7e9354b121d2 service nova] Creating event network-changed:3fc57237-0038-44cd-9586-8f19f883c4f0 for instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 on nch2-master-1 Sep 10 21:11:31.659057 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-757bba6a-c251-4695-9ccc-ed47bb819f44 req-1297e9ad-179e-4b54-9f2a-7e9354b121d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103328 Sep 10 21:11:31.660276 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2535/4974] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:32.006171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-afe0ad92-071a-4ced-96a7-33533df97328 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:32.007321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-afe0ad92-071a-4ced-96a7-33533df97328 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:32.021512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afe0ad92-071a-4ced-96a7-33533df97328 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:32.022360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afe0ad92-071a-4ced-96a7-33533df97328 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:32.024774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afe0ad92-071a-4ced-96a7-33533df97328 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:32.026177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afe0ad92-071a-4ced-96a7-33533df97328 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:32.027693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afe0ad92-071a-4ced-96a7-33533df97328 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:32.028427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-afe0ad92-071a-4ced-96a7-33533df97328 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:32.251715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-afe0ad92-071a-4ced-96a7-33533df97328 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:32.265356 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-afe0ad92-071a-4ced-96a7-33533df97328 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1368 microversion: 2.1 time: 0.261916 Sep 10 21:11:32.266762 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2440/4975] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:31 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:32.414358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:32.414994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:32.427563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:32.428064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:32.428512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:32.429240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:32.435599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:32.436278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:32.795500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:32.812731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:32.814248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:32.816106 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-62259416-b25a-4126-b0bf-343f51fa64cd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1598 microversion: 2.20 time: 0.407056 Sep 10 21:11:32.817170 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2536/4976] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:11:32 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1598 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:11:32.844555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0494068-83be-4a55-a0ed-d44fff20f3cb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:32.847287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0494068-83be-4a55-a0ed-d44fff20f3cb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:32.856627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0494068-83be-4a55-a0ed-d44fff20f3cb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:32.862479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0494068-83be-4a55-a0ed-d44fff20f3cb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:32.863422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0494068-83be-4a55-a0ed-d44fff20f3cb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:32.864589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0494068-83be-4a55-a0ed-d44fff20f3cb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:32.865214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0494068-83be-4a55-a0ed-d44fff20f3cb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:32.866100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0494068-83be-4a55-a0ed-d44fff20f3cb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:33.017703 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0494068-83be-4a55-a0ed-d44fff20f3cb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.180359 Sep 10 21:11:33.018482 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2441/4977] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Sep 10 21:11:32 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:11:33.292433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e072756-a0bf-48fb-8035-49db46982b12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:33.293311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e072756-a0bf-48fb-8035-49db46982b12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:33.305123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e072756-a0bf-48fb-8035-49db46982b12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:33.305123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e072756-a0bf-48fb-8035-49db46982b12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:33.305123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e072756-a0bf-48fb-8035-49db46982b12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:33.306008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e072756-a0bf-48fb-8035-49db46982b12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:33.306725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e072756-a0bf-48fb-8035-49db46982b12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:33.307497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e072756-a0bf-48fb-8035-49db46982b12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:33.659656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e072756-a0bf-48fb-8035-49db46982b12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:33.675896 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e072756-a0bf-48fb-8035-49db46982b12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1368 microversion: 2.1 time: 0.387450 Sep 10 21:11:33.677258 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2537/4978] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:33 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1368 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:34.701550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e19ded04-3634-4618-bf51-fb1882c17139 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:34.703676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e19ded04-3634-4618-bf51-fb1882c17139 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:34.714619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e19ded04-3634-4618-bf51-fb1882c17139 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:34.715307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e19ded04-3634-4618-bf51-fb1882c17139 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:34.715917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e19ded04-3634-4618-bf51-fb1882c17139 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:34.718307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e19ded04-3634-4618-bf51-fb1882c17139 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:34.720717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e19ded04-3634-4618-bf51-fb1882c17139 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:34.721335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e19ded04-3634-4618-bf51-fb1882c17139 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:34.775482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-fbb0cf62-9315-4fb5-b521-6ed6da30a1b3 req-9413cb9d-a4fc-4f23-9063-4ac37fffbe15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7919a6b0-623c-440c-bece-f3879f6a89ab", "tag": "07804208-07af-4af5-b975-15459b698f1d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:34.816745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-fbb0cf62-9315-4fb5-b521-6ed6da30a1b3 req-9413cb9d-a4fc-4f23-9063-4ac37fffbe15 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:34.819502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-fbb0cf62-9315-4fb5-b521-6ed6da30a1b3 req-9413cb9d-a4fc-4f23-9063-4ac37fffbe15 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:34.824363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-fbb0cf62-9315-4fb5-b521-6ed6da30a1b3 req-9413cb9d-a4fc-4f23-9063-4ac37fffbe15 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:34.849692 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-fbb0cf62-9315-4fb5-b521-6ed6da30a1b3 req-9413cb9d-a4fc-4f23-9063-4ac37fffbe15 service nova] Creating event network-changed:07804208-07af-4af5-b975-15459b698f1d for instance 7919a6b0-623c-440c-bece-f3879f6a89ab on nch2-master-1 Sep 10 21:11:34.856604 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-fbb0cf62-9315-4fb5-b521-6ed6da30a1b3 req-9413cb9d-a4fc-4f23-9063-4ac37fffbe15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085835 Sep 10 21:11:34.858928 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2538/4979] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:35.029219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e19ded04-3634-4618-bf51-fb1882c17139 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:35.042503 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e19ded04-3634-4618-bf51-fb1882c17139 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1368 microversion: 2.1 time: 0.346629 Sep 10 21:11:35.051669 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2442/4980] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:34 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:36.074646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a664624e-a23e-4c32-9664-5e86e01b8594 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:36.075371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a664624e-a23e-4c32-9664-5e86e01b8594 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:36.089159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a664624e-a23e-4c32-9664-5e86e01b8594 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:36.089759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a664624e-a23e-4c32-9664-5e86e01b8594 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:36.090117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a664624e-a23e-4c32-9664-5e86e01b8594 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:36.090875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a664624e-a23e-4c32-9664-5e86e01b8594 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:36.091306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a664624e-a23e-4c32-9664-5e86e01b8594 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:36.099213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a664624e-a23e-4c32-9664-5e86e01b8594 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:36.379229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a664624e-a23e-4c32-9664-5e86e01b8594 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:36.394529 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a664624e-a23e-4c32-9664-5e86e01b8594 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1368 microversion: 2.1 time: 0.324486 Sep 10 21:11:36.396152 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2539/4981] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:36 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1368 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:37.424556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9bebbd89-a6bf-4cdd-83f3-a8a2b2a16e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:37.425200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9bebbd89-a6bf-4cdd-83f3-a8a2b2a16e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:37.428061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:37.429327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=20 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:37.437519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bebbd89-a6bf-4cdd-83f3-a8a2b2a16e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:37.439203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bebbd89-a6bf-4cdd-83f3-a8a2b2a16e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:37.439872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bebbd89-a6bf-4cdd-83f3-a8a2b2a16e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:37.440518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bebbd89-a6bf-4cdd-83f3-a8a2b2a16e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:37.440996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bebbd89-a6bf-4cdd-83f3-a8a2b2a16e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:37.441422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9bebbd89-a6bf-4cdd-83f3-a8a2b2a16e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:37.655585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9bebbd89-a6bf-4cdd-83f3-a8a2b2a16e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:37.664732 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9bebbd89-a6bf-4cdd-83f3-a8a2b2a16e00 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1368 microversion: 2.1 time: 0.244020 Sep 10 21:11:37.687338 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2443/4982] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:37 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:37.696850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0013d4d8-b588-43b0-973d-36e6cd93c69c req-e7b7b8c0-3838-4901-82ed-caee141c5caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04e7926-fc3d-456a-ad4f-7099ef9811e9", "name": "network-vif-plugged", "status": "completed", "tag": "3fc57237-0038-44cd-9586-8f19f883c4f0"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:37.719202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:37.726132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0013d4d8-b588-43b0-973d-36e6cd93c69c req-e7b7b8c0-3838-4901-82ed-caee141c5caa service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:37.726634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0013d4d8-b588-43b0-973d-36e6cd93c69c req-e7b7b8c0-3838-4901-82ed-caee141c5caa service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:37.727086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0013d4d8-b588-43b0-973d-36e6cd93c69c req-e7b7b8c0-3838-4901-82ed-caee141c5caa service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:37.743982 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0013d4d8-b588-43b0-973d-36e6cd93c69c req-e7b7b8c0-3838-4901-82ed-caee141c5caa service nova] Creating event network-vif-plugged:3fc57237-0038-44cd-9586-8f19f883c4f0 for instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 on nch2-master-1 Sep 10 21:11:37.751552 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0013d4d8-b588-43b0-973d-36e6cd93c69c req-e7b7b8c0-3838-4901-82ed-caee141c5caa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059754 Sep 10 21:11:37.752945 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2540/4983] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:38.689892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9f569321-2695-4edf-b1f5-7f5fa717647d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:38.694669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9f569321-2695-4edf-b1f5-7f5fa717647d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:38.697571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:38.704621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f569321-2695-4edf-b1f5-7f5fa717647d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:38.705062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f569321-2695-4edf-b1f5-7f5fa717647d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:38.705505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f569321-2695-4edf-b1f5-7f5fa717647d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:38.706320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f569321-2695-4edf-b1f5-7f5fa717647d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:38.706824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f569321-2695-4edf-b1f5-7f5fa717647d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:38.707257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f569321-2695-4edf-b1f5-7f5fa717647d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:38.771875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e8ee206a-f145-4cff-9eda-52d21f8c0dad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:38.772662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e8ee206a-f145-4cff-9eda-52d21f8c0dad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:38.779886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8ee206a-f145-4cff-9eda-52d21f8c0dad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:38.780437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8ee206a-f145-4cff-9eda-52d21f8c0dad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:38.780948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8ee206a-f145-4cff-9eda-52d21f8c0dad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:38.781801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8ee206a-f145-4cff-9eda-52d21f8c0dad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:38.782373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8ee206a-f145-4cff-9eda-52d21f8c0dad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:38.782809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8ee206a-f145-4cff-9eda-52d21f8c0dad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:38.922663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9f569321-2695-4edf-b1f5-7f5fa717647d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:38.927406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e8ee206a-f145-4cff-9eda-52d21f8c0dad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:38.931886 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9f569321-2695-4edf-b1f5-7f5fa717647d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1368 microversion: 2.1 time: 0.246858 Sep 10 21:11:38.932586 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2444/4984] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:38 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:11:38.937347 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e8ee206a-f145-4cff-9eda-52d21f8c0dad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.170056 Sep 10 21:11:38.937964 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2541/4985] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:38 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:39.965864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d1b71661-5f98-449e-9745-00fb95c5f936 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:39.967431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d1b71661-5f98-449e-9745-00fb95c5f936 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:39.969574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-598fa0ae-a450-4239-8b44-e38dac3cd155 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:39.975226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1b71661-5f98-449e-9745-00fb95c5f936 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:39.975725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1b71661-5f98-449e-9745-00fb95c5f936 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:39.976172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1b71661-5f98-449e-9745-00fb95c5f936 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:39.977036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1b71661-5f98-449e-9745-00fb95c5f936 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:39.977728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1b71661-5f98-449e-9745-00fb95c5f936 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:39.978514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d1b71661-5f98-449e-9745-00fb95c5f936 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:39.978724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-598fa0ae-a450-4239-8b44-e38dac3cd155 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:39.987263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598fa0ae-a450-4239-8b44-e38dac3cd155 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:39.987619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598fa0ae-a450-4239-8b44-e38dac3cd155 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:39.988196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598fa0ae-a450-4239-8b44-e38dac3cd155 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:39.989061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598fa0ae-a450-4239-8b44-e38dac3cd155 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:39.989535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598fa0ae-a450-4239-8b44-e38dac3cd155 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:39.990072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-598fa0ae-a450-4239-8b44-e38dac3cd155 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:40.135200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d1b71661-5f98-449e-9745-00fb95c5f936 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:40.143932 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d1b71661-5f98-449e-9745-00fb95c5f936 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.183288 Sep 10 21:11:40.144801 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2542/4986] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:39 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:40.155968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-598fa0ae-a450-4239-8b44-e38dac3cd155 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:40.168605 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-598fa0ae-a450-4239-8b44-e38dac3cd155 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1557 microversion: 2.1 time: 0.209563 Sep 10 21:11:40.169850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2445/4987] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:39 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1557 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:40.170902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6dfafac3-97c3-48df-b74c-c42fd14e875a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-2144261505"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:40.173421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6dfafac3-97c3-48df-b74c-c42fd14e875a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:40.179613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfafac3-97c3-48df-b74c-c42fd14e875a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:40.180329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfafac3-97c3-48df-b74c-c42fd14e875a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:40.180973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfafac3-97c3-48df-b74c-c42fd14e875a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:40.181891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfafac3-97c3-48df-b74c-c42fd14e875a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:40.182538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfafac3-97c3-48df-b74c-c42fd14e875a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:40.182950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfafac3-97c3-48df-b74c-c42fd14e875a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:40.192686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c9d83e8b-cb47-4989-973e-526f7cbb602f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:40.193183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c9d83e8b-cb47-4989-973e-526f7cbb602f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:40.199379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d83e8b-cb47-4989-973e-526f7cbb602f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:40.199869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d83e8b-cb47-4989-973e-526f7cbb602f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:40.200703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d83e8b-cb47-4989-973e-526f7cbb602f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:40.201474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d83e8b-cb47-4989-973e-526f7cbb602f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:40.202015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d83e8b-cb47-4989-973e-526f7cbb602f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:40.202384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9d83e8b-cb47-4989-973e-526f7cbb602f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:40.287670 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c9d83e8b-cb47-4989-973e-526f7cbb602f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098949 Sep 10 21:11:40.288341 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2446/4988] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:11:40 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:11:40.418839 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6dfafac3-97c3-48df-b74c-c42fd14e875a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.251563 Sep 10 21:11:40.421125 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2543/4989] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:11:40 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Sep 10 21:11:41.640219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-62f30b2c-3d4f-4f96-8935-d6b5219f125d req-3fbc9267-523e-45a2-8e48-d09103fc33f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04e7926-fc3d-456a-ad4f-7099ef9811e9", "tag": "3fc57237-0038-44cd-9586-8f19f883c4f0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:41.649999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-62f30b2c-3d4f-4f96-8935-d6b5219f125d req-3fbc9267-523e-45a2-8e48-d09103fc33f2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:41.650602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-62f30b2c-3d4f-4f96-8935-d6b5219f125d req-3fbc9267-523e-45a2-8e48-d09103fc33f2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:41.651075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-62f30b2c-3d4f-4f96-8935-d6b5219f125d req-3fbc9267-523e-45a2-8e48-d09103fc33f2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:41.663226 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-62f30b2c-3d4f-4f96-8935-d6b5219f125d req-3fbc9267-523e-45a2-8e48-d09103fc33f2 service nova] Creating event network-changed:3fc57237-0038-44cd-9586-8f19f883c4f0 for instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 on nch2-master-1 Sep 10 21:11:41.668263 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-62f30b2c-3d4f-4f96-8935-d6b5219f125d req-3fbc9267-523e-45a2-8e48-d09103fc33f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032770 Sep 10 21:11:41.668865 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2447/4990] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:43.670026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-20315623-da28-4590-a618-70f522a5e8e0 req-8cdcdde7-7919-4e03-be0b-1f38890e012a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010766a5-73d4-43bc-8b9b-915530aac069", "name": "network-vif-unplugged", "status": "completed", "tag": "b3cfb9e7-e626-4a76-b620-73dfc70c87cd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:43.681440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-20315623-da28-4590-a618-70f522a5e8e0 req-8cdcdde7-7919-4e03-be0b-1f38890e012a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:43.682111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-20315623-da28-4590-a618-70f522a5e8e0 req-8cdcdde7-7919-4e03-be0b-1f38890e012a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:43.682666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-20315623-da28-4590-a618-70f522a5e8e0 req-8cdcdde7-7919-4e03-be0b-1f38890e012a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:43.695349 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-20315623-da28-4590-a618-70f522a5e8e0 req-8cdcdde7-7919-4e03-be0b-1f38890e012a service nova] Creating event network-vif-unplugged:b3cfb9e7-e626-4a76-b620-73dfc70c87cd for instance 010766a5-73d4-43bc-8b9b-915530aac069 on nch2-master-1 Sep 10 21:11:43.700293 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-20315623-da28-4590-a618-70f522a5e8e0 req-8cdcdde7-7919-4e03-be0b-1f38890e012a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036417 Sep 10 21:11:43.701295 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2544/4991] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:45.721139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-034338e3-1b5c-4e58-a7ee-326c66cb6017 req-7980ca7a-793f-4035-8938-c8c3b82249f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010766a5-73d4-43bc-8b9b-915530aac069", "name": "network-vif-plugged", "status": "completed", "tag": "b3cfb9e7-e626-4a76-b620-73dfc70c87cd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:45.737639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-034338e3-1b5c-4e58-a7ee-326c66cb6017 req-7980ca7a-793f-4035-8938-c8c3b82249f0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:45.738154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-034338e3-1b5c-4e58-a7ee-326c66cb6017 req-7980ca7a-793f-4035-8938-c8c3b82249f0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:45.738597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-034338e3-1b5c-4e58-a7ee-326c66cb6017 req-7980ca7a-793f-4035-8938-c8c3b82249f0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:45.750844 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-034338e3-1b5c-4e58-a7ee-326c66cb6017 req-7980ca7a-793f-4035-8938-c8c3b82249f0 service nova] Creating event network-vif-plugged:b3cfb9e7-e626-4a76-b620-73dfc70c87cd for instance 010766a5-73d4-43bc-8b9b-915530aac069 on nch2-master-1 Sep 10 21:11:45.756042 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-034338e3-1b5c-4e58-a7ee-326c66cb6017 req-7980ca7a-793f-4035-8938-c8c3b82249f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041035 Sep 10 21:11:45.757327 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2448/4992] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:11:54.930535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86f1fabc-beee-4376-9be6-0d9c96ff2903 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:54.931243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-86f1fabc-beee-4376-9be6-0d9c96ff2903 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:54.938423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=35 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:54.939081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:54.945459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86f1fabc-beee-4376-9be6-0d9c96ff2903 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:54.945986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86f1fabc-beee-4376-9be6-0d9c96ff2903 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:54.946425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86f1fabc-beee-4376-9be6-0d9c96ff2903 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:54.947127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86f1fabc-beee-4376-9be6-0d9c96ff2903 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:54.947582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86f1fabc-beee-4376-9be6-0d9c96ff2903 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:54.948009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86f1fabc-beee-4376-9be6-0d9c96ff2903 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:55.095004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-86f1fabc-beee-4376-9be6-0d9c96ff2903 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:55.102947 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-86f1fabc-beee-4376-9be6-0d9c96ff2903 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.176871 Sep 10 21:11:55.103796 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2545/4993] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:54 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:55.128781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9f3895dd-42b0-4194-a3b4-036caa7226ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1520966977"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:55.131324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9f3895dd-42b0-4194-a3b4-036caa7226ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:55.138540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3895dd-42b0-4194-a3b4-036caa7226ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:55.139347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3895dd-42b0-4194-a3b4-036caa7226ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:55.139794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3895dd-42b0-4194-a3b4-036caa7226ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:55.140522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3895dd-42b0-4194-a3b4-036caa7226ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:55.140982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3895dd-42b0-4194-a3b4-036caa7226ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:55.141411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3895dd-42b0-4194-a3b4-036caa7226ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:55.144469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=88 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:11:55.352225 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9f3895dd-42b0-4194-a3b4-036caa7226ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.228908 Sep 10 21:11:55.353217 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2449/4994] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:11:55 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 10 21:11:55.362617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-91b2f568-62ed-4e6a-ac49-17030ff8bcd5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:55.363241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-91b2f568-62ed-4e6a-ac49-17030ff8bcd5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:55.369606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91b2f568-62ed-4e6a-ac49-17030ff8bcd5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:55.370248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91b2f568-62ed-4e6a-ac49-17030ff8bcd5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:55.370707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91b2f568-62ed-4e6a-ac49-17030ff8bcd5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:55.371514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91b2f568-62ed-4e6a-ac49-17030ff8bcd5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:55.379009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91b2f568-62ed-4e6a-ac49-17030ff8bcd5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:55.379501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-91b2f568-62ed-4e6a-ac49-17030ff8bcd5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:55.525070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-91b2f568-62ed-4e6a-ac49-17030ff8bcd5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:55.533633 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-91b2f568-62ed-4e6a-ac49-17030ff8bcd5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.174918 Sep 10 21:11:55.534260 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2546/4995] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:55 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:56.557986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4cd14278-e96a-4c92-8f35-550a34036d06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:56.558704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4cd14278-e96a-4c92-8f35-550a34036d06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:56.565270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cd14278-e96a-4c92-8f35-550a34036d06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:56.565754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cd14278-e96a-4c92-8f35-550a34036d06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:56.566225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cd14278-e96a-4c92-8f35-550a34036d06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:56.566921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cd14278-e96a-4c92-8f35-550a34036d06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:56.567378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cd14278-e96a-4c92-8f35-550a34036d06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:56.567807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cd14278-e96a-4c92-8f35-550a34036d06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:56.705658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4cd14278-e96a-4c92-8f35-550a34036d06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:56.713609 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4cd14278-e96a-4c92-8f35-550a34036d06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.160817 Sep 10 21:11:56.714226 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2450/4996] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:56 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:57.737614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3d5a1380-673a-4e99-9ff7-112e62d039dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:57.738251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3d5a1380-673a-4e99-9ff7-112e62d039dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:57.744832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d5a1380-673a-4e99-9ff7-112e62d039dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:57.745310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d5a1380-673a-4e99-9ff7-112e62d039dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:57.745745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d5a1380-673a-4e99-9ff7-112e62d039dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:57.746455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d5a1380-673a-4e99-9ff7-112e62d039dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:57.746910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d5a1380-673a-4e99-9ff7-112e62d039dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:57.747509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d5a1380-673a-4e99-9ff7-112e62d039dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:57.884596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3d5a1380-673a-4e99-9ff7-112e62d039dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:57.892952 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3d5a1380-673a-4e99-9ff7-112e62d039dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1688 microversion: 2.1 time: 0.159228 Sep 10 21:11:57.893552 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2547/4997] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:57 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:58.917573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-33b40c39-86f8-440b-90a4-6c55617583bd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:11:58.918184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-33b40c39-86f8-440b-90a4-6c55617583bd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:11:58.926095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b40c39-86f8-440b-90a4-6c55617583bd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:58.926589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b40c39-86f8-440b-90a4-6c55617583bd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:58.927038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b40c39-86f8-440b-90a4-6c55617583bd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:58.927797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b40c39-86f8-440b-90a4-6c55617583bd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:58.928496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b40c39-86f8-440b-90a4-6c55617583bd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:58.928963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-33b40c39-86f8-440b-90a4-6c55617583bd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:59.064122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-33b40c39-86f8-440b-90a4-6c55617583bd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:11:59.075753 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-33b40c39-86f8-440b-90a4-6c55617583bd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1688 microversion: 2.1 time: 0.161886 Sep 10 21:11:59.076487 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2451/4998] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:11:58 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:11:59.866594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-94833619-1de0-450a-8a35-013a9b4f71b6 req-58ddf70f-8b8c-40f0-a49c-3299c7573c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010766a5-73d4-43bc-8b9b-915530aac069", "name": "network-vif-unplugged", "status": "completed", "tag": "b3cfb9e7-e626-4a76-b620-73dfc70c87cd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:11:59.878509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-94833619-1de0-450a-8a35-013a9b4f71b6 req-58ddf70f-8b8c-40f0-a49c-3299c7573c95 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:11:59.879319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-94833619-1de0-450a-8a35-013a9b4f71b6 req-58ddf70f-8b8c-40f0-a49c-3299c7573c95 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:11:59.879965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-94833619-1de0-450a-8a35-013a9b4f71b6 req-58ddf70f-8b8c-40f0-a49c-3299c7573c95 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:11:59.893460 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-94833619-1de0-450a-8a35-013a9b4f71b6 req-58ddf70f-8b8c-40f0-a49c-3299c7573c95 service nova] Creating event network-vif-unplugged:b3cfb9e7-e626-4a76-b620-73dfc70c87cd for instance 010766a5-73d4-43bc-8b9b-915530aac069 on nch2-master-1 Sep 10 21:11:59.899528 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-94833619-1de0-450a-8a35-013a9b4f71b6 req-58ddf70f-8b8c-40f0-a49c-3299c7573c95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036792 Sep 10 21:11:59.901076 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2548/4999] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:00.101007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0d51552-972f-47e6-9e14-9fc7d2842a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:00.102746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0d51552-972f-47e6-9e14-9fc7d2842a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:00.111865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d51552-972f-47e6-9e14-9fc7d2842a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:00.112357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d51552-972f-47e6-9e14-9fc7d2842a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:00.112798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d51552-972f-47e6-9e14-9fc7d2842a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:00.113499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d51552-972f-47e6-9e14-9fc7d2842a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:00.114003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d51552-972f-47e6-9e14-9fc7d2842a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:00.114430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0d51552-972f-47e6-9e14-9fc7d2842a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:00.280091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c0d51552-972f-47e6-9e14-9fc7d2842a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:00.289730 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0d51552-972f-47e6-9e14-9fc7d2842a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.193802 Sep 10 21:12:00.291014 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2452/5000] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:00 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:01.319571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34339fe5-ad82-463b-ba47-5a8a8ec06601 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:01.322212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-34339fe5-ad82-463b-ba47-5a8a8ec06601 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:01.352018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34339fe5-ad82-463b-ba47-5a8a8ec06601 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:01.352825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34339fe5-ad82-463b-ba47-5a8a8ec06601 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:01.354144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34339fe5-ad82-463b-ba47-5a8a8ec06601 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:01.355621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34339fe5-ad82-463b-ba47-5a8a8ec06601 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:01.356944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34339fe5-ad82-463b-ba47-5a8a8ec06601 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:01.357559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34339fe5-ad82-463b-ba47-5a8a8ec06601 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:01.599673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-34339fe5-ad82-463b-ba47-5a8a8ec06601 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:01.613229 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-34339fe5-ad82-463b-ba47-5a8a8ec06601 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.300564 Sep 10 21:12:01.616856 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2549/5001] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:01 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:12:02.116673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b6631b0f-c82b-4b63-8558-0e42e0c67e9a req-427d9b37-a790-4e04-8503-41a1fda6a837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010766a5-73d4-43bc-8b9b-915530aac069", "name": "network-vif-plugged", "status": "completed", "tag": "b3cfb9e7-e626-4a76-b620-73dfc70c87cd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:02.141308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b6631b0f-c82b-4b63-8558-0e42e0c67e9a req-427d9b37-a790-4e04-8503-41a1fda6a837 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:02.142315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b6631b0f-c82b-4b63-8558-0e42e0c67e9a req-427d9b37-a790-4e04-8503-41a1fda6a837 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:02.143187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b6631b0f-c82b-4b63-8558-0e42e0c67e9a req-427d9b37-a790-4e04-8503-41a1fda6a837 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:02.161775 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b6631b0f-c82b-4b63-8558-0e42e0c67e9a req-427d9b37-a790-4e04-8503-41a1fda6a837 service nova] Creating event network-vif-plugged:b3cfb9e7-e626-4a76-b620-73dfc70c87cd for instance 010766a5-73d4-43bc-8b9b-915530aac069 on nch2-master-1 Sep 10 21:12:02.168393 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b6631b0f-c82b-4b63-8558-0e42e0c67e9a req-427d9b37-a790-4e04-8503-41a1fda6a837 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059098 Sep 10 21:12:02.170671 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2453/5002] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:12:02.641596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4063a94f-4541-4a82-8f1f-0be2fdde6402 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:02.643036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4063a94f-4541-4a82-8f1f-0be2fdde6402 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:02.652426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4063a94f-4541-4a82-8f1f-0be2fdde6402 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:02.654557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4063a94f-4541-4a82-8f1f-0be2fdde6402 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:02.655731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4063a94f-4541-4a82-8f1f-0be2fdde6402 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:02.656643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4063a94f-4541-4a82-8f1f-0be2fdde6402 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:02.657336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4063a94f-4541-4a82-8f1f-0be2fdde6402 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:02.657996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4063a94f-4541-4a82-8f1f-0be2fdde6402 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:03.017636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4063a94f-4541-4a82-8f1f-0be2fdde6402 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:03.029430 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4063a94f-4541-4a82-8f1f-0be2fdde6402 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.393544 Sep 10 21:12:03.031237 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2550/5003] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:02 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:04.054769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4e80ea59-3e7b-4044-acad-188da6feede6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:04.056326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4e80ea59-3e7b-4044-acad-188da6feede6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:04.080917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e80ea59-3e7b-4044-acad-188da6feede6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:04.082389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e80ea59-3e7b-4044-acad-188da6feede6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:04.083036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e80ea59-3e7b-4044-acad-188da6feede6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:04.083980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e80ea59-3e7b-4044-acad-188da6feede6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:04.102013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e80ea59-3e7b-4044-acad-188da6feede6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:04.102533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e80ea59-3e7b-4044-acad-188da6feede6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:04.380114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e80ea59-3e7b-4044-acad-188da6feede6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:04.392215 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4e80ea59-3e7b-4044-acad-188da6feede6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.341623 Sep 10 21:12:04.393210 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2454/5004] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:04 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:05.423215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-50951ea9-e152-4672-b0b1-a2d256915c06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:05.424078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-50951ea9-e152-4672-b0b1-a2d256915c06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:05.438274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50951ea9-e152-4672-b0b1-a2d256915c06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:05.439062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50951ea9-e152-4672-b0b1-a2d256915c06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:05.441423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50951ea9-e152-4672-b0b1-a2d256915c06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:05.442437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50951ea9-e152-4672-b0b1-a2d256915c06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:05.444822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50951ea9-e152-4672-b0b1-a2d256915c06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:05.445694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50951ea9-e152-4672-b0b1-a2d256915c06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:05.717412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-50951ea9-e152-4672-b0b1-a2d256915c06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:05.726641 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-50951ea9-e152-4672-b0b1-a2d256915c06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.310698 Sep 10 21:12:05.731734 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2551/5005] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:05 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:06.755853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a39d6ad6-8c8f-4019-aa03-8fbd78c87a06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:06.757757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a39d6ad6-8c8f-4019-aa03-8fbd78c87a06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:06.768411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a39d6ad6-8c8f-4019-aa03-8fbd78c87a06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:06.771384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a39d6ad6-8c8f-4019-aa03-8fbd78c87a06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:06.772051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a39d6ad6-8c8f-4019-aa03-8fbd78c87a06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:06.772786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a39d6ad6-8c8f-4019-aa03-8fbd78c87a06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:06.773439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a39d6ad6-8c8f-4019-aa03-8fbd78c87a06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:06.773903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a39d6ad6-8c8f-4019-aa03-8fbd78c87a06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:06.987942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a39d6ad6-8c8f-4019-aa03-8fbd78c87a06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:07.002598 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a39d6ad6-8c8f-4019-aa03-8fbd78c87a06 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.251896 Sep 10 21:12:07.003906 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2455/5006] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:06 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:08.033809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c655359f-75ee-4613-92fe-5a353259292c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:08.035202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c655359f-75ee-4613-92fe-5a353259292c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:08.064281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c655359f-75ee-4613-92fe-5a353259292c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:08.071805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c655359f-75ee-4613-92fe-5a353259292c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:08.072282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c655359f-75ee-4613-92fe-5a353259292c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:08.073045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c655359f-75ee-4613-92fe-5a353259292c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:08.078122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c655359f-75ee-4613-92fe-5a353259292c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:08.081325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c655359f-75ee-4613-92fe-5a353259292c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:08.409976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c655359f-75ee-4613-92fe-5a353259292c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:08.432554 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c655359f-75ee-4613-92fe-5a353259292c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.405449 Sep 10 21:12:08.457318 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2552/5007] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:08 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:09.464024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4ef6fb67-d2a2-4c32-9b12-d388b7d65826 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:09.468722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4ef6fb67-d2a2-4c32-9b12-d388b7d65826 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:09.479682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=24 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:09.488982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef6fb67-d2a2-4c32-9b12-d388b7d65826 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:09.490708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef6fb67-d2a2-4c32-9b12-d388b7d65826 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:09.492026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef6fb67-d2a2-4c32-9b12-d388b7d65826 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:09.494030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef6fb67-d2a2-4c32-9b12-d388b7d65826 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:09.494964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef6fb67-d2a2-4c32-9b12-d388b7d65826 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:09.495619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ef6fb67-d2a2-4c32-9b12-d388b7d65826 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:09.882260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4ef6fb67-d2a2-4c32-9b12-d388b7d65826 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:09.901175 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4ef6fb67-d2a2-4c32-9b12-d388b7d65826 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.441085 Sep 10 21:12:09.903860 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2456/5008] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:09 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:10.927908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5bd594fd-a0dc-41be-94a1-264d7bf42b54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:10.928873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5bd594fd-a0dc-41be-94a1-264d7bf42b54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:10.940219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd594fd-a0dc-41be-94a1-264d7bf42b54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:10.944912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd594fd-a0dc-41be-94a1-264d7bf42b54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:10.945713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd594fd-a0dc-41be-94a1-264d7bf42b54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:10.946816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd594fd-a0dc-41be-94a1-264d7bf42b54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:10.948093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd594fd-a0dc-41be-94a1-264d7bf42b54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:10.951920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bd594fd-a0dc-41be-94a1-264d7bf42b54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:11.568584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5bd594fd-a0dc-41be-94a1-264d7bf42b54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:11.579468 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5bd594fd-a0dc-41be-94a1-264d7bf42b54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.655602 Sep 10 21:12:11.580959 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2553/5009] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:10 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:12.609646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27d2c989-569d-4f2d-a51f-ab4af38ef5f0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:12.612882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-27d2c989-569d-4f2d-a51f-ab4af38ef5f0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:12.629654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d2c989-569d-4f2d-a51f-ab4af38ef5f0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:12.630183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d2c989-569d-4f2d-a51f-ab4af38ef5f0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:12.630828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d2c989-569d-4f2d-a51f-ab4af38ef5f0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:12.632386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d2c989-569d-4f2d-a51f-ab4af38ef5f0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:12.633200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d2c989-569d-4f2d-a51f-ab4af38ef5f0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:12.634055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27d2c989-569d-4f2d-a51f-ab4af38ef5f0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:12.926487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27d2c989-569d-4f2d-a51f-ab4af38ef5f0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:12.940588 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27d2c989-569d-4f2d-a51f-ab4af38ef5f0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.334733 Sep 10 21:12:12.941746 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2457/5010] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:12 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:13.984995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-700bc0d0-cb6d-4463-b1a1-e6086ed39dc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:13.985573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-700bc0d0-cb6d-4463-b1a1-e6086ed39dc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:14.007481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700bc0d0-cb6d-4463-b1a1-e6086ed39dc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:14.008395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700bc0d0-cb6d-4463-b1a1-e6086ed39dc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:14.009101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700bc0d0-cb6d-4463-b1a1-e6086ed39dc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:14.010116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700bc0d0-cb6d-4463-b1a1-e6086ed39dc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:14.011276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700bc0d0-cb6d-4463-b1a1-e6086ed39dc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:14.011945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700bc0d0-cb6d-4463-b1a1-e6086ed39dc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:14.338759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-700bc0d0-cb6d-4463-b1a1-e6086ed39dc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:14.358546 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-700bc0d0-cb6d-4463-b1a1-e6086ed39dc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.388319 Sep 10 21:12:14.360868 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2554/5011] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:13 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:14.756270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d44e510-3ee8-4c5a-96b0-bec8b47a1c17 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1511486494", "availability_zone": "foo_zone"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:14.760227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.aggregate [None req-9d44e510-3ee8-4c5a-96b0-bec8b47a1c17 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Generated uuid 0a7e3380-dc72-4198-af8c-d64b2a6c680e for aggregate {{(pid=145771) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 21:12:14.803417 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d44e510-3ee8-4c5a-96b0-bec8b47a1c17 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.206255 Sep 10 21:12:14.804062 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2458/5012] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Sep 10 21:12:14 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:14.817633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bd265929-0a40-4d48-8833-0535f73ab29d tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:14.855478 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bd265929-0a40-4d48-8833-0535f73ab29d tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.042479 Sep 10 21:12:14.865943 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2555/5013] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Sep 10 21:12:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:14.870135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c4c70a6e-4d2d-4d4e-8133-89a68640deb7 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:14.874703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4c70a6e-4d2d-4d4e-8133-89a68640deb7 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:14.875202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4c70a6e-4d2d-4d4e-8133-89a68640deb7 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:14.875650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4c70a6e-4d2d-4d4e-8133-89a68640deb7 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:14.876391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4c70a6e-4d2d-4d4e-8133-89a68640deb7 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:14.876857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4c70a6e-4d2d-4d4e-8133-89a68640deb7 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:14.877295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c4c70a6e-4d2d-4d4e-8133-89a68640deb7 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:14.922697 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c4c70a6e-4d2d-4d4e-8133-89a68640deb7 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056425 Sep 10 21:12:14.923337 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2459/5014] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Sep 10 21:12:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:14.939129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a4c564b-4797-43ad-8176-4b13d1592216 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:14.949332 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a4c564b-4797-43ad-8176-4b13d1592216 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.015384 Sep 10 21:12:14.957198 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2556/5015] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Sep 10 21:12:14 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:12:14.962731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-841f63dc-e38f-4592-a18f-d48bca63ee88 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:14.974396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-841f63dc-e38f-4592-a18f-d48bca63ee88 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:14.974893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-841f63dc-e38f-4592-a18f-d48bca63ee88 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:14.975342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-841f63dc-e38f-4592-a18f-d48bca63ee88 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:15.301459 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-841f63dc-e38f-4592-a18f-d48bca63ee88 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.342583 Sep 10 21:12:15.302407 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2460/5016] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Sep 10 21:12:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:15.314828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5fbab7b5-ae82-431b-9c1d-109ef1013b90 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:15.324286 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5fbab7b5-ae82-431b-9c1d-109ef1013b90 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.013125 Sep 10 21:12:15.325399 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2557/5017] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 21:12:15 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:12:15.340084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bf18848d-dad6-4be8-8b7c-ba6ad77ae534 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1351119970", "availability_zone": "foo_zone"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:15.382487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d326e8f9-e7bc-4217-ac60-b50ef3e3d986 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:15.383236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d326e8f9-e7bc-4217-ac60-b50ef3e3d986 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:15.392040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d326e8f9-e7bc-4217-ac60-b50ef3e3d986 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:15.392307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d326e8f9-e7bc-4217-ac60-b50ef3e3d986 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:15.392845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d326e8f9-e7bc-4217-ac60-b50ef3e3d986 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:15.394092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d326e8f9-e7bc-4217-ac60-b50ef3e3d986 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:15.394651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d326e8f9-e7bc-4217-ac60-b50ef3e3d986 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:15.395258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d326e8f9-e7bc-4217-ac60-b50ef3e3d986 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:15.422661 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bf18848d-dad6-4be8-8b7c-ba6ad77ae534 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.087660 Sep 10 21:12:15.430311 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2461/5018] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Sep 10 21:12:15 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:15.438733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-761bc354-5663-49bc-b1e8-3ccb32b8336b tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:15.508565 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-761bc354-5663-49bc-b1e8-3ccb32b8336b tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.071949 Sep 10 21:12:15.517326 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2462/5019] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Sep 10 21:12:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:15.525056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4f7e8e94-d5d9-42eb-94eb-d113bf18a7cd tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:15.543269 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4f7e8e94-d5d9-42eb-94eb-d113bf18a7cd tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.023872 Sep 10 21:12:15.544817 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2463/5020] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 21:12:15 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:15.559939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cdd8f0a1-87b9-4bcf-82b0-f49aff58acca tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:15.576078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdd8f0a1-87b9-4bcf-82b0-f49aff58acca tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:15.577169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdd8f0a1-87b9-4bcf-82b0-f49aff58acca tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:15.577802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdd8f0a1-87b9-4bcf-82b0-f49aff58acca tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:15.682172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d326e8f9-e7bc-4217-ac60-b50ef3e3d986 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:15.691971 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d326e8f9-e7bc-4217-ac60-b50ef3e3d986 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1687 microversion: 2.1 time: 0.313199 Sep 10 21:12:15.693586 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2558/5021] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:15 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1687 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:15.760960 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cdd8f0a1-87b9-4bcf-82b0-f49aff58acca tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.204339 Sep 10 21:12:15.771548 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2464/5022] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Sep 10 21:12:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:15.775853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f06bc2ef-c226-4f50-9199-9b631ab2fa96 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:15.815586 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f06bc2ef-c226-4f50-9199-9b631ab2fa96 tempest-TestAggregatesBasicOps-559308324 tempest-TestAggregatesBasicOps-559308324-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.042779 Sep 10 21:12:15.817016 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2559/5023] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 21:12:15 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 21:12:16.722064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4040f0bd-df5a-41ec-8e70-35dae38b59fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:16.722846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4040f0bd-df5a-41ec-8e70-35dae38b59fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:16.731358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4040f0bd-df5a-41ec-8e70-35dae38b59fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:16.731993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4040f0bd-df5a-41ec-8e70-35dae38b59fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:16.732589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4040f0bd-df5a-41ec-8e70-35dae38b59fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:16.733912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4040f0bd-df5a-41ec-8e70-35dae38b59fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:16.734451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4040f0bd-df5a-41ec-8e70-35dae38b59fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:16.735100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4040f0bd-df5a-41ec-8e70-35dae38b59fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:16.982527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4040f0bd-df5a-41ec-8e70-35dae38b59fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:16.993696 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4040f0bd-df5a-41ec-8e70-35dae38b59fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1683 microversion: 2.1 time: 0.275507 Sep 10 21:12:16.994835 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2465/5024] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:16 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1683 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:18.019739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0ac73f8c-5c87-495b-b08f-e8392c2f5f2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:18.021069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0ac73f8c-5c87-495b-b08f-e8392c2f5f2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:18.030766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ac73f8c-5c87-495b-b08f-e8392c2f5f2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:18.035721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ac73f8c-5c87-495b-b08f-e8392c2f5f2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:18.036511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ac73f8c-5c87-495b-b08f-e8392c2f5f2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:18.037472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ac73f8c-5c87-495b-b08f-e8392c2f5f2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:18.038204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ac73f8c-5c87-495b-b08f-e8392c2f5f2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:18.038813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ac73f8c-5c87-495b-b08f-e8392c2f5f2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:18.119868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f012a9a7-082f-4c1b-aa91-c30c0fa4cee9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:18.120426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f012a9a7-082f-4c1b-aa91-c30c0fa4cee9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:18.127664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f012a9a7-082f-4c1b-aa91-c30c0fa4cee9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:18.128460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f012a9a7-082f-4c1b-aa91-c30c0fa4cee9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:18.129082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f012a9a7-082f-4c1b-aa91-c30c0fa4cee9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:18.130009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f012a9a7-082f-4c1b-aa91-c30c0fa4cee9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:18.130645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f012a9a7-082f-4c1b-aa91-c30c0fa4cee9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:18.131253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f012a9a7-082f-4c1b-aa91-c30c0fa4cee9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:18.175598 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f012a9a7-082f-4c1b-aa91-c30c0fa4cee9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/ips" status: 200 len: 152 microversion: 2.20 time: 0.059644 Sep 10 21:12:18.176477 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2466/5025] 10.222.0.33 () {60 vars in 1289 bytes} [Sat Sep 10 21:12:18 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/ips => generated 152 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:12:18.274228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0ac73f8c-5c87-495b-b08f-e8392c2f5f2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:18.284819 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0ac73f8c-5c87-495b-b08f-e8392c2f5f2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.268946 Sep 10 21:12:18.287052 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2560/5026] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:18 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:18.420927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3970ea6-969d-49a9-8c51-2a9d542afc55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:18.421564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e3970ea6-969d-49a9-8c51-2a9d542afc55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:18.428496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3970ea6-969d-49a9-8c51-2a9d542afc55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:18.429239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3970ea6-969d-49a9-8c51-2a9d542afc55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:18.429906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3970ea6-969d-49a9-8c51-2a9d542afc55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:18.430793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3970ea6-969d-49a9-8c51-2a9d542afc55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:18.431423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3970ea6-969d-49a9-8c51-2a9d542afc55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:18.432031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3970ea6-969d-49a9-8c51-2a9d542afc55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:18.704487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e3970ea6-969d-49a9-8c51-2a9d542afc55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:18.713592 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3970ea6-969d-49a9-8c51-2a9d542afc55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.296799 Sep 10 21:12:18.717629 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2467/5027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:18 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:18.893355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-01105356-e905-4196-8aff-97a18db72fec tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:18.894142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-01105356-e905-4196-8aff-97a18db72fec tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:18.903908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01105356-e905-4196-8aff-97a18db72fec tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:18.904426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01105356-e905-4196-8aff-97a18db72fec tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:18.904866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01105356-e905-4196-8aff-97a18db72fec tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:18.910662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01105356-e905-4196-8aff-97a18db72fec tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:18.911165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01105356-e905-4196-8aff-97a18db72fec tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:18.911620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01105356-e905-4196-8aff-97a18db72fec tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:18.957869 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-01105356-e905-4196-8aff-97a18db72fec tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/ips" status: 200 len: 145 microversion: 2.1 time: 0.069088 Sep 10 21:12:18.979980 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2561/5028] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:12:18 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/ips => generated 145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:20.243052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f7e5edaa-f72b-4d7e-b656-a4852b0683ab tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:20.244665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f7e5edaa-f72b-4d7e-b656-a4852b0683ab tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:20.272836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-925acb76-fee8-4bc8-9dfe-7199a406a5e5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:20.273400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-925acb76-fee8-4bc8-9dfe-7199a406a5e5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:20.295292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7e5edaa-f72b-4d7e-b656-a4852b0683ab tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:20.295810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7e5edaa-f72b-4d7e-b656-a4852b0683ab tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:20.296259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7e5edaa-f72b-4d7e-b656-a4852b0683ab tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:20.298519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-925acb76-fee8-4bc8-9dfe-7199a406a5e5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:20.299018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-925acb76-fee8-4bc8-9dfe-7199a406a5e5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:20.299456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-925acb76-fee8-4bc8-9dfe-7199a406a5e5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:20.300165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-925acb76-fee8-4bc8-9dfe-7199a406a5e5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:20.300620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-925acb76-fee8-4bc8-9dfe-7199a406a5e5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:20.301161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7e5edaa-f72b-4d7e-b656-a4852b0683ab tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:20.301640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7e5edaa-f72b-4d7e-b656-a4852b0683ab tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:20.302092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7e5edaa-f72b-4d7e-b656-a4852b0683ab tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:20.303764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-925acb76-fee8-4bc8-9dfe-7199a406a5e5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:20.339328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-925acb76-fee8-4bc8-9dfe-7199a406a5e5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lazy-loading 'flavor' on Instance uuid 7919a6b0-623c-440c-bece-f3879f6a89ab {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:12:20.586289 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-925acb76-fee8-4bc8-9dfe-7199a406a5e5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "POST /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/action" status: 202 len: 0 microversion: 2.20 time: 0.322675 Sep 10 21:12:20.587033 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2562/5029] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 21:12:20 2022] POST /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:12:20.593530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a9283e83-ba3d-43cf-8c71-861008545fc7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b4d016b-33f9-4632-b4f7-987f5e850cc0"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:20.596688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9283e83-ba3d-43cf-8c71-861008545fc7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:20.606087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9283e83-ba3d-43cf-8c71-861008545fc7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:20.606846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9283e83-ba3d-43cf-8c71-861008545fc7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:20.607506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9283e83-ba3d-43cf-8c71-861008545fc7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:20.608499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9283e83-ba3d-43cf-8c71-861008545fc7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:20.608986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9283e83-ba3d-43cf-8c71-861008545fc7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:20.609471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9283e83-ba3d-43cf-8c71-861008545fc7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:20.614360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f7e5edaa-f72b-4d7e-b656-a4852b0683ab tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:20.626471 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f7e5edaa-f72b-4d7e-b656-a4852b0683ab tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.390105 Sep 10 21:12:20.627537 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2468/5030] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:20 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:20.632969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:20.633716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:20.654744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:20.655321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:20.655842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:20.656723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:20.657356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:20.657873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:20.821486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:20.832433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:20.833917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:20.835115 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-87843436-8e57-42f1-bad9-bc23cf750289 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1723 microversion: 2.20 time: 0.206338 Sep 10 21:12:20.835722 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2469/5031] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:20 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:20.853945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f1f2d725-4463-4694-93ea-85ca1b1108dc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:20.854608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f1f2d725-4463-4694-93ea-85ca1b1108dc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:20.868313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1f2d725-4463-4694-93ea-85ca1b1108dc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:20.868900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1f2d725-4463-4694-93ea-85ca1b1108dc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:20.869360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1f2d725-4463-4694-93ea-85ca1b1108dc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:20.870106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1f2d725-4463-4694-93ea-85ca1b1108dc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:20.873673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1f2d725-4463-4694-93ea-85ca1b1108dc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:20.874167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1f2d725-4463-4694-93ea-85ca1b1108dc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:20.929668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:20.975189 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a9283e83-ba3d-43cf-8c71-861008545fc7 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383368 Sep 10 21:12:20.977925 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2563/5032] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:12:20 2022] POST /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:21.041923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f1f2d725-4463-4694-93ea-85ca1b1108dc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:21.052149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:21.056393 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f1f2d725-4463-4694-93ea-85ca1b1108dc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.212312 Sep 10 21:12:21.057032 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2470/5033] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:20 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:21.081610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-310c0cd0-95af-433a-8628-255d73934eeb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:21.083139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-310c0cd0-95af-433a-8628-255d73934eeb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:21.095585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-310c0cd0-95af-433a-8628-255d73934eeb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:21.096138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-310c0cd0-95af-433a-8628-255d73934eeb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:21.096594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-310c0cd0-95af-433a-8628-255d73934eeb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:21.097325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-310c0cd0-95af-433a-8628-255d73934eeb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:21.097845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-310c0cd0-95af-433a-8628-255d73934eeb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:21.098282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-310c0cd0-95af-433a-8628-255d73934eeb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:21.369678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-310c0cd0-95af-433a-8628-255d73934eeb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:21.378065 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-310c0cd0-95af-433a-8628-255d73934eeb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.301228 Sep 10 21:12:21.378884 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2564/5034] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:21 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:21.402436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e11b12cc-9edf-4ec9-94ae-6658ce9753e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:21.408178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e11b12cc-9edf-4ec9-94ae-6658ce9753e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:21.421852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e11b12cc-9edf-4ec9-94ae-6658ce9753e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:21.422930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e11b12cc-9edf-4ec9-94ae-6658ce9753e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:21.423386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e11b12cc-9edf-4ec9-94ae-6658ce9753e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:21.425311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e11b12cc-9edf-4ec9-94ae-6658ce9753e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:21.425858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e11b12cc-9edf-4ec9-94ae-6658ce9753e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:21.427091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e11b12cc-9edf-4ec9-94ae-6658ce9753e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:21.535306 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e11b12cc-9edf-4ec9-94ae-6658ce9753e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.137334 Sep 10 21:12:21.541167 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2471/5035] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:12:21 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:12:21.551747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a9379482-d0b6-4a39-8746-6aabc3fc8dd9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:21.555439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9379482-d0b6-4a39-8746-6aabc3fc8dd9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:21.566008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9379482-d0b6-4a39-8746-6aabc3fc8dd9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:21.566872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9379482-d0b6-4a39-8746-6aabc3fc8dd9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:21.567560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9379482-d0b6-4a39-8746-6aabc3fc8dd9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:21.569178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9379482-d0b6-4a39-8746-6aabc3fc8dd9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:21.569929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9379482-d0b6-4a39-8746-6aabc3fc8dd9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:21.573579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9379482-d0b6-4a39-8746-6aabc3fc8dd9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:21.869720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:21.872665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:21.886244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:21.888562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:21.890121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:21.891522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:21.892531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:21.893290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:22.106958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:22.123330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:22.128742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:22.131136 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a701eb5c-561a-46bb-99a7-f308a9f7e691 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1723 microversion: 2.20 time: 0.268225 Sep 10 21:12:22.131996 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2472/5036] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:21 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:22.137447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-94b6c0ae-6277-40e1-b1ae-b26371cc4890 req-756ef451-6ce8-424e-9618-09afe0157a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010766a5-73d4-43bc-8b9b-915530aac069", "name": "network-vif-unplugged", "status": "completed", "tag": "b3cfb9e7-e626-4a76-b620-73dfc70c87cd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:22.149292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-94b6c0ae-6277-40e1-b1ae-b26371cc4890 req-756ef451-6ce8-424e-9618-09afe0157a36 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:22.150101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-94b6c0ae-6277-40e1-b1ae-b26371cc4890 req-756ef451-6ce8-424e-9618-09afe0157a36 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:22.150847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-94b6c0ae-6277-40e1-b1ae-b26371cc4890 req-756ef451-6ce8-424e-9618-09afe0157a36 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:22.166641 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-94b6c0ae-6277-40e1-b1ae-b26371cc4890 req-756ef451-6ce8-424e-9618-09afe0157a36 service nova] Creating event network-vif-unplugged:b3cfb9e7-e626-4a76-b620-73dfc70c87cd for instance 010766a5-73d4-43bc-8b9b-915530aac069 on nch2-master-1 Sep 10 21:12:22.172296 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-94b6c0ae-6277-40e1-b1ae-b26371cc4890 req-756ef451-6ce8-424e-9618-09afe0157a36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038573 Sep 10 21:12:22.173070 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2473/5037] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:22.316947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a9379482-d0b6-4a39-8746-6aabc3fc8dd9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:22.325749 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a9379482-d0b6-4a39-8746-6aabc3fc8dd9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1672 microversion: 2.1 time: 0.784747 Sep 10 21:12:22.326462 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2565/5038] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:21 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1672 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:23.165608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:23.166347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:23.177569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:23.178154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:23.178544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:23.179293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:23.179719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:23.180154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:23.346129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:23.354655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-89b3796f-9ac1-4916-83ca-098423b7bb19 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:23.355264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-89b3796f-9ac1-4916-83ca-098423b7bb19 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:23.357421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:23.358969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:23.360403 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6feefdc9-fd08-4d98-b58c-0b22bc046085 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1723 microversion: 2.20 time: 0.200259 Sep 10 21:12:23.360971 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2474/5039] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:23 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:23.363797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b3796f-9ac1-4916-83ca-098423b7bb19 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:23.364286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b3796f-9ac1-4916-83ca-098423b7bb19 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:23.364758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b3796f-9ac1-4916-83ca-098423b7bb19 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:23.365462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b3796f-9ac1-4916-83ca-098423b7bb19 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:23.366587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b3796f-9ac1-4916-83ca-098423b7bb19 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:23.367021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89b3796f-9ac1-4916-83ca-098423b7bb19 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:23.739940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-89b3796f-9ac1-4916-83ca-098423b7bb19 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:23.752544 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-89b3796f-9ac1-4916-83ca-098423b7bb19 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1677 microversion: 2.1 time: 0.401009 Sep 10 21:12:23.753499 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2566/5040] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:23 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1677 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:24.379718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-453e9aa4-5242-4670-818b-6d6bece5a132 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:24.382517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-453e9aa4-5242-4670-818b-6d6bece5a132 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:24.387636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:24.388412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:24.391002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-453e9aa4-5242-4670-818b-6d6bece5a132 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:24.391486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-453e9aa4-5242-4670-818b-6d6bece5a132 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:24.391933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-453e9aa4-5242-4670-818b-6d6bece5a132 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:24.392639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-453e9aa4-5242-4670-818b-6d6bece5a132 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:24.393093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-453e9aa4-5242-4670-818b-6d6bece5a132 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:24.393523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-453e9aa4-5242-4670-818b-6d6bece5a132 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:24.396242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:24.396859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:24.397401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:24.398371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:24.398907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:24.399543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:24.427757 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-453e9aa4-5242-4670-818b-6d6bece5a132 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058384 Sep 10 21:12:24.428848 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2475/5041] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:12:24 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:24.440008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-72fd949c-5126-472b-9a53-76020b160912 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:24.440515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-72fd949c-5126-472b-9a53-76020b160912 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:24.446638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72fd949c-5126-472b-9a53-76020b160912 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:24.447130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72fd949c-5126-472b-9a53-76020b160912 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:24.447578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72fd949c-5126-472b-9a53-76020b160912 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:24.448296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72fd949c-5126-472b-9a53-76020b160912 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:24.448758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72fd949c-5126-472b-9a53-76020b160912 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:24.449202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-72fd949c-5126-472b-9a53-76020b160912 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:24.483068 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-72fd949c-5126-472b-9a53-76020b160912 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments/5b4d016b-33f9-4632-b4f7-987f5e850cc0" status: 200 len: 194 microversion: 2.1 time: 0.046887 Sep 10 21:12:24.488905 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2476/5042] 10.222.0.33 () {58 vars in 1413 bytes} [Sat Sep 10 21:12:24 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments/5b4d016b-33f9-4632-b4f7-987f5e850cc0 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:12:24.699027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:24.709301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:24.711787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:24.714170 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-952ebf9a-f3b4-4709-85a5-b369907a2c99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1723 microversion: 2.20 time: 0.331207 Sep 10 21:12:24.714860 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2567/5043] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:24 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:12:24.777961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7acd7a20-2f8d-41e3-b676-217def693626 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:24.778923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7acd7a20-2f8d-41e3-b676-217def693626 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:24.785279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acd7a20-2f8d-41e3-b676-217def693626 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:24.786226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acd7a20-2f8d-41e3-b676-217def693626 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:24.786847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acd7a20-2f8d-41e3-b676-217def693626 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:24.787950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acd7a20-2f8d-41e3-b676-217def693626 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:24.789089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acd7a20-2f8d-41e3-b676-217def693626 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:24.789704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acd7a20-2f8d-41e3-b676-217def693626 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:24.894466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:24.998654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b6a2ce9e-0ef8-4a93-ac93-d15bef66ffd1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:24.999156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b6a2ce9e-0ef8-4a93-ac93-d15bef66ffd1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:25.001274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:25.008536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2ce9e-0ef8-4a93-ac93-d15bef66ffd1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.008947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2ce9e-0ef8-4a93-ac93-d15bef66ffd1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.009385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2ce9e-0ef8-4a93-ac93-d15bef66ffd1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.010134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2ce9e-0ef8-4a93-ac93-d15bef66ffd1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.010604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2ce9e-0ef8-4a93-ac93-d15bef66ffd1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.011018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6a2ce9e-0ef8-4a93-ac93-d15bef66ffd1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.039858 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b6a2ce9e-0ef8-4a93-ac93-d15bef66ffd1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9/ips" status: 200 len: 149 microversion: 2.1 time: 0.056901 Sep 10 21:12:25.040743 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2568/5044] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:12:24 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9/ips => generated 149 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:12:25.054635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "163ecddb-6bf8-4316-9386-752260cc219a"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:25.070088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7acd7a20-2f8d-41e3-b676-217def693626 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:25.080584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:25.082807 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7acd7a20-2f8d-41e3-b676-217def693626 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.308947 Sep 10 21:12:25.083411 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2477/5045] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:24 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:25.089384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.089971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.090960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.091693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.092151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.092576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.108528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a32132fd-adf5-415b-8dcb-629db320973b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:25.111006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a32132fd-adf5-415b-8dcb-629db320973b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:25.122891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32132fd-adf5-415b-8dcb-629db320973b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.123396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32132fd-adf5-415b-8dcb-629db320973b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.123849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32132fd-adf5-415b-8dcb-629db320973b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.124560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32132fd-adf5-415b-8dcb-629db320973b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.125017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32132fd-adf5-415b-8dcb-629db320973b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.125447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32132fd-adf5-415b-8dcb-629db320973b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.198037 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a32132fd-adf5-415b-8dcb-629db320973b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 200 len: 322 microversion: 2.1 time: 0.094069 Sep 10 21:12:25.206236 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2478/5046] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:12:25 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 322 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:12:25.213773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9e10ebfd-4206-4414-a017-7d9e3894f389 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:25.215803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9e10ebfd-4206-4414-a017-7d9e3894f389 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:25.229563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e10ebfd-4206-4414-a017-7d9e3894f389 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.230561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e10ebfd-4206-4414-a017-7d9e3894f389 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.232115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e10ebfd-4206-4414-a017-7d9e3894f389 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.233320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e10ebfd-4206-4414-a017-7d9e3894f389 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.234253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e10ebfd-4206-4414-a017-7d9e3894f389 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.235092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e10ebfd-4206-4414-a017-7d9e3894f389 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.260012 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Invalid volume: volume 163ecddb-6bf8-4316-9386-752260cc219a is already attached to instances: d7693b5b-858c-4224-93a8-e07f29b30646 Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9/os-volume_attachments HTTP/1.1 Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 74 Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: {"volumeAttachment": {"volumeId": "163ecddb-6bf8-4316-9386-752260cc219a"}} Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid volume: volume 163ecddb-6bf8-4316-9386-752260cc219a is already attached to instances: d7693b5b-858c-4224-93a8-e07f29b30646 Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'server_id': 'f04e7926-fc3d-456a-ad4f-7099ef9811e9', 'body': {'volumeAttachment': {'volumeId': '163ecddb-6bf8-4316-9386-752260cc219a'}}} Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 163ecddb-6bf8-4316-9386-752260cc219a is already attached to instances: d7693b5b-858c-4224-93a8-e07f29b30646 Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:12:25.264339 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 163ecddb-6bf8-4316-9386-752260cc219a is already attached to instances: d7693b5b-858c-4224-93a8-e07f29b30646 Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 163ecddb-6bf8-4316-9386-752260cc219a is already attached to instances: d7693b5b-858c-4224-93a8-e07f29b30646 Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 400 to user: Invalid volume: volume 163ecddb-6bf8-4316-9386-752260cc219a is already attached to instances: d7693b5b-858c-4224-93a8-e07f29b30646 {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7ca5916f-2725-43b3-8226-b2223323bed7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.217428 Sep 10 21:12:25.270876 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2569/5047] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:12:25 2022] POST /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9/os-volume_attachments => generated 174 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 21:12:25.280803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8cc43e69-c02a-4d30-af93-f2fe07d054c8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:25.281318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8cc43e69-c02a-4d30-af93-f2fe07d054c8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:25.314354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc43e69-c02a-4d30-af93-f2fe07d054c8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.315384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc43e69-c02a-4d30-af93-f2fe07d054c8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.316460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc43e69-c02a-4d30-af93-f2fe07d054c8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.317348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc43e69-c02a-4d30-af93-f2fe07d054c8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.317954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc43e69-c02a-4d30-af93-f2fe07d054c8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.318462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8cc43e69-c02a-4d30-af93-f2fe07d054c8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.349073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8cc43e69-c02a-4d30-af93-f2fe07d054c8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:12:25.476933 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8cc43e69-c02a-4d30-af93-f2fe07d054c8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 204 len: 0 microversion: 2.1 time: 0.202650 Sep 10 21:12:25.481753 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2570/5048] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:12:25 2022] DELETE /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:12:25.488834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e3561d2-226b-47d9-8461-ab48eb23ae64 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:25.491038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e3561d2-226b-47d9-8461-ab48eb23ae64 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:25.499069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e3561d2-226b-47d9-8461-ab48eb23ae64 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.499952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e3561d2-226b-47d9-8461-ab48eb23ae64 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.500534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e3561d2-226b-47d9-8461-ab48eb23ae64 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.501384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e3561d2-226b-47d9-8461-ab48eb23ae64 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.501959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e3561d2-226b-47d9-8461-ab48eb23ae64 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.502760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e3561d2-226b-47d9-8461-ab48eb23ae64 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.526491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e10ebfd-4206-4414-a017-7d9e3894f389 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:25.540665 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9e10ebfd-4206-4414-a017-7d9e3894f389 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.332354 Sep 10 21:12:25.563462 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2479/5049] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:25 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:25.571057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54f3e63e-fc96-471f-9d31-efddeccc664a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:25.572051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-54f3e63e-fc96-471f-9d31-efddeccc664a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:25.581423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54f3e63e-fc96-471f-9d31-efddeccc664a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.582266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54f3e63e-fc96-471f-9d31-efddeccc664a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.583956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54f3e63e-fc96-471f-9d31-efddeccc664a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.584882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54f3e63e-fc96-471f-9d31-efddeccc664a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.585524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54f3e63e-fc96-471f-9d31-efddeccc664a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.586189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54f3e63e-fc96-471f-9d31-efddeccc664a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.714106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1e3561d2-226b-47d9-8461-ab48eb23ae64 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:25.724946 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e3561d2-226b-47d9-8461-ab48eb23ae64 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1682 microversion: 2.1 time: 0.241477 Sep 10 21:12:25.727418 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2571/5050] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:25 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:25.740860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:25.742079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:25.749479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.750023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.750473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.751192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.751862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.752841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.877528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-54f3e63e-fc96-471f-9d31-efddeccc664a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:25.892315 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-54f3e63e-fc96-471f-9d31-efddeccc664a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.325616 Sep 10 21:12:25.892928 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2480/5051] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:25 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:25.917425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:25.923189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-75be447a-ca2c-47ac-af17-091e5110e45d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:25.923827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-75be447a-ca2c-47ac-af17-091e5110e45d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:25.929767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:25.931204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75be447a-ca2c-47ac-af17-091e5110e45d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.931715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75be447a-ca2c-47ac-af17-091e5110e45d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.932212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75be447a-ca2c-47ac-af17-091e5110e45d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.933016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75be447a-ca2c-47ac-af17-091e5110e45d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:25.933487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75be447a-ca2c-47ac-af17-091e5110e45d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:25.934498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75be447a-ca2c-47ac-af17-091e5110e45d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:25.936529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:25.937918 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-393b26c7-8d91-412d-ae19-267e348b8ac4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1723 microversion: 2.20 time: 0.201066 Sep 10 21:12:25.940738 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2572/5052] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:25 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:25.994649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a903bca4-cf9e-438d-97cb-08117aa2ea99 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41986f54-8d42-490e-9254-4d27b78ae838"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:25.998238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a903bca4-cf9e-438d-97cb-08117aa2ea99 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:26.004596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a903bca4-cf9e-438d-97cb-08117aa2ea99 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:26.005208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a903bca4-cf9e-438d-97cb-08117aa2ea99 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:26.005750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a903bca4-cf9e-438d-97cb-08117aa2ea99 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:26.006605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a903bca4-cf9e-438d-97cb-08117aa2ea99 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:26.007166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a903bca4-cf9e-438d-97cb-08117aa2ea99 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:26.007692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a903bca4-cf9e-438d-97cb-08117aa2ea99 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:26.141146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-75be447a-ca2c-47ac-af17-091e5110e45d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:26.150686 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-75be447a-ca2c-47ac-af17-091e5110e45d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.231388 Sep 10 21:12:26.151581 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2481/5053] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:25 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:12:26.175255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8c80f67f-f4a6-458c-a3f0-ba3046780ef7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:26.175921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8c80f67f-f4a6-458c-a3f0-ba3046780ef7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:26.183268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c80f67f-f4a6-458c-a3f0-ba3046780ef7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:26.184433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c80f67f-f4a6-458c-a3f0-ba3046780ef7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:26.185388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c80f67f-f4a6-458c-a3f0-ba3046780ef7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:26.186191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c80f67f-f4a6-458c-a3f0-ba3046780ef7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:26.186656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c80f67f-f4a6-458c-a3f0-ba3046780ef7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:26.187092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c80f67f-f4a6-458c-a3f0-ba3046780ef7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:26.318784 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a903bca4-cf9e-438d-97cb-08117aa2ea99 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "POST /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328199 Sep 10 21:12:26.321871 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2573/5054] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:12:25 2022] POST /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:26.347070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8c80f67f-f4a6-458c-a3f0-ba3046780ef7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:26.357574 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8c80f67f-f4a6-458c-a3f0-ba3046780ef7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.186735 Sep 10 21:12:26.359344 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2482/5055] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:26 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:26.501723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-857418677", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "22651555-9c52-45fb-b1cb-a14fc16f0427"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:26.563609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] validate_networks() for [('22651555-9c52-45fb-b1cb-a14fc16f0427', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:12:26.753198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55e00ef5-4455-44ad-ac06-82bbcb5fad20 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:26.754816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55e00ef5-4455-44ad-ac06-82bbcb5fad20 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:26.779681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e00ef5-4455-44ad-ac06-82bbcb5fad20 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:26.780618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e00ef5-4455-44ad-ac06-82bbcb5fad20 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:26.782335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e00ef5-4455-44ad-ac06-82bbcb5fad20 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:26.783306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e00ef5-4455-44ad-ac06-82bbcb5fad20 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:26.784006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e00ef5-4455-44ad-ac06-82bbcb5fad20 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:26.784704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55e00ef5-4455-44ad-ac06-82bbcb5fad20 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:26.957490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-55e00ef5-4455-44ad-ac06-82bbcb5fad20 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:26.967066 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55e00ef5-4455-44ad-ac06-82bbcb5fad20 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1682 microversion: 2.1 time: 0.219382 Sep 10 21:12:26.968315 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2483/5056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:26 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:26.974079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:26.974995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:26.984452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:26.985303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:26.986294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:26.987104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:26.987647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:26.988269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:27.161849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:12:27.162367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:12:27.162988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:12:27.163405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:12:27.164179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:12:27.175085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:27.176744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:27.178386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:27.179550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:27.180849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:27.182036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:27.183113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:27.185581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:27.190447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:27.191702 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-655c9980-ff9f-4ac1-8a41-113b3f235bb7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1723 microversion: 2.20 time: 0.221936 Sep 10 21:12:27.208414 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2484/5057] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:26 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:27.226579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for project 15a76a25754c42099c542fa13046f01b. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:12:27.235160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for user d83b6ceb599746b394e379d52683b70c and project 15a76a25754c42099c542fa13046f01b. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:12:27.254031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:12:27.256840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:12:27.318215 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eb1c402e-3028-48d8-8365-de01e6cb8274 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821507 Sep 10 21:12:27.319209 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2574/5058] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:12:27.331181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fe728643-5140-4f0b-8e69-84e5599b3ad7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:27.331696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fe728643-5140-4f0b-8e69-84e5599b3ad7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:27.430053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fe728643-5140-4f0b-8e69-84e5599b3ad7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:27.444567 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fe728643-5140-4f0b-8e69-84e5599b3ad7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1214 microversion: 2.1 time: 0.117267 Sep 10 21:12:27.446738 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2485/5059] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:27 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:27.994024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ee4bc7d9-b568-4dc6-b943-d15cc132cbaa tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:27.994627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ee4bc7d9-b568-4dc6-b943-d15cc132cbaa tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:28.005403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bc7d9-b568-4dc6-b943-d15cc132cbaa tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:28.006006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bc7d9-b568-4dc6-b943-d15cc132cbaa tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:28.006521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bc7d9-b568-4dc6-b943-d15cc132cbaa tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:28.007298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bc7d9-b568-4dc6-b943-d15cc132cbaa tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:28.008345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bc7d9-b568-4dc6-b943-d15cc132cbaa tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:28.008781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4bc7d9-b568-4dc6-b943-d15cc132cbaa tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:28.223217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:28.226242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:28.242356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:28.243050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:28.243672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:28.244667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:28.245384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:28.250520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:28.469864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:28.485957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:28.487443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:28.491771 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a59a6d1e-d693-40b1-9ca8-03d24ab78af2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1723 microversion: 2.20 time: 0.272184 Sep 10 21:12:28.500138 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2486/5060] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:28 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:28.507616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d8cc87bf-9a0e-40ef-91e3-50ad58dc62a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:28.508598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d8cc87bf-9a0e-40ef-91e3-50ad58dc62a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:28.514178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:28.518829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8cc87bf-9a0e-40ef-91e3-50ad58dc62a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:28.519686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8cc87bf-9a0e-40ef-91e3-50ad58dc62a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:28.520589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8cc87bf-9a0e-40ef-91e3-50ad58dc62a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:28.521331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8cc87bf-9a0e-40ef-91e3-50ad58dc62a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:28.521860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8cc87bf-9a0e-40ef-91e3-50ad58dc62a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:28.522340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8cc87bf-9a0e-40ef-91e3-50ad58dc62a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:28.562504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ee4bc7d9-b568-4dc6-b943-d15cc132cbaa tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:28.570763 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ee4bc7d9-b568-4dc6-b943-d15cc132cbaa tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 200 len: 1614 microversion: 2.1 time: 0.580739 Sep 10 21:12:28.573391 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2575/5061] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:27 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 1614 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:28.621635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d8cc87bf-9a0e-40ef-91e3-50ad58dc62a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:28.634250 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d8cc87bf-9a0e-40ef-91e3-50ad58dc62a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1210 microversion: 2.1 time: 0.129502 Sep 10 21:12:28.635216 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2487/5062] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:28 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:28.690933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d3ad070a-f2d4-47fe-aecc-9bf77b1d4079 req-9c061d5c-11fa-4911-bdae-0e0d0642df74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04e7926-fc3d-456a-ad4f-7099ef9811e9", "name": "network-vif-deleted", "tag": "3fc57237-0038-44cd-9586-8f19f883c4f0"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:28.701281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d3ad070a-f2d4-47fe-aecc-9bf77b1d4079 req-9c061d5c-11fa-4911-bdae-0e0d0642df74 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:28.702066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d3ad070a-f2d4-47fe-aecc-9bf77b1d4079 req-9c061d5c-11fa-4911-bdae-0e0d0642df74 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:28.702678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d3ad070a-f2d4-47fe-aecc-9bf77b1d4079 req-9c061d5c-11fa-4911-bdae-0e0d0642df74 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:28.718705 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d3ad070a-f2d4-47fe-aecc-9bf77b1d4079 req-9c061d5c-11fa-4911-bdae-0e0d0642df74 service nova] Creating event network-vif-deleted:3fc57237-0038-44cd-9586-8f19f883c4f0 for instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 on nch2-master-1 Sep 10 21:12:28.724499 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d3ad070a-f2d4-47fe-aecc-9bf77b1d4079 req-9c061d5c-11fa-4911-bdae-0e0d0642df74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037502 Sep 10 21:12:28.729856 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2576/5063] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:29.521789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:29.522520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:29.547997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:29.548530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:29.552544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:29.553514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:29.554042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:29.554484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:29.580324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:29.605012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:29.606103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:29.629554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:29.630386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:29.630839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:29.631646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:29.632020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:29.632458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:29.651491 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 HTTP/1.1 Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'f04e7926-fc3d-456a-ad4f-7099ef9811e9'} Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:29.653993 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:29.659357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:29.659357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:29.659357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:29.659357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:12:29.659357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:12:29.659357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:12:29.659357 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:29.661023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:12:29.662104 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ac5a58b8-47c5-4984-9ab1-48b55431e969 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 404 len: 111 microversion: 2.1 time: 0.063604 Sep 10 21:12:29.663140 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2577/5064] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:29 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:12:29.668762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7c62a1ef-a61b-4689-af8c-230769bfde54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:29.670016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7c62a1ef-a61b-4689-af8c-230769bfde54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:29.676573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c62a1ef-a61b-4689-af8c-230769bfde54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:29.677070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c62a1ef-a61b-4689-af8c-230769bfde54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:29.677512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c62a1ef-a61b-4689-af8c-230769bfde54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:29.678325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c62a1ef-a61b-4689-af8c-230769bfde54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:29.678778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c62a1ef-a61b-4689-af8c-230769bfde54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:29.679213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c62a1ef-a61b-4689-af8c-230769bfde54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:29.762723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7c62a1ef-a61b-4689-af8c-230769bfde54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:29.786116 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7c62a1ef-a61b-4689-af8c-230769bfde54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1266 microversion: 2.1 time: 0.121612 Sep 10 21:12:29.786700 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2578/5065] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:29 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:29.810122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be557607-0f82-4f2d-ada7-1bc1d35ffee7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '.version_select at 0x7f99440bdb80>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:29.847151 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be557607-0f82-4f2d-ada7-1bc1d35ffee7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1518401477" status: 202 len: 0 microversion: 2.1 time: 0.055760 Sep 10 21:12:29.851012 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2579/5066] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 21:12:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1518401477 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:12:29.862229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-524551c6-5d45-46ee-bdff-407ba8fb9b6d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:29.874666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-524551c6-5d45-46ee-bdff-407ba8fb9b6d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:29.894454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-524551c6-5d45-46ee-bdff-407ba8fb9b6d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:29.894951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-524551c6-5d45-46ee-bdff-407ba8fb9b6d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:29.901121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-524551c6-5d45-46ee-bdff-407ba8fb9b6d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:29.902183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-524551c6-5d45-46ee-bdff-407ba8fb9b6d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:29.903495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-524551c6-5d45-46ee-bdff-407ba8fb9b6d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:29.906336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-524551c6-5d45-46ee-bdff-407ba8fb9b6d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:29.915007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:29.954747 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-524551c6-5d45-46ee-bdff-407ba8fb9b6d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.102417 Sep 10 21:12:29.955901 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2580/5067] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:12:29 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:29.969734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:29.987973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:29.989469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:29.990846 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ff6dce49-e5c7-44e7-b4bc-1200bd155677 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1723 microversion: 2.20 time: 0.474895 Sep 10 21:12:29.996958 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2488/5068] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:29 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1723 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:30.096908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-27147aab-be4d-487e-a977-c3ebdbb87405 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:30.097535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-27147aab-be4d-487e-a977-c3ebdbb87405 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:30.108232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27147aab-be4d-487e-a977-c3ebdbb87405 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:30.116927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27147aab-be4d-487e-a977-c3ebdbb87405 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:30.117518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27147aab-be4d-487e-a977-c3ebdbb87405 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:30.118679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27147aab-be4d-487e-a977-c3ebdbb87405 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:30.119400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27147aab-be4d-487e-a977-c3ebdbb87405 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:30.119893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27147aab-be4d-487e-a977-c3ebdbb87405 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:30.170394 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-27147aab-be4d-487e-a977-c3ebdbb87405 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments/5b4d016b-33f9-4632-b4f7-987f5e850cc0" status: 200 len: 194 microversion: 2.1 time: 0.076458 Sep 10 21:12:30.176581 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2581/5069] 10.222.0.33 () {58 vars in 1413 bytes} [Sat Sep 10 21:12:30 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments/5b4d016b-33f9-4632-b4f7-987f5e850cc0 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:30.183469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0422bf1-cd22-4c44-bce4-5871683b6301 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:30.184700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0422bf1-cd22-4c44-bce4-5871683b6301 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:30.197511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0422bf1-cd22-4c44-bce4-5871683b6301 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:30.200394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0422bf1-cd22-4c44-bce4-5871683b6301 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:30.204775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0422bf1-cd22-4c44-bce4-5871683b6301 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:30.206000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0422bf1-cd22-4c44-bce4-5871683b6301 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:30.206682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0422bf1-cd22-4c44-bce4-5871683b6301 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:30.207131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0422bf1-cd22-4c44-bce4-5871683b6301 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:30.355210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-c0422bf1-cd22-4c44-bce4-5871683b6301 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lazy-loading 'services' on Instance uuid bbebf08d-97c2-43b6-848d-8665f61d8854 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:12:30.508497 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0422bf1-cd22-4c44-bce4-5871683b6301 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments/5b4d016b-33f9-4632-b4f7-987f5e850cc0" status: 202 len: 0 microversion: 2.1 time: 0.328757 Sep 10 21:12:30.509327 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2489/5070] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 21:12:30 2022] DELETE /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments/5b4d016b-33f9-4632-b4f7-987f5e850cc0 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:12:30.815172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d0f031ca-3121-4f98-bccf-3595dfb7b802 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:30.815768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d0f031ca-3121-4f98-bccf-3595dfb7b802 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:30.823578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0f031ca-3121-4f98-bccf-3595dfb7b802 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:30.824382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0f031ca-3121-4f98-bccf-3595dfb7b802 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:30.825601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0f031ca-3121-4f98-bccf-3595dfb7b802 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:30.826591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0f031ca-3121-4f98-bccf-3595dfb7b802 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:30.827520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0f031ca-3121-4f98-bccf-3595dfb7b802 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:30.828185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0f031ca-3121-4f98-bccf-3595dfb7b802 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:30.959395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d0f031ca-3121-4f98-bccf-3595dfb7b802 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:30.971839 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d0f031ca-3121-4f98-bccf-3595dfb7b802 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1272 microversion: 2.1 time: 0.161267 Sep 10 21:12:30.972724 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2582/5071] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:30 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:31.026156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:31.026885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:31.052571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:31.055552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:31.056297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:31.058320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:31.061234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:31.063663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:31.359041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:31.368830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:31.373955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:31.375478 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ed011f3d-fb1b-49f7-aa84-28618894206c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1744 microversion: 2.20 time: 0.353882 Sep 10 21:12:31.378137 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2490/5072] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:31 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1744 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:31.742155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-875d7ef7-b32f-4a9f-8556-f829363cd264 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:31.742829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-875d7ef7-b32f-4a9f-8556-f829363cd264 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:31.752346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-875d7ef7-b32f-4a9f-8556-f829363cd264 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:31.753371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-875d7ef7-b32f-4a9f-8556-f829363cd264 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:31.754528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-875d7ef7-b32f-4a9f-8556-f829363cd264 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:31.755995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-875d7ef7-b32f-4a9f-8556-f829363cd264 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:31.756688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-875d7ef7-b32f-4a9f-8556-f829363cd264 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:31.757807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-875d7ef7-b32f-4a9f-8556-f829363cd264 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:31.859975 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-875d7ef7-b32f-4a9f-8556-f829363cd264 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments/41986f54-8d42-490e-9254-4d27b78ae838" status: 200 len: 194 microversion: 2.1 time: 0.121969 Sep 10 21:12:31.873913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29c4ec8c-a144-43d6-90dd-8d8a50434f6c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:31.874436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-29c4ec8c-a144-43d6-90dd-8d8a50434f6c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:31.882262 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2583/5073] 10.222.0.33 () {58 vars in 1413 bytes} [Sat Sep 10 21:12:31 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments/41986f54-8d42-490e-9254-4d27b78ae838 => generated 194 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:31.886233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29c4ec8c-a144-43d6-90dd-8d8a50434f6c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:31.887339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29c4ec8c-a144-43d6-90dd-8d8a50434f6c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:31.887805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29c4ec8c-a144-43d6-90dd-8d8a50434f6c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:31.888540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29c4ec8c-a144-43d6-90dd-8d8a50434f6c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:31.889009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29c4ec8c-a144-43d6-90dd-8d8a50434f6c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:31.893021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29c4ec8c-a144-43d6-90dd-8d8a50434f6c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:32.001469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96435a4a-d9a6-4257-bee3-a1620a444a0a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:32.009502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96435a4a-d9a6-4257-bee3-a1620a444a0a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:32.022906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96435a4a-d9a6-4257-bee3-a1620a444a0a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:32.026695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96435a4a-d9a6-4257-bee3-a1620a444a0a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:32.030287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96435a4a-d9a6-4257-bee3-a1620a444a0a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:32.031287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96435a4a-d9a6-4257-bee3-a1620a444a0a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:32.037878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96435a4a-d9a6-4257-bee3-a1620a444a0a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:32.038751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96435a4a-d9a6-4257-bee3-a1620a444a0a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:32.095718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-29c4ec8c-a144-43d6-90dd-8d8a50434f6c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lazy-loading 'services' on Instance uuid bbebf08d-97c2-43b6-848d-8665f61d8854 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:12:32.252672 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-29c4ec8c-a144-43d6-90dd-8d8a50434f6c tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments/41986f54-8d42-490e-9254-4d27b78ae838" status: 202 len: 0 microversion: 2.1 time: 0.383590 Sep 10 21:12:32.254640 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2491/5074] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 21:12:31 2022] DELETE /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments/41986f54-8d42-490e-9254-4d27b78ae838 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:12:32.361725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a2a035f-3b18-4cf7-8715-85504a4b8040 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:32.362611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4a2a035f-3b18-4cf7-8715-85504a4b8040 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:32.376597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2a035f-3b18-4cf7-8715-85504a4b8040 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:32.377094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2a035f-3b18-4cf7-8715-85504a4b8040 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:32.377543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2a035f-3b18-4cf7-8715-85504a4b8040 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:32.378284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2a035f-3b18-4cf7-8715-85504a4b8040 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:32.378976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2a035f-3b18-4cf7-8715-85504a4b8040 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:32.379625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2a035f-3b18-4cf7-8715-85504a4b8040 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:32.400478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-96435a4a-d9a6-4257-bee3-a1620a444a0a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:32.433391 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96435a4a-d9a6-4257-bee3-a1620a444a0a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1314 microversion: 2.1 time: 0.440473 Sep 10 21:12:32.436962 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2584/5075] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:31 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:32.446679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:32.451974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:32.463960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:32.466509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:32.467853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:32.470215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:32.473420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:32.474084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:32.590793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-4a2a035f-3b18-4cf7-8715-85504a4b8040 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lazy-loading 'services' on Instance uuid d7693b5b-858c-4224-93a8-e07f29b30646 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:12:32.723585 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a2a035f-3b18-4cf7-8715-85504a4b8040 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments/163ecddb-6bf8-4316-9386-752260cc219a" status: 202 len: 0 microversion: 2.1 time: 0.367052 Sep 10 21:12:32.724108 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2492/5076] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 21:12:32 2022] DELETE /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments/163ecddb-6bf8-4316-9386-752260cc219a => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:12:32.734463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a6db2866-eeab-4f46-97f6-7064723ef533 req-ff686a40-5ce3-4074-90f0-70cf0fe5de5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f661c48-654e-41b6-94a2-a8b9c4fa20fb", "tag": "445b64b9-f81c-4c16-8ad9-e2a81f897746"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:32.745063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a6db2866-eeab-4f46-97f6-7064723ef533 req-ff686a40-5ce3-4074-90f0-70cf0fe5de5f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:32.745867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a6db2866-eeab-4f46-97f6-7064723ef533 req-ff686a40-5ce3-4074-90f0-70cf0fe5de5f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:32.747172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a6db2866-eeab-4f46-97f6-7064723ef533 req-ff686a40-5ce3-4074-90f0-70cf0fe5de5f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:32.766193 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a6db2866-eeab-4f46-97f6-7064723ef533 req-ff686a40-5ce3-4074-90f0-70cf0fe5de5f service nova] Creating event network-changed:445b64b9-f81c-4c16-8ad9-e2a81f897746 for instance 1f661c48-654e-41b6-94a2-a8b9c4fa20fb on nch1-master-1 Sep 10 21:12:32.773236 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a6db2866-eeab-4f46-97f6-7064723ef533 req-ff686a40-5ce3-4074-90f0-70cf0fe5de5f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043685 Sep 10 21:12:32.774421 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2493/5077] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:32.780198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:32.788898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-61cfccc9-a19b-4627-821a-d883c1008ad0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:32.790907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-61cfccc9-a19b-4627-821a-d883c1008ad0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:32.799748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61cfccc9-a19b-4627-821a-d883c1008ad0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:32.800870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61cfccc9-a19b-4627-821a-d883c1008ad0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:32.801776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61cfccc9-a19b-4627-821a-d883c1008ad0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:32.802747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61cfccc9-a19b-4627-821a-d883c1008ad0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:32.803809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61cfccc9-a19b-4627-821a-d883c1008ad0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:32.803946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-61cfccc9-a19b-4627-821a-d883c1008ad0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:32.805909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:32.807797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:32.810323 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e41aefe5-63be-4bcb-aa57-bf47cfa1ffff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1744 microversion: 2.20 time: 0.371798 Sep 10 21:12:32.811448 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2585/5078] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:32 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1744 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:32.844160 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-61cfccc9-a19b-4627-821a-d883c1008ad0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060483 Sep 10 21:12:32.845004 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2494/5079] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:12:32 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:33.467689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a980662d-cd3d-43a5-8f46-a18b3209d4d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:33.468424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a980662d-cd3d-43a5-8f46-a18b3209d4d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:33.487011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a980662d-cd3d-43a5-8f46-a18b3209d4d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:33.490928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a980662d-cd3d-43a5-8f46-a18b3209d4d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:33.492086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a980662d-cd3d-43a5-8f46-a18b3209d4d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:33.493121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a980662d-cd3d-43a5-8f46-a18b3209d4d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:33.493947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a980662d-cd3d-43a5-8f46-a18b3209d4d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:33.495450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a980662d-cd3d-43a5-8f46-a18b3209d4d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:33.655541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ba83da1-76ae-4382-b8b4-94c76f079b7d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:33.661498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7ba83da1-76ae-4382-b8b4-94c76f079b7d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:33.676476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ba83da1-76ae-4382-b8b4-94c76f079b7d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:33.677587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ba83da1-76ae-4382-b8b4-94c76f079b7d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:33.680157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ba83da1-76ae-4382-b8b4-94c76f079b7d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:33.681498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ba83da1-76ae-4382-b8b4-94c76f079b7d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:33.682487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ba83da1-76ae-4382-b8b4-94c76f079b7d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:33.691473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ba83da1-76ae-4382-b8b4-94c76f079b7d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:33.742304 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ba83da1-76ae-4382-b8b4-94c76f079b7d tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091431 Sep 10 21:12:33.751893 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2495/5080] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:12:33 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:12:33.841530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:33.842544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:33.884007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:33.884795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:33.886245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:33.888682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:33.890352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:33.892142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:33.922552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a980662d-cd3d-43a5-8f46-a18b3209d4d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:33.937610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a980662d-cd3d-43a5-8f46-a18b3209d4d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1314 microversion: 2.1 time: 0.475745 Sep 10 21:12:33.939470 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2586/5081] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:33 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:33.947079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d7821592-7d3a-4161-bd36-569ffe9a0077 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:33.952621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d7821592-7d3a-4161-bd36-569ffe9a0077 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:33.989931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7821592-7d3a-4161-bd36-569ffe9a0077 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:33.993176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7821592-7d3a-4161-bd36-569ffe9a0077 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:33.998981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7821592-7d3a-4161-bd36-569ffe9a0077 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:34.005377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7821592-7d3a-4161-bd36-569ffe9a0077 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:34.008096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7821592-7d3a-4161-bd36-569ffe9a0077 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:34.010774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d7821592-7d3a-4161-bd36-569ffe9a0077 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:34.096056 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d7821592-7d3a-4161-bd36-569ffe9a0077 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155312 Sep 10 21:12:34.097488 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2587/5082] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:12:33 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:34.106625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-521d306b-d266-47db-9bf9-7977d7a26a01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:34.109463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-521d306b-d266-47db-9bf9-7977d7a26a01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:34.128625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-521d306b-d266-47db-9bf9-7977d7a26a01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:34.132389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-521d306b-d266-47db-9bf9-7977d7a26a01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:34.135184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-521d306b-d266-47db-9bf9-7977d7a26a01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:34.139515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-521d306b-d266-47db-9bf9-7977d7a26a01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:34.140228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-521d306b-d266-47db-9bf9-7977d7a26a01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:34.143092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-521d306b-d266-47db-9bf9-7977d7a26a01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:34.192009 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-521d306b-d266-47db-9bf9-7977d7a26a01 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092957 Sep 10 21:12:34.202631 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2588/5083] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:12:34 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:12:34.333741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8e73be1-0031-4e02-a5ea-85975184c7e2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:34.334761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8e73be1-0031-4e02-a5ea-85975184c7e2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:34.345220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e73be1-0031-4e02-a5ea-85975184c7e2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:34.345718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e73be1-0031-4e02-a5ea-85975184c7e2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:34.347362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e73be1-0031-4e02-a5ea-85975184c7e2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:34.347497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e73be1-0031-4e02-a5ea-85975184c7e2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:34.348109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e73be1-0031-4e02-a5ea-85975184c7e2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:34.348592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8e73be1-0031-4e02-a5ea-85975184c7e2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:34.360203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:34.377239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:34.387702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:34.394487 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c570098-efb3-4e32-8e4b-2c06af93792b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.561507 Sep 10 21:12:34.397600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8e73be1-0031-4e02-a5ea-85975184c7e2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:12:34.410814 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2496/5084] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:33 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:12:34.620542 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8e73be1-0031-4e02-a5ea-85975184c7e2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 204 len: 0 microversion: 2.1 time: 0.291305 Sep 10 21:12:34.632702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4453b135-a79d-403b-bad5-9c786e3a887b tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:34.633577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4453b135-a79d-403b-bad5-9c786e3a887b tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:34.638614 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2589/5085] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:12:34 2022] DELETE /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:12:34.645555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4453b135-a79d-403b-bad5-9c786e3a887b tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:34.647719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4453b135-a79d-403b-bad5-9c786e3a887b tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:34.648651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4453b135-a79d-403b-bad5-9c786e3a887b tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:34.650316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4453b135-a79d-403b-bad5-9c786e3a887b tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:34.654478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4453b135-a79d-403b-bad5-9c786e3a887b tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:34.655532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4453b135-a79d-403b-bad5-9c786e3a887b tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:34.993409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4453b135-a79d-403b-bad5-9c786e3a887b tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:35.000598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8c5eaab-6fd4-45d9-8584-f9486e825bc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:35.002266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8c5eaab-6fd4-45d9-8584-f9486e825bc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:35.009722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c5eaab-6fd4-45d9-8584-f9486e825bc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:35.010159 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4453b135-a79d-403b-bad5-9c786e3a887b tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1673 microversion: 2.1 time: 0.380482 Sep 10 21:12:35.010797 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2497/5086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:34 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1673 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:35.023806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c5eaab-6fd4-45d9-8584-f9486e825bc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:35.026791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c5eaab-6fd4-45d9-8584-f9486e825bc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:35.029560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c5eaab-6fd4-45d9-8584-f9486e825bc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:35.030088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c5eaab-6fd4-45d9-8584-f9486e825bc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:35.030546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8c5eaab-6fd4-45d9-8584-f9486e825bc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:35.111817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c8c48ce8-accb-4936-8a15-5387e6c714f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:35.114554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c8c48ce8-accb-4936-8a15-5387e6c714f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:35.128425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c48ce8-accb-4936-8a15-5387e6c714f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:35.130607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c48ce8-accb-4936-8a15-5387e6c714f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:35.131779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c48ce8-accb-4936-8a15-5387e6c714f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:35.133675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c48ce8-accb-4936-8a15-5387e6c714f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:35.134395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c48ce8-accb-4936-8a15-5387e6c714f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:35.137404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c48ce8-accb-4936-8a15-5387e6c714f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:35.190779 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c8c48ce8-accb-4936-8a15-5387e6c714f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083558 Sep 10 21:12:35.192075 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2498/5087] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:12:35 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:12:35.318701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8c5eaab-6fd4-45d9-8584-f9486e825bc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:35.329281 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8c5eaab-6fd4-45d9-8584-f9486e825bc3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1314 microversion: 2.1 time: 0.346235 Sep 10 21:12:35.330491 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2590/5088] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:34 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:12:35.432051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:35.434056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:35.446921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:35.448860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:35.451371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:35.452578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:35.453625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:35.455434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.036544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9f2bdb9e-ff42-48e5-9aeb-d36486e7e348 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:36.037202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9f2bdb9e-ff42-48e5-9aeb-d36486e7e348 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:36.051136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:36.051876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f2bdb9e-ff42-48e5-9aeb-d36486e7e348 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.052418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f2bdb9e-ff42-48e5-9aeb-d36486e7e348 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.052908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f2bdb9e-ff42-48e5-9aeb-d36486e7e348 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.053861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f2bdb9e-ff42-48e5-9aeb-d36486e7e348 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.054289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f2bdb9e-ff42-48e5-9aeb-d36486e7e348 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.055511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f2bdb9e-ff42-48e5-9aeb-d36486e7e348 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.061296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:36.071349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:36.072695 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ca8812c-1c7e-4fda-abc9-7a4dc8c9aa21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.646995 Sep 10 21:12:36.073314 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2499/5089] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:35 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:36.205495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bb813240-b636-4a16-a47f-74c7a2137e3c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:36.209064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bb813240-b636-4a16-a47f-74c7a2137e3c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:36.217186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb813240-b636-4a16-a47f-74c7a2137e3c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.218136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb813240-b636-4a16-a47f-74c7a2137e3c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.218818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb813240-b636-4a16-a47f-74c7a2137e3c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.219773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb813240-b636-4a16-a47f-74c7a2137e3c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.220555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb813240-b636-4a16-a47f-74c7a2137e3c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.221219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb813240-b636-4a16-a47f-74c7a2137e3c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.267559 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bb813240-b636-4a16-a47f-74c7a2137e3c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067698 Sep 10 21:12:36.278057 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2500/5090] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:12:36 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 21:12:36.356856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-32aca236-76ab-4b47-a308-b048174e23d4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:36.358018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-32aca236-76ab-4b47-a308-b048174e23d4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:36.371527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32aca236-76ab-4b47-a308-b048174e23d4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.375899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32aca236-76ab-4b47-a308-b048174e23d4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.377368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32aca236-76ab-4b47-a308-b048174e23d4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.378584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32aca236-76ab-4b47-a308-b048174e23d4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.379293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32aca236-76ab-4b47-a308-b048174e23d4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.380179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32aca236-76ab-4b47-a308-b048174e23d4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.420684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9f2bdb9e-ff42-48e5-9aeb-d36486e7e348 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:36.436640 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9f2bdb9e-ff42-48e5-9aeb-d36486e7e348 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1673 microversion: 2.1 time: 0.403260 Sep 10 21:12:36.440109 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2591/5091] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:36 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1673 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:36.449435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a8584af-c9c3-4106-b888-2e0b8c0e1092 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:36.452157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a8584af-c9c3-4106-b888-2e0b8c0e1092 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:36.461166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a8584af-c9c3-4106-b888-2e0b8c0e1092 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.463063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a8584af-c9c3-4106-b888-2e0b8c0e1092 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.463515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a8584af-c9c3-4106-b888-2e0b8c0e1092 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.464247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a8584af-c9c3-4106-b888-2e0b8c0e1092 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.465249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a8584af-c9c3-4106-b888-2e0b8c0e1092 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.465689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a8584af-c9c3-4106-b888-2e0b8c0e1092 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.539530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a8584af-c9c3-4106-b888-2e0b8c0e1092 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:12:36.671212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-32aca236-76ab-4b47-a308-b048174e23d4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:36.684078 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-32aca236-76ab-4b47-a308-b048174e23d4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1314 microversion: 2.1 time: 0.332770 Sep 10 21:12:36.701234 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2501/5092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:36 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:12:36.701234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-43515d6d-aaf4-40ac-89e2-f1c548e3ca4b req-9341b253-2262-4f6a-a904-a1a306e87c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7919a6b0-623c-440c-bece-f3879f6a89ab", "name": "network-vif-plugged", "status": "completed", "tag": "07804208-07af-4af5-b975-15459b698f1d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:36.720620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-43515d6d-aaf4-40ac-89e2-f1c548e3ca4b req-9341b253-2262-4f6a-a904-a1a306e87c35 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.721115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-43515d6d-aaf4-40ac-89e2-f1c548e3ca4b req-9341b253-2262-4f6a-a904-a1a306e87c35 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.721555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-43515d6d-aaf4-40ac-89e2-f1c548e3ca4b req-9341b253-2262-4f6a-a904-a1a306e87c35 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.738663 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-43515d6d-aaf4-40ac-89e2-f1c548e3ca4b req-9341b253-2262-4f6a-a904-a1a306e87c35 service nova] Creating event network-vif-plugged:07804208-07af-4af5-b975-15459b698f1d for instance 7919a6b0-623c-440c-bece-f3879f6a89ab on nch2-master-1 Sep 10 21:12:36.745143 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-43515d6d-aaf4-40ac-89e2-f1c548e3ca4b req-9341b253-2262-4f6a-a904-a1a306e87c35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058242 Sep 10 21:12:36.746328 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2502/5093] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:36.747172 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a8584af-c9c3-4106-b888-2e0b8c0e1092 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 204 len: 0 microversion: 2.1 time: 0.305449 Sep 10 21:12:36.753497 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2592/5094] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:12:36 2022] DELETE /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:12:36.764545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b05bab14-ec32-4adc-8fc7-e6b6658420b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:36.765329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b05bab14-ec32-4adc-8fc7-e6b6658420b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:36.773113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b05bab14-ec32-4adc-8fc7-e6b6658420b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.773877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b05bab14-ec32-4adc-8fc7-e6b6658420b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.774326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b05bab14-ec32-4adc-8fc7-e6b6658420b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:36.775054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b05bab14-ec32-4adc-8fc7-e6b6658420b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:36.775677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b05bab14-ec32-4adc-8fc7-e6b6658420b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:36.776313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b05bab14-ec32-4adc-8fc7-e6b6658420b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:37.025504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b05bab14-ec32-4adc-8fc7-e6b6658420b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:37.033641 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b05bab14-ec32-4adc-8fc7-e6b6658420b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1678 microversion: 2.1 time: 0.275441 Sep 10 21:12:37.038873 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2503/5095] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:36 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1678 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:12:37.110638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:37.111635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:37.120066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:37.121399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:37.122239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:37.123378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:37.124062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:37.124846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:37.152012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:37.216410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:37.247142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:37.328379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:37.338090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:37.340734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:37.342507 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-396a50ab-1d27-4fb6-899a-0d8e6d9d00fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.241263 Sep 10 21:12:37.344297 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2593/5096] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:37 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:37.465458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:37.472219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c02627d-297d-45e4-baaa-8893006aa13f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:37.472857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4c02627d-297d-45e4-baaa-8893006aa13f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:37.500082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c02627d-297d-45e4-baaa-8893006aa13f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:37.501009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c02627d-297d-45e4-baaa-8893006aa13f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:37.501663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c02627d-297d-45e4-baaa-8893006aa13f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:37.502623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c02627d-297d-45e4-baaa-8893006aa13f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:37.503263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c02627d-297d-45e4-baaa-8893006aa13f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:37.503872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c02627d-297d-45e4-baaa-8893006aa13f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:37.563953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:37.711874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4224fbd9-c291-4e3c-b582-642c33547b82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:37.719076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4224fbd9-c291-4e3c-b582-642c33547b82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:37.740108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4224fbd9-c291-4e3c-b582-642c33547b82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:37.744042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4224fbd9-c291-4e3c-b582-642c33547b82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:37.745191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4224fbd9-c291-4e3c-b582-642c33547b82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:37.747573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4224fbd9-c291-4e3c-b582-642c33547b82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:37.749711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4224fbd9-c291-4e3c-b582-642c33547b82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:37.751213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4224fbd9-c291-4e3c-b582-642c33547b82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:37.865749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4c02627d-297d-45e4-baaa-8893006aa13f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:37.896278 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c02627d-297d-45e4-baaa-8893006aa13f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1673 microversion: 2.1 time: 0.432769 Sep 10 21:12:37.898972 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2504/5097] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:37 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1673 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:38.050539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4224fbd9-c291-4e3c-b582-642c33547b82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:38.066016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d1563c3a-8ce6-4c95-ad22-cfdfd645780e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:38.066960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d1563c3a-8ce6-4c95-ad22-cfdfd645780e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:38.076643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1563c3a-8ce6-4c95-ad22-cfdfd645780e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:38.077326 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4224fbd9-c291-4e3c-b582-642c33547b82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1314 microversion: 2.1 time: 0.368797 Sep 10 21:12:38.078940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1563c3a-8ce6-4c95-ad22-cfdfd645780e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:38.079388 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2594/5098] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:37 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:12:38.080023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1563c3a-8ce6-4c95-ad22-cfdfd645780e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:38.080952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1563c3a-8ce6-4c95-ad22-cfdfd645780e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:38.081578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1563c3a-8ce6-4c95-ad22-cfdfd645780e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:38.082220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1563c3a-8ce6-4c95-ad22-cfdfd645780e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:38.363149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d1563c3a-8ce6-4c95-ad22-cfdfd645780e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:38.372131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:38.372750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:38.374517 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d1563c3a-8ce6-4c95-ad22-cfdfd645780e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1678 microversion: 2.1 time: 0.312699 Sep 10 21:12:38.375676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2505/5099] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:38 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1678 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:38.397636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:38.398634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:38.399085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:38.399833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:38.400634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:38.401309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:38.767021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:38.803076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:38.806623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:38.809134 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c5e153a-9308-498c-bd86-e41ccc92b1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.441190 Sep 10 21:12:38.827624 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2595/5100] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:38 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:12:38.943422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-778c3413-042a-45b8-be66-1d07d724b8a2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:38.945734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-778c3413-042a-45b8-be66-1d07d724b8a2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:38.969734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-778c3413-042a-45b8-be66-1d07d724b8a2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:38.970577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-778c3413-042a-45b8-be66-1d07d724b8a2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:38.971809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-778c3413-042a-45b8-be66-1d07d724b8a2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:38.972714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-778c3413-042a-45b8-be66-1d07d724b8a2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:38.973729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-778c3413-042a-45b8-be66-1d07d724b8a2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:38.974392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-778c3413-042a-45b8-be66-1d07d724b8a2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:39.121427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-af2485d1-f867-4ef6-bd7a-8e9a51fec0c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:39.122676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-af2485d1-f867-4ef6-bd7a-8e9a51fec0c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:39.135575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2485d1-f867-4ef6-bd7a-8e9a51fec0c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:39.137427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2485d1-f867-4ef6-bd7a-8e9a51fec0c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:39.138253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2485d1-f867-4ef6-bd7a-8e9a51fec0c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:39.139918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2485d1-f867-4ef6-bd7a-8e9a51fec0c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:39.140872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2485d1-f867-4ef6-bd7a-8e9a51fec0c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:39.141987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-af2485d1-f867-4ef6-bd7a-8e9a51fec0c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:39.375578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-778c3413-042a-45b8-be66-1d07d724b8a2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:39.388482 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-778c3413-042a-45b8-be66-1d07d724b8a2 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1673 microversion: 2.1 time: 0.462187 Sep 10 21:12:39.391787 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2506/5101] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:38 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1673 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:39.409496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c181de26-f537-4d74-93ec-fdcf18fbc16a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:39.410456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c181de26-f537-4d74-93ec-fdcf18fbc16a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:39.434541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c181de26-f537-4d74-93ec-fdcf18fbc16a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:39.436325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c181de26-f537-4d74-93ec-fdcf18fbc16a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:39.442800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c181de26-f537-4d74-93ec-fdcf18fbc16a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:39.444094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c181de26-f537-4d74-93ec-fdcf18fbc16a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:39.450275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c181de26-f537-4d74-93ec-fdcf18fbc16a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:39.450792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c181de26-f537-4d74-93ec-fdcf18fbc16a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:39.634576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-af2485d1-f867-4ef6-bd7a-8e9a51fec0c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:39.644737 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-af2485d1-f867-4ef6-bd7a-8e9a51fec0c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1314 microversion: 2.1 time: 0.541931 Sep 10 21:12:39.645408 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2596/5102] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:39 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:39.840395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:39.841376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:39.861591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:39.862398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:39.863093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:39.864031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:39.869795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:39.870514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:40.361498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:40.379081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:40.382256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:40.387870 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0a164b45-af00-40d9-a835-22f35416a552 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.549753 Sep 10 21:12:40.388537 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2597/5103] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:39 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:40.442633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e976a198-38fe-4d27-9744-63d42b0777e0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:40.443657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e976a198-38fe-4d27-9744-63d42b0777e0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:40.468686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e976a198-38fe-4d27-9744-63d42b0777e0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:40.472188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e976a198-38fe-4d27-9744-63d42b0777e0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:40.473065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e976a198-38fe-4d27-9744-63d42b0777e0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:40.475497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e976a198-38fe-4d27-9744-63d42b0777e0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:40.486622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e976a198-38fe-4d27-9744-63d42b0777e0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:40.489356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e976a198-38fe-4d27-9744-63d42b0777e0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:40.515931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c181de26-f537-4d74-93ec-fdcf18fbc16a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:40.547146 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c181de26-f537-4d74-93ec-fdcf18fbc16a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1678 microversion: 2.1 time: 1.149283 Sep 10 21:12:40.549627 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2507/5104] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:39 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1678 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:40.674589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e69052ad-99ca-401e-a81a-a2de7407df3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:40.675969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e69052ad-99ca-401e-a81a-a2de7407df3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:40.692663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e69052ad-99ca-401e-a81a-a2de7407df3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:40.694363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e69052ad-99ca-401e-a81a-a2de7407df3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:40.697741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e69052ad-99ca-401e-a81a-a2de7407df3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:40.711120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e69052ad-99ca-401e-a81a-a2de7407df3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:40.713295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e69052ad-99ca-401e-a81a-a2de7407df3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:40.717810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e69052ad-99ca-401e-a81a-a2de7407df3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:40.906078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e976a198-38fe-4d27-9744-63d42b0777e0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:40.922922 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e976a198-38fe-4d27-9744-63d42b0777e0 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1673 microversion: 2.1 time: 0.481055 Sep 10 21:12:40.924250 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2598/5105] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:40 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1673 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:12:40.931479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-42b1920a-a2ec-4e95-a47b-77ead10fd314 req-4cd34200-4de8-464b-9495-971c81024447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f661c48-654e-41b6-94a2-a8b9c4fa20fb", "name": "network-vif-plugged", "status": "completed", "tag": "445b64b9-f81c-4c16-8ad9-e2a81f897746"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:40.958710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-42b1920a-a2ec-4e95-a47b-77ead10fd314 req-4cd34200-4de8-464b-9495-971c81024447 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:40.960665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-42b1920a-a2ec-4e95-a47b-77ead10fd314 req-4cd34200-4de8-464b-9495-971c81024447 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:40.961401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-42b1920a-a2ec-4e95-a47b-77ead10fd314 req-4cd34200-4de8-464b-9495-971c81024447 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:40.987416 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-42b1920a-a2ec-4e95-a47b-77ead10fd314 req-4cd34200-4de8-464b-9495-971c81024447 service nova] Creating event network-vif-plugged:445b64b9-f81c-4c16-8ad9-e2a81f897746 for instance 1f661c48-654e-41b6-94a2-a8b9c4fa20fb on nch1-master-1 Sep 10 21:12:41.009189 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-42b1920a-a2ec-4e95-a47b-77ead10fd314 req-4cd34200-4de8-464b-9495-971c81024447 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082488 Sep 10 21:12:41.014193 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2599/5106] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:41.420183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:41.421267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:41.437325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:41.438117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:41.438725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:41.441595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:41.442554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:41.444688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:41.686052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e69052ad-99ca-401e-a81a-a2de7407df3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:41.709600 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e69052ad-99ca-401e-a81a-a2de7407df3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1314 microversion: 2.1 time: 1.039174 Sep 10 21:12:41.713814 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2508/5107] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:40 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1314 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:12:41.721689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-92e115cd-3d09-415d-88e0-ee44f2fc210e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:41.726560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-92e115cd-3d09-415d-88e0-ee44f2fc210e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:41.742588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e115cd-3d09-415d-88e0-ee44f2fc210e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:41.743973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e115cd-3d09-415d-88e0-ee44f2fc210e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:41.744793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e115cd-3d09-415d-88e0-ee44f2fc210e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:41.745973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e115cd-3d09-415d-88e0-ee44f2fc210e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:41.747107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e115cd-3d09-415d-88e0-ee44f2fc210e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:41.748157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92e115cd-3d09-415d-88e0-ee44f2fc210e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:41.888019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:41.904895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:41.907031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:41.909217 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-69147c2a-0a03-4549-a796-918d65880eae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.495460 Sep 10 21:12:41.927002 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2600/5108] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:41 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:41.952932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ba04ab1-5226-49c6-9122-a9c81863aac1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:41.953750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6ba04ab1-5226-49c6-9122-a9c81863aac1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:41.965306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:41.968715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba04ab1-5226-49c6-9122-a9c81863aac1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:41.969255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba04ab1-5226-49c6-9122-a9c81863aac1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:41.969708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba04ab1-5226-49c6-9122-a9c81863aac1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:41.976034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba04ab1-5226-49c6-9122-a9c81863aac1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:41.976811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba04ab1-5226-49c6-9122-a9c81863aac1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:41.977795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba04ab1-5226-49c6-9122-a9c81863aac1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:42.269677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ba04ab1-5226-49c6-9122-a9c81863aac1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:42.282958 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ba04ab1-5226-49c6-9122-a9c81863aac1 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1673 microversion: 2.1 time: 0.334663 Sep 10 21:12:42.285222 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2601/5109] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:41 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1673 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:42.741391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-acf04f2c-c6fa-4296-a105-229bcb94c2ea tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:42.743200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-acf04f2c-c6fa-4296-a105-229bcb94c2ea tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:42.756664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acf04f2c-c6fa-4296-a105-229bcb94c2ea tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:42.757487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acf04f2c-c6fa-4296-a105-229bcb94c2ea tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:42.758214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acf04f2c-c6fa-4296-a105-229bcb94c2ea tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:42.759229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acf04f2c-c6fa-4296-a105-229bcb94c2ea tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:42.759880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acf04f2c-c6fa-4296-a105-229bcb94c2ea tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:42.761976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-acf04f2c-c6fa-4296-a105-229bcb94c2ea tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:43.059323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-92e115cd-3d09-415d-88e0-ee44f2fc210e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:43.078743 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-92e115cd-3d09-415d-88e0-ee44f2fc210e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1678 microversion: 2.1 time: 1.361507 Sep 10 21:12:43.080576 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2509/5110] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:41 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1678 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:43.092812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:43.094029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:43.126362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:43.128311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:43.134451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:43.140222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:43.144835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-acf04f2c-c6fa-4296-a105-229bcb94c2ea tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:43.155381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:43.157109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:43.164610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-acf04f2c-c6fa-4296-a105-229bcb94c2ea tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1314 microversion: 2.1 time: 0.424092 Sep 10 21:12:43.186745 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2602/5111] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:42 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:43.315301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da8cc607-5b49-432c-918b-2a18a2acb8a5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:43.320873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-da8cc607-5b49-432c-918b-2a18a2acb8a5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:43.348616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da8cc607-5b49-432c-918b-2a18a2acb8a5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:43.350405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da8cc607-5b49-432c-918b-2a18a2acb8a5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:43.350909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da8cc607-5b49-432c-918b-2a18a2acb8a5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:43.354101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da8cc607-5b49-432c-918b-2a18a2acb8a5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:43.358456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da8cc607-5b49-432c-918b-2a18a2acb8a5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:43.359400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da8cc607-5b49-432c-918b-2a18a2acb8a5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:43.549289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-da8cc607-5b49-432c-918b-2a18a2acb8a5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:43.568933 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da8cc607-5b49-432c-918b-2a18a2acb8a5 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1605 microversion: 2.1 time: 0.263664 Sep 10 21:12:43.569399 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2603/5112] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:43 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1605 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:44.120240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-63a57d81-2a09-4e9b-a19b-87e7aeda1c36 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:44.121452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-63a57d81-2a09-4e9b-a19b-87e7aeda1c36 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:44.136053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63a57d81-2a09-4e9b-a19b-87e7aeda1c36 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:44.136909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63a57d81-2a09-4e9b-a19b-87e7aeda1c36 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:44.137779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63a57d81-2a09-4e9b-a19b-87e7aeda1c36 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:44.139598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63a57d81-2a09-4e9b-a19b-87e7aeda1c36 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:44.140076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63a57d81-2a09-4e9b-a19b-87e7aeda1c36 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:44.140545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63a57d81-2a09-4e9b-a19b-87e7aeda1c36 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:44.214678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:44.228750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:44.233107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:44.245554 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1cd44ac5-a3e5-4fcd-9171-6b1e1fe888a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 1.158667 Sep 10 21:12:44.246463 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2510/5113] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:43 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:44.258194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c444fd92-f7d4-4882-a5b6-1e15f45dc6f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:44.258194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c444fd92-f7d4-4882-a5b6-1e15f45dc6f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:44.303431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c444fd92-f7d4-4882-a5b6-1e15f45dc6f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:44.304450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c444fd92-f7d4-4882-a5b6-1e15f45dc6f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:44.305465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c444fd92-f7d4-4882-a5b6-1e15f45dc6f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:44.310822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c444fd92-f7d4-4882-a5b6-1e15f45dc6f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:44.317802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c444fd92-f7d4-4882-a5b6-1e15f45dc6f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:44.318760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c444fd92-f7d4-4882-a5b6-1e15f45dc6f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:44.339650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-63a57d81-2a09-4e9b-a19b-87e7aeda1c36 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:44.348494 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-63a57d81-2a09-4e9b-a19b-87e7aeda1c36 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1611 microversion: 2.1 time: 0.236861 Sep 10 21:12:44.349375 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2604/5114] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:44 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1611 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:44.603357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-febe2c01-055b-4549-8b6d-c6f30533419a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:44.604751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-febe2c01-055b-4549-8b6d-c6f30533419a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:44.624741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-febe2c01-055b-4549-8b6d-c6f30533419a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:44.625789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-febe2c01-055b-4549-8b6d-c6f30533419a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:44.626599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-febe2c01-055b-4549-8b6d-c6f30533419a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:44.627842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-febe2c01-055b-4549-8b6d-c6f30533419a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:44.628545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-febe2c01-055b-4549-8b6d-c6f30533419a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:44.629246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-febe2c01-055b-4549-8b6d-c6f30533419a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:44.774959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-febe2c01-055b-4549-8b6d-c6f30533419a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:44.787778 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-febe2c01-055b-4549-8b6d-c6f30533419a tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1605 microversion: 2.1 time: 0.189002 Sep 10 21:12:44.803360 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2605/5115] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:44 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1605 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:44.925158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c444fd92-f7d4-4882-a5b6-1e15f45dc6f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:44.934900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a9bbf442-3504-45d7-9429-a574d02f7976 req-af0a73c8-ece9-4f18-a676-17f4db109f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbebf08d-97c2-43b6-848d-8665f61d8854", "name": "network-vif-deleted", "tag": "843f51c3-30f6-417c-8823-56aa1ba415c8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:44.988943 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c444fd92-f7d4-4882-a5b6-1e15f45dc6f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1502 microversion: 2.1 time: 0.741184 Sep 10 21:12:44.993684 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2511/5116] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:44 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1502 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:45.007467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a9bbf442-3504-45d7-9429-a574d02f7976 req-af0a73c8-ece9-4f18-a676-17f4db109f91 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.008084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a9bbf442-3504-45d7-9429-a574d02f7976 req-af0a73c8-ece9-4f18-a676-17f4db109f91 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.025266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5560a944-575b-49c6-9e69-e3b711aae477 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:45.028206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a9bbf442-3504-45d7-9429-a574d02f7976 req-af0a73c8-ece9-4f18-a676-17f4db109f91 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.046717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5560a944-575b-49c6-9e69-e3b711aae477 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.047535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5560a944-575b-49c6-9e69-e3b711aae477 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.048359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5560a944-575b-49c6-9e69-e3b711aae477 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.095998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5560a944-575b-49c6-9e69-e3b711aae477 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Going to try to stop instance {{(pid=145771) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 21:12:45.099765 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a9bbf442-3504-45d7-9429-a574d02f7976 req-af0a73c8-ece9-4f18-a676-17f4db109f91 service nova] Creating event network-vif-deleted:843f51c3-30f6-417c-8823-56aa1ba415c8 for instance bbebf08d-97c2-43b6-848d-8665f61d8854 on nch1-master-1 Sep 10 21:12:45.120318 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a9bbf442-3504-45d7-9429-a574d02f7976 req-af0a73c8-ece9-4f18-a676-17f4db109f91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207570 Sep 10 21:12:45.124155 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2606/5117] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:45.237697 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5560a944-575b-49c6-9e69-e3b711aae477 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb/action" status: 202 len: 0 microversion: 2.1 time: 0.224140 Sep 10 21:12:45.239030 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2512/5118] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:12:45 2022] POST /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:12:45.250793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-764ddf53-88f1-4255-ad55-8b6101da23c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:45.251969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-764ddf53-88f1-4255-ad55-8b6101da23c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:45.285804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:45.290794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:45.298854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-764ddf53-88f1-4255-ad55-8b6101da23c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.306047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-764ddf53-88f1-4255-ad55-8b6101da23c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.307065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-764ddf53-88f1-4255-ad55-8b6101da23c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.310896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-764ddf53-88f1-4255-ad55-8b6101da23c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.316011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.317245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.318104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.319176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.319854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.320497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.321012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-764ddf53-88f1-4255-ad55-8b6101da23c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.321520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-764ddf53-88f1-4255-ad55-8b6101da23c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.666496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-764ddf53-88f1-4255-ad55-8b6101da23c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:45.677365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-764ddf53-88f1-4255-ad55-8b6101da23c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.432210 Sep 10 21:12:45.679991 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2607/5119] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:45 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:45.692010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7177fb5a-c410-494c-a2d1-b9de81b0e12f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:45.693027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7177fb5a-c410-494c-a2d1-b9de81b0e12f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:45.701942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7177fb5a-c410-494c-a2d1-b9de81b0e12f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.702856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7177fb5a-c410-494c-a2d1-b9de81b0e12f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.703479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7177fb5a-c410-494c-a2d1-b9de81b0e12f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.704463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7177fb5a-c410-494c-a2d1-b9de81b0e12f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.707728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7177fb5a-c410-494c-a2d1-b9de81b0e12f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.708567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7177fb5a-c410-494c-a2d1-b9de81b0e12f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.827137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7177fb5a-c410-494c-a2d1-b9de81b0e12f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:45.840191 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7177fb5a-c410-494c-a2d1-b9de81b0e12f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1611 microversion: 2.1 time: 0.158317 Sep 10 21:12:45.841374 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2608/5120] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:45 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1611 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:45.872731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:45.873656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:45.884587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.886918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.887857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.889688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.891753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.892948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.945199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:45.946062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:45.946863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:45.947505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lazy-loading 'fault' on Instance uuid bbebf08d-97c2-43b6-848d-8665f61d8854 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:12:46.052612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e5077421c44eb7abcda40582c7ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b196d42c2d6416c81818922af07b8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:46.068560 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5c941cc3-6cd7-4e3f-ac2f-10c7a31ddbb6 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 200 len: 1327 microversion: 2.1 time: 0.202335 Sep 10 21:12:46.072651 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2609/5121] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:45 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 1327 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:46.180203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:46.191171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:46.192763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:46.194033 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6adcf2b0-3ba1-4fcc-89b9-562dce8a4fe2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.914518 Sep 10 21:12:46.218018 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2513/5122] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:45 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:46.704054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a8217dd8-5b71-4eed-9292-59ed7244621d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:46.706729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a8217dd8-5b71-4eed-9292-59ed7244621d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:46.726369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8217dd8-5b71-4eed-9292-59ed7244621d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:46.731996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8217dd8-5b71-4eed-9292-59ed7244621d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:46.733668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8217dd8-5b71-4eed-9292-59ed7244621d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:46.734869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8217dd8-5b71-4eed-9292-59ed7244621d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:46.735709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8217dd8-5b71-4eed-9292-59ed7244621d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:46.736542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8217dd8-5b71-4eed-9292-59ed7244621d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:46.868012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:46.868587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:46.886933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:46.887774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:46.895910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:46.897005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:46.900817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:46.905235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:47.054591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:47.055079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:47.060415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:47.061197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lazy-loading 'fault' on Instance uuid d7693b5b-858c-4224-93a8-e07f29b30646 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:12:47.089432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a8217dd8-5b71-4eed-9292-59ed7244621d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:47.108716 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a8217dd8-5b71-4eed-9292-59ed7244621d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.410672 Sep 10 21:12:47.111562 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2610/5123] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:46 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:47.128006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:47.128667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:47.148613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:47.150671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:47.152772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:47.153903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:47.155617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:47.156269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:47.175918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:47.178017 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] HTTP exception thrown: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:47.178411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Request method failure captured: Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 HTTP/1.1 Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxEV6jv3JJE-qB1TZIGEjv-scsRBkB2K5LAqiMkDVDA2v0uPyGK28D6dzqxbMFiq8bw-vG9EY9FMtKKN8amSEFZ-p3BlGaTZePzxAIftZltKXS7oXqY9BD4Ay6IC1KTDag1F3JvYSrKbL2CQeJ-F3_m9kUaLPmQTexhjxCDqooXa5k Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b196d42c2d6416c81818922af07b8a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b196d42c2d6416c81818922af07b8a3"}]}] Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 13e5077421c44eb7abcda40582c7ea9a Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'bbebf08d-97c2-43b6-848d-8665f61d8854'} Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:47.181683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:47.187514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:47.187514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:47.187514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:47.187514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:12:47.187514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:12:47.187514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:47.187514 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:47.189592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Returning 404 to user: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:12:47.192024 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1be8036d-de6b-49f1-ab82-5fad2a870d61 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 404 len: 111 microversion: 2.1 time: 0.067400 Sep 10 21:12:47.194632 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-af93de0f-d194-411c-8453-b7c03278d7f0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 200 len: 1331 microversion: 2.1 time: 0.330847 Sep 10 21:12:47.195487 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2514/5124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:46 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 1331 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:47.197291 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2611/5125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:47 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:12:47.207594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae4268b4-86a9-4cfb-9812-b997d4be7d27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '.version_select at 0x7f994425f3a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:47.221632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4e6ce703-482a-4ca0-8829-a6bf0b541989 req-7a0ab316-fce6-49bb-ab9e-292ddbfc3f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7693b5b-858c-4224-93a8-e07f29b30646", "name": "network-vif-deleted", "tag": "498021c7-c910-46d0-97a2-7bd480886623"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:47.248625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4e6ce703-482a-4ca0-8829-a6bf0b541989 req-7a0ab316-fce6-49bb-ab9e-292ddbfc3f2d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:47.249111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4e6ce703-482a-4ca0-8829-a6bf0b541989 req-7a0ab316-fce6-49bb-ab9e-292ddbfc3f2d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:47.249546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4e6ce703-482a-4ca0-8829-a6bf0b541989 req-7a0ab316-fce6-49bb-ab9e-292ddbfc3f2d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:47.306067 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae4268b4-86a9-4cfb-9812-b997d4be7d27 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2015045020" status: 202 len: 0 microversion: 2.1 time: 0.107590 Sep 10 21:12:47.307127 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2515/5126] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 21:12:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2015045020 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:12:47.310227 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4e6ce703-482a-4ca0-8829-a6bf0b541989 req-7a0ab316-fce6-49bb-ab9e-292ddbfc3f2d service nova] Creating event network-vif-deleted:498021c7-c910-46d0-97a2-7bd480886623 for instance d7693b5b-858c-4224-93a8-e07f29b30646 on nch1-master-1 Sep 10 21:12:47.326883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:47.329325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:47.331442 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4e6ce703-482a-4ca0-8829-a6bf0b541989 req-7a0ab316-fce6-49bb-ab9e-292ddbfc3f2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112303 Sep 10 21:12:47.333534 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2612/5127] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:47.339438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:47.340735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:47.341387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:47.342540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:47.343200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:47.343799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:47.630213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:47.642568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:47.644810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:47.646367 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-494925c5-7c86-4ef3-ba48-6e70731d8da9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.337814 Sep 10 21:12:47.647221 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2516/5128] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:47 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:48.134723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5504972a-7a7a-4f94-aea0-ff5bb59a0010 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:48.145361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5504972a-7a7a-4f94-aea0-ff5bb59a0010 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:48.169584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5504972a-7a7a-4f94-aea0-ff5bb59a0010 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:48.178458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5504972a-7a7a-4f94-aea0-ff5bb59a0010 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:48.181809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5504972a-7a7a-4f94-aea0-ff5bb59a0010 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:48.232436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:48.233098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5504972a-7a7a-4f94-aea0-ff5bb59a0010 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:48.234378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5504972a-7a7a-4f94-aea0-ff5bb59a0010 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:48.234695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:48.238825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5504972a-7a7a-4f94-aea0-ff5bb59a0010 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:48.251742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:48.252259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:48.252848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:48.253883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:48.254706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:48.255068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:48.292029 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 HTTP/1.1 Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'd7693b5b-858c-4224-93a8-e07f29b30646'} Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:48.300355 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:48.308807 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:48.308807 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:48.308807 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:48.308807 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:12:48.308807 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:12:48.308807 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:12:48.308807 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:48.308807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:12:48.313230 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c997a60c-74d9-4a89-a8d3-597bcc1f308f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 404 len: 111 microversion: 2.1 time: 0.087822 Sep 10 21:12:48.316437 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2517/5129] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:48 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:12:48.342960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4d7deb77-361d-41b4-98f2-ceb93612af93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '.version_select at 0x7f994425fca0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:48.376356 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4d7deb77-361d-41b4-98f2-ceb93612af93 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-183368343" status: 202 len: 0 microversion: 2.1 time: 0.057466 Sep 10 21:12:48.377258 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2518/5130] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 21:12:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-183368343 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:12:48.647994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5504972a-7a7a-4f94-aea0-ff5bb59a0010 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:48.660042 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5504972a-7a7a-4f94-aea0-ff5bb59a0010 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.530748 Sep 10 21:12:48.675116 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2613/5131] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:48 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:48.685698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:48.688962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:48.705029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:48.706205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:48.707873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:48.708859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:48.709277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:48.709968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:49.021916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:49.038973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:49.041274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:49.044090 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-03a9af03-95ab-4eba-bffd-b1c75b7ad0c7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.369446 Sep 10 21:12:49.045471 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2519/5132] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:48 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:49.689392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1366c1fb-9881-4533-bc0a-5c98f9cdfafe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:49.690074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1366c1fb-9881-4533-bc0a-5c98f9cdfafe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:49.702376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1366c1fb-9881-4533-bc0a-5c98f9cdfafe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:49.706614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1366c1fb-9881-4533-bc0a-5c98f9cdfafe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:49.707304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1366c1fb-9881-4533-bc0a-5c98f9cdfafe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:49.708056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1366c1fb-9881-4533-bc0a-5c98f9cdfafe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:49.708517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1366c1fb-9881-4533-bc0a-5c98f9cdfafe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:49.709153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1366c1fb-9881-4533-bc0a-5c98f9cdfafe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:50.077477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:50.081122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:50.120720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:50.122702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:50.123877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:50.154672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:50.155653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:50.156317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:50.196553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1366c1fb-9881-4533-bc0a-5c98f9cdfafe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:50.215569 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1366c1fb-9881-4533-bc0a-5c98f9cdfafe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.529965 Sep 10 21:12:50.217018 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2614/5133] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:49 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:50.502255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:50.515747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:50.519543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:50.521332 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4e959c09-3429-4621-b567-5b7d620db92d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.451957 Sep 10 21:12:50.522442 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2520/5134] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:50 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:50.591253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3902cb5d-3891-4942-be51-9b3c9792f5a8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: .version_select at 0x7f9944ce54c0>, body: {"keypair": {"name": "tempest-keypair-1589204664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmepZisSQYjBWMXZYxYayi8yKrNLDcd0nIhC/TrFtm0uhfNb473/V/6JTG4B13ErSeidSr/b3av+TJiHc1BJYMeQt/niymMX4oBlFHbnofmdnn+x1uCnq0k011k+ZMx1w=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:50.616946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3902cb5d-3891-4942-be51-9b3c9792f5a8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:12:50.626089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3902cb5d-3891-4942-be51-9b3c9792f5a8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for user 54dcc78ee39c4119b08023d3cc692d6b and project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:12:50.718564 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3902cb5d-3891-4942-be51-9b3c9792f5a8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128039 Sep 10 21:12:50.724816 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2615/5135] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:12:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:51.242834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8fe1f94-68d7-4aa0-87f0-b54e4dd68cc1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:51.244730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8fe1f94-68d7-4aa0-87f0-b54e4dd68cc1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:51.260544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fe1f94-68d7-4aa0-87f0-b54e4dd68cc1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:51.261382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fe1f94-68d7-4aa0-87f0-b54e4dd68cc1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:51.262193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fe1f94-68d7-4aa0-87f0-b54e4dd68cc1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:51.263099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fe1f94-68d7-4aa0-87f0-b54e4dd68cc1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:51.264458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fe1f94-68d7-4aa0-87f0-b54e4dd68cc1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:51.265161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fe1f94-68d7-4aa0-87f0-b54e4dd68cc1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:51.552470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:51.558641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:51.580010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:51.580541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:51.580992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:51.588893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:51.590295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:51.590839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:51.759045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8fe1f94-68d7-4aa0-87f0-b54e4dd68cc1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:51.770854 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8fe1f94-68d7-4aa0-87f0-b54e4dd68cc1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.533194 Sep 10 21:12:51.774916 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2521/5136] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:51 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:52.379607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:52.419011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:52.425587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:52.428673 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2571d4ed-c939-48dd-ac05-2d819d51b87d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.880415 Sep 10 21:12:52.435073 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2616/5137] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:51 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:52.715493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:52.717577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:52.730282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:52.734862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:52.737211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:52.738297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:52.740712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:52.741578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:52.801889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0dfb19d-9ab1-4641-9140-843100ed28bc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:52.803094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0dfb19d-9ab1-4641-9140-843100ed28bc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:52.813611 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] HTTP exception thrown: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Request method failure captured: Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 HTTP/1.1 Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxEV6jv3JJE-qB1TZIGEjv-scsRBkB2K5LAqiMkDVDA2v0uPyGK28D6dzqxbMFiq8bw-vG9EY9FMtKKN8amSEFZ-p3BlGaTZePzxAIftZltKXS7oXqY9BD4Ay6IC1KTDag1F3JvYSrKbL2CQeJ-F3_m9kUaLPmQTexhjxCDqooXa5k Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b196d42c2d6416c81818922af07b8a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b196d42c2d6416c81818922af07b8a3"}]}] Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 13e5077421c44eb7abcda40582c7ea9a Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'bbebf08d-97c2-43b6-848d-8665f61d8854'} Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:12:52.828618 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:52.834127 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:52.842544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb19d-9ab1-4641-9140-843100ed28bc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:52.843479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb19d-9ab1-4641-9140-843100ed28bc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:52.844205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb19d-9ab1-4641-9140-843100ed28bc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:52.845252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb19d-9ab1-4641-9140-843100ed28bc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:52.846769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb19d-9ab1-4641-9140-843100ed28bc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:52.847293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Returning 404 to user: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:12:52.847809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb19d-9ab1-4641-9140-843100ed28bc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:52.854537 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-630798a9-c5bb-445b-a044-4fb0190bfc23 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 404 len: 111 microversion: 2.1 time: 0.144652 Sep 10 21:12:52.857487 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2522/5138] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:12:52 2022] DELETE /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:12:52.877005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:52.877700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: bbebf08d-97c2-43b6-848d-8665f61d8854] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:52.889155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:52.893447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:52.899005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:52.900206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:52.901101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:52.903157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:52.921441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:52.924369 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] HTTP exception thrown: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Request method failure captured: Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 HTTP/1.1 Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxEV6jv3JJE-qB1TZIGEjv-scsRBkB2K5LAqiMkDVDA2v0uPyGK28D6dzqxbMFiq8bw-vG9EY9FMtKKN8amSEFZ-p3BlGaTZePzxAIftZltKXS7oXqY9BD4Ay6IC1KTDag1F3JvYSrKbL2CQeJ-F3_m9kUaLPmQTexhjxCDqooXa5k Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b196d42c2d6416c81818922af07b8a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b196d42c2d6416c81818922af07b8a3"}]}] Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 13e5077421c44eb7abcda40582c7ea9a Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'bbebf08d-97c2-43b6-848d-8665f61d8854'} Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:52.926968 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:52.933617 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:52.933617 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:52.933617 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:52.933617 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:12:52.933617 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:12:52.933617 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. Sep 10 21:12:52.933617 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:52.936731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Returning 404 to user: Instance bbebf08d-97c2-43b6-848d-8665f61d8854 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:12:52.937969 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-46662c8a-d61f-46fe-955b-a14d3d26262f tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854" status: 404 len: 111 microversion: 2.1 time: 0.076424 Sep 10 21:12:52.942227 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2523/5139] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:52 2022] GET /compute/v2.1/servers/bbebf08d-97c2-43b6-848d-8665f61d8854 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:12:53.194435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0dfb19d-9ab1-4641-9140-843100ed28bc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:53.205563 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0dfb19d-9ab1-4641-9140-843100ed28bc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.410496 Sep 10 21:12:53.206968 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2617/5140] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:52 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:12:53.318969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-49e012af-330a-4abd-9c5e-63d9d4a0a849 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:53.321907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49e012af-330a-4abd-9c5e-63d9d4a0a849 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:53.322706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49e012af-330a-4abd-9c5e-63d9d4a0a849 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:53.323419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49e012af-330a-4abd-9c5e-63d9d4a0a849 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:53.324328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49e012af-330a-4abd-9c5e-63d9d4a0a849 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:53.326080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49e012af-330a-4abd-9c5e-63d9d4a0a849 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:53.342171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49e012af-330a-4abd-9c5e-63d9d4a0a849 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:53.387449 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-49e012af-330a-4abd-9c5e-63d9d4a0a849 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.443585 Sep 10 21:12:53.388849 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2524/5141] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Sep 10 21:12:52 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:12:53.465129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:53.466521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:53.477401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:53.478159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:53.479186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:53.481033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:53.481814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:53.483235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:53.692298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1757411852", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "e530c2d2-9685-4067-b514-eafa9f57a39c"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:53.849389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] validate_networks() for [('e530c2d2-9685-4067-b514-eafa9f57a39c', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:12:53.880459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:53.900824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:53.904910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:53.906194 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b7d8d051-6834-4ab4-adb0-2872b4020535 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.446587 Sep 10 21:12:53.912275 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2618/5142] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:53 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:54.243346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-932165494", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05daa8b2-a600-4c08-8c3a-78652e8f4ca4"}], "security_groups": [{"name": "tempest-securitygroup--1055750884"}], "key_name": "tempest-keypair-1589204664", "user_data": "}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:12:54.461768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] validate_networks() for [('05daa8b2-a600-4c08-8c3a-78652e8f4ca4', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:12:54.580509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:12:54.581417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:12:54.582157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:12:54.583332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:12:54.584014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:12:54.597507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:54.598595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:54.599296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:54.600155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:54.601364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:54.602301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:54.630042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Getting quotas for project 284406fb5bca447e99e96da850338927. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:12:54.637795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Getting quotas for user a52844a1f8e142849762f7394dd0010a and project 284406fb5bca447e99e96da850338927. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:12:54.653141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:12:54.656074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:12:54.702217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:12:54.744982 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-48ae2ec1-2147-499b-aaac-a37743e16c27 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057506 Sep 10 21:12:54.746907 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2525/5143] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:12:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:12:54.758355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7df37958-9c65-42ee-8884-9ac5c16d10f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:54.759387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7df37958-9c65-42ee-8884-9ac5c16d10f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:54.767620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7df37958-9c65-42ee-8884-9ac5c16d10f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:54.768532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7df37958-9c65-42ee-8884-9ac5c16d10f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:54.769431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7df37958-9c65-42ee-8884-9ac5c16d10f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:54.770538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7df37958-9c65-42ee-8884-9ac5c16d10f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:54.772251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7df37958-9c65-42ee-8884-9ac5c16d10f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:54.773147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7df37958-9c65-42ee-8884-9ac5c16d10f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:55.009774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7df37958-9c65-42ee-8884-9ac5c16d10f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:55.023435 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7df37958-9c65-42ee-8884-9ac5c16d10f4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.275092 Sep 10 21:12:55.026224 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2526/5144] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:54 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:55.037521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:55.046426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:55.067638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:55.068255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:55.068818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:55.069667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:55.070261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:55.072225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:55.088835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:12:55.090802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:12:55.091368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:12:55.091793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:12:55.092213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:12:55.102679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:55.103385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:55.104171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:55.105866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:55.106601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:55.107205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:55.117259 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] HTTP exception thrown: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Request method failure captured: Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb HTTP/1.1 Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPxEV6jv3JJE-qB1TZIGEjv-scsRBkB2K5LAqiMkDVDA2v0uPyGK28D6dzqxbMFiq8bw-vG9EY9FMtKKN8amSEFZ-p3BlGaTZePzxAIftZltKXS7oXqY9BD4Ay6IC1KTDag1F3JvYSrKbL2CQeJ-F3_m9kUaLPmQTexhjxCDqooXa5k Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b196d42c2d6416c81818922af07b8a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b196d42c2d6416c81818922af07b8a3"}]}] Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 13e5077421c44eb7abcda40582c7ea9a Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'e06501f8-3bc9-4240-b2ca-514d8d6fdacb'} Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:12:55.119613 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:12:55.126584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:12:55.129338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Returning 404 to user: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:12:55.131047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:12:55.134926 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cff789ff-96b3-4a57-87f6-71c90560efdb tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 404 len: 111 microversion: 2.1 time: 0.105245 Sep 10 21:12:55.135528 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2527/5145] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:12:55 2022] DELETE /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:12:55.142205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for user 54dcc78ee39c4119b08023d3cc692d6b and project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:12:55.154543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f76b23db-6fb6-4c24-8678-05ea43bd9b2d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:55.155185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f76b23db-6fb6-4c24-8678-05ea43bd9b2d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:55.162884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:12:55.166389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:12:55.308938 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f76b23db-6fb6-4c24-8678-05ea43bd9b2d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1329 microversion: 2.1 time: 0.168459 Sep 10 21:12:55.322602 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2528/5146] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:55 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1329 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:55.335957 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-990ada59-b90f-4a98-822e-5d31b20fbb88 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.097294 Sep 10 21:12:55.337787 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2619/5147] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:12:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:12:55.339574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:55.343122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:55.351560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:55.353314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] [instance: e06501f8-3bc9-4240-b2ca-514d8d6fdacb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:55.361271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:55.363459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:55.365518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:55.367742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:55.369264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:55.371197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:55.377771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:55.379375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:55.385775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:55.395435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:55.396001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:55.396397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:55.417951 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] HTTP exception thrown: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Request method failure captured: Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb HTTP/1.1 Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPxEV6jv3JJE-qB1TZIGEjv-scsRBkB2K5LAqiMkDVDA2v0uPyGK28D6dzqxbMFiq8bw-vG9EY9FMtKKN8amSEFZ-p3BlGaTZePzxAIftZltKXS7oXqY9BD4Ay6IC1KTDag1F3JvYSrKbL2CQeJ-F3_m9kUaLPmQTexhjxCDqooXa5k Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b196d42c2d6416c81818922af07b8a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b196d42c2d6416c81818922af07b8a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b196d42c2d6416c81818922af07b8a3"}]}] Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9b196d42c2d6416c81818922af07b8a3 Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1091829673 Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 13e5077421c44eb7abcda40582c7ea9a Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeTestJSON-1091829673-project Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e06501f8-3bc9-4240-b2ca-514d8d6fdacb'} Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:12:55.419948 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:55.425380 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:12:55.425380 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:12:55.425380 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:12:55.425380 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:12:55.425380 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:12:55.425380 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. Sep 10 21:12:55.425380 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:12:55.426781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] Returning 404 to user: Instance e06501f8-3bc9-4240-b2ca-514d8d6fdacb could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:12:55.427851 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e53ee31-ff4c-456c-837d-1afbb158e385 tempest-AttachVolumeTestJSON-1091829673 tempest-AttachVolumeTestJSON-1091829673-project] 10.222.0.33 "GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb" status: 404 len: 111 microversion: 2.1 time: 0.088862 Sep 10 21:12:55.428725 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2620/5148] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:55 2022] GET /compute/v2.1/servers/e06501f8-3bc9-4240-b2ca-514d8d6fdacb => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:12:55.447940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-911ffe04-abfc-4efd-9921-79dd5a1b8838 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:55.449264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-911ffe04-abfc-4efd-9921-79dd5a1b8838 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:55.605710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-911ffe04-abfc-4efd-9921-79dd5a1b8838 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:55.613280 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-911ffe04-abfc-4efd-9921-79dd5a1b8838 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1241 microversion: 2.1 time: 0.182973 Sep 10 21:12:55.617070 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2621/5149] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:55 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:55.701760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:55.713639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:55.717459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:55.719407 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6086b072-ef60-467d-a067-baff80d41bdb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.395462 Sep 10 21:12:55.720218 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2529/5150] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:55 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:12:56.053767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f6081d6-cacb-4ee1-be82-dccb5c9dd053 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:56.054816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4f6081d6-cacb-4ee1-be82-dccb5c9dd053 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:56.071535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6081d6-cacb-4ee1-be82-dccb5c9dd053 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:56.075426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6081d6-cacb-4ee1-be82-dccb5c9dd053 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:56.076215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6081d6-cacb-4ee1-be82-dccb5c9dd053 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:56.077247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6081d6-cacb-4ee1-be82-dccb5c9dd053 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:56.078008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6081d6-cacb-4ee1-be82-dccb5c9dd053 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:56.079153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f6081d6-cacb-4ee1-be82-dccb5c9dd053 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:56.336394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-310f6459-e46b-4e94-8b33-6069146abe9c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:56.337013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-310f6459-e46b-4e94-8b33-6069146abe9c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:56.346762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310f6459-e46b-4e94-8b33-6069146abe9c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:56.358194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310f6459-e46b-4e94-8b33-6069146abe9c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:56.359144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310f6459-e46b-4e94-8b33-6069146abe9c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:56.362684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310f6459-e46b-4e94-8b33-6069146abe9c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:56.363614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310f6459-e46b-4e94-8b33-6069146abe9c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:56.364395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310f6459-e46b-4e94-8b33-6069146abe9c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:56.540733 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-310f6459-e46b-4e94-8b33-6069146abe9c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1416 microversion: 2.1 time: 0.204511 Sep 10 21:12:56.543170 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2530/5151] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:56 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1416 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:56.636348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4f6081d6-cacb-4ee1-be82-dccb5c9dd053 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:56.643410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6bb0ff49-ba69-4ac2-954c-cf40d811eb11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:56.644037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6bb0ff49-ba69-4ac2-954c-cf40d811eb11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:56.653938 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f6081d6-cacb-4ee1-be82-dccb5c9dd053 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.604206 Sep 10 21:12:56.654707 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2622/5152] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:56 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:56.670858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bb0ff49-ba69-4ac2-954c-cf40d811eb11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:56.672843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bb0ff49-ba69-4ac2-954c-cf40d811eb11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:56.673904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bb0ff49-ba69-4ac2-954c-cf40d811eb11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:56.674858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bb0ff49-ba69-4ac2-954c-cf40d811eb11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:56.675735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bb0ff49-ba69-4ac2-954c-cf40d811eb11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:56.676749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6bb0ff49-ba69-4ac2-954c-cf40d811eb11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:56.749184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:56.749347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6bb0ff49-ba69-4ac2-954c-cf40d811eb11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:56.750258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:56.759615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:56.760923 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6bb0ff49-ba69-4ac2-954c-cf40d811eb11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1237 microversion: 2.1 time: 0.121309 Sep 10 21:12:56.762246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:56.762929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:56.763080 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2531/5153] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:56 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1237 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:56.764067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:56.764542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:56.764981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:56.991782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:57.002225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:57.003943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:57.005354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e8925108-193a-4ba5-acbc-fb6ec684dfa2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1739 microversion: 2.20 time: 0.260537 Sep 10 21:12:57.006610 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2623/5154] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:56 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:12:57.579144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f373dbc2-e7d4-4012-93d3-f39d274023bb tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:57.581320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f373dbc2-e7d4-4012-93d3-f39d274023bb tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:57.612736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f373dbc2-e7d4-4012-93d3-f39d274023bb tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:57.615886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f373dbc2-e7d4-4012-93d3-f39d274023bb tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:57.618914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f373dbc2-e7d4-4012-93d3-f39d274023bb tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:57.624009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f373dbc2-e7d4-4012-93d3-f39d274023bb tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:57.624678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f373dbc2-e7d4-4012-93d3-f39d274023bb tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:57.627371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f373dbc2-e7d4-4012-93d3-f39d274023bb tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:57.677197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-17108cc4-265c-481b-873c-a973df66c3dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:57.677861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-17108cc4-265c-481b-873c-a973df66c3dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:57.687085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17108cc4-265c-481b-873c-a973df66c3dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:57.687531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17108cc4-265c-481b-873c-a973df66c3dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:57.687986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17108cc4-265c-481b-873c-a973df66c3dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:57.688847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17108cc4-265c-481b-873c-a973df66c3dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:57.689315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17108cc4-265c-481b-873c-a973df66c3dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:57.689748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17108cc4-265c-481b-873c-a973df66c3dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:57.783221 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f373dbc2-e7d4-4012-93d3-f39d274023bb tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1434 microversion: 2.1 time: 0.217384 Sep 10 21:12:57.783827 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2532/5155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:57 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1434 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:57.801817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e49e748d-dc80-4841-b227-0a3b61cb166f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:57.802473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e49e748d-dc80-4841-b227-0a3b61cb166f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:57.815895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49e748d-dc80-4841-b227-0a3b61cb166f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:57.816402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49e748d-dc80-4841-b227-0a3b61cb166f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:57.817006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49e748d-dc80-4841-b227-0a3b61cb166f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:57.817733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49e748d-dc80-4841-b227-0a3b61cb166f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:57.818228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49e748d-dc80-4841-b227-0a3b61cb166f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:57.818695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e49e748d-dc80-4841-b227-0a3b61cb166f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:57.927018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e49e748d-dc80-4841-b227-0a3b61cb166f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:57.935753 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e49e748d-dc80-4841-b227-0a3b61cb166f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1293 microversion: 2.1 time: 0.150827 Sep 10 21:12:57.936389 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2533/5156] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:57 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1293 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:58.028743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-17108cc4-265c-481b-873c-a973df66c3dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:58.034950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:58.036001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:58.039141 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-17108cc4-265c-481b-873c-a973df66c3dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.366468 Sep 10 21:12:58.039813 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2624/5157] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:57 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:12:58.058980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:58.059478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:58.059922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:58.060637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:58.061094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:58.061521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:58.374502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:58.383614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:58.385700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:58.387486 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fd899b7d-7ba1-4a8f-81f9-d5eabf63eace tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1721 microversion: 2.20 time: 0.357453 Sep 10 21:12:58.388674 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2534/5158] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:58 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1721 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:12:58.816427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c69793d7-5927-41d8-b1a6-14ec42784338 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:58.818637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c69793d7-5927-41d8-b1a6-14ec42784338 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:58.844457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69793d7-5927-41d8-b1a6-14ec42784338 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:58.845615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69793d7-5927-41d8-b1a6-14ec42784338 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:58.846455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69793d7-5927-41d8-b1a6-14ec42784338 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:58.848504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69793d7-5927-41d8-b1a6-14ec42784338 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:58.850498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69793d7-5927-41d8-b1a6-14ec42784338 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:58.850960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c69793d7-5927-41d8-b1a6-14ec42784338 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:58.961916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d61eb1cc-4cf6-404d-960c-ae87e4e92532 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:58.963320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d61eb1cc-4cf6-404d-960c-ae87e4e92532 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:58.974355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d61eb1cc-4cf6-404d-960c-ae87e4e92532 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:58.975286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d61eb1cc-4cf6-404d-960c-ae87e4e92532 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:58.977190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d61eb1cc-4cf6-404d-960c-ae87e4e92532 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:58.979067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d61eb1cc-4cf6-404d-960c-ae87e4e92532 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:58.980563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d61eb1cc-4cf6-404d-960c-ae87e4e92532 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:58.982307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d61eb1cc-4cf6-404d-960c-ae87e4e92532 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:59.018081 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c69793d7-5927-41d8-b1a6-14ec42784338 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1464 microversion: 2.1 time: 0.212664 Sep 10 21:12:59.019170 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2625/5159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:58 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1464 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:59.067125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b7eb1753-5770-479c-9645-c338e6d830a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:59.068964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b7eb1753-5770-479c-9645-c338e6d830a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:59.076851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7eb1753-5770-479c-9645-c338e6d830a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:59.077689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7eb1753-5770-479c-9645-c338e6d830a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:59.078350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7eb1753-5770-479c-9645-c338e6d830a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:59.079266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7eb1753-5770-479c-9645-c338e6d830a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:59.079976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7eb1753-5770-479c-9645-c338e6d830a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:59.080577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b7eb1753-5770-479c-9645-c338e6d830a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:59.245456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b7eb1753-5770-479c-9645-c338e6d830a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:59.253955 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b7eb1753-5770-479c-9645-c338e6d830a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.190735 Sep 10 21:12:59.254614 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2626/5160] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:59 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:59.283683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d61eb1cc-4cf6-404d-960c-ae87e4e92532 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:59.294673 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d61eb1cc-4cf6-404d-960c-ae87e4e92532 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1299 microversion: 2.1 time: 0.337354 Sep 10 21:12:59.295737 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2535/5161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:12:58 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1299 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:12:59.414538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:12:59.415612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:12:59.422773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:59.423624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:59.424235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:59.425131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:12:59.425898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:12:59.426613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:12:59.601123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:59.611404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:59.613023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:12:59.614423 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-92f69f97-5e5b-4758-b001-02323216783e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1721 microversion: 2.20 time: 0.204203 Sep 10 21:12:59.626081 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2627/5162] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:12:59 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:00.045173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2b66f733-b387-4582-b0cf-d0946ed8f0bd tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:00.046081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2b66f733-b387-4582-b0cf-d0946ed8f0bd tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:00.053708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b66f733-b387-4582-b0cf-d0946ed8f0bd tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:00.054267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b66f733-b387-4582-b0cf-d0946ed8f0bd tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:00.054748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b66f733-b387-4582-b0cf-d0946ed8f0bd tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:00.055473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b66f733-b387-4582-b0cf-d0946ed8f0bd tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:00.055976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b66f733-b387-4582-b0cf-d0946ed8f0bd tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:00.056414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b66f733-b387-4582-b0cf-d0946ed8f0bd tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:00.220930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ee545224-4669-44ea-b7f7-d457017f3344 req-6b71ca61-4b8a-43e7-a430-96ac736fe91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7919a6b0-623c-440c-bece-f3879f6a89ab", "name": "network-vif-unplugged", "status": "completed", "tag": "07804208-07af-4af5-b975-15459b698f1d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:00.236694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ee545224-4669-44ea-b7f7-d457017f3344 req-6b71ca61-4b8a-43e7-a430-96ac736fe91e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:00.237555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ee545224-4669-44ea-b7f7-d457017f3344 req-6b71ca61-4b8a-43e7-a430-96ac736fe91e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:00.238372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ee545224-4669-44ea-b7f7-d457017f3344 req-6b71ca61-4b8a-43e7-a430-96ac736fe91e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:00.258566 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ee545224-4669-44ea-b7f7-d457017f3344 req-6b71ca61-4b8a-43e7-a430-96ac736fe91e service nova] Creating event network-vif-unplugged:07804208-07af-4af5-b975-15459b698f1d for instance 7919a6b0-623c-440c-bece-f3879f6a89ab on nch2-master-1 Sep 10 21:13:00.265456 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ee545224-4669-44ea-b7f7-d457017f3344 req-6b71ca61-4b8a-43e7-a430-96ac736fe91e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048743 Sep 10 21:13:00.267455 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2628/5163] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:13:00.282137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-855afa8c-fa4c-4484-8961-ea47f969453b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:00.282967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-855afa8c-fa4c-4484-8961-ea47f969453b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:00.292956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855afa8c-fa4c-4484-8961-ea47f969453b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:00.293607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855afa8c-fa4c-4484-8961-ea47f969453b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:00.294850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855afa8c-fa4c-4484-8961-ea47f969453b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:00.296102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855afa8c-fa4c-4484-8961-ea47f969453b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:00.296589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855afa8c-fa4c-4484-8961-ea47f969453b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:00.297315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-855afa8c-fa4c-4484-8961-ea47f969453b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:00.486989 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2b66f733-b387-4582-b0cf-d0946ed8f0bd tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1464 microversion: 2.1 time: 0.447276 Sep 10 21:13:00.487698 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2536/5164] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:00 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1464 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:00.492892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f6d4fb38-ea27-4286-89c7-1772d0840b11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:00.493717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f6d4fb38-ea27-4286-89c7-1772d0840b11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:00.519958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d4fb38-ea27-4286-89c7-1772d0840b11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:00.523104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d4fb38-ea27-4286-89c7-1772d0840b11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:00.523568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d4fb38-ea27-4286-89c7-1772d0840b11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:00.524305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d4fb38-ea27-4286-89c7-1772d0840b11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:00.524786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d4fb38-ea27-4286-89c7-1772d0840b11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:00.529915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d4fb38-ea27-4286-89c7-1772d0840b11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:00.625560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-855afa8c-fa4c-4484-8961-ea47f969453b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:00.638013 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-855afa8c-fa4c-4484-8961-ea47f969453b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.363759 Sep 10 21:13:00.641332 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2629/5165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:00 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:00.646411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:00.647258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:00.657453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:00.663694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:00.664153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:00.669774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:00.671212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:00.673780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:00.923250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:00.934611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:00.936852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:00.938593 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9ebd9567-aac0-4b3c-b592-ee8ad6a92dc8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1724 microversion: 2.20 time: 0.296046 Sep 10 21:13:00.939283 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2630/5166] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:00 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:00.987267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1bd80c81-8a16-4d24-951b-b13d2476c42d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9338801-901c-402e-9f20-3c7626c11b89"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:00.991396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1bd80c81-8a16-4d24-951b-b13d2476c42d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:01.016337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f6d4fb38-ea27-4286-89c7-1772d0840b11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:01.034695 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f6d4fb38-ea27-4286-89c7-1772d0840b11 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1367 microversion: 2.1 time: 0.545615 Sep 10 21:13:01.035216 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2537/5167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:00 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1367 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:01.036162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bd80c81-8a16-4d24-951b-b13d2476c42d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:01.036908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bd80c81-8a16-4d24-951b-b13d2476c42d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:01.038230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bd80c81-8a16-4d24-951b-b13d2476c42d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:01.039419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bd80c81-8a16-4d24-951b-b13d2476c42d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:01.040135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bd80c81-8a16-4d24-951b-b13d2476c42d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:01.041455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bd80c81-8a16-4d24-951b-b13d2476c42d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:01.341126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:01.431138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f87d7c46-5d44-4709-81ef-0433b1d4c6d3 req-93ebd52d-69ec-4f10-9a85-8fa67795824c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32087cf6-ff25-4837-941c-f2b677d84dab", "tag": "f1cf1a26-92dd-4862-82b4-acd7848706ea"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:01.472520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f87d7c46-5d44-4709-81ef-0433b1d4c6d3 req-93ebd52d-69ec-4f10-9a85-8fa67795824c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:01.475487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f87d7c46-5d44-4709-81ef-0433b1d4c6d3 req-93ebd52d-69ec-4f10-9a85-8fa67795824c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:01.476896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f87d7c46-5d44-4709-81ef-0433b1d4c6d3 req-93ebd52d-69ec-4f10-9a85-8fa67795824c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:01.501553 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1bd80c81-8a16-4d24-951b-b13d2476c42d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "POST /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.541070 Sep 10 21:13:01.502881 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2631/5168] 10.222.0.33 () {62 vars in 1364 bytes} [Sat Sep 10 21:13:00 2022] POST /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments => generated 188 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:13:01.515785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-778e2c81-f46c-4735-835e-82f14e4a163c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:01.516872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-778e2c81-f46c-4735-835e-82f14e4a163c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:01.553373 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f87d7c46-5d44-4709-81ef-0433b1d4c6d3 req-93ebd52d-69ec-4f10-9a85-8fa67795824c service nova] Creating event network-changed:f1cf1a26-92dd-4862-82b4-acd7848706ea for instance 32087cf6-ff25-4837-941c-f2b677d84dab on nch2-master-1 Sep 10 21:13:01.559416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-778e2c81-f46c-4735-835e-82f14e4a163c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:01.584748 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f87d7c46-5d44-4709-81ef-0433b1d4c6d3 req-93ebd52d-69ec-4f10-9a85-8fa67795824c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144063 Sep 10 21:13:01.584748 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2538/5169] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:13:01.585249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-778e2c81-f46c-4735-835e-82f14e4a163c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:01.585249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-778e2c81-f46c-4735-835e-82f14e4a163c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:01.585249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-778e2c81-f46c-4735-835e-82f14e4a163c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:01.585249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-778e2c81-f46c-4735-835e-82f14e4a163c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:01.585249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-778e2c81-f46c-4735-835e-82f14e4a163c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:01.665429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-20e9551d-e02f-4d30-a7d3-b237455d51e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:01.666268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-20e9551d-e02f-4d30-a7d3-b237455d51e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:01.673506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20e9551d-e02f-4d30-a7d3-b237455d51e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:01.674564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20e9551d-e02f-4d30-a7d3-b237455d51e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:01.675244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20e9551d-e02f-4d30-a7d3-b237455d51e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:01.676209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20e9551d-e02f-4d30-a7d3-b237455d51e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:01.676944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20e9551d-e02f-4d30-a7d3-b237455d51e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:01.677608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20e9551d-e02f-4d30-a7d3-b237455d51e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:01.863657 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-778e2c81-f46c-4735-835e-82f14e4a163c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1464 microversion: 2.1 time: 0.353455 Sep 10 21:13:01.864368 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2632/5170] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:01 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:01.883669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e1b9d2b-c5e2-4dc2-9d9d-eb62725d149b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:01.883669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e1b9d2b-c5e2-4dc2-9d9d-eb62725d149b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:01.883669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1b9d2b-c5e2-4dc2-9d9d-eb62725d149b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:01.883669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1b9d2b-c5e2-4dc2-9d9d-eb62725d149b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:01.883669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1b9d2b-c5e2-4dc2-9d9d-eb62725d149b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:01.883669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1b9d2b-c5e2-4dc2-9d9d-eb62725d149b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:01.883669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1b9d2b-c5e2-4dc2-9d9d-eb62725d149b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:01.883669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e1b9d2b-c5e2-4dc2-9d9d-eb62725d149b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:01.938064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e1b9d2b-c5e2-4dc2-9d9d-eb62725d149b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=145772) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 21:13:01.951699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:02.021042 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e1b9d2b-c5e2-4dc2-9d9d-eb62725d149b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "POST /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/action" status: 202 len: 0 microversion: 2.20 time: 0.154793 Sep 10 21:13:02.022401 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2633/5171] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 21:13:01 2022] POST /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:13:02.031883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:02.033791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:02.045340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:02.046099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:02.046788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:02.047765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:02.048457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:02.049114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:02.082916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-20e9551d-e02f-4d30-a7d3-b237455d51e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:02.095299 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-20e9551d-e02f-4d30-a7d3-b237455d51e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.434195 Sep 10 21:13:02.096751 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2539/5172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:01 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:02.104088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb98ebf2-7063-48b3-ab6c-173332966e9a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:02.105097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fb98ebf2-7063-48b3-ab6c-173332966e9a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:02.112900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb98ebf2-7063-48b3-ab6c-173332966e9a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:02.113740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb98ebf2-7063-48b3-ab6c-173332966e9a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:02.114215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb98ebf2-7063-48b3-ab6c-173332966e9a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:02.114952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb98ebf2-7063-48b3-ab6c-173332966e9a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:02.115410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb98ebf2-7063-48b3-ab6c-173332966e9a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:02.115830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb98ebf2-7063-48b3-ab6c-173332966e9a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:02.336725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:02.351462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:02.352941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:02.355181 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ca5e28d7-d60c-40dd-9e64-3ea4bb7838c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1750 microversion: 2.20 time: 0.328395 Sep 10 21:13:02.362768 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2634/5173] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:02 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1750 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:13:02.723597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3e65b7f4-6eac-4e75-adc4-42e946a8dbcd req-38a8cd9e-9d26-4004-9209-789eba1433a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e983600b-2110-437c-a0db-fb0d9c8fe55c", "tag": "1fd22866-4f2e-4ce7-a0e8-bb4d5e06024d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:02.726785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fb98ebf2-7063-48b3-ab6c-173332966e9a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:02.738132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3e65b7f4-6eac-4e75-adc4-42e946a8dbcd req-38a8cd9e-9d26-4004-9209-789eba1433a0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:02.739817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3e65b7f4-6eac-4e75-adc4-42e946a8dbcd req-38a8cd9e-9d26-4004-9209-789eba1433a0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:02.740440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3e65b7f4-6eac-4e75-adc4-42e946a8dbcd req-38a8cd9e-9d26-4004-9209-789eba1433a0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:02.742560 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fb98ebf2-7063-48b3-ab6c-173332966e9a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1367 microversion: 2.1 time: 0.643363 Sep 10 21:13:02.759438 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2540/5174] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:02 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1367 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:02.760937 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3e65b7f4-6eac-4e75-adc4-42e946a8dbcd req-38a8cd9e-9d26-4004-9209-789eba1433a0 service nova] Creating event network-changed:1fd22866-4f2e-4ce7-a0e8-bb4d5e06024d for instance e983600b-2110-437c-a0db-fb0d9c8fe55c on nch2-master-1 Sep 10 21:13:02.766286 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3e65b7f4-6eac-4e75-adc4-42e946a8dbcd req-38a8cd9e-9d26-4004-9209-789eba1433a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047687 Sep 10 21:13:02.766957 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2635/5175] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:13:02.893102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f21e6f5a-f1c5-4351-a7a0-fb536cc1b203 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:02.894862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f21e6f5a-f1c5-4351-a7a0-fb536cc1b203 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:02.902944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f21e6f5a-f1c5-4351-a7a0-fb536cc1b203 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:02.903713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f21e6f5a-f1c5-4351-a7a0-fb536cc1b203 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:02.904162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f21e6f5a-f1c5-4351-a7a0-fb536cc1b203 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:02.905123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f21e6f5a-f1c5-4351-a7a0-fb536cc1b203 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:02.905760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f21e6f5a-f1c5-4351-a7a0-fb536cc1b203 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:02.906393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f21e6f5a-f1c5-4351-a7a0-fb536cc1b203 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:03.094310 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f21e6f5a-f1c5-4351-a7a0-fb536cc1b203 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1464 microversion: 2.1 time: 0.206389 Sep 10 21:13:03.095409 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2541/5176] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:02 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1464 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:03.121019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e812c1f1-669a-4ab6-887c-7429e5d7e6e6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:03.122227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e812c1f1-669a-4ab6-887c-7429e5d7e6e6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:03.129094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e812c1f1-669a-4ab6-887c-7429e5d7e6e6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:03.129793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e812c1f1-669a-4ab6-887c-7429e5d7e6e6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:03.130265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e812c1f1-669a-4ab6-887c-7429e5d7e6e6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:03.130964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e812c1f1-669a-4ab6-887c-7429e5d7e6e6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:03.131467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e812c1f1-669a-4ab6-887c-7429e5d7e6e6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:03.131902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e812c1f1-669a-4ab6-887c-7429e5d7e6e6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:03.289719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e812c1f1-669a-4ab6-887c-7429e5d7e6e6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:03.316916 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e812c1f1-669a-4ab6-887c-7429e5d7e6e6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.200536 Sep 10 21:13:03.318425 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2636/5177] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:03 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:03.389501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:03.390468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:03.398521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:03.399279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:03.399912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:03.400930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:03.402055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:03.403462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:03.766886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c17c901d-393a-4873-a246-c0c92aa7f4da tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:03.767502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c17c901d-393a-4873-a246-c0c92aa7f4da tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:03.781218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:03.786275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c17c901d-393a-4873-a246-c0c92aa7f4da tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:03.787201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c17c901d-393a-4873-a246-c0c92aa7f4da tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:03.787654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c17c901d-393a-4873-a246-c0c92aa7f4da tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:03.788799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c17c901d-393a-4873-a246-c0c92aa7f4da tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:03.789450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c17c901d-393a-4873-a246-c0c92aa7f4da tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:03.790836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c17c901d-393a-4873-a246-c0c92aa7f4da tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:03.807603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:03.813051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:03.815019 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eab5d0af-7258-4cb3-a071-4f3fbaab4b46 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1750 microversion: 2.20 time: 0.430770 Sep 10 21:13:03.825165 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2542/5178] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:03 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1750 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:04.118907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eeb46069-908c-4e2e-b260-9ea52dcce213 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:04.119526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eeb46069-908c-4e2e-b260-9ea52dcce213 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:04.135324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb46069-908c-4e2e-b260-9ea52dcce213 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:04.136497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb46069-908c-4e2e-b260-9ea52dcce213 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:04.137193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb46069-908c-4e2e-b260-9ea52dcce213 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:04.138192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb46069-908c-4e2e-b260-9ea52dcce213 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:04.138897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb46069-908c-4e2e-b260-9ea52dcce213 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:04.139008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eeb46069-908c-4e2e-b260-9ea52dcce213 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:04.233780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c17c901d-393a-4873-a246-c0c92aa7f4da tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:04.252428 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c17c901d-393a-4873-a246-c0c92aa7f4da tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1367 microversion: 2.1 time: 0.489842 Sep 10 21:13:04.253030 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2637/5179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:03 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1367 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:04.344605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa515bb0-1dc0-4a83-b36e-c61ee4299ab0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:04.345491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aa515bb0-1dc0-4a83-b36e-c61ee4299ab0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:04.356808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa515bb0-1dc0-4a83-b36e-c61ee4299ab0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:04.357729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa515bb0-1dc0-4a83-b36e-c61ee4299ab0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:04.358459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa515bb0-1dc0-4a83-b36e-c61ee4299ab0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:04.359405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa515bb0-1dc0-4a83-b36e-c61ee4299ab0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:04.360083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa515bb0-1dc0-4a83-b36e-c61ee4299ab0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:04.360731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa515bb0-1dc0-4a83-b36e-c61ee4299ab0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:04.422839 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eeb46069-908c-4e2e-b260-9ea52dcce213 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1464 microversion: 2.1 time: 0.307770 Sep 10 21:13:04.423662 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2543/5180] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:04 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:04.647498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aa515bb0-1dc0-4a83-b36e-c61ee4299ab0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:04.658913 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aa515bb0-1dc0-4a83-b36e-c61ee4299ab0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.318066 Sep 10 21:13:04.660375 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2638/5181] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:04 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:04.852517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:04.854412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:04.857667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:04.863793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:04.864614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:04.865158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:04.866161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:04.867373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:04.868356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:04.875236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:05.065410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:05.076188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:05.079504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:05.079504 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d8fe4c54-fa7e-4dc8-96a6-d0d005e8ee76 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1752 microversion: 2.20 time: 0.230844 Sep 10 21:13:05.080771 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2544/5182] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:04 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1752 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:05.278159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-298fd501-d69d-4777-ab72-6bbd23f88c05 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:05.279006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-298fd501-d69d-4777-ab72-6bbd23f88c05 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:05.282515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:05.290554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-298fd501-d69d-4777-ab72-6bbd23f88c05 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:05.291042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-298fd501-d69d-4777-ab72-6bbd23f88c05 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:05.291949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-298fd501-d69d-4777-ab72-6bbd23f88c05 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:05.293499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-298fd501-d69d-4777-ab72-6bbd23f88c05 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:05.293676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-298fd501-d69d-4777-ab72-6bbd23f88c05 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:05.294203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-298fd501-d69d-4777-ab72-6bbd23f88c05 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:05.447986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ccbb290c-abfd-4f32-ac82-51e55f493d52 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:05.449673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ccbb290c-abfd-4f32-ac82-51e55f493d52 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:05.455546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:05.467484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ccbb290c-abfd-4f32-ac82-51e55f493d52 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:05.471314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-298fd501-d69d-4777-ab72-6bbd23f88c05 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:05.472441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ccbb290c-abfd-4f32-ac82-51e55f493d52 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:05.477744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ccbb290c-abfd-4f32-ac82-51e55f493d52 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:05.478902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ccbb290c-abfd-4f32-ac82-51e55f493d52 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:05.479497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ccbb290c-abfd-4f32-ac82-51e55f493d52 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:05.488339 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-298fd501-d69d-4777-ab72-6bbd23f88c05 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1367 microversion: 2.1 time: 0.210380 Sep 10 21:13:05.488339 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2639/5183] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:05 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:05.489290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ccbb290c-abfd-4f32-ac82-51e55f493d52 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:05.631442 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ccbb290c-abfd-4f32-ac82-51e55f493d52 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1464 microversion: 2.1 time: 0.187949 Sep 10 21:13:05.632005 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2545/5184] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:05 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1464 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:05.684630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ebb279a7-d7a1-4193-9521-dd15e0c58a07 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:05.685357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ebb279a7-d7a1-4193-9521-dd15e0c58a07 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:05.687583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:05.694139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebb279a7-d7a1-4193-9521-dd15e0c58a07 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:05.694807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebb279a7-d7a1-4193-9521-dd15e0c58a07 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:05.695491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebb279a7-d7a1-4193-9521-dd15e0c58a07 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:05.696286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebb279a7-d7a1-4193-9521-dd15e0c58a07 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:05.696826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebb279a7-d7a1-4193-9521-dd15e0c58a07 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:05.697357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebb279a7-d7a1-4193-9521-dd15e0c58a07 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:05.842565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ebb279a7-d7a1-4193-9521-dd15e0c58a07 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:05.852647 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ebb279a7-d7a1-4193-9521-dd15e0c58a07 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.172217 Sep 10 21:13:05.853500 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2640/5185] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:05 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:06.108792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:06.109421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:06.122495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:06.123102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:06.123661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:06.124467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:06.125198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:06.126066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:06.378721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:06.388474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:06.389961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:06.391407 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-603f5c29-516e-4c9e-9d4f-b858cfc07730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.288510 Sep 10 21:13:06.406594 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2546/5186] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:06 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:06.507791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bfc47954-fdf0-48af-a258-aec7b2359a12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:06.509106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bfc47954-fdf0-48af-a258-aec7b2359a12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:06.530785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfc47954-fdf0-48af-a258-aec7b2359a12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:06.531363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfc47954-fdf0-48af-a258-aec7b2359a12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:06.531705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfc47954-fdf0-48af-a258-aec7b2359a12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:06.532495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfc47954-fdf0-48af-a258-aec7b2359a12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:06.532954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfc47954-fdf0-48af-a258-aec7b2359a12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:06.533384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bfc47954-fdf0-48af-a258-aec7b2359a12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:06.656768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-17f7c9a3-81ba-4e47-aeb6-2cb1a032ed74 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:06.657962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-17f7c9a3-81ba-4e47-aeb6-2cb1a032ed74 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:06.685535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17f7c9a3-81ba-4e47-aeb6-2cb1a032ed74 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:06.686210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17f7c9a3-81ba-4e47-aeb6-2cb1a032ed74 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:06.687395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17f7c9a3-81ba-4e47-aeb6-2cb1a032ed74 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:06.688589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17f7c9a3-81ba-4e47-aeb6-2cb1a032ed74 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:06.690096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17f7c9a3-81ba-4e47-aeb6-2cb1a032ed74 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:06.690704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17f7c9a3-81ba-4e47-aeb6-2cb1a032ed74 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:06.716339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bfc47954-fdf0-48af-a258-aec7b2359a12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:06.732647 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bfc47954-fdf0-48af-a258-aec7b2359a12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1367 microversion: 2.1 time: 0.227867 Sep 10 21:13:06.734056 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2641/5187] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:06 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:06.883093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-df29da83-e4cd-41f5-8ccf-569792d7e536 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:06.884232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-df29da83-e4cd-41f5-8ccf-569792d7e536 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:06.895763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df29da83-e4cd-41f5-8ccf-569792d7e536 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:06.897415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df29da83-e4cd-41f5-8ccf-569792d7e536 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:06.898172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df29da83-e4cd-41f5-8ccf-569792d7e536 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:06.899547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df29da83-e4cd-41f5-8ccf-569792d7e536 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:06.900588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df29da83-e4cd-41f5-8ccf-569792d7e536 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:06.902267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df29da83-e4cd-41f5-8ccf-569792d7e536 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:06.950649 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-17f7c9a3-81ba-4e47-aeb6-2cb1a032ed74 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1464 microversion: 2.1 time: 0.299052 Sep 10 21:13:06.955424 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2547/5188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:06 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1464 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:07.099070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df29da83-e4cd-41f5-8ccf-569792d7e536 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:07.107402 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-df29da83-e4cd-41f5-8ccf-569792d7e536 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.233869 Sep 10 21:13:07.108023 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2642/5189] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:06 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:07.184379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-54f2c15e-696e-4a7f-b3e3-4bed9839e31a req-7a795e92-a532-4cb2-b21f-1e40bdabc912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7919a6b0-623c-440c-bece-f3879f6a89ab", "tag": "07804208-07af-4af5-b975-15459b698f1d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:07.194710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-54f2c15e-696e-4a7f-b3e3-4bed9839e31a req-7a795e92-a532-4cb2-b21f-1e40bdabc912 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:07.195202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-54f2c15e-696e-4a7f-b3e3-4bed9839e31a req-7a795e92-a532-4cb2-b21f-1e40bdabc912 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:07.196231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-54f2c15e-696e-4a7f-b3e3-4bed9839e31a req-7a795e92-a532-4cb2-b21f-1e40bdabc912 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:07.212645 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-54f2c15e-696e-4a7f-b3e3-4bed9839e31a req-7a795e92-a532-4cb2-b21f-1e40bdabc912 service nova] Creating event network-changed:07804208-07af-4af5-b975-15459b698f1d for instance 7919a6b0-623c-440c-bece-f3879f6a89ab on nch1-master-1 Sep 10 21:13:07.222015 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-54f2c15e-696e-4a7f-b3e3-4bed9839e31a req-7a795e92-a532-4cb2-b21f-1e40bdabc912 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041928 Sep 10 21:13:07.223244 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2548/5190] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:07.419899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:07.420796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:07.427431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:07.428161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:07.428601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:07.429348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:07.430126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:07.430544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:07.603228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:07.615924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:07.617881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:07.619324 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5399d50c-7d27-429d-a518-da09c43b1ea7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.204574 Sep 10 21:13:07.619899 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2643/5191] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:07 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:07.758276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3af47e87-d04d-4b0e-95d4-7faddd7f822c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:07.759114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3af47e87-d04d-4b0e-95d4-7faddd7f822c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:07.766379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af47e87-d04d-4b0e-95d4-7faddd7f822c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:07.766872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af47e87-d04d-4b0e-95d4-7faddd7f822c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:07.767353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af47e87-d04d-4b0e-95d4-7faddd7f822c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:07.768069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af47e87-d04d-4b0e-95d4-7faddd7f822c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:07.768532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af47e87-d04d-4b0e-95d4-7faddd7f822c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:07.768966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3af47e87-d04d-4b0e-95d4-7faddd7f822c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:07.922270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3af47e87-d04d-4b0e-95d4-7faddd7f822c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:07.934160 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3af47e87-d04d-4b0e-95d4-7faddd7f822c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1367 microversion: 2.1 time: 0.181107 Sep 10 21:13:07.946565 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2549/5192] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:07 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:07.983853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d4e5939e-5ec2-46e5-887c-5ed9ccc411ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:07.984670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d4e5939e-5ec2-46e5-887c-5ed9ccc411ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:07.992342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4e5939e-5ec2-46e5-887c-5ed9ccc411ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:07.993010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4e5939e-5ec2-46e5-887c-5ed9ccc411ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:07.993991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4e5939e-5ec2-46e5-887c-5ed9ccc411ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:07.996454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4e5939e-5ec2-46e5-887c-5ed9ccc411ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:07.997433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4e5939e-5ec2-46e5-887c-5ed9ccc411ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:07.998307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4e5939e-5ec2-46e5-887c-5ed9ccc411ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:08.133736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c49b55b2-87ca-4cfa-8724-304cffe74d69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:08.134717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c49b55b2-87ca-4cfa-8724-304cffe74d69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:08.146382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c49b55b2-87ca-4cfa-8724-304cffe74d69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:08.149012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c49b55b2-87ca-4cfa-8724-304cffe74d69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:08.150984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c49b55b2-87ca-4cfa-8724-304cffe74d69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:08.155401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c49b55b2-87ca-4cfa-8724-304cffe74d69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:08.155886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c49b55b2-87ca-4cfa-8724-304cffe74d69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:08.156484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c49b55b2-87ca-4cfa-8724-304cffe74d69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:08.187952 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d4e5939e-5ec2-46e5-887c-5ed9ccc411ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1464 microversion: 2.1 time: 0.209499 Sep 10 21:13:08.189373 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2644/5193] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:07 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1464 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:08.464391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-5ce684d5-1ddc-48d8-b0b8-e43217134559 req-8b8d6b87-0e84-4c8b-b8e6-04a7f815faac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32087cf6-ff25-4837-941c-f2b677d84dab", "name": "network-vif-plugged", "status": "completed", "tag": "f1cf1a26-92dd-4862-82b4-acd7848706ea"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:08.486514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5ce684d5-1ddc-48d8-b0b8-e43217134559 req-8b8d6b87-0e84-4c8b-b8e6-04a7f815faac service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:08.489512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5ce684d5-1ddc-48d8-b0b8-e43217134559 req-8b8d6b87-0e84-4c8b-b8e6-04a7f815faac service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:08.490225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5ce684d5-1ddc-48d8-b0b8-e43217134559 req-8b8d6b87-0e84-4c8b-b8e6-04a7f815faac service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:08.519622 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-5ce684d5-1ddc-48d8-b0b8-e43217134559 req-8b8d6b87-0e84-4c8b-b8e6-04a7f815faac service nova] Creating event network-vif-plugged:f1cf1a26-92dd-4862-82b4-acd7848706ea for instance 32087cf6-ff25-4837-941c-f2b677d84dab on nch2-master-1 Sep 10 21:13:08.533761 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-5ce684d5-1ddc-48d8-b0b8-e43217134559 req-8b8d6b87-0e84-4c8b-b8e6-04a7f815faac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074346 Sep 10 21:13:08.536716 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2645/5194] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:13:08.649635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:08.650604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:08.653203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c49b55b2-87ca-4cfa-8724-304cffe74d69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:08.666436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:08.668519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:08.670140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:08.672626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:08.673947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:08.676338 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c49b55b2-87ca-4cfa-8724-304cffe74d69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.547812 Sep 10 21:13:08.677041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:08.679763 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2550/5195] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:08 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:08.960344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f6806c42-05e5-496c-85a5-70718732beaf tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:08.961149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f6806c42-05e5-496c-85a5-70718732beaf tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:08.982144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6806c42-05e5-496c-85a5-70718732beaf tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:08.982665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6806c42-05e5-496c-85a5-70718732beaf tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:08.985340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6806c42-05e5-496c-85a5-70718732beaf tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:08.986209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6806c42-05e5-496c-85a5-70718732beaf tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:08.986596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6806c42-05e5-496c-85a5-70718732beaf tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:08.987045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6806c42-05e5-496c-85a5-70718732beaf tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:09.043740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:09.063327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:09.065399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:09.072273 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5ae7d51-2ced-4325-a331-30e979ff2263 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.428469 Sep 10 21:13:09.073985 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2646/5196] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:08 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:13:09.214686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b758889c-518e-4034-a14a-44b0ed1f7c0f tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:09.215767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b758889c-518e-4034-a14a-44b0ed1f7c0f tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:09.226826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b758889c-518e-4034-a14a-44b0ed1f7c0f tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:09.228912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b758889c-518e-4034-a14a-44b0ed1f7c0f tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:09.230722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b758889c-518e-4034-a14a-44b0ed1f7c0f tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:09.234244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b758889c-518e-4034-a14a-44b0ed1f7c0f tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:09.235242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b758889c-518e-4034-a14a-44b0ed1f7c0f tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:09.236782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b758889c-518e-4034-a14a-44b0ed1f7c0f tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:09.282346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:09.298759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f6806c42-05e5-496c-85a5-70718732beaf tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:09.324831 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f6806c42-05e5-496c-85a5-70718732beaf tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1367 microversion: 2.1 time: 0.355073 Sep 10 21:13:09.329955 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2551/5197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:08 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:09.470858 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b758889c-518e-4034-a14a-44b0ed1f7c0f tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1464 microversion: 2.1 time: 0.261638 Sep 10 21:13:09.472750 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2647/5198] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:09 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:09.704775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f32e19d3-c7c7-4e9d-9c44-d4586be27e11 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:09.705592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f32e19d3-c7c7-4e9d-9c44-d4586be27e11 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:09.713488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f32e19d3-c7c7-4e9d-9c44-d4586be27e11 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:09.715292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f32e19d3-c7c7-4e9d-9c44-d4586be27e11 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:09.715745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f32e19d3-c7c7-4e9d-9c44-d4586be27e11 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:09.716486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f32e19d3-c7c7-4e9d-9c44-d4586be27e11 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:09.716981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f32e19d3-c7c7-4e9d-9c44-d4586be27e11 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:09.717644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f32e19d3-c7c7-4e9d-9c44-d4586be27e11 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:09.965349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f32e19d3-c7c7-4e9d-9c44-d4586be27e11 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:09.987935 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f32e19d3-c7c7-4e9d-9c44-d4586be27e11 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.287654 Sep 10 21:13:09.989144 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2552/5199] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:09 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:10.105984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:10.107341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:10.126104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:10.127087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:10.127766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:10.128739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:10.129498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:10.131230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:10.355302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-22cc310d-6f4f-43bb-adfa-1e3de86bf557 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:10.355931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-22cc310d-6f4f-43bb-adfa-1e3de86bf557 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:10.376329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22cc310d-6f4f-43bb-adfa-1e3de86bf557 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:10.376839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22cc310d-6f4f-43bb-adfa-1e3de86bf557 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:10.377293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22cc310d-6f4f-43bb-adfa-1e3de86bf557 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:10.383684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22cc310d-6f4f-43bb-adfa-1e3de86bf557 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:10.384492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22cc310d-6f4f-43bb-adfa-1e3de86bf557 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:10.385147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22cc310d-6f4f-43bb-adfa-1e3de86bf557 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:10.667006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-22cc310d-6f4f-43bb-adfa-1e3de86bf557 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:10.706752 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-22cc310d-6f4f-43bb-adfa-1e3de86bf557 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1367 microversion: 2.1 time: 0.356670 Sep 10 21:13:10.723185 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2553/5200] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:10 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:10.730245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-79213895-1040-4884-b2d6-1c642497386c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:10.732497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-79213895-1040-4884-b2d6-1c642497386c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:10.739359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79213895-1040-4884-b2d6-1c642497386c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:10.740282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79213895-1040-4884-b2d6-1c642497386c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:10.741139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79213895-1040-4884-b2d6-1c642497386c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:10.742938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79213895-1040-4884-b2d6-1c642497386c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:10.743634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79213895-1040-4884-b2d6-1c642497386c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:10.744302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-79213895-1040-4884-b2d6-1c642497386c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:10.837030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:10.849193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:10.851294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:10.852858 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-61f7f32f-5f89-4027-8547-651c94bea6c0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.754754 Sep 10 21:13:10.853900 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2648/5201] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:10 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:10.867852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d772143c-3ea8-4fd5-a406-b7cd850f2858 req-0bb8f6e5-6604-4f80-9ed7-ac6ce815cd8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e983600b-2110-437c-a0db-fb0d9c8fe55c", "name": "network-vif-plugged", "status": "completed", "tag": "1fd22866-4f2e-4ce7-a0e8-bb4d5e06024d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:10.907138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d772143c-3ea8-4fd5-a406-b7cd850f2858 req-0bb8f6e5-6604-4f80-9ed7-ac6ce815cd8c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:10.908267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d772143c-3ea8-4fd5-a406-b7cd850f2858 req-0bb8f6e5-6604-4f80-9ed7-ac6ce815cd8c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:10.908981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d772143c-3ea8-4fd5-a406-b7cd850f2858 req-0bb8f6e5-6604-4f80-9ed7-ac6ce815cd8c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:10.933748 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d772143c-3ea8-4fd5-a406-b7cd850f2858 req-0bb8f6e5-6604-4f80-9ed7-ac6ce815cd8c service nova] Creating event network-vif-plugged:1fd22866-4f2e-4ce7-a0e8-bb4d5e06024d for instance e983600b-2110-437c-a0db-fb0d9c8fe55c on nch2-master-1 Sep 10 21:13:10.942085 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d772143c-3ea8-4fd5-a406-b7cd850f2858 req-0bb8f6e5-6604-4f80-9ed7-ac6ce815cd8c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078179 Sep 10 21:13:10.947574 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2649/5202] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:11.014516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e4e912cf-33a2-4d19-a8fb-4d05b8305b42 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:11.016040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e4e912cf-33a2-4d19-a8fb-4d05b8305b42 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:11.022519 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-79213895-1040-4884-b2d6-1c642497386c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1648 microversion: 2.1 time: 0.297820 Sep 10 21:13:11.034961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e912cf-33a2-4d19-a8fb-4d05b8305b42 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:11.034961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e912cf-33a2-4d19-a8fb-4d05b8305b42 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:11.034961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e912cf-33a2-4d19-a8fb-4d05b8305b42 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:11.034961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e912cf-33a2-4d19-a8fb-4d05b8305b42 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:11.034961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e912cf-33a2-4d19-a8fb-4d05b8305b42 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:11.034961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e4e912cf-33a2-4d19-a8fb-4d05b8305b42 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:11.036212 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2554/5203] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:10 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1648 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:11.055499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-94830c79-e0c2-4fc4-834c-a876290adda2 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:11.056118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-94830c79-e0c2-4fc4-834c-a876290adda2 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:11.063689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94830c79-e0c2-4fc4-834c-a876290adda2 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:11.064196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94830c79-e0c2-4fc4-834c-a876290adda2 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:11.064648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94830c79-e0c2-4fc4-834c-a876290adda2 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:11.065515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94830c79-e0c2-4fc4-834c-a876290adda2 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:11.066331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94830c79-e0c2-4fc4-834c-a876290adda2 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:11.067231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94830c79-e0c2-4fc4-834c-a876290adda2 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:11.296410 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-94830c79-e0c2-4fc4-834c-a876290adda2 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1648 microversion: 2.1 time: 0.243683 Sep 10 21:13:11.299312 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2555/5204] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:11 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1648 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:11.328558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd353580-3f2a-473a-be51-9e4c8bbd6d66 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:11.329639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd353580-3f2a-473a-be51-9e4c8bbd6d66 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:11.341560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd353580-3f2a-473a-be51-9e4c8bbd6d66 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:11.342309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd353580-3f2a-473a-be51-9e4c8bbd6d66 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:11.344886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd353580-3f2a-473a-be51-9e4c8bbd6d66 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:11.347611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd353580-3f2a-473a-be51-9e4c8bbd6d66 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:11.349138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd353580-3f2a-473a-be51-9e4c8bbd6d66 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:11.350909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd353580-3f2a-473a-be51-9e4c8bbd6d66 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:11.473537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e4e912cf-33a2-4d19-a8fb-4d05b8305b42 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:11.482983 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e4e912cf-33a2-4d19-a8fb-4d05b8305b42 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.474109 Sep 10 21:13:11.483503 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2650/5205] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:11 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:11.586554 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd353580-3f2a-473a-be51-9e4c8bbd6d66 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1648 microversion: 2.1 time: 0.262491 Sep 10 21:13:11.589004 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2556/5206] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:11 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1648 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:11.726562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-29326760", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "e530c2d2-9685-4067-b514-eafa9f57a39c"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:11.733435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-edcbec89-8fc1-451b-9aa8-d48595fdc0b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:11.734022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-edcbec89-8fc1-451b-9aa8-d48595fdc0b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:11.740125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edcbec89-8fc1-451b-9aa8-d48595fdc0b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:11.740619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edcbec89-8fc1-451b-9aa8-d48595fdc0b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:11.741060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edcbec89-8fc1-451b-9aa8-d48595fdc0b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:11.741772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edcbec89-8fc1-451b-9aa8-d48595fdc0b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:11.742266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edcbec89-8fc1-451b-9aa8-d48595fdc0b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:11.742696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edcbec89-8fc1-451b-9aa8-d48595fdc0b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:11.825710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] validate_networks() for [('e530c2d2-9685-4067-b514-eafa9f57a39c', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:13:11.974017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-edcbec89-8fc1-451b-9aa8-d48595fdc0b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:11.990847 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-edcbec89-8fc1-451b-9aa8-d48595fdc0b8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1367 microversion: 2.1 time: 0.256078 Sep 10 21:13:11.991516 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2557/5207] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:11 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:12.006913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:12.007548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:12.015198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:12.015732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:12.027196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:12.028247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:12.029115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:12.029727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:12.468083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:13:12.468515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:13:12.469098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:13:12.469514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:13:12.470101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:13:12.488984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:12.491847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:12.492798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:12.494173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:12.494828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:12.496358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:12.520189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Getting quotas for project 284406fb5bca447e99e96da850338927. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:13:12.553480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Getting quotas for user a52844a1f8e142849762f7394dd0010a and project 284406fb5bca447e99e96da850338927. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:13:12.576118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:13:12.579204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:13:12.641917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:12.653763 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4a58b1e9-ef4c-4115-9526-de867fe8c215 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930226 Sep 10 21:13:12.666271 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2651/5208] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:13:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:13:12.676736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-48b85c57-463d-41e4-91f6-1fe9f782e0e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:12.680749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-48b85c57-463d-41e4-91f6-1fe9f782e0e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:12.700191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48b85c57-463d-41e4-91f6-1fe9f782e0e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:12.702065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48b85c57-463d-41e4-91f6-1fe9f782e0e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:12.702934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48b85c57-463d-41e4-91f6-1fe9f782e0e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:12.706057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48b85c57-463d-41e4-91f6-1fe9f782e0e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:12.709043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48b85c57-463d-41e4-91f6-1fe9f782e0e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:12.709762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48b85c57-463d-41e4-91f6-1fe9f782e0e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:12.717392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:12.722749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:12.730044 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1e1dc4bd-b1d5-40e7-bd27-8bac75522b6b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.731263 Sep 10 21:13:12.731516 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2558/5209] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:11 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:12.747268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8d450cd3-a8c3-4e4a-b452-666c96616cde tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:12.752279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8d450cd3-a8c3-4e4a-b452-666c96616cde tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:12.864164 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8d450cd3-a8c3-4e4a-b452-666c96616cde tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1327 microversion: 2.1 time: 0.128700 Sep 10 21:13:12.864775 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2559/5210] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:12 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:13.023144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cb74b4cf-6dbc-4f66-91f7-d043f878ac03 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:13.024375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cb74b4cf-6dbc-4f66-91f7-d043f878ac03 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:13.035597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb74b4cf-6dbc-4f66-91f7-d043f878ac03 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:13.044967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb74b4cf-6dbc-4f66-91f7-d043f878ac03 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:13.044967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb74b4cf-6dbc-4f66-91f7-d043f878ac03 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:13.044967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb74b4cf-6dbc-4f66-91f7-d043f878ac03 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:13.044967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb74b4cf-6dbc-4f66-91f7-d043f878ac03 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:13.044967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb74b4cf-6dbc-4f66-91f7-d043f878ac03 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:13.191531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-48b85c57-463d-41e4-91f6-1fe9f782e0e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:13.201215 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-48b85c57-463d-41e4-91f6-1fe9f782e0e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1512 microversion: 2.1 time: 0.532725 Sep 10 21:13:13.202249 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2652/5211] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:12 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:13.299103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cb74b4cf-6dbc-4f66-91f7-d043f878ac03 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:13.310144 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cb74b4cf-6dbc-4f66-91f7-d043f878ac03 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1556 microversion: 2.1 time: 0.293291 Sep 10 21:13:13.311323 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2560/5212] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:13 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1556 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:13.336815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cecc80ae-a8fa-461d-8a1a-f6d82a4b4d1c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:13.337317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cecc80ae-a8fa-461d-8a1a-f6d82a4b4d1c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:13.344595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecc80ae-a8fa-461d-8a1a-f6d82a4b4d1c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:13.345668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecc80ae-a8fa-461d-8a1a-f6d82a4b4d1c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:13.346354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecc80ae-a8fa-461d-8a1a-f6d82a4b4d1c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:13.347352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecc80ae-a8fa-461d-8a1a-f6d82a4b4d1c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:13.348018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecc80ae-a8fa-461d-8a1a-f6d82a4b4d1c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:13.348682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecc80ae-a8fa-461d-8a1a-f6d82a4b4d1c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:13.558825 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cecc80ae-a8fa-461d-8a1a-f6d82a4b4d1c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225043 Sep 10 21:13:13.559733 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2653/5213] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:13:13 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:13.759045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:13.760509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:13.771872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:13.774988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:13.778218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:13.778872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:13.779363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:13.780276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:13.893321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-384d5462-8847-475c-b8ba-0e1cbaa4a5ed tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:13.893993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-384d5462-8847-475c-b8ba-0e1cbaa4a5ed tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:13.905378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384d5462-8847-475c-b8ba-0e1cbaa4a5ed tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:13.905908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384d5462-8847-475c-b8ba-0e1cbaa4a5ed tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:13.906355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384d5462-8847-475c-b8ba-0e1cbaa4a5ed tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:13.907069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384d5462-8847-475c-b8ba-0e1cbaa4a5ed tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:13.907791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384d5462-8847-475c-b8ba-0e1cbaa4a5ed tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:13.910394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384d5462-8847-475c-b8ba-0e1cbaa4a5ed tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:14.036020 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-384d5462-8847-475c-b8ba-0e1cbaa4a5ed tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1344 microversion: 2.1 time: 0.145219 Sep 10 21:13:14.065170 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2654/5214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:13 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1344 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:14.232482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fd4f64aa-989d-4715-9995-9d3483f784ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:14.233458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fd4f64aa-989d-4715-9995-9d3483f784ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:14.255598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd4f64aa-989d-4715-9995-9d3483f784ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:14.257722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd4f64aa-989d-4715-9995-9d3483f784ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:14.266258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd4f64aa-989d-4715-9995-9d3483f784ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:14.267832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd4f64aa-989d-4715-9995-9d3483f784ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:14.268495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd4f64aa-989d-4715-9995-9d3483f784ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:14.269114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd4f64aa-989d-4715-9995-9d3483f784ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:14.509206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:14.528334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:14.531544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:14.535680 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bf73239f-fd27-4b63-90e2-87c398e9f043 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.780779 Sep 10 21:13:14.545370 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2561/5215] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:13 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:14.881575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fd4f64aa-989d-4715-9995-9d3483f784ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:14.892580 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fd4f64aa-989d-4715-9995-9d3483f784ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1489 microversion: 2.1 time: 0.669682 Sep 10 21:13:14.898390 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2655/5216] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:14 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1489 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:14.924070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a96d4c81-d0d2-4f91-8526-bd05fac1dd4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:14.927595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a96d4c81-d0d2-4f91-8526-bd05fac1dd4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:14.944093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a96d4c81-d0d2-4f91-8526-bd05fac1dd4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:14.946701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a96d4c81-d0d2-4f91-8526-bd05fac1dd4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:14.947339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a96d4c81-d0d2-4f91-8526-bd05fac1dd4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:14.950175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a96d4c81-d0d2-4f91-8526-bd05fac1dd4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:14.951119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a96d4c81-d0d2-4f91-8526-bd05fac1dd4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:14.952325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a96d4c81-d0d2-4f91-8526-bd05fac1dd4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:15.009415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:15.068868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ddac345-9b44-4d89-b3c5-bc9a9d3fd668 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:15.069660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ddac345-9b44-4d89-b3c5-bc9a9d3fd668 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:15.076882 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a96d4c81-d0d2-4f91-8526-bd05fac1dd4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 200 len: 147 microversion: 2.1 time: 0.156807 Sep 10 21:13:15.082019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ddac345-9b44-4d89-b3c5-bc9a9d3fd668 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:15.083915 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2562/5217] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:14 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 147 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:15.092428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8bbc8310-a67f-496e-9490-12a252f5e102 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:15.094176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ddac345-9b44-4d89-b3c5-bc9a9d3fd668 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:15.095158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8bbc8310-a67f-496e-9490-12a252f5e102 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:15.096540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ddac345-9b44-4d89-b3c5-bc9a9d3fd668 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:15.097656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ddac345-9b44-4d89-b3c5-bc9a9d3fd668 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:15.098464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ddac345-9b44-4d89-b3c5-bc9a9d3fd668 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:15.100670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ddac345-9b44-4d89-b3c5-bc9a9d3fd668 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:15.119266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bbc8310-a67f-496e-9490-12a252f5e102 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:15.121048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bbc8310-a67f-496e-9490-12a252f5e102 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:15.123362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bbc8310-a67f-496e-9490-12a252f5e102 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:15.124329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bbc8310-a67f-496e-9490-12a252f5e102 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:15.124977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bbc8310-a67f-496e-9490-12a252f5e102 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:15.126789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8bbc8310-a67f-496e-9490-12a252f5e102 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:15.318881 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ddac345-9b44-4d89-b3c5-bc9a9d3fd668 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1414 microversion: 2.1 time: 0.251061 Sep 10 21:13:15.319818 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2656/5218] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:15 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1414 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:15.468392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8bbc8310-a67f-496e-9490-12a252f5e102 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:15.506265 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8bbc8310-a67f-496e-9490-12a252f5e102 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.414403 Sep 10 21:13:15.506939 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2563/5219] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:15 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:15.578302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d22ff4f1-c18b-45a3-af79-7b4acf57f941 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:15.579478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:15.579866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d22ff4f1-c18b-45a3-af79-7b4acf57f941 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:15.580106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:15.588061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d22ff4f1-c18b-45a3-af79-7b4acf57f941 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:15.589610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d22ff4f1-c18b-45a3-af79-7b4acf57f941 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:15.590999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d22ff4f1-c18b-45a3-af79-7b4acf57f941 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:15.592145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d22ff4f1-c18b-45a3-af79-7b4acf57f941 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:15.592897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d22ff4f1-c18b-45a3-af79-7b4acf57f941 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:15.593588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d22ff4f1-c18b-45a3-af79-7b4acf57f941 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:15.605020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:15.610221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:15.612414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:15.615372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:15.619197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:15.624744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:16.149116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:16.175940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:16.183344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:16.184618 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-81f6614b-f969-4449-a359-bc9266d8474d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.609473 Sep 10 21:13:16.227197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d22ff4f1-c18b-45a3-af79-7b4acf57f941 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:16.228354 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2564/5220] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:15 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:16.257390 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d22ff4f1-c18b-45a3-af79-7b4acf57f941 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.692271 Sep 10 21:13:16.259243 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2657/5221] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:15 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:16.284539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f1391c28-a094-4da7-90e4-dfc58adbeb03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:16.285286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f1391c28-a094-4da7-90e4-dfc58adbeb03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:16.316009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1391c28-a094-4da7-90e4-dfc58adbeb03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:16.316825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1391c28-a094-4da7-90e4-dfc58adbeb03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:16.317760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1391c28-a094-4da7-90e4-dfc58adbeb03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:16.319983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1391c28-a094-4da7-90e4-dfc58adbeb03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:16.321920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1391c28-a094-4da7-90e4-dfc58adbeb03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:16.324017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f1391c28-a094-4da7-90e4-dfc58adbeb03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:16.346753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6792d991-4314-42c7-9da4-b0d1adf1606d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:16.347623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6792d991-4314-42c7-9da4-b0d1adf1606d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:16.364377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6792d991-4314-42c7-9da4-b0d1adf1606d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:16.364891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6792d991-4314-42c7-9da4-b0d1adf1606d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:16.365342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6792d991-4314-42c7-9da4-b0d1adf1606d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:16.384555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6792d991-4314-42c7-9da4-b0d1adf1606d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:16.385451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6792d991-4314-42c7-9da4-b0d1adf1606d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:16.386331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6792d991-4314-42c7-9da4-b0d1adf1606d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:17.024705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f1391c28-a094-4da7-90e4-dfc58adbeb03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:17.033228 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f1391c28-a094-4da7-90e4-dfc58adbeb03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.752706 Sep 10 21:13:17.066258 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2565/5222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:16 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:17.072830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2d28fca2-cf64-4c20-98ef-299406dd4051 req-cb965666-c216-42d4-8eaf-9656c2e829c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e983600b-2110-437c-a0db-fb0d9c8fe55c", "tag": "1fd22866-4f2e-4ce7-a0e8-bb4d5e06024d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:17.096250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2d28fca2-cf64-4c20-98ef-299406dd4051 req-cb965666-c216-42d4-8eaf-9656c2e829c7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:17.096745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2d28fca2-cf64-4c20-98ef-299406dd4051 req-cb965666-c216-42d4-8eaf-9656c2e829c7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:17.102158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2d28fca2-cf64-4c20-98ef-299406dd4051 req-cb965666-c216-42d4-8eaf-9656c2e829c7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:17.131410 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2d28fca2-cf64-4c20-98ef-299406dd4051 req-cb965666-c216-42d4-8eaf-9656c2e829c7 service nova] Creating event network-changed:1fd22866-4f2e-4ce7-a0e8-bb4d5e06024d for instance e983600b-2110-437c-a0db-fb0d9c8fe55c on nch2-master-1 Sep 10 21:13:17.142748 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2d28fca2-cf64-4c20-98ef-299406dd4051 req-cb965666-c216-42d4-8eaf-9656c2e829c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075007 Sep 10 21:13:17.143367 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2566/5223] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:17.154492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-24c3eb86-08c0-47b5-8372-60315ac246a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:17.158491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-24c3eb86-08c0-47b5-8372-60315ac246a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:17.176348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24c3eb86-08c0-47b5-8372-60315ac246a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:17.177799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24c3eb86-08c0-47b5-8372-60315ac246a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:17.179597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24c3eb86-08c0-47b5-8372-60315ac246a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:17.186612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24c3eb86-08c0-47b5-8372-60315ac246a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:17.187793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24c3eb86-08c0-47b5-8372-60315ac246a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:17.188917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24c3eb86-08c0-47b5-8372-60315ac246a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:17.366579 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6792d991-4314-42c7-9da4-b0d1adf1606d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1422 microversion: 2.1 time: 1.023324 Sep 10 21:13:17.386315 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2658/5224] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:16 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1422 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:17.402641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:17.405810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:17.422942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:17.424068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:17.424786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:17.425766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:17.426593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:17.427368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:17.889500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:17.902997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:17.906886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:17.909966 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a4ad0791-ef23-4fe7-a497-8954155e2f00 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.517623 Sep 10 21:13:17.910868 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2659/5225] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:17 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:18.198929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-24c3eb86-08c0-47b5-8372-60315ac246a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:18.211486 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-24c3eb86-08c0-47b5-8372-60315ac246a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 1.060752 Sep 10 21:13:18.232144 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2567/5226] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:17 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:18.393337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-57e4a924-a935-48c9-8b48-d745edc761e8 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:18.394000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-57e4a924-a935-48c9-8b48-d745edc761e8 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:18.408770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4a924-a935-48c9-8b48-d745edc761e8 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:18.409279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4a924-a935-48c9-8b48-d745edc761e8 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:18.409725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4a924-a935-48c9-8b48-d745edc761e8 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:18.415974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4a924-a935-48c9-8b48-d745edc761e8 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:18.416657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4a924-a935-48c9-8b48-d745edc761e8 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:18.417742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-57e4a924-a935-48c9-8b48-d745edc761e8 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:18.482187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1666417042", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "22651555-9c52-45fb-b1cb-a14fc16f0427"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:18.611333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] validate_networks() for [('22651555-9c52-45fb-b1cb-a14fc16f0427', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:13:18.690673 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-57e4a924-a935-48c9-8b48-d745edc761e8 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1420 microversion: 2.1 time: 0.289122 Sep 10 21:13:18.698520 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2660/5227] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:18 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:18.962228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:18.963092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:18.983958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:18.984504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:18.984952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:18.989012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:18.994142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:18.994649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:19.310521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:19.326353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:19.329248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:19.330768 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8db86232-f16f-4eb3-9e11-598f79c4af4d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.373982 Sep 10 21:13:19.331885 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2661/5228] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:18 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:19.602839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:13:19.603448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:13:19.605042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:13:19.605800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:13:19.606445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:13:19.621364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:19.622573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:19.623316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:19.625194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:19.625874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:19.626740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:19.656217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for project 15a76a25754c42099c542fa13046f01b. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:13:19.662163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for user d83b6ceb599746b394e379d52683b70c and project 15a76a25754c42099c542fa13046f01b. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:13:19.672651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:19.676724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:13:19.679097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:13:19.720662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1a4818b4-0d11-4120-9f76-c74c803df1da tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:19.721275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1a4818b4-0d11-4120-9f76-c74c803df1da tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:19.735620 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6db6e45-7437-4e20-b22f-50697e4c2f9e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.263561 Sep 10 21:13:19.736294 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2568/5229] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:13:19.739305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a4818b4-0d11-4120-9f76-c74c803df1da tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:19.739818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a4818b4-0d11-4120-9f76-c74c803df1da tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:19.740287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a4818b4-0d11-4120-9f76-c74c803df1da tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:19.741189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a4818b4-0d11-4120-9f76-c74c803df1da tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:19.742223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a4818b4-0d11-4120-9f76-c74c803df1da tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:19.742878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1a4818b4-0d11-4120-9f76-c74c803df1da tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:19.747441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9a1420fe-e6c3-4a21-9eaa-778245d0bb54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:19.748358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9a1420fe-e6c3-4a21-9eaa-778245d0bb54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:19.816340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a1420fe-e6c3-4a21-9eaa-778245d0bb54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:19.823656 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9a1420fe-e6c3-4a21-9eaa-778245d0bb54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1215 microversion: 2.1 time: 0.080062 Sep 10 21:13:19.824564 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2569/5230] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:19 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:20.061204 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1a4818b4-0d11-4120-9f76-c74c803df1da tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.343633 Sep 10 21:13:20.079754 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2662/5231] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:19 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:20.365047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:20.366075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:20.379539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:20.380359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:20.381570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:20.383847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:20.384505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:20.385846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:20.654974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:20.678826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:20.681024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:20.683118 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8546164-6b3a-43fe-a1e5-34b9315a7cf3 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.325538 Sep 10 21:13:20.692292 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2570/5232] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:20 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:20.848436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21011170-e925-4fb3-aca9-9a0eaef78f94 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:20.848978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21011170-e925-4fb3-aca9-9a0eaef78f94 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:20.858437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21011170-e925-4fb3-aca9-9a0eaef78f94 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:20.859041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21011170-e925-4fb3-aca9-9a0eaef78f94 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:20.859347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21011170-e925-4fb3-aca9-9a0eaef78f94 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:20.860203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21011170-e925-4fb3-aca9-9a0eaef78f94 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:20.861034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21011170-e925-4fb3-aca9-9a0eaef78f94 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:20.861471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21011170-e925-4fb3-aca9-9a0eaef78f94 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:20.932716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-21011170-e925-4fb3-aca9-9a0eaef78f94 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:20.941536 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21011170-e925-4fb3-aca9-9a0eaef78f94 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1267 microversion: 2.1 time: 0.097943 Sep 10 21:13:20.942564 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2663/5233] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:20 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:21.089766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b15e2c1d-2d8a-4cd5-875a-7305a0087c08 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:21.090511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b15e2c1d-2d8a-4cd5-875a-7305a0087c08 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:21.096556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a5dff8ae-d0ed-48c5-886f-29a6040832f0 req-1ae30971-c3a2-49c6-9d47-b2eb5746db56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d23f2e-4092-45cf-883c-aca65dcf4709", "tag": "0386f662-eeed-4f45-ab8e-6bb1c9e26901"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:21.102875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15e2c1d-2d8a-4cd5-875a-7305a0087c08 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:21.103378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15e2c1d-2d8a-4cd5-875a-7305a0087c08 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:21.104695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15e2c1d-2d8a-4cd5-875a-7305a0087c08 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:21.108424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15e2c1d-2d8a-4cd5-875a-7305a0087c08 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:21.110377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15e2c1d-2d8a-4cd5-875a-7305a0087c08 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:21.110994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b15e2c1d-2d8a-4cd5-875a-7305a0087c08 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:21.111889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a5dff8ae-d0ed-48c5-886f-29a6040832f0 req-1ae30971-c3a2-49c6-9d47-b2eb5746db56 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:21.113704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a5dff8ae-d0ed-48c5-886f-29a6040832f0 req-1ae30971-c3a2-49c6-9d47-b2eb5746db56 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:21.114597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a5dff8ae-d0ed-48c5-886f-29a6040832f0 req-1ae30971-c3a2-49c6-9d47-b2eb5746db56 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:21.143282 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a5dff8ae-d0ed-48c5-886f-29a6040832f0 req-1ae30971-c3a2-49c6-9d47-b2eb5746db56 service nova] Creating event network-changed:0386f662-eeed-4f45-ab8e-6bb1c9e26901 for instance 11d23f2e-4092-45cf-883c-aca65dcf4709 on nch1-master-1 Sep 10 21:13:21.148671 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a5dff8ae-d0ed-48c5-886f-29a6040832f0 req-1ae30971-c3a2-49c6-9d47-b2eb5746db56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063898 Sep 10 21:13:21.153344 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2571/5234] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:21.383153 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b15e2c1d-2d8a-4cd5-875a-7305a0087c08 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.298658 Sep 10 21:13:21.384325 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2664/5235] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:21 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:21.710674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:21.711382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:21.719229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:21.720478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:21.720478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:21.721000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:21.721664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:21.722135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:21.896241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:21.906516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:21.908332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:21.909656 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0f9951ec-803e-4508-b10a-c85f87ba6d6a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.204387 Sep 10 21:13:21.926316 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2572/5236] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:21 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:21.973004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-be186c83-6113-4118-b4af-2acc50c963a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:21.973854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-be186c83-6113-4118-b4af-2acc50c963a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:21.985472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be186c83-6113-4118-b4af-2acc50c963a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:21.986086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be186c83-6113-4118-b4af-2acc50c963a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:21.987219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be186c83-6113-4118-b4af-2acc50c963a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:21.988268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be186c83-6113-4118-b4af-2acc50c963a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:21.990021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be186c83-6113-4118-b4af-2acc50c963a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:21.991377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-be186c83-6113-4118-b4af-2acc50c963a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:22.340083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-be186c83-6113-4118-b4af-2acc50c963a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:22.343968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:22.359403 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-be186c83-6113-4118-b4af-2acc50c963a4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1315 microversion: 2.1 time: 0.395152 Sep 10 21:13:22.362661 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2665/5237] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:21 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:22.407470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1cf755b7-8d20-4f85-9dbf-26787d82907d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:22.407998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1cf755b7-8d20-4f85-9dbf-26787d82907d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:22.419830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf755b7-8d20-4f85-9dbf-26787d82907d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:22.421095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf755b7-8d20-4f85-9dbf-26787d82907d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:22.421853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf755b7-8d20-4f85-9dbf-26787d82907d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:22.422671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf755b7-8d20-4f85-9dbf-26787d82907d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:22.423217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf755b7-8d20-4f85-9dbf-26787d82907d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:22.423810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cf755b7-8d20-4f85-9dbf-26787d82907d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:22.859895 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1cf755b7-8d20-4f85-9dbf-26787d82907d tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.456371 Sep 10 21:13:22.860853 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2573/5238] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:22 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:22.938388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:22.938998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:22.941537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:22.942567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:22.948199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:22.949033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:22.949490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:22.950301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:22.950757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:22.951421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:23.052257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-57950c85-61c6-4020-8c20-c3811c213ff9 req-797aa245-b54e-456a-9d60-651231c963bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a0156a-616b-48b0-9cc4-191d12c4bbaa", "tag": "b267aeac-2c16-4b9e-8210-7ece1fbf8a01"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:23.065908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-57950c85-61c6-4020-8c20-c3811c213ff9 req-797aa245-b54e-456a-9d60-651231c963bb service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:23.066623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-57950c85-61c6-4020-8c20-c3811c213ff9 req-797aa245-b54e-456a-9d60-651231c963bb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:23.067063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-57950c85-61c6-4020-8c20-c3811c213ff9 req-797aa245-b54e-456a-9d60-651231c963bb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:23.083006 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-57950c85-61c6-4020-8c20-c3811c213ff9 req-797aa245-b54e-456a-9d60-651231c963bb service nova] Creating event network-changed:b267aeac-2c16-4b9e-8210-7ece1fbf8a01 for instance c1a0156a-616b-48b0-9cc4-191d12c4bbaa on nch2-master-1 Sep 10 21:13:23.093556 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-57950c85-61c6-4020-8c20-c3811c213ff9 req-797aa245-b54e-456a-9d60-651231c963bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044863 Sep 10 21:13:23.094702 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2574/5239] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:23.252430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:23.263328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:23.265011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:23.266418 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c5b1588d-1d78-4e88-8309-6f22958e1f59 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.332351 Sep 10 21:13:23.267187 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2666/5240] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:22 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:23.386252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-37ccd4d6-1dad-4e72-a1cb-0a6aa4207416 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:23.387011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-37ccd4d6-1dad-4e72-a1cb-0a6aa4207416 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:23.394484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37ccd4d6-1dad-4e72-a1cb-0a6aa4207416 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:23.395069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37ccd4d6-1dad-4e72-a1cb-0a6aa4207416 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:23.395586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37ccd4d6-1dad-4e72-a1cb-0a6aa4207416 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:23.396372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37ccd4d6-1dad-4e72-a1cb-0a6aa4207416 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:23.396917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37ccd4d6-1dad-4e72-a1cb-0a6aa4207416 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:23.397417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-37ccd4d6-1dad-4e72-a1cb-0a6aa4207416 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:23.552577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-37ccd4d6-1dad-4e72-a1cb-0a6aa4207416 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:23.560846 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-37ccd4d6-1dad-4e72-a1cb-0a6aa4207416 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1315 microversion: 2.1 time: 0.179603 Sep 10 21:13:23.561708 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2575/5241] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:23 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:23.883932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a64c41a-dc9f-4440-8ff3-174cccab9c89 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:23.884556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a64c41a-dc9f-4440-8ff3-174cccab9c89 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:23.893572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a64c41a-dc9f-4440-8ff3-174cccab9c89 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:23.894105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a64c41a-dc9f-4440-8ff3-174cccab9c89 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:23.894550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a64c41a-dc9f-4440-8ff3-174cccab9c89 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:23.895265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a64c41a-dc9f-4440-8ff3-174cccab9c89 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:23.895727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a64c41a-dc9f-4440-8ff3-174cccab9c89 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:23.896167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a64c41a-dc9f-4440-8ff3-174cccab9c89 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:24.085005 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a64c41a-dc9f-4440-8ff3-174cccab9c89 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.204835 Sep 10 21:13:24.085589 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2667/5242] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:23 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:24.295685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:24.296371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:24.304730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:24.305519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:24.306107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:24.307144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:24.307604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:24.308091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:24.564332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:24.585012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0a63569-5e25-4da8-91db-f05878c70d0d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:24.585627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0a63569-5e25-4da8-91db-f05878c70d0d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:24.592144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:24.593728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0a63569-5e25-4da8-91db-f05878c70d0d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:24.594468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0a63569-5e25-4da8-91db-f05878c70d0d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:24.594766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:24.595308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0a63569-5e25-4da8-91db-f05878c70d0d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:24.596358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0a63569-5e25-4da8-91db-f05878c70d0d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:24.597065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0a63569-5e25-4da8-91db-f05878c70d0d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:24.597201 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-937aebf2-817e-413c-916c-b679ed517cd2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.308259 Sep 10 21:13:24.597914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0a63569-5e25-4da8-91db-f05878c70d0d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:24.609722 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2576/5243] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:24 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:24.842303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0a63569-5e25-4da8-91db-f05878c70d0d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:24.856230 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0a63569-5e25-4da8-91db-f05878c70d0d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1315 microversion: 2.1 time: 0.275510 Sep 10 21:13:24.856952 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2668/5244] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:24 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:25.108974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-95611637-795b-4112-b697-27edbe374cfc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:25.109660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-95611637-795b-4112-b697-27edbe374cfc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:25.115921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95611637-795b-4112-b697-27edbe374cfc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:25.116614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95611637-795b-4112-b697-27edbe374cfc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:25.117405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95611637-795b-4112-b697-27edbe374cfc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:25.118361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95611637-795b-4112-b697-27edbe374cfc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:25.119138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95611637-795b-4112-b697-27edbe374cfc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:25.120187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-95611637-795b-4112-b697-27edbe374cfc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:25.271591 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-95611637-795b-4112-b697-27edbe374cfc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.166543 Sep 10 21:13:25.272190 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2577/5245] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:25 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:25.627101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:25.628530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:25.638361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:25.638863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:25.639312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:25.640028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:25.640490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:25.640945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:25.780046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:25.789048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:25.790585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:25.791914 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5028ea9-e8bf-4b7a-ae2c-c8038a404442 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.168693 Sep 10 21:13:25.792485 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2669/5246] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:25 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:25.879696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-75e74ba0-bf58-4be1-a957-29b0886212e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:25.880307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-75e74ba0-bf58-4be1-a957-29b0886212e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:25.893870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75e74ba0-bf58-4be1-a957-29b0886212e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:25.894558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75e74ba0-bf58-4be1-a957-29b0886212e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:25.895162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75e74ba0-bf58-4be1-a957-29b0886212e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:25.896067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75e74ba0-bf58-4be1-a957-29b0886212e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:25.896522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75e74ba0-bf58-4be1-a957-29b0886212e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:25.897058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75e74ba0-bf58-4be1-a957-29b0886212e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:26.050018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-75e74ba0-bf58-4be1-a957-29b0886212e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:26.058082 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-75e74ba0-bf58-4be1-a957-29b0886212e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1315 microversion: 2.1 time: 0.182114 Sep 10 21:13:26.058793 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2578/5247] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:25 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:26.296531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8e2616a-bcd7-4755-83eb-c9494fa385dc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:26.297400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c8e2616a-bcd7-4755-83eb-c9494fa385dc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:26.304691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e2616a-bcd7-4755-83eb-c9494fa385dc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:26.305290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e2616a-bcd7-4755-83eb-c9494fa385dc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:26.305945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e2616a-bcd7-4755-83eb-c9494fa385dc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:26.306826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e2616a-bcd7-4755-83eb-c9494fa385dc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:26.308283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e2616a-bcd7-4755-83eb-c9494fa385dc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:26.308942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8e2616a-bcd7-4755-83eb-c9494fa385dc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:26.468243 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c8e2616a-bcd7-4755-83eb-c9494fa385dc tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.175509 Sep 10 21:13:26.468837 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2670/5248] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:26 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:26.818949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:26.819576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:26.826938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:26.827435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:26.827889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:26.828596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:26.829056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:26.829504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:26.978031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:26.987541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:26.989010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:26.990309 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f5f32e4-1c24-4a57-8914-79d1f24ff319 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.175513 Sep 10 21:13:26.991193 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2579/5249] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:26 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:27.084809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cf6581a0-ba5c-4616-83c1-82c78b344d3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:27.086026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cf6581a0-ba5c-4616-83c1-82c78b344d3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:27.097467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf6581a0-ba5c-4616-83c1-82c78b344d3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:27.098510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf6581a0-ba5c-4616-83c1-82c78b344d3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:27.099237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf6581a0-ba5c-4616-83c1-82c78b344d3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:27.101107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf6581a0-ba5c-4616-83c1-82c78b344d3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:27.101811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf6581a0-ba5c-4616-83c1-82c78b344d3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:27.102740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cf6581a0-ba5c-4616-83c1-82c78b344d3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:27.258293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cf6581a0-ba5c-4616-83c1-82c78b344d3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:27.267996 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cf6581a0-ba5c-4616-83c1-82c78b344d3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1315 microversion: 2.1 time: 0.188407 Sep 10 21:13:27.268482 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2671/5250] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:27 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:27.491701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ddec03e9-95ef-4f3f-8c44-f0711fba1837 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:27.492325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ddec03e9-95ef-4f3f-8c44-f0711fba1837 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:27.499497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddec03e9-95ef-4f3f-8c44-f0711fba1837 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:27.500002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddec03e9-95ef-4f3f-8c44-f0711fba1837 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:27.500448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddec03e9-95ef-4f3f-8c44-f0711fba1837 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:27.501152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddec03e9-95ef-4f3f-8c44-f0711fba1837 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:27.501652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddec03e9-95ef-4f3f-8c44-f0711fba1837 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:27.502231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddec03e9-95ef-4f3f-8c44-f0711fba1837 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:27.641815 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ddec03e9-95ef-4f3f-8c44-f0711fba1837 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.153980 Sep 10 21:13:27.642748 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2580/5251] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:27 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:28.016984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:28.017738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:28.024442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.024917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.025370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:28.026665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.027137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.027579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:28.157675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-cf764d25-56ed-400f-950c-85b8e97c5ef4 req-4efef357-074e-4ad5-a2cb-401c41f8764c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7919a6b0-623c-440c-bece-f3879f6a89ab", "name": "network-vif-plugged", "status": "completed", "tag": "07804208-07af-4af5-b975-15459b698f1d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:28.173747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:28.181167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cf764d25-56ed-400f-950c-85b8e97c5ef4 req-4efef357-074e-4ad5-a2cb-401c41f8764c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.181668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cf764d25-56ed-400f-950c-85b8e97c5ef4 req-4efef357-074e-4ad5-a2cb-401c41f8764c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.182766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cf764d25-56ed-400f-950c-85b8e97c5ef4 req-4efef357-074e-4ad5-a2cb-401c41f8764c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:28.185623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:28.187450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:28.188914 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-677db63f-567f-46d6-861d-e86d74550342 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.176273 Sep 10 21:13:28.201720 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cf764d25-56ed-400f-950c-85b8e97c5ef4 req-4efef357-074e-4ad5-a2cb-401c41f8764c service nova] Creating event network-vif-plugged:07804208-07af-4af5-b975-15459b698f1d for instance 7919a6b0-623c-440c-bece-f3879f6a89ab on nch1-master-1 Sep 10 21:13:28.202421 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2672/5252] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:28 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:28.207921 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-cf764d25-56ed-400f-950c-85b8e97c5ef4 req-4efef357-074e-4ad5-a2cb-401c41f8764c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056775 Sep 10 21:13:28.209141 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2581/5253] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:13:28.291098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d201e2cd-5348-4e65-982a-502279ab8d1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:28.292678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d201e2cd-5348-4e65-982a-502279ab8d1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:28.300631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d201e2cd-5348-4e65-982a-502279ab8d1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.301372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d201e2cd-5348-4e65-982a-502279ab8d1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.302018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d201e2cd-5348-4e65-982a-502279ab8d1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:28.302901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d201e2cd-5348-4e65-982a-502279ab8d1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.303532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d201e2cd-5348-4e65-982a-502279ab8d1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.304134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d201e2cd-5348-4e65-982a-502279ab8d1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:28.488282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d201e2cd-5348-4e65-982a-502279ab8d1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:28.499065 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d201e2cd-5348-4e65-982a-502279ab8d1e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1315 microversion: 2.1 time: 0.211755 Sep 10 21:13:28.500166 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2673/5254] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:28 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:28.665695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-51ef7b3a-1364-42c1-a690-c83d0ac3b819 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:28.666399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-51ef7b3a-1364-42c1-a690-c83d0ac3b819 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:28.673201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef7b3a-1364-42c1-a690-c83d0ac3b819 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.673888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef7b3a-1364-42c1-a690-c83d0ac3b819 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.674468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef7b3a-1364-42c1-a690-c83d0ac3b819 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:28.675267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef7b3a-1364-42c1-a690-c83d0ac3b819 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.675869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef7b3a-1364-42c1-a690-c83d0ac3b819 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.676375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51ef7b3a-1364-42c1-a690-c83d0ac3b819 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:28.702775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c13007c4-e3d1-45cd-8738-9f8a2b5bf22e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:28.703790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c13007c4-e3d1-45cd-8738-9f8a2b5bf22e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:28.710062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c13007c4-e3d1-45cd-8738-9f8a2b5bf22e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.711077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c13007c4-e3d1-45cd-8738-9f8a2b5bf22e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.711963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c13007c4-e3d1-45cd-8738-9f8a2b5bf22e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:28.712937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c13007c4-e3d1-45cd-8738-9f8a2b5bf22e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.713785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c13007c4-e3d1-45cd-8738-9f8a2b5bf22e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.714556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c13007c4-e3d1-45cd-8738-9f8a2b5bf22e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:28.745198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c13007c4-e3d1-45cd-8738-9f8a2b5bf22e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:13:28.783154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:28.817746 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-51ef7b3a-1364-42c1-a690-c83d0ac3b819 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.155741 Sep 10 21:13:28.818803 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2674/5255] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:28 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:28.841020 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c13007c4-e3d1-45cd-8738-9f8a2b5bf22e tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 204 len: 0 microversion: 2.42 time: 0.505527 Sep 10 21:13:28.841609 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2582/5256] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:13:28 2022] DELETE /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 21:13:28.850841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:28.851589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:28.855058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:28.858880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.859558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.860135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:28.860857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:28.861321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:28.861755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:29.063127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:29.072968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:29.074521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:29.075727 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a892af96-c46e-4497-8a3f-06d802d3cb99 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 2960 microversion: 2.42 time: 0.229872 Sep 10 21:13:29.076299 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2675/5257] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:28 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 2960 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:29.217368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:29.218207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:29.225813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:29.226416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:29.226923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:29.227691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:29.228216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:29.228712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:29.371651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:29.380363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:29.381811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:29.383003 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-99b673b9-3d97-4247-95fa-67fc41cf9fcc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.170424 Sep 10 21:13:29.383569 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2583/5258] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:29 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:29.522691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-15f4b5ef-58bb-42ff-8558-99a466c3c0bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:29.523312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-15f4b5ef-58bb-42ff-8558-99a466c3c0bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:29.530792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15f4b5ef-58bb-42ff-8558-99a466c3c0bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:29.531549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15f4b5ef-58bb-42ff-8558-99a466c3c0bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:29.531798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15f4b5ef-58bb-42ff-8558-99a466c3c0bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:29.532436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15f4b5ef-58bb-42ff-8558-99a466c3c0bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:29.532900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15f4b5ef-58bb-42ff-8558-99a466c3c0bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:29.533334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15f4b5ef-58bb-42ff-8558-99a466c3c0bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:29.683675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-15f4b5ef-58bb-42ff-8558-99a466c3c0bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:29.693367 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-15f4b5ef-58bb-42ff-8558-99a466c3c0bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1315 microversion: 2.1 time: 0.174463 Sep 10 21:13:29.694564 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2676/5259] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:29 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:29.843369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dad82bd3-c457-4c22-ad63-12716a4f4735 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:29.844102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dad82bd3-c457-4c22-ad63-12716a4f4735 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:29.847672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:29.848515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=10 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:29.852955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dad82bd3-c457-4c22-ad63-12716a4f4735 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:29.853520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dad82bd3-c457-4c22-ad63-12716a4f4735 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:29.854310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dad82bd3-c457-4c22-ad63-12716a4f4735 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:29.855318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dad82bd3-c457-4c22-ad63-12716a4f4735 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:29.855767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dad82bd3-c457-4c22-ad63-12716a4f4735 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:29.856405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dad82bd3-c457-4c22-ad63-12716a4f4735 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:30.050865 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dad82bd3-c457-4c22-ad63-12716a4f4735 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.199325 Sep 10 21:13:30.054892 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2584/5260] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:29 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:30.113050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:30.114199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:30.122713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:30.123306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:30.124040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:30.125432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:30.126142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:30.126837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:30.246406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f4a5f596-4792-4ded-9f5a-4133a90d2f1a req-460d70cc-4b52-4b47-95d3-b45dea553ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a0156a-616b-48b0-9cc4-191d12c4bbaa", "name": "network-vif-plugged", "status": "completed", "tag": "b267aeac-2c16-4b9e-8210-7ece1fbf8a01"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:30.279956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f4a5f596-4792-4ded-9f5a-4133a90d2f1a req-460d70cc-4b52-4b47-95d3-b45dea553ed0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:30.280870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f4a5f596-4792-4ded-9f5a-4133a90d2f1a req-460d70cc-4b52-4b47-95d3-b45dea553ed0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:30.281602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f4a5f596-4792-4ded-9f5a-4133a90d2f1a req-460d70cc-4b52-4b47-95d3-b45dea553ed0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:30.310541 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f4a5f596-4792-4ded-9f5a-4133a90d2f1a req-460d70cc-4b52-4b47-95d3-b45dea553ed0 service nova] Creating event network-vif-plugged:b267aeac-2c16-4b9e-8210-7ece1fbf8a01 for instance c1a0156a-616b-48b0-9cc4-191d12c4bbaa on nch2-master-1 Sep 10 21:13:30.316285 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f4a5f596-4792-4ded-9f5a-4133a90d2f1a req-460d70cc-4b52-4b47-95d3-b45dea553ed0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078209 Sep 10 21:13:30.317645 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2585/5261] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:30.387129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:30.397954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:30.401694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:30.403014 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a69f0574-4829-4c0c-98be-5f6407b47179 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 2960 microversion: 2.42 time: 0.303156 Sep 10 21:13:30.403593 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2677/5262] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:30 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 2960 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:30.413566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:30.417114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:30.424753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:30.426083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:30.426531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:30.427462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:30.427925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:30.428543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:30.595052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:30.605976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:30.607509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:30.608815 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e02fb2ba-bc37-41bf-963f-18c2e141048c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1808 microversion: 2.20 time: 0.201483 Sep 10 21:13:30.617919 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2586/5263] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:30 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:13:30.718130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2a5299e8-d7e7-49f2-a028-48cc8451bde2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:30.718687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2a5299e8-d7e7-49f2-a028-48cc8451bde2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:30.731524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a5299e8-d7e7-49f2-a028-48cc8451bde2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:30.732524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a5299e8-d7e7-49f2-a028-48cc8451bde2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:30.733137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a5299e8-d7e7-49f2-a028-48cc8451bde2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:30.734286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a5299e8-d7e7-49f2-a028-48cc8451bde2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:30.735196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a5299e8-d7e7-49f2-a028-48cc8451bde2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:30.736252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2a5299e8-d7e7-49f2-a028-48cc8451bde2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:30.894804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2a5299e8-d7e7-49f2-a028-48cc8451bde2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:30.904033 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2a5299e8-d7e7-49f2-a028-48cc8451bde2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1315 microversion: 2.1 time: 0.190221 Sep 10 21:13:30.904631 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2678/5264] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:30 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:31.078068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e129aa77-6a74-4f18-be25-c34e6f43d453 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:31.078913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e129aa77-6a74-4f18-be25-c34e6f43d453 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:31.086604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e129aa77-6a74-4f18-be25-c34e6f43d453 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:31.087093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e129aa77-6a74-4f18-be25-c34e6f43d453 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:31.087729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e129aa77-6a74-4f18-be25-c34e6f43d453 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:31.088989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e129aa77-6a74-4f18-be25-c34e6f43d453 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:31.089443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e129aa77-6a74-4f18-be25-c34e6f43d453 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:31.090089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e129aa77-6a74-4f18-be25-c34e6f43d453 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:31.230353 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e129aa77-6a74-4f18-be25-c34e6f43d453 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.156133 Sep 10 21:13:31.231201 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2587/5265] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:31 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:31.432654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:31.433275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:31.439606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:31.440090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:31.440525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:31.441217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:31.441689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:31.442130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:31.632568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:31.636894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:31.637519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:31.643275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:31.644469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:31.644972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:31.645667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:31.646151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:31.646653 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a99ea4e8-7ad0-421c-9685-dd63ed853177 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 2960 microversion: 2.42 time: 0.218696 Sep 10 21:13:31.646882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:31.647242 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2679/5266] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:31 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 2960 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:13:31.647405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:31.648117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:31.788580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:31.797390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:31.798928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:31.800135 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1baba52d-9492-40be-8225-8fc796c54969 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1795 microversion: 2.20 time: 0.167972 Sep 10 21:13:31.800773 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2588/5267] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:31 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1795 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:31.927179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b12ce3dd-7fa0-433b-a7af-9ea93281cbdd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:31.928532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b12ce3dd-7fa0-433b-a7af-9ea93281cbdd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:31.935567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12ce3dd-7fa0-433b-a7af-9ea93281cbdd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:31.936203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12ce3dd-7fa0-433b-a7af-9ea93281cbdd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:31.936652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12ce3dd-7fa0-433b-a7af-9ea93281cbdd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:31.937359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12ce3dd-7fa0-433b-a7af-9ea93281cbdd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:31.937838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12ce3dd-7fa0-433b-a7af-9ea93281cbdd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:31.938559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12ce3dd-7fa0-433b-a7af-9ea93281cbdd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:32.112733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b12ce3dd-7fa0-433b-a7af-9ea93281cbdd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:32.124409 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b12ce3dd-7fa0-433b-a7af-9ea93281cbdd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1315 microversion: 2.1 time: 0.201296 Sep 10 21:13:32.125085 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2680/5268] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:31 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:32.254875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8b04178-c670-4313-ae90-0df56263cfbf tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:32.255500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8b04178-c670-4313-ae90-0df56263cfbf tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:32.262578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8b04178-c670-4313-ae90-0df56263cfbf tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:32.263075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8b04178-c670-4313-ae90-0df56263cfbf tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:32.263520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8b04178-c670-4313-ae90-0df56263cfbf tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:32.264312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8b04178-c670-4313-ae90-0df56263cfbf tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:32.264803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8b04178-c670-4313-ae90-0df56263cfbf tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:32.265244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8b04178-c670-4313-ae90-0df56263cfbf tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:32.334678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-158a3836-1f33-4c7a-8ec8-969298edca59 req-51d8f388-028e-4909-878c-4d20bcc51dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d23f2e-4092-45cf-883c-aca65dcf4709", "name": "network-vif-plugged", "status": "completed", "tag": "0386f662-eeed-4f45-ab8e-6bb1c9e26901"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:32.345437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-158a3836-1f33-4c7a-8ec8-969298edca59 req-51d8f388-028e-4909-878c-4d20bcc51dab service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:32.346345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-158a3836-1f33-4c7a-8ec8-969298edca59 req-51d8f388-028e-4909-878c-4d20bcc51dab service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:32.346932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-158a3836-1f33-4c7a-8ec8-969298edca59 req-51d8f388-028e-4909-878c-4d20bcc51dab service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:32.363382 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-158a3836-1f33-4c7a-8ec8-969298edca59 req-51d8f388-028e-4909-878c-4d20bcc51dab service nova] Creating event network-vif-plugged:0386f662-eeed-4f45-ab8e-6bb1c9e26901 for instance 11d23f2e-4092-45cf-883c-aca65dcf4709 on nch1-master-1 Sep 10 21:13:32.374381 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-158a3836-1f33-4c7a-8ec8-969298edca59 req-51d8f388-028e-4909-878c-4d20bcc51dab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041625 Sep 10 21:13:32.375052 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2681/5269] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:13:32.407543 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8b04178-c670-4313-ae90-0df56263cfbf tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.156655 Sep 10 21:13:32.408139 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2589/5270] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:32 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:32.679817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:32.680589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:32.688563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:32.689060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:32.689511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:32.690248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:32.690711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:32.691142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:32.972525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:32.984887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:32.987198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:32.988147 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-80e1d47d-8378-45c0-80af-e708851cde05 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 2960 microversion: 2.42 time: 0.314263 Sep 10 21:13:32.988875 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2682/5271] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:32 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 2960 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:33.148594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a118ee52-f586-4d8e-8359-f11f3da43e5d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:33.149807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a118ee52-f586-4d8e-8359-f11f3da43e5d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:33.165907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a118ee52-f586-4d8e-8359-f11f3da43e5d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:33.167431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a118ee52-f586-4d8e-8359-f11f3da43e5d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:33.167993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a118ee52-f586-4d8e-8359-f11f3da43e5d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:33.168980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a118ee52-f586-4d8e-8359-f11f3da43e5d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:33.169446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a118ee52-f586-4d8e-8359-f11f3da43e5d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:33.169901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a118ee52-f586-4d8e-8359-f11f3da43e5d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:33.318863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a118ee52-f586-4d8e-8359-f11f3da43e5d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:33.327866 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a118ee52-f586-4d8e-8359-f11f3da43e5d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1503 microversion: 2.1 time: 0.184556 Sep 10 21:13:33.342704 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2590/5272] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:33 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:33.356621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5964963c-a14c-496a-9135-a86a5082a911 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:33.359207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5964963c-a14c-496a-9135-a86a5082a911 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:33.365484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5964963c-a14c-496a-9135-a86a5082a911 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:33.366338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5964963c-a14c-496a-9135-a86a5082a911 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:33.367027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5964963c-a14c-496a-9135-a86a5082a911 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:33.367987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5964963c-a14c-496a-9135-a86a5082a911 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:33.368685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5964963c-a14c-496a-9135-a86a5082a911 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:33.370046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5964963c-a14c-496a-9135-a86a5082a911 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:33.393765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:33.413332 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5964963c-a14c-496a-9135-a86a5082a911 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.061135 Sep 10 21:13:33.414683 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2683/5273] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:33 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:33.431266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-887f1951-5867-445d-94ec-5cbf68915875 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:33.432590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-887f1951-5867-445d-94ec-5cbf68915875 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:33.438897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-887f1951-5867-445d-94ec-5cbf68915875 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:33.439389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-887f1951-5867-445d-94ec-5cbf68915875 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:33.440047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-887f1951-5867-445d-94ec-5cbf68915875 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:33.440965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-887f1951-5867-445d-94ec-5cbf68915875 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:33.441610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-887f1951-5867-445d-94ec-5cbf68915875 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:33.442082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-887f1951-5867-445d-94ec-5cbf68915875 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:33.588454 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-887f1951-5867-445d-94ec-5cbf68915875 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1462 microversion: 2.1 time: 0.161257 Sep 10 21:13:33.589512 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2591/5274] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:33 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1462 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:34.022542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:34.023405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:34.032124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:34.032754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:34.033288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:34.034106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:34.034643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:34.035157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:34.427974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54fa2649-6f94-4126-a7f7-b9a964527460 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:34.431395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-54fa2649-6f94-4126-a7f7-b9a964527460 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:34.440181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54fa2649-6f94-4126-a7f7-b9a964527460 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:34.440636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54fa2649-6f94-4126-a7f7-b9a964527460 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:34.441335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54fa2649-6f94-4126-a7f7-b9a964527460 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:34.442196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54fa2649-6f94-4126-a7f7-b9a964527460 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:34.442657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54fa2649-6f94-4126-a7f7-b9a964527460 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:34.443090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54fa2649-6f94-4126-a7f7-b9a964527460 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:34.489964 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-54fa2649-6f94-4126-a7f7-b9a964527460 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.066087 Sep 10 21:13:34.494014 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2592/5275] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:34 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:34.614921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ea650211-eebb-415b-8d35-ff8c75171514 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:34.616033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ea650211-eebb-415b-8d35-ff8c75171514 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:34.624229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea650211-eebb-415b-8d35-ff8c75171514 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:34.624721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea650211-eebb-415b-8d35-ff8c75171514 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:34.625165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea650211-eebb-415b-8d35-ff8c75171514 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:34.626121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea650211-eebb-415b-8d35-ff8c75171514 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:34.626585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea650211-eebb-415b-8d35-ff8c75171514 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:34.627015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ea650211-eebb-415b-8d35-ff8c75171514 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:34.744030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:34.755591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:34.757341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:34.758833 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c170ae9-0e33-4e9a-876f-7c9c608e17b1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 2918 microversion: 2.42 time: 0.740903 Sep 10 21:13:34.774359 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2684/5276] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:34 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 2918 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:34.775274 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ea650211-eebb-415b-8d35-ff8c75171514 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1646 microversion: 2.1 time: 0.164004 Sep 10 21:13:34.776809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2593/5277] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:34 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1646 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:34.804220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d412cdbc-ebe4-45de-ba7f-ff30afa47793 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:34.804821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d412cdbc-ebe4-45de-ba7f-ff30afa47793 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:34.813295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d412cdbc-ebe4-45de-ba7f-ff30afa47793 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:34.813806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d412cdbc-ebe4-45de-ba7f-ff30afa47793 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:34.814279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d412cdbc-ebe4-45de-ba7f-ff30afa47793 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:34.815009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d412cdbc-ebe4-45de-ba7f-ff30afa47793 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:34.815471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d412cdbc-ebe4-45de-ba7f-ff30afa47793 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:34.816107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d412cdbc-ebe4-45de-ba7f-ff30afa47793 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.044900 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d412cdbc-ebe4-45de-ba7f-ff30afa47793 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1646 microversion: 2.1 time: 0.244159 Sep 10 21:13:35.046052 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2685/5278] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:34 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1646 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:35.069669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f77f334f-d861-42e6-9554-d43fb60443d9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:35.070499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f77f334f-d861-42e6-9554-d43fb60443d9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:35.082383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77f334f-d861-42e6-9554-d43fb60443d9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.082885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77f334f-d861-42e6-9554-d43fb60443d9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.083324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77f334f-d861-42e6-9554-d43fb60443d9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.084039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77f334f-d861-42e6-9554-d43fb60443d9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.084494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77f334f-d861-42e6-9554-d43fb60443d9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.085093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f77f334f-d861-42e6-9554-d43fb60443d9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.184294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6ef1c2c9-5d3c-4ea7-b30e-950c65629d4c req-97f4da8f-f3a8-4559-a0e3-0d6c4ec8aec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-deleted", "tag": "2a244a93-1742-44b5-9cca-49760a0090a8"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:35.196729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6ef1c2c9-5d3c-4ea7-b30e-950c65629d4c req-97f4da8f-f3a8-4559-a0e3-0d6c4ec8aec0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.198152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6ef1c2c9-5d3c-4ea7-b30e-950c65629d4c req-97f4da8f-f3a8-4559-a0e3-0d6c4ec8aec0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.199311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6ef1c2c9-5d3c-4ea7-b30e-950c65629d4c req-97f4da8f-f3a8-4559-a0e3-0d6c4ec8aec0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.216356 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6ef1c2c9-5d3c-4ea7-b30e-950c65629d4c req-97f4da8f-f3a8-4559-a0e3-0d6c4ec8aec0 service nova] Creating event network-vif-deleted:2a244a93-1742-44b5-9cca-49760a0090a8 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:13:35.222371 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6ef1c2c9-5d3c-4ea7-b30e-950c65629d4c req-97f4da8f-f3a8-4559-a0e3-0d6c4ec8aec0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043683 Sep 10 21:13:35.223544 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2686/5279] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:13:35.258047 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f77f334f-d861-42e6-9554-d43fb60443d9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1646 microversion: 2.1 time: 0.194121 Sep 10 21:13:35.273914 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2594/5280] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:35 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1646 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:35.283201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-009e717c-2180-42c1-80f4-b441efad2c45 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:35.284036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-009e717c-2180-42c1-80f4-b441efad2c45 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:35.290937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-009e717c-2180-42c1-80f4-b441efad2c45 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.292196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-009e717c-2180-42c1-80f4-b441efad2c45 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.292863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-009e717c-2180-42c1-80f4-b441efad2c45 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.293581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-009e717c-2180-42c1-80f4-b441efad2c45 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.294295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-009e717c-2180-42c1-80f4-b441efad2c45 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.294937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-009e717c-2180-42c1-80f4-b441efad2c45 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.322833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-009e717c-2180-42c1-80f4-b441efad2c45 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:13:35.413577 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-009e717c-2180-42c1-80f4-b441efad2c45 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 204 len: 0 microversion: 2.1 time: 0.134082 Sep 10 21:13:35.418502 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2687/5281] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:13:35 2022] DELETE /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:13:35.424175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-48331240-3c7c-4775-9902-600bc0d4ae7c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:35.425086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-48331240-3c7c-4775-9902-600bc0d4ae7c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:35.432178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48331240-3c7c-4775-9902-600bc0d4ae7c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.432964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48331240-3c7c-4775-9902-600bc0d4ae7c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.433606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48331240-3c7c-4775-9902-600bc0d4ae7c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.434426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48331240-3c7c-4775-9902-600bc0d4ae7c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.434883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48331240-3c7c-4775-9902-600bc0d4ae7c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.435481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-48331240-3c7c-4775-9902-600bc0d4ae7c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.504614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d08b55c2-3f5f-4680-a000-f520867d326c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:35.508189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d08b55c2-3f5f-4680-a000-f520867d326c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:35.516095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d08b55c2-3f5f-4680-a000-f520867d326c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.516930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d08b55c2-3f5f-4680-a000-f520867d326c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.517904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d08b55c2-3f5f-4680-a000-f520867d326c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.518950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d08b55c2-3f5f-4680-a000-f520867d326c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.519583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d08b55c2-3f5f-4680-a000-f520867d326c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.520327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d08b55c2-3f5f-4680-a000-f520867d326c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.581331 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d08b55c2-3f5f-4680-a000-f520867d326c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.082415 Sep 10 21:13:35.589059 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2688/5282] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:35 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:35.606871 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-48331240-3c7c-4775-9902-600bc0d4ae7c tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1652 microversion: 2.1 time: 0.185952 Sep 10 21:13:35.618008 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2595/5283] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:35 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1652 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:35.803922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:35.804684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:35.812472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.813020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.813416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:35.814157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:35.814791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:35.815493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:36.037013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:36.052191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:36.054594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:36.056168 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-51a189c6-d563-4b3f-b6a8-4d947eb1af1c tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 2710 microversion: 2.42 time: 0.257972 Sep 10 21:13:36.057412 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2689/5284] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:35 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 2710 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:36.529257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1e74e867-4a4f-4448-8f0d-b18736fb4117 req-628eca3c-7858-483b-8e5c-007978e39688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-unplugged", "status": "completed", "tag": "9769a59b-2ba7-4bea-9c47-8429bd368de3"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:36.539770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1e74e867-4a4f-4448-8f0d-b18736fb4117 req-628eca3c-7858-483b-8e5c-007978e39688 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:36.540519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1e74e867-4a4f-4448-8f0d-b18736fb4117 req-628eca3c-7858-483b-8e5c-007978e39688 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:36.541688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1e74e867-4a4f-4448-8f0d-b18736fb4117 req-628eca3c-7858-483b-8e5c-007978e39688 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:36.555009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1e74e867-4a4f-4448-8f0d-b18736fb4117 req-628eca3c-7858-483b-8e5c-007978e39688 service nova] Creating event network-vif-unplugged:9769a59b-2ba7-4bea-9c47-8429bd368de3 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:13:36.562020 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1e74e867-4a4f-4448-8f0d-b18736fb4117 req-628eca3c-7858-483b-8e5c-007978e39688 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038277 Sep 10 21:13:36.562723 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2596/5285] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:36.594875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-30279fdc-5030-4d9c-9dd5-1741df4ac5a6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:36.598103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-30279fdc-5030-4d9c-9dd5-1741df4ac5a6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:36.623236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30279fdc-5030-4d9c-9dd5-1741df4ac5a6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:36.624067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30279fdc-5030-4d9c-9dd5-1741df4ac5a6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:36.624935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30279fdc-5030-4d9c-9dd5-1741df4ac5a6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:36.626006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30279fdc-5030-4d9c-9dd5-1741df4ac5a6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:36.626672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30279fdc-5030-4d9c-9dd5-1741df4ac5a6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:36.627413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30279fdc-5030-4d9c-9dd5-1741df4ac5a6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:36.631911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8b49a242-bee3-4f25-b28e-a6d001591fa4 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:36.632722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8b49a242-bee3-4f25-b28e-a6d001591fa4 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:36.644652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b49a242-bee3-4f25-b28e-a6d001591fa4 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:36.645153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b49a242-bee3-4f25-b28e-a6d001591fa4 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:36.645602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b49a242-bee3-4f25-b28e-a6d001591fa4 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:36.646640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b49a242-bee3-4f25-b28e-a6d001591fa4 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:36.646821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b49a242-bee3-4f25-b28e-a6d001591fa4 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:36.652045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b49a242-bee3-4f25-b28e-a6d001591fa4 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:36.677179 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-30279fdc-5030-4d9c-9dd5-1741df4ac5a6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.087815 Sep 10 21:13:36.678502 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2690/5286] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:36 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:36.927740 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8b49a242-bee3-4f25-b28e-a6d001591fa4 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1652 microversion: 2.1 time: 0.299984 Sep 10 21:13:36.928950 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2597/5287] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:36 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1652 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:37.086174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:37.086887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:37.096470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:37.097261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:37.097855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:37.098821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:37.099459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:37.100076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:37.245087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5da648ae-5c77-45ce-8dd4-ba4dbfdd2349 req-dcc0279d-e327-4c3d-b4aa-c1dc5eeb96fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-deleted", "tag": "f5fb4882-1873-4d19-b174-8c22dc2b8ff7"}, {"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-deleted", "tag": "dad0bc97-94ef-450b-bb75-2b4c63e2b9eb"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:37.264071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5da648ae-5c77-45ce-8dd4-ba4dbfdd2349 req-dcc0279d-e327-4c3d-b4aa-c1dc5eeb96fb service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:37.264564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5da648ae-5c77-45ce-8dd4-ba4dbfdd2349 req-dcc0279d-e327-4c3d-b4aa-c1dc5eeb96fb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:37.265001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5da648ae-5c77-45ce-8dd4-ba4dbfdd2349 req-dcc0279d-e327-4c3d-b4aa-c1dc5eeb96fb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:37.289068 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5da648ae-5c77-45ce-8dd4-ba4dbfdd2349 req-dcc0279d-e327-4c3d-b4aa-c1dc5eeb96fb service nova] Creating event network-vif-deleted:f5fb4882-1873-4d19-b174-8c22dc2b8ff7 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:13:37.289984 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5da648ae-5c77-45ce-8dd4-ba4dbfdd2349 req-dcc0279d-e327-4c3d-b4aa-c1dc5eeb96fb service nova] Creating event network-vif-deleted:dad0bc97-94ef-450b-bb75-2b4c63e2b9eb for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:13:37.310012 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5da648ae-5c77-45ce-8dd4-ba4dbfdd2349 req-dcc0279d-e327-4c3d-b4aa-c1dc5eeb96fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069503 Sep 10 21:13:37.317046 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2598/5288] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:37.436019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:37.446034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:37.455950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:37.459482 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f9878269-317f-4fae-be81-d4224cb417a8 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 2616 microversion: 2.42 time: 0.377622 Sep 10 21:13:37.463041 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2691/5289] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:37 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 2616 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:37.697485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f176e6e7-2495-467f-895d-3e2a0a843b14 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:37.703088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f176e6e7-2495-467f-895d-3e2a0a843b14 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:37.733541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f176e6e7-2495-467f-895d-3e2a0a843b14 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:37.734419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f176e6e7-2495-467f-895d-3e2a0a843b14 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:37.735977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f176e6e7-2495-467f-895d-3e2a0a843b14 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:37.737250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f176e6e7-2495-467f-895d-3e2a0a843b14 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:37.739258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f176e6e7-2495-467f-895d-3e2a0a843b14 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:37.739945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f176e6e7-2495-467f-895d-3e2a0a843b14 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:37.798382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-24b747c5-8413-4579-8505-4e2688a0dc8f req-228895d4-d08e-4fa0-afc9-3d9e13d3cde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d23f2e-4092-45cf-883c-aca65dcf4709", "name": "network-vif-deleted", "tag": "0386f662-eeed-4f45-ab8e-6bb1c9e26901"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:37.818197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-24b747c5-8413-4579-8505-4e2688a0dc8f req-228895d4-d08e-4fa0-afc9-3d9e13d3cde8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:37.818685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-24b747c5-8413-4579-8505-4e2688a0dc8f req-228895d4-d08e-4fa0-afc9-3d9e13d3cde8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:37.821816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-24b747c5-8413-4579-8505-4e2688a0dc8f req-228895d4-d08e-4fa0-afc9-3d9e13d3cde8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:37.844882 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f176e6e7-2495-467f-895d-3e2a0a843b14 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.153384 Sep 10 21:13:37.847806 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2599/5290] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:37 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:37.854241 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-24b747c5-8413-4579-8505-4e2688a0dc8f req-228895d4-d08e-4fa0-afc9-3d9e13d3cde8 service nova] Creating event network-vif-deleted:0386f662-eeed-4f45-ab8e-6bb1c9e26901 for instance 11d23f2e-4092-45cf-883c-aca65dcf4709 on nch1-master-1 Sep 10 21:13:37.873458 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-24b747c5-8413-4579-8505-4e2688a0dc8f req-228895d4-d08e-4fa0-afc9-3d9e13d3cde8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078030 Sep 10 21:13:37.874621 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2692/5291] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:37.960514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:37.969110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:37.987013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:37.987518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:37.987966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:37.988693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:37.991343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:37.991794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:38.054141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:38.054649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:38.055101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:38.055565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lazy-loading 'fault' on Instance uuid 11d23f2e-4092-45cf-883c-aca65dcf4709 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:13:38.147205 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e24efe4a-3e2f-4066-b5ef-7ab2594b07e0 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 200 len: 1452 microversion: 2.1 time: 0.196241 Sep 10 21:13:38.148313 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2600/5292] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:37 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 1452 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:38.500309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:38.502064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:38.510567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:38.511846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:38.512549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:38.513513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:38.518853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:38.519340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:38.602758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-48cd62dc-6677-46a7-b873-8753985b73d0 req-d6a2a0f4-e133-4b7a-8022-7c7672981cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-unplugged", "status": "completed", "tag": "d889b597-182a-4d75-a4d9-b8e48cc0efb8"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:38.631453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-48cd62dc-6677-46a7-b873-8753985b73d0 req-d6a2a0f4-e133-4b7a-8022-7c7672981cea service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:38.632234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-48cd62dc-6677-46a7-b873-8753985b73d0 req-d6a2a0f4-e133-4b7a-8022-7c7672981cea service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:38.636468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-48cd62dc-6677-46a7-b873-8753985b73d0 req-d6a2a0f4-e133-4b7a-8022-7c7672981cea service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:38.645114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:38.675732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:38.677698 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-48cd62dc-6677-46a7-b873-8753985b73d0 req-d6a2a0f4-e133-4b7a-8022-7c7672981cea service nova] Creating event network-vif-unplugged:d889b597-182a-4d75-a4d9-b8e48cc0efb8 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:13:38.688634 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-48cd62dc-6677-46a7-b873-8753985b73d0 req-d6a2a0f4-e133-4b7a-8022-7c7672981cea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090331 Sep 10 21:13:38.692502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:38.697258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86fa572828244998b44eb39d9330da7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861e58c5bee84a44be5045e10b4594a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:38.698154 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2601/5293] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:38.703421 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eaef0310-873b-4f8f-8b3d-1cabf148f640 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 200 len: 1604 microversion: 2.42 time: 0.210381 Sep 10 21:13:38.722655 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2693/5294] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:38 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 1604 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:13:38.861628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3cd9648b-3b65-4cca-bae6-e5435d35488c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:38.864266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3cd9648b-3b65-4cca-bae6-e5435d35488c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:38.871807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd9648b-3b65-4cca-bae6-e5435d35488c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:38.872658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd9648b-3b65-4cca-bae6-e5435d35488c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:38.874237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd9648b-3b65-4cca-bae6-e5435d35488c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:38.875228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd9648b-3b65-4cca-bae6-e5435d35488c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:38.875768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd9648b-3b65-4cca-bae6-e5435d35488c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:38.876764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cd9648b-3b65-4cca-bae6-e5435d35488c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:38.935599 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3cd9648b-3b65-4cca-bae6-e5435d35488c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.081227 Sep 10 21:13:38.939950 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2602/5295] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:38 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:39.172999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:39.173881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 11d23f2e-4092-45cf-883c-aca65dcf4709] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:39.180641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.181216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.182305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:39.183148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.183690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.184138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:39.198607 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] HTTP exception thrown: Instance 11d23f2e-4092-45cf-883c-aca65dcf4709 could not be found. Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Request method failure captured: Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 HTTP/1.1 Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP3UzKAt4uvlrCWD5oKEXjfmdlGJmeniDLydWdvNgjmNe9xnmV3JUPkrNHxQoXp-CUySiNp_cr6mVGY593tV9HxjW-KHgj9a-QpMPCVzabEYaAGUhDS61kuLbyWQVVk3rTp6iofkzR1x3aJzPWNKILn9QCvlARZ7ikKhZGWMeKfrna0 Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 284406fb5bca447e99e96da850338927 Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestServerMultinode-2083618831 Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/284406fb5bca447e99e96da850338927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/284406fb5bca447e99e96da850338927"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_284406fb5bca447e99e96da850338927", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/284406fb5bca447e99e96da850338927"}]}] Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestServerMultinode-2083618831 Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 284406fb5bca447e99e96da850338927 Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestServerMultinode-2083618831 Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestServerMultinode-2083618831-project-admin Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a52844a1f8e142849762f7394dd0010a Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestServerMultinode-2083618831-project-admin Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 11d23f2e-4092-45cf-883c-aca65dcf4709 could not be found. Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '11d23f2e-4092-45cf-883c-aca65dcf4709'} Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d23f2e-4092-45cf-883c-aca65dcf4709 could not be found. Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d23f2e-4092-45cf-883c-aca65dcf4709 could not be found. Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:39.200300 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:39.206577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:39.206577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:39.206577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:39.206577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:13:39.206577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:13:39.206577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d23f2e-4092-45cf-883c-aca65dcf4709 could not be found. Sep 10 21:13:39.206577 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:39.206577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Returning 404 to user: Instance 11d23f2e-4092-45cf-883c-aca65dcf4709 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:13:39.206577 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1f6c7e65-5f8a-4278-a477-d1ddef8838ec tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709" status: 404 len: 111 microversion: 2.1 time: 0.032608 Sep 10 21:13:39.206577 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2694/5296] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:39 2022] GET /compute/v2.1/servers/11d23f2e-4092-45cf-883c-aca65dcf4709 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:13:39.213792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dd9eaf0b-d2b0-4f2e-abc8-caeea2f93075 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:39.214501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dd9eaf0b-d2b0-4f2e-abc8-caeea2f93075 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:39.222693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9eaf0b-d2b0-4f2e-abc8-caeea2f93075 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.223183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9eaf0b-d2b0-4f2e-abc8-caeea2f93075 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.223624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9eaf0b-d2b0-4f2e-abc8-caeea2f93075 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:39.224328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9eaf0b-d2b0-4f2e-abc8-caeea2f93075 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.224790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9eaf0b-d2b0-4f2e-abc8-caeea2f93075 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.225216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd9eaf0b-d2b0-4f2e-abc8-caeea2f93075 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:39.259479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dd9eaf0b-d2b0-4f2e-abc8-caeea2f93075 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:13:39.363709 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dd9eaf0b-d2b0-4f2e-abc8-caeea2f93075 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 204 len: 0 microversion: 2.1 time: 0.154466 Sep 10 21:13:39.364562 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2603/5297] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:13:39 2022] DELETE /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:13:39.369682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4bc05db7-2e16-43f9-81e6-7bd7639b483c req-e991305c-acd0-49e4-b667-898bab4c630c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-deleted", "tag": "d889b597-182a-4d75-a4d9-b8e48cc0efb8"}, {"server_uuid": "4533574a-7cba-4173-b441-ef75ab76969c", "name": "network-vif-deleted", "tag": "9769a59b-2ba7-4bea-9c47-8429bd368de3"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:39.376164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b5a911fb-6120-460e-b38a-c3b7ffee38ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:39.376878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b5a911fb-6120-460e-b38a-c3b7ffee38ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:39.384733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5a911fb-6120-460e-b38a-c3b7ffee38ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.385668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5a911fb-6120-460e-b38a-c3b7ffee38ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.386462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4bc05db7-2e16-43f9-81e6-7bd7639b483c req-e991305c-acd0-49e4-b667-898bab4c630c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.386929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5a911fb-6120-460e-b38a-c3b7ffee38ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:39.387467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4bc05db7-2e16-43f9-81e6-7bd7639b483c req-e991305c-acd0-49e4-b667-898bab4c630c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.387678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5a911fb-6120-460e-b38a-c3b7ffee38ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.388231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4bc05db7-2e16-43f9-81e6-7bd7639b483c req-e991305c-acd0-49e4-b667-898bab4c630c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:39.388553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5a911fb-6120-460e-b38a-c3b7ffee38ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.389169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b5a911fb-6120-460e-b38a-c3b7ffee38ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:39.410542 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4bc05db7-2e16-43f9-81e6-7bd7639b483c req-e991305c-acd0-49e4-b667-898bab4c630c service nova] Creating event network-vif-deleted:d889b597-182a-4d75-a4d9-b8e48cc0efb8 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:13:39.411072 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4bc05db7-2e16-43f9-81e6-7bd7639b483c req-e991305c-acd0-49e4-b667-898bab4c630c service nova] Creating event network-vif-deleted:9769a59b-2ba7-4bea-9c47-8429bd368de3 for instance 4533574a-7cba-4173-b441-ef75ab76969c on nch2-master-1 Sep 10 21:13:39.421052 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4bc05db7-2e16-43f9-81e6-7bd7639b483c req-e991305c-acd0-49e4-b667-898bab4c630c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058457 Sep 10 21:13:39.422204 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2695/5298] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:39.549507 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b5a911fb-6120-460e-b38a-c3b7ffee38ee tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1654 microversion: 2.1 time: 0.180189 Sep 10 21:13:39.550366 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2604/5299] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:39 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1654 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:39.737302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:39.738192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:39.744954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.745575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.746095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:39.746923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.747392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.748155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:39.763548 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] HTTP exception thrown: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Request method failure captured: Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c HTTP/1.1 Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPynaXrdQ9mL_AV09WZ0N9alt692W9XANr-6hjp19AEP07IvHDs1sayQmexoBznmZ6AnTvKYQ7mes4sNSBQUCyPBtXzl9PUZ2x4QCdIGHBpIipOmzcJpe51B8DFCoCEi3IY0DBgNPamVCaeLC5SMHcn3AbXyspi0A8cCrlz4NF6loYQ Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.42 Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 861e58c5bee84a44be5045e10b4594a1 Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1990060725 Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/861e58c5bee84a44be5045e10b4594a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/861e58c5bee84a44be5045e10b4594a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_861e58c5bee84a44be5045e10b4594a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/861e58c5bee84a44be5045e10b4594a1"}]}] Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1990060725 Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 861e58c5bee84a44be5045e10b4594a1 Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1990060725 Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TaggedBootDevicesTest_v242-1990060725-project Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 86fa572828244998b44eb39d9330da7e Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1990060725-project Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '4533574a-7cba-4173-b441-ef75ab76969c'} Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:39.765090 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Returning 404 to user: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3aa57c4a-c055-4f8b-aa53-d190897af2bd tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 404 len: 111 microversion: 2.42 time: 0.034350 Sep 10 21:13:39.774315 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2696/5300] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:39 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:13:39.776053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-623e7491-f3e3-443f-9edf-06ac0c464967 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '.version_select at 0x7f99461e4550>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:39.796634 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-623e7491-f3e3-443f-9edf-06ac0c464967 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-946532115" status: 204 len: 0 microversion: 2.42 time: 0.024974 Sep 10 21:13:39.797320 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2605/5301] 10.222.0.33 () {60 vars in 1259 bytes} [Sat Sep 10 21:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-946532115 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 21:13:39.948596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e8522089-ab6b-49d5-bede-f8c482572440 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:39.952556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e8522089-ab6b-49d5-bede-f8c482572440 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:39.960516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8522089-ab6b-49d5-bede-f8c482572440 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.961294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8522089-ab6b-49d5-bede-f8c482572440 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.962265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8522089-ab6b-49d5-bede-f8c482572440 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:39.964615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8522089-ab6b-49d5-bede-f8c482572440 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:39.965328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8522089-ab6b-49d5-bede-f8c482572440 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:39.967193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8522089-ab6b-49d5-bede-f8c482572440 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:40.543952 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e8522089-ab6b-49d5-bede-f8c482572440 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.601156 Sep 10 21:13:40.547622 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2697/5302] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:39 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:40.578100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d1adb3f4-da63-4336-8cae-d35691c13fff tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:40.578722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d1adb3f4-da63-4336-8cae-d35691c13fff tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:40.586560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1adb3f4-da63-4336-8cae-d35691c13fff tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:40.587408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1adb3f4-da63-4336-8cae-d35691c13fff tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:40.588898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1adb3f4-da63-4336-8cae-d35691c13fff tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:40.589970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1adb3f4-da63-4336-8cae-d35691c13fff tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:40.590623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1adb3f4-da63-4336-8cae-d35691c13fff tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:40.591063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1adb3f4-da63-4336-8cae-d35691c13fff tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:40.745893 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d1adb3f4-da63-4336-8cae-d35691c13fff tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1654 microversion: 2.1 time: 0.173016 Sep 10 21:13:40.747359 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2606/5303] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:40 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1654 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:41.482963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-33785150-0c22-4a1c-8f6e-2b6a999b4a0e req-930473da-2d25-419c-b582-2aa1a8db6127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32087cf6-ff25-4837-941c-f2b677d84dab", "name": "network-vif-deleted", "tag": "f1cf1a26-92dd-4862-82b4-acd7848706ea"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:41.538764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33785150-0c22-4a1c-8f6e-2b6a999b4a0e req-930473da-2d25-419c-b582-2aa1a8db6127 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:41.541556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33785150-0c22-4a1c-8f6e-2b6a999b4a0e req-930473da-2d25-419c-b582-2aa1a8db6127 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:41.542875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33785150-0c22-4a1c-8f6e-2b6a999b4a0e req-930473da-2d25-419c-b582-2aa1a8db6127 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:41.556269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5994f75c-a843-4f97-a8fc-420c8c0713ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:41.560391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5994f75c-a843-4f97-a8fc-420c8c0713ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:41.563980 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-33785150-0c22-4a1c-8f6e-2b6a999b4a0e req-930473da-2d25-419c-b582-2aa1a8db6127 service nova] Creating event network-vif-deleted:f1cf1a26-92dd-4862-82b4-acd7848706ea for instance 32087cf6-ff25-4837-941c-f2b677d84dab on nch2-master-1 Sep 10 21:13:41.566534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:41.568132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5994f75c-a843-4f97-a8fc-420c8c0713ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:41.568635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5994f75c-a843-4f97-a8fc-420c8c0713ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:41.569081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5994f75c-a843-4f97-a8fc-420c8c0713ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:41.570015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5994f75c-a843-4f97-a8fc-420c8c0713ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:41.570712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5994f75c-a843-4f97-a8fc-420c8c0713ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:41.571447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5994f75c-a843-4f97-a8fc-420c8c0713ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:41.579173 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-33785150-0c22-4a1c-8f6e-2b6a999b4a0e req-930473da-2d25-419c-b582-2aa1a8db6127 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110839 Sep 10 21:13:41.579804 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2698/5304] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:41.625468 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5994f75c-a843-4f97-a8fc-420c8c0713ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.073471 Sep 10 21:13:41.626834 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2607/5305] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:41 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:41.775114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:41.778713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:41.793147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:41.793655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:41.794180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:41.795015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:41.795368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:41.795765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:41.860260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:41.860752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:41.861191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:41.861733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lazy-loading 'fault' on Instance uuid 32087cf6-ff25-4837-941c-f2b677d84dab {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:13:41.990275 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f947c87e-cc43-4831-b81f-d6645357abc9 tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 200 len: 1454 microversion: 2.1 time: 0.220851 Sep 10 21:13:41.991380 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2699/5306] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:41 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 1454 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:42.639922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c2156da5-3041-41da-a65d-e3856571970a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:42.650015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c2156da5-3041-41da-a65d-e3856571970a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:42.670368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2156da5-3041-41da-a65d-e3856571970a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:42.671578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2156da5-3041-41da-a65d-e3856571970a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:42.673514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2156da5-3041-41da-a65d-e3856571970a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:42.675087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2156da5-3041-41da-a65d-e3856571970a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:42.675727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2156da5-3041-41da-a65d-e3856571970a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:42.680582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c2156da5-3041-41da-a65d-e3856571970a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:42.761282 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c2156da5-3041-41da-a65d-e3856571970a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.127155 Sep 10 21:13:42.764455 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2608/5307] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:42 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:43.019930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:43.020557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] [instance: 32087cf6-ff25-4837-941c-f2b677d84dab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:43.034943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:43.035449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:43.035899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:43.036621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:43.037086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:43.037522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:43.053529 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] HTTP exception thrown: Instance 32087cf6-ff25-4837-941c-f2b677d84dab could not be found. Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Request method failure captured: Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab HTTP/1.1 Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP3UzKAt4uvlrCWD5oKEXjfmdlGJmeniDLydWdvNgjmNe9xnmV3JUPkrNHxQoXp-CUySiNp_cr6mVGY593tV9HxjW-KHgj9a-QpMPCVzabEYaAGUhDS61kuLbyWQVVk3rTp6iofkzR1x3aJzPWNKILn9QCvlARZ7ikKhZGWMeKfrna0 Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 284406fb5bca447e99e96da850338927 Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestServerMultinode-2083618831 Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/284406fb5bca447e99e96da850338927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/284406fb5bca447e99e96da850338927"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_284406fb5bca447e99e96da850338927", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/284406fb5bca447e99e96da850338927"}]}] Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestServerMultinode-2083618831 Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 284406fb5bca447e99e96da850338927 Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestServerMultinode-2083618831 Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestServerMultinode-2083618831-project-admin Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a52844a1f8e142849762f7394dd0010a Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestServerMultinode-2083618831-project-admin Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 32087cf6-ff25-4837-941c-f2b677d84dab could not be found. Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '32087cf6-ff25-4837-941c-f2b677d84dab'} Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32087cf6-ff25-4837-941c-f2b677d84dab could not be found. Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32087cf6-ff25-4837-941c-f2b677d84dab could not be found. Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:43.055254 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.061391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:43.061391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:43.061391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:43.061391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:13:43.061391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:13:43.061391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32087cf6-ff25-4837-941c-f2b677d84dab could not be found. Sep 10 21:13:43.061391 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.061391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] Returning 404 to user: Instance 32087cf6-ff25-4837-941c-f2b677d84dab could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:13:43.061391 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e732c28-f72d-479b-8391-e22c82cdc45a tempest-TestServerMultinode-2083618831 tempest-TestServerMultinode-2083618831-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab" status: 404 len: 111 microversion: 2.1 time: 0.042979 Sep 10 21:13:43.061391 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2700/5308] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:43 2022] GET /compute/v2.1/servers/32087cf6-ff25-4837-941c-f2b677d84dab => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:13:43.544095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:43.544804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:43.571130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:43.572750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:43.573625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:43.574565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:43.575193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:43.575787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:43.609074 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] HTTP exception thrown: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Request method failure captured: Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c HTTP/1.1 Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPynaXrdQ9mL_AV09WZ0N9alt692W9XANr-6hjp19AEP07IvHDs1sayQmexoBznmZ6AnTvKYQ7mes4sNSBQUCyPBtXzl9PUZ2x4QCdIGHBpIipOmzcJpe51B8DFCoCEi3IY0DBgNPamVCaeLC5SMHcn3AbXyspi0A8cCrlz4NF6loYQ Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.42 Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 861e58c5bee84a44be5045e10b4594a1 Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1990060725 Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/861e58c5bee84a44be5045e10b4594a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/861e58c5bee84a44be5045e10b4594a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_861e58c5bee84a44be5045e10b4594a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/861e58c5bee84a44be5045e10b4594a1"}]}] Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1990060725 Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 861e58c5bee84a44be5045e10b4594a1 Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1990060725 Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TaggedBootDevicesTest_v242-1990060725-project Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 86fa572828244998b44eb39d9330da7e Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1990060725-project Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '4533574a-7cba-4173-b441-ef75ab76969c'} Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:13:43.610833 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Returning 404 to user: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-17d47ccb-1711-42e4-846a-c618c8298780 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 404 len: 111 microversion: 2.42 time: 0.079296 Sep 10 21:13:43.616705 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2609/5309] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:13:43 2022] DELETE /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:13:43.623348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:43.624613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] [instance: 4533574a-7cba-4173-b441-ef75ab76969c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:43.633105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:43.633659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:43.634140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:43.635417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:43.635884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:43.636522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:43.654633 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] HTTP exception thrown: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Request method failure captured: Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c HTTP/1.1 Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHPynaXrdQ9mL_AV09WZ0N9alt692W9XANr-6hjp19AEP07IvHDs1sayQmexoBznmZ6AnTvKYQ7mes4sNSBQUCyPBtXzl9PUZ2x4QCdIGHBpIipOmzcJpe51B8DFCoCEi3IY0DBgNPamVCaeLC5SMHcn3AbXyspi0A8cCrlz4NF6loYQ Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.42 Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 861e58c5bee84a44be5045e10b4594a1 Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1990060725 Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/861e58c5bee84a44be5045e10b4594a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/861e58c5bee84a44be5045e10b4594a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_861e58c5bee84a44be5045e10b4594a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/861e58c5bee84a44be5045e10b4594a1"}]}] Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1990060725 Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 861e58c5bee84a44be5045e10b4594a1 Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1990060725 Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TaggedBootDevicesTest_v242-1990060725-project Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 86fa572828244998b44eb39d9330da7e Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1990060725-project Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '4533574a-7cba-4173-b441-ef75ab76969c'} Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.656209 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] Returning 404 to user: Instance 4533574a-7cba-4173-b441-ef75ab76969c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9fc856e7-bb5a-4529-8735-3d0d44f679a1 tempest-TaggedBootDevicesTest_v242-1990060725 tempest-TaggedBootDevicesTest_v242-1990060725-project] 10.222.0.33 "GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c" status: 404 len: 111 microversion: 2.42 time: 0.040597 Sep 10 21:13:43.661038 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2701/5310] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:13:43 2022] GET /compute/v2.1/servers/4533574a-7cba-4173-b441-ef75ab76969c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:13:43.776830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7fdc5721-6113-4de7-ac48-069094f4da75 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:43.780489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7fdc5721-6113-4de7-ac48-069094f4da75 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:43.798306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fdc5721-6113-4de7-ac48-069094f4da75 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:43.799311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fdc5721-6113-4de7-ac48-069094f4da75 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:43.799311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fdc5721-6113-4de7-ac48-069094f4da75 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:43.800032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fdc5721-6113-4de7-ac48-069094f4da75 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:43.800374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fdc5721-6113-4de7-ac48-069094f4da75 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:43.800797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fdc5721-6113-4de7-ac48-069094f4da75 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:43.862839 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7fdc5721-6113-4de7-ac48-069094f4da75 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.089926 Sep 10 21:13:43.867201 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2610/5311] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:43 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:44.875818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-adb6120b-9158-4b63-a6ee-3d6e03b4f4ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:44.878363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-adb6120b-9158-4b63-a6ee-3d6e03b4f4ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:44.887231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb6120b-9158-4b63-a6ee-3d6e03b4f4ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:44.887662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb6120b-9158-4b63-a6ee-3d6e03b4f4ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:44.888292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb6120b-9158-4b63-a6ee-3d6e03b4f4ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:44.889176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb6120b-9158-4b63-a6ee-3d6e03b4f4ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:44.889908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb6120b-9158-4b63-a6ee-3d6e03b4f4ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:44.890296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adb6120b-9158-4b63-a6ee-3d6e03b4f4ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:44.938218 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-adb6120b-9158-4b63-a6ee-3d6e03b4f4ef tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.066618 Sep 10 21:13:44.939181 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2702/5312] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:44 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:45.952565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eaaa290b-8561-418a-925b-31bec834bff9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:45.955191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eaaa290b-8561-418a-925b-31bec834bff9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:45.982058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaaa290b-8561-418a-925b-31bec834bff9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:45.982684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaaa290b-8561-418a-925b-31bec834bff9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:45.985196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaaa290b-8561-418a-925b-31bec834bff9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:45.985196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaaa290b-8561-418a-925b-31bec834bff9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:45.985196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaaa290b-8561-418a-925b-31bec834bff9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:45.985196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaaa290b-8561-418a-925b-31bec834bff9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:46.038040 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eaaa290b-8561-418a-925b-31bec834bff9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 14 microversion: 2.1 time: 0.090711 Sep 10 21:13:46.038491 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2611/5313] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:45 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:13:47.056820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b72e8073-27eb-4ca7-858e-8e4de3ec5e27 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:47.062109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b72e8073-27eb-4ca7-858e-8e4de3ec5e27 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:47.075957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b72e8073-27eb-4ca7-858e-8e4de3ec5e27 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:47.076765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b72e8073-27eb-4ca7-858e-8e4de3ec5e27 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:47.078302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b72e8073-27eb-4ca7-858e-8e4de3ec5e27 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:47.079281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b72e8073-27eb-4ca7-858e-8e4de3ec5e27 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:47.080038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b72e8073-27eb-4ca7-858e-8e4de3ec5e27 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:47.080686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b72e8073-27eb-4ca7-858e-8e4de3ec5e27 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:47.153009 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b72e8073-27eb-4ca7-858e-8e4de3ec5e27 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action" status: 200 len: 8207 microversion: 2.1 time: 0.105994 Sep 10 21:13:47.158612 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2703/5314] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:47 2022] POST /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa/action => generated 8207 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:47.166630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bc52ffb3-1c62-4195-a98a-a05e2874422b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:47.169082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bc52ffb3-1c62-4195-a98a-a05e2874422b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:47.186746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc52ffb3-1c62-4195-a98a-a05e2874422b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:47.187826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc52ffb3-1c62-4195-a98a-a05e2874422b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:47.188515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc52ffb3-1c62-4195-a98a-a05e2874422b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:47.201021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc52ffb3-1c62-4195-a98a-a05e2874422b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:47.201666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc52ffb3-1c62-4195-a98a-a05e2874422b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:47.205370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc52ffb3-1c62-4195-a98a-a05e2874422b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:47.419618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc52ffb3-1c62-4195-a98a-a05e2874422b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:47.428131 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bc52ffb3-1c62-4195-a98a-a05e2874422b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.266518 Sep 10 21:13:47.434642 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2612/5315] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:47 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:47.457756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c4d8c66-3efb-4e53-be24-89e464133355 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:47.458603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c4d8c66-3efb-4e53-be24-89e464133355 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:47.470606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c66-3efb-4e53-be24-89e464133355 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:47.471488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c66-3efb-4e53-be24-89e464133355 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:47.472478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c66-3efb-4e53-be24-89e464133355 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:47.473493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c66-3efb-4e53-be24-89e464133355 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:47.474469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c66-3efb-4e53-be24-89e464133355 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:47.475649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c66-3efb-4e53-be24-89e464133355 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:47.747704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c4d8c66-3efb-4e53-be24-89e464133355 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:47.758417 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c4d8c66-3efb-4e53-be24-89e464133355 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.305378 Sep 10 21:13:47.760437 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2704/5316] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:47 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:47.784167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d08d2330-65b7-43e4-b9c6-4b2cd7a3d453 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:47.785240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d08d2330-65b7-43e4-b9c6-4b2cd7a3d453 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:47.793323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d08d2330-65b7-43e4-b9c6-4b2cd7a3d453 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:47.794129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d08d2330-65b7-43e4-b9c6-4b2cd7a3d453 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:47.794756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d08d2330-65b7-43e4-b9c6-4b2cd7a3d453 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:47.795868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d08d2330-65b7-43e4-b9c6-4b2cd7a3d453 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:47.796524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d08d2330-65b7-43e4-b9c6-4b2cd7a3d453 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:47.797135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d08d2330-65b7-43e4-b9c6-4b2cd7a3d453 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.155832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d08d2330-65b7-43e4-b9c6-4b2cd7a3d453 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:48.164546 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d08d2330-65b7-43e4-b9c6-4b2cd7a3d453 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.384030 Sep 10 21:13:48.173393 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2613/5317] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:47 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:48.188071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4707e05f-c686-47b2-a524-3be6bcb6d070 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:48.189753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4707e05f-c686-47b2-a524-3be6bcb6d070 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:48.199024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4707e05f-c686-47b2-a524-3be6bcb6d070 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:48.199819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4707e05f-c686-47b2-a524-3be6bcb6d070 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:48.200506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4707e05f-c686-47b2-a524-3be6bcb6d070 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.201437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4707e05f-c686-47b2-a524-3be6bcb6d070 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:48.202203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4707e05f-c686-47b2-a524-3be6bcb6d070 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:48.202704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4707e05f-c686-47b2-a524-3be6bcb6d070 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.223088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:48.349569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4707e05f-c686-47b2-a524-3be6bcb6d070 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:48.358812 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4707e05f-c686-47b2-a524-3be6bcb6d070 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.174607 Sep 10 21:13:48.359406 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2705/5318] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:48 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:48.381936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0823d843-b475-4227-bfa8-006045be4123 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:48.382352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0823d843-b475-4227-bfa8-006045be4123 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:48.389367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0823d843-b475-4227-bfa8-006045be4123 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:48.389988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0823d843-b475-4227-bfa8-006045be4123 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:48.390425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0823d843-b475-4227-bfa8-006045be4123 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.391300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0823d843-b475-4227-bfa8-006045be4123 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:48.391766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0823d843-b475-4227-bfa8-006045be4123 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:48.392388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0823d843-b475-4227-bfa8-006045be4123 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.440991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0823d843-b475-4227-bfa8-006045be4123 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Locking {{(pid=145771) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 10 21:13:48.498882 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0823d843-b475-4227-bfa8-006045be4123 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.121602 Sep 10 21:13:48.502443 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2614/5319] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:48 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:13:48.507767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8177c91f-8214-447a-a787-08c23d9b3542 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:48.508827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8177c91f-8214-447a-a787-08c23d9b3542 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:48.515089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8177c91f-8214-447a-a787-08c23d9b3542 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:48.515582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8177c91f-8214-447a-a787-08c23d9b3542 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:48.516026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8177c91f-8214-447a-a787-08c23d9b3542 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.516732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8177c91f-8214-447a-a787-08c23d9b3542 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:48.517193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8177c91f-8214-447a-a787-08c23d9b3542 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:48.517629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8177c91f-8214-447a-a787-08c23d9b3542 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.655422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8177c91f-8214-447a-a787-08c23d9b3542 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:48.664357 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8177c91f-8214-447a-a787-08c23d9b3542 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.159785 Sep 10 21:13:48.664971 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2706/5320] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:48 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:48.688813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bab78dfb-6b9b-48ad-a593-756c55b9c795 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:48.696296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bab78dfb-6b9b-48ad-a593-756c55b9c795 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:48.696788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bab78dfb-6b9b-48ad-a593-756c55b9c795 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:48.698504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bab78dfb-6b9b-48ad-a593-756c55b9c795 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.727039 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-bab78dfb-6b9b-48ad-a593-756c55b9c795 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] HTTP exception thrown: Instance 010766a5-73d4-43bc-8b9b-915530aac069 is locked Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bab78dfb-6b9b-48ad-a593-756c55b9c795 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Request method failure captured: Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action HTTP/1.1 Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 15 Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP07LJkT0eqhQbcFK2cLpNXQ6K9cp7_Q7ooRPesMYBGiV5ZAWO0tgg0u9XsKAq-Lh655UeWg-VZnfaFjahgGEBoRwA9fWm4uBZBqkVn0zU5bMwf9wPV6zvYKIPMqvVJpU8RzpBN-qlcYr-8aj3HqcZ6QolRcIasDDFEHk_My4lrKqj8 Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_15a76a25754c42099c542fa13046f01b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/15a76a25754c42099c542fa13046f01b"}]}] Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d83b6ceb599746b394e379d52683b70c Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: {"os-stop": {}} Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 010766a5-73d4-43bc-8b9b-915530aac069 is locked Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '010766a5-73d4-43bc-8b9b-915530aac069', 'body': {'os-stop': {}}} Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 010766a5-73d4-43bc-8b9b-915530aac069 is locked Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 010766a5-73d4-43bc-8b9b-915530aac069 is locked Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010766a5-73d4-43bc-8b9b-915530aac069 is locked Sep 10 21:13:48.729581 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:13:48.737237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bab78dfb-6b9b-48ad-a593-756c55b9c795 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Returning 409 to user: Instance 010766a5-73d4-43bc-8b9b-915530aac069 is locked {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:13:48.737237 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bab78dfb-6b9b-48ad-a593-756c55b9c795 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 409 len: 107 microversion: 2.1 time: 0.046555 Sep 10 21:13:48.739994 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2615/5321] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:48 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 107 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 21:13:48.757648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d0e661d7-734c-4c38-aea6-4587eee8f218 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:48.758326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d0e661d7-734c-4c38-aea6-4587eee8f218 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:48.778612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0e661d7-734c-4c38-aea6-4587eee8f218 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:48.779137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0e661d7-734c-4c38-aea6-4587eee8f218 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:48.779592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0e661d7-734c-4c38-aea6-4587eee8f218 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.780317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0e661d7-734c-4c38-aea6-4587eee8f218 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:48.781205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0e661d7-734c-4c38-aea6-4587eee8f218 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:48.783383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d0e661d7-734c-4c38-aea6-4587eee8f218 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.832345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d0e661d7-734c-4c38-aea6-4587eee8f218 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Unlocking {{(pid=145772) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 10 21:13:48.896245 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d0e661d7-734c-4c38-aea6-4587eee8f218 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.143225 Sep 10 21:13:48.897516 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2707/5322] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:48 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:13:48.907065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ab632cd-da71-4161-a5d4-69642534975f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:48.913186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ab632cd-da71-4161-a5d4-69642534975f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:48.914151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ab632cd-da71-4161-a5d4-69642534975f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:48.914858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ab632cd-da71-4161-a5d4-69642534975f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:48.945078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ab632cd-da71-4161-a5d4-69642534975f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Going to try to stop instance {{(pid=145771) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 21:13:48.993596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:49.003019 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ab632cd-da71-4161-a5d4-69642534975f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.101072 Sep 10 21:13:49.003922 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2616/5323] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:13:48 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:13:49.013245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2506b7c1-1d5e-47f0-8d31-988e3452e203 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:49.014617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2506b7c1-1d5e-47f0-8d31-988e3452e203 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:49.023627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2506b7c1-1d5e-47f0-8d31-988e3452e203 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:49.024290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2506b7c1-1d5e-47f0-8d31-988e3452e203 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:49.034389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2506b7c1-1d5e-47f0-8d31-988e3452e203 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:49.036230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2506b7c1-1d5e-47f0-8d31-988e3452e203 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:49.037156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2506b7c1-1d5e-47f0-8d31-988e3452e203 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:49.037910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2506b7c1-1d5e-47f0-8d31-988e3452e203 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:49.230910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2506b7c1-1d5e-47f0-8d31-988e3452e203 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:49.241480 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2506b7c1-1d5e-47f0-8d31-988e3452e203 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.232782 Sep 10 21:13:49.242238 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2708/5324] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:49 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:50.268276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9640cc9-cc5f-4d6f-aa45-7dbaca593155 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:50.269448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9640cc9-cc5f-4d6f-aa45-7dbaca593155 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:50.276653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9640cc9-cc5f-4d6f-aa45-7dbaca593155 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:50.277241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9640cc9-cc5f-4d6f-aa45-7dbaca593155 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:50.277756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9640cc9-cc5f-4d6f-aa45-7dbaca593155 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:50.278630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9640cc9-cc5f-4d6f-aa45-7dbaca593155 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:50.279818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9640cc9-cc5f-4d6f-aa45-7dbaca593155 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:50.280345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9640cc9-cc5f-4d6f-aa45-7dbaca593155 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:50.654920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a9640cc9-cc5f-4d6f-aa45-7dbaca593155 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:50.662743 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9640cc9-cc5f-4d6f-aa45-7dbaca593155 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.401566 Sep 10 21:13:50.663333 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2617/5325] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:50 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:51.687831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-48a76483-df72-4e92-bde3-c49d08c13d95 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:51.688647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-48a76483-df72-4e92-bde3-c49d08c13d95 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:51.701979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48a76483-df72-4e92-bde3-c49d08c13d95 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:51.702552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48a76483-df72-4e92-bde3-c49d08c13d95 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:51.703014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48a76483-df72-4e92-bde3-c49d08c13d95 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:51.707973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48a76483-df72-4e92-bde3-c49d08c13d95 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:51.708669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48a76483-df72-4e92-bde3-c49d08c13d95 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:51.709131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48a76483-df72-4e92-bde3-c49d08c13d95 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:51.820776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8944d825-5eea-4b67-8c97-ddc3814298ce tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:51.821324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8944d825-5eea-4b67-8c97-ddc3814298ce tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:51.829867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8944d825-5eea-4b67-8c97-ddc3814298ce tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:51.830441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8944d825-5eea-4b67-8c97-ddc3814298ce tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:51.830884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8944d825-5eea-4b67-8c97-ddc3814298ce tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:51.831600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8944d825-5eea-4b67-8c97-ddc3814298ce tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:51.832060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8944d825-5eea-4b67-8c97-ddc3814298ce tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:51.832490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8944d825-5eea-4b67-8c97-ddc3814298ce tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:51.865687 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8944d825-5eea-4b67-8c97-ddc3814298ce tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/ips" status: 200 len: 149 microversion: 2.1 time: 0.049541 Sep 10 21:13:51.867021 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2618/5326] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:13:51 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:13:52.068582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-48a76483-df72-4e92-bde3-c49d08c13d95 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:52.085522 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-48a76483-df72-4e92-bde3-c49d08c13d95 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.400316 Sep 10 21:13:52.097007 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2709/5327] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:51 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:53.132412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8ce0014e-937f-4432-aaa3-be710efe005e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:53.133234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8ce0014e-937f-4432-aaa3-be710efe005e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:53.146101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ce0014e-937f-4432-aaa3-be710efe005e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:53.146763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ce0014e-937f-4432-aaa3-be710efe005e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:53.147223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ce0014e-937f-4432-aaa3-be710efe005e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:53.148387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ce0014e-937f-4432-aaa3-be710efe005e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:53.148867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ce0014e-937f-4432-aaa3-be710efe005e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:53.149306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ce0014e-937f-4432-aaa3-be710efe005e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:53.339610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a73c3461-71b4-4d30-9461-5fa7098e8f82 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:53.342433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a73c3461-71b4-4d30-9461-5fa7098e8f82 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:53.364358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a73c3461-71b4-4d30-9461-5fa7098e8f82 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:53.365486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a73c3461-71b4-4d30-9461-5fa7098e8f82 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:53.366464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a73c3461-71b4-4d30-9461-5fa7098e8f82 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:53.367664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a73c3461-71b4-4d30-9461-5fa7098e8f82 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:53.368915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a73c3461-71b4-4d30-9461-5fa7098e8f82 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:53.369871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a73c3461-71b4-4d30-9461-5fa7098e8f82 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:53.843375 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a73c3461-71b4-4d30-9461-5fa7098e8f82 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.509182 Sep 10 21:13:53.865257 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2710/5328] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:13:53 2022] POST /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:13:53.935646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8ce0014e-937f-4432-aaa3-be710efe005e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:53.949120 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8ce0014e-937f-4432-aaa3-be710efe005e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.832165 Sep 10 21:13:53.949706 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2619/5329] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:53 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:54.984071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-41c1b24e-8467-495e-9873-0aedcbe23387 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:54.985139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-41c1b24e-8467-495e-9873-0aedcbe23387 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:54.996133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41c1b24e-8467-495e-9873-0aedcbe23387 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:54.996781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41c1b24e-8467-495e-9873-0aedcbe23387 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:54.997306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41c1b24e-8467-495e-9873-0aedcbe23387 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:54.998770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41c1b24e-8467-495e-9873-0aedcbe23387 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:55.000545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41c1b24e-8467-495e-9873-0aedcbe23387 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:55.002289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41c1b24e-8467-495e-9873-0aedcbe23387 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:55.340393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-41c1b24e-8467-495e-9873-0aedcbe23387 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:55.348322 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-41c1b24e-8467-495e-9873-0aedcbe23387 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.375591 Sep 10 21:13:55.349483 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2711/5330] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:54 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:56.376289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fe36278a-fab4-4a75-9e7e-1a8290314b10 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:56.378025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fe36278a-fab4-4a75-9e7e-1a8290314b10 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:56.389209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe36278a-fab4-4a75-9e7e-1a8290314b10 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:56.391076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe36278a-fab4-4a75-9e7e-1a8290314b10 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:56.396068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe36278a-fab4-4a75-9e7e-1a8290314b10 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:56.398150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe36278a-fab4-4a75-9e7e-1a8290314b10 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:56.398890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe36278a-fab4-4a75-9e7e-1a8290314b10 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:56.399539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fe36278a-fab4-4a75-9e7e-1a8290314b10 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:56.589913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fe36278a-fab4-4a75-9e7e-1a8290314b10 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:56.601081 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fe36278a-fab4-4a75-9e7e-1a8290314b10 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.226432 Sep 10 21:13:56.601707 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2620/5331] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:56 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:57.333164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:13:57.336136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:57.347222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:57.347757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:57.348166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:57.349655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:57.350287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:57.350730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:57.474385 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Invalid volume: volume 2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6 is already attached to instances: e983600b-2110-437c-a0db-fb0d9c8fe55c Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments HTTP/1.1 Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 74 Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: {"volumeAttachment": {"volumeId": "2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6"}} Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid volume: volume 2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6 is already attached to instances: e983600b-2110-437c-a0db-fb0d9c8fe55c Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'server_id': 'e983600b-2110-437c-a0db-fb0d9c8fe55c', 'body': {'volumeAttachment': {'volumeId': '2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6'}}} Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6 is already attached to instances: e983600b-2110-437c-a0db-fb0d9c8fe55c Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:13:57.477426 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6 is already attached to instances: e983600b-2110-437c-a0db-fb0d9c8fe55c Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6 is already attached to instances: e983600b-2110-437c-a0db-fb0d9c8fe55c Sep 10 21:13:57.481299 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:13:57.485187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 400 to user: Invalid volume: volume 2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6 is already attached to instances: e983600b-2110-437c-a0db-fb0d9c8fe55c {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:13:57.486728 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c2237ac3-1908-445f-ab34-9972dc1f12d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.158762 Sep 10 21:13:57.487872 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2712/5332] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:13:57 2022] POST /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments => generated 174 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:13:57.575585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f54d790-00e6-4ef4-928a-3059211f2496 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:57.576934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2f54d790-00e6-4ef4-928a-3059211f2496 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:57.585946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f54d790-00e6-4ef4-928a-3059211f2496 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:57.586981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f54d790-00e6-4ef4-928a-3059211f2496 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:57.587741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f54d790-00e6-4ef4-928a-3059211f2496 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:57.588814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f54d790-00e6-4ef4-928a-3059211f2496 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:57.589498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f54d790-00e6-4ef4-928a-3059211f2496 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:57.590190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2f54d790-00e6-4ef4-928a-3059211f2496 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:57.626574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4cfe427b-8106-4bcb-8154-128dbf682a62 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:57.627480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4cfe427b-8106-4bcb-8154-128dbf682a62 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:57.639702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cfe427b-8106-4bcb-8154-128dbf682a62 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:57.642477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cfe427b-8106-4bcb-8154-128dbf682a62 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:57.642928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cfe427b-8106-4bcb-8154-128dbf682a62 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:57.643653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cfe427b-8106-4bcb-8154-128dbf682a62 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:57.644113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cfe427b-8106-4bcb-8154-128dbf682a62 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:57.644546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cfe427b-8106-4bcb-8154-128dbf682a62 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:57.713631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-2f54d790-00e6-4ef4-928a-3059211f2496 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lazy-loading 'services' on Instance uuid e983600b-2110-437c-a0db-fb0d9c8fe55c {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:13:57.829845 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f54d790-00e6-4ef4-928a-3059211f2496 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments/2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6" status: 202 len: 0 microversion: 2.1 time: 0.258108 Sep 10 21:13:57.831717 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2621/5333] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 21:13:57 2022] DELETE /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments/2b97907b-51ab-48f1-a08c-a3ac3b4ae0e6 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:13:57.843440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb383781-c6f5-44c8-9d82-890b1dca23a6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:57.850583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4cfe427b-8106-4bcb-8154-128dbf682a62 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:57.858235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fb383781-c6f5-44c8-9d82-890b1dca23a6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:57.870274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb383781-c6f5-44c8-9d82-890b1dca23a6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:57.871304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb383781-c6f5-44c8-9d82-890b1dca23a6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:57.872558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb383781-c6f5-44c8-9d82-890b1dca23a6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:57.873560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb383781-c6f5-44c8-9d82-890b1dca23a6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:57.874648 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4cfe427b-8106-4bcb-8154-128dbf682a62 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.253330 Sep 10 21:13:57.875331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb383781-c6f5-44c8-9d82-890b1dca23a6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:57.876184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2713/5334] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:57 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:13:57.876548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb383781-c6f5-44c8-9d82-890b1dca23a6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:57.917093 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fb383781-c6f5-44c8-9d82-890b1dca23a6 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080882 Sep 10 21:13:57.919937 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2622/5335] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:13:57 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:13:58.903559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ff07e8dd-1124-41cf-8d20-11795eb7b4e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:58.904213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ff07e8dd-1124-41cf-8d20-11795eb7b4e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:58.907445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:13:58.914004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff07e8dd-1124-41cf-8d20-11795eb7b4e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:58.914496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff07e8dd-1124-41cf-8d20-11795eb7b4e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:58.915094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff07e8dd-1124-41cf-8d20-11795eb7b4e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:58.916406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff07e8dd-1124-41cf-8d20-11795eb7b4e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:58.916870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff07e8dd-1124-41cf-8d20-11795eb7b4e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:58.917302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff07e8dd-1124-41cf-8d20-11795eb7b4e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:58.931128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a38d1249-6170-4c24-a021-05ab5327c214 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:58.936203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a38d1249-6170-4c24-a021-05ab5327c214 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:58.944173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38d1249-6170-4c24-a021-05ab5327c214 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:58.944765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38d1249-6170-4c24-a021-05ab5327c214 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:58.945252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38d1249-6170-4c24-a021-05ab5327c214 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:58.946147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38d1249-6170-4c24-a021-05ab5327c214 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:58.946736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38d1249-6170-4c24-a021-05ab5327c214 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:58.947265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a38d1249-6170-4c24-a021-05ab5327c214 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:58.983366 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a38d1249-6170-4c24-a021-05ab5327c214 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057030 Sep 10 21:13:58.983966 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2623/5336] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:13:58 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 21:13:59.054873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c8e121c5-bf47-4e7d-9c63-6d3dd3a651b9 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:59.055646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c8e121c5-bf47-4e7d-9c63-6d3dd3a651b9 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:59.062190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8e121c5-bf47-4e7d-9c63-6d3dd3a651b9 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:59.062997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8e121c5-bf47-4e7d-9c63-6d3dd3a651b9 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:59.063610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8e121c5-bf47-4e7d-9c63-6d3dd3a651b9 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:59.064495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8e121c5-bf47-4e7d-9c63-6d3dd3a651b9 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:59.065124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8e121c5-bf47-4e7d-9c63-6d3dd3a651b9 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:59.065732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8e121c5-bf47-4e7d-9c63-6d3dd3a651b9 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:59.081087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ff07e8dd-1124-41cf-8d20-11795eb7b4e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:59.091150 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ff07e8dd-1124-41cf-8d20-11795eb7b4e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.192500 Sep 10 21:13:59.091745 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2714/5337] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:58 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:13:59.095550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c8e121c5-bf47-4e7d-9c63-6d3dd3a651b9 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:13:59.178778 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c8e121c5-bf47-4e7d-9c63-6d3dd3a651b9 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 204 len: 0 microversion: 2.1 time: 0.127574 Sep 10 21:13:59.179552 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2624/5338] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:13:59 2022] DELETE /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:13:59.188777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-beee1378-c546-4287-8ec6-0764a2734762 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:13:59.189398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-beee1378-c546-4287-8ec6-0764a2734762 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:13:59.198952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-beee1378-c546-4287-8ec6-0764a2734762 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:59.199444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-beee1378-c546-4287-8ec6-0764a2734762 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:59.200036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-beee1378-c546-4287-8ec6-0764a2734762 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:59.200890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-beee1378-c546-4287-8ec6-0764a2734762 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:13:59.201514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-beee1378-c546-4287-8ec6-0764a2734762 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:13:59.202168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-beee1378-c546-4287-8ec6-0764a2734762 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:13:59.373234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-beee1378-c546-4287-8ec6-0764a2734762 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:13:59.381986 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-beee1378-c546-4287-8ec6-0764a2734762 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1681 microversion: 2.1 time: 0.197419 Sep 10 21:13:59.382492 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2715/5339] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:13:59 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:00.116349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-330fe44c-b75d-4587-8181-a6a5f8e22c03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:00.116905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-330fe44c-b75d-4587-8181-a6a5f8e22c03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:00.123879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-330fe44c-b75d-4587-8181-a6a5f8e22c03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:00.124373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-330fe44c-b75d-4587-8181-a6a5f8e22c03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:00.124813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-330fe44c-b75d-4587-8181-a6a5f8e22c03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:00.125515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-330fe44c-b75d-4587-8181-a6a5f8e22c03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:00.126031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-330fe44c-b75d-4587-8181-a6a5f8e22c03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:00.126466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-330fe44c-b75d-4587-8181-a6a5f8e22c03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:00.268284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-330fe44c-b75d-4587-8181-a6a5f8e22c03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:00.276462 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-330fe44c-b75d-4587-8181-a6a5f8e22c03 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1657 microversion: 2.1 time: 0.164711 Sep 10 21:14:00.277053 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2625/5340] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:00 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1657 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:00.299135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-14d869d6-4d10-4f36-ba08-708aa49fcb65 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:00.306613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14d869d6-4d10-4f36-ba08-708aa49fcb65 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:00.307114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14d869d6-4d10-4f36-ba08-708aa49fcb65 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:00.307552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14d869d6-4d10-4f36-ba08-708aa49fcb65 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:00.330915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-14d869d6-4d10-4f36-ba08-708aa49fcb65 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Going to try to start instance {{(pid=145772) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 21:14:00.377746 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-14d869d6-4d10-4f36-ba08-708aa49fcb65 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.082507 Sep 10 21:14:00.381311 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2716/5341] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:14:00 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:14:00.386607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-40aec07a-da89-498e-89f3-4d1a19efdd28 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:00.387228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-40aec07a-da89-498e-89f3-4d1a19efdd28 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:00.393462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40aec07a-da89-498e-89f3-4d1a19efdd28 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:00.394088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40aec07a-da89-498e-89f3-4d1a19efdd28 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:00.394545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40aec07a-da89-498e-89f3-4d1a19efdd28 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:00.395262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40aec07a-da89-498e-89f3-4d1a19efdd28 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:00.395728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40aec07a-da89-498e-89f3-4d1a19efdd28 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:00.396183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40aec07a-da89-498e-89f3-4d1a19efdd28 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:00.408462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a2a98787-ca99-4fd7-a143-e5dbdc3c165d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:00.409579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a2a98787-ca99-4fd7-a143-e5dbdc3c165d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:00.417163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a98787-ca99-4fd7-a143-e5dbdc3c165d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:00.418052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a98787-ca99-4fd7-a143-e5dbdc3c165d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:00.418873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a98787-ca99-4fd7-a143-e5dbdc3c165d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:00.420125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a98787-ca99-4fd7-a143-e5dbdc3c165d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:00.420780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a98787-ca99-4fd7-a143-e5dbdc3c165d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:00.421617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a98787-ca99-4fd7-a143-e5dbdc3c165d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:00.426504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:00.556342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-40aec07a-da89-498e-89f3-4d1a19efdd28 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:00.564819 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-40aec07a-da89-498e-89f3-4d1a19efdd28 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1666 microversion: 2.1 time: 0.182084 Sep 10 21:14:00.566078 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2626/5342] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:00 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1666 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:00.579585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a2a98787-ca99-4fd7-a143-e5dbdc3c165d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:00.588603 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a2a98787-ca99-4fd7-a143-e5dbdc3c165d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1681 microversion: 2.1 time: 0.184656 Sep 10 21:14:00.589314 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2717/5343] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:00 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:01.589933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7759d63c-9283-4293-93e3-9434c372bff2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:01.590496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7759d63c-9283-4293-93e3-9434c372bff2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:01.598275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7759d63c-9283-4293-93e3-9434c372bff2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:01.598801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7759d63c-9283-4293-93e3-9434c372bff2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:01.599245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7759d63c-9283-4293-93e3-9434c372bff2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:01.599962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7759d63c-9283-4293-93e3-9434c372bff2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:01.600428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7759d63c-9283-4293-93e3-9434c372bff2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:01.600864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7759d63c-9283-4293-93e3-9434c372bff2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:01.613769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c1e01a1b-3e21-402b-b876-9b690d119924 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:01.614983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c1e01a1b-3e21-402b-b876-9b690d119924 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:01.623916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1e01a1b-3e21-402b-b876-9b690d119924 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:01.625235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1e01a1b-3e21-402b-b876-9b690d119924 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:01.625978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1e01a1b-3e21-402b-b876-9b690d119924 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:01.627091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1e01a1b-3e21-402b-b876-9b690d119924 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:01.627983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1e01a1b-3e21-402b-b876-9b690d119924 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:01.628563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1e01a1b-3e21-402b-b876-9b690d119924 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:01.774384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c1e01a1b-3e21-402b-b876-9b690d119924 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:01.782969 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c1e01a1b-3e21-402b-b876-9b690d119924 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1681 microversion: 2.1 time: 0.173233 Sep 10 21:14:01.783556 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2718/5344] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:01 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:01.885911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7759d63c-9283-4293-93e3-9434c372bff2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:01.901305 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7759d63c-9283-4293-93e3-9434c372bff2 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1666 microversion: 2.1 time: 0.313629 Sep 10 21:14:01.921760 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2627/5345] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:01 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1666 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:02.444310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-61b514da-b19b-48df-801d-b31a527a4f45 req-55dec5ef-2a2d-4220-a29f-857d915f5be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e983600b-2110-437c-a0db-fb0d9c8fe55c", "name": "network-vif-deleted", "tag": "1fd22866-4f2e-4ce7-a0e8-bb4d5e06024d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:02.473514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-61b514da-b19b-48df-801d-b31a527a4f45 req-55dec5ef-2a2d-4220-a29f-857d915f5be6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:02.474667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-61b514da-b19b-48df-801d-b31a527a4f45 req-55dec5ef-2a2d-4220-a29f-857d915f5be6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:02.475907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-61b514da-b19b-48df-801d-b31a527a4f45 req-55dec5ef-2a2d-4220-a29f-857d915f5be6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:02.499122 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-61b514da-b19b-48df-801d-b31a527a4f45 req-55dec5ef-2a2d-4220-a29f-857d915f5be6 service nova] Creating event network-vif-deleted:1fd22866-4f2e-4ce7-a0e8-bb4d5e06024d for instance e983600b-2110-437c-a0db-fb0d9c8fe55c on nch2-master-1 Sep 10 21:14:02.507165 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-61b514da-b19b-48df-801d-b31a527a4f45 req-55dec5ef-2a2d-4220-a29f-857d915f5be6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070106 Sep 10 21:14:02.512985 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2719/5346] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:14:02.827117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:02.828417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:02.840370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:02.841065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:02.841696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:02.842731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:02.843322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:02.844178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:02.927440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:02.928170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:02.930872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:02.931530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e1104c3-7632-4378-864d-bd35f6dbd35e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:02.931955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e1104c3-7632-4378-864d-bd35f6dbd35e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:02.932777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lazy-loading 'fault' on Instance uuid e983600b-2110-437c-a0db-fb0d9c8fe55c {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:14:02.948960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e1104c3-7632-4378-864d-bd35f6dbd35e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:02.949725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e1104c3-7632-4378-864d-bd35f6dbd35e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:02.950197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e1104c3-7632-4378-864d-bd35f6dbd35e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:02.950947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e1104c3-7632-4378-864d-bd35f6dbd35e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:02.955191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e1104c3-7632-4378-864d-bd35f6dbd35e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:02.956588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e1104c3-7632-4378-864d-bd35f6dbd35e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:03.092763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:03.114028 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d9f4a6c-9d8e-4593-b33b-c37a4cb4c3a1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 200 len: 1331 microversion: 2.1 time: 0.290904 Sep 10 21:14:03.114265 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2628/5347] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:02 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 1331 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:03.314559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8e1104c3-7632-4378-864d-bd35f6dbd35e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:03.327402 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e1104c3-7632-4378-864d-bd35f6dbd35e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.401765 Sep 10 21:14:03.328844 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2720/5348] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:02 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:03.363355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4d349a26-9dfa-4bdd-8ea0-4f4a6be0901f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:03.364392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4d349a26-9dfa-4bdd-8ea0-4f4a6be0901f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:03.387381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d349a26-9dfa-4bdd-8ea0-4f4a6be0901f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:03.388244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d349a26-9dfa-4bdd-8ea0-4f4a6be0901f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:03.389108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d349a26-9dfa-4bdd-8ea0-4f4a6be0901f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:03.390175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d349a26-9dfa-4bdd-8ea0-4f4a6be0901f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:03.390955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d349a26-9dfa-4bdd-8ea0-4f4a6be0901f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:03.391612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d349a26-9dfa-4bdd-8ea0-4f4a6be0901f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:03.657207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d349a26-9dfa-4bdd-8ea0-4f4a6be0901f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:03.666908 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4d349a26-9dfa-4bdd-8ea0-4f4a6be0901f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.308635 Sep 10 21:14:03.667827 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2629/5349] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:03 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:03.698923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e28851c3-cab3-4205-b477-f1b4ed597b84 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:03.699815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e28851c3-cab3-4205-b477-f1b4ed597b84 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:03.707730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e28851c3-cab3-4205-b477-f1b4ed597b84 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:03.708530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e28851c3-cab3-4205-b477-f1b4ed597b84 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:03.709386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e28851c3-cab3-4205-b477-f1b4ed597b84 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:03.710536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e28851c3-cab3-4205-b477-f1b4ed597b84 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:03.711230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e28851c3-cab3-4205-b477-f1b4ed597b84 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:03.711865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e28851c3-cab3-4205-b477-f1b4ed597b84 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:03.795774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e28851c3-cab3-4205-b477-f1b4ed597b84 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Unlocking {{(pid=145772) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 10 21:14:03.887291 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e28851c3-cab3-4205-b477-f1b4ed597b84 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.196383 Sep 10 21:14:03.888384 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2721/5350] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:14:03 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:14:03.900186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27770ee3-8f40-4182-afbc-0a51e2ec24cf tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:03.901573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-27770ee3-8f40-4182-afbc-0a51e2ec24cf tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:03.914816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27770ee3-8f40-4182-afbc-0a51e2ec24cf tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:03.918126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27770ee3-8f40-4182-afbc-0a51e2ec24cf tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:03.918924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27770ee3-8f40-4182-afbc-0a51e2ec24cf tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:03.919946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27770ee3-8f40-4182-afbc-0a51e2ec24cf tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:03.920423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27770ee3-8f40-4182-afbc-0a51e2ec24cf tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:03.920870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27770ee3-8f40-4182-afbc-0a51e2ec24cf tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:04.163759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:04.164410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:04.200771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:04.201456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:04.202073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:04.202962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:04.203601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:04.204387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:04.214717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27770ee3-8f40-4182-afbc-0a51e2ec24cf tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:04.228970 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c HTTP/1.1 Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e983600b-2110-437c-a0db-fb0d9c8fe55c'} Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:14:04.231354 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:04.235324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:04.235324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:14:04.235324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:14:04.235324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:14:04.235324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:14:04.235324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:14:04.235324 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:04.235324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:14:04.235324 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5730bdf6-0e7e-4d9f-ae25-f70f505b95d1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 404 len: 111 microversion: 2.1 time: 0.078745 Sep 10 21:14:04.235324 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2722/5351] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:04 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:14:04.246077 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27770ee3-8f40-4182-afbc-0a51e2ec24cf tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.349553 Sep 10 21:14:04.246221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2500b510-e6b2-4cb9-a579-6a8ea7f5fde7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '.version_select at 0x7f9945014820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:04.246707 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2630/5352] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:03 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:04.276653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7ee3027d-dd00-4645-9509-1e7cf56697dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:04.295875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7ee3027d-dd00-4645-9509-1e7cf56697dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:04.310513 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2500b510-e6b2-4cb9-a579-6a8ea7f5fde7 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589204664" status: 202 len: 0 microversion: 2.1 time: 0.071956 Sep 10 21:14:04.311544 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2723/5353] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 21:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589204664 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:14:04.328422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ee3027d-dd00-4645-9509-1e7cf56697dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:04.334459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ee3027d-dd00-4645-9509-1e7cf56697dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:04.339266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ee3027d-dd00-4645-9509-1e7cf56697dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:04.340370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ee3027d-dd00-4645-9509-1e7cf56697dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:04.347096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ee3027d-dd00-4645-9509-1e7cf56697dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:04.352572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7ee3027d-dd00-4645-9509-1e7cf56697dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:04.419464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:04.915951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7ee3027d-dd00-4645-9509-1e7cf56697dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:04.943627 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7ee3027d-dd00-4645-9509-1e7cf56697dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.671997 Sep 10 21:14:04.944261 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2631/5354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:04 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:04.975509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0dbcfd6-793a-4cd2-ab48-26d28a395bd7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:04.976152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0dbcfd6-793a-4cd2-ab48-26d28a395bd7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:05.004889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dbcfd6-793a-4cd2-ab48-26d28a395bd7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:05.008462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dbcfd6-793a-4cd2-ab48-26d28a395bd7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:05.008877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dbcfd6-793a-4cd2-ab48-26d28a395bd7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:05.011749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dbcfd6-793a-4cd2-ab48-26d28a395bd7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:05.012846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dbcfd6-793a-4cd2-ab48-26d28a395bd7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:05.015170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dbcfd6-793a-4cd2-ab48-26d28a395bd7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:05.296922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0dbcfd6-793a-4cd2-ab48-26d28a395bd7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:05.307302 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0dbcfd6-793a-4cd2-ab48-26d28a395bd7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.342787 Sep 10 21:14:05.308597 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2724/5355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:04 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:05.331021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-29f5252b-0b9d-4f7c-adbd-0ce00d82b8c6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:05.331689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-29f5252b-0b9d-4f7c-adbd-0ce00d82b8c6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:05.338200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f5252b-0b9d-4f7c-adbd-0ce00d82b8c6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:05.338978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f5252b-0b9d-4f7c-adbd-0ce00d82b8c6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:05.339629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f5252b-0b9d-4f7c-adbd-0ce00d82b8c6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:05.340553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f5252b-0b9d-4f7c-adbd-0ce00d82b8c6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:05.341249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f5252b-0b9d-4f7c-adbd-0ce00d82b8c6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:05.341922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-29f5252b-0b9d-4f7c-adbd-0ce00d82b8c6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:05.376100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-06bc43a2-3d95-4f11-886a-febf6b855f37 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: .version_select at 0x7f99448c2310>, body: {"keypair": {"name": "tempest-keypair-228661552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ36Q+CzaL5BtDM6Eb7485ZaiYalddHdJKqtIxuPozFB4cZB29WkeMMUUQMdnauQVl7ghkf5IJORg3fcVqMBQtVBvBbn3afVYj9sH77elv1XV8a8mFWkEdj/e6CN2KraQ=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:05.412702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-06bc43a2-3d95-4f11-886a-febf6b855f37 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:14:05.424586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-06bc43a2-3d95-4f11-886a-febf6b855f37 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for user 54dcc78ee39c4119b08023d3cc692d6b and project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:14:05.454553 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-29f5252b-0b9d-4f7c-adbd-0ce00d82b8c6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.127275 Sep 10 21:14:05.458789 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2632/5356] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:14:05 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:14:05.473203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e085ba1d-2ae1-4ed5-a255-2214cd5411d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:05.474137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e085ba1d-2ae1-4ed5-a255-2214cd5411d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:05.496886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e085ba1d-2ae1-4ed5-a255-2214cd5411d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:05.500757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e085ba1d-2ae1-4ed5-a255-2214cd5411d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:05.501554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e085ba1d-2ae1-4ed5-a255-2214cd5411d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:05.502470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e085ba1d-2ae1-4ed5-a255-2214cd5411d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:05.504500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e085ba1d-2ae1-4ed5-a255-2214cd5411d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:05.506143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e085ba1d-2ae1-4ed5-a255-2214cd5411d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:05.509851 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-06bc43a2-3d95-4f11-886a-febf6b855f37 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142162 Sep 10 21:14:05.512613 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2725/5357] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:14:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:14:05.866718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e085ba1d-2ae1-4ed5-a255-2214cd5411d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:05.891022 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e085ba1d-2ae1-4ed5-a255-2214cd5411d5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1675 microversion: 2.1 time: 0.431298 Sep 10 21:14:05.892045 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2633/5358] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:05 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1675 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:06.918583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9daf7085-7274-462e-97a9-91383e75614c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:06.919196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9daf7085-7274-462e-97a9-91383e75614c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:06.932137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9daf7085-7274-462e-97a9-91383e75614c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:06.934525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9daf7085-7274-462e-97a9-91383e75614c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:06.935089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9daf7085-7274-462e-97a9-91383e75614c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:06.935734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9daf7085-7274-462e-97a9-91383e75614c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:06.936253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9daf7085-7274-462e-97a9-91383e75614c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:06.936662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9daf7085-7274-462e-97a9-91383e75614c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:07.344393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9daf7085-7274-462e-97a9-91383e75614c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:07.362508 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9daf7085-7274-462e-97a9-91383e75614c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1655 microversion: 2.1 time: 0.449646 Sep 10 21:14:07.391730 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2726/5359] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:06 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1655 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:07.405354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-15778289-90d9-439f-a75d-6a81f5e0b0b7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:07.405927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-15778289-90d9-439f-a75d-6a81f5e0b0b7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:07.427022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15778289-90d9-439f-a75d-6a81f5e0b0b7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:07.427550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15778289-90d9-439f-a75d-6a81f5e0b0b7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:07.428011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15778289-90d9-439f-a75d-6a81f5e0b0b7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:07.428757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15778289-90d9-439f-a75d-6a81f5e0b0b7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:07.433707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15778289-90d9-439f-a75d-6a81f5e0b0b7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:07.434420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15778289-90d9-439f-a75d-6a81f5e0b0b7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:07.603584 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-15778289-90d9-439f-a75d-6a81f5e0b0b7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.202740 Sep 10 21:14:07.607076 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2634/5360] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:14:07 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:14:07.623545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-540d26bb-5b18-4713-958d-6e092c1bca20 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:07.624547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-540d26bb-5b18-4713-958d-6e092c1bca20 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:07.646768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-540d26bb-5b18-4713-958d-6e092c1bca20 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:07.648131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-540d26bb-5b18-4713-958d-6e092c1bca20 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:07.653220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-540d26bb-5b18-4713-958d-6e092c1bca20 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:07.654483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-540d26bb-5b18-4713-958d-6e092c1bca20 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:07.657044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-540d26bb-5b18-4713-958d-6e092c1bca20 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:07.660014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-540d26bb-5b18-4713-958d-6e092c1bca20 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:07.987983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-540d26bb-5b18-4713-958d-6e092c1bca20 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:08.015409 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-540d26bb-5b18-4713-958d-6e092c1bca20 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1662 microversion: 2.1 time: 0.405419 Sep 10 21:14:08.016797 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2727/5361] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:07 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1662 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:08.123183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-311905495", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05daa8b2-a600-4c08-8c3a-78652e8f4ca4"}], "security_groups": [{"name": "tempest-securitygroup--567927147"}], "key_name": "tempest-keypair-228661552", "user_data": "}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:08.170743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-215387156", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "af5399ae-d2f3-4a06-95b4-a347e2e567a8"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:08.259635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] validate_networks() for [('05daa8b2-a600-4c08-8c3a-78652e8f4ca4', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:14:08.261016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] validate_networks() for [('af5399ae-d2f3-4a06-95b4-a347e2e567a8', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:14:08.671267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:14:08.671861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:14:08.672576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:14:08.673005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:14:08.673426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:14:08.678148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:14:08.678871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:14:08.679368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:14:08.679778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:14:08.680343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:14:08.683550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:08.684052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:08.684500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:08.685249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:08.685712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:08.686175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:08.690528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:08.691015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:08.691613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:08.692529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:08.692956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:08.693642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:08.705653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Getting quotas for project d2931f7a57c6444db783288bda1a74b8. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:14:08.711448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Getting quotas for user 9bbe85c6ecdb49a8b186a8cb6e1f400e and project d2931f7a57c6444db783288bda1a74b8. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:14:08.715192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:14:08.720703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Getting quotas for user 54dcc78ee39c4119b08023d3cc692d6b and project c8d7ded29d1345b4b3111a69f4efec6f. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:14:08.724282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:14:08.726757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:14:08.734624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:14:08.736968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:14:08.779091 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-10b65cd3-fd9b-46df-a062-d64b771aa006 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863070 Sep 10 21:14:08.780244 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2635/5362] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:14:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:14:08.795453 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7159f751-27d7-4523-affe-e24f912b926e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.683682 Sep 10 21:14:08.795684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4257a968-1005-4668-a00b-bc678c1a51cf tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:08.802440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4257a968-1005-4668-a00b-bc678c1a51cf tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:08.803051 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2728/5363] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:14:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:14:08.810485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3a9f6464-aede-4fdc-9af7-3cce90b43be4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:08.811361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3a9f6464-aede-4fdc-9af7-3cce90b43be4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:08.871969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4257a968-1005-4668-a00b-bc678c1a51cf tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:08.881673 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4257a968-1005-4668-a00b-bc678c1a51cf tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1224 microversion: 2.1 time: 0.092188 Sep 10 21:14:08.882306 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2636/5364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:08 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:08.885400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a9f6464-aede-4fdc-9af7-3cce90b43be4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:08.895665 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3a9f6464-aede-4fdc-9af7-3cce90b43be4 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1240 microversion: 2.1 time: 0.091214 Sep 10 21:14:08.896271 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2729/5365] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:08 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:09.041306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89d54503-ed80-4ee6-a528-518a30397c64 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:09.042212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-89d54503-ed80-4ee6-a528-518a30397c64 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:09.049360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89d54503-ed80-4ee6-a528-518a30397c64 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:09.050245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89d54503-ed80-4ee6-a528-518a30397c64 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:09.050938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89d54503-ed80-4ee6-a528-518a30397c64 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:09.051752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89d54503-ed80-4ee6-a528-518a30397c64 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:09.052327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89d54503-ed80-4ee6-a528-518a30397c64 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:09.052884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89d54503-ed80-4ee6-a528-518a30397c64 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:09.218277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89d54503-ed80-4ee6-a528-518a30397c64 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:09.229361 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-89d54503-ed80-4ee6-a528-518a30397c64 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.191864 Sep 10 21:14:09.244306 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2637/5366] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:09 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:09.255308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35d40ebc-4b09-4bf5-9979-64b94669ca92 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:09.255935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35d40ebc-4b09-4bf5-9979-64b94669ca92 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:09.265501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d40ebc-4b09-4bf5-9979-64b94669ca92 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:09.266872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d40ebc-4b09-4bf5-9979-64b94669ca92 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:09.267598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d40ebc-4b09-4bf5-9979-64b94669ca92 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:09.268653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d40ebc-4b09-4bf5-9979-64b94669ca92 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:09.270460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d40ebc-4b09-4bf5-9979-64b94669ca92 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:09.271097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d40ebc-4b09-4bf5-9979-64b94669ca92 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:09.584284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35d40ebc-4b09-4bf5-9979-64b94669ca92 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:09.610601 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35d40ebc-4b09-4bf5-9979-64b94669ca92 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.351107 Sep 10 21:14:09.611298 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2730/5367] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:09 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:09.636855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0efceeec-a1b6-41c0-8378-43c769e5c1a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:09.637864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0efceeec-a1b6-41c0-8378-43c769e5c1a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:09.646773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0efceeec-a1b6-41c0-8378-43c769e5c1a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:09.647587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0efceeec-a1b6-41c0-8378-43c769e5c1a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:09.648221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0efceeec-a1b6-41c0-8378-43c769e5c1a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:09.649141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0efceeec-a1b6-41c0-8378-43c769e5c1a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:09.650860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0efceeec-a1b6-41c0-8378-43c769e5c1a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:09.651887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0efceeec-a1b6-41c0-8378-43c769e5c1a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:09.842473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0efceeec-a1b6-41c0-8378-43c769e5c1a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:09.852899 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0efceeec-a1b6-41c0-8378-43c769e5c1a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.221515 Sep 10 21:14:09.855043 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2638/5368] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:09 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:09.877922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7510427b-3616-40e8-bd7c-861fc6b2f44d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:09.878995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7510427b-3616-40e8-bd7c-861fc6b2f44d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:09.898159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7510427b-3616-40e8-bd7c-861fc6b2f44d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:09.898948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7510427b-3616-40e8-bd7c-861fc6b2f44d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:09.902267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7510427b-3616-40e8-bd7c-861fc6b2f44d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:09.903113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7510427b-3616-40e8-bd7c-861fc6b2f44d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:09.903601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7510427b-3616-40e8-bd7c-861fc6b2f44d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:09.904062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7510427b-3616-40e8-bd7c-861fc6b2f44d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:09.908406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d4b796d-05a8-49a9-aeb5-3c01d46a2ee7 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:09.909378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d4b796d-05a8-49a9-aeb5-3c01d46a2ee7 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:09.920056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d4b796d-05a8-49a9-aeb5-3c01d46a2ee7 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:09.923753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d4b796d-05a8-49a9-aeb5-3c01d46a2ee7 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:09.924920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d4b796d-05a8-49a9-aeb5-3c01d46a2ee7 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:09.926482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d4b796d-05a8-49a9-aeb5-3c01d46a2ee7 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:09.928507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d4b796d-05a8-49a9-aeb5-3c01d46a2ee7 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:09.929797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d4b796d-05a8-49a9-aeb5-3c01d46a2ee7 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:10.100284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3d4b796d-05a8-49a9-aeb5-3c01d46a2ee7 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:10.112631 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d4b796d-05a8-49a9-aeb5-3c01d46a2ee7 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1220 microversion: 2.1 time: 0.208002 Sep 10 21:14:10.127600 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2639/5369] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:09 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1220 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:10.138632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7510427b-3616-40e8-bd7c-861fc6b2f44d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:10.140121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ac21d3a4-e0d6-4698-b163-3184ed38c5ca tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:10.142034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ac21d3a4-e0d6-4698-b163-3184ed38c5ca tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:10.151352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac21d3a4-e0d6-4698-b163-3184ed38c5ca tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:10.152333 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7510427b-3616-40e8-bd7c-861fc6b2f44d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.278156 Sep 10 21:14:10.152565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac21d3a4-e0d6-4698-b163-3184ed38c5ca tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:10.153243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac21d3a4-e0d6-4698-b163-3184ed38c5ca tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:10.153519 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2731/5370] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:09 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:10.154423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac21d3a4-e0d6-4698-b163-3184ed38c5ca tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:10.154888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac21d3a4-e0d6-4698-b163-3184ed38c5ca tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:10.155346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ac21d3a4-e0d6-4698-b163-3184ed38c5ca tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:10.182441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dd3cf9bc-d824-48e0-8040-330ca2664fa0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:10.186670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dd3cf9bc-d824-48e0-8040-330ca2664fa0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:10.195988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd3cf9bc-d824-48e0-8040-330ca2664fa0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:10.197180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd3cf9bc-d824-48e0-8040-330ca2664fa0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:10.197695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd3cf9bc-d824-48e0-8040-330ca2664fa0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:10.198697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd3cf9bc-d824-48e0-8040-330ca2664fa0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:10.199413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd3cf9bc-d824-48e0-8040-330ca2664fa0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:10.199920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd3cf9bc-d824-48e0-8040-330ca2664fa0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:10.272334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ac21d3a4-e0d6-4698-b163-3184ed38c5ca tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:10.282362 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ac21d3a4-e0d6-4698-b163-3184ed38c5ca tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1292 microversion: 2.1 time: 0.153384 Sep 10 21:14:10.283094 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2640/5371] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:10 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1292 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:10.357332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dd3cf9bc-d824-48e0-8040-330ca2664fa0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:10.365729 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dd3cf9bc-d824-48e0-8040-330ca2664fa0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.190622 Sep 10 21:14:10.366430 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2732/5372] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:10 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:10.388368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aaa96ec4-995d-4bef-80e4-21137cdc8a08 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:10.388997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aaa96ec4-995d-4bef-80e4-21137cdc8a08 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:10.395044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaa96ec4-995d-4bef-80e4-21137cdc8a08 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:10.395545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaa96ec4-995d-4bef-80e4-21137cdc8a08 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:10.395994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaa96ec4-995d-4bef-80e4-21137cdc8a08 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:10.396715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaa96ec4-995d-4bef-80e4-21137cdc8a08 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:10.397182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaa96ec4-995d-4bef-80e4-21137cdc8a08 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:10.397618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aaa96ec4-995d-4bef-80e4-21137cdc8a08 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:10.539116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-aaa96ec4-995d-4bef-80e4-21137cdc8a08 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:10.547715 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aaa96ec4-995d-4bef-80e4-21137cdc8a08 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.163751 Sep 10 21:14:10.548441 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2641/5373] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:10 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:11.143431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e91e8f00-d702-4fdb-9c2e-5deb1c39701f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:11.144175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e91e8f00-d702-4fdb-9c2e-5deb1c39701f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:11.151167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e91e8f00-d702-4fdb-9c2e-5deb1c39701f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:11.151976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e91e8f00-d702-4fdb-9c2e-5deb1c39701f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:11.153068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e91e8f00-d702-4fdb-9c2e-5deb1c39701f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:11.154032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e91e8f00-d702-4fdb-9c2e-5deb1c39701f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:11.154974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e91e8f00-d702-4fdb-9c2e-5deb1c39701f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:11.155625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e91e8f00-d702-4fdb-9c2e-5deb1c39701f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:11.280446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e91e8f00-d702-4fdb-9c2e-5deb1c39701f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:11.309742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8835ac59-7a76-439f-995f-e70c5910a947 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:11.310960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8835ac59-7a76-439f-995f-e70c5910a947 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:11.318469 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e91e8f00-d702-4fdb-9c2e-5deb1c39701f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1276 microversion: 2.1 time: 0.164157 Sep 10 21:14:11.320714 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2733/5374] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:11 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:11.343521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8835ac59-7a76-439f-995f-e70c5910a947 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:11.347207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8835ac59-7a76-439f-995f-e70c5910a947 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:11.348724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8835ac59-7a76-439f-995f-e70c5910a947 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:11.349701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8835ac59-7a76-439f-995f-e70c5910a947 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:11.350353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8835ac59-7a76-439f-995f-e70c5910a947 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:11.352475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8835ac59-7a76-439f-995f-e70c5910a947 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:11.493967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8835ac59-7a76-439f-995f-e70c5910a947 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:11.502704 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8835ac59-7a76-439f-995f-e70c5910a947 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1298 microversion: 2.1 time: 0.200350 Sep 10 21:14:11.509508 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2642/5375] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:11 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1298 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:12.343598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c5b16206-8a49-4a6e-a098-8354c91b0f79 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:12.344901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c5b16206-8a49-4a6e-a098-8354c91b0f79 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:12.355194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b16206-8a49-4a6e-a098-8354c91b0f79 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:12.355998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b16206-8a49-4a6e-a098-8354c91b0f79 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:12.356604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b16206-8a49-4a6e-a098-8354c91b0f79 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:12.358139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b16206-8a49-4a6e-a098-8354c91b0f79 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:12.359069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b16206-8a49-4a6e-a098-8354c91b0f79 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:12.359912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5b16206-8a49-4a6e-a098-8354c91b0f79 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:12.529008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fd3c50dc-fb03-4e46-ac46-98f765df9974 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:12.529537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fd3c50dc-fb03-4e46-ac46-98f765df9974 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:12.532831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:12.538365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3c50dc-fb03-4e46-ac46-98f765df9974 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:12.539192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3c50dc-fb03-4e46-ac46-98f765df9974 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:12.539795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3c50dc-fb03-4e46-ac46-98f765df9974 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:12.541246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3c50dc-fb03-4e46-ac46-98f765df9974 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:12.541908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3c50dc-fb03-4e46-ac46-98f765df9974 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:12.542507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3c50dc-fb03-4e46-ac46-98f765df9974 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:12.736790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c5b16206-8a49-4a6e-a098-8354c91b0f79 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:12.748386 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c5b16206-8a49-4a6e-a098-8354c91b0f79 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1324 microversion: 2.1 time: 0.410978 Sep 10 21:14:12.749647 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2734/5376] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:12 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1324 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:12.942525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fd3c50dc-fb03-4e46-ac46-98f765df9974 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:12.955602 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fd3c50dc-fb03-4e46-ac46-98f765df9974 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1365 microversion: 2.1 time: 0.431286 Sep 10 21:14:12.963435 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2643/5377] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:12 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1365 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:13.010678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f2e8cc05-f4e9-465b-9ae5-09a8491cbeaf req-c8522bcd-72d7-458a-a679-fe3313d197c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e32f9e-ea2d-4481-ab27-9325f7349ce4", "tag": "634a5b75-d21e-4503-8aba-d6fbff6e4c07"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:13.028003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f2e8cc05-f4e9-465b-9ae5-09a8491cbeaf req-c8522bcd-72d7-458a-a679-fe3313d197c1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:13.028502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f2e8cc05-f4e9-465b-9ae5-09a8491cbeaf req-c8522bcd-72d7-458a-a679-fe3313d197c1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:13.028945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f2e8cc05-f4e9-465b-9ae5-09a8491cbeaf req-c8522bcd-72d7-458a-a679-fe3313d197c1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:13.048337 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f2e8cc05-f4e9-465b-9ae5-09a8491cbeaf req-c8522bcd-72d7-458a-a679-fe3313d197c1 service nova] Creating event network-changed:634a5b75-d21e-4503-8aba-d6fbff6e4c07 for instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 on nch2-master-1 Sep 10 21:14:13.065087 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f2e8cc05-f4e9-465b-9ae5-09a8491cbeaf req-c8522bcd-72d7-458a-a679-fe3313d197c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272371 Sep 10 21:14:13.065875 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2735/5378] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:14:13.451177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b35748b3-7448-4fa9-a6e3-b7ca0f519ec5 req-4e14e1fb-0e3b-4ed0-af9d-34c2bc76e6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4a66f1f-4d8e-482f-8ebf-54f1e70c587e", "tag": "0002a5df-8f06-41c4-9e08-ab9e9c64dbd1"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:13.460854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b35748b3-7448-4fa9-a6e3-b7ca0f519ec5 req-4e14e1fb-0e3b-4ed0-af9d-34c2bc76e6e3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:13.461340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b35748b3-7448-4fa9-a6e3-b7ca0f519ec5 req-4e14e1fb-0e3b-4ed0-af9d-34c2bc76e6e3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:13.461781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b35748b3-7448-4fa9-a6e3-b7ca0f519ec5 req-4e14e1fb-0e3b-4ed0-af9d-34c2bc76e6e3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:13.472851 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b35748b3-7448-4fa9-a6e3-b7ca0f519ec5 req-4e14e1fb-0e3b-4ed0-af9d-34c2bc76e6e3 service nova] Creating event network-changed:0002a5df-8f06-41c4-9e08-ab9e9c64dbd1 for instance a4a66f1f-4d8e-482f-8ebf-54f1e70c587e on nch2-master-1 Sep 10 21:14:13.478260 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b35748b3-7448-4fa9-a6e3-b7ca0f519ec5 req-4e14e1fb-0e3b-4ed0-af9d-34c2bc76e6e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096632 Sep 10 21:14:13.478851 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2644/5379] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:13.775364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cd96a8f5-fa6b-4809-b1e2-0b9d787cd945 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:13.775966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cd96a8f5-fa6b-4809-b1e2-0b9d787cd945 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:13.782217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96a8f5-fa6b-4809-b1e2-0b9d787cd945 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:13.782698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96a8f5-fa6b-4809-b1e2-0b9d787cd945 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:13.783132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96a8f5-fa6b-4809-b1e2-0b9d787cd945 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:13.783819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96a8f5-fa6b-4809-b1e2-0b9d787cd945 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:13.784270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96a8f5-fa6b-4809-b1e2-0b9d787cd945 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:13.784692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cd96a8f5-fa6b-4809-b1e2-0b9d787cd945 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:13.918083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cd96a8f5-fa6b-4809-b1e2-0b9d787cd945 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:13.922644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:13.927354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cd96a8f5-fa6b-4809-b1e2-0b9d787cd945 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1324 microversion: 2.1 time: 0.157816 Sep 10 21:14:13.927965 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2736/5380] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:13 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:13.991226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd3c5dc4-6a05-433a-8715-774387b475ff tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:13.992437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd3c5dc4-6a05-433a-8715-774387b475ff tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:13.998937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd3c5dc4-6a05-433a-8715-774387b475ff tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:13.999429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd3c5dc4-6a05-433a-8715-774387b475ff tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:13.999868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd3c5dc4-6a05-433a-8715-774387b475ff tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:14.000575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd3c5dc4-6a05-433a-8715-774387b475ff tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:14.001033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd3c5dc4-6a05-433a-8715-774387b475ff tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:14.001466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd3c5dc4-6a05-433a-8715-774387b475ff tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:14.143590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd3c5dc4-6a05-433a-8715-774387b475ff tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:14.152208 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd3c5dc4-6a05-433a-8715-774387b475ff tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1365 microversion: 2.1 time: 0.166241 Sep 10 21:14:14.152781 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2645/5381] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:13 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:14.955581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96b33518-af45-4b53-adfa-3fe8aee1ee7b tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:14.956247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96b33518-af45-4b53-adfa-3fe8aee1ee7b tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:14.969670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b33518-af45-4b53-adfa-3fe8aee1ee7b tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:14.974127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b33518-af45-4b53-adfa-3fe8aee1ee7b tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:14.975993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b33518-af45-4b53-adfa-3fe8aee1ee7b tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:14.978561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b33518-af45-4b53-adfa-3fe8aee1ee7b tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:14.979420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b33518-af45-4b53-adfa-3fe8aee1ee7b tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:14.980732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b33518-af45-4b53-adfa-3fe8aee1ee7b tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:15.178737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4e0b98df-c5d3-471e-9981-f8dfea8b3c4d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:15.182639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4e0b98df-c5d3-471e-9981-f8dfea8b3c4d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:15.193353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0b98df-c5d3-471e-9981-f8dfea8b3c4d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:15.194366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0b98df-c5d3-471e-9981-f8dfea8b3c4d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:15.195633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0b98df-c5d3-471e-9981-f8dfea8b3c4d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:15.197065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0b98df-c5d3-471e-9981-f8dfea8b3c4d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:15.197706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0b98df-c5d3-471e-9981-f8dfea8b3c4d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:15.198578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e0b98df-c5d3-471e-9981-f8dfea8b3c4d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:15.367202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e0b98df-c5d3-471e-9981-f8dfea8b3c4d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:15.375916 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4e0b98df-c5d3-471e-9981-f8dfea8b3c4d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1365 microversion: 2.1 time: 0.204991 Sep 10 21:14:15.376774 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2646/5382] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:15 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:15.526709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-96b33518-af45-4b53-adfa-3fe8aee1ee7b tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:15.534833 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96b33518-af45-4b53-adfa-3fe8aee1ee7b tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1324 microversion: 2.1 time: 0.587053 Sep 10 21:14:15.535412 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2737/5383] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:14 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1324 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:16.399202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6e217dd5-44c2-48c3-9076-85a9d2d92af1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:16.400099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6e217dd5-44c2-48c3-9076-85a9d2d92af1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:16.407159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e217dd5-44c2-48c3-9076-85a9d2d92af1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:16.407652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e217dd5-44c2-48c3-9076-85a9d2d92af1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:16.408093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e217dd5-44c2-48c3-9076-85a9d2d92af1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:16.408799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e217dd5-44c2-48c3-9076-85a9d2d92af1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:16.409266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e217dd5-44c2-48c3-9076-85a9d2d92af1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:16.409698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e217dd5-44c2-48c3-9076-85a9d2d92af1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:16.558921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-11b91f15-37cc-4827-8c16-add4997e8556 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:16.560191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-11b91f15-37cc-4827-8c16-add4997e8556 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:16.570972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11b91f15-37cc-4827-8c16-add4997e8556 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:16.576038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11b91f15-37cc-4827-8c16-add4997e8556 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:16.576213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11b91f15-37cc-4827-8c16-add4997e8556 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:16.576977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11b91f15-37cc-4827-8c16-add4997e8556 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:16.577451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11b91f15-37cc-4827-8c16-add4997e8556 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:16.580528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11b91f15-37cc-4827-8c16-add4997e8556 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:16.615956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6e217dd5-44c2-48c3-9076-85a9d2d92af1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:16.632249 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6e217dd5-44c2-48c3-9076-85a9d2d92af1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1365 microversion: 2.1 time: 0.235902 Sep 10 21:14:16.634186 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2647/5384] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:16 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:16.789177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-11b91f15-37cc-4827-8c16-add4997e8556 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:16.800888 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-11b91f15-37cc-4827-8c16-add4997e8556 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1324 microversion: 2.1 time: 0.246322 Sep 10 21:14:16.802532 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2738/5385] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:16 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:17.656990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7501aee9-5107-41d3-b211-4d3e6a6c4181 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:17.657622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7501aee9-5107-41d3-b211-4d3e6a6c4181 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:17.664998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7501aee9-5107-41d3-b211-4d3e6a6c4181 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:17.665531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7501aee9-5107-41d3-b211-4d3e6a6c4181 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:17.666059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7501aee9-5107-41d3-b211-4d3e6a6c4181 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:17.666822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7501aee9-5107-41d3-b211-4d3e6a6c4181 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:17.667307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7501aee9-5107-41d3-b211-4d3e6a6c4181 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:17.667733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7501aee9-5107-41d3-b211-4d3e6a6c4181 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:17.672924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:17.820973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7501aee9-5107-41d3-b211-4d3e6a6c4181 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:17.824977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fa77e863-f3d8-46d0-9830-f152f4b0d44a tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:17.825977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fa77e863-f3d8-46d0-9830-f152f4b0d44a tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:17.833782 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7501aee9-5107-41d3-b211-4d3e6a6c4181 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1365 microversion: 2.1 time: 0.178060 Sep 10 21:14:17.833782 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2648/5386] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:17 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:17.835006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa77e863-f3d8-46d0-9830-f152f4b0d44a tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:17.835662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa77e863-f3d8-46d0-9830-f152f4b0d44a tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:17.836284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa77e863-f3d8-46d0-9830-f152f4b0d44a tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:17.838428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa77e863-f3d8-46d0-9830-f152f4b0d44a tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:17.838913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa77e863-f3d8-46d0-9830-f152f4b0d44a tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:17.839362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fa77e863-f3d8-46d0-9830-f152f4b0d44a tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:18.012682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fa77e863-f3d8-46d0-9830-f152f4b0d44a tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:18.021404 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fa77e863-f3d8-46d0-9830-f152f4b0d44a tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1324 microversion: 2.1 time: 0.201460 Sep 10 21:14:18.025945 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2739/5387] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:17 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1324 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:18.837047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:18.856964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-74ad4a62-2fc0-44d5-a7c1-9a80b440a083 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:18.857589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-74ad4a62-2fc0-44d5-a7c1-9a80b440a083 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:18.864656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:18.869419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ad4a62-2fc0-44d5-a7c1-9a80b440a083 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:18.870153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ad4a62-2fc0-44d5-a7c1-9a80b440a083 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:18.870948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ad4a62-2fc0-44d5-a7c1-9a80b440a083 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:18.871829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ad4a62-2fc0-44d5-a7c1-9a80b440a083 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:18.872978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ad4a62-2fc0-44d5-a7c1-9a80b440a083 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:18.874078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74ad4a62-2fc0-44d5-a7c1-9a80b440a083 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:18.879244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:18.913733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:19.038971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-62022022-63ab-4924-8726-2da5ffa0d25a req-9d9d611b-4344-432f-a7c2-3bb6601815a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e32f9e-ea2d-4481-ab27-9325f7349ce4", "name": "network-vif-plugged", "status": "completed", "tag": "634a5b75-d21e-4503-8aba-d6fbff6e4c07"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:19.049359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-62022022-63ab-4924-8726-2da5ffa0d25a req-9d9d611b-4344-432f-a7c2-3bb6601815a5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:19.049914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-62022022-63ab-4924-8726-2da5ffa0d25a req-9d9d611b-4344-432f-a7c2-3bb6601815a5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:19.050317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-62022022-63ab-4924-8726-2da5ffa0d25a req-9d9d611b-4344-432f-a7c2-3bb6601815a5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:19.056902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-74ad4a62-2fc0-44d5-a7c1-9a80b440a083 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:19.064179 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-62022022-63ab-4924-8726-2da5ffa0d25a req-9d9d611b-4344-432f-a7c2-3bb6601815a5 service nova] Creating event network-vif-plugged:634a5b75-d21e-4503-8aba-d6fbff6e4c07 for instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 on nch2-master-1 Sep 10 21:14:19.064933 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-74ad4a62-2fc0-44d5-a7c1-9a80b440a083 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1365 microversion: 2.1 time: 0.212936 Sep 10 21:14:19.065525 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2740/5388] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:18 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:19.070212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9cffd9ff-6563-49d6-825e-2b3d9f9d2838 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:19.070549 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-62022022-63ab-4924-8726-2da5ffa0d25a req-9d9d611b-4344-432f-a7c2-3bb6601815a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240409 Sep 10 21:14:19.070831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9cffd9ff-6563-49d6-825e-2b3d9f9d2838 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:19.071238 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2649/5389] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:19.079742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cffd9ff-6563-49d6-825e-2b3d9f9d2838 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:19.080245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cffd9ff-6563-49d6-825e-2b3d9f9d2838 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:19.080682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cffd9ff-6563-49d6-825e-2b3d9f9d2838 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:19.081573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cffd9ff-6563-49d6-825e-2b3d9f9d2838 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:19.082176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cffd9ff-6563-49d6-825e-2b3d9f9d2838 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:19.082830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cffd9ff-6563-49d6-825e-2b3d9f9d2838 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:19.328689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9cffd9ff-6563-49d6-825e-2b3d9f9d2838 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:19.336821 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9cffd9ff-6563-49d6-825e-2b3d9f9d2838 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1324 microversion: 2.1 time: 0.270204 Sep 10 21:14:19.337536 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2741/5390] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:19 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:20.092020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a2b5c37-37b7-44d1-a863-4e0afeaa5d4f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:20.092878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4a2b5c37-37b7-44d1-a863-4e0afeaa5d4f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:20.100387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2b5c37-37b7-44d1-a863-4e0afeaa5d4f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:20.101014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2b5c37-37b7-44d1-a863-4e0afeaa5d4f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:20.101530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2b5c37-37b7-44d1-a863-4e0afeaa5d4f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:20.102405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2b5c37-37b7-44d1-a863-4e0afeaa5d4f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:20.103121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2b5c37-37b7-44d1-a863-4e0afeaa5d4f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:20.103543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a2b5c37-37b7-44d1-a863-4e0afeaa5d4f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:20.249717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4a2b5c37-37b7-44d1-a863-4e0afeaa5d4f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:20.258262 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a2b5c37-37b7-44d1-a863-4e0afeaa5d4f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1365 microversion: 2.1 time: 0.171715 Sep 10 21:14:20.260375 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2650/5391] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:20 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:20.360142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7ce46a93-b3ee-4c11-b21d-b0549d8478fc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:20.360813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7ce46a93-b3ee-4c11-b21d-b0549d8478fc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:20.367588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ce46a93-b3ee-4c11-b21d-b0549d8478fc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:20.368188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ce46a93-b3ee-4c11-b21d-b0549d8478fc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:20.368921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ce46a93-b3ee-4c11-b21d-b0549d8478fc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:20.369719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ce46a93-b3ee-4c11-b21d-b0549d8478fc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:20.370412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ce46a93-b3ee-4c11-b21d-b0549d8478fc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:20.370847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ce46a93-b3ee-4c11-b21d-b0549d8478fc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:20.528375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7ce46a93-b3ee-4c11-b21d-b0549d8478fc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:20.537417 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7ce46a93-b3ee-4c11-b21d-b0549d8478fc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1324 microversion: 2.1 time: 0.181165 Sep 10 21:14:20.538319 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2742/5392] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:20 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1324 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:21.086107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-569b7c69-49d9-4080-a083-983f6c81d9a1 req-480fff3d-6e1f-4497-af1c-c68858cb8230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4a66f1f-4d8e-482f-8ebf-54f1e70c587e", "name": "network-vif-plugged", "status": "completed", "tag": "0002a5df-8f06-41c4-9e08-ab9e9c64dbd1"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:21.096451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-569b7c69-49d9-4080-a083-983f6c81d9a1 req-480fff3d-6e1f-4497-af1c-c68858cb8230 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:21.097018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-569b7c69-49d9-4080-a083-983f6c81d9a1 req-480fff3d-6e1f-4497-af1c-c68858cb8230 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:21.097341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-569b7c69-49d9-4080-a083-983f6c81d9a1 req-480fff3d-6e1f-4497-af1c-c68858cb8230 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:21.109453 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-569b7c69-49d9-4080-a083-983f6c81d9a1 req-480fff3d-6e1f-4497-af1c-c68858cb8230 service nova] Creating event network-vif-plugged:0002a5df-8f06-41c4-9e08-ab9e9c64dbd1 for instance a4a66f1f-4d8e-482f-8ebf-54f1e70c587e on nch2-master-1 Sep 10 21:14:21.115012 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-569b7c69-49d9-4080-a083-983f6c81d9a1 req-480fff3d-6e1f-4497-af1c-c68858cb8230 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032656 Sep 10 21:14:21.116070 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2651/5393] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:21.284125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a34fa35e-f463-4062-bca9-da83123df213 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:21.284801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a34fa35e-f463-4062-bca9-da83123df213 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:21.291955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a34fa35e-f463-4062-bca9-da83123df213 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:21.292468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a34fa35e-f463-4062-bca9-da83123df213 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:21.292894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a34fa35e-f463-4062-bca9-da83123df213 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:21.293613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a34fa35e-f463-4062-bca9-da83123df213 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:21.294115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a34fa35e-f463-4062-bca9-da83123df213 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:21.294561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a34fa35e-f463-4062-bca9-da83123df213 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:21.483109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a34fa35e-f463-4062-bca9-da83123df213 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:21.491224 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a34fa35e-f463-4062-bca9-da83123df213 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1555 microversion: 2.1 time: 0.211522 Sep 10 21:14:21.492005 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2743/5394] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:21 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:21.516498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-57110664-29bf-4400-a5d7-e5ace15fd3f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:21.517204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-57110664-29bf-4400-a5d7-e5ace15fd3f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:21.523834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57110664-29bf-4400-a5d7-e5ace15fd3f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:21.525199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57110664-29bf-4400-a5d7-e5ace15fd3f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:21.525641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57110664-29bf-4400-a5d7-e5ace15fd3f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:21.526545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57110664-29bf-4400-a5d7-e5ace15fd3f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:21.527151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57110664-29bf-4400-a5d7-e5ace15fd3f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:21.527890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-57110664-29bf-4400-a5d7-e5ace15fd3f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:21.563824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-504d3a89-b328-4df9-ac4d-6326115ccbdc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:21.565248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-504d3a89-b328-4df9-ac4d-6326115ccbdc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:21.575037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-504d3a89-b328-4df9-ac4d-6326115ccbdc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:21.575843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-504d3a89-b328-4df9-ac4d-6326115ccbdc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:21.576468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-504d3a89-b328-4df9-ac4d-6326115ccbdc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:21.577357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-504d3a89-b328-4df9-ac4d-6326115ccbdc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:21.578423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-504d3a89-b328-4df9-ac4d-6326115ccbdc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:21.579031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-504d3a89-b328-4df9-ac4d-6326115ccbdc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:21.619389 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-57110664-29bf-4400-a5d7-e5ace15fd3f1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109047 Sep 10 21:14:21.620119 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2652/5395] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:14:21 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:21.737280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-504d3a89-b328-4df9-ac4d-6326115ccbdc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:21.750656 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-504d3a89-b328-4df9-ac4d-6326115ccbdc tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1324 microversion: 2.1 time: 0.191540 Sep 10 21:14:21.751256 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2744/5396] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:21 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1324 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:22.777896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a21ed0c6-5635-4a94-bce2-98e09a524d12 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:22.778530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a21ed0c6-5635-4a94-bce2-98e09a524d12 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:22.784715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a21ed0c6-5635-4a94-bce2-98e09a524d12 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:22.785210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a21ed0c6-5635-4a94-bce2-98e09a524d12 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:22.786112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a21ed0c6-5635-4a94-bce2-98e09a524d12 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:22.786828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a21ed0c6-5635-4a94-bce2-98e09a524d12 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:22.787314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a21ed0c6-5635-4a94-bce2-98e09a524d12 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:22.787914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a21ed0c6-5635-4a94-bce2-98e09a524d12 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:22.981937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-886d0347-3922-46e0-86b9-e0a252ebae7e req-c9cda59e-ae05-472c-8460-b595f14857a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e32f9e-ea2d-4481-ab27-9325f7349ce4", "tag": "634a5b75-d21e-4503-8aba-d6fbff6e4c07"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:22.995014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-886d0347-3922-46e0-86b9-e0a252ebae7e req-c9cda59e-ae05-472c-8460-b595f14857a2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:22.995452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-886d0347-3922-46e0-86b9-e0a252ebae7e req-c9cda59e-ae05-472c-8460-b595f14857a2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:22.995995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-886d0347-3922-46e0-86b9-e0a252ebae7e req-c9cda59e-ae05-472c-8460-b595f14857a2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:23.011694 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-886d0347-3922-46e0-86b9-e0a252ebae7e req-c9cda59e-ae05-472c-8460-b595f14857a2 service nova] Creating event network-changed:634a5b75-d21e-4503-8aba-d6fbff6e4c07 for instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 on nch2-master-1 Sep 10 21:14:23.020069 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-886d0347-3922-46e0-86b9-e0a252ebae7e req-c9cda59e-ae05-472c-8460-b595f14857a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040528 Sep 10 21:14:23.021393 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2745/5397] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:23.027450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a21ed0c6-5635-4a94-bce2-98e09a524d12 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:23.051200 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a21ed0c6-5635-4a94-bce2-98e09a524d12 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1520 microversion: 2.1 time: 0.279353 Sep 10 21:14:23.072705 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2653/5398] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:22 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:23.078099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:23.078672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:23.095074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:23.095943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:23.096291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:23.097406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:23.097892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:23.098430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:23.145812 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] HTTP exception thrown: Action 999 not found Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Request method failure captured: Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e/os-instance-actions/999 HTTP/1.1 Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP4fsFJlDASHewwcHGui6cnbqgx5tra0BtJ1J-mbfX5Nq0F2efqTPQ1nhfryTlYv0Y-g_ZHVxF6tuZL91eXzpSjlzBsGXKJHiVojTxJmvvplNwz6OpLHfjSxjcuboO3lbRcGV-cogql_i2km7sVMqcN06wGNLGnEvrIajHJ9xjfF0jM Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: d2931f7a57c6444db783288bda1a74b8 Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1677814366 Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2931f7a57c6444db783288bda1a74b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2931f7a57c6444db783288bda1a74b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2931f7a57c6444db783288bda1a74b8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2931f7a57c6444db783288bda1a74b8"}]}] Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1677814366 Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: d2931f7a57c6444db783288bda1a74b8 Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1677814366 Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-InstanceActionsNegativeTestJSON-1677814366-project Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9bbe85c6ecdb49a8b186a8cb6e1f400e Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1677814366-project Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: exception: Action 999 not found Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'server_id': 'a4a66f1f-4d8e-482f-8ebf-54f1e70c587e', 'id': '999'} Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 10 21:14:23.151416 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:23.155858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Returning 404 to user: Action 999 not found {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:14:23.156874 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ccceab47-1d39-485b-8ca9-31a49f901053 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.083261 Sep 10 21:14:23.169592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-abe43648-80cf-48dd-83e8-fd536d67a8aa tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '.version_select at 0x7f993f9139d0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:23.170377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-abe43648-80cf-48dd-83e8-fd536d67a8aa tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: ff6aca3b-7a26-4fbb-8e35-e05470bf5832] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:23.178653 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2746/5399] 10.222.0.33 () {58 vars in 1308 bytes} [Sat Sep 10 21:14:23 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e/os-instance-actions/999 => generated 66 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 21:14:23.183403 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-abe43648-80cf-48dd-83e8-fd536d67a8aa tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] HTTP exception thrown: Instance ff6aca3b-7a26-4fbb-8e35-e05470bf5832 could not be found. Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-abe43648-80cf-48dd-83e8-fd536d67a8aa tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Request method failure captured: Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/ff6aca3b-7a26-4fbb-8e35-e05470bf5832/os-instance-actions HTTP/1.1 Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP4fsFJlDASHewwcHGui6cnbqgx5tra0BtJ1J-mbfX5Nq0F2efqTPQ1nhfryTlYv0Y-g_ZHVxF6tuZL91eXzpSjlzBsGXKJHiVojTxJmvvplNwz6OpLHfjSxjcuboO3lbRcGV-cogql_i2km7sVMqcN06wGNLGnEvrIajHJ9xjfF0jM Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d2931f7a57c6444db783288bda1a74b8 Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1677814366 Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2931f7a57c6444db783288bda1a74b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2931f7a57c6444db783288bda1a74b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2931f7a57c6444db783288bda1a74b8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2931f7a57c6444db783288bda1a74b8"}]}] Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1677814366 Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d2931f7a57c6444db783288bda1a74b8 Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1677814366 Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-InstanceActionsNegativeTestJSON-1677814366-project Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 9bbe85c6ecdb49a8b186a8cb6e1f400e Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1677814366-project Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: method: Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance ff6aca3b-7a26-4fbb-8e35-e05470bf5832 could not be found. Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'server_id': 'ff6aca3b-7a26-4fbb-8e35-e05470bf5832'} Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff6aca3b-7a26-4fbb-8e35-e05470bf5832 could not be found. Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:14:23.186836 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff6aca3b-7a26-4fbb-8e35-e05470bf5832 could not be found. Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff6aca3b-7a26-4fbb-8e35-e05470bf5832 could not be found. Sep 10 21:14:23.190533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:14:23.192357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-abe43648-80cf-48dd-83e8-fd536d67a8aa tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Returning 404 to user: Instance ff6aca3b-7a26-4fbb-8e35-e05470bf5832 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:14:23.193371 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-abe43648-80cf-48dd-83e8-fd536d67a8aa tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/ff6aca3b-7a26-4fbb-8e35-e05470bf5832/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.029967 Sep 10 21:14:23.194556 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2654/5400] 10.222.0.33 () {58 vars in 1296 bytes} [Sat Sep 10 21:14:23 2022] GET /compute/v2.1/servers/ff6aca3b-7a26-4fbb-8e35-e05470bf5832/os-instance-actions => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:14:23.204557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96235981-b6c2-4a78-80dc-94104985eb1f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:23.205440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96235981-b6c2-4a78-80dc-94104985eb1f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:23.216107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96235981-b6c2-4a78-80dc-94104985eb1f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:23.217435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96235981-b6c2-4a78-80dc-94104985eb1f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:23.218099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96235981-b6c2-4a78-80dc-94104985eb1f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:23.219464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96235981-b6c2-4a78-80dc-94104985eb1f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:23.220089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96235981-b6c2-4a78-80dc-94104985eb1f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:23.220675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96235981-b6c2-4a78-80dc-94104985eb1f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:23.256358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96235981-b6c2-4a78-80dc-94104985eb1f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:14:23.375755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:23.390198 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96235981-b6c2-4a78-80dc-94104985eb1f tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 204 len: 0 microversion: 2.1 time: 0.186296 Sep 10 21:14:23.390903 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2747/5401] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:14:23 2022] DELETE /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:14:23.400896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9b7615e8-d524-4292-9fd0-81a9be5d0e7c tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:23.402750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9b7615e8-d524-4292-9fd0-81a9be5d0e7c tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:23.410992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b7615e8-d524-4292-9fd0-81a9be5d0e7c tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:23.411489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b7615e8-d524-4292-9fd0-81a9be5d0e7c tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:23.411983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b7615e8-d524-4292-9fd0-81a9be5d0e7c tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:23.412685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b7615e8-d524-4292-9fd0-81a9be5d0e7c tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:23.413360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b7615e8-d524-4292-9fd0-81a9be5d0e7c tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:23.414010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b7615e8-d524-4292-9fd0-81a9be5d0e7c tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:23.568775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9b7615e8-d524-4292-9fd0-81a9be5d0e7c tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:23.577772 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9b7615e8-d524-4292-9fd0-81a9be5d0e7c tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1526 microversion: 2.1 time: 0.182556 Sep 10 21:14:23.578530 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2655/5402] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:23 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1526 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:24.603380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-11acfe14-8ab4-40f2-a11b-2425dc171702 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:24.604504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-11acfe14-8ab4-40f2-a11b-2425dc171702 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:24.612688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acfe14-8ab4-40f2-a11b-2425dc171702 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:24.613251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acfe14-8ab4-40f2-a11b-2425dc171702 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:24.613775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acfe14-8ab4-40f2-a11b-2425dc171702 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:24.614606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acfe14-8ab4-40f2-a11b-2425dc171702 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:24.615230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acfe14-8ab4-40f2-a11b-2425dc171702 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:24.615812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-11acfe14-8ab4-40f2-a11b-2425dc171702 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:24.834560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-11acfe14-8ab4-40f2-a11b-2425dc171702 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:24.843506 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-11acfe14-8ab4-40f2-a11b-2425dc171702 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1526 microversion: 2.1 time: 0.244978 Sep 10 21:14:24.844277 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2748/5403] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:24 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1526 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:25.654597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1a2a060f-9a8b-4626-a7d0-4c128d9cd9c5 req-150260bc-0f74-4148-94f0-3aa6b6bded61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4a66f1f-4d8e-482f-8ebf-54f1e70c587e", "name": "network-vif-deleted", "tag": "0002a5df-8f06-41c4-9e08-ab9e9c64dbd1"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:25.672443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1a2a060f-9a8b-4626-a7d0-4c128d9cd9c5 req-150260bc-0f74-4148-94f0-3aa6b6bded61 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:25.673434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1a2a060f-9a8b-4626-a7d0-4c128d9cd9c5 req-150260bc-0f74-4148-94f0-3aa6b6bded61 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:25.674151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1a2a060f-9a8b-4626-a7d0-4c128d9cd9c5 req-150260bc-0f74-4148-94f0-3aa6b6bded61 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:25.690755 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1a2a060f-9a8b-4626-a7d0-4c128d9cd9c5 req-150260bc-0f74-4148-94f0-3aa6b6bded61 service nova] Creating event network-vif-deleted:0002a5df-8f06-41c4-9e08-ab9e9c64dbd1 for instance a4a66f1f-4d8e-482f-8ebf-54f1e70c587e on nch2-master-1 Sep 10 21:14:25.696665 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1a2a060f-9a8b-4626-a7d0-4c128d9cd9c5 req-150260bc-0f74-4148-94f0-3aa6b6bded61 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046493 Sep 10 21:14:25.697372 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2656/5404] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:25.870012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:25.870822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:25.877445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:25.877961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:25.878399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:25.879103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:25.879558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:25.879983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:25.913248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:25.913726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:25.914187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:25.914640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lazy-loading 'fault' on Instance uuid a4a66f1f-4d8e-482f-8ebf-54f1e70c587e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:14:25.957716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbe85c6ecdb49a8b186a8cb6e1f400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2931f7a57c6444db783288bda1a74b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:25.965594 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0870553e-6a92-4eae-ac5e-f6b6adaff716 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 200 len: 1314 microversion: 2.1 time: 0.100569 Sep 10 21:14:25.966197 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2749/5405] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:25 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 1314 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:26.989162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:26.989906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] [instance: a4a66f1f-4d8e-482f-8ebf-54f1e70c587e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:26.997127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:26.997621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:26.998103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:26.998809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:26.999341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:26.999758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:27.013914 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] HTTP exception thrown: Instance a4a66f1f-4d8e-482f-8ebf-54f1e70c587e could not be found. Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Request method failure captured: Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e HTTP/1.1 Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP4fsFJlDASHewwcHGui6cnbqgx5tra0BtJ1J-mbfX5Nq0F2efqTPQ1nhfryTlYv0Y-g_ZHVxF6tuZL91eXzpSjlzBsGXKJHiVojTxJmvvplNwz6OpLHfjSxjcuboO3lbRcGV-cogql_i2km7sVMqcN06wGNLGnEvrIajHJ9xjfF0jM Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: d2931f7a57c6444db783288bda1a74b8 Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1677814366 Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2931f7a57c6444db783288bda1a74b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2931f7a57c6444db783288bda1a74b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2931f7a57c6444db783288bda1a74b8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2931f7a57c6444db783288bda1a74b8"}]}] Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1677814366 Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: d2931f7a57c6444db783288bda1a74b8 Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1677814366 Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-InstanceActionsNegativeTestJSON-1677814366-project Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 9bbe85c6ecdb49a8b186a8cb6e1f400e Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1677814366-project Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance a4a66f1f-4d8e-482f-8ebf-54f1e70c587e could not be found. Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'a4a66f1f-4d8e-482f-8ebf-54f1e70c587e'} Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4a66f1f-4d8e-482f-8ebf-54f1e70c587e could not be found. Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4a66f1f-4d8e-482f-8ebf-54f1e70c587e could not be found. Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:14:27.015584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4a66f1f-4d8e-482f-8ebf-54f1e70c587e could not be found. Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] Returning 404 to user: Instance a4a66f1f-4d8e-482f-8ebf-54f1e70c587e could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5e12b925-2107-4fbb-a1e7-4ffb009eae25 tempest-InstanceActionsNegativeTestJSON-1677814366 tempest-InstanceActionsNegativeTestJSON-1677814366-project] 10.222.0.33 "GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e" status: 404 len: 111 microversion: 2.1 time: 0.032141 Sep 10 21:14:27.019596 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2657/5406] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:26 2022] GET /compute/v2.1/servers/a4a66f1f-4d8e-482f-8ebf-54f1e70c587e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:14:36.242200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:36.242933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:36.387036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-183594564", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "778c3bb1-23f3-4437-92ca-7ee555ccd991"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:36.456040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] validate_networks() for [('778c3bb1-23f3-4437-92ca-7ee555ccd991', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:14:37.052379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:14:37.052800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:14:37.053285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:14:37.053684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:14:37.054118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:14:37.063218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:37.063701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:37.064140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:37.064874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:37.065327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:37.065748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:37.084372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Getting quotas for project f5c9ea913d214c569e6d6c3c1327f43a. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:14:37.090796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Getting quotas for user 9b7e48fd0dab42d3a904f7a07b939011 and project f5c9ea913d214c569e6d6c3c1327f43a. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:14:37.102929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Going to run 3 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:14:37.105536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:14:37.142474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: c529e350-a097-4506-a06b-48cde8ec0496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=3964ac47-a047-40af-a52e-1b8eca583f63,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:14:37.187072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=c529e350-a097-4506-a06b-48cde8ec0496,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:14:37.267410 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a9e35ecc-4044-4e92-9823-cd1218c8479c tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031753 Sep 10 21:14:37.268281 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2750/5407] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:14:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:14:37.279610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-abc6cf01-555e-487a-8cc1-c723899bbe47 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:37.284597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-abc6cf01-555e-487a-8cc1-c723899bbe47 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:37.285373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-abc6cf01-555e-487a-8cc1-c723899bbe47 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Searching by: {'deleted': False, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:14:37.287861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=29 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:37.288522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=34 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:37.318749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abc6cf01-555e-487a-8cc1-c723899bbe47 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:37.319245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abc6cf01-555e-487a-8cc1-c723899bbe47 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:37.319690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abc6cf01-555e-487a-8cc1-c723899bbe47 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:37.320633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abc6cf01-555e-487a-8cc1-c723899bbe47 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:37.321968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abc6cf01-555e-487a-8cc1-c723899bbe47 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:37.323175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abc6cf01-555e-487a-8cc1-c723899bbe47 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:37.346249 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-abc6cf01-555e-487a-8cc1-c723899bbe47 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.070637 Sep 10 21:14:37.346847 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2658/5408] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 21:14:37 2022] GET /compute/v2.1/servers => generated 1015 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:37.360719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a813f5d8-c6ae-465f-8310-3ff87b07c330 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:37.361567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a813f5d8-c6ae-465f-8310-3ff87b07c330 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:37.452127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a813f5d8-c6ae-465f-8310-3ff87b07c330 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:37.462663 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a813f5d8-c6ae-465f-8310-3ff87b07c330 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1222 microversion: 2.1 time: 0.106342 Sep 10 21:14:37.464094 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2751/5409] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:37 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:38.489489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-65b54d70-e8ae-49af-b976-1ab1be709a78 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:38.490342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-65b54d70-e8ae-49af-b976-1ab1be709a78 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:38.504573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65b54d70-e8ae-49af-b976-1ab1be709a78 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:38.505058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65b54d70-e8ae-49af-b976-1ab1be709a78 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:38.505677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65b54d70-e8ae-49af-b976-1ab1be709a78 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:38.506489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65b54d70-e8ae-49af-b976-1ab1be709a78 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:38.506946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65b54d70-e8ae-49af-b976-1ab1be709a78 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:38.507372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65b54d70-e8ae-49af-b976-1ab1be709a78 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:38.584966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-65b54d70-e8ae-49af-b976-1ab1be709a78 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:38.599639 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-65b54d70-e8ae-49af-b976-1ab1be709a78 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1226 microversion: 2.1 time: 0.114756 Sep 10 21:14:38.600422 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2659/5410] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:38 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:38.923300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28e74ae5-338e-4efc-a135-7461e1d10944 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:38.923813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-28e74ae5-338e-4efc-a135-7461e1d10944 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:38.932269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28e74ae5-338e-4efc-a135-7461e1d10944 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:38.933029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28e74ae5-338e-4efc-a135-7461e1d10944 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:38.933464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28e74ae5-338e-4efc-a135-7461e1d10944 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:38.934200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28e74ae5-338e-4efc-a135-7461e1d10944 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:38.934799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28e74ae5-338e-4efc-a135-7461e1d10944 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:38.935232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28e74ae5-338e-4efc-a135-7461e1d10944 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:38.966817 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-28e74ae5-338e-4efc-a135-7461e1d10944 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments/c9338801-901c-402e-9f20-3c7626c11b89" status: 200 len: 194 microversion: 2.20 time: 0.047447 Sep 10 21:14:38.967561 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2752/5411] 10.222.0.33 () {60 vars in 1454 bytes} [Sat Sep 10 21:14:38 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments/c9338801-901c-402e-9f20-3c7626c11b89 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:14:39.059176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cdc82bcb-b60b-4302-90ed-bfb44618a852 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:39.059685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cdc82bcb-b60b-4302-90ed-bfb44618a852 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:39.065772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc82bcb-b60b-4302-90ed-bfb44618a852 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:39.066282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc82bcb-b60b-4302-90ed-bfb44618a852 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:39.066719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc82bcb-b60b-4302-90ed-bfb44618a852 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:39.067416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc82bcb-b60b-4302-90ed-bfb44618a852 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:39.068036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc82bcb-b60b-4302-90ed-bfb44618a852 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:39.068459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cdc82bcb-b60b-4302-90ed-bfb44618a852 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:39.203271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-cdc82bcb-b60b-4302-90ed-bfb44618a852 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lazy-loading 'services' on Instance uuid 7919a6b0-623c-440c-bece-f3879f6a89ab {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:14:39.362932 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cdc82bcb-b60b-4302-90ed-bfb44618a852 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments/c9338801-901c-402e-9f20-3c7626c11b89" status: 202 len: 0 microversion: 2.20 time: 0.308809 Sep 10 21:14:39.363768 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2660/5412] 10.222.0.33 () {60 vars in 1457 bytes} [Sat Sep 10 21:14:39 2022] DELETE /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments/c9338801-901c-402e-9f20-3c7626c11b89 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:14:39.374680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-78a099e2-05de-497a-a1db-4ed1dc8715b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:39.377672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-78a099e2-05de-497a-a1db-4ed1dc8715b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:39.418763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78a099e2-05de-497a-a1db-4ed1dc8715b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:39.420164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78a099e2-05de-497a-a1db-4ed1dc8715b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:39.420634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78a099e2-05de-497a-a1db-4ed1dc8715b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:39.421382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78a099e2-05de-497a-a1db-4ed1dc8715b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:39.428802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78a099e2-05de-497a-a1db-4ed1dc8715b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:39.429401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78a099e2-05de-497a-a1db-4ed1dc8715b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:39.512288 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-78a099e2-05de-497a-a1db-4ed1dc8715b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143889 Sep 10 21:14:39.514102 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2753/5413] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Sep 10 21:14:39 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 21:14:39.625648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8da270fe-fab7-4a27-b96a-c654165c2224 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:39.626385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8da270fe-fab7-4a27-b96a-c654165c2224 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:39.646742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8da270fe-fab7-4a27-b96a-c654165c2224 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:39.647252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8da270fe-fab7-4a27-b96a-c654165c2224 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:39.647687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8da270fe-fab7-4a27-b96a-c654165c2224 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:39.648584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8da270fe-fab7-4a27-b96a-c654165c2224 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:39.649223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8da270fe-fab7-4a27-b96a-c654165c2224 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:39.649569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8da270fe-fab7-4a27-b96a-c654165c2224 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:39.811333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8da270fe-fab7-4a27-b96a-c654165c2224 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:39.823100 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8da270fe-fab7-4a27-b96a-c654165c2224 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1274 microversion: 2.1 time: 0.201432 Sep 10 21:14:39.830505 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2661/5414] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:39 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:40.531389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ff32c9d5-9850-40b4-b28e-03f41dca941b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:40.533607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ff32c9d5-9850-40b4-b28e-03f41dca941b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:40.551390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff32c9d5-9850-40b4-b28e-03f41dca941b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:40.553277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff32c9d5-9850-40b4-b28e-03f41dca941b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:40.553900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff32c9d5-9850-40b4-b28e-03f41dca941b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:40.554776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff32c9d5-9850-40b4-b28e-03f41dca941b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:40.558938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff32c9d5-9850-40b4-b28e-03f41dca941b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:40.560558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff32c9d5-9850-40b4-b28e-03f41dca941b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:40.639182 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ff32c9d5-9850-40b4-b28e-03f41dca941b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115512 Sep 10 21:14:40.640520 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2754/5415] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Sep 10 21:14:40 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:14:40.760479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8e087e8-0e66-4611-ad8c-5a86fc9aef82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:40.764000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8e087e8-0e66-4611-ad8c-5a86fc9aef82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:40.781876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8e087e8-0e66-4611-ad8c-5a86fc9aef82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:40.784146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8e087e8-0e66-4611-ad8c-5a86fc9aef82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:40.786590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8e087e8-0e66-4611-ad8c-5a86fc9aef82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:40.787494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8e087e8-0e66-4611-ad8c-5a86fc9aef82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:40.789117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8e087e8-0e66-4611-ad8c-5a86fc9aef82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:40.792164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8e087e8-0e66-4611-ad8c-5a86fc9aef82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:40.858103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93ad71bd-4062-4cb5-9e63-e59f8bebf966 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:40.858718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-93ad71bd-4062-4cb5-9e63-e59f8bebf966 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:40.890593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93ad71bd-4062-4cb5-9e63-e59f8bebf966 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:40.894040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93ad71bd-4062-4cb5-9e63-e59f8bebf966 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:40.894860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93ad71bd-4062-4cb5-9e63-e59f8bebf966 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:40.897646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93ad71bd-4062-4cb5-9e63-e59f8bebf966 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:40.899901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93ad71bd-4062-4cb5-9e63-e59f8bebf966 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:40.900777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93ad71bd-4062-4cb5-9e63-e59f8bebf966 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:41.038094 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8e087e8-0e66-4611-ad8c-5a86fc9aef82 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.282308 Sep 10 21:14:41.053397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93ad71bd-4062-4cb5-9e63-e59f8bebf966 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:41.059708 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2662/5416] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:14:40 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:14:41.065754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3eeabd3d-68ab-49c7-8b7b-0070bd82d7cb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:41.072319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3eeabd3d-68ab-49c7-8b7b-0070bd82d7cb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:41.084400 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93ad71bd-4062-4cb5-9e63-e59f8bebf966 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1292 microversion: 2.1 time: 0.230763 Sep 10 21:14:41.085402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3eeabd3d-68ab-49c7-8b7b-0070bd82d7cb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:41.086099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3eeabd3d-68ab-49c7-8b7b-0070bd82d7cb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:41.086711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3eeabd3d-68ab-49c7-8b7b-0070bd82d7cb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:41.087585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3eeabd3d-68ab-49c7-8b7b-0070bd82d7cb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:41.088856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3eeabd3d-68ab-49c7-8b7b-0070bd82d7cb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:41.089690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3eeabd3d-68ab-49c7-8b7b-0070bd82d7cb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:41.101642 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2755/5417] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:40 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1292 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:41.656446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-151e60f1-334c-4144-a805-1dd6ebdb9ff0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:41.659494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-151e60f1-334c-4144-a805-1dd6ebdb9ff0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:41.667834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-151e60f1-334c-4144-a805-1dd6ebdb9ff0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:41.668632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-151e60f1-334c-4144-a805-1dd6ebdb9ff0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:41.669226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-151e60f1-334c-4144-a805-1dd6ebdb9ff0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:41.671009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-151e60f1-334c-4144-a805-1dd6ebdb9ff0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:41.671655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-151e60f1-334c-4144-a805-1dd6ebdb9ff0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:41.672243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-151e60f1-334c-4144-a805-1dd6ebdb9ff0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:41.718934 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-151e60f1-334c-4144-a805-1dd6ebdb9ff0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069688 Sep 10 21:14:41.720181 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2756/5418] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Sep 10 21:14:41 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:41.811181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c7a77680-8b01-4c75-b65e-43a1d9cf143c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:41.811960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c7a77680-8b01-4c75-b65e-43a1d9cf143c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:41.824594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7a77680-8b01-4c75-b65e-43a1d9cf143c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:41.825132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7a77680-8b01-4c75-b65e-43a1d9cf143c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:41.825578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7a77680-8b01-4c75-b65e-43a1d9cf143c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:41.826357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7a77680-8b01-4c75-b65e-43a1d9cf143c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:41.827647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7a77680-8b01-4c75-b65e-43a1d9cf143c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:41.828106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c7a77680-8b01-4c75-b65e-43a1d9cf143c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:41.873448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c7a77680-8b01-4c75-b65e-43a1d9cf143c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:14:41.922571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3eeabd3d-68ab-49c7-8b7b-0070bd82d7cb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:41.938885 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3eeabd3d-68ab-49c7-8b7b-0070bd82d7cb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1672 microversion: 2.1 time: 0.877379 Sep 10 21:14:41.941090 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2663/5419] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:41 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1672 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:42.076989 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c7a77680-8b01-4c75-b65e-43a1d9cf143c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 204 len: 0 microversion: 2.20 time: 0.278182 Sep 10 21:14:42.077908 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2757/5420] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:14:41 2022] DELETE /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 21:14:42.095737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:42.097547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:42.116918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-22179f7b-234e-41f2-aba7-dfc19d330e90 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:42.118081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-22179f7b-234e-41f2-aba7-dfc19d330e90 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:42.124068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:42.127110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:42.127894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:42.129221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:42.130721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:42.133187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:42.135491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22179f7b-234e-41f2-aba7-dfc19d330e90 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:42.138331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22179f7b-234e-41f2-aba7-dfc19d330e90 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:42.140483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22179f7b-234e-41f2-aba7-dfc19d330e90 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:42.143245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22179f7b-234e-41f2-aba7-dfc19d330e90 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:42.145272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22179f7b-234e-41f2-aba7-dfc19d330e90 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:42.151550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22179f7b-234e-41f2-aba7-dfc19d330e90 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:42.287149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-22179f7b-234e-41f2-aba7-dfc19d330e90 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:42.295329 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-22179f7b-234e-41f2-aba7-dfc19d330e90 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1280 microversion: 2.1 time: 0.184393 Sep 10 21:14:42.295940 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2758/5421] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:42 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:42.422452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:42.430983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:42.433507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:42.434764 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2cbc4365-f1c9-4940-a44a-d67e9e62c730 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1723 microversion: 2.20 time: 0.352250 Sep 10 21:14:42.435376 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2664/5422] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:42 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:14:42.982149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81ce4810-ed68-4757-a28c-efd1a9b4a6d8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:42.983461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81ce4810-ed68-4757-a28c-efd1a9b4a6d8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:42.991279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ce4810-ed68-4757-a28c-efd1a9b4a6d8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:42.991870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ce4810-ed68-4757-a28c-efd1a9b4a6d8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:42.992321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ce4810-ed68-4757-a28c-efd1a9b4a6d8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:42.993140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ce4810-ed68-4757-a28c-efd1a9b4a6d8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:42.993757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ce4810-ed68-4757-a28c-efd1a9b4a6d8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:42.994586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81ce4810-ed68-4757-a28c-efd1a9b4a6d8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:43.048838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0efa4e48-a60c-4298-a166-cd6a4217886d req-b6b59538-2916-4dc6-8818-d4d660bbe145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c529e350-a097-4506-a06b-48cde8ec0496", "tag": "623243eb-f9e2-4693-aa5e-1ae688494551"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:43.071496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0efa4e48-a60c-4298-a166-cd6a4217886d req-b6b59538-2916-4dc6-8818-d4d660bbe145 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:43.073769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0efa4e48-a60c-4298-a166-cd6a4217886d req-b6b59538-2916-4dc6-8818-d4d660bbe145 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:43.074603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0efa4e48-a60c-4298-a166-cd6a4217886d req-b6b59538-2916-4dc6-8818-d4d660bbe145 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:43.092351 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0efa4e48-a60c-4298-a166-cd6a4217886d req-b6b59538-2916-4dc6-8818-d4d660bbe145 service nova] Creating event network-changed:623243eb-f9e2-4693-aa5e-1ae688494551 for instance c529e350-a097-4506-a06b-48cde8ec0496 on nch2-master-1 Sep 10 21:14:43.098468 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0efa4e48-a60c-4298-a166-cd6a4217886d req-b6b59538-2916-4dc6-8818-d4d660bbe145 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059377 Sep 10 21:14:43.099639 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2665/5423] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:43.171913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-81ce4810-ed68-4757-a28c-efd1a9b4a6d8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:43.180869 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81ce4810-ed68-4757-a28c-efd1a9b4a6d8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.210500 Sep 10 21:14:43.182984 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2759/5424] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:42 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:43.320888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-502b8be6-b674-4317-ba3e-dae1a8ca68bd tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:43.321890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-502b8be6-b674-4317-ba3e-dae1a8ca68bd tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:43.328288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-502b8be6-b674-4317-ba3e-dae1a8ca68bd tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:43.328960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-502b8be6-b674-4317-ba3e-dae1a8ca68bd tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:43.329550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-502b8be6-b674-4317-ba3e-dae1a8ca68bd tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:43.330297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-502b8be6-b674-4317-ba3e-dae1a8ca68bd tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:43.330752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-502b8be6-b674-4317-ba3e-dae1a8ca68bd tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:43.331251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-502b8be6-b674-4317-ba3e-dae1a8ca68bd tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:43.463807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:43.464610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:43.470687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:43.471181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:43.471626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:43.472343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:43.472794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:43.473232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:43.701506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:43.711548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:43.714700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:43.716087 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-25d88d75-f913-447e-9037-f03319a4bb93 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1723 microversion: 2.20 time: 0.256946 Sep 10 21:14:43.716742 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2760/5425] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:43 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:14:43.880694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-502b8be6-b674-4317-ba3e-dae1a8ca68bd tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:43.890084 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-502b8be6-b674-4317-ba3e-dae1a8ca68bd tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1322 microversion: 2.1 time: 0.573647 Sep 10 21:14:43.890923 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2666/5426] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:43 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1322 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:44.751757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:44.752912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:44.760870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:44.761668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:44.762143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:44.762869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:44.763474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:44.764048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:44.919306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-403e6b8b-5f6a-465e-8849-7fbae5ca37eb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:44.922240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-403e6b8b-5f6a-465e-8849-7fbae5ca37eb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:44.944178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-403e6b8b-5f6a-465e-8849-7fbae5ca37eb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:44.945296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-403e6b8b-5f6a-465e-8849-7fbae5ca37eb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:44.946071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-403e6b8b-5f6a-465e-8849-7fbae5ca37eb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:44.947021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-403e6b8b-5f6a-465e-8849-7fbae5ca37eb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:44.948874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-403e6b8b-5f6a-465e-8849-7fbae5ca37eb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:44.949563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-403e6b8b-5f6a-465e-8849-7fbae5ca37eb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:45.004540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:45.039094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:45.048732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:45.053495 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-71ab8901-0d6b-4374-9967-b5353fd5dfef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 200 len: 1656 microversion: 2.20 time: 0.302933 Sep 10 21:14:45.057194 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2761/5427] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:44 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 1656 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:14:45.158715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-88f95a7c-7e5a-45e5-adb1-daa0503af68d req-3c626634-c618-476d-b605-1a9ec704c541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96b3777-0127-496d-922a-69908440e634", "tag": "9211fa85-8f48-4dc8-a67f-17093c9c0a81"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:45.179556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-88f95a7c-7e5a-45e5-adb1-daa0503af68d req-3c626634-c618-476d-b605-1a9ec704c541 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:45.180284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-88f95a7c-7e5a-45e5-adb1-daa0503af68d req-3c626634-c618-476d-b605-1a9ec704c541 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:45.180928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-88f95a7c-7e5a-45e5-adb1-daa0503af68d req-3c626634-c618-476d-b605-1a9ec704c541 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:45.216887 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-88f95a7c-7e5a-45e5-adb1-daa0503af68d req-3c626634-c618-476d-b605-1a9ec704c541 service nova] Creating event network-changed:9211fa85-8f48-4dc8-a67f-17093c9c0a81 for instance b96b3777-0127-496d-922a-69908440e634 on nch1-master-1 Sep 10 21:14:45.227687 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-88f95a7c-7e5a-45e5-adb1-daa0503af68d req-3c626634-c618-476d-b605-1a9ec704c541 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073848 Sep 10 21:14:45.229981 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2762/5428] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:14:45.285617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3db9d9ef-4518-4035-91f7-fd22e0386af1 req-9e17f2f6-c1c0-4cfb-9ee7-5e12898b5565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7919a6b0-623c-440c-bece-f3879f6a89ab", "name": "network-vif-deleted", "tag": "07804208-07af-4af5-b975-15459b698f1d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:45.298119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3db9d9ef-4518-4035-91f7-fd22e0386af1 req-9e17f2f6-c1c0-4cfb-9ee7-5e12898b5565 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:45.298594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3db9d9ef-4518-4035-91f7-fd22e0386af1 req-9e17f2f6-c1c0-4cfb-9ee7-5e12898b5565 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:45.299024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3db9d9ef-4518-4035-91f7-fd22e0386af1 req-9e17f2f6-c1c0-4cfb-9ee7-5e12898b5565 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:45.321818 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3db9d9ef-4518-4035-91f7-fd22e0386af1 req-9e17f2f6-c1c0-4cfb-9ee7-5e12898b5565 service nova] Creating event network-vif-deleted:07804208-07af-4af5-b975-15459b698f1d for instance 7919a6b0-623c-440c-bece-f3879f6a89ab on nch1-master-1 Sep 10 21:14:45.334889 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3db9d9ef-4518-4035-91f7-fd22e0386af1 req-9e17f2f6-c1c0-4cfb-9ee7-5e12898b5565 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054236 Sep 10 21:14:45.335855 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2763/5429] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:45.782578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-403e6b8b-5f6a-465e-8849-7fbae5ca37eb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:45.794192 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-403e6b8b-5f6a-465e-8849-7fbae5ca37eb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1322 microversion: 2.1 time: 0.882792 Sep 10 21:14:45.795271 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2667/5430] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:44 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1322 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:46.086292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:46.086997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:46.094335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:46.095052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:46.095671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:46.096701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:46.097162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:46.097588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:46.114524 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] HTTP exception thrown: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Request method failure captured: Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab HTTP/1.1 Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP1wfHaSCfCkRxOxIe4AM5SN10Bur9bpB2r-9zd49iOEi5encqdNrfNiphzy_K82vOgdeKvxMeZc7GatseKAzB0POCphvQ5xHyBzt8yC_8J-mzSyQMeSKD4E75KvzK5wLqcvsR8uyn4QZyJVcdITVdeyWq_qxNpDNrQdijUD8je0Cco Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d055111e2e44ed7afe3b335094df69a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d055111e2e44ed7afe3b335094df69a"}]}] Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 3f03d688d0ee4d2b951828a3f496c914 Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '7919a6b0-623c-440c-bece-f3879f6a89ab'} Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:46.116521 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Returning 404 to user: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-52b3cac5-a64a-4b45-ba81-2db89c7a8ba2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 404 len: 111 microversion: 2.20 time: 0.037215 Sep 10 21:14:46.120397 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2764/5431] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:46 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:14:46.128544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f23e10f0-c701-478f-8b8f-c36cc6f2861d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '.version_select at 0x7f994459b940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:46.153311 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f23e10f0-c701-478f-8b8f-c36cc6f2861d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266236701" status: 204 len: 0 microversion: 2.20 time: 0.029220 Sep 10 21:14:46.161920 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2668/5432] 10.222.0.33 () {60 vars in 1259 bytes} [Sat Sep 10 21:14:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266236701 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 21:14:46.817057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b1c85c62-e135-4a33-80bb-6fd2d463d3bb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:46.817855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b1c85c62-e135-4a33-80bb-6fd2d463d3bb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:46.827932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c85c62-e135-4a33-80bb-6fd2d463d3bb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:46.834458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c85c62-e135-4a33-80bb-6fd2d463d3bb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:46.835217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c85c62-e135-4a33-80bb-6fd2d463d3bb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:46.836994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c85c62-e135-4a33-80bb-6fd2d463d3bb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:46.836994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c85c62-e135-4a33-80bb-6fd2d463d3bb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:46.837800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c85c62-e135-4a33-80bb-6fd2d463d3bb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:46.988729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8c108b3c-6f90-4d01-b283-4cd8864895a9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Action: 'create', calling method: .version_select at 0x7f993f8eadc0>, body: {"keypair": {"name": "tempest-keypair-1386136538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFO51PSUKRchg5RXNF3DtDA5LHMViFkV40xowPOCG7U+Xa6Lmp97nBNPWS1YpDOvhbNxjsu0yHgNAwuZa6KczvLrTIaQWy4y7KNa1iNQNs5wQudkSJY+Wd19cglGQVnfvg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:47.027479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-8c108b3c-6f90-4d01-b283-4cd8864895a9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Getting quotas for project 2d055111e2e44ed7afe3b335094df69a. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:14:47.037271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-8c108b3c-6f90-4d01-b283-4cd8864895a9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Getting quotas for user 3f03d688d0ee4d2b951828a3f496c914 and project 2d055111e2e44ed7afe3b335094df69a. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:14:47.066468 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8c108b3c-6f90-4d01-b283-4cd8864895a9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.081513 Sep 10 21:14:47.067186 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2669/5433] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Sep 10 21:14:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 10 21:14:47.070050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1c85c62-e135-4a33-80bb-6fd2d463d3bb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:47.073184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:47.080151 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b1c85c62-e135-4a33-80bb-6fd2d463d3bb tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1322 microversion: 2.1 time: 0.267255 Sep 10 21:14:47.080776 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2765/5434] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:46 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:47.270385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-381ac12d-a4f6-4288-931d-a6111a556ed9 req-039ebf67-afe5-4718-b2af-7b2731ce1349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3964ac47-a047-40af-a52e-1b8eca583f63", "tag": "445079fc-4327-492c-856f-9fc28de4864f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:47.283935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-381ac12d-a4f6-4288-931d-a6111a556ed9 req-039ebf67-afe5-4718-b2af-7b2731ce1349 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:47.284824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-381ac12d-a4f6-4288-931d-a6111a556ed9 req-039ebf67-afe5-4718-b2af-7b2731ce1349 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:47.285406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-381ac12d-a4f6-4288-931d-a6111a556ed9 req-039ebf67-afe5-4718-b2af-7b2731ce1349 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:47.304103 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-381ac12d-a4f6-4288-931d-a6111a556ed9 req-039ebf67-afe5-4718-b2af-7b2731ce1349 service nova] Creating event network-changed:445079fc-4327-492c-856f-9fc28de4864f for instance 3964ac47-a047-40af-a52e-1b8eca583f63 on nch1-master-1 Sep 10 21:14:47.313658 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-381ac12d-a4f6-4288-931d-a6111a556ed9 req-039ebf67-afe5-4718-b2af-7b2731ce1349 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048414 Sep 10 21:14:47.314581 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2670/5435] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:48.109432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2d4f0781-631b-4127-a216-19b3ef288d8d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:48.110188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2d4f0781-631b-4127-a216-19b3ef288d8d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:48.113213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:48.119981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d4f0781-631b-4127-a216-19b3ef288d8d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:48.120499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d4f0781-631b-4127-a216-19b3ef288d8d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:48.121206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d4f0781-631b-4127-a216-19b3ef288d8d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:48.121982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d4f0781-631b-4127-a216-19b3ef288d8d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:48.123160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d4f0781-631b-4127-a216-19b3ef288d8d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:48.123681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d4f0781-631b-4127-a216-19b3ef288d8d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:48.340277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2d4f0781-631b-4127-a216-19b3ef288d8d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:48.346973 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2d4f0781-631b-4127-a216-19b3ef288d8d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1322 microversion: 2.1 time: 0.242981 Sep 10 21:14:48.347778 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2766/5436] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:48 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:48.542035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:48.547937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-251925026", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d0a4717-d4e3-4410-baaa-82d0d71c8a06"}], "security_groups": [{"name": "tempest-securitygroup--1932508458"}], "key_name": "tempest-keypair-1386136538", "user_data": "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:48.819564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] validate_networks() for [('8d0a4717-d4e3-4410-baaa-82d0d71c8a06', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:14:48.929222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b4c96c7b-9749-4766-9f5f-4a85d5fa7eb7 req-a81069d1-0d97-4404-a524-9a12c173007c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c529e350-a097-4506-a06b-48cde8ec0496", "name": "network-vif-plugged", "status": "completed", "tag": "623243eb-f9e2-4693-aa5e-1ae688494551"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:48.945283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b4c96c7b-9749-4766-9f5f-4a85d5fa7eb7 req-a81069d1-0d97-4404-a524-9a12c173007c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:48.945971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b4c96c7b-9749-4766-9f5f-4a85d5fa7eb7 req-a81069d1-0d97-4404-a524-9a12c173007c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:48.946340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b4c96c7b-9749-4766-9f5f-4a85d5fa7eb7 req-a81069d1-0d97-4404-a524-9a12c173007c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:48.959854 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b4c96c7b-9749-4766-9f5f-4a85d5fa7eb7 req-a81069d1-0d97-4404-a524-9a12c173007c service nova] Creating event network-vif-plugged:623243eb-f9e2-4693-aa5e-1ae688494551 for instance c529e350-a097-4506-a06b-48cde8ec0496 on nch2-master-1 Sep 10 21:14:48.967066 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b4c96c7b-9749-4766-9f5f-4a85d5fa7eb7 req-a81069d1-0d97-4404-a524-9a12c173007c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042300 Sep 10 21:14:48.968186 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2767/5437] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:14:49.354693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:14:49.354994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:14:49.355603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:14:49.356094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:14:49.356588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:14:49.366244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:49.366809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:49.367386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:49.368185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:49.368706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:49.369933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:49.373072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f10e690-b37f-47c7-8949-663b1324a3b8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:49.373775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2f10e690-b37f-47c7-8949-663b1324a3b8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:49.382935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f10e690-b37f-47c7-8949-663b1324a3b8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:49.383559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f10e690-b37f-47c7-8949-663b1324a3b8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:49.384161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f10e690-b37f-47c7-8949-663b1324a3b8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:49.385093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f10e690-b37f-47c7-8949-663b1324a3b8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:49.385713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f10e690-b37f-47c7-8949-663b1324a3b8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:49.388655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Getting quotas for project 2d055111e2e44ed7afe3b335094df69a. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:14:49.389417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f10e690-b37f-47c7-8949-663b1324a3b8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:49.395174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Getting quotas for user 3f03d688d0ee4d2b951828a3f496c914 and project 2d055111e2e44ed7afe3b335094df69a. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:14:49.409962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:14:49.412610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:14:49.475412 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-15745144-3288-46dd-bff9-96dc7ada8701 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.934674 Sep 10 21:14:49.476575 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2671/5438] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 21:14:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 21:14:49.498510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-238105f8-d1e2-4f97-a95b-23640d117956 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:49.499239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-238105f8-d1e2-4f97-a95b-23640d117956 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:49.550606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2f10e690-b37f-47c7-8949-663b1324a3b8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:49.560439 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f10e690-b37f-47c7-8949-663b1324a3b8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1322 microversion: 2.1 time: 0.193187 Sep 10 21:14:49.561711 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2768/5439] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:49 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:49.576973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-238105f8-d1e2-4f97-a95b-23640d117956 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:49.585003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-238105f8-d1e2-4f97-a95b-23640d117956 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:49.586612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-238105f8-d1e2-4f97-a95b-23640d117956 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:49.589361 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-238105f8-d1e2-4f97-a95b-23640d117956 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1281 microversion: 2.20 time: 0.105079 Sep 10 21:14:49.590116 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2672/5440] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:49 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:14:50.583656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-64ba937d-8b91-4115-bda4-8bfee3af7d9d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:50.584272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-64ba937d-8b91-4115-bda4-8bfee3af7d9d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:50.592336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64ba937d-8b91-4115-bda4-8bfee3af7d9d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:50.592814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64ba937d-8b91-4115-bda4-8bfee3af7d9d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:50.593248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64ba937d-8b91-4115-bda4-8bfee3af7d9d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:50.593969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64ba937d-8b91-4115-bda4-8bfee3af7d9d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:50.594428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64ba937d-8b91-4115-bda4-8bfee3af7d9d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:50.594852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-64ba937d-8b91-4115-bda4-8bfee3af7d9d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:50.598999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:50.616843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:50.617451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:50.624619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:50.625102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:50.625538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:50.626258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:50.626713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:50.627143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:50.694318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:50.703560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:50.705021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:50.706195 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f959792-3063-4e37-bceb-4476f96f7b81 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1333 microversion: 2.20 time: 0.093280 Sep 10 21:14:50.706770 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2673/5441] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:50 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:14:50.734304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-64ba937d-8b91-4115-bda4-8bfee3af7d9d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:50.742042 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-64ba937d-8b91-4115-bda4-8bfee3af7d9d tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1322 microversion: 2.1 time: 0.162177 Sep 10 21:14:50.742618 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2769/5442] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:50 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:51.163305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1179659762", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:51.217038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] validate_networks() for None {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:14:51.732928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:51.733678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:51.741043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:51.741532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:51.742000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:51.742713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:51.743168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:51.743596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:51.811645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:51.820390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:51.821871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:51.823830 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bc46dc76-17da-4eb3-a3a7-0405caa581cf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1339 microversion: 2.20 time: 0.095639 Sep 10 21:14:51.824417 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2770/5443] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:51 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:14:51.829094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b9dd0da9-eb9a-4228-b96a-adcbd28f9cd2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:51.829718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b9dd0da9-eb9a-4228-b96a-adcbd28f9cd2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:51.836269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9dd0da9-eb9a-4228-b96a-adcbd28f9cd2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:51.836770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9dd0da9-eb9a-4228-b96a-adcbd28f9cd2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:51.837223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9dd0da9-eb9a-4228-b96a-adcbd28f9cd2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:51.838156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9dd0da9-eb9a-4228-b96a-adcbd28f9cd2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:51.838821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9dd0da9-eb9a-4228-b96a-adcbd28f9cd2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:51.839270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b9dd0da9-eb9a-4228-b96a-adcbd28f9cd2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:51.988997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b9dd0da9-eb9a-4228-b96a-adcbd28f9cd2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:51.996845 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b9dd0da9-eb9a-4228-b96a-adcbd28f9cd2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1322 microversion: 2.1 time: 0.171457 Sep 10 21:14:51.997609 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2771/5444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:51 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:52.178602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:14:52.179072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:14:52.179647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:14:52.180192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:14:52.180612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:14:52.189641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:52.190365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:52.190810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:52.191549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:52.192011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:52.192439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:52.210971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Getting quotas for project ff8f2031a94548e5bb3eea8bce391e8e. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:14:52.216810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Getting quotas for user 8db29080e8c047b88b33e61bf5270c35 and project ff8f2031a94548e5bb3eea8bce391e8e. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:14:52.229336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:14:52.232560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:14:52.287060 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-96575149-63bd-4c6b-b061-11cd5ce5532e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127584 Sep 10 21:14:52.288876 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2674/5445] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:14:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:14:52.300414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e2627e7-2b62-46b0-a818-6201b1255318 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:52.301229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e2627e7-2b62-46b0-a818-6201b1255318 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:52.365295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6e2627e7-2b62-46b0-a818-6201b1255318 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:52.374632 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e2627e7-2b62-46b0-a818-6201b1255318 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1215 microversion: 2.1 time: 0.077906 Sep 10 21:14:52.388429 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2772/5446] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:52 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:52.795151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c7d2f046-1ce5-40b4-9317-cfa00a5b0eb0 req-850ac683-86ed-46c0-84b2-8a5587fffa58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96b3777-0127-496d-922a-69908440e634", "name": "network-vif-plugged", "status": "completed", "tag": "9211fa85-8f48-4dc8-a67f-17093c9c0a81"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:52.818252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c7d2f046-1ce5-40b4-9317-cfa00a5b0eb0 req-850ac683-86ed-46c0-84b2-8a5587fffa58 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:52.818927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c7d2f046-1ce5-40b4-9317-cfa00a5b0eb0 req-850ac683-86ed-46c0-84b2-8a5587fffa58 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:52.819519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c7d2f046-1ce5-40b4-9317-cfa00a5b0eb0 req-850ac683-86ed-46c0-84b2-8a5587fffa58 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:52.839261 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c7d2f046-1ce5-40b4-9317-cfa00a5b0eb0 req-850ac683-86ed-46c0-84b2-8a5587fffa58 service nova] Creating event network-vif-plugged:9211fa85-8f48-4dc8-a67f-17093c9c0a81 for instance b96b3777-0127-496d-922a-69908440e634 on nch1-master-1 Sep 10 21:14:52.850774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:52.851523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:52.860123 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c7d2f046-1ce5-40b4-9317-cfa00a5b0eb0 req-850ac683-86ed-46c0-84b2-8a5587fffa58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067765 Sep 10 21:14:52.860469 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2675/5447] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:52.863887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:52.864828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:52.865649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:52.866585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:52.867200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:52.872845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:53.023832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8aec4372-ffa2-4e86-a518-05507dc41bb1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:53.024572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8aec4372-ffa2-4e86-a518-05507dc41bb1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:53.037273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8aec4372-ffa2-4e86-a518-05507dc41bb1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:53.037789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8aec4372-ffa2-4e86-a518-05507dc41bb1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:53.038272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8aec4372-ffa2-4e86-a518-05507dc41bb1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:53.039006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8aec4372-ffa2-4e86-a518-05507dc41bb1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:53.039488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8aec4372-ffa2-4e86-a518-05507dc41bb1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:53.046622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8aec4372-ffa2-4e86-a518-05507dc41bb1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:53.095011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:53.106347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:53.108729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:53.110006 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-749c68a0-ce4a-4dfa-9dda-e1dd6e70e7c9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1407 microversion: 2.20 time: 0.263899 Sep 10 21:14:53.113899 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2773/5448] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:52 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:14:53.324763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8aec4372-ffa2-4e86-a518-05507dc41bb1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:53.334028 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8aec4372-ffa2-4e86-a518-05507dc41bb1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1322 microversion: 2.1 time: 0.317177 Sep 10 21:14:53.334789 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2676/5449] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:53 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:53.398406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c448951-55f1-4a71-81aa-322d2fec1a8e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:53.398935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c448951-55f1-4a71-81aa-322d2fec1a8e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:53.405190 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c448951-55f1-4a71-81aa-322d2fec1a8e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:53.405674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c448951-55f1-4a71-81aa-322d2fec1a8e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:53.406175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c448951-55f1-4a71-81aa-322d2fec1a8e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:53.406839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c448951-55f1-4a71-81aa-322d2fec1a8e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:53.407293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c448951-55f1-4a71-81aa-322d2fec1a8e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:53.407721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c448951-55f1-4a71-81aa-322d2fec1a8e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:53.478142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c448951-55f1-4a71-81aa-322d2fec1a8e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:53.487971 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c448951-55f1-4a71-81aa-322d2fec1a8e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1267 microversion: 2.1 time: 0.093389 Sep 10 21:14:53.489060 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2774/5450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:53 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:53.795751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3d736522-46ed-4d08-ac13-3317daaa9665 req-2c8fb069-ae4c-405f-9950-96e40575b196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26", "tag": "0c8d8555-28a1-427f-b57c-affbeeda6daf"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:53.807503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3d736522-46ed-4d08-ac13-3317daaa9665 req-2c8fb069-ae4c-405f-9950-96e40575b196 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:53.807999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3d736522-46ed-4d08-ac13-3317daaa9665 req-2c8fb069-ae4c-405f-9950-96e40575b196 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:53.808439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3d736522-46ed-4d08-ac13-3317daaa9665 req-2c8fb069-ae4c-405f-9950-96e40575b196 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:53.823142 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3d736522-46ed-4d08-ac13-3317daaa9665 req-2c8fb069-ae4c-405f-9950-96e40575b196 service nova] Creating event network-changed:0c8d8555-28a1-427f-b57c-affbeeda6daf for instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 on nch2-master-1 Sep 10 21:14:53.827968 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3d736522-46ed-4d08-ac13-3317daaa9665 req-2c8fb069-ae4c-405f-9950-96e40575b196 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038402 Sep 10 21:14:53.828588 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2677/5451] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:54.135526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:54.136140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:54.143071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:54.143559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:54.143993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:54.144695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:54.145147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:54.145573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:54.288988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:54.298817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:54.300328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:54.301448 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ecc0e29e-688f-4744-ae37-dd4ddea3cbd5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1407 microversion: 2.20 time: 0.169939 Sep 10 21:14:54.302469 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2775/5452] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:54 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:14:54.357454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e96c5ebb-160a-4787-8d4c-83c271d303b1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:54.358194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e96c5ebb-160a-4787-8d4c-83c271d303b1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:54.364515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c5ebb-160a-4787-8d4c-83c271d303b1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:54.365010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c5ebb-160a-4787-8d4c-83c271d303b1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:54.365655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c5ebb-160a-4787-8d4c-83c271d303b1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:54.366402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c5ebb-160a-4787-8d4c-83c271d303b1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:54.366867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c5ebb-160a-4787-8d4c-83c271d303b1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:54.367330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c5ebb-160a-4787-8d4c-83c271d303b1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:54.512519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e96c5ebb-160a-4787-8d4c-83c271d303b1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:54.517375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0a99f3e3-4475-41fa-acf2-b02d6d1530ff tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:54.518170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0a99f3e3-4475-41fa-acf2-b02d6d1530ff tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:54.526355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a99f3e3-4475-41fa-acf2-b02d6d1530ff tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:54.527146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a99f3e3-4475-41fa-acf2-b02d6d1530ff tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:54.528635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a99f3e3-4475-41fa-acf2-b02d6d1530ff tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:54.529899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a99f3e3-4475-41fa-acf2-b02d6d1530ff tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:54.530570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a99f3e3-4475-41fa-acf2-b02d6d1530ff tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:54.531284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a99f3e3-4475-41fa-acf2-b02d6d1530ff tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:54.531454 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e96c5ebb-160a-4787-8d4c-83c271d303b1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1322 microversion: 2.1 time: 0.178519 Sep 10 21:14:54.532899 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2678/5453] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:54 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:54.602362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0a99f3e3-4475-41fa-acf2-b02d6d1530ff tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:54.610812 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0a99f3e3-4475-41fa-acf2-b02d6d1530ff tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1267 microversion: 2.1 time: 0.097823 Sep 10 21:14:54.611400 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2776/5454] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:54 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:54.876503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2d08c864-0c44-4ad1-95b5-079ff8b23f6c req-89a35d21-c54e-4aff-98a6-97406cec1003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3964ac47-a047-40af-a52e-1b8eca583f63", "name": "network-vif-plugged", "status": "completed", "tag": "445079fc-4327-492c-856f-9fc28de4864f"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:54.887562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2d08c864-0c44-4ad1-95b5-079ff8b23f6c req-89a35d21-c54e-4aff-98a6-97406cec1003 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:54.888037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2d08c864-0c44-4ad1-95b5-079ff8b23f6c req-89a35d21-c54e-4aff-98a6-97406cec1003 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:54.888471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2d08c864-0c44-4ad1-95b5-079ff8b23f6c req-89a35d21-c54e-4aff-98a6-97406cec1003 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:54.899436 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2d08c864-0c44-4ad1-95b5-079ff8b23f6c req-89a35d21-c54e-4aff-98a6-97406cec1003 service nova] Creating event network-vif-plugged:445079fc-4327-492c-856f-9fc28de4864f for instance 3964ac47-a047-40af-a52e-1b8eca583f63 on nch1-master-1 Sep 10 21:14:54.904283 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2d08c864-0c44-4ad1-95b5-079ff8b23f6c req-89a35d21-c54e-4aff-98a6-97406cec1003 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031592 Sep 10 21:14:54.904882 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2679/5455] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:55.327761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:55.328382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:55.335437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:55.335930 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:55.336400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:55.337106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:55.338091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:55.338520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:55.473572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:55.483350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:55.485035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:55.486362 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ef0dc80e-b374-478b-8e44-49d858d55aba tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1407 microversion: 2.20 time: 0.163132 Sep 10 21:14:55.487005 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2777/5456] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:55 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:14:55.558667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f6d31d1b-e49e-45a4-ac8c-a1e92902eec8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:55.559371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f6d31d1b-e49e-45a4-ac8c-a1e92902eec8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:55.565666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d31d1b-e49e-45a4-ac8c-a1e92902eec8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:55.566777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d31d1b-e49e-45a4-ac8c-a1e92902eec8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:55.566777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d31d1b-e49e-45a4-ac8c-a1e92902eec8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:55.567314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d31d1b-e49e-45a4-ac8c-a1e92902eec8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:55.567769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d31d1b-e49e-45a4-ac8c-a1e92902eec8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:55.568219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f6d31d1b-e49e-45a4-ac8c-a1e92902eec8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:55.635371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-43461adb-33e6-4599-8cd5-6cdf4ffc34ae tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:55.635871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-43461adb-33e6-4599-8cd5-6cdf4ffc34ae tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:55.642413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43461adb-33e6-4599-8cd5-6cdf4ffc34ae tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:55.642918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43461adb-33e6-4599-8cd5-6cdf4ffc34ae tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:55.643365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43461adb-33e6-4599-8cd5-6cdf4ffc34ae tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:55.644120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43461adb-33e6-4599-8cd5-6cdf4ffc34ae tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:55.644574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43461adb-33e6-4599-8cd5-6cdf4ffc34ae tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:55.645016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43461adb-33e6-4599-8cd5-6cdf4ffc34ae tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:55.713919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-43461adb-33e6-4599-8cd5-6cdf4ffc34ae tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:55.722156 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-43461adb-33e6-4599-8cd5-6cdf4ffc34ae tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1273 microversion: 2.1 time: 0.091161 Sep 10 21:14:55.722779 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2778/5457] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:55 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:55.895355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f6d31d1b-e49e-45a4-ac8c-a1e92902eec8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:55.903882 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f6d31d1b-e49e-45a4-ac8c-a1e92902eec8 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 200 len: 1514 microversion: 2.1 time: 0.350182 Sep 10 21:14:55.921676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2680/5458] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:55 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 1514 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:55.926972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96deb81f-82fb-474d-8db5-e2adb5bfc22b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:55.927587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96deb81f-82fb-474d-8db5-e2adb5bfc22b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: c529e350-a097-4506-a06b-48cde8ec0496] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:55.934875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96deb81f-82fb-474d-8db5-e2adb5bfc22b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:55.935504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96deb81f-82fb-474d-8db5-e2adb5bfc22b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:55.935953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96deb81f-82fb-474d-8db5-e2adb5bfc22b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:55.936699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96deb81f-82fb-474d-8db5-e2adb5bfc22b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:55.937156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96deb81f-82fb-474d-8db5-e2adb5bfc22b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:55.937593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96deb81f-82fb-474d-8db5-e2adb5bfc22b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:56.077252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-96deb81f-82fb-474d-8db5-e2adb5bfc22b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:56.088549 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96deb81f-82fb-474d-8db5-e2adb5bfc22b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496" status: 200 len: 1515 microversion: 2.1 time: 0.164842 Sep 10 21:14:56.089586 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2779/5459] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:55 2022] GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:56.111507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a96a957-4ee5-445d-862c-d68c924cfa2e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:56.112446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4a96a957-4ee5-445d-862c-d68c924cfa2e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:56.119550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a96a957-4ee5-445d-862c-d68c924cfa2e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:56.119858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a96a957-4ee5-445d-862c-d68c924cfa2e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:56.120244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a96a957-4ee5-445d-862c-d68c924cfa2e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:56.121163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a96a957-4ee5-445d-862c-d68c924cfa2e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:56.121852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a96a957-4ee5-445d-862c-d68c924cfa2e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:56.122443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a96a957-4ee5-445d-862c-d68c924cfa2e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:56.127504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:56.356962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4a96a957-4ee5-445d-862c-d68c924cfa2e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:56.365245 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a96a957-4ee5-445d-862c-d68c924cfa2e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 200 len: 1322 microversion: 2.1 time: 0.257934 Sep 10 21:14:56.365877 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2681/5460] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:56 2022] GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:56.512249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:56.512801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:56.519535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:56.520047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:56.520472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:56.521178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:56.522064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:56.522247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:56.686423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:56.694899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:56.696371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:56.697668 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ada8bb1-690e-422f-ac60-d27f3e4f8af6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1407 microversion: 2.20 time: 0.190272 Sep 10 21:14:56.698523 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2780/5461] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:56 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:14:56.748196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a2ffe1db-fd0b-49ce-bff3-e66a8645e866 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:56.748894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a2ffe1db-fd0b-49ce-bff3-e66a8645e866 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:56.755205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2ffe1db-fd0b-49ce-bff3-e66a8645e866 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:56.755707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2ffe1db-fd0b-49ce-bff3-e66a8645e866 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:56.756154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2ffe1db-fd0b-49ce-bff3-e66a8645e866 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:56.756884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2ffe1db-fd0b-49ce-bff3-e66a8645e866 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:56.757347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2ffe1db-fd0b-49ce-bff3-e66a8645e866 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:56.757779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2ffe1db-fd0b-49ce-bff3-e66a8645e866 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:57.226573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a2ffe1db-fd0b-49ce-bff3-e66a8645e866 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:57.235009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a2ffe1db-fd0b-49ce-bff3-e66a8645e866 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1315 microversion: 2.1 time: 0.491821 Sep 10 21:14:57.235916 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2682/5462] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:56 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:57.373097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-90adac97-eae4-4d8a-9f5b-dcac1421b835 req-f92f8e10-1255-45a4-807f-4ee714829b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c61cdb3-4758-47c1-acb2-2cf56ef7fe56", "tag": "bf84a19e-1fe5-4448-907f-106fd87e28c3"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:57.383500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-90adac97-eae4-4d8a-9f5b-dcac1421b835 req-f92f8e10-1255-45a4-807f-4ee714829b98 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:57.384918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-90adac97-eae4-4d8a-9f5b-dcac1421b835 req-f92f8e10-1255-45a4-807f-4ee714829b98 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:57.385516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-90adac97-eae4-4d8a-9f5b-dcac1421b835 req-f92f8e10-1255-45a4-807f-4ee714829b98 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:57.390918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3fa9b4fd-3328-4557-82a9-7aebcf72c1a6 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:57.391706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3fa9b4fd-3328-4557-82a9-7aebcf72c1a6 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:57.401708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fa9b4fd-3328-4557-82a9-7aebcf72c1a6 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:57.402595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fa9b4fd-3328-4557-82a9-7aebcf72c1a6 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:57.403041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fa9b4fd-3328-4557-82a9-7aebcf72c1a6 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:57.404566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fa9b4fd-3328-4557-82a9-7aebcf72c1a6 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:57.404566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fa9b4fd-3328-4557-82a9-7aebcf72c1a6 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:57.404819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3fa9b4fd-3328-4557-82a9-7aebcf72c1a6 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:57.419424 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-90adac97-eae4-4d8a-9f5b-dcac1421b835 req-f92f8e10-1255-45a4-807f-4ee714829b98 service nova] Creating event network-changed:bf84a19e-1fe5-4448-907f-106fd87e28c3 for instance 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 on nch1-master-1 Sep 10 21:14:57.426482 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-90adac97-eae4-4d8a-9f5b-dcac1421b835 req-f92f8e10-1255-45a4-807f-4ee714829b98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057336 Sep 10 21:14:57.427549 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2781/5463] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:57.622975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3fa9b4fd-3328-4557-82a9-7aebcf72c1a6 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:57.633181 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3fa9b4fd-3328-4557-82a9-7aebcf72c1a6 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 200 len: 1515 microversion: 2.1 time: 0.249058 Sep 10 21:14:57.633912 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2683/5464] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:57 2022] GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:14:57.657689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d3cae3bf-2c18-485c-928c-8f3671d377ce tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:57.658432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d3cae3bf-2c18-485c-928c-8f3671d377ce tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:57.665189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3cae3bf-2c18-485c-928c-8f3671d377ce tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:57.666317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3cae3bf-2c18-485c-928c-8f3671d377ce tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:57.666897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3cae3bf-2c18-485c-928c-8f3671d377ce tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:57.667454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3cae3bf-2c18-485c-928c-8f3671d377ce tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:57.667903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3cae3bf-2c18-485c-928c-8f3671d377ce tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:57.668436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3cae3bf-2c18-485c-928c-8f3671d377ce tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:57.694009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d3cae3bf-2c18-485c-928c-8f3671d377ce tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:14:57.723410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:57.724302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:57.731914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:57.732412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:57.733131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:57.733942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:57.734398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:57.735025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:57.771625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:57.789055 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d3cae3bf-2c18-485c-928c-8f3671d377ce tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 204 len: 0 microversion: 2.1 time: 0.136430 Sep 10 21:14:57.790084 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2782/5465] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:14:57 2022] DELETE /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:14:57.800230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35d14ab9-0d10-4cd3-b602-19da509d5fff tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:57.801060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35d14ab9-0d10-4cd3-b602-19da509d5fff tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:57.807772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d14ab9-0d10-4cd3-b602-19da509d5fff tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:57.808260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d14ab9-0d10-4cd3-b602-19da509d5fff tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:57.808701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d14ab9-0d10-4cd3-b602-19da509d5fff tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:57.809400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d14ab9-0d10-4cd3-b602-19da509d5fff tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:57.809878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d14ab9-0d10-4cd3-b602-19da509d5fff tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:57.810309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d14ab9-0d10-4cd3-b602-19da509d5fff tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:57.951347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35d14ab9-0d10-4cd3-b602-19da509d5fff tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:57.958893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:57.959398 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35d14ab9-0d10-4cd3-b602-19da509d5fff tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 200 len: 1521 microversion: 2.1 time: 0.163949 Sep 10 21:14:57.969872 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2783/5466] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:57 2022] GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:57.970069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:57.970069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:57.971256 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a3b2f96f-70b1-46dd-840b-7ec23d3536b4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1407 microversion: 2.20 time: 0.251840 Sep 10 21:14:57.971975 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2684/5467] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:57 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:14:58.258590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4085872d-6112-4006-b09c-3e80fc805cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:58.259133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4085872d-6112-4006-b09c-3e80fc805cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:58.265917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4085872d-6112-4006-b09c-3e80fc805cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:58.266407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4085872d-6112-4006-b09c-3e80fc805cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:58.266849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4085872d-6112-4006-b09c-3e80fc805cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:58.267542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4085872d-6112-4006-b09c-3e80fc805cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:58.268001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4085872d-6112-4006-b09c-3e80fc805cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:58.268431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4085872d-6112-4006-b09c-3e80fc805cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:58.398160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4085872d-6112-4006-b09c-3e80fc805cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:58.406267 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4085872d-6112-4006-b09c-3e80fc805cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1315 microversion: 2.1 time: 0.151678 Sep 10 21:14:58.406854 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2784/5468] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:58 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:58.981540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-428a2222-e14f-4bec-b493-ad8a3c809859 req-fb4ad813-c214-4853-beb6-5a7cd690f0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26", "name": "network-vif-plugged", "status": "completed", "tag": "0c8d8555-28a1-427f-b57c-affbeeda6daf"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:14:58.985479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9cf82034-3f27-4693-851c-ab7796b159b7 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:58.986227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9cf82034-3f27-4693-851c-ab7796b159b7 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:58.993219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:58.993802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf82034-3f27-4693-851c-ab7796b159b7 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:58.994633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf82034-3f27-4693-851c-ab7796b159b7 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:58.995064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf82034-3f27-4693-851c-ab7796b159b7 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:58.996094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf82034-3f27-4693-851c-ab7796b159b7 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:58.996746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf82034-3f27-4693-851c-ab7796b159b7 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:58.997173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9cf82034-3f27-4693-851c-ab7796b159b7 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:59.000223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-428a2222-e14f-4bec-b493-ad8a3c809859 req-fb4ad813-c214-4853-beb6-5a7cd690f0b9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:59.000931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-428a2222-e14f-4bec-b493-ad8a3c809859 req-fb4ad813-c214-4853-beb6-5a7cd690f0b9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:59.001605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-428a2222-e14f-4bec-b493-ad8a3c809859 req-fb4ad813-c214-4853-beb6-5a7cd690f0b9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:59.017412 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-428a2222-e14f-4bec-b493-ad8a3c809859 req-fb4ad813-c214-4853-beb6-5a7cd690f0b9 service nova] Creating event network-vif-plugged:0c8d8555-28a1-427f-b57c-affbeeda6daf for instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 on nch2-master-1 Sep 10 21:14:59.025581 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-428a2222-e14f-4bec-b493-ad8a3c809859 req-fb4ad813-c214-4853-beb6-5a7cd690f0b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053210 Sep 10 21:14:59.026266 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2685/5469] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:14:59.031885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:59.032584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:59.040611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:59.041679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:59.042323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:59.043216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:59.043836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:59.044272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:59.151936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9cf82034-3f27-4693-851c-ab7796b159b7 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:59.155644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:14:59.160951 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9cf82034-3f27-4693-851c-ab7796b159b7 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 200 len: 1521 microversion: 2.1 time: 0.179941 Sep 10 21:14:59.161704 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2785/5470] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:58 2022] GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:14:59.243990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:59.253562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:59.255456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:59.256631 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1cdd44b6-8d01-456d-9749-40d8758ad9a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1407 microversion: 2.20 time: 0.229187 Sep 10 21:14:59.257200 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2686/5471] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:14:59 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:14:59.401333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-26f05516-64eb-4e37-8031-ce8120aecfa1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:59.401778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-26f05516-64eb-4e37-8031-ce8120aecfa1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:59.407864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26f05516-64eb-4e37-8031-ce8120aecfa1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:59.408355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26f05516-64eb-4e37-8031-ce8120aecfa1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:59.408796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26f05516-64eb-4e37-8031-ce8120aecfa1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:59.409496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26f05516-64eb-4e37-8031-ce8120aecfa1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:59.409990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26f05516-64eb-4e37-8031-ce8120aecfa1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:59.410421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26f05516-64eb-4e37-8031-ce8120aecfa1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:59.428417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-963cea20-2365-4089-95d7-51654785a343 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:14:59.429110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-963cea20-2365-4089-95d7-51654785a343 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:14:59.434135 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-26f05516-64eb-4e37-8031-ce8120aecfa1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/ips" status: 200 len: 150 microversion: 2.1 time: 0.210396 Sep 10 21:14:59.434877 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2786/5472] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Sep 10 21:14:59 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/ips => generated 150 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:14:59.435617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963cea20-2365-4089-95d7-51654785a343 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:59.436115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963cea20-2365-4089-95d7-51654785a343 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:59.436560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963cea20-2365-4089-95d7-51654785a343 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:59.437260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963cea20-2365-4089-95d7-51654785a343 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:14:59.437719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963cea20-2365-4089-95d7-51654785a343 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:14:59.438177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-963cea20-2365-4089-95d7-51654785a343 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:14:59.576466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-963cea20-2365-4089-95d7-51654785a343 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:14:59.584878 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-963cea20-2365-4089-95d7-51654785a343 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1315 microversion: 2.1 time: 0.160266 Sep 10 21:14:59.585613 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2687/5473] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:14:59 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:00.185052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e118b179-ed96-45bd-a520-a3ff7dd39b98 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:00.185583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e118b179-ed96-45bd-a520-a3ff7dd39b98 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:00.192455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e118b179-ed96-45bd-a520-a3ff7dd39b98 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:00.192941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e118b179-ed96-45bd-a520-a3ff7dd39b98 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:00.193378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e118b179-ed96-45bd-a520-a3ff7dd39b98 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:00.194091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e118b179-ed96-45bd-a520-a3ff7dd39b98 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:00.194552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e118b179-ed96-45bd-a520-a3ff7dd39b98 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:00.194979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e118b179-ed96-45bd-a520-a3ff7dd39b98 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:00.281947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:00.282576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:00.289513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:00.290056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:00.291007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:00.291727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:00.292214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:00.292651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:00.327973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e118b179-ed96-45bd-a520-a3ff7dd39b98 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:00.336161 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e118b179-ed96-45bd-a520-a3ff7dd39b98 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 200 len: 1521 microversion: 2.1 time: 0.155327 Sep 10 21:15:00.336755 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2787/5474] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:00 2022] GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:00.423358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:00.433588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:00.435122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:00.436174 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c5d9b50-e826-4a8f-b49f-6dc825aca012 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1407 microversion: 2.20 time: 0.158217 Sep 10 21:15:00.436748 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2688/5475] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:00 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:15:00.610847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-877a5c40-e68e-4bc8-b2f0-6830e0793017 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:00.611561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-877a5c40-e68e-4bc8-b2f0-6830e0793017 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:00.617559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-877a5c40-e68e-4bc8-b2f0-6830e0793017 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:00.618077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-877a5c40-e68e-4bc8-b2f0-6830e0793017 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:00.618514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-877a5c40-e68e-4bc8-b2f0-6830e0793017 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:00.619755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-877a5c40-e68e-4bc8-b2f0-6830e0793017 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:00.620204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-877a5c40-e68e-4bc8-b2f0-6830e0793017 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:00.620629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-877a5c40-e68e-4bc8-b2f0-6830e0793017 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:00.754866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-877a5c40-e68e-4bc8-b2f0-6830e0793017 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:00.768214 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-877a5c40-e68e-4bc8-b2f0-6830e0793017 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1315 microversion: 2.1 time: 0.162676 Sep 10 21:15:00.768974 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2788/5476] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:00 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:00.784527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ee199909-de2a-43ad-80e3-3516b8e2fc4c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7af387bd-473f-4f69-9aac-f2cebe475944"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:00.787014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ee199909-de2a-43ad-80e3-3516b8e2fc4c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:00.792988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee199909-de2a-43ad-80e3-3516b8e2fc4c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:00.793469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee199909-de2a-43ad-80e3-3516b8e2fc4c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:00.793951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee199909-de2a-43ad-80e3-3516b8e2fc4c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:00.794666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee199909-de2a-43ad-80e3-3516b8e2fc4c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:00.795124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee199909-de2a-43ad-80e3-3516b8e2fc4c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:00.795549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee199909-de2a-43ad-80e3-3516b8e2fc4c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:01.050639 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ee199909-de2a-43ad-80e3-3516b8e2fc4c tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "POST /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270145 Sep 10 21:15:01.056918 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2689/5477] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:15:00 2022] POST /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:01.360398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-76bd7387-c7ab-459b-8c56-93c4459aaa46 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:01.361006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-76bd7387-c7ab-459b-8c56-93c4459aaa46 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:01.369015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76bd7387-c7ab-459b-8c56-93c4459aaa46 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:01.369510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76bd7387-c7ab-459b-8c56-93c4459aaa46 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:01.370145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76bd7387-c7ab-459b-8c56-93c4459aaa46 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:01.370863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76bd7387-c7ab-459b-8c56-93c4459aaa46 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:01.371323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76bd7387-c7ab-459b-8c56-93c4459aaa46 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:01.371759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-76bd7387-c7ab-459b-8c56-93c4459aaa46 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:01.461522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:01.462279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:01.471284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:01.471859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:01.472379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:01.473185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:01.473873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:01.474371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:01.537230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-76bd7387-c7ab-459b-8c56-93c4459aaa46 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:01.546419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-76bd7387-c7ab-459b-8c56-93c4459aaa46 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 200 len: 1521 microversion: 2.1 time: 0.190258 Sep 10 21:15:01.547154 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2789/5478] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:01 2022] GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:01.792139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7f87a53d-cb64-4841-8f35-01129f64b37e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:01.792841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7f87a53d-cb64-4841-8f35-01129f64b37e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:01.801988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f87a53d-cb64-4841-8f35-01129f64b37e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:01.802753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f87a53d-cb64-4841-8f35-01129f64b37e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:01.803241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f87a53d-cb64-4841-8f35-01129f64b37e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:01.804067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f87a53d-cb64-4841-8f35-01129f64b37e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:01.804677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f87a53d-cb64-4841-8f35-01129f64b37e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:01.805261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f87a53d-cb64-4841-8f35-01129f64b37e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:01.819555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:01.833248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:01.835312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:01.837680 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5d67213e-753b-4485-bd19-284635213374 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1599 microversion: 2.20 time: 0.380368 Sep 10 21:15:01.839978 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2690/5479] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:01 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1599 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:15:01.866156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dde63e45-689a-4bc3-949b-158fb1232f41 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:01.866918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dde63e45-689a-4bc3-949b-158fb1232f41 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:01.875410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dde63e45-689a-4bc3-949b-158fb1232f41 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:01.876639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dde63e45-689a-4bc3-949b-158fb1232f41 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:01.877234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dde63e45-689a-4bc3-949b-158fb1232f41 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:01.878127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dde63e45-689a-4bc3-949b-158fb1232f41 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:01.879013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dde63e45-689a-4bc3-949b-158fb1232f41 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:01.879602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dde63e45-689a-4bc3-949b-158fb1232f41 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:01.972558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7f87a53d-cb64-4841-8f35-01129f64b37e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:01.988362 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7f87a53d-cb64-4841-8f35-01129f64b37e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1315 microversion: 2.1 time: 0.199504 Sep 10 21:15:01.988980 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2790/5480] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:01 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:02.008956 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dde63e45-689a-4bc3-949b-158fb1232f41 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.146689 Sep 10 21:15:02.009746 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2691/5481] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Sep 10 21:15:01 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:15:02.142674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-33ecb789-4648-422d-a3a1-dab4e8448dee req-5bc64caf-c82d-456a-9d88-13d3a4a8c54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3964ac47-a047-40af-a52e-1b8eca583f63", "name": "network-vif-deleted", "tag": "445079fc-4327-492c-856f-9fc28de4864f"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:02.168285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33ecb789-4648-422d-a3a1-dab4e8448dee req-5bc64caf-c82d-456a-9d88-13d3a4a8c54e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:02.171223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33ecb789-4648-422d-a3a1-dab4e8448dee req-5bc64caf-c82d-456a-9d88-13d3a4a8c54e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:02.173659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-33ecb789-4648-422d-a3a1-dab4e8448dee req-5bc64caf-c82d-456a-9d88-13d3a4a8c54e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:02.201236 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-33ecb789-4648-422d-a3a1-dab4e8448dee req-5bc64caf-c82d-456a-9d88-13d3a4a8c54e service nova] Creating event network-vif-deleted:445079fc-4327-492c-856f-9fc28de4864f for instance 3964ac47-a047-40af-a52e-1b8eca583f63 on nch1-master-1 Sep 10 21:15:02.211096 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-33ecb789-4648-422d-a3a1-dab4e8448dee req-5bc64caf-c82d-456a-9d88-13d3a4a8c54e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072231 Sep 10 21:15:02.219711 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2791/5482] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:02.566913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:02.567921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=18 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:02.574570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:02.575455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:02.584608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:02.585493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:02.586313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:02.587084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:02.587850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:02.588625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:02.624472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:02.625124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:02.625636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:02.626267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lazy-loading 'fault' on Instance uuid 3964ac47-a047-40af-a52e-1b8eca583f63 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:15:02.672881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:02.686232 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-25febb12-3b48-4716-a965-45769d466b26 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 200 len: 1312 microversion: 2.1 time: 0.120021 Sep 10 21:15:02.686918 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2692/5483] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:02 2022] GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:03.016400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-300b0f86-41ed-45f2-9dfe-f355ca0c6cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:03.017526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-300b0f86-41ed-45f2-9dfe-f355ca0c6cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:03.021245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:03.027729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-300b0f86-41ed-45f2-9dfe-f355ca0c6cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:03.028224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-300b0f86-41ed-45f2-9dfe-f355ca0c6cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:03.028667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-300b0f86-41ed-45f2-9dfe-f355ca0c6cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:03.029380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-300b0f86-41ed-45f2-9dfe-f355ca0c6cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:03.029853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-300b0f86-41ed-45f2-9dfe-f355ca0c6cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:03.030302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-300b0f86-41ed-45f2-9dfe-f355ca0c6cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:03.235184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e8e5503f-3a0c-4b5a-bb6e-3918b750deb8 req-51423805-8f99-416f-a4b3-616a96174806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26", "tag": "0c8d8555-28a1-427f-b57c-affbeeda6daf"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:03.244484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-300b0f86-41ed-45f2-9dfe-f355ca0c6cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:03.245234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e8e5503f-3a0c-4b5a-bb6e-3918b750deb8 req-51423805-8f99-416f-a4b3-616a96174806 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:03.245758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e8e5503f-3a0c-4b5a-bb6e-3918b750deb8 req-51423805-8f99-416f-a4b3-616a96174806 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:03.246230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e8e5503f-3a0c-4b5a-bb6e-3918b750deb8 req-51423805-8f99-416f-a4b3-616a96174806 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:03.256419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-300b0f86-41ed-45f2-9dfe-f355ca0c6cc4 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1315 microversion: 2.1 time: 0.247238 Sep 10 21:15:03.257247 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2792/5484] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:03 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:03.257807 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e8e5503f-3a0c-4b5a-bb6e-3918b750deb8 req-51423805-8f99-416f-a4b3-616a96174806 service nova] Creating event network-changed:0c8d8555-28a1-427f-b57c-affbeeda6daf for instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 on nch2-master-1 Sep 10 21:15:03.263407 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e8e5503f-3a0c-4b5a-bb6e-3918b750deb8 req-51423805-8f99-416f-a4b3-616a96174806 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033953 Sep 10 21:15:03.264007 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2693/5485] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:15:03.710752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:03.711924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:03.720337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:03.721135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:03.721763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:03.722503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:03.723016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:03.723620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:03.745321 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] HTTP exception thrown: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Request method failure captured: Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 HTTP/1.1 Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP485ujLi1DQbp2DwYA3cLswhwcLev8G6u6P6ze58BaxReECxC3wm7_EMK6I-GGZs3aUREaHJlb7blKzf6UnEoDO66ifKKoMjKE-2HziQ9VgcnqjP6anI5BX4QCscaftwgQPDN-e32klqaTwBS3Fq2HECWVsnQeKEV0P_6yeJ-WrgLE Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5c9ea913d214c569e6d6c3c1327f43a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5c9ea913d214c569e6d6c3c1327f43a"}]}] Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9b7e48fd0dab42d3a904f7a07b939011 Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '3964ac47-a047-40af-a52e-1b8eca583f63'} Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.748264 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:03.752891 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.752891 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:03.752891 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:03.752891 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:03.752891 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:03.752891 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:03.752891 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:03.752891 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.754922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Returning 404 to user: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:03.757854 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0937f3d0-b8c9-4ad3-8bfb-da2f9d473f89 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 404 len: 111 microversion: 2.1 time: 0.051785 Sep 10 21:15:03.761573 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2793/5486] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:03 2022] GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:03.770231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4e5d7b49-3ee2-4af2-a094-63e67d0e6518 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:03.777015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e5d7b49-3ee2-4af2-a094-63e67d0e6518 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:03.778095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4e5d7b49-3ee2-4af2-a094-63e67d0e6518 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:15:03.784145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e5d7b49-3ee2-4af2-a094-63e67d0e6518 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:03.784701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e5d7b49-3ee2-4af2-a094-63e67d0e6518 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:03.785229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e5d7b49-3ee2-4af2-a094-63e67d0e6518 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:03.786398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e5d7b49-3ee2-4af2-a094-63e67d0e6518 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:03.787159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e5d7b49-3ee2-4af2-a094-63e67d0e6518 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:03.787735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e5d7b49-3ee2-4af2-a094-63e67d0e6518 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:03.871769 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4e5d7b49-3ee2-4af2-a094-63e67d0e6518 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.106733 Sep 10 21:15:03.872688 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2694/5487] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Sep 10 21:15:03 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:15:03.885334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7664e029-a5ec-446c-bf45-6f166d02e20f tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7664e029-a5ec-446c-bf45-6f166d02e20f tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Request method failure captured: Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP485ujLi1DQbp2DwYA3cLswhwcLev8G6u6P6ze58BaxReECxC3wm7_EMK6I-GGZs3aUREaHJlb7blKzf6UnEoDO66ifKKoMjKE-2HziQ9VgcnqjP6anI5BX4QCscaftwgQPDN-e32klqaTwBS3Fq2HECWVsnQeKEV0P_6yeJ-WrgLE Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5c9ea913d214c569e6d6c3c1327f43a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5c9ea913d214c569e6d6c3c1327f43a"}]}] Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9b7e48fd0dab42d3a904f7a07b939011 Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: action_args: {} Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 10 21:15:03.889442 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7664e029-a5ec-446c-bf45-6f166d02e20f tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7664e029-a5ec-446c-bf45-6f166d02e20f tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009406 Sep 10 21:15:03.893575 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2794/5488] 10.222.0.33 () {58 vars in 1182 bytes} [Sat Sep 10 21:15:03 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:15:03.900239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:03.905684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:03.906387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Searching by: {'deleted': False, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:15:03.911746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:03.912224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:03.912657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:03.913372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:03.913893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:03.914266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:03.945121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:15:03.985507 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0763eb12-c6e8-4914-b282-c025e8156530 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.089115 Sep 10 21:15:03.986133 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2695/5489] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 21:15:03 2022] GET /compute/v2.1/servers => generated 681 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:03.999342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.005800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:04.006286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.compute.servers [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Removing options 'limit' from query {{(pid=145772) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 21:15:04.007065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Searching by: {'deleted': False, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:15:04.014266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.014757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.015348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.016013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.016449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.017052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.044997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:15:04.075044 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-207d7858-c193-45de-b559-9781d6e32a95 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.080969 Sep 10 21:15:04.075653 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2795/5490] 10.222.0.33 () {58 vars in 1144 bytes} [Sat Sep 10 21:15:03 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:04.089548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f70bc571-eb3a-4005-b922-3ec1c51451ca tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f70bc571-eb3a-4005-b922-3ec1c51451ca tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Request method failure captured: Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP485ujLi1DQbp2DwYA3cLswhwcLev8G6u6P6ze58BaxReECxC3wm7_EMK6I-GGZs3aUREaHJlb7blKzf6UnEoDO66ifKKoMjKE-2HziQ9VgcnqjP6anI5BX4QCscaftwgQPDN-e32klqaTwBS3Fq2HECWVsnQeKEV0P_6yeJ-WrgLE Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5c9ea913d214c569e6d6c3c1327f43a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5c9ea913d214c569e6d6c3c1327f43a"}]}] Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 9b7e48fd0dab42d3a904f7a07b939011 Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: action_args: {} Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi '-1' Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 10 21:15:04.093921 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 10 21:15:04.098341 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.100033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f70bc571-eb3a-4005-b922-3ec1c51451ca tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:04.100911 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f70bc571-eb3a-4005-b922-3ec1c51451ca tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.015748 Sep 10 21:15:04.101506 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2696/5491] 10.222.0.33 () {58 vars in 1142 bytes} [Sat Sep 10 21:15:04 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:15:04.111717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e73e962-2a83-46ca-8522-77de511bc498 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e73e962-2a83-46ca-8522-77de511bc498 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Request method failure captured: Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP485ujLi1DQbp2DwYA3cLswhwcLev8G6u6P6ze58BaxReECxC3wm7_EMK6I-GGZs3aUREaHJlb7blKzf6UnEoDO66ifKKoMjKE-2HziQ9VgcnqjP6anI5BX4QCscaftwgQPDN-e32klqaTwBS3Fq2HECWVsnQeKEV0P_6yeJ-WrgLE Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5c9ea913d214c569e6d6c3c1327f43a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5c9ea913d214c569e6d6c3c1327f43a"}]}] Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9b7e48fd0dab42d3a904f7a07b939011 Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: action_args: {} Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi 'testing' Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 10 21:15:04.115807 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e73e962-2a83-46ca-8522-77de511bc498 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e73e962-2a83-46ca-8522-77de511bc498 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.009505 Sep 10 21:15:04.119512 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2796/5492] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Sep 10 21:15:04 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:15:04.127067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d00d1d75-fcef-4bd0-84a8-982963fe0607 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.132347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d00d1d75-fcef-4bd0-84a8-982963fe0607 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:04.133024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d00d1d75-fcef-4bd0-84a8-982963fe0607 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:15:04.142832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.compute.servers [None req-d00d1d75-fcef-4bd0-84a8-982963fe0607 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Flavor 'non_existing_flavor' could not be found {{(pid=145771) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 10 21:15:04.143912 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d00d1d75-fcef-4bd0-84a8-982963fe0607 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.020735 Sep 10 21:15:04.144525 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2697/5493] 10.222.0.33 () {58 vars in 1178 bytes} [Sat Sep 10 21:15:04 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:15:04.163501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3741871-e27b-4e61-89a7-79cedce6c513 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.168904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f3741871-e27b-4e61-89a7-79cedce6c513 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:04.169575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3741871-e27b-4e61-89a7-79cedce6c513 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:15:04.176502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3741871-e27b-4e61-89a7-79cedce6c513 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.176980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3741871-e27b-4e61-89a7-79cedce6c513 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.177414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3741871-e27b-4e61-89a7-79cedce6c513 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.178174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3741871-e27b-4e61-89a7-79cedce6c513 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.178629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3741871-e27b-4e61-89a7-79cedce6c513 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.179053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3741871-e27b-4e61-89a7-79cedce6c513 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.268637 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3741871-e27b-4e61-89a7-79cedce6c513 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.109940 Sep 10 21:15:04.269529 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2797/5494] 10.222.0.33 () {58 vars in 1174 bytes} [Sat Sep 10 21:15:04 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 21:15:04.283511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d4ba5db-172d-40ba-aea7-b778a621e04e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.286163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4cb1ca32-0370-4c61-bd28-48a497168daa tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.287140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4cb1ca32-0370-4c61-bd28-48a497168daa tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:04.288859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d4ba5db-172d-40ba-aea7-b778a621e04e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:04.289605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d4ba5db-172d-40ba-aea7-b778a621e04e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:15:04.295278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d4ba5db-172d-40ba-aea7-b778a621e04e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.295715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb1ca32-0370-4c61-bd28-48a497168daa tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.295866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d4ba5db-172d-40ba-aea7-b778a621e04e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.296200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d4ba5db-172d-40ba-aea7-b778a621e04e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.296526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb1ca32-0370-4c61-bd28-48a497168daa tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.296929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d4ba5db-172d-40ba-aea7-b778a621e04e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.297329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb1ca32-0370-4c61-bd28-48a497168daa tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.297716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d4ba5db-172d-40ba-aea7-b778a621e04e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.297816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d4ba5db-172d-40ba-aea7-b778a621e04e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.298352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb1ca32-0370-4c61-bd28-48a497168daa tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.298890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb1ca32-0370-4c61-bd28-48a497168daa tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.299480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4cb1ca32-0370-4c61-bd28-48a497168daa tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.407420 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d4ba5db-172d-40ba-aea7-b778a621e04e tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.127489 Sep 10 21:15:04.409223 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2798/5495] 10.222.0.33 () {58 vars in 1184 bytes} [Sat Sep 10 21:15:04 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 21:15:04.424469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.431993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:04.434086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Searching by: {'deleted': False, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:15:04.442023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.442597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.443217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.444439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.445219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.446126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.493767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:15:04.561857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4cb1ca32-0370-4c61-bd28-48a497168daa tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:04.571423 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4cb1ca32-0370-4c61-bd28-48a497168daa tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1315 microversion: 2.1 time: 0.291287 Sep 10 21:15:04.572077 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2698/5496] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:04 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:04.581468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:04.591715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.592362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.592901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.680624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-95420e48-94b6-465c-8a75-b64974d20ac0 req-9cd99f04-b5f9-42ad-a1d0-b4417b7d2a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c61cdb3-4758-47c1-acb2-2cf56ef7fe56", "name": "network-vif-plugged", "status": "completed", "tag": "bf84a19e-1fe5-4448-907f-106fd87e28c3"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:04.699002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-95420e48-94b6-465c-8a75-b64974d20ac0 req-9cd99f04-b5f9-42ad-a1d0-b4417b7d2a1c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.699546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-95420e48-94b6-465c-8a75-b64974d20ac0 req-9cd99f04-b5f9-42ad-a1d0-b4417b7d2a1c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.700041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-95420e48-94b6-465c-8a75-b64974d20ac0 req-9cd99f04-b5f9-42ad-a1d0-b4417b7d2a1c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.745989 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-95420e48-94b6-465c-8a75-b64974d20ac0 req-9cd99f04-b5f9-42ad-a1d0-b4417b7d2a1c service nova] Creating event network-vif-plugged:bf84a19e-1fe5-4448-907f-106fd87e28c3 for instance 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 on nch1-master-1 Sep 10 21:15:04.751660 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-95420e48-94b6-465c-8a75-b64974d20ac0 req-9cd99f04-b5f9-42ad-a1d0-b4417b7d2a1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076198 Sep 10 21:15:04.753220 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2699/5497] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:15:04.758812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b164c0f7-db56-451e-b7e0-0fc32ec5cb19 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.759574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b164c0f7-db56-451e-b7e0-0fc32ec5cb19 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:04.766777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b164c0f7-db56-451e-b7e0-0fc32ec5cb19 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.767436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b164c0f7-db56-451e-b7e0-0fc32ec5cb19 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.768071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b164c0f7-db56-451e-b7e0-0fc32ec5cb19 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.768988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b164c0f7-db56-451e-b7e0-0fc32ec5cb19 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.769790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b164c0f7-db56-451e-b7e0-0fc32ec5cb19 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.770390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b164c0f7-db56-451e-b7e0-0fc32ec5cb19 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.837791 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8d123cca-356e-4a84-9946-e18b5c01079b tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.419543 Sep 10 21:15:04.838888 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2799/5498] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 21:15:04 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:04.874307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-75c17c48-7caa-4dae-a0ae-786504671cc4 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.883327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-75c17c48-7caa-4dae-a0ae-786504671cc4 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:04.885121 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-75c17c48-7caa-4dae-a0ae-786504671cc4 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.022823 Sep 10 21:15:04.885121 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2800/5499] 10.222.0.33 () {58 vars in 1178 bytes} [Sat Sep 10 21:15:04 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:15:04.898729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:04.903573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:04.904462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Searching by: {'deleted': False, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:15:04.912405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.913159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.913808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.914697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:04.915326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:04.915922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:04.943763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:04.949277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-b164c0f7-db56-451e-b7e0-0fc32ec5cb19 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lazy-loading 'services' on Instance uuid 30e32f9e-ea2d-4481-ab27-9325f7349ce4 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:15:04.960373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:15:05.000482 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d8db057d-d835-4662-9515-c8f050380811 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.105408 Sep 10 21:15:05.003916 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2801/5500] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 21:15:04 2022] GET /compute/v2.1/servers => generated 681 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:05.019649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:05.020387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:05.029485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.029941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.030384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.031091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.031548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.031976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.050425 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] HTTP exception thrown: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Request method failure captured: Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 HTTP/1.1 Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP485ujLi1DQbp2DwYA3cLswhwcLev8G6u6P6ze58BaxReECxC3wm7_EMK6I-GGZs3aUREaHJlb7blKzf6UnEoDO66ifKKoMjKE-2HziQ9VgcnqjP6anI5BX4QCscaftwgQPDN-e32klqaTwBS3Fq2HECWVsnQeKEV0P_6yeJ-WrgLE Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5c9ea913d214c569e6d6c3c1327f43a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5c9ea913d214c569e6d6c3c1327f43a"}]}] Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9b7e48fd0dab42d3a904f7a07b939011 Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '3964ac47-a047-40af-a52e-1b8eca583f63'} Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:05.052412 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:05.056478 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:05.062701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Returning 404 to user: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:05.063587 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f5651b1-6282-4215-9f8f-71e32d146c52 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 404 len: 111 microversion: 2.1 time: 0.053348 Sep 10 21:15:05.064161 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2802/5501] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:15:05 2022] DELETE /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:05.072731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ccabd24-0e27-4dd6-959b-246b878f4125 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:05.074195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ccabd24-0e27-4dd6-959b-246b878f4125 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: c529e350-a097-4506-a06b-48cde8ec0496] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:05.076455 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b164c0f7-db56-451e-b7e0-0fc32ec5cb19 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-volume_attachments/7af387bd-473f-4f69-9aac-f2cebe475944" status: 202 len: 0 microversion: 2.1 time: 0.321169 Sep 10 21:15:05.081560 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2700/5502] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 21:15:04 2022] DELETE /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-volume_attachments/7af387bd-473f-4f69-9aac-f2cebe475944 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:15:05.089225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-65e7ae08-5053-429e-902f-709f8d0c6cb0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:05.093213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-65e7ae08-5053-429e-902f-709f8d0c6cb0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:05.096357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ccabd24-0e27-4dd6-959b-246b878f4125 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.097392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ccabd24-0e27-4dd6-959b-246b878f4125 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.098079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ccabd24-0e27-4dd6-959b-246b878f4125 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.101014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ccabd24-0e27-4dd6-959b-246b878f4125 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.101854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ccabd24-0e27-4dd6-959b-246b878f4125 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.102325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ccabd24-0e27-4dd6-959b-246b878f4125 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.102936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65e7ae08-5053-429e-902f-709f8d0c6cb0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.103609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65e7ae08-5053-429e-902f-709f8d0c6cb0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.104266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65e7ae08-5053-429e-902f-709f8d0c6cb0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.106374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65e7ae08-5053-429e-902f-709f8d0c6cb0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.107241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65e7ae08-5053-429e-902f-709f8d0c6cb0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.108019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65e7ae08-5053-429e-902f-709f8d0c6cb0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.133286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ccabd24-0e27-4dd6-959b-246b878f4125 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: c529e350-a097-4506-a06b-48cde8ec0496] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:15:05.143598 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-65e7ae08-5053-429e-902f-709f8d0c6cb0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060171 Sep 10 21:15:05.144186 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2701/5503] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:15:05 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:05.225532 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ccabd24-0e27-4dd6-959b-246b878f4125 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496" status: 204 len: 0 microversion: 2.1 time: 0.156440 Sep 10 21:15:05.226300 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2803/5504] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:15:05 2022] DELETE /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:15:05.234533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a0c75e0d-f1f1-40fa-a23c-5a4eb9105555 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:05.235031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a0c75e0d-f1f1-40fa-a23c-5a4eb9105555 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:05.241234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0c75e0d-f1f1-40fa-a23c-5a4eb9105555 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.241725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0c75e0d-f1f1-40fa-a23c-5a4eb9105555 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.242191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0c75e0d-f1f1-40fa-a23c-5a4eb9105555 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.242882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0c75e0d-f1f1-40fa-a23c-5a4eb9105555 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.243337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0c75e0d-f1f1-40fa-a23c-5a4eb9105555 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.243766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0c75e0d-f1f1-40fa-a23c-5a4eb9105555 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.269429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a0c75e0d-f1f1-40fa-a23c-5a4eb9105555 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:15:05.343999 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a0c75e0d-f1f1-40fa-a23c-5a4eb9105555 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 204 len: 0 microversion: 2.1 time: 0.113036 Sep 10 21:15:05.344813 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2702/5505] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:15:05 2022] DELETE /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:15:05.352965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:05.353662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: 3964ac47-a047-40af-a52e-1b8eca583f63] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:05.359999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.360482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.360919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.361614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.362108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.362537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.376311 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] HTTP exception thrown: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Request method failure captured: Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 HTTP/1.1 Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP485ujLi1DQbp2DwYA3cLswhwcLev8G6u6P6ze58BaxReECxC3wm7_EMK6I-GGZs3aUREaHJlb7blKzf6UnEoDO66ifKKoMjKE-2HziQ9VgcnqjP6anI5BX4QCscaftwgQPDN-e32klqaTwBS3Fq2HECWVsnQeKEV0P_6yeJ-WrgLE Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5c9ea913d214c569e6d6c3c1327f43a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5c9ea913d214c569e6d6c3c1327f43a"}]}] Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9b7e48fd0dab42d3a904f7a07b939011 Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '3964ac47-a047-40af-a52e-1b8eca583f63'} Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:05.377950 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Returning 404 to user: Instance 3964ac47-a047-40af-a52e-1b8eca583f63 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-70700300-cbfc-48c5-8933-160a408a6daa tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63" status: 404 len: 111 microversion: 2.1 time: 0.030513 Sep 10 21:15:05.381627 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2804/5506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:05 2022] GET /compute/v2.1/servers/3964ac47-a047-40af-a52e-1b8eca583f63 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:05.388840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f9503591-10d3-49ac-8517-9864e6114cad tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:05.389549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f9503591-10d3-49ac-8517-9864e6114cad tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: c529e350-a097-4506-a06b-48cde8ec0496] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:05.395554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9503591-10d3-49ac-8517-9864e6114cad tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.396043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9503591-10d3-49ac-8517-9864e6114cad tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.396485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9503591-10d3-49ac-8517-9864e6114cad tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.397184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9503591-10d3-49ac-8517-9864e6114cad tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.397642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9503591-10d3-49ac-8517-9864e6114cad tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.398099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9503591-10d3-49ac-8517-9864e6114cad tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.532397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f9503591-10d3-49ac-8517-9864e6114cad tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:05.540084 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f9503591-10d3-49ac-8517-9864e6114cad tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496" status: 200 len: 1521 microversion: 2.1 time: 0.156104 Sep 10 21:15:05.540655 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2703/5507] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:05 2022] GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:05.597753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07960db7-2d5e-4060-bb42-b39ab1aa4a7a tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:05.598328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-07960db7-2d5e-4060-bb42-b39ab1aa4a7a tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:05.605159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07960db7-2d5e-4060-bb42-b39ab1aa4a7a tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.605781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07960db7-2d5e-4060-bb42-b39ab1aa4a7a tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.606238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07960db7-2d5e-4060-bb42-b39ab1aa4a7a tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.606934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07960db7-2d5e-4060-bb42-b39ab1aa4a7a tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:05.607399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07960db7-2d5e-4060-bb42-b39ab1aa4a7a tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:05.607831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07960db7-2d5e-4060-bb42-b39ab1aa4a7a tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:05.740635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-07960db7-2d5e-4060-bb42-b39ab1aa4a7a tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:05.749411 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-07960db7-2d5e-4060-bb42-b39ab1aa4a7a tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1315 microversion: 2.1 time: 0.155582 Sep 10 21:15:05.750001 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2805/5508] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:05 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:06.157351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bb1eb541-3f99-40a8-a2cf-398697725da1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:06.159564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bb1eb541-3f99-40a8-a2cf-398697725da1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:06.167210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1eb541-3f99-40a8-a2cf-398697725da1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:06.167690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1eb541-3f99-40a8-a2cf-398697725da1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:06.168179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1eb541-3f99-40a8-a2cf-398697725da1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:06.168874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1eb541-3f99-40a8-a2cf-398697725da1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:06.169330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1eb541-3f99-40a8-a2cf-398697725da1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:06.169763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb1eb541-3f99-40a8-a2cf-398697725da1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:06.199624 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bb1eb541-3f99-40a8-a2cf-398697725da1 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046285 Sep 10 21:15:06.200184 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2704/5509] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:15:06 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:06.563711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81e39825-4ed3-419e-87aa-93bf27b09935 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:06.564312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81e39825-4ed3-419e-87aa-93bf27b09935 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: c529e350-a097-4506-a06b-48cde8ec0496] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:06.571172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e39825-4ed3-419e-87aa-93bf27b09935 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:06.571650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e39825-4ed3-419e-87aa-93bf27b09935 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:06.572079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e39825-4ed3-419e-87aa-93bf27b09935 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:06.572766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e39825-4ed3-419e-87aa-93bf27b09935 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:06.573236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e39825-4ed3-419e-87aa-93bf27b09935 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:06.573654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81e39825-4ed3-419e-87aa-93bf27b09935 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:06.705315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-81e39825-4ed3-419e-87aa-93bf27b09935 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:06.708864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:06.715186 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81e39825-4ed3-419e-87aa-93bf27b09935 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496" status: 200 len: 1521 microversion: 2.1 time: 0.155268 Sep 10 21:15:06.715825 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2806/5510] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:06 2022] GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:06.772161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-317008cf-58fd-4ced-8494-9f3ef6683826 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:06.772768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-317008cf-58fd-4ced-8494-9f3ef6683826 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:06.779820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-317008cf-58fd-4ced-8494-9f3ef6683826 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:06.780307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-317008cf-58fd-4ced-8494-9f3ef6683826 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:06.780741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-317008cf-58fd-4ced-8494-9f3ef6683826 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:06.781464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-317008cf-58fd-4ced-8494-9f3ef6683826 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:06.781955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-317008cf-58fd-4ced-8494-9f3ef6683826 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:06.782383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-317008cf-58fd-4ced-8494-9f3ef6683826 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:06.917759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-317008cf-58fd-4ced-8494-9f3ef6683826 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:06.926454 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-317008cf-58fd-4ced-8494-9f3ef6683826 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1315 microversion: 2.1 time: 0.158114 Sep 10 21:15:06.927206 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2705/5511] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:06 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:07.212124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8b17e789-b74f-465d-a352-2f1369dbcc5e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:07.214669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8b17e789-b74f-465d-a352-2f1369dbcc5e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:07.222668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b17e789-b74f-465d-a352-2f1369dbcc5e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.223155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b17e789-b74f-465d-a352-2f1369dbcc5e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.223598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b17e789-b74f-465d-a352-2f1369dbcc5e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:07.224308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b17e789-b74f-465d-a352-2f1369dbcc5e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.224767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b17e789-b74f-465d-a352-2f1369dbcc5e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.225203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b17e789-b74f-465d-a352-2f1369dbcc5e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:07.257450 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8b17e789-b74f-465d-a352-2f1369dbcc5e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049416 Sep 10 21:15:07.258288 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2807/5512] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Sep 10 21:15:07 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 21:15:07.325363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4908ff62-4108-4f51-a7f2-7d02577089c5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:07.325960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4908ff62-4108-4f51-a7f2-7d02577089c5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:07.332799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4908ff62-4108-4f51-a7f2-7d02577089c5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.333291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4908ff62-4108-4f51-a7f2-7d02577089c5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.333727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4908ff62-4108-4f51-a7f2-7d02577089c5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:07.334454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4908ff62-4108-4f51-a7f2-7d02577089c5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.334909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4908ff62-4108-4f51-a7f2-7d02577089c5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.335335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4908ff62-4108-4f51-a7f2-7d02577089c5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:07.362976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4908ff62-4108-4f51-a7f2-7d02577089c5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:15:07.475669 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4908ff62-4108-4f51-a7f2-7d02577089c5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 204 len: 0 microversion: 2.1 time: 0.154251 Sep 10 21:15:07.476575 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2706/5513] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:15:07 2022] DELETE /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:15:07.487420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-67eaf682-1541-4c51-b876-a7729a074336 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:07.488049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-67eaf682-1541-4c51-b876-a7729a074336 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:07.496602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67eaf682-1541-4c51-b876-a7729a074336 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.497373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67eaf682-1541-4c51-b876-a7729a074336 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.498573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67eaf682-1541-4c51-b876-a7729a074336 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:07.499482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67eaf682-1541-4c51-b876-a7729a074336 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.500093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67eaf682-1541-4c51-b876-a7729a074336 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.501161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67eaf682-1541-4c51-b876-a7729a074336 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:07.595608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-db122ae9-1592-4404-874e-8ac6be25c71e req-58d7199d-aac9-4e09-bbde-e3fad1d2c19c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c529e350-a097-4506-a06b-48cde8ec0496", "name": "network-vif-deleted", "tag": "623243eb-f9e2-4693-aa5e-1ae688494551"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:07.626785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-db122ae9-1592-4404-874e-8ac6be25c71e req-58d7199d-aac9-4e09-bbde-e3fad1d2c19c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.627169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-db122ae9-1592-4404-874e-8ac6be25c71e req-58d7199d-aac9-4e09-bbde-e3fad1d2c19c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.627604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-db122ae9-1592-4404-874e-8ac6be25c71e req-58d7199d-aac9-4e09-bbde-e3fad1d2c19c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:07.640379 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-db122ae9-1592-4404-874e-8ac6be25c71e req-58d7199d-aac9-4e09-bbde-e3fad1d2c19c service nova] Creating event network-vif-deleted:623243eb-f9e2-4693-aa5e-1ae688494551 for instance c529e350-a097-4506-a06b-48cde8ec0496 on nch2-master-1 Sep 10 21:15:07.645498 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-db122ae9-1592-4404-874e-8ac6be25c71e req-58d7199d-aac9-4e09-bbde-e3fad1d2c19c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053889 Sep 10 21:15:07.646404 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2707/5514] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:15:07.672494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-67eaf682-1541-4c51-b876-a7729a074336 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:07.681271 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-67eaf682-1541-4c51-b876-a7729a074336 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1680 microversion: 2.1 time: 0.198780 Sep 10 21:15:07.685876 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2808/5515] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:07 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:07.741329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a12869d-b1e5-4711-8c96-c01eca556448 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:07.742109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3a12869d-b1e5-4711-8c96-c01eca556448 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: c529e350-a097-4506-a06b-48cde8ec0496] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:07.750587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a12869d-b1e5-4711-8c96-c01eca556448 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.751168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a12869d-b1e5-4711-8c96-c01eca556448 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.751684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a12869d-b1e5-4711-8c96-c01eca556448 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:07.752560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a12869d-b1e5-4711-8c96-c01eca556448 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.753178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a12869d-b1e5-4711-8c96-c01eca556448 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.753706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a12869d-b1e5-4711-8c96-c01eca556448 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:07.834672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a12869d-b1e5-4711-8c96-c01eca556448 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:07.843483 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3a12869d-b1e5-4711-8c96-c01eca556448 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496" status: 200 len: 1479 microversion: 2.1 time: 0.106956 Sep 10 21:15:07.844282 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2708/5516] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:07 2022] GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496 => generated 1479 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:07.952074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1412234a-30a8-4a89-bd45-b84e6466fc08 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:07.952780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1412234a-30a8-4a89-bd45-b84e6466fc08 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:07.960670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1412234a-30a8-4a89-bd45-b84e6466fc08 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.962125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1412234a-30a8-4a89-bd45-b84e6466fc08 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.962662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1412234a-30a8-4a89-bd45-b84e6466fc08 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:07.964123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1412234a-30a8-4a89-bd45-b84e6466fc08 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:07.964679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1412234a-30a8-4a89-bd45-b84e6466fc08 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:07.965180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1412234a-30a8-4a89-bd45-b84e6466fc08 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:08.120583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1412234a-30a8-4a89-bd45-b84e6466fc08 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:08.128980 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1412234a-30a8-4a89-bd45-b84e6466fc08 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1465 microversion: 2.1 time: 0.182187 Sep 10 21:15:08.129571 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2809/5517] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:07 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1465 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:08.178406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c054e00d-1474-4357-8c66-46682894ac66 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:08.178991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c054e00d-1474-4357-8c66-46682894ac66 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:08.185472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c054e00d-1474-4357-8c66-46682894ac66 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:08.186075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c054e00d-1474-4357-8c66-46682894ac66 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:08.186586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c054e00d-1474-4357-8c66-46682894ac66 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:08.187358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c054e00d-1474-4357-8c66-46682894ac66 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:08.187902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c054e00d-1474-4357-8c66-46682894ac66 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:08.188402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c054e00d-1474-4357-8c66-46682894ac66 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:08.214715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c054e00d-1474-4357-8c66-46682894ac66 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:15:08.294397 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c054e00d-1474-4357-8c66-46682894ac66 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 204 len: 0 microversion: 2.1 time: 0.119910 Sep 10 21:15:08.295146 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2709/5518] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:15:08 2022] DELETE /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:15:08.303186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c538cbd-cb87-4757-aeba-b5131eb7da4b tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:08.303941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c538cbd-cb87-4757-aeba-b5131eb7da4b tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:08.311090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c538cbd-cb87-4757-aeba-b5131eb7da4b tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:08.311546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c538cbd-cb87-4757-aeba-b5131eb7da4b tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:08.311976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c538cbd-cb87-4757-aeba-b5131eb7da4b tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:08.312660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c538cbd-cb87-4757-aeba-b5131eb7da4b tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:08.313110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c538cbd-cb87-4757-aeba-b5131eb7da4b tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:08.313533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c538cbd-cb87-4757-aeba-b5131eb7da4b tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:08.448618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c538cbd-cb87-4757-aeba-b5131eb7da4b tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:08.456490 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c538cbd-cb87-4757-aeba-b5131eb7da4b tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1471 microversion: 2.1 time: 0.157189 Sep 10 21:15:08.457063 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2810/5519] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:08 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:08.706795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dc081b88-9618-4f4d-9123-42eaf5acadbe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:08.707425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dc081b88-9618-4f4d-9123-42eaf5acadbe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:08.715054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc081b88-9618-4f4d-9123-42eaf5acadbe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:08.715495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc081b88-9618-4f4d-9123-42eaf5acadbe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:08.715937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc081b88-9618-4f4d-9123-42eaf5acadbe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:08.716631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc081b88-9618-4f4d-9123-42eaf5acadbe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:08.717092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc081b88-9618-4f4d-9123-42eaf5acadbe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:08.717521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc081b88-9618-4f4d-9123-42eaf5acadbe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:08.864558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dc081b88-9618-4f4d-9123-42eaf5acadbe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:08.868194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:08.869422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: c529e350-a097-4506-a06b-48cde8ec0496] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:08.873268 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dc081b88-9618-4f4d-9123-42eaf5acadbe tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1680 microversion: 2.1 time: 0.170760 Sep 10 21:15:08.873876 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2710/5520] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:08 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:08.888210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:08.888838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:08.889380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:08.890335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:08.890797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:08.891229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:08.925021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:08.925509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:08.925994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:08.926446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lazy-loading 'fault' on Instance uuid c529e350-a097-4506-a06b-48cde8ec0496 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:15:08.969108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b7e48fd0dab42d3a904f7a07b939011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c9ea913d214c569e6d6c3c1327f43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:08.977208 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7020b100-39cb-4971-b445-c512a50bc5e1 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496" status: 200 len: 1312 microversion: 2.1 time: 0.113123 Sep 10 21:15:08.977880 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2811/5521] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:08 2022] GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496 => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:09.480611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-066ada2b-b6f7-4890-a4b8-18987391cf5e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:09.481313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-066ada2b-b6f7-4890-a4b8-18987391cf5e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:09.487505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-066ada2b-b6f7-4890-a4b8-18987391cf5e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:09.487996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-066ada2b-b6f7-4890-a4b8-18987391cf5e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:09.488440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-066ada2b-b6f7-4890-a4b8-18987391cf5e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:09.489151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-066ada2b-b6f7-4890-a4b8-18987391cf5e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:09.489615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-066ada2b-b6f7-4890-a4b8-18987391cf5e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:09.490081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-066ada2b-b6f7-4890-a4b8-18987391cf5e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:09.672865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-2fe88f16-10f8-404e-826a-ff636e1f6692 req-ad2b120d-4188-4490-9802-b73e49089dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96b3777-0127-496d-922a-69908440e634", "name": "network-vif-deleted", "tag": "9211fa85-8f48-4dc8-a67f-17093c9c0a81"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:09.687677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2fe88f16-10f8-404e-826a-ff636e1f6692 req-ad2b120d-4188-4490-9802-b73e49089dd1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:09.688151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2fe88f16-10f8-404e-826a-ff636e1f6692 req-ad2b120d-4188-4490-9802-b73e49089dd1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:09.688937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-2fe88f16-10f8-404e-826a-ff636e1f6692 req-ad2b120d-4188-4490-9802-b73e49089dd1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:09.702312 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-2fe88f16-10f8-404e-826a-ff636e1f6692 req-ad2b120d-4188-4490-9802-b73e49089dd1 service nova] Creating event network-vif-deleted:9211fa85-8f48-4dc8-a67f-17093c9c0a81 for instance b96b3777-0127-496d-922a-69908440e634 on nch1-master-1 Sep 10 21:15:09.707597 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-2fe88f16-10f8-404e-826a-ff636e1f6692 req-ad2b120d-4188-4490-9802-b73e49089dd1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039557 Sep 10 21:15:09.708623 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2812/5522] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:09.740349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-066ada2b-b6f7-4890-a4b8-18987391cf5e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:09.749736 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-066ada2b-b6f7-4890-a4b8-18987391cf5e tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1471 microversion: 2.1 time: 0.274098 Sep 10 21:15:09.750496 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2711/5523] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:09 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1471 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:09.898028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b1c9768a-979b-42e5-9a6b-47abbd625c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:09.898732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b1c9768a-979b-42e5-9a6b-47abbd625c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:09.906458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c9768a-979b-42e5-9a6b-47abbd625c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:09.906949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c9768a-979b-42e5-9a6b-47abbd625c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:09.907403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c9768a-979b-42e5-9a6b-47abbd625c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:09.908095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c9768a-979b-42e5-9a6b-47abbd625c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:09.908547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c9768a-979b-42e5-9a6b-47abbd625c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:09.908972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1c9768a-979b-42e5-9a6b-47abbd625c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:10.003964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:10.004595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: c529e350-a097-4506-a06b-48cde8ec0496] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:10.017674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1c9768a-979b-42e5-9a6b-47abbd625c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:10.030301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:10.030998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:10.031604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:10.032194 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b1c9768a-979b-42e5-9a6b-47abbd625c12 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1613 microversion: 2.1 time: 0.138466 Sep 10 21:15:10.033692 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2813/5524] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:09 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1613 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:10.040759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:10.041473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:10.042336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:10.057562 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] HTTP exception thrown: Instance c529e350-a097-4506-a06b-48cde8ec0496 could not be found. Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Request method failure captured: Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496 HTTP/1.1 Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP485ujLi1DQbp2DwYA3cLswhwcLev8G6u6P6ze58BaxReECxC3wm7_EMK6I-GGZs3aUREaHJlb7blKzf6UnEoDO66ifKKoMjKE-2HziQ9VgcnqjP6anI5BX4QCscaftwgQPDN-e32klqaTwBS3Fq2HECWVsnQeKEV0P_6yeJ-WrgLE Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5c9ea913d214c569e6d6c3c1327f43a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5c9ea913d214c569e6d6c3c1327f43a"}]}] Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 9b7e48fd0dab42d3a904f7a07b939011 Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance c529e350-a097-4506-a06b-48cde8ec0496 could not be found. Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'c529e350-a097-4506-a06b-48cde8ec0496'} Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c529e350-a097-4506-a06b-48cde8ec0496 could not be found. Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c529e350-a097-4506-a06b-48cde8ec0496 could not be found. Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:10.059431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c529e350-a097-4506-a06b-48cde8ec0496 could not be found. Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Returning 404 to user: Instance c529e350-a097-4506-a06b-48cde8ec0496 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4877b5d1-94d6-4bee-9f4c-75cbbeb17567 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496" status: 404 len: 111 microversion: 2.1 time: 0.064243 Sep 10 21:15:10.063254 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2712/5525] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:09 2022] GET /compute/v2.1/servers/c529e350-a097-4506-a06b-48cde8ec0496 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:15:10.069394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:10.070035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] [instance: b96b3777-0127-496d-922a-69908440e634] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:10.077225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:10.077710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:10.078177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:10.078874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:10.079324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:10.079752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:10.096465 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] HTTP exception thrown: Instance b96b3777-0127-496d-922a-69908440e634 could not be found. Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Request method failure captured: Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 HTTP/1.1 Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP485ujLi1DQbp2DwYA3cLswhwcLev8G6u6P6ze58BaxReECxC3wm7_EMK6I-GGZs3aUREaHJlb7blKzf6UnEoDO66ifKKoMjKE-2HziQ9VgcnqjP6anI5BX4QCscaftwgQPDN-e32klqaTwBS3Fq2HECWVsnQeKEV0P_6yeJ-WrgLE Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5c9ea913d214c569e6d6c3c1327f43a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5c9ea913d214c569e6d6c3c1327f43a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5c9ea913d214c569e6d6c3c1327f43a"}]}] Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f5c9ea913d214c569e6d6c3c1327f43a Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-412073072 Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 9b7e48fd0dab42d3a904f7a07b939011 Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ListServersNegativeTestJSON-412073072-project Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance b96b3777-0127-496d-922a-69908440e634 could not be found. Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b96b3777-0127-496d-922a-69908440e634'} Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96b3777-0127-496d-922a-69908440e634 could not be found. Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96b3777-0127-496d-922a-69908440e634 could not be found. Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:10.098253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96b3777-0127-496d-922a-69908440e634 could not be found. Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] Returning 404 to user: Instance b96b3777-0127-496d-922a-69908440e634 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21d5f0a0-3954-41cc-8aa6-a884b3d76db2 tempest-ListServersNegativeTestJSON-412073072 tempest-ListServersNegativeTestJSON-412073072-project] 10.222.0.33 "GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634" status: 404 len: 111 microversion: 2.1 time: 0.034347 Sep 10 21:15:10.103091 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2814/5526] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:10 2022] GET /compute/v2.1/servers/b96b3777-0127-496d-922a-69908440e634 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:10.778273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ec82653d-6c6f-495b-883f-3b6ff4768eef tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:10.779496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ec82653d-6c6f-495b-883f-3b6ff4768eef tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:10.787208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec82653d-6c6f-495b-883f-3b6ff4768eef tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:10.787894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec82653d-6c6f-495b-883f-3b6ff4768eef tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:10.788561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec82653d-6c6f-495b-883f-3b6ff4768eef tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:10.789429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec82653d-6c6f-495b-883f-3b6ff4768eef tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:10.789921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec82653d-6c6f-495b-883f-3b6ff4768eef tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:10.790495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec82653d-6c6f-495b-883f-3b6ff4768eef tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:10.796752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:10.979981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ec82653d-6c6f-495b-883f-3b6ff4768eef tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db29080e8c047b88b33e61bf5270c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f2031a94548e5bb3eea8bce391e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:10.993337 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ec82653d-6c6f-495b-883f-3b6ff4768eef tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 200 len: 1471 microversion: 2.1 time: 0.218880 Sep 10 21:15:10.994543 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2713/5527] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:10 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:11.057722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:11.058691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:11.071652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:11.072644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:11.074398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:11.075348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:11.076433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:11.077031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:11.145990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:11.147083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:11.147715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:11.148421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lazy-loading 'fault' on Instance uuid 30e32f9e-ea2d-4481-ab27-9325f7349ce4 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:15:11.348166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54dcc78ee39c4119b08023d3cc692d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d7ded29d1345b4b3111a69f4efec6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:11.357378 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f91e57e-841b-46c9-b016-2604ca9e2d4e tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 200 len: 1330 microversion: 2.1 time: 0.304576 Sep 10 21:15:11.358535 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2815/5528] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:11 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 1330 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:11.741548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-7a92d1d1-4b74-462c-8b6c-9894f0df4b04 req-c82e727e-e42d-4e5b-bfe0-cd5a6a57264c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e32f9e-ea2d-4481-ab27-9325f7349ce4", "name": "network-vif-deleted", "tag": "634a5b75-d21e-4503-8aba-d6fbff6e4c07"}, {"server_uuid": "8c61cdb3-4758-47c1-acb2-2cf56ef7fe56", "name": "network-vif-deleted", "tag": "bf84a19e-1fe5-4448-907f-106fd87e28c3"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:11.757554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7a92d1d1-4b74-462c-8b6c-9894f0df4b04 req-c82e727e-e42d-4e5b-bfe0-cd5a6a57264c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:11.758247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7a92d1d1-4b74-462c-8b6c-9894f0df4b04 req-c82e727e-e42d-4e5b-bfe0-cd5a6a57264c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:11.758699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7a92d1d1-4b74-462c-8b6c-9894f0df4b04 req-c82e727e-e42d-4e5b-bfe0-cd5a6a57264c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:11.774686 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7a92d1d1-4b74-462c-8b6c-9894f0df4b04 req-c82e727e-e42d-4e5b-bfe0-cd5a6a57264c service nova] Creating event network-vif-deleted:634a5b75-d21e-4503-8aba-d6fbff6e4c07 for instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 on nch2-master-1 Sep 10 21:15:11.775190 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7a92d1d1-4b74-462c-8b6c-9894f0df4b04 req-c82e727e-e42d-4e5b-bfe0-cd5a6a57264c service nova] Creating event network-vif-deleted:bf84a19e-1fe5-4448-907f-106fd87e28c3 for instance 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 on nch1-master-1 Sep 10 21:15:11.785795 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-7a92d1d1-4b74-462c-8b6c-9894f0df4b04 req-c82e727e-e42d-4e5b-bfe0-cd5a6a57264c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048186 Sep 10 21:15:11.790226 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2714/5529] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:12.023229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:12.023927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] [instance: 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:12.030817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:12.031388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:12.031898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:12.032701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:12.033217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:12.033865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:12.048734 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] HTTP exception thrown: Instance 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 could not be found. Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Request method failure captured: Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 HTTP/1.1 Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP5JwLF_WW8eD-b7xkzPUcHCPk128_lRsaSsbfZo66zCsfgdFMaM4NXoD2IIiEQGPXwCsrwd57Uc-wwxTzdnc_HTRaSTo97sG0m1Rh5c4Ru-YHxUmO61oFJG9y4kbYTylcZqHoxTMWkoTroMLiFEm5YDukt6jlMc6csWT2ZEaHepddk Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: ff8f2031a94548e5bb3eea8bce391e8e Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesNegativeTest-1076307142 Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff8f2031a94548e5bb3eea8bce391e8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ff8f2031a94548e5bb3eea8bce391e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ff8f2031a94548e5bb3eea8bce391e8e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ff8f2031a94548e5bb3eea8bce391e8e"}]}] Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesNegativeTest-1076307142 Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: ff8f2031a94548e5bb3eea8bce391e8e Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesNegativeTest-1076307142 Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesNegativeTest-1076307142-project Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 8db29080e8c047b88b33e61bf5270c35 Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesNegativeTest-1076307142-project Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 could not be found. Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '8c61cdb3-4758-47c1-acb2-2cf56ef7fe56'} Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 could not be found. Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 could not be found. Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:12.050360 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:12.054517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:12.054517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:12.054517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:12.054517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:12.054517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:12.054517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 could not be found. Sep 10 21:15:12.054517 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:12.055648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] Returning 404 to user: Instance 8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:12.056497 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5007b9a5-3484-488f-a895-dbc77e4026c9 tempest-VolumesNegativeTest-1076307142 tempest-VolumesNegativeTest-1076307142-project] 10.222.0.33 "GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56" status: 404 len: 111 microversion: 2.1 time: 0.037597 Sep 10 21:15:12.057576 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2816/5530] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:12 2022] GET /compute/v2.1/servers/8c61cdb3-4758-47c1-acb2-2cf56ef7fe56 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:12.382290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:12.383344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:12.390269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:12.390977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:12.391423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:12.392518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:12.393154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:12.393752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:12.408705 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 HTTP/1.1 Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '30e32f9e-ea2d-4481-ab27-9325f7349ce4'} Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:12.410828 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:12.414345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:12.414345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:12.414345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:12.414345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:12.414345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:12.414345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:12.414345 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:12.414345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:12.414345 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-77fa6b20-8402-43dc-b136-4079878f79a0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 404 len: 111 microversion: 2.1 time: 0.035436 Sep 10 21:15:12.417217 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2715/5531] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:12 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:12.423688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-616d5216-85bd-4832-b5fb-ab71b5205fba tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '.version_select at 0x7f993f89d1f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:12.456555 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-616d5216-85bd-4832-b5fb-ab71b5205fba tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-228661552" status: 202 len: 0 microversion: 2.1 time: 0.036591 Sep 10 21:15:12.461519 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2817/5532] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 21:15:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-228661552 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:15:14.718049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:14.719202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:14.725227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:14.727558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:14.728110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:14.728718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:14.729918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:14.730544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:14.730977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:14.748521 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 HTTP/1.1 Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '30e32f9e-ea2d-4481-ab27-9325f7349ce4'} Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:14.750415 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-520970f9-b6dd-499b-b4df-462f0f3c6d0f tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 404 len: 111 microversion: 2.1 time: 0.038706 Sep 10 21:15:14.755645 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2716/5533] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:15:14 2022] DELETE /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:14.760030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:14.766086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:14.766687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: 30e32f9e-ea2d-4481-ab27-9325f7349ce4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:14.774032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:14.774700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:14.775126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:14.776716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:14.777251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:14.777861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:14.792482 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 HTTP/1.1 Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '30e32f9e-ea2d-4481-ab27-9325f7349ce4'} Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:14.794054 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:14.797531 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:14.797531 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:14.797531 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:14.797531 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:14.797531 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:14.797531 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. Sep 10 21:15:14.797531 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:14.798934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance 30e32f9e-ea2d-4481-ab27-9325f7349ce4 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:14.799610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-87d5c9c1-9292-41bb-b2ce-785090d9c83a tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4" status: 404 len: 111 microversion: 2.1 time: 0.041439 Sep 10 21:15:14.800308 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2818/5534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:14 2022] GET /compute/v2.1/servers/30e32f9e-ea2d-4481-ab27-9325f7349ce4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:15.980129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:15.980532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:15.987316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:15.987842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:15.988288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:15.989016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:15.989476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:15.989943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:15.993123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=10 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:16.004961 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c HTTP/1.1 Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'e983600b-2110-437c-a0db-fb0d9c8fe55c'} Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:16.006590 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5298900f-ea6d-492c-b6ee-0c762c3e3cc0 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 404 len: 111 microversion: 2.1 time: 0.033013 Sep 10 21:15:16.011143 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2717/5535] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:15:15 2022] DELETE /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:16.016301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:16.016921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: e983600b-2110-437c-a0db-fb0d9c8fe55c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:16.022884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:16.023377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:16.023823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:16.024527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:16.024990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:16.025423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:16.039313 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c HTTP/1.1 Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'e983600b-2110-437c-a0db-fb0d9c8fe55c'} Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:16.040893 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.045431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.045431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:16.045431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:16.045431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:16.045431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:16.045431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. Sep 10 21:15:16.045431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.045431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance e983600b-2110-437c-a0db-fb0d9c8fe55c could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:16.045431 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5cf30541-0b6a-4256-8750-9f3f77c0c2f8 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c" status: 404 len: 111 microversion: 2.1 time: 0.030403 Sep 10 21:15:16.045431 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2718/5536] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:16 2022] GET /compute/v2.1/servers/e983600b-2110-437c-a0db-fb0d9c8fe55c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:16.051394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:16.051907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:16.058466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:16.058960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:16.059407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:16.060114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:16.060581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:16.061016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:16.075130 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 HTTP/1.1 Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'f04e7926-fc3d-456a-ad4f-7099ef9811e9'} Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:16.076720 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8bd866c-26ae-40c6-b128-128218037729 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 404 len: 111 microversion: 2.1 time: 0.030353 Sep 10 21:15:16.080787 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2719/5537] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:15:16 2022] DELETE /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:15:16.086994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:16.087614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: f04e7926-fc3d-456a-ad4f-7099ef9811e9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:16.094166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:16.094661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:16.095111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:16.095828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:16.096274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:16.096704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:16.112844 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 HTTP/1.1 Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'f04e7926-fc3d-456a-ad4f-7099ef9811e9'} Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:16.114452 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.118738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:16.118738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:16.118738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:16.118738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:16.118738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:16.118738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. Sep 10 21:15:16.118738 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:16.118738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance f04e7926-fc3d-456a-ad4f-7099ef9811e9 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:16.118738 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7055775f-6737-4726-972d-4c51ba48624d tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9" status: 404 len: 111 microversion: 2.1 time: 0.033054 Sep 10 21:15:16.120080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-578735122", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": "none"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:16.120238 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2720/5538] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:16 2022] GET /compute/v2.1/servers/f04e7926-fc3d-456a-ad4f-7099ef9811e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:15:16.174957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:15:16.175389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:15:16.175862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:15:16.176271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:15:16.176685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:15:16.190204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:16.191490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:16.192106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:16.193323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:16.193800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:16.194309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:16.212814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Getting quotas for project 3ae9868b7610448b90be6b692fd087d8. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:15:16.220165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Getting quotas for user a16673f69a1445f982ad5c5c800ca3af and project 3ae9868b7610448b90be6b692fd087d8. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:15:16.238556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:15:16.238556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:15:16.270124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:16.294383 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2cc0d498-d194-4234-bc2f-77343fd8a250 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.305576 Sep 10 21:15:16.299390 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2819/5539] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 21:15:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 311 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 21:15:16.311024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7671fe17-3d42-4aed-9afd-55bec084df38 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:16.311872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7671fe17-3d42-4aed-9afd-55bec084df38 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:16.374891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7671fe17-3d42-4aed-9afd-55bec084df38 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:16.382956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7671fe17-3d42-4aed-9afd-55bec084df38 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:16.384658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7671fe17-3d42-4aed-9afd-55bec084df38 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:16.386498 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7671fe17-3d42-4aed-9afd-55bec084df38 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1280 microversion: 2.47 time: 0.080079 Sep 10 21:15:16.387309 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2721/5540] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:16 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:17.271642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:17.272150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:17.283464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:17.283962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:17.284405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:17.285114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:17.285741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:17.286376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:17.301855 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 HTTP/1.1 Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'd7693b5b-858c-4224-93a8-e07f29b30646'} Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:17.303388 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0159bf78-d086-4870-9ffa-1b499f589846 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 404 len: 111 microversion: 2.1 time: 0.037446 Sep 10 21:15:17.307834 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2820/5541] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:15:17 2022] DELETE /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:15:17.319342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:17.319342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] [instance: d7693b5b-858c-4224-93a8-e07f29b30646] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:17.324340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:17.324842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:17.325278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:17.326014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:17.326472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:17.327083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:17.341852 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] HTTP exception thrown: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Request method failure captured: Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 HTTP/1.1 Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP0IIk6QZxgHkLfvlv3RS_OQZeIZJ1SVGUN2CKhf45x0nxn0fVWqzjwqiHbPKT7PgIfbkwcbX-wb44V4kXUyOO4lZCTOQ15RlAR8f32oF3BC8RYbftPve6bk2EQZTG9RcWUCXKL7a_8aU8YyjdofuEa9eBymFcqNwV66YJURGX9LDRw Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8d7ded29d1345b4b3111a69f4efec6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8d7ded29d1345b4b3111a69f4efec6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8d7ded29d1345b4b3111a69f4efec6f"}]}] Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c8d7ded29d1345b4b3111a69f4efec6f Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1142263200 Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 54dcc78ee39c4119b08023d3cc692d6b Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeNegativeTest-1142263200-project Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'd7693b5b-858c-4224-93a8-e07f29b30646'} Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:17.343427 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:17.347513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:17.347513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:17.347513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:17.347513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:17.347513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:17.347513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. Sep 10 21:15:17.347513 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:17.347513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] Returning 404 to user: Instance d7693b5b-858c-4224-93a8-e07f29b30646 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:17.347513 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ceb4a2ad-1b37-491f-ae96-f2df1f3ee1e5 tempest-AttachVolumeNegativeTest-1142263200 tempest-AttachVolumeNegativeTest-1142263200-project] 10.222.0.33 "GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646" status: 404 len: 111 microversion: 2.1 time: 0.033544 Sep 10 21:15:17.347513 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2722/5542] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:17 2022] GET /compute/v2.1/servers/d7693b5b-858c-4224-93a8-e07f29b30646 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:15:17.415950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:17.416611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:17.424728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:17.425494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:17.426200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:17.426908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:17.427836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:17.427931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:17.532464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:17.545623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:17.548438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:17.549605 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d1ad34e-9cb9-4471-a1fc-8dbaf74e52ee tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1332 microversion: 2.47 time: 0.139562 Sep 10 21:15:17.550197 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2821/5543] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:17 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1332 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:18.584399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:18.585682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:18.597970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:18.598627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:18.599068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:18.611760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:18.612505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:18.613097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:18.722225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:18.733006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:18.734703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:18.736367 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9dd0440b-97f4-433b-8de7-50635d4ce190 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1338 microversion: 2.47 time: 0.156177 Sep 10 21:15:18.737095 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2822/5544] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:18 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1338 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:18.846717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-82f0fbd0-f7fa-4b30-a6b4-5f8778c24811 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:18.847495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-82f0fbd0-f7fa-4b30-a6b4-5f8778c24811 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:18.855431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82f0fbd0-f7fa-4b30-a6b4-5f8778c24811 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:18.855940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82f0fbd0-f7fa-4b30-a6b4-5f8778c24811 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:18.856379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82f0fbd0-f7fa-4b30-a6b4-5f8778c24811 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:18.857292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82f0fbd0-f7fa-4b30-a6b4-5f8778c24811 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:18.857752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82f0fbd0-f7fa-4b30-a6b4-5f8778c24811 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:18.858300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82f0fbd0-f7fa-4b30-a6b4-5f8778c24811 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:19.096913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-82f0fbd0-f7fa-4b30-a6b4-5f8778c24811 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:19.105666 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-82f0fbd0-f7fa-4b30-a6b4-5f8778c24811 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.588022 Sep 10 21:15:19.106357 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2723/5545] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:18 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:19.129955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-906004cd-c453-42f1-ae9f-87a6259b183f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:19.131183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-906004cd-c453-42f1-ae9f-87a6259b183f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:19.137639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906004cd-c453-42f1-ae9f-87a6259b183f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:19.138609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906004cd-c453-42f1-ae9f-87a6259b183f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:19.138786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906004cd-c453-42f1-ae9f-87a6259b183f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:19.139486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906004cd-c453-42f1-ae9f-87a6259b183f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:19.139937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906004cd-c453-42f1-ae9f-87a6259b183f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:19.140523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-906004cd-c453-42f1-ae9f-87a6259b183f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:19.275384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-906004cd-c453-42f1-ae9f-87a6259b183f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:19.284373 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-906004cd-c453-42f1-ae9f-87a6259b183f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.158328 Sep 10 21:15:19.285171 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2823/5546] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:19 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:19.307506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-104a05fb-b933-4112-a7a5-a2b0d99058f1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:19.308378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-104a05fb-b933-4112-a7a5-a2b0d99058f1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:19.314768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-104a05fb-b933-4112-a7a5-a2b0d99058f1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:19.315268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-104a05fb-b933-4112-a7a5-a2b0d99058f1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:19.315710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-104a05fb-b933-4112-a7a5-a2b0d99058f1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:19.316422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-104a05fb-b933-4112-a7a5-a2b0d99058f1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:19.316885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-104a05fb-b933-4112-a7a5-a2b0d99058f1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:19.317484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-104a05fb-b933-4112-a7a5-a2b0d99058f1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:19.561274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-104a05fb-b933-4112-a7a5-a2b0d99058f1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:19.577532 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-104a05fb-b933-4112-a7a5-a2b0d99058f1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.274425 Sep 10 21:15:19.578187 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2724/5547] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:19 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:19.606102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2496dd97-2718-4bc0-a8f3-10295aaad404 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:19.607359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2496dd97-2718-4bc0-a8f3-10295aaad404 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:19.615256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2496dd97-2718-4bc0-a8f3-10295aaad404 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:19.615948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2496dd97-2718-4bc0-a8f3-10295aaad404 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:19.616569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2496dd97-2718-4bc0-a8f3-10295aaad404 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:19.617443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2496dd97-2718-4bc0-a8f3-10295aaad404 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:19.617959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2496dd97-2718-4bc0-a8f3-10295aaad404 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:19.618549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2496dd97-2718-4bc0-a8f3-10295aaad404 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:19.764244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:19.765125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:19.772072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:19.773777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:19.774474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:19.775277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:19.776404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:19.777371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:19.778111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:19.797128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2496dd97-2718-4bc0-a8f3-10295aaad404 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:19.808596 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2496dd97-2718-4bc0-a8f3-10295aaad404 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.208905 Sep 10 21:15:19.809797 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2824/5548] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:19 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:19.899638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1288296850", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "22651555-9c52-45fb-b1cb-a14fc16f0427"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:19.918435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:19.945434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:19.947352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:19.949720 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fa50a6cf-85d7-470e-9ec7-f3073b5ae75a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1338 microversion: 2.47 time: 0.189284 Sep 10 21:15:19.950421 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2725/5549] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:19 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1338 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:15:20.002107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] validate_networks() for [('22651555-9c52-45fb-b1cb-a14fc16f0427', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:15:20.468340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:15:20.468757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:15:20.469230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:15:20.469640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:15:20.470104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:15:20.480414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:20.480913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:20.481353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:20.482139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:20.482594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:20.483017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:20.510897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for project 15a76a25754c42099c542fa13046f01b. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:15:20.516420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for user d83b6ceb599746b394e379d52683b70c and project 15a76a25754c42099c542fa13046f01b. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:15:20.528776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:15:20.531009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:15:20.577031 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5c352f89-7766-4368-bad0-3278fd405faa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681893 Sep 10 21:15:20.577908 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2825/5550] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:15:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:15:20.589951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-59643b0e-2a79-4f5c-993d-4a359a79e630 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:20.590567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-59643b0e-2a79-4f5c-993d-4a359a79e630 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:20.647402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-59643b0e-2a79-4f5c-993d-4a359a79e630 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:20.655810 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-59643b0e-2a79-4f5c-993d-4a359a79e630 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1215 microversion: 2.1 time: 0.070856 Sep 10 21:15:20.656455 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2726/5551] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:20 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:20.976619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:20.977366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:20.990707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:20.993792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:20.997861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:20.999409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:21.000164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:21.000718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:21.116029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:21.132524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:21.134329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:21.139317 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1490511a-a2fe-4935-8c02-7115bf032d7b tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1338 microversion: 2.47 time: 0.166493 Sep 10 21:15:21.146079 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2826/5552] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:20 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1338 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:21.684006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-13541ee4-3fa2-4277-96f1-75ae8de0db22 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:21.686425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-13541ee4-3fa2-4277-96f1-75ae8de0db22 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:21.697262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13541ee4-3fa2-4277-96f1-75ae8de0db22 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:21.698631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13541ee4-3fa2-4277-96f1-75ae8de0db22 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:21.699235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13541ee4-3fa2-4277-96f1-75ae8de0db22 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:21.700350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13541ee4-3fa2-4277-96f1-75ae8de0db22 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:21.701456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13541ee4-3fa2-4277-96f1-75ae8de0db22 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:21.702321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13541ee4-3fa2-4277-96f1-75ae8de0db22 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:21.803823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-13541ee4-3fa2-4277-96f1-75ae8de0db22 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:21.812688 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-13541ee4-3fa2-4277-96f1-75ae8de0db22 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1267 microversion: 2.1 time: 0.137204 Sep 10 21:15:21.818054 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2727/5553] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:21 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:22.167799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:22.169120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:22.176969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:22.177795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:22.178483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:22.179451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:22.180144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:22.180779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:22.254075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:22.270150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:22.271607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:22.272790 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-68797127-e98b-4ab6-a73f-10206ca12291 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1359 microversion: 2.47 time: 0.109461 Sep 10 21:15:22.273359 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2827/5554] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:22 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1359 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:22.300130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d4747f28-243e-48ce-bae0-ac4ecbf359ea tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2073101805"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:22.303888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4747f28-243e-48ce-bae0-ac4ecbf359ea tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:22.317971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4747f28-243e-48ce-bae0-ac4ecbf359ea tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:22.318487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4747f28-243e-48ce-bae0-ac4ecbf359ea tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:22.318976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4747f28-243e-48ce-bae0-ac4ecbf359ea tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:22.320040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4747f28-243e-48ce-bae0-ac4ecbf359ea tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:22.320663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4747f28-243e-48ce-bae0-ac4ecbf359ea tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:22.321785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4747f28-243e-48ce-bae0-ac4ecbf359ea tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:22.589560 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d4747f28-243e-48ce-bae0-ac4ecbf359ea tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "POST /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a/action" status: 202 len: 52 microversion: 2.47 time: 0.294686 Sep 10 21:15:22.603559 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2728/5555] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 21:15:22 2022] POST /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a/action => generated 52 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 10 21:15:22.604988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5bd6b9c-6752-4001-860e-0277f881ee3c tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:22.605507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5bd6b9c-6752-4001-860e-0277f881ee3c tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:22.612403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5bd6b9c-6752-4001-860e-0277f881ee3c tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:22.613354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5bd6b9c-6752-4001-860e-0277f881ee3c tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:22.614144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5bd6b9c-6752-4001-860e-0277f881ee3c tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:22.615216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5bd6b9c-6752-4001-860e-0277f881ee3c tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:22.616086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5bd6b9c-6752-4001-860e-0277f881ee3c tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:22.616671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5bd6b9c-6752-4001-860e-0277f881ee3c tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:22.643402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:22.653228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5bd6b9c-6752-4001-860e-0277f881ee3c tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:15:22.773391 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5bd6b9c-6752-4001-860e-0277f881ee3c tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 204 len: 0 microversion: 2.47 time: 0.174028 Sep 10 21:15:22.775505 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2828/5556] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:15:22 2022] DELETE /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 21:15:22.786581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:22.788475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:22.799033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:22.799983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:22.800721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:22.801645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:22.802352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:22.803218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:22.846240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-43d36567-9055-4687-b3f9-6b2ad21ada6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:22.846905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-43d36567-9055-4687-b3f9-6b2ad21ada6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:22.861404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43d36567-9055-4687-b3f9-6b2ad21ada6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:22.861973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43d36567-9055-4687-b3f9-6b2ad21ada6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:22.862375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43d36567-9055-4687-b3f9-6b2ad21ada6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:22.863221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43d36567-9055-4687-b3f9-6b2ad21ada6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:22.863631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43d36567-9055-4687-b3f9-6b2ad21ada6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:22.864062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-43d36567-9055-4687-b3f9-6b2ad21ada6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:22.952580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-43d36567-9055-4687-b3f9-6b2ad21ada6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:22.968499 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-43d36567-9055-4687-b3f9-6b2ad21ada6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1273 microversion: 2.1 time: 0.126389 Sep 10 21:15:22.969348 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2829/5557] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:22 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:23.253582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:23.263622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:23.265328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:23.272867 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-63e3b1b2-a414-4580-97de-a2f5f7004745 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1365 microversion: 2.47 time: 0.492018 Sep 10 21:15:23.275581 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2729/5558] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:22 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1365 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:23.995261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3a2fa4ab-23ba-42c3-8b07-96dc999ad7a9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:23.995885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3a2fa4ab-23ba-42c3-8b07-96dc999ad7a9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:24.004175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a2fa4ab-23ba-42c3-8b07-96dc999ad7a9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:24.004175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a2fa4ab-23ba-42c3-8b07-96dc999ad7a9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:24.004175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a2fa4ab-23ba-42c3-8b07-96dc999ad7a9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:24.006387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a2fa4ab-23ba-42c3-8b07-96dc999ad7a9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:24.007630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a2fa4ab-23ba-42c3-8b07-96dc999ad7a9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:24.008412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a2fa4ab-23ba-42c3-8b07-96dc999ad7a9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:24.201494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a2fa4ab-23ba-42c3-8b07-96dc999ad7a9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:24.212564 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3a2fa4ab-23ba-42c3-8b07-96dc999ad7a9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1315 microversion: 2.1 time: 0.222376 Sep 10 21:15:24.227543 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2830/5559] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:23 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:24.304153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:24.305752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:24.342054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:24.343002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:24.343704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:24.345560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:24.346477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:24.347612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:24.380804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0f0d29a0-5d68-42e1-ad72-72ed92f3f364 req-30f23ccf-3013-4df4-afd1-15dc3785ed47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33229432-7e4c-40cb-8bbf-c5a11e562b94", "tag": "4eee075f-3ed6-4e71-a2ea-73e196e4cb97"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:24.408647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0f0d29a0-5d68-42e1-ad72-72ed92f3f364 req-30f23ccf-3013-4df4-afd1-15dc3785ed47 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:24.409132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0f0d29a0-5d68-42e1-ad72-72ed92f3f364 req-30f23ccf-3013-4df4-afd1-15dc3785ed47 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:24.410249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0f0d29a0-5d68-42e1-ad72-72ed92f3f364 req-30f23ccf-3013-4df4-afd1-15dc3785ed47 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:24.437520 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0f0d29a0-5d68-42e1-ad72-72ed92f3f364 req-30f23ccf-3013-4df4-afd1-15dc3785ed47 service nova] Creating event network-changed:4eee075f-3ed6-4e71-a2ea-73e196e4cb97 for instance 33229432-7e4c-40cb-8bbf-c5a11e562b94 on nch2-master-1 Sep 10 21:15:24.453920 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0f0d29a0-5d68-42e1-ad72-72ed92f3f364 req-30f23ccf-3013-4df4-afd1-15dc3785ed47 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076589 Sep 10 21:15:24.454760 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2831/5560] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:24.495591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:24.507536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:24.509380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:24.511502 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-839ecf33-c4a4-490d-ad70-15ba0840969a tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1365 microversion: 2.47 time: 0.214744 Sep 10 21:15:24.513357 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2730/5561] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:24 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:15:25.241174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8328c80b-17f6-4650-8a8c-fbc860b98cf6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:25.241903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8328c80b-17f6-4650-8a8c-fbc860b98cf6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:25.249106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8328c80b-17f6-4650-8a8c-fbc860b98cf6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:25.249781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8328c80b-17f6-4650-8a8c-fbc860b98cf6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:25.250247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8328c80b-17f6-4650-8a8c-fbc860b98cf6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:25.250963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8328c80b-17f6-4650-8a8c-fbc860b98cf6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:25.251580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8328c80b-17f6-4650-8a8c-fbc860b98cf6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:25.252178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8328c80b-17f6-4650-8a8c-fbc860b98cf6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:25.411577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8328c80b-17f6-4650-8a8c-fbc860b98cf6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:25.421613 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8328c80b-17f6-4650-8a8c-fbc860b98cf6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1315 microversion: 2.1 time: 0.185660 Sep 10 21:15:25.422468 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2832/5562] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:25 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:25.540712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:25.542192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:25.550291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:25.550999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:25.551596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:25.552568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:25.553001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:25.553687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:25.632690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:25.656870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:25.658400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:25.659638 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6133a744-f1f7-442b-b881-013616f0e405 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1365 microversion: 2.47 time: 0.122859 Sep 10 21:15:25.675371 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2731/5563] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:25 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:26.446525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5123a0a-f423-484c-8d0e-9805e1bc84ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:26.447187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5123a0a-f423-484c-8d0e-9805e1bc84ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:26.455012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5123a0a-f423-484c-8d0e-9805e1bc84ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:26.455510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5123a0a-f423-484c-8d0e-9805e1bc84ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:26.455951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5123a0a-f423-484c-8d0e-9805e1bc84ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:26.456656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5123a0a-f423-484c-8d0e-9805e1bc84ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:26.457355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5123a0a-f423-484c-8d0e-9805e1bc84ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:26.457937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5123a0a-f423-484c-8d0e-9805e1bc84ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:26.668903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5123a0a-f423-484c-8d0e-9805e1bc84ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:26.686680 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5123a0a-f423-484c-8d0e-9805e1bc84ec tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1315 microversion: 2.1 time: 0.239079 Sep 10 21:15:26.687816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:26.688344 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2833/5564] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:26 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:26.689244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:26.701073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:26.702037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:26.702712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:26.704882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:26.705573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:26.706303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:26.812925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:26.824859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:26.834950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:26.836895 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-25b12ae8-fbfc-4076-a4e5-1900f0bf771d tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1365 microversion: 2.47 time: 0.152989 Sep 10 21:15:26.838394 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2732/5565] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:26 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:27.714059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8b87ca93-a237-4ec4-aa9c-b2df26276fc7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:27.715014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8b87ca93-a237-4ec4-aa9c-b2df26276fc7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:27.722486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b87ca93-a237-4ec4-aa9c-b2df26276fc7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:27.722983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b87ca93-a237-4ec4-aa9c-b2df26276fc7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:27.723424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b87ca93-a237-4ec4-aa9c-b2df26276fc7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:27.724130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b87ca93-a237-4ec4-aa9c-b2df26276fc7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:27.729093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b87ca93-a237-4ec4-aa9c-b2df26276fc7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:27.730011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8b87ca93-a237-4ec4-aa9c-b2df26276fc7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:27.828311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-93974fac-6b90-4172-ac62-39e610fdb4b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:27.829638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-93974fac-6b90-4172-ac62-39e610fdb4b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:27.844989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93974fac-6b90-4172-ac62-39e610fdb4b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:27.847479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93974fac-6b90-4172-ac62-39e610fdb4b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:27.848201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93974fac-6b90-4172-ac62-39e610fdb4b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:27.850506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93974fac-6b90-4172-ac62-39e610fdb4b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:27.851092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93974fac-6b90-4172-ac62-39e610fdb4b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:27.851765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93974fac-6b90-4172-ac62-39e610fdb4b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:27.987577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8b87ca93-a237-4ec4-aa9c-b2df26276fc7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:27.988445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-93974fac-6b90-4172-ac62-39e610fdb4b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lazy-loading 'services' on Instance uuid c3c63541-628c-4ce4-9f01-692098a47a8a {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:15:27.999544 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8b87ca93-a237-4ec4-aa9c-b2df26276fc7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1315 microversion: 2.1 time: 0.290075 Sep 10 21:15:28.000146 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2834/5566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:27 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:28.014217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:28.014217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:28.014217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:28.014217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:28.014217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:28.014603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:28.015128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:28.015959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:28.064048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:28.064952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:28.065364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:28.066300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lazy-loading 'fault' on Instance uuid 5814b238-6db2-4755-aede-6bb14e2a591a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:15:28.113974 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-93974fac-6b90-4172-ac62-39e610fdb4b0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a/os-volume_attachments/d9700a70-feeb-4768-a297-e5cc27b3c3fe" status: 202 len: 0 microversion: 2.1 time: 0.304101 Sep 10 21:15:28.117363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:28.118467 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2733/5567] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 21:15:27 2022] DELETE /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a/os-volume_attachments/d9700a70-feeb-4768-a297-e5cc27b3c3fe => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:15:28.127987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:28.129799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a16673f69a1445f982ad5c5c800ca3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae9868b7610448b90be6b692fd087d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:28.131368 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3a7ef840-bf86-4897-afdd-f7a53c5c54d4 tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 200 len: 1370 microversion: 2.47 time: 0.130204 Sep 10 21:15:28.146573 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2835/5568] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:28 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:29.027948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eb85eaa3-803b-4f62-9be3-e1ab6300c52a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:29.028670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eb85eaa3-803b-4f62-9be3-e1ab6300c52a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:29.054333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb85eaa3-803b-4f62-9be3-e1ab6300c52a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:29.055023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb85eaa3-803b-4f62-9be3-e1ab6300c52a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:29.055631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb85eaa3-803b-4f62-9be3-e1ab6300c52a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:29.056408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb85eaa3-803b-4f62-9be3-e1ab6300c52a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:29.057200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb85eaa3-803b-4f62-9be3-e1ab6300c52a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:29.057644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb85eaa3-803b-4f62-9be3-e1ab6300c52a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:29.160617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:29.161470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] [instance: 5814b238-6db2-4755-aede-6bb14e2a591a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:29.176985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:29.178300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:29.179175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:29.183492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:29.184098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:29.185237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:29.216864 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] HTTP exception thrown: Instance 5814b238-6db2-4755-aede-6bb14e2a591a could not be found. Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Request method failure captured: Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a HTTP/1.1 Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP5jj1pwirublrmjSNYhCj1cxJRmrumy-DI0fUpaKUWz5xZRY34joFb5OcroDBJRj06HoZXk3poT1bZ_nqNNGHRNa1lgCF8MH1iJjNaO8A0ZNV2MOSu2tkmmjjughXFuwskhNWV_5jWXQfzVrrpx35U-_S4Qjr-qZ-aH0TI4r3BhHFY Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.47 Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 3ae9868b7610448b90be6b692fd087d8 Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAaction247Test-1003239422 Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3ae9868b7610448b90be6b692fd087d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3ae9868b7610448b90be6b692fd087d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3ae9868b7610448b90be6b692fd087d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3ae9868b7610448b90be6b692fd087d8"}]}] Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAaction247Test-1003239422 Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 3ae9868b7610448b90be6b692fd087d8 Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAaction247Test-1003239422 Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAaction247Test-1003239422-project Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: a16673f69a1445f982ad5c5c800ca3af Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAaction247Test-1003239422-project Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 5814b238-6db2-4755-aede-6bb14e2a591a could not be found. Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '5814b238-6db2-4755-aede-6bb14e2a591a'} Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5814b238-6db2-4755-aede-6bb14e2a591a could not be found. Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5814b238-6db2-4755-aede-6bb14e2a591a could not be found. Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:29.219298 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:29.223180 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:29.223180 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:29.223180 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:29.223180 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:29.223180 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:29.223180 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:29.223180 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5814b238-6db2-4755-aede-6bb14e2a591a could not be found. Sep 10 21:15:29.223180 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:15:29.225192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] Returning 404 to user: Instance 5814b238-6db2-4755-aede-6bb14e2a591a could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:29.226343 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-62f7de2e-d1a6-4402-875b-5e4f00ad93be tempest-ServersAaction247Test-1003239422 tempest-ServersAaction247Test-1003239422-project] 10.222.0.33 "GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a" status: 404 len: 111 microversion: 2.47 time: 0.069930 Sep 10 21:15:29.227505 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2836/5569] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:29 2022] GET /compute/v2.1/servers/5814b238-6db2-4755-aede-6bb14e2a591a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 10 21:15:29.299341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eb85eaa3-803b-4f62-9be3-e1ab6300c52a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:29.306057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-45c5595f-c59b-4d56-a050-9c1e84cd60f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:29.307610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-45c5595f-c59b-4d56-a050-9c1e84cd60f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:29.322214 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eb85eaa3-803b-4f62-9be3-e1ab6300c52a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1315 microversion: 2.1 time: 0.299510 Sep 10 21:15:29.325523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c5595f-c59b-4d56-a050-9c1e84cd60f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:29.326295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c5595f-c59b-4d56-a050-9c1e84cd60f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:29.327759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c5595f-c59b-4d56-a050-9c1e84cd60f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:29.329103 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2734/5570] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:29 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:29.329430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c5595f-c59b-4d56-a050-9c1e84cd60f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:29.330050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c5595f-c59b-4d56-a050-9c1e84cd60f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:29.330778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45c5595f-c59b-4d56-a050-9c1e84cd60f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:29.366426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-45c5595f-c59b-4d56-a050-9c1e84cd60f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:15:29.421137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b7e25296-a9e5-42a0-9f8c-c54e5870b4fc req-6cff3634-297d-4a6a-b381-c6fbe897d303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33229432-7e4c-40cb-8bbf-c5a11e562b94", "name": "network-vif-plugged", "status": "completed", "tag": "4eee075f-3ed6-4e71-a2ea-73e196e4cb97"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:29.440672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b7e25296-a9e5-42a0-9f8c-c54e5870b4fc req-6cff3634-297d-4a6a-b381-c6fbe897d303 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:29.441460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b7e25296-a9e5-42a0-9f8c-c54e5870b4fc req-6cff3634-297d-4a6a-b381-c6fbe897d303 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:29.442331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b7e25296-a9e5-42a0-9f8c-c54e5870b4fc req-6cff3634-297d-4a6a-b381-c6fbe897d303 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:29.449575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:29.464741 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b7e25296-a9e5-42a0-9f8c-c54e5870b4fc req-6cff3634-297d-4a6a-b381-c6fbe897d303 service nova] Creating event network-vif-plugged:4eee075f-3ed6-4e71-a2ea-73e196e4cb97 for instance 33229432-7e4c-40cb-8bbf-c5a11e562b94 on nch2-master-1 Sep 10 21:15:29.473302 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b7e25296-a9e5-42a0-9f8c-c54e5870b4fc req-6cff3634-297d-4a6a-b381-c6fbe897d303 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058669 Sep 10 21:15:29.474632 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2735/5571] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:15:29.572687 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-45c5595f-c59b-4d56-a050-9c1e84cd60f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 204 len: 0 microversion: 2.1 time: 0.269671 Sep 10 21:15:29.579662 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2837/5572] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:15:29 2022] DELETE /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:15:29.598166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-97ff88f9-0503-4396-a530-cb27e79e7463 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:29.601780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-97ff88f9-0503-4396-a530-cb27e79e7463 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:29.626140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97ff88f9-0503-4396-a530-cb27e79e7463 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:29.626708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97ff88f9-0503-4396-a530-cb27e79e7463 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:29.627213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97ff88f9-0503-4396-a530-cb27e79e7463 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:29.627956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97ff88f9-0503-4396-a530-cb27e79e7463 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:29.634336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97ff88f9-0503-4396-a530-cb27e79e7463 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:29.635404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97ff88f9-0503-4396-a530-cb27e79e7463 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:29.910772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-97ff88f9-0503-4396-a530-cb27e79e7463 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:29.922301 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-97ff88f9-0503-4396-a530-cb27e79e7463 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1513 microversion: 2.1 time: 0.338130 Sep 10 21:15:29.948720 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2736/5573] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:29 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1513 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:30.356420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-01b38722-f23a-4341-a95b-4bb400084b30 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:30.357193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-01b38722-f23a-4341-a95b-4bb400084b30 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:30.377440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01b38722-f23a-4341-a95b-4bb400084b30 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:30.380496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01b38722-f23a-4341-a95b-4bb400084b30 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:30.382860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01b38722-f23a-4341-a95b-4bb400084b30 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:30.387490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01b38722-f23a-4341-a95b-4bb400084b30 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:30.388100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01b38722-f23a-4341-a95b-4bb400084b30 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:30.389646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01b38722-f23a-4341-a95b-4bb400084b30 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:30.491711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:30.523595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:30.729681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-01b38722-f23a-4341-a95b-4bb400084b30 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:30.740994 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-01b38722-f23a-4341-a95b-4bb400084b30 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1315 microversion: 2.1 time: 0.389859 Sep 10 21:15:30.755540 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2838/5574] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:30 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:30.946723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1862e4d8-5716-4c86-baec-95b42036466d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:30.948132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1862e4d8-5716-4c86-baec-95b42036466d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:30.957046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:30.973403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1862e4d8-5716-4c86-baec-95b42036466d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:30.980965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1862e4d8-5716-4c86-baec-95b42036466d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:30.982541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1862e4d8-5716-4c86-baec-95b42036466d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:30.985409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1862e4d8-5716-4c86-baec-95b42036466d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:30.986506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1862e4d8-5716-4c86-baec-95b42036466d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:30.986967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1862e4d8-5716-4c86-baec-95b42036466d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:31.014972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0fd4bf78-fe64-4ada-9b42-0a16cbee068e req-f7ed0ff5-87a6-4262-a555-6d63256d5dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c63541-628c-4ce4-9f01-692098a47a8a", "name": "network-vif-deleted", "tag": "eb658c5c-4d51-4734-bb8b-cfed61b26aee"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:31.037961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0fd4bf78-fe64-4ada-9b42-0a16cbee068e req-f7ed0ff5-87a6-4262-a555-6d63256d5dce service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:31.038506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0fd4bf78-fe64-4ada-9b42-0a16cbee068e req-f7ed0ff5-87a6-4262-a555-6d63256d5dce service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:31.039365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0fd4bf78-fe64-4ada-9b42-0a16cbee068e req-f7ed0ff5-87a6-4262-a555-6d63256d5dce service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:31.073374 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0fd4bf78-fe64-4ada-9b42-0a16cbee068e req-f7ed0ff5-87a6-4262-a555-6d63256d5dce service nova] Creating event network-vif-deleted:eb658c5c-4d51-4734-bb8b-cfed61b26aee for instance c3c63541-628c-4ce4-9f01-692098a47a8a on nch1-master-1 Sep 10 21:15:31.088891 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0fd4bf78-fe64-4ada-9b42-0a16cbee068e req-f7ed0ff5-87a6-4262-a555-6d63256d5dce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077536 Sep 10 21:15:31.103914 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2839/5575] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:31.154781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1862e4d8-5716-4c86-baec-95b42036466d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:31.174854 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1862e4d8-5716-4c86-baec-95b42036466d tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 200 len: 1471 microversion: 2.1 time: 0.232548 Sep 10 21:15:31.175292 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2737/5576] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:30 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:31.779529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e59a3696-239c-43bd-b4c5-3b6e52ac0256 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:31.793107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e59a3696-239c-43bd-b4c5-3b6e52ac0256 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:31.814199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e59a3696-239c-43bd-b4c5-3b6e52ac0256 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:31.815124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e59a3696-239c-43bd-b4c5-3b6e52ac0256 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:31.816138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e59a3696-239c-43bd-b4c5-3b6e52ac0256 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:31.822730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e59a3696-239c-43bd-b4c5-3b6e52ac0256 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:31.823750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e59a3696-239c-43bd-b4c5-3b6e52ac0256 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:31.824597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e59a3696-239c-43bd-b4c5-3b6e52ac0256 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:32.170630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e59a3696-239c-43bd-b4c5-3b6e52ac0256 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:32.180922 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e59a3696-239c-43bd-b4c5-3b6e52ac0256 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1502 microversion: 2.1 time: 0.415823 Sep 10 21:15:32.209966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:32.211211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: c3c63541-628c-4ce4-9f01-692098a47a8a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:32.218798 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2840/5577] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:31 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1502 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:32.227672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-80489490-eef2-43c0-9f62-1f1c708a9e9a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:32.230136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:32.230984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:32.232201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-80489490-eef2-43c0-9f62-1f1c708a9e9a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:32.232634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:32.233588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:32.237337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:32.238088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:32.245215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80489490-eef2-43c0-9f62-1f1c708a9e9a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:32.262145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80489490-eef2-43c0-9f62-1f1c708a9e9a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:32.262808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80489490-eef2-43c0-9f62-1f1c708a9e9a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:32.266068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80489490-eef2-43c0-9f62-1f1c708a9e9a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:32.266771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80489490-eef2-43c0-9f62-1f1c708a9e9a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:32.271971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80489490-eef2-43c0-9f62-1f1c708a9e9a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:32.291477 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] HTTP exception thrown: Instance c3c63541-628c-4ce4-9f01-692098a47a8a could not be found. Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Request method failure captured: Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a HTTP/1.1 Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPy6fR-f23NiKySWcGkRfOSL8oNw44bjIDd36MgRAlmsMLISWrlNZDrjQeICxb_FjSSmJAfEgxu81aYDrFt-IsIDaYbiG453RpY6rhCq7M8ULDSuC6L-MbhyCmkADePLbGaI1ewcasIQq0AhEQuwequfjnPoSNZLrhI5oRg1wajFZxQ Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e82a0bb2cc874614b0061f4c71ce082d Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1018573873 Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e82a0bb2cc874614b0061f4c71ce082d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e82a0bb2cc874614b0061f4c71ce082d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e82a0bb2cc874614b0061f4c71ce082d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e82a0bb2cc874614b0061f4c71ce082d"}]}] Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-VolumesSnapshotTestJSON-1018573873 Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e82a0bb2cc874614b0061f4c71ce082d Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1018573873 Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-VolumesSnapshotTestJSON-1018573873-project Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2c96909ab4eb449d81769b4c1a52ec88 Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-VolumesSnapshotTestJSON-1018573873-project Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance c3c63541-628c-4ce4-9f01-692098a47a8a could not be found. Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'c3c63541-628c-4ce4-9f01-692098a47a8a'} Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c63541-628c-4ce4-9f01-692098a47a8a could not be found. Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c63541-628c-4ce4-9f01-692098a47a8a could not be found. Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:15:32.293299 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:32.298262 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:15:32.298262 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:15:32.298262 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:15:32.298262 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:15:32.298262 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:15:32.298262 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c63541-628c-4ce4-9f01-692098a47a8a could not be found. Sep 10 21:15:32.298262 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:15:32.299851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Returning 404 to user: Instance c3c63541-628c-4ce4-9f01-692098a47a8a could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:15:32.300919 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae63deea-718b-4046-abd1-76c3ff997dc7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a" status: 404 len: 111 microversion: 2.1 time: 0.101496 Sep 10 21:15:32.306293 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2738/5578] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:32 2022] GET /compute/v2.1/servers/c3c63541-628c-4ce4-9f01-692098a47a8a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:15:32.621384 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.network.security_group_api [None req-80489490-eef2-43c0-9f62-1f1c708a9e9a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Removing security group e0da248f-6891-49bb-af86-b185caebca32 from port 4eee075f-3ed6-4e71-a2ea-73e196e4cb97 Sep 10 21:15:33.554166 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-80489490-eef2-43c0-9f62-1f1c708a9e9a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94/action" status: 202 len: 0 microversion: 2.1 time: 1.333823 Sep 10 21:15:33.554842 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2841/5579] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:15:32 2022] POST /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94/action => generated 0 bytes in 1335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:15:33.573514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-284e0b6f-0bcf-4ea5-89ba-453b2ce886eb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:33.575071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-284e0b6f-0bcf-4ea5-89ba-453b2ce886eb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:33.578688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ba462af1-2ccb-4081-b75b-d5f6c3243524 req-524c4f6f-83c4-43dd-9e6d-d7b5af9ec180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33229432-7e4c-40cb-8bbf-c5a11e562b94", "tag": "4eee075f-3ed6-4e71-a2ea-73e196e4cb97"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:33.591339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284e0b6f-0bcf-4ea5-89ba-453b2ce886eb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:33.592442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284e0b6f-0bcf-4ea5-89ba-453b2ce886eb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:33.595158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284e0b6f-0bcf-4ea5-89ba-453b2ce886eb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:33.596147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284e0b6f-0bcf-4ea5-89ba-453b2ce886eb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:33.596828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284e0b6f-0bcf-4ea5-89ba-453b2ce886eb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:33.599281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-284e0b6f-0bcf-4ea5-89ba-453b2ce886eb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:33.610016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ba462af1-2ccb-4081-b75b-d5f6c3243524 req-524c4f6f-83c4-43dd-9e6d-d7b5af9ec180 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:33.610734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ba462af1-2ccb-4081-b75b-d5f6c3243524 req-524c4f6f-83c4-43dd-9e6d-d7b5af9ec180 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:33.611287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ba462af1-2ccb-4081-b75b-d5f6c3243524 req-524c4f6f-83c4-43dd-9e6d-d7b5af9ec180 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:33.647568 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ba462af1-2ccb-4081-b75b-d5f6c3243524 req-524c4f6f-83c4-43dd-9e6d-d7b5af9ec180 service nova] Creating event network-changed:4eee075f-3ed6-4e71-a2ea-73e196e4cb97 for instance 33229432-7e4c-40cb-8bbf-c5a11e562b94 on nch2-master-1 Sep 10 21:15:33.670472 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ba462af1-2ccb-4081-b75b-d5f6c3243524 req-524c4f6f-83c4-43dd-9e6d-d7b5af9ec180 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097327 Sep 10 21:15:33.671932 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2842/5580] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:33.906404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-284e0b6f-0bcf-4ea5-89ba-453b2ce886eb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:33.914485 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-284e0b6f-0bcf-4ea5-89ba-453b2ce886eb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1460 microversion: 2.1 time: 0.354547 Sep 10 21:15:33.915082 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2739/5581] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:33 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1460 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:33.957024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4f14283a-ebf3-4e2c-9de6-0c5a3bdd3a9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:33.957742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4f14283a-ebf3-4e2c-9de6-0c5a3bdd3a9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:33.983632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f14283a-ebf3-4e2c-9de6-0c5a3bdd3a9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:33.984252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f14283a-ebf3-4e2c-9de6-0c5a3bdd3a9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:33.984719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f14283a-ebf3-4e2c-9de6-0c5a3bdd3a9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:33.985464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f14283a-ebf3-4e2c-9de6-0c5a3bdd3a9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:33.986507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f14283a-ebf3-4e2c-9de6-0c5a3bdd3a9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:33.986946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4f14283a-ebf3-4e2c-9de6-0c5a3bdd3a9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:34.209884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4f14283a-ebf3-4e2c-9de6-0c5a3bdd3a9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:34.218851 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4f14283a-ebf3-4e2c-9de6-0c5a3bdd3a9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.268572 Sep 10 21:15:34.242263 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2843/5582] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:33 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:34.244969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc0b79b0-401e-447c-b723-d9524349f834 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:34.245606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cc0b79b0-401e-447c-b723-d9524349f834 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:34.255031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc0b79b0-401e-447c-b723-d9524349f834 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:34.257546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc0b79b0-401e-447c-b723-d9524349f834 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:34.258220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc0b79b0-401e-447c-b723-d9524349f834 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:34.261601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc0b79b0-401e-447c-b723-d9524349f834 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:34.263991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc0b79b0-401e-447c-b723-d9524349f834 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:34.264829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc0b79b0-401e-447c-b723-d9524349f834 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:35.264395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cc0b79b0-401e-447c-b723-d9524349f834 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:35.277033 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cc0b79b0-401e-447c-b723-d9524349f834 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 1.036033 Sep 10 21:15:35.277448 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2740/5583] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:34 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:35.301610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-535c0c1f-3b13-49c6-9e6f-c840b20bef4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:35.306978 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-535c0c1f-3b13-49c6-9e6f-c840b20bef4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:35.320067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-535c0c1f-3b13-49c6-9e6f-c840b20bef4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:35.323770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-535c0c1f-3b13-49c6-9e6f-c840b20bef4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:35.324252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-535c0c1f-3b13-49c6-9e6f-c840b20bef4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:35.326919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-535c0c1f-3b13-49c6-9e6f-c840b20bef4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:35.328387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-535c0c1f-3b13-49c6-9e6f-c840b20bef4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:35.329220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-535c0c1f-3b13-49c6-9e6f-c840b20bef4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:35.366778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:35.581051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-535c0c1f-3b13-49c6-9e6f-c840b20bef4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:35.603136 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-535c0c1f-3b13-49c6-9e6f-c840b20bef4d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.305295 Sep 10 21:15:35.606911 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2844/5584] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:35 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:35.635257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5bb8b5c2-7be7-4251-8dc7-c22fe1b3d8e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:35.636382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5bb8b5c2-7be7-4251-8dc7-c22fe1b3d8e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:35.661425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bb8b5c2-7be7-4251-8dc7-c22fe1b3d8e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:35.662531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bb8b5c2-7be7-4251-8dc7-c22fe1b3d8e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:35.663193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bb8b5c2-7be7-4251-8dc7-c22fe1b3d8e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:35.664231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bb8b5c2-7be7-4251-8dc7-c22fe1b3d8e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:35.665038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bb8b5c2-7be7-4251-8dc7-c22fe1b3d8e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:35.667298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bb8b5c2-7be7-4251-8dc7-c22fe1b3d8e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:36.033372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5bb8b5c2-7be7-4251-8dc7-c22fe1b3d8e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:36.050377 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5bb8b5c2-7be7-4251-8dc7-c22fe1b3d8e3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.420429 Sep 10 21:15:36.053148 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2741/5585] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:35 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:36.277798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1631020007", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "22651555-9c52-45fb-b1cb-a14fc16f0427"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:36.387649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] validate_networks() for [('22651555-9c52-45fb-b1cb-a14fc16f0427', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:15:37.012220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4fa688ed-1c3b-4caa-82ba-fef6f0477401 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Action: 'create', calling method: .version_select at 0x7f993f7ac940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1251884827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOwbXCqeJLyaE5a+6wg6Ys0IleE2i12i7XM8j9hlZBK6Ze94/8IluRp1784pov/G3NT+CucHODFwXQAurMw921/IJ5kkMNDQojNoxjvZABWeO9x58k35zwiesqU5rw0eA=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:37.041531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-4fa688ed-1c3b-4caa-82ba-fef6f0477401 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:15:37.054140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-4fa688ed-1c3b-4caa-82ba-fef6f0477401 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for user 93648515d8fb42a7aaf61e245db0e07d and project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:15:37.093412 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4fa688ed-1c3b-4caa-82ba-fef6f0477401 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.086309 Sep 10 21:15:37.096136 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2742/5586] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:15:37 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:37.551752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:15:37.552228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:15:37.552637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:15:37.553045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:15:37.553569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:15:37.573275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:37.574165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:37.575386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:37.578766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:37.581463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:37.582161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:37.622170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for project 15a76a25754c42099c542fa13046f01b. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:15:37.630468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Getting quotas for user d83b6ceb599746b394e379d52683b70c and project 15a76a25754c42099c542fa13046f01b. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:15:37.650230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:15:37.653976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:15:37.780272 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-62cab07c-d716-41e6-8634-7f7f0da03bc6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505608 Sep 10 21:15:37.782679 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2845/5587] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:15:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:15:37.808367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b77cf4e0-fa9b-43d0-b8f6-6674e371864b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:37.811067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b77cf4e0-fa9b-43d0-b8f6-6674e371864b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:38.045716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b77cf4e0-fa9b-43d0-b8f6-6674e371864b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:38.060898 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b77cf4e0-fa9b-43d0-b8f6-6674e371864b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1215 microversion: 2.1 time: 0.263562 Sep 10 21:15:38.077863 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2743/5588] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:37 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:39.075781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-154850663", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "930c0dd0-f0ea-47cb-8600-714de7f78e35"}], "key_name": "tempest-TestNetworkBasicOps-1251884827", "security_groups": [{"name": "tempest-secgroup-smoke-61814002"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:39.093685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-182dd39c-e1be-403c-904b-8449a3f6f58b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:39.096210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-182dd39c-e1be-403c-904b-8449a3f6f58b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:39.115484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182dd39c-e1be-403c-904b-8449a3f6f58b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:39.117699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182dd39c-e1be-403c-904b-8449a3f6f58b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:39.118589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182dd39c-e1be-403c-904b-8449a3f6f58b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:39.121602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182dd39c-e1be-403c-904b-8449a3f6f58b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:39.122319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182dd39c-e1be-403c-904b-8449a3f6f58b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:39.125214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-182dd39c-e1be-403c-904b-8449a3f6f58b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:39.297399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] validate_networks() for [('930c0dd0-f0ea-47cb-8600-714de7f78e35', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:15:39.333078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-182dd39c-e1be-403c-904b-8449a3f6f58b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:39.342484 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-182dd39c-e1be-403c-904b-8449a3f6f58b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1267 microversion: 2.1 time: 0.253558 Sep 10 21:15:39.346076 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2744/5589] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:39 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:39.627202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dcec4f0d-08f1-41f2-9358-633e9d2aae78 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:39.627960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dcec4f0d-08f1-41f2-9358-633e9d2aae78 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:39.652295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcec4f0d-08f1-41f2-9358-633e9d2aae78 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:39.652862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcec4f0d-08f1-41f2-9358-633e9d2aae78 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:39.653333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcec4f0d-08f1-41f2-9358-633e9d2aae78 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:39.654136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcec4f0d-08f1-41f2-9358-633e9d2aae78 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:39.654587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcec4f0d-08f1-41f2-9358-633e9d2aae78 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:39.655029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dcec4f0d-08f1-41f2-9358-633e9d2aae78 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:39.771876 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dcec4f0d-08f1-41f2-9358-633e9d2aae78 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/ips" status: 200 len: 151 microversion: 2.20 time: 0.145888 Sep 10 21:15:39.792410 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2745/5590] 10.222.0.33 () {60 vars in 1289 bytes} [Sat Sep 10 21:15:39 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/ips => generated 151 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 21:15:40.005458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-102575031", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "7a8fdb28-6d9b-45ed-bd69-2ed1221658f3"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:40.194925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] validate_networks() for [('7a8fdb28-6d9b-45ed-bd69-2ed1221658f3', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:15:40.404203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:15:40.404757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:15:40.405291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:15:40.405715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:15:40.406154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:15:40.415367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:40.442617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:40.444973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:40.445427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:40.449845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:40.450327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:40.450764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:40.507779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:15:40.524868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for user 93648515d8fb42a7aaf61e245db0e07d and project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:15:40.560380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:15:40.568702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:15:40.690562 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9322da5c-8230-48f0-bf67-84154c427134 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.616411 Sep 10 21:15:40.702364 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2846/5591] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:15:39 2022] POST /compute/v2.1/servers => generated 404 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:15:40.714586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-954f9b28-6779-49e6-9864-8cd00e8db191 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:40.715764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-954f9b28-6779-49e6-9864-8cd00e8db191 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:40.748992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-954f9b28-6779-49e6-9864-8cd00e8db191 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:40.750049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-954f9b28-6779-49e6-9864-8cd00e8db191 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:40.751862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-954f9b28-6779-49e6-9864-8cd00e8db191 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:40.764499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-954f9b28-6779-49e6-9864-8cd00e8db191 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:40.766419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-954f9b28-6779-49e6-9864-8cd00e8db191 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:40.768480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-954f9b28-6779-49e6-9864-8cd00e8db191 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:40.862842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-954f9b28-6779-49e6-9864-8cd00e8db191 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:40.874039 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-954f9b28-6779-49e6-9864-8cd00e8db191 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1273 microversion: 2.1 time: 0.165811 Sep 10 21:15:40.874669 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2847/5592] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:40 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:40.881113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-630089ed-7984-4df6-8e01-8a35f1b5e09b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:40.882295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-630089ed-7984-4df6-8e01-8a35f1b5e09b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:40.984698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-630089ed-7984-4df6-8e01-8a35f1b5e09b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:41.006941 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-630089ed-7984-4df6-8e01-8a35f1b5e09b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1248 microversion: 2.1 time: 0.128862 Sep 10 21:15:41.008266 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2848/5593] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:40 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1248 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:41.848155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f723fcf-9b1c-496b-83cf-7d0bc79f17ae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:41.848851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5f723fcf-9b1c-496b-83cf-7d0bc79f17ae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:41.862994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f723fcf-9b1c-496b-83cf-7d0bc79f17ae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:41.866008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f723fcf-9b1c-496b-83cf-7d0bc79f17ae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:41.870801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f723fcf-9b1c-496b-83cf-7d0bc79f17ae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:41.871903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f723fcf-9b1c-496b-83cf-7d0bc79f17ae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:41.872604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f723fcf-9b1c-496b-83cf-7d0bc79f17ae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:41.873461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f723fcf-9b1c-496b-83cf-7d0bc79f17ae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:41.915343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-5f723fcf-9b1c-496b-83cf-7d0bc79f17ae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lazy-loading 'flavor' on Instance uuid b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:15:42.239526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:15:42.240705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:15:42.241418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:15:42.242723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:15:42.243381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:15:42.264977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:42.268181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:42.268754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:42.269707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:42.270883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:42.271539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:42.281803 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f723fcf-9b1c-496b-83cf-7d0bc79f17ae tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "POST /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/action" status: 202 len: 0 microversion: 2.20 time: 0.441720 Sep 10 21:15:42.288012 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2849/5594] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 21:15:41 2022] POST /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:15:42.302944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3c3eab48-ff62-4af4-a4d4-3bfe67ff099f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:42.304024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3c3eab48-ff62-4af4-a4d4-3bfe67ff099f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:42.316139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Getting quotas for project e82a0bb2cc874614b0061f4c71ce082d. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:15:42.319014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c3eab48-ff62-4af4-a4d4-3bfe67ff099f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:42.319602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c3eab48-ff62-4af4-a4d4-3bfe67ff099f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:42.320455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c3eab48-ff62-4af4-a4d4-3bfe67ff099f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:42.321313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c3eab48-ff62-4af4-a4d4-3bfe67ff099f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:42.322455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c3eab48-ff62-4af4-a4d4-3bfe67ff099f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:42.322948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3c3eab48-ff62-4af4-a4d4-3bfe67ff099f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:42.330961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Getting quotas for user 2c96909ab4eb449d81769b4c1a52ec88 and project e82a0bb2cc874614b0061f4c71ce082d. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:15:42.361757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:15:42.364337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:15:42.433789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3c3eab48-ff62-4af4-a4d4-3bfe67ff099f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:42.447809 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3c3eab48-ff62-4af4-a4d4-3bfe67ff099f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1273 microversion: 2.1 time: 0.157957 Sep 10 21:15:42.448778 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2850/5595] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:42 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:42.454778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da4d3085-4258-4ace-87bb-17012329d133 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:42.455518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-da4d3085-4258-4ace-87bb-17012329d133 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:42.463082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da4d3085-4258-4ace-87bb-17012329d133 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:42.464210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da4d3085-4258-4ace-87bb-17012329d133 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:42.464855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da4d3085-4258-4ace-87bb-17012329d133 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:42.465394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da4d3085-4258-4ace-87bb-17012329d133 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:42.466675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da4d3085-4258-4ace-87bb-17012329d133 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:42.467122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da4d3085-4258-4ace-87bb-17012329d133 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:42.482982 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a327e7b5-08e0-4b64-a7b2-976f914dc5f5 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.482853 Sep 10 21:15:42.487003 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2746/5596] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:15:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:15:42.499276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:42.501685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:42.516444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:42.516948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:42.517388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:42.518135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:42.519093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:42.519677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:42.614973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-da4d3085-4258-4ace-87bb-17012329d133 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:42.627649 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da4d3085-4258-4ace-87bb-17012329d133 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1308 microversion: 2.1 time: 0.177606 Sep 10 21:15:42.630821 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2851/5597] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:42 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:42.645265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b6c0d0f1-a647-467f-b1e0-8254ddf67ff0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:42.647178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b6c0d0f1-a647-467f-b1e0-8254ddf67ff0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:42.788666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b6c0d0f1-a647-467f-b1e0-8254ddf67ff0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:42.800988 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b6c0d0f1-a647-467f-b1e0-8254ddf67ff0 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1218 microversion: 2.1 time: 0.164943 Sep 10 21:15:42.801623 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2852/5598] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:42 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:43.439545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:43.456655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:43.458304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:43.462993 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b033c945-2018-421b-9bc8-a3a68529968b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.974000 Sep 10 21:15:43.463784 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2747/5599] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:42 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:43.485408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1bf510b9-6234-49ae-8484-5c65349a12f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:43.486574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1bf510b9-6234-49ae-8484-5c65349a12f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:43.494868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bf510b9-6234-49ae-8484-5c65349a12f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:43.495499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bf510b9-6234-49ae-8484-5c65349a12f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:43.495941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bf510b9-6234-49ae-8484-5c65349a12f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:43.496655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bf510b9-6234-49ae-8484-5c65349a12f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:43.497112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bf510b9-6234-49ae-8484-5c65349a12f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:43.497590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bf510b9-6234-49ae-8484-5c65349a12f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:43.658913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fb830f87-1bb4-4d0b-a87c-b5d1eec2864e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:43.659884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fb830f87-1bb4-4d0b-a87c-b5d1eec2864e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:43.671094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb830f87-1bb4-4d0b-a87c-b5d1eec2864e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:43.674587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb830f87-1bb4-4d0b-a87c-b5d1eec2864e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:43.675241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb830f87-1bb4-4d0b-a87c-b5d1eec2864e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:43.676256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb830f87-1bb4-4d0b-a87c-b5d1eec2864e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:43.677167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb830f87-1bb4-4d0b-a87c-b5d1eec2864e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:43.677768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fb830f87-1bb4-4d0b-a87c-b5d1eec2864e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:43.734293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1bf510b9-6234-49ae-8484-5c65349a12f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:43.745767 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1bf510b9-6234-49ae-8484-5c65349a12f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.262800 Sep 10 21:15:43.763765 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2853/5600] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:43 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:43.829784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-15b46ad8-d8c3-4ad4-95dc-ce7505212745 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:43.831024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-15b46ad8-d8c3-4ad4-95dc-ce7505212745 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:43.850665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15b46ad8-d8c3-4ad4-95dc-ce7505212745 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:43.851172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15b46ad8-d8c3-4ad4-95dc-ce7505212745 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:43.851611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15b46ad8-d8c3-4ad4-95dc-ce7505212745 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:43.852325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15b46ad8-d8c3-4ad4-95dc-ce7505212745 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:43.852786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15b46ad8-d8c3-4ad4-95dc-ce7505212745 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:43.854773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-15b46ad8-d8c3-4ad4-95dc-ce7505212745 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:43.894385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fb830f87-1bb4-4d0b-a87c-b5d1eec2864e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:43.916814 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fb830f87-1bb4-4d0b-a87c-b5d1eec2864e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1306 microversion: 2.1 time: 0.257503 Sep 10 21:15:43.920638 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2748/5601] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:43 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1306 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:43.979823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-15b46ad8-d8c3-4ad4-95dc-ce7505212745 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:43.991671 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-15b46ad8-d8c3-4ad4-95dc-ce7505212745 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1270 microversion: 2.1 time: 0.166798 Sep 10 21:15:43.992619 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2854/5602] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:43 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:44.493017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:44.494912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:44.502647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:44.503400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:44.503841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:44.504552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:44.505085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:44.505572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:44.772541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6a1209da-b514-4aba-b325-30aca1c3a91c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:44.773221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6a1209da-b514-4aba-b325-30aca1c3a91c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:44.780870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a1209da-b514-4aba-b325-30aca1c3a91c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:44.781620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a1209da-b514-4aba-b325-30aca1c3a91c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:44.782786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a1209da-b514-4aba-b325-30aca1c3a91c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:44.783581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a1209da-b514-4aba-b325-30aca1c3a91c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:44.784116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a1209da-b514-4aba-b325-30aca1c3a91c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:44.786172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6a1209da-b514-4aba-b325-30aca1c3a91c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:44.957209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6a1209da-b514-4aba-b325-30aca1c3a91c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:44.966849 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6a1209da-b514-4aba-b325-30aca1c3a91c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.199897 Sep 10 21:15:44.970207 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2855/5603] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:44 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:44.989869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a3ad608-6bc8-45bb-9955-929013811bbe tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:44.991100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a3ad608-6bc8-45bb-9955-929013811bbe tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:44.997924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a3ad608-6bc8-45bb-9955-929013811bbe tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:44.998426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a3ad608-6bc8-45bb-9955-929013811bbe tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:44.998863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a3ad608-6bc8-45bb-9955-929013811bbe tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:44.999571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a3ad608-6bc8-45bb-9955-929013811bbe tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:45.000027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a3ad608-6bc8-45bb-9955-929013811bbe tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:45.000450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a3ad608-6bc8-45bb-9955-929013811bbe tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:45.078255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7a3ad608-6bc8-45bb-9955-929013811bbe tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:45.089915 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a3ad608-6bc8-45bb-9955-929013811bbe tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1306 microversion: 2.1 time: 0.116903 Sep 10 21:15:45.090981 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2856/5604] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:44 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1306 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:45.096276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d11927b-6e55-49ed-8dc1-d5f537af0ebe tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:45.096980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8d11927b-6e55-49ed-8dc1-d5f537af0ebe tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:45.111857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d11927b-6e55-49ed-8dc1-d5f537af0ebe tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:45.112504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d11927b-6e55-49ed-8dc1-d5f537af0ebe tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:45.113014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d11927b-6e55-49ed-8dc1-d5f537af0ebe tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:45.113926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d11927b-6e55-49ed-8dc1-d5f537af0ebe tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:45.114516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d11927b-6e55-49ed-8dc1-d5f537af0ebe tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:45.115020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d11927b-6e55-49ed-8dc1-d5f537af0ebe tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:45.194073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8d11927b-6e55-49ed-8dc1-d5f537af0ebe tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:45.204589 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8d11927b-6e55-49ed-8dc1-d5f537af0ebe tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1276 microversion: 2.1 time: 0.112341 Sep 10 21:15:45.205394 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2857/5605] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:45 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:45.449694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:45.460797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:45.462441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:45.464227 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a792d64a-35d1-439f-9974-1a0577aa0c9a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.975101 Sep 10 21:15:45.465432 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2749/5606] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:44 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:46.003742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3d3b9813-d01a-4a36-a859-d438c1508c3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:46.006214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3d3b9813-d01a-4a36-a859-d438c1508c3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:46.034920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3b9813-d01a-4a36-a859-d438c1508c3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:46.041189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3b9813-d01a-4a36-a859-d438c1508c3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:46.041696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3b9813-d01a-4a36-a859-d438c1508c3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:46.045469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3b9813-d01a-4a36-a859-d438c1508c3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:46.046297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3b9813-d01a-4a36-a859-d438c1508c3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:46.046751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3d3b9813-d01a-4a36-a859-d438c1508c3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:46.277038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-755422197", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:46.294651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3d3b9813-d01a-4a36-a859-d438c1508c3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:46.304505 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3d3b9813-d01a-4a36-a859-d438c1508c3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.311753 Sep 10 21:15:46.308423 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2858/5607] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:45 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:46.324572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-016042c1-b32c-4bfd-bc15-d4be59d1621a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:46.331078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-016042c1-b32c-4bfd-bc15-d4be59d1621a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:46.346668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-016042c1-b32c-4bfd-bc15-d4be59d1621a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:46.347530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-016042c1-b32c-4bfd-bc15-d4be59d1621a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:46.348187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-016042c1-b32c-4bfd-bc15-d4be59d1621a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:46.352484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-016042c1-b32c-4bfd-bc15-d4be59d1621a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:46.359487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-016042c1-b32c-4bfd-bc15-d4be59d1621a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:46.362477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-016042c1-b32c-4bfd-bc15-d4be59d1621a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:46.374073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] validate_networks() for [('49e92ac3-121f-424b-833e-e4483ee1e637', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:15:46.569674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-016042c1-b32c-4bfd-bc15-d4be59d1621a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:46.601594 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-016042c1-b32c-4bfd-bc15-d4be59d1621a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.291393 Sep 10 21:15:46.608287 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2859/5608] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:46 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:46.618362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4d7e7270-c136-4544-a2c6-e1abc050ab00 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:46.620891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4d7e7270-c136-4544-a2c6-e1abc050ab00 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:46.635224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d7e7270-c136-4544-a2c6-e1abc050ab00 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:46.635761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d7e7270-c136-4544-a2c6-e1abc050ab00 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:46.636640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d7e7270-c136-4544-a2c6-e1abc050ab00 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:46.637374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d7e7270-c136-4544-a2c6-e1abc050ab00 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:46.637927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d7e7270-c136-4544-a2c6-e1abc050ab00 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:46.638369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d7e7270-c136-4544-a2c6-e1abc050ab00 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:46.768711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4d7e7270-c136-4544-a2c6-e1abc050ab00 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:46.783205 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4d7e7270-c136-4544-a2c6-e1abc050ab00 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1276 microversion: 2.1 time: 0.173193 Sep 10 21:15:46.804046 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2860/5609] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:46 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:46.815369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:46.817591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:46.829283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:46.830140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:46.830838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:46.831797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:46.832519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:46.833324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:47.032983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:47.044394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:47.046722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:47.048444 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1eb3358e-67c3-4b68-a7fd-d50b7a5051a7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.242881 Sep 10 21:15:47.049700 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2861/5610] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:46 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:47.054472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f502f92b-ec89-4ca0-8d61-56195a897f2f req-e9590b3e-32de-4b45-8a66-9656f811d34e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab021c5-f772-432f-8147-3b7f70eeae59", "tag": "b471905b-b736-4e3b-9546-4c0558cb7edf"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:47.067924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f502f92b-ec89-4ca0-8d61-56195a897f2f req-e9590b3e-32de-4b45-8a66-9656f811d34e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:47.068782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f502f92b-ec89-4ca0-8d61-56195a897f2f req-e9590b3e-32de-4b45-8a66-9656f811d34e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:47.070073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f502f92b-ec89-4ca0-8d61-56195a897f2f req-e9590b3e-32de-4b45-8a66-9656f811d34e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:47.086464 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f502f92b-ec89-4ca0-8d61-56195a897f2f req-e9590b3e-32de-4b45-8a66-9656f811d34e service nova] Creating event network-changed:b471905b-b736-4e3b-9546-4c0558cb7edf for instance 9ab021c5-f772-432f-8147-3b7f70eeae59 on nch1-master-1 Sep 10 21:15:47.093539 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f502f92b-ec89-4ca0-8d61-56195a897f2f req-e9590b3e-32de-4b45-8a66-9656f811d34e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042382 Sep 10 21:15:47.095221 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2862/5611] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:47.335720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-56e922f8-9132-4dc9-a908-857736c4a247 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:47.336688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-56e922f8-9132-4dc9-a908-857736c4a247 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:47.347783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e922f8-9132-4dc9-a908-857736c4a247 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:47.348370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e922f8-9132-4dc9-a908-857736c4a247 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:47.349048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e922f8-9132-4dc9-a908-857736c4a247 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:47.349894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e922f8-9132-4dc9-a908-857736c4a247 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:47.350473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e922f8-9132-4dc9-a908-857736c4a247 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:47.351241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-56e922f8-9132-4dc9-a908-857736c4a247 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:47.359510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:47.564515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-56e922f8-9132-4dc9-a908-857736c4a247 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:47.577965 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-56e922f8-9132-4dc9-a908-857736c4a247 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.248266 Sep 10 21:15:47.596323 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2863/5612] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:47 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:47.630518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f45ee298-7671-4403-93b5-857fe62226ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:47.631645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f45ee298-7671-4403-93b5-857fe62226ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:47.652470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f45ee298-7671-4403-93b5-857fe62226ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:47.654740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f45ee298-7671-4403-93b5-857fe62226ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:47.655384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f45ee298-7671-4403-93b5-857fe62226ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:47.656389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f45ee298-7671-4403-93b5-857fe62226ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:47.656965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f45ee298-7671-4403-93b5-857fe62226ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:47.657676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f45ee298-7671-4403-93b5-857fe62226ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:47.791075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:15:47.792546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:15:47.793946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:15:47.794594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:15:47.795269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:15:47.810222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:47.816825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:47.818361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:47.827330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:47.829369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:47.830123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:47.859768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Getting quotas for project 3d9f98a3f93d409a94ee87eec97206c1. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:15:47.870587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Getting quotas for user eac0a8d66da042e096cab5c715f40a27 and project 3d9f98a3f93d409a94ee87eec97206c1. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:15:47.894570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:15:47.897368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:15:47.905133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f45ee298-7671-4403-93b5-857fe62226ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:47.913249 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f45ee298-7671-4403-93b5-857fe62226ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.286536 Sep 10 21:15:47.914084 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2864/5613] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:47 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:47.919964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ed66f64c-e561-4d82-af24-daf6b7df8667 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:47.920575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ed66f64c-e561-4d82-af24-daf6b7df8667 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:47.945364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed66f64c-e561-4d82-af24-daf6b7df8667 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:47.945894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed66f64c-e561-4d82-af24-daf6b7df8667 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:47.946344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed66f64c-e561-4d82-af24-daf6b7df8667 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:47.947892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed66f64c-e561-4d82-af24-daf6b7df8667 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:47.948368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed66f64c-e561-4d82-af24-daf6b7df8667 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:47.948804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ed66f64c-e561-4d82-af24-daf6b7df8667 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:47.959511 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0fcd2266-dfe5-4db3-b84c-2ae7a1ba5804 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.943697 Sep 10 21:15:47.968411 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2750/5614] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:15:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:15:47.979510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6023719d-0ef8-49d2-a822-3068426f1058 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:47.980398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6023719d-0ef8-49d2-a822-3068426f1058 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:48.160870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ed66f64c-e561-4d82-af24-daf6b7df8667 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:48.171810 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ed66f64c-e561-4d82-af24-daf6b7df8667 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1318 microversion: 2.1 time: 0.255294 Sep 10 21:15:48.172873 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2865/5615] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:47 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:48.182968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:48.183595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:48.190050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:48.190788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:48.191375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:48.192235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:48.193112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:48.193689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:48.380035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:48.391344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:48.393040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:48.394753 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c1097cd9-9a0d-4ea5-bf15-b4d1f4d15ba1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.220570 Sep 10 21:15:48.395475 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2866/5616] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:48 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:48.411127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6023719d-0ef8-49d2-a822-3068426f1058 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:48.424543 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6023719d-0ef8-49d2-a822-3068426f1058 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1213 microversion: 2.1 time: 0.454525 Sep 10 21:15:48.425730 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2751/5617] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:47 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1213 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:48.602708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7654ca72-3813-4489-b397-d2ab2d87d59d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:48.604076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7654ca72-3813-4489-b397-d2ab2d87d59d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:48.611817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7654ca72-3813-4489-b397-d2ab2d87d59d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:48.612638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7654ca72-3813-4489-b397-d2ab2d87d59d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:48.613280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7654ca72-3813-4489-b397-d2ab2d87d59d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:48.614563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7654ca72-3813-4489-b397-d2ab2d87d59d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:48.615222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7654ca72-3813-4489-b397-d2ab2d87d59d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:48.615923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7654ca72-3813-4489-b397-d2ab2d87d59d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:48.782102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7654ca72-3813-4489-b397-d2ab2d87d59d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:48.791240 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7654ca72-3813-4489-b397-d2ab2d87d59d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.191825 Sep 10 21:15:48.792563 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2867/5618] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:48 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:48.937688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-baf625fe-7c2a-490b-85c4-618869f83aaf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:48.939107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-baf625fe-7c2a-490b-85c4-618869f83aaf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:48.947634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf625fe-7c2a-490b-85c4-618869f83aaf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:48.948431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf625fe-7c2a-490b-85c4-618869f83aaf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:48.949007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf625fe-7c2a-490b-85c4-618869f83aaf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:48.949738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf625fe-7c2a-490b-85c4-618869f83aaf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:48.950227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf625fe-7c2a-490b-85c4-618869f83aaf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:48.950823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf625fe-7c2a-490b-85c4-618869f83aaf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:49.131964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a0e82376-74a0-4c42-8c41-96e07e0b51f4 req-6b7d89a2-f010-42c0-bec6-4fda7fb9a3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c119a968-8e9d-4f49-bdd9-1da99159cecc", "tag": "3584c8e9-718d-4a42-b791-17326796df18"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:49.147895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a0e82376-74a0-4c42-8c41-96e07e0b51f4 req-6b7d89a2-f010-42c0-bec6-4fda7fb9a3c2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:49.148384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a0e82376-74a0-4c42-8c41-96e07e0b51f4 req-6b7d89a2-f010-42c0-bec6-4fda7fb9a3c2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:49.148838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a0e82376-74a0-4c42-8c41-96e07e0b51f4 req-6b7d89a2-f010-42c0-bec6-4fda7fb9a3c2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:49.165213 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a0e82376-74a0-4c42-8c41-96e07e0b51f4 req-6b7d89a2-f010-42c0-bec6-4fda7fb9a3c2 service nova] Creating event network-changed:3584c8e9-718d-4a42-b791-17326796df18 for instance c119a968-8e9d-4f49-bdd9-1da99159cecc on nch1-master-1 Sep 10 21:15:49.172363 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a0e82376-74a0-4c42-8c41-96e07e0b51f4 req-6b7d89a2-f010-42c0-bec6-4fda7fb9a3c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045669 Sep 10 21:15:49.173345 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2868/5619] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:49.197931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40cd7d3b-9f22-4a17-adef-9f6e0ba60e8a tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:49.198827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-40cd7d3b-9f22-4a17-adef-9f6e0ba60e8a tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:49.209937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40cd7d3b-9f22-4a17-adef-9f6e0ba60e8a tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:49.210448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40cd7d3b-9f22-4a17-adef-9f6e0ba60e8a tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:49.210899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40cd7d3b-9f22-4a17-adef-9f6e0ba60e8a tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:49.211763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40cd7d3b-9f22-4a17-adef-9f6e0ba60e8a tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:49.212289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40cd7d3b-9f22-4a17-adef-9f6e0ba60e8a tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:49.212724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40cd7d3b-9f22-4a17-adef-9f6e0ba60e8a tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:49.215030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-baf625fe-7c2a-490b-85c4-618869f83aaf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:49.231194 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-baf625fe-7c2a-490b-85c4-618869f83aaf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.299305 Sep 10 21:15:49.243166 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2752/5620] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:48 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:49.366851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40cd7d3b-9f22-4a17-adef-9f6e0ba60e8a tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:49.377786 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40cd7d3b-9f22-4a17-adef-9f6e0ba60e8a tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1318 microversion: 2.1 time: 0.184569 Sep 10 21:15:49.379586 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2869/5621] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:49 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:49.424882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:49.425511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:49.431088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:49.433219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:49.433721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:49.434383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:49.434919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:49.435384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:49.436030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:49.451983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5d3d2db-ef66-46c8-b6d0-71a51e9b8533 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:49.453458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5d3d2db-ef66-46c8-b6d0-71a51e9b8533 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:49.461932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5d3d2db-ef66-46c8-b6d0-71a51e9b8533 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:49.464004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5d3d2db-ef66-46c8-b6d0-71a51e9b8533 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:49.465476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5d3d2db-ef66-46c8-b6d0-71a51e9b8533 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:49.466866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5d3d2db-ef66-46c8-b6d0-71a51e9b8533 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:49.467563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5d3d2db-ef66-46c8-b6d0-71a51e9b8533 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:49.468425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5d3d2db-ef66-46c8-b6d0-71a51e9b8533 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:49.554952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5d3d2db-ef66-46c8-b6d0-71a51e9b8533 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:49.566475 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5d3d2db-ef66-46c8-b6d0-71a51e9b8533 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1217 microversion: 2.1 time: 0.120980 Sep 10 21:15:49.567069 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2870/5622] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:49 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:49.815513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-562829e1-72a5-42f7-b63e-43f046c7e2b6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:49.816654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-562829e1-72a5-42f7-b63e-43f046c7e2b6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:49.828109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-562829e1-72a5-42f7-b63e-43f046c7e2b6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:49.830038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-562829e1-72a5-42f7-b63e-43f046c7e2b6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:49.831020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-562829e1-72a5-42f7-b63e-43f046c7e2b6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:49.833266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-562829e1-72a5-42f7-b63e-43f046c7e2b6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:49.834860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-562829e1-72a5-42f7-b63e-43f046c7e2b6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:49.835733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-562829e1-72a5-42f7-b63e-43f046c7e2b6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:50.001932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:50.021432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:50.023883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:50.027307 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-312442ed-2030-464e-a263-d9ca8c3aab3f tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.604877 Sep 10 21:15:50.034559 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2753/5623] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:49 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:50.111925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-562829e1-72a5-42f7-b63e-43f046c7e2b6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:50.121076 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-562829e1-72a5-42f7-b63e-43f046c7e2b6 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.310090 Sep 10 21:15:50.122014 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2871/5624] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:49 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:50.255354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cf36ee5e-f4e4-4f8c-a2d0-1aa3fc988d25 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:50.256262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cf36ee5e-f4e4-4f8c-a2d0-1aa3fc988d25 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:50.265252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf36ee5e-f4e4-4f8c-a2d0-1aa3fc988d25 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:50.265757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf36ee5e-f4e4-4f8c-a2d0-1aa3fc988d25 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:50.266256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf36ee5e-f4e4-4f8c-a2d0-1aa3fc988d25 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:50.267112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf36ee5e-f4e4-4f8c-a2d0-1aa3fc988d25 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:50.267577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf36ee5e-f4e4-4f8c-a2d0-1aa3fc988d25 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:50.268008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf36ee5e-f4e4-4f8c-a2d0-1aa3fc988d25 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:50.403570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-38ddf431-b7fe-4b51-8833-419d426dd0cd tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:50.406539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-38ddf431-b7fe-4b51-8833-419d426dd0cd tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:50.414077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ddf431-b7fe-4b51-8833-419d426dd0cd tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:50.414795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ddf431-b7fe-4b51-8833-419d426dd0cd tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:50.416202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ddf431-b7fe-4b51-8833-419d426dd0cd tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:50.419912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ddf431-b7fe-4b51-8833-419d426dd0cd tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:50.421231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ddf431-b7fe-4b51-8833-419d426dd0cd tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:50.421967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38ddf431-b7fe-4b51-8833-419d426dd0cd tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:50.425797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cf36ee5e-f4e4-4f8c-a2d0-1aa3fc988d25 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:50.435827 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cf36ee5e-f4e4-4f8c-a2d0-1aa3fc988d25 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.183974 Sep 10 21:15:50.436428 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2754/5625] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:50 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:50.481729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:50.599142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-38ddf431-b7fe-4b51-8833-419d426dd0cd tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:50.599912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5959ac7a-ef72-4e5a-8cb3-fc243f36d5f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:50.603731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5959ac7a-ef72-4e5a-8cb3-fc243f36d5f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:50.608647 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-38ddf431-b7fe-4b51-8833-419d426dd0cd tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1318 microversion: 2.1 time: 0.209988 Sep 10 21:15:50.615366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5959ac7a-ef72-4e5a-8cb3-fc243f36d5f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:50.616640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5959ac7a-ef72-4e5a-8cb3-fc243f36d5f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:50.618114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5959ac7a-ef72-4e5a-8cb3-fc243f36d5f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:50.619252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5959ac7a-ef72-4e5a-8cb3-fc243f36d5f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:50.619784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5959ac7a-ef72-4e5a-8cb3-fc243f36d5f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:50.620274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5959ac7a-ef72-4e5a-8cb3-fc243f36d5f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:50.624154 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2872/5626] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:50 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:50.806707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5959ac7a-ef72-4e5a-8cb3-fc243f36d5f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:50.819161 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5959ac7a-ef72-4e5a-8cb3-fc243f36d5f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1217 microversion: 2.1 time: 0.232302 Sep 10 21:15:50.835054 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2755/5627] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:50 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1217 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:51.058167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:51.058941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:51.065382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.065889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.066723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.067547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.068070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.068624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.145094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54b539af-1da5-4040-9a8b-e4861d1544f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:51.145962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-54b539af-1da5-4040-9a8b-e4861d1544f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:51.155274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54b539af-1da5-4040-9a8b-e4861d1544f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.155780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54b539af-1da5-4040-9a8b-e4861d1544f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.156250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54b539af-1da5-4040-9a8b-e4861d1544f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.156962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54b539af-1da5-4040-9a8b-e4861d1544f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.157424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54b539af-1da5-4040-9a8b-e4861d1544f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.157873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54b539af-1da5-4040-9a8b-e4861d1544f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.213395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:51.227145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:51.229895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:51.231584 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-22722069-ba21-4004-99a9-2c3158b427a4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.178383 Sep 10 21:15:51.232677 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2873/5628] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:51 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:51.238713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-894be203-aa40-4136-bdb8-52d502400f6c req-650aa393-24b8-4e03-a158-bcc2d9251373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bea937c-8d71-4a89-a3d2-73a337fe9e43", "tag": "0ae638fe-5b88-4b4d-93a8-13bc37bb0641"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:51.249477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-894be203-aa40-4136-bdb8-52d502400f6c req-650aa393-24b8-4e03-a158-bcc2d9251373 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.250092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-894be203-aa40-4136-bdb8-52d502400f6c req-650aa393-24b8-4e03-a158-bcc2d9251373 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.250592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-894be203-aa40-4136-bdb8-52d502400f6c req-650aa393-24b8-4e03-a158-bcc2d9251373 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.270148 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-894be203-aa40-4136-bdb8-52d502400f6c req-650aa393-24b8-4e03-a158-bcc2d9251373 service nova] Creating event network-changed:0ae638fe-5b88-4b4d-93a8-13bc37bb0641 for instance 6bea937c-8d71-4a89-a3d2-73a337fe9e43 on nch2-master-1 Sep 10 21:15:51.274918 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-894be203-aa40-4136-bdb8-52d502400f6c req-650aa393-24b8-4e03-a158-bcc2d9251373 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040811 Sep 10 21:15:51.276002 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2874/5629] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:51.461453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-77b59615-362b-492b-8e8f-b1ecc9ea8de5 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:51.463651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-77b59615-362b-492b-8e8f-b1ecc9ea8de5 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:51.475802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77b59615-362b-492b-8e8f-b1ecc9ea8de5 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.476725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77b59615-362b-492b-8e8f-b1ecc9ea8de5 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.478791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77b59615-362b-492b-8e8f-b1ecc9ea8de5 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.480547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77b59615-362b-492b-8e8f-b1ecc9ea8de5 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.481544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77b59615-362b-492b-8e8f-b1ecc9ea8de5 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.482209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77b59615-362b-492b-8e8f-b1ecc9ea8de5 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.604460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-54b539af-1da5-4040-9a8b-e4861d1544f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:51.614014 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-54b539af-1da5-4040-9a8b-e4861d1544f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.473330 Sep 10 21:15:51.616222 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2756/5630] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:51 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:51.636959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-098b6d76-80df-4e9b-bbe0-37c88f94634b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:51.637584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-098b6d76-80df-4e9b-bbe0-37c88f94634b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:51.649271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-098b6d76-80df-4e9b-bbe0-37c88f94634b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.650939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-098b6d76-80df-4e9b-bbe0-37c88f94634b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.652323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-098b6d76-80df-4e9b-bbe0-37c88f94634b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.654406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-098b6d76-80df-4e9b-bbe0-37c88f94634b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.655305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-098b6d76-80df-4e9b-bbe0-37c88f94634b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.656199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-098b6d76-80df-4e9b-bbe0-37c88f94634b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.863420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-77b59615-362b-492b-8e8f-b1ecc9ea8de5 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:51.875531 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-77b59615-362b-492b-8e8f-b1ecc9ea8de5 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.419446 Sep 10 21:15:51.876141 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2875/5631] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:51 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:51.884701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8052fae-712e-4c14-92d7-edf2dde4929a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:51.885532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8052fae-712e-4c14-92d7-edf2dde4929a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:51.893365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8052fae-712e-4c14-92d7-edf2dde4929a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.894499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8052fae-712e-4c14-92d7-edf2dde4929a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.898936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8052fae-712e-4c14-92d7-edf2dde4929a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.898936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8052fae-712e-4c14-92d7-edf2dde4929a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:51.898936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8052fae-712e-4c14-92d7-edf2dde4929a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:51.898936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8052fae-712e-4c14-92d7-edf2dde4929a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:51.999258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8052fae-712e-4c14-92d7-edf2dde4929a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:52.013320 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8052fae-712e-4c14-92d7-edf2dde4929a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1271 microversion: 2.1 time: 0.135564 Sep 10 21:15:52.013949 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2876/5632] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:51 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:52.256305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-098b6d76-80df-4e9b-bbe0-37c88f94634b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:52.261747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:52.262872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:52.270325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:52.270788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:52.271352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:52.271485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:52.272668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:52.273572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:52.274119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:52.290051 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-098b6d76-80df-4e9b-bbe0-37c88f94634b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1318 microversion: 2.1 time: 0.659303 Sep 10 21:15:52.309066 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2757/5633] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:51 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:52.528684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:52.542297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:52.545095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:52.547128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9d9bb6ce-02e2-4456-ad7c-8076ddf97706 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.292096 Sep 10 21:15:52.548388 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2877/5634] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:52 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:52.641673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e0cbfd13-1b06-4be5-89f3-a4c402c42339 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:52.642453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e0cbfd13-1b06-4be5-89f3-a4c402c42339 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:52.650053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cbfd13-1b06-4be5-89f3-a4c402c42339 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:52.650484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cbfd13-1b06-4be5-89f3-a4c402c42339 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:52.651242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cbfd13-1b06-4be5-89f3-a4c402c42339 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:52.652469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cbfd13-1b06-4be5-89f3-a4c402c42339 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:52.653134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cbfd13-1b06-4be5-89f3-a4c402c42339 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:52.653683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e0cbfd13-1b06-4be5-89f3-a4c402c42339 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:52.815900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e0cbfd13-1b06-4be5-89f3-a4c402c42339 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:52.826972 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e0cbfd13-1b06-4be5-89f3-a4c402c42339 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.189422 Sep 10 21:15:52.828538 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2758/5635] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:52 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:52.901002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85e34d60-8035-4a2f-a4b8-c79312ad5e58 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:52.901811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-85e34d60-8035-4a2f-a4b8-c79312ad5e58 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:52.903946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=16 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:52.910860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85e34d60-8035-4a2f-a4b8-c79312ad5e58 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:52.911349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85e34d60-8035-4a2f-a4b8-c79312ad5e58 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:52.911788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85e34d60-8035-4a2f-a4b8-c79312ad5e58 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:52.912499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85e34d60-8035-4a2f-a4b8-c79312ad5e58 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:52.912940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85e34d60-8035-4a2f-a4b8-c79312ad5e58 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:52.913530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85e34d60-8035-4a2f-a4b8-c79312ad5e58 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:53.038559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-203eab50-dd44-4d72-92f3-d7d09dd00f90 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:53.039344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-203eab50-dd44-4d72-92f3-d7d09dd00f90 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:53.045685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-203eab50-dd44-4d72-92f3-d7d09dd00f90 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:53.046212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-203eab50-dd44-4d72-92f3-d7d09dd00f90 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:53.046658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-203eab50-dd44-4d72-92f3-d7d09dd00f90 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:53.047581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-203eab50-dd44-4d72-92f3-d7d09dd00f90 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:53.048048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-203eab50-dd44-4d72-92f3-d7d09dd00f90 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:53.048478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-203eab50-dd44-4d72-92f3-d7d09dd00f90 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:53.081945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-85e34d60-8035-4a2f-a4b8-c79312ad5e58 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:53.091445 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-85e34d60-8035-4a2f-a4b8-c79312ad5e58 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.194713 Sep 10 21:15:53.092284 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2878/5636] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:52 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:53.217690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-203eab50-dd44-4d72-92f3-d7d09dd00f90 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:53.229193 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-203eab50-dd44-4d72-92f3-d7d09dd00f90 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1313 microversion: 2.1 time: 0.194449 Sep 10 21:15:53.229948 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2759/5637] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:53 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:53.318701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1001b460-9258-4ca0-8e8e-21072d61b182 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:53.319340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1001b460-9258-4ca0-8e8e-21072d61b182 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:53.326794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1001b460-9258-4ca0-8e8e-21072d61b182 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:53.327281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1001b460-9258-4ca0-8e8e-21072d61b182 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:53.327721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1001b460-9258-4ca0-8e8e-21072d61b182 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:53.328469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1001b460-9258-4ca0-8e8e-21072d61b182 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:53.329224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1001b460-9258-4ca0-8e8e-21072d61b182 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:53.329805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1001b460-9258-4ca0-8e8e-21072d61b182 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:53.488855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1001b460-9258-4ca0-8e8e-21072d61b182 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:53.497681 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1001b460-9258-4ca0-8e8e-21072d61b182 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1318 microversion: 2.1 time: 0.183178 Sep 10 21:15:53.498297 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2879/5638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:53 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:53.574660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:53.575378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:53.582225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:53.582721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:53.583160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:53.583858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:53.584310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:53.584955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:53.739216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:53.750267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:53.752441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:53.754628 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-416f8398-477f-42d4-a029-6986b303484a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.184412 Sep 10 21:15:53.755270 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2760/5639] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:53 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:53.852420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-039855cb-eba5-423b-8ae3-98f9d890c165 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:53.853929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-039855cb-eba5-423b-8ae3-98f9d890c165 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:53.860206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-039855cb-eba5-423b-8ae3-98f9d890c165 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:53.860802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-039855cb-eba5-423b-8ae3-98f9d890c165 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:53.861259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-039855cb-eba5-423b-8ae3-98f9d890c165 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:53.862103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-039855cb-eba5-423b-8ae3-98f9d890c165 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:53.862576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-039855cb-eba5-423b-8ae3-98f9d890c165 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:53.862999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-039855cb-eba5-423b-8ae3-98f9d890c165 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:54.002002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-039855cb-eba5-423b-8ae3-98f9d890c165 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:54.010340 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-039855cb-eba5-423b-8ae3-98f9d890c165 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.161363 Sep 10 21:15:54.011112 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2880/5640] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:53 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:54.115863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1933c826-fe96-409a-8562-778eb17df92d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:54.116484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1933c826-fe96-409a-8562-778eb17df92d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:54.125661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1933c826-fe96-409a-8562-778eb17df92d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:54.126354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1933c826-fe96-409a-8562-778eb17df92d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:54.126800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1933c826-fe96-409a-8562-778eb17df92d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:54.127676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1933c826-fe96-409a-8562-778eb17df92d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:54.128139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1933c826-fe96-409a-8562-778eb17df92d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:54.128570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1933c826-fe96-409a-8562-778eb17df92d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:54.253802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7555d4a3-f8c5-4d86-a079-2ab66c64412d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:54.254444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7555d4a3-f8c5-4d86-a079-2ab66c64412d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:54.263370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7555d4a3-f8c5-4d86-a079-2ab66c64412d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:54.264233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7555d4a3-f8c5-4d86-a079-2ab66c64412d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:54.264959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7555d4a3-f8c5-4d86-a079-2ab66c64412d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:54.268875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1933c826-fe96-409a-8562-778eb17df92d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:54.272537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7555d4a3-f8c5-4d86-a079-2ab66c64412d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:54.273717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7555d4a3-f8c5-4d86-a079-2ab66c64412d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:54.274191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7555d4a3-f8c5-4d86-a079-2ab66c64412d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:54.279302 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1933c826-fe96-409a-8562-778eb17df92d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.167135 Sep 10 21:15:54.279751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:54.280151 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2761/5641] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:54 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:54.408302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7555d4a3-f8c5-4d86-a079-2ab66c64412d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:54.416859 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7555d4a3-f8c5-4d86-a079-2ab66c64412d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1313 microversion: 2.1 time: 0.167573 Sep 10 21:15:54.417448 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2881/5642] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:54 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:54.522693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c029ecc0-63a0-4e74-a0ec-6b1978c7af78 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:54.523355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c029ecc0-63a0-4e74-a0ec-6b1978c7af78 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:54.530615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c029ecc0-63a0-4e74-a0ec-6b1978c7af78 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:54.531327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c029ecc0-63a0-4e74-a0ec-6b1978c7af78 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:54.532112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c029ecc0-63a0-4e74-a0ec-6b1978c7af78 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:54.537863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c029ecc0-63a0-4e74-a0ec-6b1978c7af78 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:54.538587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c029ecc0-63a0-4e74-a0ec-6b1978c7af78 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:54.539464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c029ecc0-63a0-4e74-a0ec-6b1978c7af78 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:54.711280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c029ecc0-63a0-4e74-a0ec-6b1978c7af78 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:54.732630 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c029ecc0-63a0-4e74-a0ec-6b1978c7af78 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1318 microversion: 2.1 time: 0.214428 Sep 10 21:15:54.733508 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2762/5643] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:54 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:54.781881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:54.782943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:54.792553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:54.793447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:54.794252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:54.795119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:54.795768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:54.796385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:54.979528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b32d8c21-e454-4fa5-89f0-3a5e2170d679 req-0309c3a3-ff25-4004-9217-5f79ba4ab454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab021c5-f772-432f-8147-3b7f70eeae59", "name": "network-vif-plugged", "status": "completed", "tag": "b471905b-b736-4e3b-9546-4c0558cb7edf"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:54.992724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b32d8c21-e454-4fa5-89f0-3a5e2170d679 req-0309c3a3-ff25-4004-9217-5f79ba4ab454 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:54.993505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b32d8c21-e454-4fa5-89f0-3a5e2170d679 req-0309c3a3-ff25-4004-9217-5f79ba4ab454 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:54.994029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b32d8c21-e454-4fa5-89f0-3a5e2170d679 req-0309c3a3-ff25-4004-9217-5f79ba4ab454 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:55.007838 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b32d8c21-e454-4fa5-89f0-3a5e2170d679 req-0309c3a3-ff25-4004-9217-5f79ba4ab454 service nova] Creating event network-vif-plugged:b471905b-b736-4e3b-9546-4c0558cb7edf for instance 9ab021c5-f772-432f-8147-3b7f70eeae59 on nch1-master-1 Sep 10 21:15:55.014422 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b32d8c21-e454-4fa5-89f0-3a5e2170d679 req-0309c3a3-ff25-4004-9217-5f79ba4ab454 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038652 Sep 10 21:15:55.015648 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2763/5644] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:15:55.037026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3bcece7-2e85-45ba-93a8-37853729b3f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:55.038970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b3bcece7-2e85-45ba-93a8-37853729b3f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:55.048031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3bcece7-2e85-45ba-93a8-37853729b3f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:55.048911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3bcece7-2e85-45ba-93a8-37853729b3f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:55.049601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3bcece7-2e85-45ba-93a8-37853729b3f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:55.050637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3bcece7-2e85-45ba-93a8-37853729b3f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:55.051378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3bcece7-2e85-45ba-93a8-37853729b3f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:55.052051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3bcece7-2e85-45ba-93a8-37853729b3f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:55.285741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b3bcece7-2e85-45ba-93a8-37853729b3f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:55.304078 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b3bcece7-2e85-45ba-93a8-37853729b3f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.265616 Sep 10 21:15:55.304963 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2764/5645] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:55 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:55.319424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dea26fe3-a02e-4d3c-9853-a5ccd19f47f1 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:55.320464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:55.320970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dea26fe3-a02e-4d3c-9853-a5ccd19f47f1 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:55.335748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dea26fe3-a02e-4d3c-9853-a5ccd19f47f1 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:55.336449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dea26fe3-a02e-4d3c-9853-a5ccd19f47f1 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:55.337004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dea26fe3-a02e-4d3c-9853-a5ccd19f47f1 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:55.339148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dea26fe3-a02e-4d3c-9853-a5ccd19f47f1 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:55.340978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dea26fe3-a02e-4d3c-9853-a5ccd19f47f1 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:55.342168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dea26fe3-a02e-4d3c-9853-a5ccd19f47f1 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:55.343755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:55.347527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:55.352260 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-407e6b47-5474-44c5-8132-d427a660b0bf tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.572644 Sep 10 21:15:55.355411 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2882/5646] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:54 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:55.441753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5a034a8b-3be0-45b9-b224-6afc9e3c050e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:55.442814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a034a8b-3be0-45b9-b224-6afc9e3c050e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:55.450193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a034a8b-3be0-45b9-b224-6afc9e3c050e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:55.451147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a034a8b-3be0-45b9-b224-6afc9e3c050e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:55.451783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a034a8b-3be0-45b9-b224-6afc9e3c050e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:55.452897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a034a8b-3be0-45b9-b224-6afc9e3c050e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:55.453644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a034a8b-3be0-45b9-b224-6afc9e3c050e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:55.454322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a034a8b-3be0-45b9-b224-6afc9e3c050e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:55.547770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dea26fe3-a02e-4d3c-9853-a5ccd19f47f1 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:55.558545 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dea26fe3-a02e-4d3c-9853-a5ccd19f47f1 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.251855 Sep 10 21:15:55.559147 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2765/5647] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:55 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:55.687714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5a034a8b-3be0-45b9-b224-6afc9e3c050e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:55.697244 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5a034a8b-3be0-45b9-b224-6afc9e3c050e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1313 microversion: 2.1 time: 0.260914 Sep 10 21:15:55.698192 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2883/5648] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:55 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:55.757089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-349cc8d3-c225-47f3-be82-9b3e470d470f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:55.757714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-349cc8d3-c225-47f3-be82-9b3e470d470f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:55.765736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-349cc8d3-c225-47f3-be82-9b3e470d470f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:55.766253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-349cc8d3-c225-47f3-be82-9b3e470d470f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:55.767001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-349cc8d3-c225-47f3-be82-9b3e470d470f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:55.767799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-349cc8d3-c225-47f3-be82-9b3e470d470f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:55.768427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-349cc8d3-c225-47f3-be82-9b3e470d470f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:55.768969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-349cc8d3-c225-47f3-be82-9b3e470d470f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:55.788795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7a3f7218-5c97-40d5-9ea5-56556da5a7f2 req-23d91e83-6d64-4748-9543-b25d7069a48d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5eb0bd1-784c-46dc-93eb-ac3ee145635d", "tag": "8763e159-351b-434e-b3ac-c39d9396d62d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:55.801581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a3f7218-5c97-40d5-9ea5-56556da5a7f2 req-23d91e83-6d64-4748-9543-b25d7069a48d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:55.802192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a3f7218-5c97-40d5-9ea5-56556da5a7f2 req-23d91e83-6d64-4748-9543-b25d7069a48d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:55.802715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a3f7218-5c97-40d5-9ea5-56556da5a7f2 req-23d91e83-6d64-4748-9543-b25d7069a48d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:55.815684 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7a3f7218-5c97-40d5-9ea5-56556da5a7f2 req-23d91e83-6d64-4748-9543-b25d7069a48d service nova] Creating event network-changed:8763e159-351b-434e-b3ac-c39d9396d62d for instance b5eb0bd1-784c-46dc-93eb-ac3ee145635d on nch1-master-1 Sep 10 21:15:55.820425 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7a3f7218-5c97-40d5-9ea5-56556da5a7f2 req-23d91e83-6d64-4748-9543-b25d7069a48d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035558 Sep 10 21:15:55.821537 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2884/5649] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:15:55.934533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-349cc8d3-c225-47f3-be82-9b3e470d470f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:55.942901 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-349cc8d3-c225-47f3-be82-9b3e470d470f tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1318 microversion: 2.1 time: 0.189715 Sep 10 21:15:55.943562 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2766/5650] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:55 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:56.329367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-89d052f2-1213-4eac-9f8f-0baa737fd980 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:56.330178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-89d052f2-1213-4eac-9f8f-0baa737fd980 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:56.336579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d052f2-1213-4eac-9f8f-0baa737fd980 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:56.337627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d052f2-1213-4eac-9f8f-0baa737fd980 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:56.338248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d052f2-1213-4eac-9f8f-0baa737fd980 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:56.339158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d052f2-1213-4eac-9f8f-0baa737fd980 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:56.339624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d052f2-1213-4eac-9f8f-0baa737fd980 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:56.340279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89d052f2-1213-4eac-9f8f-0baa737fd980 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:56.381308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:56.381999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:56.391119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:56.391624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:56.392078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:56.392790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:56.393425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:56.394072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:56.534346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-89d052f2-1213-4eac-9f8f-0baa737fd980 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:56.543014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:56.545202 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-89d052f2-1213-4eac-9f8f-0baa737fd980 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1315 microversion: 2.1 time: 0.220005 Sep 10 21:15:56.546427 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2885/5651] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:56 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:56.552686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:56.555120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:56.556733 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7e07ffe4-ff24-43b0-bae9-a6f831010217 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.179305 Sep 10 21:15:56.557400 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2767/5652] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:56 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:15:56.583631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-edb6affa-8511-4645-9f23-6d0b45f1d800 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:56.584245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-edb6affa-8511-4645-9f23-6d0b45f1d800 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:56.591551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb6affa-8511-4645-9f23-6d0b45f1d800 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:56.592038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb6affa-8511-4645-9f23-6d0b45f1d800 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:56.592472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb6affa-8511-4645-9f23-6d0b45f1d800 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:56.593164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb6affa-8511-4645-9f23-6d0b45f1d800 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:56.593615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb6affa-8511-4645-9f23-6d0b45f1d800 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:56.594066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edb6affa-8511-4645-9f23-6d0b45f1d800 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:56.720344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8c24e70c-2406-495e-b354-79969d972183 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:56.721445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8c24e70c-2406-495e-b354-79969d972183 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:56.728758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c24e70c-2406-495e-b354-79969d972183 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:56.729628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c24e70c-2406-495e-b354-79969d972183 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:56.730576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c24e70c-2406-495e-b354-79969d972183 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:56.731430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c24e70c-2406-495e-b354-79969d972183 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:56.732118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c24e70c-2406-495e-b354-79969d972183 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:56.732655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c24e70c-2406-495e-b354-79969d972183 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:56.893075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-edb6affa-8511-4645-9f23-6d0b45f1d800 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:56.908684 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-edb6affa-8511-4645-9f23-6d0b45f1d800 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.328827 Sep 10 21:15:56.909848 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2886/5653] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:56 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:56.921724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8c24e70c-2406-495e-b354-79969d972183 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:56.936225 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8c24e70c-2406-495e-b354-79969d972183 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1313 microversion: 2.1 time: 0.220365 Sep 10 21:15:56.938491 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2768/5654] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:56 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:56.967330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a8cbf9e6-30cb-4253-a37c-13485006e0d2 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:56.967942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a8cbf9e6-30cb-4253-a37c-13485006e0d2 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:56.974572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8cbf9e6-30cb-4253-a37c-13485006e0d2 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:56.975031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8cbf9e6-30cb-4253-a37c-13485006e0d2 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:56.975654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8cbf9e6-30cb-4253-a37c-13485006e0d2 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:56.976398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8cbf9e6-30cb-4253-a37c-13485006e0d2 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:56.976862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8cbf9e6-30cb-4253-a37c-13485006e0d2 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:56.977296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8cbf9e6-30cb-4253-a37c-13485006e0d2 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.075002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0f8de1f0-ef56-40a0-bf95-4648ca8eb1f6 req-7cf88a75-93da-4915-8ee8-f06934e48b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bea937c-8d71-4a89-a3d2-73a337fe9e43", "name": "network-vif-plugged", "status": "completed", "tag": "0ae638fe-5b88-4b4d-93a8-13bc37bb0641"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:57.091900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0f8de1f0-ef56-40a0-bf95-4648ca8eb1f6 req-7cf88a75-93da-4915-8ee8-f06934e48b23 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.092400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0f8de1f0-ef56-40a0-bf95-4648ca8eb1f6 req-7cf88a75-93da-4915-8ee8-f06934e48b23 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.093054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0f8de1f0-ef56-40a0-bf95-4648ca8eb1f6 req-7cf88a75-93da-4915-8ee8-f06934e48b23 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.107942 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0f8de1f0-ef56-40a0-bf95-4648ca8eb1f6 req-7cf88a75-93da-4915-8ee8-f06934e48b23 service nova] Creating event network-vif-plugged:0ae638fe-5b88-4b4d-93a8-13bc37bb0641 for instance 6bea937c-8d71-4a89-a3d2-73a337fe9e43 on nch2-master-1 Sep 10 21:15:57.114297 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0f8de1f0-ef56-40a0-bf95-4648ca8eb1f6 req-7cf88a75-93da-4915-8ee8-f06934e48b23 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044040 Sep 10 21:15:57.115554 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2769/5655] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:15:57.264076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a8cbf9e6-30cb-4253-a37c-13485006e0d2 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:57.277171 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a8cbf9e6-30cb-4253-a37c-13485006e0d2 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1318 microversion: 2.1 time: 0.313855 Sep 10 21:15:57.277909 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2887/5656] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:56 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:57.573479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-338268f2-283f-4bbf-9bb8-5be994b58996 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:57.574487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-338268f2-283f-4bbf-9bb8-5be994b58996 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:57.582842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-338268f2-283f-4bbf-9bb8-5be994b58996 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.583343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-338268f2-283f-4bbf-9bb8-5be994b58996 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.583791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-338268f2-283f-4bbf-9bb8-5be994b58996 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.584507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-338268f2-283f-4bbf-9bb8-5be994b58996 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.584973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-338268f2-283f-4bbf-9bb8-5be994b58996 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.585596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-338268f2-283f-4bbf-9bb8-5be994b58996 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.585954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:57.587749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:57.594602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:57.600629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.601278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.602062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.603550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.608658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.609331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.769093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-338268f2-283f-4bbf-9bb8-5be994b58996 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:57.779933 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-338268f2-283f-4bbf-9bb8-5be994b58996 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1502 microversion: 2.1 time: 0.210641 Sep 10 21:15:57.794614 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2770/5657] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:57 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:57.803761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:57.810559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-753d5814-5ff5-41b9-959f-b7e2a26d9b69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:57.811999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-753d5814-5ff5-41b9-959f-b7e2a26d9b69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:57.814326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:57.815830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:57.817130 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c35294a-ae6b-49a9-9448-1cd12b5d9629 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.238061 Sep 10 21:15:57.820386 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2888/5658] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:57 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:57.828060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-753d5814-5ff5-41b9-959f-b7e2a26d9b69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.828639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-753d5814-5ff5-41b9-959f-b7e2a26d9b69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.829167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-753d5814-5ff5-41b9-959f-b7e2a26d9b69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.830215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-753d5814-5ff5-41b9-959f-b7e2a26d9b69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.830770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-753d5814-5ff5-41b9-959f-b7e2a26d9b69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.831369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-753d5814-5ff5-41b9-959f-b7e2a26d9b69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.847217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:57.910944 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-753d5814-5ff5-41b9-959f-b7e2a26d9b69 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59/action" status: 202 len: 0 microversion: 2.1 time: 0.105527 Sep 10 21:15:57.914706 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2771/5659] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:15:57 2022] POST /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:15:57.921138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b006b0b7-9598-45c2-a3ad-53734d3d16bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:57.922362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b006b0b7-9598-45c2-a3ad-53734d3d16bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:57.928903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b006b0b7-9598-45c2-a3ad-53734d3d16bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.929423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b006b0b7-9598-45c2-a3ad-53734d3d16bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.929878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b006b0b7-9598-45c2-a3ad-53734d3d16bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.930578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b006b0b7-9598-45c2-a3ad-53734d3d16bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.931696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b006b0b7-9598-45c2-a3ad-53734d3d16bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.932290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b006b0b7-9598-45c2-a3ad-53734d3d16bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.939379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-820dd8c4-4fdf-4b64-8de9-1fdb34f1233d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:57.940093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-820dd8c4-4fdf-4b64-8de9-1fdb34f1233d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:57.947364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-820dd8c4-4fdf-4b64-8de9-1fdb34f1233d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.947941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-820dd8c4-4fdf-4b64-8de9-1fdb34f1233d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.948315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-820dd8c4-4fdf-4b64-8de9-1fdb34f1233d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:57.949032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-820dd8c4-4fdf-4b64-8de9-1fdb34f1233d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:57.949498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-820dd8c4-4fdf-4b64-8de9-1fdb34f1233d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:57.949998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-820dd8c4-4fdf-4b64-8de9-1fdb34f1233d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:58.090745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b006b0b7-9598-45c2-a3ad-53734d3d16bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:58.099573 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b006b0b7-9598-45c2-a3ad-53734d3d16bb tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1507 microversion: 2.1 time: 0.182822 Sep 10 21:15:58.100727 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2889/5660] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:57 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:58.107782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-37a287fb-1d6a-4ec9-8e32-f4742c5604ad tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:58.107955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-820dd8c4-4fdf-4b64-8de9-1fdb34f1233d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:58.109265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-37a287fb-1d6a-4ec9-8e32-f4742c5604ad tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:58.115695 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-820dd8c4-4fdf-4b64-8de9-1fdb34f1233d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.181593 Sep 10 21:15:58.117302 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2772/5661] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:57 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:58.131312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a287fb-1d6a-4ec9-8e32-f4742c5604ad tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:58.131820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a287fb-1d6a-4ec9-8e32-f4742c5604ad tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:58.132269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a287fb-1d6a-4ec9-8e32-f4742c5604ad tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:58.132991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a287fb-1d6a-4ec9-8e32-f4742c5604ad tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:58.133463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a287fb-1d6a-4ec9-8e32-f4742c5604ad tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:58.135486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a287fb-1d6a-4ec9-8e32-f4742c5604ad tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:58.270615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-37a287fb-1d6a-4ec9-8e32-f4742c5604ad tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:58.279519 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-37a287fb-1d6a-4ec9-8e32-f4742c5604ad tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1313 microversion: 2.1 time: 0.177102 Sep 10 21:15:58.280036 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2890/5662] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:58 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:58.301873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da0dad39-f5e4-4c97-ba10-20fa9b8ad3f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:58.302515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da0dad39-f5e4-4c97-ba10-20fa9b8ad3f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:58.308646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da0dad39-f5e4-4c97-ba10-20fa9b8ad3f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:58.309197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da0dad39-f5e4-4c97-ba10-20fa9b8ad3f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:58.309564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da0dad39-f5e4-4c97-ba10-20fa9b8ad3f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:58.310280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da0dad39-f5e4-4c97-ba10-20fa9b8ad3f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:58.310753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da0dad39-f5e4-4c97-ba10-20fa9b8ad3f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:58.311151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da0dad39-f5e4-4c97-ba10-20fa9b8ad3f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:58.416457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=20 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:58.450226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da0dad39-f5e4-4c97-ba10-20fa9b8ad3f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:58.458674 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da0dad39-f5e4-4c97-ba10-20fa9b8ad3f7 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1318 microversion: 2.1 time: 0.160748 Sep 10 21:15:58.459243 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2773/5663] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:58 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:58.843779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:58.844489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:58.852615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:58.853107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:58.853538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:58.854268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:58.854718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:58.855601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.005216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:59.013965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:59.015423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:59.016764 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b4d42ea2-3a81-47d0-a140-7b9b2950dffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1744 microversion: 2.20 time: 0.177458 Sep 10 21:15:59.021878 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2891/5664] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:15:58 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:15:59.125267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a7191666-10d6-41e2-bf0d-b903c88e97d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:59.126301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a7191666-10d6-41e2-bf0d-b903c88e97d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:59.132016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6fa6f6b8-5319-4966-9923-e1478b20b243 req-c62b516a-1d76-4369-9aba-ae313922732e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c119a968-8e9d-4f49-bdd9-1da99159cecc", "name": "network-vif-plugged", "status": "completed", "tag": "3584c8e9-718d-4a42-b791-17326796df18"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:59.137579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7191666-10d6-41e2-bf0d-b903c88e97d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.138327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7191666-10d6-41e2-bf0d-b903c88e97d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.139156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7191666-10d6-41e2-bf0d-b903c88e97d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.139997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7191666-10d6-41e2-bf0d-b903c88e97d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.140526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7191666-10d6-41e2-bf0d-b903c88e97d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.141249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7191666-10d6-41e2-bf0d-b903c88e97d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.143536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6fa6f6b8-5319-4966-9923-e1478b20b243 req-c62b516a-1d76-4369-9aba-ae313922732e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.144214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6fa6f6b8-5319-4966-9923-e1478b20b243 req-c62b516a-1d76-4369-9aba-ae313922732e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.144656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6fa6f6b8-5319-4966-9923-e1478b20b243 req-c62b516a-1d76-4369-9aba-ae313922732e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.156379 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6fa6f6b8-5319-4966-9923-e1478b20b243 req-c62b516a-1d76-4369-9aba-ae313922732e service nova] Creating event network-vif-plugged:3584c8e9-718d-4a42-b791-17326796df18 for instance c119a968-8e9d-4f49-bdd9-1da99159cecc on nch1-master-1 Sep 10 21:15:59.163090 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6fa6f6b8-5319-4966-9923-e1478b20b243 req-c62b516a-1d76-4369-9aba-ae313922732e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034621 Sep 10 21:15:59.164257 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2892/5665] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:15:59.171197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5063026e-70d8-4ea5-a45f-f2129d490ff3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:59.172795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5063026e-70d8-4ea5-a45f-f2129d490ff3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:59.179926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5063026e-70d8-4ea5-a45f-f2129d490ff3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.180418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5063026e-70d8-4ea5-a45f-f2129d490ff3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.181811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5063026e-70d8-4ea5-a45f-f2129d490ff3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.183030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5063026e-70d8-4ea5-a45f-f2129d490ff3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.183655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5063026e-70d8-4ea5-a45f-f2129d490ff3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.184544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5063026e-70d8-4ea5-a45f-f2129d490ff3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.326845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a7191666-10d6-41e2-bf0d-b903c88e97d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:59.334882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:15:59.340677 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a7191666-10d6-41e2-bf0d-b903c88e97d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1507 microversion: 2.1 time: 0.219430 Sep 10 21:15:59.341539 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2774/5666] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:59 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:59.348347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dd886271-a09c-4231-9d69-8d9e970260dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:59.349292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dd886271-a09c-4231-9d69-8d9e970260dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:59.357451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd886271-a09c-4231-9d69-8d9e970260dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.358350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd886271-a09c-4231-9d69-8d9e970260dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.359637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5063026e-70d8-4ea5-a45f-f2129d490ff3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:59.360302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd886271-a09c-4231-9d69-8d9e970260dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.361555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd886271-a09c-4231-9d69-8d9e970260dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.362352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd886271-a09c-4231-9d69-8d9e970260dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.363005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd886271-a09c-4231-9d69-8d9e970260dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.368726 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5063026e-70d8-4ea5-a45f-f2129d490ff3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.202446 Sep 10 21:15:59.369916 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2893/5667] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:59 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:59.484261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bab3887d-e780-4564-84a0-7cfe96da875b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:15:59.485012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bab3887d-e780-4564-84a0-7cfe96da875b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:59.491748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bab3887d-e780-4564-84a0-7cfe96da875b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.492605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bab3887d-e780-4564-84a0-7cfe96da875b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.493050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bab3887d-e780-4564-84a0-7cfe96da875b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.494743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bab3887d-e780-4564-84a0-7cfe96da875b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.495204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bab3887d-e780-4564-84a0-7cfe96da875b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.495632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bab3887d-e780-4564-84a0-7cfe96da875b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.517878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dd886271-a09c-4231-9d69-8d9e970260dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:59.529406 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dd886271-a09c-4231-9d69-8d9e970260dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1313 microversion: 2.1 time: 0.185764 Sep 10 21:15:59.530642 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2775/5668] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:59 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:15:59.691025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bab3887d-e780-4564-84a0-7cfe96da875b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:15:59.708211 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bab3887d-e780-4564-84a0-7cfe96da875b tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1508 microversion: 2.1 time: 0.230668 Sep 10 21:15:59.708921 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2894/5669] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:15:59 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:15:59.732642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6dba9604-2298-4eff-ad0d-e5b2831291d8 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17e9affe-6cc0-4457-a1df-c7bd87e924ce", "device": "/dev/sdb"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:15:59.735401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6dba9604-2298-4eff-ad0d-e5b2831291d8 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:15:59.741393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dba9604-2298-4eff-ad0d-e5b2831291d8 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.741990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dba9604-2298-4eff-ad0d-e5b2831291d8 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.742396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dba9604-2298-4eff-ad0d-e5b2831291d8 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:15:59.743094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dba9604-2298-4eff-ad0d-e5b2831291d8 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:15:59.744319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dba9604-2298-4eff-ad0d-e5b2831291d8 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:15:59.744665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6dba9604-2298-4eff-ad0d-e5b2831291d8 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.044707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:00.046115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:00.049388 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6dba9604-2298-4eff-ad0d-e5b2831291d8 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "POST /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321734 Sep 10 21:16:00.050530 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2776/5670] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:15:59 2022] POST /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:16:00.054093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:00.054584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:00.055026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.055949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:00.056685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:00.057122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.216456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:00.227025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:00.229495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:00.231181 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ddced91f-11b5-4ee0-b748-b783aa9783b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1744 microversion: 2.20 time: 0.191457 Sep 10 21:16:00.231757 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2895/5671] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:00 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:00.365768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bcb0869a-aaa8-442b-a393-de17f6d54877 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:00.367136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bcb0869a-aaa8-442b-a393-de17f6d54877 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:00.376525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcb0869a-aaa8-442b-a393-de17f6d54877 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:00.377113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcb0869a-aaa8-442b-a393-de17f6d54877 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:00.377797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcb0869a-aaa8-442b-a393-de17f6d54877 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.378799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcb0869a-aaa8-442b-a393-de17f6d54877 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:00.379605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcb0869a-aaa8-442b-a393-de17f6d54877 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:00.380377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bcb0869a-aaa8-442b-a393-de17f6d54877 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.392990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b260638e-9527-4d86-8288-ef99c5f87e03 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:00.393625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b260638e-9527-4d86-8288-ef99c5f87e03 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:00.412329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b260638e-9527-4d86-8288-ef99c5f87e03 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:00.412844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b260638e-9527-4d86-8288-ef99c5f87e03 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:00.414013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b260638e-9527-4d86-8288-ef99c5f87e03 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.415151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b260638e-9527-4d86-8288-ef99c5f87e03 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:00.415796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b260638e-9527-4d86-8288-ef99c5f87e03 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:00.416619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b260638e-9527-4d86-8288-ef99c5f87e03 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.558470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bcb0869a-aaa8-442b-a393-de17f6d54877 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:00.571351 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bcb0869a-aaa8-442b-a393-de17f6d54877 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1487 microversion: 2.1 time: 0.210366 Sep 10 21:16:00.571940 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2777/5672] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:00 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1487 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:00.590896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5843d5ff-07eb-409f-8331-9a8e54f9960c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:00.591560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5843d5ff-07eb-409f-8331-9a8e54f9960c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:00.597967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5843d5ff-07eb-409f-8331-9a8e54f9960c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:00.598466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5843d5ff-07eb-409f-8331-9a8e54f9960c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:00.598910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5843d5ff-07eb-409f-8331-9a8e54f9960c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.599623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5843d5ff-07eb-409f-8331-9a8e54f9960c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:00.600265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5843d5ff-07eb-409f-8331-9a8e54f9960c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:00.600891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5843d5ff-07eb-409f-8331-9a8e54f9960c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.667127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b260638e-9527-4d86-8288-ef99c5f87e03 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:00.678808 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b260638e-9527-4d86-8288-ef99c5f87e03 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1372 microversion: 2.1 time: 0.289979 Sep 10 21:16:00.680299 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2896/5673] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:00 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1372 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:00.687872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-48aedcba-c9ba-441c-a09a-fd3264c90c54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:00.688747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-48aedcba-c9ba-441c-a09a-fd3264c90c54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:00.697115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aedcba-c9ba-441c-a09a-fd3264c90c54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:00.698231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aedcba-c9ba-441c-a09a-fd3264c90c54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:00.699083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aedcba-c9ba-441c-a09a-fd3264c90c54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.700186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aedcba-c9ba-441c-a09a-fd3264c90c54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:00.700926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aedcba-c9ba-441c-a09a-fd3264c90c54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:00.701677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48aedcba-c9ba-441c-a09a-fd3264c90c54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:00.735092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-48aedcba-c9ba-441c-a09a-fd3264c90c54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lazy-loading 'flavor' on Instance uuid 9ab021c5-f772-432f-8147-3b7f70eeae59 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:16:00.823068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:00.842856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5843d5ff-07eb-409f-8331-9a8e54f9960c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:00.858966 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5843d5ff-07eb-409f-8331-9a8e54f9960c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1313 microversion: 2.1 time: 0.277856 Sep 10 21:16:00.860462 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2778/5674] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:00 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:01.138811 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-48aedcba-c9ba-441c-a09a-fd3264c90c54 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59/action" status: 202 len: 0 microversion: 2.1 time: 0.455603 Sep 10 21:16:01.141367 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2897/5675] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:16:00 2022] POST /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:16:01.150020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-97a3ba25-c640-47fb-a61d-b76adafe4431 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:01.150841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-97a3ba25-c640-47fb-a61d-b76adafe4431 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:01.157228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97a3ba25-c640-47fb-a61d-b76adafe4431 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.158135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97a3ba25-c640-47fb-a61d-b76adafe4431 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.158780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97a3ba25-c640-47fb-a61d-b76adafe4431 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:01.159669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97a3ba25-c640-47fb-a61d-b76adafe4431 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.160460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97a3ba25-c640-47fb-a61d-b76adafe4431 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.161053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97a3ba25-c640-47fb-a61d-b76adafe4431 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:01.261016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:01.261806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:01.275890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.276420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.277819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:01.281415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.282382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.283816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:01.437149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-97a3ba25-c640-47fb-a61d-b76adafe4431 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:01.445310 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-97a3ba25-c640-47fb-a61d-b76adafe4431 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1493 microversion: 2.1 time: 0.299648 Sep 10 21:16:01.468230 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2779/5676] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:01 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1493 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:01.587907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:01.598106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:01.599797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:01.601379 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ae9022c-4bc7-44fb-8a75-e3e4b4cb810d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.345376 Sep 10 21:16:01.607680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d6877d71-d914-4c77-9de6-3857423a8652 req-b9a4af02-eae9-490a-b48a-7f2841c94138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26", "name": "network-vif-plugged", "status": "completed", "tag": "0c8d8555-28a1-427f-b57c-affbeeda6daf"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:01.614392 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2898/5677] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:01 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:01.620738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d6877d71-d914-4c77-9de6-3857423a8652 req-b9a4af02-eae9-490a-b48a-7f2841c94138 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.621231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d6877d71-d914-4c77-9de6-3857423a8652 req-b9a4af02-eae9-490a-b48a-7f2841c94138 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.621683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d6877d71-d914-4c77-9de6-3857423a8652 req-b9a4af02-eae9-490a-b48a-7f2841c94138 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:01.643472 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d6877d71-d914-4c77-9de6-3857423a8652 req-b9a4af02-eae9-490a-b48a-7f2841c94138 service nova] Creating event network-vif-plugged:0c8d8555-28a1-427f-b57c-affbeeda6daf for instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 on nch2-master-1 Sep 10 21:16:01.651033 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d6877d71-d914-4c77-9de6-3857423a8652 req-b9a4af02-eae9-490a-b48a-7f2841c94138 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047405 Sep 10 21:16:01.652787 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2780/5678] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:16:01.712763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-660d2b36-d25d-46bb-9b9f-8a4fda9376d9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:01.713415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-660d2b36-d25d-46bb-9b9f-8a4fda9376d9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:01.721010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660d2b36-d25d-46bb-9b9f-8a4fda9376d9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.721760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660d2b36-d25d-46bb-9b9f-8a4fda9376d9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.722427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660d2b36-d25d-46bb-9b9f-8a4fda9376d9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:01.723358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660d2b36-d25d-46bb-9b9f-8a4fda9376d9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.724020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660d2b36-d25d-46bb-9b9f-8a4fda9376d9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.724614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-660d2b36-d25d-46bb-9b9f-8a4fda9376d9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:01.890133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cb646762-5916-49ca-99a5-fdbe5e51206c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:01.891139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cb646762-5916-49ca-99a5-fdbe5e51206c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:01.898080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb646762-5916-49ca-99a5-fdbe5e51206c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.898836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb646762-5916-49ca-99a5-fdbe5e51206c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.900044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb646762-5916-49ca-99a5-fdbe5e51206c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:01.900944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb646762-5916-49ca-99a5-fdbe5e51206c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.901688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb646762-5916-49ca-99a5-fdbe5e51206c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.902337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb646762-5916-49ca-99a5-fdbe5e51206c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:01.938294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-660d2b36-d25d-46bb-9b9f-8a4fda9376d9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:01.957316 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-660d2b36-d25d-46bb-9b9f-8a4fda9376d9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1544 microversion: 2.1 time: 0.255105 Sep 10 21:16:01.959697 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2899/5679] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:01 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1544 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:01.983807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a1ce408-a4c5-45ee-a095-f4a7960c2a69 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:01.985679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4a1ce408-a4c5-45ee-a095-f4a7960c2a69 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:01.993030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a1ce408-a4c5-45ee-a095-f4a7960c2a69 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.994109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a1ce408-a4c5-45ee-a095-f4a7960c2a69 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.995164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a1ce408-a4c5-45ee-a095-f4a7960c2a69 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:01.996114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a1ce408-a4c5-45ee-a095-f4a7960c2a69 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:01.996790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a1ce408-a4c5-45ee-a095-f4a7960c2a69 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:01.997444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a1ce408-a4c5-45ee-a095-f4a7960c2a69 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:02.147726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cb646762-5916-49ca-99a5-fdbe5e51206c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:02.156469 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cb646762-5916-49ca-99a5-fdbe5e51206c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1313 microversion: 2.1 time: 0.270588 Sep 10 21:16:02.161227 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2781/5680] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:01 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:02.218816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4a1ce408-a4c5-45ee-a095-f4a7960c2a69 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:02.238697 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4a1ce408-a4c5-45ee-a095-f4a7960c2a69 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1544 microversion: 2.1 time: 0.259323 Sep 10 21:16:02.239315 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2900/5681] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:01 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1544 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:02.469395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da2d0a77-7e56-47ab-9806-0a3bf77fca78 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:02.470862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da2d0a77-7e56-47ab-9806-0a3bf77fca78 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:02.486011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da2d0a77-7e56-47ab-9806-0a3bf77fca78 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:02.486710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da2d0a77-7e56-47ab-9806-0a3bf77fca78 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:02.490994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da2d0a77-7e56-47ab-9806-0a3bf77fca78 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:02.492751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da2d0a77-7e56-47ab-9806-0a3bf77fca78 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:02.493626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da2d0a77-7e56-47ab-9806-0a3bf77fca78 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:02.494486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da2d0a77-7e56-47ab-9806-0a3bf77fca78 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:02.639772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:02.640789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:02.656751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:02.657441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:02.658053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:02.658894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:02.659622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:02.660300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:02.939504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:02.951699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:02.954635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:02.956931 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d89c0671-41d8-44e4-8335-7a0fb6cc6d49 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.321009 Sep 10 21:16:02.958894 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2901/5682] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:02 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:03.186741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7f4d4370-977d-4279-90a4-2d69dfaa82d1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:03.187259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7f4d4370-977d-4279-90a4-2d69dfaa82d1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:03.197661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f4d4370-977d-4279-90a4-2d69dfaa82d1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:03.198418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f4d4370-977d-4279-90a4-2d69dfaa82d1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:03.199102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f4d4370-977d-4279-90a4-2d69dfaa82d1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:03.199983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f4d4370-977d-4279-90a4-2d69dfaa82d1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:03.201252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f4d4370-977d-4279-90a4-2d69dfaa82d1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:03.201861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f4d4370-977d-4279-90a4-2d69dfaa82d1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:03.307774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da2d0a77-7e56-47ab-9806-0a3bf77fca78 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:03.323577 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da2d0a77-7e56-47ab-9806-0a3bf77fca78 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1493 microversion: 2.1 time: 0.858648 Sep 10 21:16:03.338382 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2782/5683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:02 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1493 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:03.482623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7f4d4370-977d-4279-90a4-2d69dfaa82d1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:03.494429 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7f4d4370-977d-4279-90a4-2d69dfaa82d1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1313 microversion: 2.1 time: 0.311203 Sep 10 21:16:03.495473 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2902/5684] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:03 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:03.695035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-84b2c5ef-5aea-4375-96bb-dde9db587dd3 req-96ec9f10-bf66-40b3-bee4-23e175f315dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5eb0bd1-784c-46dc-93eb-ac3ee145635d", "name": "network-vif-plugged", "status": "completed", "tag": "8763e159-351b-434e-b3ac-c39d9396d62d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:03.729808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-84b2c5ef-5aea-4375-96bb-dde9db587dd3 req-96ec9f10-bf66-40b3-bee4-23e175f315dd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:03.730584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-84b2c5ef-5aea-4375-96bb-dde9db587dd3 req-96ec9f10-bf66-40b3-bee4-23e175f315dd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:03.731016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-84b2c5ef-5aea-4375-96bb-dde9db587dd3 req-96ec9f10-bf66-40b3-bee4-23e175f315dd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:03.755749 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-84b2c5ef-5aea-4375-96bb-dde9db587dd3 req-96ec9f10-bf66-40b3-bee4-23e175f315dd service nova] Creating event network-vif-plugged:8763e159-351b-434e-b3ac-c39d9396d62d for instance b5eb0bd1-784c-46dc-93eb-ac3ee145635d on nch1-master-1 Sep 10 21:16:03.762511 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-84b2c5ef-5aea-4375-96bb-dde9db587dd3 req-96ec9f10-bf66-40b3-bee4-23e175f315dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072754 Sep 10 21:16:03.763646 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2783/5685] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:16:03.988540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:03.989797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:04.014031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:04.015231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:04.016661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:04.021780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:04.022928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:04.023538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:04.217389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:04.229035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:04.231113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:04.232475 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da85a40b-5026-49a7-8c4c-a89aaa8d8c38 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.251050 Sep 10 21:16:04.253234 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2903/5686] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:03 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:04.355610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-07c35516-06f2-4f00-8ecb-4265590804fc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:04.356382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-07c35516-06f2-4f00-8ecb-4265590804fc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:04.365721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07c35516-06f2-4f00-8ecb-4265590804fc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:04.371106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07c35516-06f2-4f00-8ecb-4265590804fc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:04.373191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07c35516-06f2-4f00-8ecb-4265590804fc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:04.374739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07c35516-06f2-4f00-8ecb-4265590804fc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:04.375621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07c35516-06f2-4f00-8ecb-4265590804fc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:04.376960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07c35516-06f2-4f00-8ecb-4265590804fc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:04.523856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-832c0c88-5c9a-4bfa-855b-96f14d960bb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:04.530433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-832c0c88-5c9a-4bfa-855b-96f14d960bb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:04.538412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-832c0c88-5c9a-4bfa-855b-96f14d960bb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:04.539504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-832c0c88-5c9a-4bfa-855b-96f14d960bb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:04.540499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-832c0c88-5c9a-4bfa-855b-96f14d960bb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:04.541637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-832c0c88-5c9a-4bfa-855b-96f14d960bb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:04.542446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-832c0c88-5c9a-4bfa-855b-96f14d960bb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:04.543098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-832c0c88-5c9a-4bfa-855b-96f14d960bb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:04.689143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-07c35516-06f2-4f00-8ecb-4265590804fc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:04.713009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-07c35516-06f2-4f00-8ecb-4265590804fc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1514 microversion: 2.1 time: 0.361368 Sep 10 21:16:04.714712 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2784/5687] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:04 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1514 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:04.785249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-832c0c88-5c9a-4bfa-855b-96f14d960bb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:04.794846 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-832c0c88-5c9a-4bfa-855b-96f14d960bb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1313 microversion: 2.1 time: 0.276530 Sep 10 21:16:04.796067 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2904/5688] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:04 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:05.271214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:05.280197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:05.316777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:05.318409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:05.320283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:05.321518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:05.324230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:05.324961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:05.616389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:05.628024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:05.639004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:05.644101 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-668bdf31-fb97-4de5-affe-1a77593fcf05 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.384365 Sep 10 21:16:05.644944 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2785/5689] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:05 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:05.738037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-1110c748-a7f8-4f46-9858-9fd786afb180 req-9250d3c8-2657-41cf-9b58-4d194aa33aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c119a968-8e9d-4f49-bdd9-1da99159cecc", "tag": "3584c8e9-718d-4a42-b791-17326796df18"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:05.746148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4113de7c-353b-4f43-9516-3daeca448950 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:05.747198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4113de7c-353b-4f43-9516-3daeca448950 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:05.761986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1110c748-a7f8-4f46-9858-9fd786afb180 req-9250d3c8-2657-41cf-9b58-4d194aa33aac service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:05.763769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1110c748-a7f8-4f46-9858-9fd786afb180 req-9250d3c8-2657-41cf-9b58-4d194aa33aac service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:05.764421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1110c748-a7f8-4f46-9858-9fd786afb180 req-9250d3c8-2657-41cf-9b58-4d194aa33aac service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:05.797571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4113de7c-353b-4f43-9516-3daeca448950 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:05.798264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4113de7c-353b-4f43-9516-3daeca448950 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:05.798735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4113de7c-353b-4f43-9516-3daeca448950 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:05.801268 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-1110c748-a7f8-4f46-9858-9fd786afb180 req-9250d3c8-2657-41cf-9b58-4d194aa33aac service nova] Creating event network-changed:3584c8e9-718d-4a42-b791-17326796df18 for instance c119a968-8e9d-4f49-bdd9-1da99159cecc on nch1-master-1 Sep 10 21:16:05.810312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4113de7c-353b-4f43-9516-3daeca448950 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:05.810312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4113de7c-353b-4f43-9516-3daeca448950 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:05.810312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4113de7c-353b-4f43-9516-3daeca448950 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:05.822391 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-1110c748-a7f8-4f46-9858-9fd786afb180 req-9250d3c8-2657-41cf-9b58-4d194aa33aac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087957 Sep 10 21:16:05.827512 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2905/5690] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:16:05.835343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-00de514e-b78f-4a9c-a791-c244dd43f2dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:05.836388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-00de514e-b78f-4a9c-a791-c244dd43f2dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:05.848389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00de514e-b78f-4a9c-a791-c244dd43f2dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:05.849503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00de514e-b78f-4a9c-a791-c244dd43f2dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:05.850481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00de514e-b78f-4a9c-a791-c244dd43f2dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:05.851456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00de514e-b78f-4a9c-a791-c244dd43f2dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:05.852516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00de514e-b78f-4a9c-a791-c244dd43f2dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:05.853358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00de514e-b78f-4a9c-a791-c244dd43f2dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:06.130675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4113de7c-353b-4f43-9516-3daeca448950 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:06.207350 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4113de7c-353b-4f43-9516-3daeca448950 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1514 microversion: 2.1 time: 0.469818 Sep 10 21:16:06.213451 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2786/5691] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:05 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1514 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:06.419036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-00de514e-b78f-4a9c-a791-c244dd43f2dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:06.429562 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-00de514e-b78f-4a9c-a791-c244dd43f2dd tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1498 microversion: 2.1 time: 0.601591 Sep 10 21:16:06.453400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62f98cec-ae04-4aa5-8ef5-47a814d8d892 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:06.455024 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2906/5692] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:05 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1498 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:06.464287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62f98cec-ae04-4aa5-8ef5-47a814d8d892 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:06.473980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62f98cec-ae04-4aa5-8ef5-47a814d8d892 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:06.474846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62f98cec-ae04-4aa5-8ef5-47a814d8d892 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:06.475916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62f98cec-ae04-4aa5-8ef5-47a814d8d892 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:06.479790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62f98cec-ae04-4aa5-8ef5-47a814d8d892 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:06.480952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62f98cec-ae04-4aa5-8ef5-47a814d8d892 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:06.481680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62f98cec-ae04-4aa5-8ef5-47a814d8d892 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:06.520306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-62f98cec-ae04-4aa5-8ef5-47a814d8d892 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lazy-loading 'flavor' on Instance uuid b5eb0bd1-784c-46dc-93eb-ac3ee145635d {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:16:06.676348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:06.677803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:06.695645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:06.697216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:06.699858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:06.704655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:06.708840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:06.710118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:06.721723 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62f98cec-ae04-4aa5-8ef5-47a814d8d892 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "POST /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d/action" status: 200 len: 32 microversion: 2.1 time: 0.272169 Sep 10 21:16:06.722400 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2787/5693] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:16:06 2022] POST /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d/action => generated 32 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 21:16:06.755198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-82c5aa46-3b6b-4714-803b-98980ce136ac tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:06.757455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-82c5aa46-3b6b-4714-803b-98980ce136ac tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:06.776978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c5aa46-3b6b-4714-803b-98980ce136ac tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:06.777861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c5aa46-3b6b-4714-803b-98980ce136ac tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:06.780294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c5aa46-3b6b-4714-803b-98980ce136ac tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:06.782353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c5aa46-3b6b-4714-803b-98980ce136ac tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:06.786430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c5aa46-3b6b-4714-803b-98980ce136ac tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:06.787227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82c5aa46-3b6b-4714-803b-98980ce136ac tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:07.074857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:07.111735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:07.115862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:07.126456 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-51011a31-b78e-4857-b041-f66eebb8b8dd tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.454135 Sep 10 21:16:07.147467 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2907/5694] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:06 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:07.236652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-466ad8ca-a3d3-424a-a1e7-02cbdb135bf4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:07.237479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-466ad8ca-a3d3-424a-a1e7-02cbdb135bf4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:07.254827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-466ad8ca-a3d3-424a-a1e7-02cbdb135bf4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:07.259213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-466ad8ca-a3d3-424a-a1e7-02cbdb135bf4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:07.260795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-466ad8ca-a3d3-424a-a1e7-02cbdb135bf4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:07.263059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-466ad8ca-a3d3-424a-a1e7-02cbdb135bf4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:07.263917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-466ad8ca-a3d3-424a-a1e7-02cbdb135bf4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:07.267129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-466ad8ca-a3d3-424a-a1e7-02cbdb135bf4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:07.272935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-82c5aa46-3b6b-4714-803b-98980ce136ac tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:07.286881 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-82c5aa46-3b6b-4714-803b-98980ce136ac tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.557555 Sep 10 21:16:07.288835 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2788/5695] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:06 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:08.016060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-466ad8ca-a3d3-424a-a1e7-02cbdb135bf4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:08.026565 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-466ad8ca-a3d3-424a-a1e7-02cbdb135bf4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.794433 Sep 10 21:16:08.030717 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2908/5696] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:07 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:08.157039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:08.157668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:08.174173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:08.174852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:08.175290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:08.176137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:08.176788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:08.177391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:08.231405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:08.317409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8a96afc1-d3d9-40c5-8da1-66ccfd66d141 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:08.319154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8a96afc1-d3d9-40c5-8da1-66ccfd66d141 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:08.349609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a96afc1-d3d9-40c5-8da1-66ccfd66d141 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:08.354773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a96afc1-d3d9-40c5-8da1-66ccfd66d141 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:08.356538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a96afc1-d3d9-40c5-8da1-66ccfd66d141 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:08.357650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a96afc1-d3d9-40c5-8da1-66ccfd66d141 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:08.358635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a96afc1-d3d9-40c5-8da1-66ccfd66d141 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:08.360011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a96afc1-d3d9-40c5-8da1-66ccfd66d141 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:08.471916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:08.483994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:08.487038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:08.488561 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-59859781-ab31-4198-9c3b-41529e711aef tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.336229 Sep 10 21:16:08.489949 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2789/5697] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:08 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:08.644549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8a96afc1-d3d9-40c5-8da1-66ccfd66d141 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:08.664703 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8a96afc1-d3d9-40c5-8da1-66ccfd66d141 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.351826 Sep 10 21:16:08.666296 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2909/5698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:08 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:09.060795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-58c66376-6edb-49a1-9e75-0aebb53c9226 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:09.061428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-58c66376-6edb-49a1-9e75-0aebb53c9226 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:09.077804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58c66376-6edb-49a1-9e75-0aebb53c9226 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:09.078422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58c66376-6edb-49a1-9e75-0aebb53c9226 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:09.080494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58c66376-6edb-49a1-9e75-0aebb53c9226 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:09.081350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58c66376-6edb-49a1-9e75-0aebb53c9226 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:09.081869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58c66376-6edb-49a1-9e75-0aebb53c9226 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:09.082319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58c66376-6edb-49a1-9e75-0aebb53c9226 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:09.474348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-58c66376-6edb-49a1-9e75-0aebb53c9226 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:09.502341 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-58c66376-6edb-49a1-9e75-0aebb53c9226 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.445254 Sep 10 21:16:09.505550 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2790/5699] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:09 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:09.526606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:09.528030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:09.538758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:09.543146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:09.547542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:09.551562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:09.552866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:09.556805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:09.691041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a098c31e-7782-477c-8056-a8648ad1157b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:09.692136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a098c31e-7782-477c-8056-a8648ad1157b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:09.718711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098c31e-7782-477c-8056-a8648ad1157b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:09.719613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098c31e-7782-477c-8056-a8648ad1157b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:09.720391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098c31e-7782-477c-8056-a8648ad1157b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:09.722094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098c31e-7782-477c-8056-a8648ad1157b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:09.724494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098c31e-7782-477c-8056-a8648ad1157b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:09.725148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098c31e-7782-477c-8056-a8648ad1157b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:10.048936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:10.063843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:10.071971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:10.073900 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-25d07f35-8082-4d7f-b9a2-2a7b9e1ad8b2 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.552516 Sep 10 21:16:10.082492 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2910/5700] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:09 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:10.097580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6b6eb681-b080-4383-a925-37ab6a32c449 req-5f0b1b21-d2ee-4372-b17a-0269766a6b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab021c5-f772-432f-8147-3b7f70eeae59", "name": "network-vif-plugged", "status": "completed", "tag": "b471905b-b736-4e3b-9546-4c0558cb7edf"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:10.134207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6b6eb681-b080-4383-a925-37ab6a32c449 req-5f0b1b21-d2ee-4372-b17a-0269766a6b60 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:10.134707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6b6eb681-b080-4383-a925-37ab6a32c449 req-5f0b1b21-d2ee-4372-b17a-0269766a6b60 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:10.135153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6b6eb681-b080-4383-a925-37ab6a32c449 req-5f0b1b21-d2ee-4372-b17a-0269766a6b60 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:10.168348 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6b6eb681-b080-4383-a925-37ab6a32c449 req-5f0b1b21-d2ee-4372-b17a-0269766a6b60 service nova] Creating event network-vif-plugged:b471905b-b736-4e3b-9546-4c0558cb7edf for instance 9ab021c5-f772-432f-8147-3b7f70eeae59 on nch1-master-1 Sep 10 21:16:10.187939 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6b6eb681-b080-4383-a925-37ab6a32c449 req-5f0b1b21-d2ee-4372-b17a-0269766a6b60 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104105 Sep 10 21:16:10.188843 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2911/5701] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:16:10.196914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a098c31e-7782-477c-8056-a8648ad1157b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:10.218315 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a098c31e-7782-477c-8056-a8648ad1157b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.530259 Sep 10 21:16:10.220424 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2791/5702] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:09 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:10.533370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e73df12-cd1f-4697-ba32-fa012b3a58f3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:10.534117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e73df12-cd1f-4697-ba32-fa012b3a58f3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:10.549901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e73df12-cd1f-4697-ba32-fa012b3a58f3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:10.550631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e73df12-cd1f-4697-ba32-fa012b3a58f3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:10.551241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e73df12-cd1f-4697-ba32-fa012b3a58f3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:10.552159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e73df12-cd1f-4697-ba32-fa012b3a58f3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:10.553086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e73df12-cd1f-4697-ba32-fa012b3a58f3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:10.553731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e73df12-cd1f-4697-ba32-fa012b3a58f3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:10.734549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e73df12-cd1f-4697-ba32-fa012b3a58f3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:10.745133 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e73df12-cd1f-4697-ba32-fa012b3a58f3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.217421 Sep 10 21:16:10.746262 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2912/5703] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:10 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:11.112031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:11.112655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:11.127408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:11.128863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:11.130552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:11.133879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:11.138286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:11.138938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:11.359295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:11.361264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8f49ff78-5c88-4274-ad2b-a6895a7dcfe8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:11.362001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8f49ff78-5c88-4274-ad2b-a6895a7dcfe8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:11.373518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:11.375258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:11.376692 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6cfe7fa8-0995-4d61-8f74-bb4f699f583b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.268766 Sep 10 21:16:11.377452 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2792/5704] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:11 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:11.379550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f49ff78-5c88-4274-ad2b-a6895a7dcfe8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:11.380435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f49ff78-5c88-4274-ad2b-a6895a7dcfe8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:11.383842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f49ff78-5c88-4274-ad2b-a6895a7dcfe8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:11.384605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f49ff78-5c88-4274-ad2b-a6895a7dcfe8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:11.387091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f49ff78-5c88-4274-ad2b-a6895a7dcfe8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:11.390164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f49ff78-5c88-4274-ad2b-a6895a7dcfe8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:11.644020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8f49ff78-5c88-4274-ad2b-a6895a7dcfe8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:11.656802 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8f49ff78-5c88-4274-ad2b-a6895a7dcfe8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.300533 Sep 10 21:16:11.675669 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2913/5705] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:11 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:11.788261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9be836c9-2387-4f7b-bcb9-f88d79230d55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:11.788261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9be836c9-2387-4f7b-bcb9-f88d79230d55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:11.804135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9be836c9-2387-4f7b-bcb9-f88d79230d55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:11.804913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9be836c9-2387-4f7b-bcb9-f88d79230d55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:11.806064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9be836c9-2387-4f7b-bcb9-f88d79230d55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:11.811208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9be836c9-2387-4f7b-bcb9-f88d79230d55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:11.812253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9be836c9-2387-4f7b-bcb9-f88d79230d55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:11.815995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9be836c9-2387-4f7b-bcb9-f88d79230d55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:12.152714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9be836c9-2387-4f7b-bcb9-f88d79230d55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:12.161641 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9be836c9-2387-4f7b-bcb9-f88d79230d55 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.394136 Sep 10 21:16:12.162712 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2793/5706] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:11 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:12.405586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:12.406478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:12.417245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:12.418147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:12.425557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:12.426565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:12.427196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:12.434084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:12.680989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5d72d483-cd26-4479-bb8f-7f5001bd9763 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:12.681867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5d72d483-cd26-4479-bb8f-7f5001bd9763 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:12.697364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d72d483-cd26-4479-bb8f-7f5001bd9763 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:12.700136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d72d483-cd26-4479-bb8f-7f5001bd9763 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:12.701105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d72d483-cd26-4479-bb8f-7f5001bd9763 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:12.702330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d72d483-cd26-4479-bb8f-7f5001bd9763 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:12.710225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d72d483-cd26-4479-bb8f-7f5001bd9763 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:12.714121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d72d483-cd26-4479-bb8f-7f5001bd9763 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:13.030170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5d72d483-cd26-4479-bb8f-7f5001bd9763 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:13.041716 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5d72d483-cd26-4479-bb8f-7f5001bd9763 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.364957 Sep 10 21:16:13.044619 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2794/5707] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:12 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:13.191517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-734dbf50-507b-4b7f-a8ea-f7fde9918d26 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:13.193019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-734dbf50-507b-4b7f-a8ea-f7fde9918d26 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:13.201599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-734dbf50-507b-4b7f-a8ea-f7fde9918d26 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:13.202134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-734dbf50-507b-4b7f-a8ea-f7fde9918d26 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:13.202585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-734dbf50-507b-4b7f-a8ea-f7fde9918d26 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:13.203329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-734dbf50-507b-4b7f-a8ea-f7fde9918d26 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:13.204000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-734dbf50-507b-4b7f-a8ea-f7fde9918d26 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:13.204620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-734dbf50-507b-4b7f-a8ea-f7fde9918d26 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:13.218481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:13.230721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:13.232543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:13.234383 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7d2d9be0-21c3-499f-8e3e-865e8c01280b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.832638 Sep 10 21:16:13.235277 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2914/5708] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:12 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:13.528242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-734dbf50-507b-4b7f-a8ea-f7fde9918d26 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:13.544713 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-734dbf50-507b-4b7f-a8ea-f7fde9918d26 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.357908 Sep 10 21:16:13.564442 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2795/5709] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:13 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:14.038769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] Calling method '.version_select at 0x7f993f87a550>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:14.041866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:14.042746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:14.049259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:14.066555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:14.071935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-df00a82b-1641-4a2b-b22a-48252d2ab133 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:14.073119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-df00a82b-1641-4a2b-b22a-48252d2ab133 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:14.085896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df00a82b-1641-4a2b-b22a-48252d2ab133 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:14.088663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df00a82b-1641-4a2b-b22a-48252d2ab133 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:14.090631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:14.090947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df00a82b-1641-4a2b-b22a-48252d2ab133 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:14.091130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:14.092982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df00a82b-1641-4a2b-b22a-48252d2ab133 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:14.094362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:14.094785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df00a82b-1641-4a2b-b22a-48252d2ab133 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:14.095445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df00a82b-1641-4a2b-b22a-48252d2ab133 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:14.116672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:14.117181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:14.117624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:14.129664 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8040df5a-ad4c-4dec-b9a6-7b88ebaa20f7 tempest-PortsAdminExtendedAttrsTestJSON-501732931 tempest-PortsAdminExtendedAttrsTestJSON-501732931-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.335836 Sep 10 21:16:14.137387 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2915/5710] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 21:16:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:16:14.287597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:14.289146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:14.302078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:14.304706 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:14.306531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:14.308375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:14.311237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:14.311877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:14.408458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-df00a82b-1641-4a2b-b22a-48252d2ab133 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:14.424466 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-df00a82b-1641-4a2b-b22a-48252d2ab133 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.358352 Sep 10 21:16:14.442197 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2796/5711] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:14 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:14.572416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d087e936-9ec3-4c8b-891e-7871ce936f8b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:14.573324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d087e936-9ec3-4c8b-891e-7871ce936f8b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:14.583613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d087e936-9ec3-4c8b-891e-7871ce936f8b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:14.585502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d087e936-9ec3-4c8b-891e-7871ce936f8b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:14.591257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d087e936-9ec3-4c8b-891e-7871ce936f8b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:14.593368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d087e936-9ec3-4c8b-891e-7871ce936f8b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:14.594153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d087e936-9ec3-4c8b-891e-7871ce936f8b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:14.594842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d087e936-9ec3-4c8b-891e-7871ce936f8b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:14.611985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:14.628163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:14.630060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:14.631505 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc17be9c-eb24-4571-ba93-6f8610d819e8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.349216 Sep 10 21:16:14.645851 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2916/5712] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:14 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:14.926644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d087e936-9ec3-4c8b-891e-7871ce936f8b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:14.937285 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d087e936-9ec3-4c8b-891e-7871ce936f8b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.369790 Sep 10 21:16:14.942302 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2797/5713] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:14 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:15.449467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-597a94fe-1528-4e2f-9174-4f39ed21fdf2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:15.450885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-597a94fe-1528-4e2f-9174-4f39ed21fdf2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:15.463388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-597a94fe-1528-4e2f-9174-4f39ed21fdf2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:15.465180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-597a94fe-1528-4e2f-9174-4f39ed21fdf2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:15.466493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-597a94fe-1528-4e2f-9174-4f39ed21fdf2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:15.471032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-597a94fe-1528-4e2f-9174-4f39ed21fdf2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:15.471778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-597a94fe-1528-4e2f-9174-4f39ed21fdf2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:15.472405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-597a94fe-1528-4e2f-9174-4f39ed21fdf2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:15.661623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:15.663003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:15.683076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:15.683939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:15.685048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:15.687876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:15.689777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:15.690485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:15.806744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-597a94fe-1528-4e2f-9174-4f39ed21fdf2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:15.818878 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-597a94fe-1528-4e2f-9174-4f39ed21fdf2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.373946 Sep 10 21:16:15.823458 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2917/5714] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:15 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:15.980500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f0d1733-58fa-46d0-93c3-5dcfa3e5516c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:15.981539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2f0d1733-58fa-46d0-93c3-5dcfa3e5516c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:15.993938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f0d1733-58fa-46d0-93c3-5dcfa3e5516c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:15.994726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f0d1733-58fa-46d0-93c3-5dcfa3e5516c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:15.995167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f0d1733-58fa-46d0-93c3-5dcfa3e5516c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:15.995891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f0d1733-58fa-46d0-93c3-5dcfa3e5516c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:15.996350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f0d1733-58fa-46d0-93c3-5dcfa3e5516c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:15.999950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f0d1733-58fa-46d0-93c3-5dcfa3e5516c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:16.249386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2f0d1733-58fa-46d0-93c3-5dcfa3e5516c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:16.265313 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f0d1733-58fa-46d0-93c3-5dcfa3e5516c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.289699 Sep 10 21:16:16.268047 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2918/5715] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:15 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:16.309408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:16.323576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:16.325370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:16.330552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-303ad257-c322-459b-820a-7241d440cc97 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.672755 Sep 10 21:16:16.331402 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2798/5716] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:15 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:16.847634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-874dff6f-136f-4230-8f58-c8c2066df9fc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:16.848221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-874dff6f-136f-4230-8f58-c8c2066df9fc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:16.872192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-874dff6f-136f-4230-8f58-c8c2066df9fc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:16.872866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-874dff6f-136f-4230-8f58-c8c2066df9fc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:16.874375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-874dff6f-136f-4230-8f58-c8c2066df9fc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:16.878033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-874dff6f-136f-4230-8f58-c8c2066df9fc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:16.879170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-874dff6f-136f-4230-8f58-c8c2066df9fc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:16.880486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-874dff6f-136f-4230-8f58-c8c2066df9fc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:17.259219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-874dff6f-136f-4230-8f58-c8c2066df9fc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:17.277889 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-874dff6f-136f-4230-8f58-c8c2066df9fc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.434704 Sep 10 21:16:17.287991 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2919/5717] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:16 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:17.307314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d59a69c7-f50f-43a0-aa26-ed883c166e2a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:17.308808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d59a69c7-f50f-43a0-aa26-ed883c166e2a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:17.330066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d59a69c7-f50f-43a0-aa26-ed883c166e2a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:17.338645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d59a69c7-f50f-43a0-aa26-ed883c166e2a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:17.345353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d59a69c7-f50f-43a0-aa26-ed883c166e2a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:17.347244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d59a69c7-f50f-43a0-aa26-ed883c166e2a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:17.348846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d59a69c7-f50f-43a0-aa26-ed883c166e2a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:17.350801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d59a69c7-f50f-43a0-aa26-ed883c166e2a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:17.360937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:17.361798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:17.373403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:17.380277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:17.380730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:17.381479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:17.381958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:17.390230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:17.652620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:17.661054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d59a69c7-f50f-43a0-aa26-ed883c166e2a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:17.664327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:17.666749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:17.668148 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e9598f4-6802-40a5-a6d2-bb438910946b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1739 microversion: 2.20 time: 0.312141 Sep 10 21:16:17.685867 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2920/5718] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:17 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:17.711038 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d59a69c7-f50f-43a0-aa26-ed883c166e2a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.409726 Sep 10 21:16:17.722174 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2799/5719] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:17 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:18.317147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-80a6f11a-1b1c-4541-b85d-6c52a62589eb tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:18.319322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-80a6f11a-1b1c-4541-b85d-6c52a62589eb tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:18.335060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80a6f11a-1b1c-4541-b85d-6c52a62589eb tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:18.336500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80a6f11a-1b1c-4541-b85d-6c52a62589eb tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:18.337318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80a6f11a-1b1c-4541-b85d-6c52a62589eb tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:18.338890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80a6f11a-1b1c-4541-b85d-6c52a62589eb tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:18.340674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80a6f11a-1b1c-4541-b85d-6c52a62589eb tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:18.341344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-80a6f11a-1b1c-4541-b85d-6c52a62589eb tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:18.656347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-80a6f11a-1b1c-4541-b85d-6c52a62589eb tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:18.672145 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-80a6f11a-1b1c-4541-b85d-6c52a62589eb tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.359241 Sep 10 21:16:18.687513 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2921/5720] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:18 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:18.700895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:18.701513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:18.709069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:18.709557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:18.714058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:18.714707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:18.715359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:18.715945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:18.779157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e02f5a0-aeea-4cc6-91e3-3db7f94d0159 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:18.779949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e02f5a0-aeea-4cc6-91e3-3db7f94d0159 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:18.796229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e02f5a0-aeea-4cc6-91e3-3db7f94d0159 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:18.796896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e02f5a0-aeea-4cc6-91e3-3db7f94d0159 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:18.797469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e02f5a0-aeea-4cc6-91e3-3db7f94d0159 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:18.798355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e02f5a0-aeea-4cc6-91e3-3db7f94d0159 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:18.799044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e02f5a0-aeea-4cc6-91e3-3db7f94d0159 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:18.799728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e02f5a0-aeea-4cc6-91e3-3db7f94d0159 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:19.039355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8e02f5a0-aeea-4cc6-91e3-3db7f94d0159 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:19.059506 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e02f5a0-aeea-4cc6-91e3-3db7f94d0159 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.285395 Sep 10 21:16:19.060777 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2922/5721] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:18 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:19.113406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:19.131023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:19.132709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:19.135643 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3833d38e-5f2e-4fd9-9a81-773c0f3962fc tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1721 microversion: 2.20 time: 0.439288 Sep 10 21:16:19.137579 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2800/5722] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:18 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1721 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:19.700625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d71e250b-f0d7-414e-a87d-d5470b345669 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:19.701439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d71e250b-f0d7-414e-a87d-d5470b345669 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:19.728692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71e250b-f0d7-414e-a87d-d5470b345669 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:19.729788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71e250b-f0d7-414e-a87d-d5470b345669 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:19.733192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71e250b-f0d7-414e-a87d-d5470b345669 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:19.734497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71e250b-f0d7-414e-a87d-d5470b345669 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:19.735127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71e250b-f0d7-414e-a87d-d5470b345669 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:19.736707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d71e250b-f0d7-414e-a87d-d5470b345669 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:19.999894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d71e250b-f0d7-414e-a87d-d5470b345669 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:20.010027 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d71e250b-f0d7-414e-a87d-d5470b345669 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.314874 Sep 10 21:16:20.021852 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2923/5723] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:19 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:20.089102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-15285d7a-76be-4bc0-acff-732b83ca4635 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:20.090316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-15285d7a-76be-4bc0-acff-732b83ca4635 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:20.095296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=95 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:20.100552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15285d7a-76be-4bc0-acff-732b83ca4635 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:20.101419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15285d7a-76be-4bc0-acff-732b83ca4635 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:20.103601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15285d7a-76be-4bc0-acff-732b83ca4635 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:20.105625 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15285d7a-76be-4bc0-acff-732b83ca4635 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:20.106378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15285d7a-76be-4bc0-acff-732b83ca4635 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:20.107709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-15285d7a-76be-4bc0-acff-732b83ca4635 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:20.171800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:20.172411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:20.183778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:20.184273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:20.186131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:20.187078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:20.187692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:20.188400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:20.314615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-15285d7a-76be-4bc0-acff-732b83ca4635 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:20.326494 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-15285d7a-76be-4bc0-acff-732b83ca4635 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.241693 Sep 10 21:16:20.327363 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2801/5724] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:20 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:20.408410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:20.421801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:20.423556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:20.424945 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-369d6bc6-136a-4fad-afc4-dfbe75f16908 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1721 microversion: 2.20 time: 0.257251 Sep 10 21:16:20.433764 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2924/5725] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:20 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:21.044036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6abbc407-bff8-42e4-8748-99f94d8af8f5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:21.044985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6abbc407-bff8-42e4-8748-99f94d8af8f5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:21.055766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6abbc407-bff8-42e4-8748-99f94d8af8f5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:21.057449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6abbc407-bff8-42e4-8748-99f94d8af8f5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:21.057974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6abbc407-bff8-42e4-8748-99f94d8af8f5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:21.058734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6abbc407-bff8-42e4-8748-99f94d8af8f5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:21.059466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6abbc407-bff8-42e4-8748-99f94d8af8f5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:21.059903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6abbc407-bff8-42e4-8748-99f94d8af8f5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:21.352923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-adc827b3-2758-4b90-9996-ef3ce1265a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:21.354470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-adc827b3-2758-4b90-9996-ef3ce1265a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:21.376102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc827b3-2758-4b90-9996-ef3ce1265a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:21.381292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc827b3-2758-4b90-9996-ef3ce1265a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:21.385013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc827b3-2758-4b90-9996-ef3ce1265a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:21.386248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc827b3-2758-4b90-9996-ef3ce1265a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:21.387231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc827b3-2758-4b90-9996-ef3ce1265a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:21.391105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-adc827b3-2758-4b90-9996-ef3ce1265a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:21.617674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-adc827b3-2758-4b90-9996-ef3ce1265a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:21.626527 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-adc827b3-2758-4b90-9996-ef3ce1265a40 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.277620 Sep 10 21:16:21.628142 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2925/5726] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:21 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:21.633317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-57835d03-588f-4144-bd06-a026e573bac4 req-c2b1de46-5e88-4718-a4b2-6c771e0aea36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26", "name": "network-vif-unplugged", "status": "completed", "tag": "0c8d8555-28a1-427f-b57c-affbeeda6daf"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:21.644158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-57835d03-588f-4144-bd06-a026e573bac4 req-c2b1de46-5e88-4718-a4b2-6c771e0aea36 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:21.644973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-57835d03-588f-4144-bd06-a026e573bac4 req-c2b1de46-5e88-4718-a4b2-6c771e0aea36 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:21.645663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-57835d03-588f-4144-bd06-a026e573bac4 req-c2b1de46-5e88-4718-a4b2-6c771e0aea36 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:21.659281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.compute.server_external_events [req-57835d03-588f-4144-bd06-a026e573bac4 req-c2b1de46-5e88-4718-a4b2-6c771e0aea36 service nova] Unable to find a host for instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26. Dropping event network-vif-unplugged {{(pid=145772) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 21:16:21.660728 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-57835d03-588f-4144-bd06-a026e573bac4 req-c2b1de46-5e88-4718-a4b2-6c771e0aea36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031416 Sep 10 21:16:21.661591 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2926/5727] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 21:16:21.668193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:21.669365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:21.676732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:21.677583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:21.678237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:21.679122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:21.679729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:21.680898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:21.747076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6abbc407-bff8-42e4-8748-99f94d8af8f5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:21.761877 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6abbc407-bff8-42e4-8748-99f94d8af8f5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.724578 Sep 10 21:16:21.762805 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2802/5728] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:21 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:21.840832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:21.849685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:21.851289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:21.852701 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40eec00e-a431-4026-934c-e611349c1b21 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1664 microversion: 2.20 time: 0.189764 Sep 10 21:16:21.853302 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2927/5729] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:21 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1664 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:21.880769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8d2c7596-a7f3-4244-9cf2-67df783f42ed tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa246a1d-91cf-4200-ae47-6ca885d6f74b"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:21.884199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8d2c7596-a7f3-4244-9cf2-67df783f42ed tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:21.893265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d2c7596-a7f3-4244-9cf2-67df783f42ed tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:21.895314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d2c7596-a7f3-4244-9cf2-67df783f42ed tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:21.895838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d2c7596-a7f3-4244-9cf2-67df783f42ed tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:21.896877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d2c7596-a7f3-4244-9cf2-67df783f42ed tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:21.897113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d2c7596-a7f3-4244-9cf2-67df783f42ed tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:21.897750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d2c7596-a7f3-4244-9cf2-67df783f42ed tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:22.207925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:22.219477 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8d2c7596-a7f3-4244-9cf2-67df783f42ed tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "POST /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.343045 Sep 10 21:16:22.226543 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2803/5730] 10.222.0.33 () {62 vars in 1364 bytes} [Sat Sep 10 21:16:21 2022] POST /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/os-volume_attachments => generated 188 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:16:22.358361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c6fc437f-9abe-44f4-a207-9b8a2f858e94 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:22.358945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c6fc437f-9abe-44f4-a207-9b8a2f858e94 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:22.365671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6fc437f-9abe-44f4-a207-9b8a2f858e94 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:22.366198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6fc437f-9abe-44f4-a207-9b8a2f858e94 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:22.366639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6fc437f-9abe-44f4-a207-9b8a2f858e94 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:22.367339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6fc437f-9abe-44f4-a207-9b8a2f858e94 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:22.370839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6fc437f-9abe-44f4-a207-9b8a2f858e94 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:22.371315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6fc437f-9abe-44f4-a207-9b8a2f858e94 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:22.607645 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c6fc437f-9abe-44f4-a207-9b8a2f858e94 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/os-volume_attachments/aa246a1d-91cf-4200-ae47-6ca885d6f74b" status: 202 len: 0 microversion: 2.20 time: 0.253965 Sep 10 21:16:22.608423 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2928/5731] 10.222.0.33 () {60 vars in 1457 bytes} [Sat Sep 10 21:16:22 2022] DELETE /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/os-volume_attachments/aa246a1d-91cf-4200-ae47-6ca885d6f74b => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:16:22.651071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38031b30-fc9c-4a49-97d4-27fbbf08728d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:22.651681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38031b30-fc9c-4a49-97d4-27fbbf08728d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:22.660479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38031b30-fc9c-4a49-97d4-27fbbf08728d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:22.661063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38031b30-fc9c-4a49-97d4-27fbbf08728d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:22.661508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38031b30-fc9c-4a49-97d4-27fbbf08728d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:22.662235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38031b30-fc9c-4a49-97d4-27fbbf08728d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:22.662687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38031b30-fc9c-4a49-97d4-27fbbf08728d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:22.663452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38031b30-fc9c-4a49-97d4-27fbbf08728d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:22.685563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0217e1c0-b3aa-40ab-862c-a0681e843bc1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:22.686294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0217e1c0-b3aa-40ab-862c-a0681e843bc1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:22.692450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0217e1c0-b3aa-40ab-862c-a0681e843bc1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:22.693025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0217e1c0-b3aa-40ab-862c-a0681e843bc1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:22.693537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0217e1c0-b3aa-40ab-862c-a0681e843bc1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:22.694377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0217e1c0-b3aa-40ab-862c-a0681e843bc1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:22.695048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0217e1c0-b3aa-40ab-862c-a0681e843bc1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:22.695725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0217e1c0-b3aa-40ab-862c-a0681e843bc1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:22.728984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0217e1c0-b3aa-40ab-862c-a0681e843bc1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=145772) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 21:16:22.764219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:22.818920 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0217e1c0-b3aa-40ab-862c-a0681e843bc1 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "POST /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/action" status: 202 len: 0 microversion: 2.20 time: 0.136539 Sep 10 21:16:22.823227 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2929/5732] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 21:16:22 2022] POST /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:16:22.831447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-efd4d200-012d-4cf1-97dc-f3c635de7e62 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:22.832407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-efd4d200-012d-4cf1-97dc-f3c635de7e62 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:22.843465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd4d200-012d-4cf1-97dc-f3c635de7e62 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:22.844728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd4d200-012d-4cf1-97dc-f3c635de7e62 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:22.846049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd4d200-012d-4cf1-97dc-f3c635de7e62 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:22.847439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd4d200-012d-4cf1-97dc-f3c635de7e62 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:22.850192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd4d200-012d-4cf1-97dc-f3c635de7e62 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:22.850981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd4d200-012d-4cf1-97dc-f3c635de7e62 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:22.852534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38031b30-fc9c-4a49-97d4-27fbbf08728d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:22.862259 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38031b30-fc9c-4a49-97d4-27fbbf08728d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.215626 Sep 10 21:16:22.863211 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2804/5733] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:22 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:22.869220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:22.869856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:22.876240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:22.876969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:22.877578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:22.878572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:22.879348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:22.880497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:23.071457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:23.080905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:23.082423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:23.083789 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-71467528-b6e7-4634-b006-ceaba1777ffb tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1672 microversion: 2.20 time: 0.219432 Sep 10 21:16:23.084534 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2805/5734] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:22 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1672 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:23.194472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-efd4d200-012d-4cf1-97dc-f3c635de7e62 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:23.216450 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-efd4d200-012d-4cf1-97dc-f3c635de7e62 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.391373 Sep 10 21:16:23.226066 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2930/5735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:22 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:23.890723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a040541a-d723-494b-b157-235c9858f544 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:23.891341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a040541a-d723-494b-b157-235c9858f544 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:23.898495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a040541a-d723-494b-b157-235c9858f544 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:23.899971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a040541a-d723-494b-b157-235c9858f544 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:23.900529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a040541a-d723-494b-b157-235c9858f544 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:23.901242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a040541a-d723-494b-b157-235c9858f544 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:23.901893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a040541a-d723-494b-b157-235c9858f544 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:23.902338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a040541a-d723-494b-b157-235c9858f544 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:24.059859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a040541a-d723-494b-b157-235c9858f544 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:24.068128 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a040541a-d723-494b-b157-235c9858f544 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1506 microversion: 2.1 time: 0.181128 Sep 10 21:16:24.068693 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2806/5736] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:23 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:24.110448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:24.111060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:24.118529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:24.119026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:24.119465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:24.120166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:24.120625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:24.121053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:24.240591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-50dce089-4e05-40c0-aa1a-4d8279f4d359 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:24.241324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-50dce089-4e05-40c0-aa1a-4d8279f4d359 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:24.248485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50dce089-4e05-40c0-aa1a-4d8279f4d359 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:24.248986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50dce089-4e05-40c0-aa1a-4d8279f4d359 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:24.249432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50dce089-4e05-40c0-aa1a-4d8279f4d359 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:24.250163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50dce089-4e05-40c0-aa1a-4d8279f4d359 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:24.250632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50dce089-4e05-40c0-aa1a-4d8279f4d359 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:24.251067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50dce089-4e05-40c0-aa1a-4d8279f4d359 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:24.307449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:24.317301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:24.319032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:24.320421 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-32dbe046-60bb-44a6-a297-9585732a6450 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.214288 Sep 10 21:16:24.321205 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2931/5737] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:24 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:24.466979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-50dce089-4e05-40c0-aa1a-4d8279f4d359 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:24.474915 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-50dce089-4e05-40c0-aa1a-4d8279f4d359 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.238177 Sep 10 21:16:24.491035 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2807/5738] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:24 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:25.093292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7101361c-b0de-4ffe-b8c7-99e095e6a6e1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:25.094048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7101361c-b0de-4ffe-b8c7-99e095e6a6e1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:25.100289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7101361c-b0de-4ffe-b8c7-99e095e6a6e1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:25.100854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7101361c-b0de-4ffe-b8c7-99e095e6a6e1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:25.101513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7101361c-b0de-4ffe-b8c7-99e095e6a6e1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:25.103023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7101361c-b0de-4ffe-b8c7-99e095e6a6e1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:25.103573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7101361c-b0de-4ffe-b8c7-99e095e6a6e1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:25.104214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7101361c-b0de-4ffe-b8c7-99e095e6a6e1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:25.254246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7101361c-b0de-4ffe-b8c7-99e095e6a6e1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:25.266363 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7101361c-b0de-4ffe-b8c7-99e095e6a6e1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1506 microversion: 2.1 time: 0.177681 Sep 10 21:16:25.267222 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2932/5739] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:25 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:25.348046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:25.348713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:25.357002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:25.357556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:25.358513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:25.359295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:25.359973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:25.363703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:25.503943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ffbe918-414e-4e50-b721-51c300cfac03 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:25.504572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ffbe918-414e-4e50-b721-51c300cfac03 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:25.523648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ffbe918-414e-4e50-b721-51c300cfac03 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:25.524977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ffbe918-414e-4e50-b721-51c300cfac03 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:25.525726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:25.526456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ffbe918-414e-4e50-b721-51c300cfac03 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:25.528425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ffbe918-414e-4e50-b721-51c300cfac03 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:25.530319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ffbe918-414e-4e50-b721-51c300cfac03 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:25.530931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ffbe918-414e-4e50-b721-51c300cfac03 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:25.543490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:25.548370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:25.550874 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2e4a8cba-5a78-4511-99cb-d1eed2d11865 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.207645 Sep 10 21:16:25.566054 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2808/5740] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:25 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:25.759609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5ffbe918-414e-4e50-b721-51c300cfac03 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:25.770596 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ffbe918-414e-4e50-b721-51c300cfac03 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.273522 Sep 10 21:16:25.771721 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2933/5741] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:25 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:26.293853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e8845c11-6106-45b5-a74b-f9245f9062fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:26.296152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e8845c11-6106-45b5-a74b-f9245f9062fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:26.308038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8845c11-6106-45b5-a74b-f9245f9062fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:26.308880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8845c11-6106-45b5-a74b-f9245f9062fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:26.309521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8845c11-6106-45b5-a74b-f9245f9062fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:26.310964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8845c11-6106-45b5-a74b-f9245f9062fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:26.311698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8845c11-6106-45b5-a74b-f9245f9062fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:26.312422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e8845c11-6106-45b5-a74b-f9245f9062fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:26.585482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:26.588300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:26.603393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:26.606489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:26.607456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:26.608589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:26.610664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:26.611311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:26.750389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e8845c11-6106-45b5-a74b-f9245f9062fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:26.763987 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e8845c11-6106-45b5-a74b-f9245f9062fe tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 200 len: 1509 microversion: 2.1 time: 0.477007 Sep 10 21:16:26.767537 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2809/5742] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:26 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 1509 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:26.798948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-60560da3-a169-4f5b-b123-6f53942e30cc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:26.799985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-60560da3-a169-4f5b-b123-6f53942e30cc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:26.815341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60560da3-a169-4f5b-b123-6f53942e30cc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:26.816102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60560da3-a169-4f5b-b123-6f53942e30cc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:26.818278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60560da3-a169-4f5b-b123-6f53942e30cc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:26.819303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60560da3-a169-4f5b-b123-6f53942e30cc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:26.822171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60560da3-a169-4f5b-b123-6f53942e30cc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:26.823203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60560da3-a169-4f5b-b123-6f53942e30cc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:27.007790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:27.018717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:27.025402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:27.028553 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2bca4dd9-bd34-4180-ad20-7f58637fc490 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.447803 Sep 10 21:16:27.043595 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2934/5743] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:26 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:27.053576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21d3e537-442d-40e9-a46c-7a3e870d9126 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:27.062372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21d3e537-442d-40e9-a46c-7a3e870d9126 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:27.079536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:27.082866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d3e537-442d-40e9-a46c-7a3e870d9126 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:27.086633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d3e537-442d-40e9-a46c-7a3e870d9126 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:27.087726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d3e537-442d-40e9-a46c-7a3e870d9126 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:27.088711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d3e537-442d-40e9-a46c-7a3e870d9126 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:27.092033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d3e537-442d-40e9-a46c-7a3e870d9126 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:27.092909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21d3e537-442d-40e9-a46c-7a3e870d9126 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:27.165510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-60560da3-a169-4f5b-b123-6f53942e30cc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:27.175556 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-60560da3-a169-4f5b-b123-6f53942e30cc tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.386034 Sep 10 21:16:27.179126 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2810/5744] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:26 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:27.223573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3490e64-3c8f-4bd5-859a-f48fe9f385c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:27.225054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e3490e64-3c8f-4bd5-859a-f48fe9f385c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:27.235184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3490e64-3c8f-4bd5-859a-f48fe9f385c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:27.236401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3490e64-3c8f-4bd5-859a-f48fe9f385c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:27.237320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3490e64-3c8f-4bd5-859a-f48fe9f385c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:27.254515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3490e64-3c8f-4bd5-859a-f48fe9f385c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:27.256799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3490e64-3c8f-4bd5-859a-f48fe9f385c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:27.257851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3490e64-3c8f-4bd5-859a-f48fe9f385c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:27.433647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-21d3e537-442d-40e9-a46c-7a3e870d9126 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:27.442000 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21d3e537-442d-40e9-a46c-7a3e870d9126 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.393756 Sep 10 21:16:27.447170 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2935/5745] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:27 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:27.537287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e3490e64-3c8f-4bd5-859a-f48fe9f385c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:27.550622 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3490e64-3c8f-4bd5-859a-f48fe9f385c8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.332420 Sep 10 21:16:27.553938 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2811/5746] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:27 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:27.579844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e94e250-bf58-4012-bb1e-1ce6fb6d953f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:27.581126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e94e250-bf58-4012-bb1e-1ce6fb6d953f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:27.588901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e94e250-bf58-4012-bb1e-1ce6fb6d953f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:27.590242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e94e250-bf58-4012-bb1e-1ce6fb6d953f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:27.590940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e94e250-bf58-4012-bb1e-1ce6fb6d953f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:27.591904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e94e250-bf58-4012-bb1e-1ce6fb6d953f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:27.592527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e94e250-bf58-4012-bb1e-1ce6fb6d953f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:27.593118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e94e250-bf58-4012-bb1e-1ce6fb6d953f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:27.623383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c9ce3ea4-34a9-4e43-8e05-764cd09a3dfe req-cc2d541d-bff6-4c17-aa14-2bc788992c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab021c5-f772-432f-8147-3b7f70eeae59", "name": "network-vif-unplugged", "status": "completed", "tag": "b471905b-b736-4e3b-9546-4c0558cb7edf"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:27.650827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c9ce3ea4-34a9-4e43-8e05-764cd09a3dfe req-cc2d541d-bff6-4c17-aa14-2bc788992c09 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:27.651323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c9ce3ea4-34a9-4e43-8e05-764cd09a3dfe req-cc2d541d-bff6-4c17-aa14-2bc788992c09 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:27.651949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c9ce3ea4-34a9-4e43-8e05-764cd09a3dfe req-cc2d541d-bff6-4c17-aa14-2bc788992c09 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:27.690612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.compute.server_external_events [req-c9ce3ea4-34a9-4e43-8e05-764cd09a3dfe req-cc2d541d-bff6-4c17-aa14-2bc788992c09 service nova] Unable to find a host for instance 9ab021c5-f772-432f-8147-3b7f70eeae59. Dropping event network-vif-unplugged {{(pid=145771) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 21:16:27.692187 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c9ce3ea4-34a9-4e43-8e05-764cd09a3dfe req-cc2d541d-bff6-4c17-aa14-2bc788992c09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.072955 Sep 10 21:16:27.693673 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2812/5747] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 21:16:28.055745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:28.057264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:28.069586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:28.071818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:28.072546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:28.074248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:28.076432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:28.077139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:28.271791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1e94e250-bf58-4012-bb1e-1ce6fb6d953f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:28.282377 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e94e250-bf58-4012-bb1e-1ce6fb6d953f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.706489 Sep 10 21:16:28.282971 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2936/5748] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:27 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:28.308067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:28.310163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3238064-c9a8-4dfe-85e8-8f6e1f80864e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:28.314471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3238064-c9a8-4dfe-85e8-8f6e1f80864e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:28.328193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3238064-c9a8-4dfe-85e8-8f6e1f80864e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:28.328865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:28.329689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3238064-c9a8-4dfe-85e8-8f6e1f80864e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:28.332027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3238064-c9a8-4dfe-85e8-8f6e1f80864e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:28.333467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:28.334605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3238064-c9a8-4dfe-85e8-8f6e1f80864e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:28.336932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3238064-c9a8-4dfe-85e8-8f6e1f80864e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:28.337564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3238064-c9a8-4dfe-85e8-8f6e1f80864e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:28.340377 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4d43b70f-dc06-450d-9a55-cf43d1e36b27 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.288586 Sep 10 21:16:28.342117 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2813/5749] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:28 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:28.481158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d4addbee-5f80-427f-ab84-dbd02b322e8c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:28.481980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4addbee-5f80-427f-ab84-dbd02b322e8c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:28.495551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4addbee-5f80-427f-ab84-dbd02b322e8c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:28.498867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4addbee-5f80-427f-ab84-dbd02b322e8c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:28.499487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4addbee-5f80-427f-ab84-dbd02b322e8c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:28.501010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4addbee-5f80-427f-ab84-dbd02b322e8c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:28.503729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4addbee-5f80-427f-ab84-dbd02b322e8c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:28.504644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4addbee-5f80-427f-ab84-dbd02b322e8c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:28.780117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d4addbee-5f80-427f-ab84-dbd02b322e8c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:28.793859 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d4addbee-5f80-427f-ab84-dbd02b322e8c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.317540 Sep 10 21:16:28.794465 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2814/5750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:28 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:29.027810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f3238064-c9a8-4dfe-85e8-8f6e1f80864e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:29.040438 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3238064-c9a8-4dfe-85e8-8f6e1f80864e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.738443 Sep 10 21:16:29.041746 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2937/5751] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:28 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:29.065285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-507f6749-b63c-4333-823c-fa19b71dfd71 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:29.074379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-507f6749-b63c-4333-823c-fa19b71dfd71 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:29.075420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-507f6749-b63c-4333-823c-fa19b71dfd71 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:29.076114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-507f6749-b63c-4333-823c-fa19b71dfd71 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:29.105040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-507f6749-b63c-4333-823c-fa19b71dfd71 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Going to try to stop instance {{(pid=145771) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 21:16:29.184088 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-507f6749-b63c-4333-823c-fa19b71dfd71 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.122488 Sep 10 21:16:29.193441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2cc9a238-2280-4181-add9-9d548485fe5b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:29.194545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2cc9a238-2280-4181-add9-9d548485fe5b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:29.197619 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2815/5752] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:16:29 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:16:29.203139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc9a238-2280-4181-add9-9d548485fe5b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:29.203722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc9a238-2280-4181-add9-9d548485fe5b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:29.205877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc9a238-2280-4181-add9-9d548485fe5b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:29.205877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc9a238-2280-4181-add9-9d548485fe5b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:29.205877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc9a238-2280-4181-add9-9d548485fe5b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:29.206162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2cc9a238-2280-4181-add9-9d548485fe5b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:29.372516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:29.391734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:29.397026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:29.397651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:29.398256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:29.399215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:29.399960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:29.400500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:29.562901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2cc9a238-2280-4181-add9-9d548485fe5b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:29.584260 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2cc9a238-2280-4181-add9-9d548485fe5b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.394707 Sep 10 21:16:29.585710 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2938/5753] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:29 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:29.612568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:29.627256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:29.629246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:29.631164 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a371105e-e944-4721-99ab-b2ba167ccd7b tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.263853 Sep 10 21:16:29.631850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2816/5754] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:29 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:29.821853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b1925431-bd06-4bd7-8d72-7b8763a04202 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:29.823056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b1925431-bd06-4bd7-8d72-7b8763a04202 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:29.832664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1925431-bd06-4bd7-8d72-7b8763a04202 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:29.833584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1925431-bd06-4bd7-8d72-7b8763a04202 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:29.834378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1925431-bd06-4bd7-8d72-7b8763a04202 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:29.835331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1925431-bd06-4bd7-8d72-7b8763a04202 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:29.835799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1925431-bd06-4bd7-8d72-7b8763a04202 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:29.836781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1925431-bd06-4bd7-8d72-7b8763a04202 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:30.109557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1925431-bd06-4bd7-8d72-7b8763a04202 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:30.118265 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b1925431-bd06-4bd7-8d72-7b8763a04202 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.301352 Sep 10 21:16:30.122495 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2939/5755] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:29 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:30.616085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f49eaf35-5958-4e5b-8dae-f8a16c0e746a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:30.617209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f49eaf35-5958-4e5b-8dae-f8a16c0e746a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:30.626689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49eaf35-5958-4e5b-8dae-f8a16c0e746a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:30.627182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49eaf35-5958-4e5b-8dae-f8a16c0e746a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:30.627621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49eaf35-5958-4e5b-8dae-f8a16c0e746a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:30.628342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49eaf35-5958-4e5b-8dae-f8a16c0e746a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:30.628787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49eaf35-5958-4e5b-8dae-f8a16c0e746a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:30.629211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f49eaf35-5958-4e5b-8dae-f8a16c0e746a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:30.658609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:30.659469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:30.667526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:30.668196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:30.669727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:30.670494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:30.670957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:30.671392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:30.839291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f49eaf35-5958-4e5b-8dae-f8a16c0e746a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:30.848938 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f49eaf35-5958-4e5b-8dae-f8a16c0e746a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.237627 Sep 10 21:16:30.853719 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2817/5756] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:30 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:30.901986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:30.919425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:30.921547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:30.923065 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ce62894-c98b-4465-825b-5174abd42e88 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.268739 Sep 10 21:16:30.924184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2940/5757] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:30 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:31.144018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3dc8e56-5ae0-4fcd-83e0-513536c22152 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:31.144728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b3dc8e56-5ae0-4fcd-83e0-513536c22152 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:31.152458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3dc8e56-5ae0-4fcd-83e0-513536c22152 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:31.153206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3dc8e56-5ae0-4fcd-83e0-513536c22152 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:31.153814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3dc8e56-5ae0-4fcd-83e0-513536c22152 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:31.154722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3dc8e56-5ae0-4fcd-83e0-513536c22152 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:31.155303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3dc8e56-5ae0-4fcd-83e0-513536c22152 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:31.156298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3dc8e56-5ae0-4fcd-83e0-513536c22152 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:31.376218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b3dc8e56-5ae0-4fcd-83e0-513536c22152 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:31.386117 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b3dc8e56-5ae0-4fcd-83e0-513536c22152 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.246389 Sep 10 21:16:31.393001 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2818/5758] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:31 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:31.886836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-13d323dd-2b75-4514-8b89-ca38f0866b6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:31.887451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-13d323dd-2b75-4514-8b89-ca38f0866b6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:31.894317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13d323dd-2b75-4514-8b89-ca38f0866b6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:31.894810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13d323dd-2b75-4514-8b89-ca38f0866b6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:31.895247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13d323dd-2b75-4514-8b89-ca38f0866b6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:31.896166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13d323dd-2b75-4514-8b89-ca38f0866b6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:31.896632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13d323dd-2b75-4514-8b89-ca38f0866b6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:31.897062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13d323dd-2b75-4514-8b89-ca38f0866b6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:31.953413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:31.955047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:31.971589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:31.974260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:31.977138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:31.980805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:31.985442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:31.986398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:32.061397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13d323dd-2b75-4514-8b89-ca38f0866b6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:32.084967 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-13d323dd-2b75-4514-8b89-ca38f0866b6d tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.202316 Sep 10 21:16:32.101442 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2941/5759] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:31 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:32.231298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:32.235584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:32.251818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:32.253536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:32.254831 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9a84d443-3ab4-45d3-a93f-00b98a556819 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.310045 Sep 10 21:16:32.255432 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2819/5760] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:31 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:32.412042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62f4a7a9-9c03-44eb-af32-f5e884ed25cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:32.412762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-62f4a7a9-9c03-44eb-af32-f5e884ed25cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:32.425500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f4a7a9-9c03-44eb-af32-f5e884ed25cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:32.426171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f4a7a9-9c03-44eb-af32-f5e884ed25cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:32.426684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f4a7a9-9c03-44eb-af32-f5e884ed25cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:32.427466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f4a7a9-9c03-44eb-af32-f5e884ed25cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:32.428024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f4a7a9-9c03-44eb-af32-f5e884ed25cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:32.432522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-62f4a7a9-9c03-44eb-af32-f5e884ed25cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:32.615676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-62f4a7a9-9c03-44eb-af32-f5e884ed25cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:32.625281 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-62f4a7a9-9c03-44eb-af32-f5e884ed25cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.217392 Sep 10 21:16:32.626177 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2942/5761] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:32 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:33.125616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70c1f3b2-5e94-4ee2-8c12-22967a447baa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:33.127163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-70c1f3b2-5e94-4ee2-8c12-22967a447baa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:33.136610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70c1f3b2-5e94-4ee2-8c12-22967a447baa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:33.137429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70c1f3b2-5e94-4ee2-8c12-22967a447baa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:33.138065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70c1f3b2-5e94-4ee2-8c12-22967a447baa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:33.138994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70c1f3b2-5e94-4ee2-8c12-22967a447baa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:33.139612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70c1f3b2-5e94-4ee2-8c12-22967a447baa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:33.140218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70c1f3b2-5e94-4ee2-8c12-22967a447baa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:33.281432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:33.282167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:33.295451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:33.296484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:33.302104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:33.303749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:33.304328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:33.305030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:33.401500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-70c1f3b2-5e94-4ee2-8c12-22967a447baa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:33.418333 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-70c1f3b2-5e94-4ee2-8c12-22967a447baa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.297016 Sep 10 21:16:33.423449 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2820/5762] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:33 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:33.514406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:33.523092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:33.525280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:33.526788 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-84f5c324-cf68-4315-a9ba-7afb78d79e2a tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.249503 Sep 10 21:16:33.527478 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2943/5763] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:33 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:33.655970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66b5582d-8892-4a6c-8d62-aa86400e4b32 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:33.656701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-66b5582d-8892-4a6c-8d62-aa86400e4b32 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:33.662865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66b5582d-8892-4a6c-8d62-aa86400e4b32 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:33.663348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66b5582d-8892-4a6c-8d62-aa86400e4b32 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:33.663784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66b5582d-8892-4a6c-8d62-aa86400e4b32 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:33.665284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66b5582d-8892-4a6c-8d62-aa86400e4b32 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:33.665948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66b5582d-8892-4a6c-8d62-aa86400e4b32 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:33.666411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66b5582d-8892-4a6c-8d62-aa86400e4b32 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:33.805080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-66b5582d-8892-4a6c-8d62-aa86400e4b32 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:33.813001 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-66b5582d-8892-4a6c-8d62-aa86400e4b32 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.161124 Sep 10 21:16:33.813570 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2821/5764] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:33 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:34.443553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d8b4a561-9fa4-456a-9e44-1449af30f734 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:34.444202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d8b4a561-9fa4-456a-9e44-1449af30f734 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:34.451988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b4a561-9fa4-456a-9e44-1449af30f734 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:34.452477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b4a561-9fa4-456a-9e44-1449af30f734 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:34.452913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b4a561-9fa4-456a-9e44-1449af30f734 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:34.453608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b4a561-9fa4-456a-9e44-1449af30f734 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:34.454090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b4a561-9fa4-456a-9e44-1449af30f734 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:34.454519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d8b4a561-9fa4-456a-9e44-1449af30f734 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:34.562117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:34.563413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:34.577914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:34.578819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:34.579306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:34.580028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:34.580482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:34.580912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:34.618824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d8b4a561-9fa4-456a-9e44-1449af30f734 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:34.630590 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d8b4a561-9fa4-456a-9e44-1449af30f734 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.190972 Sep 10 21:16:34.631902 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2944/5765] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:34 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:34.769886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:34.778457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:34.779999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:34.792573 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a7938e18-1816-4c44-9c97-25060a95a1b8 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.227264 Sep 10 21:16:34.793472 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2822/5766] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:34 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:34.835681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c0d1efb8-1c09-4303-9a87-bbbaad9b53bc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:34.836595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c0d1efb8-1c09-4303-9a87-bbbaad9b53bc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:34.842780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0d1efb8-1c09-4303-9a87-bbbaad9b53bc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:34.843389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0d1efb8-1c09-4303-9a87-bbbaad9b53bc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:34.843801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0d1efb8-1c09-4303-9a87-bbbaad9b53bc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:34.844839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0d1efb8-1c09-4303-9a87-bbbaad9b53bc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:34.845376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0d1efb8-1c09-4303-9a87-bbbaad9b53bc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:34.845946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0d1efb8-1c09-4303-9a87-bbbaad9b53bc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:34.989189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c0d1efb8-1c09-4303-9a87-bbbaad9b53bc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:34.991454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:34.999374 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c0d1efb8-1c09-4303-9a87-bbbaad9b53bc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1504 microversion: 2.1 time: 0.167800 Sep 10 21:16:34.999946 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2945/5767] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:34 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:35.660122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-05813ccc-97f6-4c9e-8f69-6ac24c43199c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:35.660641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-05813ccc-97f6-4c9e-8f69-6ac24c43199c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:35.668243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05813ccc-97f6-4c9e-8f69-6ac24c43199c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:35.668766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05813ccc-97f6-4c9e-8f69-6ac24c43199c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:35.669204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05813ccc-97f6-4c9e-8f69-6ac24c43199c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:35.669933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05813ccc-97f6-4c9e-8f69-6ac24c43199c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:35.670423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05813ccc-97f6-4c9e-8f69-6ac24c43199c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:35.670855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-05813ccc-97f6-4c9e-8f69-6ac24c43199c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:35.804133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-05813ccc-97f6-4c9e-8f69-6ac24c43199c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:35.812401 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-05813ccc-97f6-4c9e-8f69-6ac24c43199c tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.156483 Sep 10 21:16:35.813105 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2823/5768] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:35 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:35.825785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:35.826636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:35.835059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:35.835721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:35.836914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:35.837786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:35.838297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:35.838735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:35.979271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:35.987991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:35.989461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:35.990665 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c623bf64-2dc4-4dc3-ad08-ece357468ef7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.174896 Sep 10 21:16:35.991232 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2946/5769] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:35 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:36.023081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8832a3d-de12-478d-9ed3-f20cb8a5ac22 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:36.024015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8832a3d-de12-478d-9ed3-f20cb8a5ac22 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:36.031583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8832a3d-de12-478d-9ed3-f20cb8a5ac22 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:36.032424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8832a3d-de12-478d-9ed3-f20cb8a5ac22 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:36.032881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8832a3d-de12-478d-9ed3-f20cb8a5ac22 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:36.033605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8832a3d-de12-478d-9ed3-f20cb8a5ac22 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:36.034109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8832a3d-de12-478d-9ed3-f20cb8a5ac22 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:36.034569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8832a3d-de12-478d-9ed3-f20cb8a5ac22 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:36.182498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8832a3d-de12-478d-9ed3-f20cb8a5ac22 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:36.190972 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8832a3d-de12-478d-9ed3-f20cb8a5ac22 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1484 microversion: 2.1 time: 0.172009 Sep 10 21:16:36.191649 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2824/5770] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:36 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1484 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:36.307066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-737174066", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:36.360911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] validate_networks() for [('49e92ac3-121f-424b-833e-e4483ee1e637', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:16:36.738635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:16:36.739099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:16:36.739660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:16:36.740079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:16:36.740493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:16:36.749513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:36.750038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:36.750471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:36.751199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:36.751653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:36.752072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:36.768638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Getting quotas for project 3d9f98a3f93d409a94ee87eec97206c1. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:16:36.774461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Getting quotas for user eac0a8d66da042e096cab5c715f40a27 and project 3d9f98a3f93d409a94ee87eec97206c1. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:16:36.786494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:16:36.788775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:16:36.839997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c5aacab-730a-4351-890d-90629c17732f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:36.841221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4c5aacab-730a-4351-890d-90629c17732f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:36.848596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c5aacab-730a-4351-890d-90629c17732f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:36.849369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c5aacab-730a-4351-890d-90629c17732f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:36.850113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c5aacab-730a-4351-890d-90629c17732f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:36.851050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c5aacab-730a-4351-890d-90629c17732f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:36.852300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c5aacab-730a-4351-890d-90629c17732f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:36.852991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c5aacab-730a-4351-890d-90629c17732f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:36.859365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e09fb08-722b-4d56-ae8e-01a75b4b7cb2 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.556921 Sep 10 21:16:36.860056 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2947/5771] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:16:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:16:36.873602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-564396ed-baad-4b52-b694-ea91942e5d71 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:36.874562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-564396ed-baad-4b52-b694-ea91942e5d71 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:36.936599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-564396ed-baad-4b52-b694-ea91942e5d71 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:36.944536 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-564396ed-baad-4b52-b694-ea91942e5d71 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1213 microversion: 2.1 time: 0.075100 Sep 10 21:16:36.945805 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2948/5772] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:36 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:37.017889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:37.019206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:37.026991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:37.027478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:37.028446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:37.029064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:37.029511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:37.030072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:37.095277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4c5aacab-730a-4351-890d-90629c17732f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:37.104884 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c5aacab-730a-4351-890d-90629c17732f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.269930 Sep 10 21:16:37.119306 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2825/5773] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:36 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:37.188248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:37.198736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:37.200685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:37.203031 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f7daf623-16e1-493a-8876-7ff65a06c1fe tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.189095 Sep 10 21:16:37.203605 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2949/5774] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:37 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:37.967797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8ede2425-d9c5-4185-9a9b-f57e70e129a1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:37.968484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8ede2425-d9c5-4185-9a9b-f57e70e129a1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:37.981970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ede2425-d9c5-4185-9a9b-f57e70e129a1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:37.982519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ede2425-d9c5-4185-9a9b-f57e70e129a1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:37.982968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ede2425-d9c5-4185-9a9b-f57e70e129a1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:37.983688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ede2425-d9c5-4185-9a9b-f57e70e129a1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:37.984149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ede2425-d9c5-4185-9a9b-f57e70e129a1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:37.984576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8ede2425-d9c5-4185-9a9b-f57e70e129a1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:38.075931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8ede2425-d9c5-4185-9a9b-f57e70e129a1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:38.085052 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8ede2425-d9c5-4185-9a9b-f57e70e129a1 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1265 microversion: 2.1 time: 0.121250 Sep 10 21:16:38.085655 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2826/5775] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:37 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1265 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:38.131059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5d2a353-7c3c-4787-8bac-2a5e7f3752f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:38.132412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5d2a353-7c3c-4787-8bac-2a5e7f3752f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:38.141913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d2a353-7c3c-4787-8bac-2a5e7f3752f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:38.142695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d2a353-7c3c-4787-8bac-2a5e7f3752f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:38.143337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d2a353-7c3c-4787-8bac-2a5e7f3752f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:38.144219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d2a353-7c3c-4787-8bac-2a5e7f3752f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:38.144992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d2a353-7c3c-4787-8bac-2a5e7f3752f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:38.145499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5d2a353-7c3c-4787-8bac-2a5e7f3752f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:38.229063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:38.229997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:38.238488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:38.239239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:38.239840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:38.240708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:38.241323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:38.241942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:38.333686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a5d2a353-7c3c-4787-8bac-2a5e7f3752f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:38.345471 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5d2a353-7c3c-4787-8bac-2a5e7f3752f5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.218682 Sep 10 21:16:38.360630 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2950/5776] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:38 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:38.542047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:38.551436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:38.553266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:38.554847 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f3c3a432-a108-4a8e-b67f-268e219d0851 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.330101 Sep 10 21:16:38.556006 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2827/5777] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:38 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:39.135360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-77544cca-9398-41a3-8ea1-32a568af2d53 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:39.151053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-77544cca-9398-41a3-8ea1-32a568af2d53 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:39.168461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77544cca-9398-41a3-8ea1-32a568af2d53 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:39.170555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77544cca-9398-41a3-8ea1-32a568af2d53 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:39.171029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77544cca-9398-41a3-8ea1-32a568af2d53 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:39.172567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77544cca-9398-41a3-8ea1-32a568af2d53 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:39.173383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77544cca-9398-41a3-8ea1-32a568af2d53 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:39.173863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-77544cca-9398-41a3-8ea1-32a568af2d53 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:39.372769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1a5357dc-5ee6-4b15-8de6-9a26bfb6f89a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:39.373501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1a5357dc-5ee6-4b15-8de6-9a26bfb6f89a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:39.384491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a5357dc-5ee6-4b15-8de6-9a26bfb6f89a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:39.386710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a5357dc-5ee6-4b15-8de6-9a26bfb6f89a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:39.387377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a5357dc-5ee6-4b15-8de6-9a26bfb6f89a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:39.388333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a5357dc-5ee6-4b15-8de6-9a26bfb6f89a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:39.389007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a5357dc-5ee6-4b15-8de6-9a26bfb6f89a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:39.389661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1a5357dc-5ee6-4b15-8de6-9a26bfb6f89a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:39.471728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-77544cca-9398-41a3-8ea1-32a568af2d53 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:39.480983 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-77544cca-9398-41a3-8ea1-32a568af2d53 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1313 microversion: 2.1 time: 0.374136 Sep 10 21:16:39.481585 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2951/5778] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:39 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:39.486708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0b72117d-980e-4b07-baf2-52ccd136f2cf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:39.489270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0b72117d-980e-4b07-baf2-52ccd136f2cf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:39.498967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b72117d-980e-4b07-baf2-52ccd136f2cf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:39.499563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b72117d-980e-4b07-baf2-52ccd136f2cf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:39.500078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b72117d-980e-4b07-baf2-52ccd136f2cf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:39.500905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b72117d-980e-4b07-baf2-52ccd136f2cf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:39.501413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b72117d-980e-4b07-baf2-52ccd136f2cf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:39.501947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0b72117d-980e-4b07-baf2-52ccd136f2cf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:39.575930 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0b72117d-980e-4b07-baf2-52ccd136f2cf tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "POST /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc/action" status: 200 len: 24563 microversion: 2.1 time: 0.092866 Sep 10 21:16:39.576944 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2952/5779] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:16:39 2022] POST /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc/action => generated 24563 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:16:39.583375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:39.585513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:39.609776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:39.613477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:39.614204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:39.615177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:39.617694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:39.620575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:39.792690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1a5357dc-5ee6-4b15-8de6-9a26bfb6f89a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:39.815027 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1a5357dc-5ee6-4b15-8de6-9a26bfb6f89a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.446065 Sep 10 21:16:39.820460 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2828/5780] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:39 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:39.826542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a04821bd-4395-4653-97e1-fcd1f348f46d req-3ba424c2-077d-447a-9ffd-3cd4c4599fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26", "name": "network-vif-plugged", "status": "completed", "tag": "0c8d8555-28a1-427f-b57c-affbeeda6daf"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:39.845948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a04821bd-4395-4653-97e1-fcd1f348f46d req-3ba424c2-077d-447a-9ffd-3cd4c4599fac service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:39.846733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a04821bd-4395-4653-97e1-fcd1f348f46d req-3ba424c2-077d-447a-9ffd-3cd4c4599fac service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:39.847627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a04821bd-4395-4653-97e1-fcd1f348f46d req-3ba424c2-077d-447a-9ffd-3cd4c4599fac service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:39.866019 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a04821bd-4395-4653-97e1-fcd1f348f46d req-3ba424c2-077d-447a-9ffd-3cd4c4599fac service nova] Creating event network-vif-plugged:0c8d8555-28a1-427f-b57c-affbeeda6daf for instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 on nch2-master-1 Sep 10 21:16:39.884975 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a04821bd-4395-4653-97e1-fcd1f348f46d req-3ba424c2-077d-447a-9ffd-3cd4c4599fac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062659 Sep 10 21:16:39.885721 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2829/5781] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:16:40.056485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:40.077552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:40.079746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:40.081334 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7bda2f04-a876-4c9d-bcfc-c4f28f82f13e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.502850 Sep 10 21:16:40.082205 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2953/5782] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:39 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:16:40.505403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a2537d49-8f96-4459-a8d4-c53898aaa849 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:40.506229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a2537d49-8f96-4459-a8d4-c53898aaa849 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:40.520236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2537d49-8f96-4459-a8d4-c53898aaa849 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:40.521844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2537d49-8f96-4459-a8d4-c53898aaa849 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:40.522551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2537d49-8f96-4459-a8d4-c53898aaa849 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:40.524118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2537d49-8f96-4459-a8d4-c53898aaa849 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:40.524933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2537d49-8f96-4459-a8d4-c53898aaa849 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:40.525613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a2537d49-8f96-4459-a8d4-c53898aaa849 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:40.594869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d2bfd9d5-4b37-4b6a-a421-9c56037cc778 req-45f19d03-ae30-4ef0-ad99-fe774f0d00cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42984cfc-7066-4626-b537-5916ae2e2803", "tag": "eda49759-650f-472d-84a8-b76180f33c9c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:40.609863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d2bfd9d5-4b37-4b6a-a421-9c56037cc778 req-45f19d03-ae30-4ef0-ad99-fe774f0d00cd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:40.611304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d2bfd9d5-4b37-4b6a-a421-9c56037cc778 req-45f19d03-ae30-4ef0-ad99-fe774f0d00cd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:40.612002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d2bfd9d5-4b37-4b6a-a421-9c56037cc778 req-45f19d03-ae30-4ef0-ad99-fe774f0d00cd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:40.624455 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d2bfd9d5-4b37-4b6a-a421-9c56037cc778 req-45f19d03-ae30-4ef0-ad99-fe774f0d00cd service nova] Creating event network-changed:eda49759-650f-472d-84a8-b76180f33c9c for instance 42984cfc-7066-4626-b537-5916ae2e2803 on nch2-master-1 Sep 10 21:16:40.630658 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d2bfd9d5-4b37-4b6a-a421-9c56037cc778 req-45f19d03-ae30-4ef0-ad99-fe774f0d00cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039288 Sep 10 21:16:40.631360 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2954/5783] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:16:40.847860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-efd60757-ef93-4951-bb52-3215f111f2a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:40.848581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-efd60757-ef93-4951-bb52-3215f111f2a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:40.856963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd60757-ef93-4951-bb52-3215f111f2a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:40.857753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd60757-ef93-4951-bb52-3215f111f2a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:40.858235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd60757-ef93-4951-bb52-3215f111f2a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:40.858961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd60757-ef93-4951-bb52-3215f111f2a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:40.859422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd60757-ef93-4951-bb52-3215f111f2a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:40.859852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efd60757-ef93-4951-bb52-3215f111f2a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:41.008646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-efd60757-ef93-4951-bb52-3215f111f2a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:41.017274 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-efd60757-ef93-4951-bb52-3215f111f2a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.173843 Sep 10 21:16:41.029268 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2955/5784] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:40 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:41.110878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:41.111499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:41.119225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:41.120191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:41.120658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:41.121384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:41.121876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:41.122382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:41.268943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a2537d49-8f96-4459-a8d4-c53898aaa849 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:41.280372 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a2537d49-8f96-4459-a8d4-c53898aaa849 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1313 microversion: 2.1 time: 0.779450 Sep 10 21:16:41.293707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:41.294448 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2830/5785] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:40 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:41.299025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:41.300494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:41.301868 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10c96150-8262-4547-8b88-0b1b71c263d5 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.195059 Sep 10 21:16:41.302571 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2956/5786] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:41 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:42.043330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8b7581a2-d27e-4905-b879-9a263305d408 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:42.044052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8b7581a2-d27e-4905-b879-9a263305d408 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:42.053374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b7581a2-d27e-4905-b879-9a263305d408 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:42.053902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b7581a2-d27e-4905-b879-9a263305d408 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:42.055086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b7581a2-d27e-4905-b879-9a263305d408 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:42.055986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b7581a2-d27e-4905-b879-9a263305d408 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:42.056455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b7581a2-d27e-4905-b879-9a263305d408 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:42.056891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b7581a2-d27e-4905-b879-9a263305d408 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:42.219513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8b7581a2-d27e-4905-b879-9a263305d408 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:42.235712 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8b7581a2-d27e-4905-b879-9a263305d408 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.197819 Sep 10 21:16:42.236672 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2831/5787] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:42 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:42.303637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ce0cf3c3-ccef-47ad-9474-1448b8e52994 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:42.304264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ce0cf3c3-ccef-47ad-9474-1448b8e52994 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:42.312294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce0cf3c3-ccef-47ad-9474-1448b8e52994 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:42.312985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce0cf3c3-ccef-47ad-9474-1448b8e52994 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:42.313566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce0cf3c3-ccef-47ad-9474-1448b8e52994 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:42.314489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce0cf3c3-ccef-47ad-9474-1448b8e52994 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:42.314961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce0cf3c3-ccef-47ad-9474-1448b8e52994 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:42.315407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce0cf3c3-ccef-47ad-9474-1448b8e52994 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:42.328533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:42.330059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:42.336894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:42.337865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:42.338510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:42.339228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:42.339859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:42.340293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:42.492140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:42.502434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:42.504033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:42.505368 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bef9ce04-359a-4467-9122-354abdfeb62d tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1730 microversion: 2.20 time: 0.181335 Sep 10 21:16:42.506088 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2832/5788] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:42 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:42.556579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ce0cf3c3-ccef-47ad-9474-1448b8e52994 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:42.566225 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ce0cf3c3-ccef-47ad-9474-1448b8e52994 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1313 microversion: 2.1 time: 0.266505 Sep 10 21:16:42.566866 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2957/5789] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:42 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:43.265939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-07d078e6-484e-4f98-9609-20567c7f5e3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:43.267446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-07d078e6-484e-4f98-9609-20567c7f5e3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:43.282756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07d078e6-484e-4f98-9609-20567c7f5e3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:43.283267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07d078e6-484e-4f98-9609-20567c7f5e3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:43.283783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07d078e6-484e-4f98-9609-20567c7f5e3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:43.284768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07d078e6-484e-4f98-9609-20567c7f5e3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:43.285232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07d078e6-484e-4f98-9609-20567c7f5e3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:43.285672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-07d078e6-484e-4f98-9609-20567c7f5e3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:43.460141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-07d078e6-484e-4f98-9609-20567c7f5e3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:43.468970 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-07d078e6-484e-4f98-9609-20567c7f5e3a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1680 microversion: 2.1 time: 0.212285 Sep 10 21:16:43.469819 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2833/5790] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:43 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:43.533340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:43.534341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:43.543146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:43.543870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:43.544614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:43.545505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:43.546003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:43.546434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:43.592996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-df1911c5-eaa4-40fb-9f05-0caede706470 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:43.593623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-df1911c5-eaa4-40fb-9f05-0caede706470 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:43.606891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df1911c5-eaa4-40fb-9f05-0caede706470 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:43.614277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df1911c5-eaa4-40fb-9f05-0caede706470 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:43.614965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df1911c5-eaa4-40fb-9f05-0caede706470 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:43.615866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df1911c5-eaa4-40fb-9f05-0caede706470 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:43.620088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df1911c5-eaa4-40fb-9f05-0caede706470 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:43.620552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-df1911c5-eaa4-40fb-9f05-0caede706470 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:43.769289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:43.782693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:43.785230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:43.787335 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-58c8f8c5-d960-48bc-8cf0-3e3ff7fbef3c tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1717 microversion: 2.20 time: 0.259129 Sep 10 21:16:43.788505 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2958/5791] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:16:43 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1717 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:16:43.883298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-df1911c5-eaa4-40fb-9f05-0caede706470 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:43.892598 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-df1911c5-eaa4-40fb-9f05-0caede706470 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1313 microversion: 2.1 time: 0.306755 Sep 10 21:16:43.893317 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2834/5792] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:43 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:44.494255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e858861-5733-4792-a401-f29fe0bada80 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:44.494884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e858861-5733-4792-a401-f29fe0bada80 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:44.501083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e858861-5733-4792-a401-f29fe0bada80 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:44.501526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e858861-5733-4792-a401-f29fe0bada80 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:44.502176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e858861-5733-4792-a401-f29fe0bada80 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:44.503044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e858861-5733-4792-a401-f29fe0bada80 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:44.503661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e858861-5733-4792-a401-f29fe0bada80 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:44.504279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e858861-5733-4792-a401-f29fe0bada80 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:44.764323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7e858861-5733-4792-a401-f29fe0bada80 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:44.773920 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e858861-5733-4792-a401-f29fe0bada80 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1657 microversion: 2.1 time: 0.283687 Sep 10 21:16:44.774518 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2959/5793] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:44 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1657 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:44.798153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1d5d1a8-483f-4363-8bf4-653f4fa83787 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:44.807017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1d5d1a8-483f-4363-8bf4-653f4fa83787 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:44.807512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1d5d1a8-483f-4363-8bf4-653f4fa83787 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:44.808114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1d5d1a8-483f-4363-8bf4-653f4fa83787 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:44.834424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a1d5d1a8-483f-4363-8bf4-653f4fa83787 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Going to try to start instance {{(pid=145771) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 21:16:44.890576 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a1d5d1a8-483f-4363-8bf4-653f4fa83787 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.096130 Sep 10 21:16:44.891332 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2835/5794] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:16:44 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:16:44.900387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-935eaf1c-738a-45a1-8bdd-31bd8fe57866 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:44.901018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-935eaf1c-738a-45a1-8bdd-31bd8fe57866 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:44.909478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-935eaf1c-738a-45a1-8bdd-31bd8fe57866 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:44.910338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-935eaf1c-738a-45a1-8bdd-31bd8fe57866 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:44.910990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-935eaf1c-738a-45a1-8bdd-31bd8fe57866 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:44.918720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-935eaf1c-738a-45a1-8bdd-31bd8fe57866 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:44.919523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-935eaf1c-738a-45a1-8bdd-31bd8fe57866 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:44.921558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-935eaf1c-738a-45a1-8bdd-31bd8fe57866 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:44.925098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eace4f8f-52a6-4a2a-ae7d-141be44c161d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:44.930776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eace4f8f-52a6-4a2a-ae7d-141be44c161d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:44.944057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eace4f8f-52a6-4a2a-ae7d-141be44c161d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:44.945936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eace4f8f-52a6-4a2a-ae7d-141be44c161d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:44.946581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eace4f8f-52a6-4a2a-ae7d-141be44c161d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:44.947537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eace4f8f-52a6-4a2a-ae7d-141be44c161d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:44.948247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eace4f8f-52a6-4a2a-ae7d-141be44c161d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:44.948901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eace4f8f-52a6-4a2a-ae7d-141be44c161d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:44.974482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:45.115595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-935eaf1c-738a-45a1-8bdd-31bd8fe57866 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:45.125315 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-935eaf1c-738a-45a1-8bdd-31bd8fe57866 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1666 microversion: 2.1 time: 0.229561 Sep 10 21:16:45.125965 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2960/5795] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:44 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1666 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:45.196555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eace4f8f-52a6-4a2a-ae7d-141be44c161d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:45.206099 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eace4f8f-52a6-4a2a-ae7d-141be44c161d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1313 microversion: 2.1 time: 0.292980 Sep 10 21:16:45.222750 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2836/5796] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:44 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:45.827947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f449c1a7-548b-4164-a543-ce563872be32 req-9027fcfa-ab25-43d3-95cc-02427f10a3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42984cfc-7066-4626-b537-5916ae2e2803", "name": "network-vif-plugged", "status": "completed", "tag": "eda49759-650f-472d-84a8-b76180f33c9c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:45.840394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f449c1a7-548b-4164-a543-ce563872be32 req-9027fcfa-ab25-43d3-95cc-02427f10a3c8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:45.840983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f449c1a7-548b-4164-a543-ce563872be32 req-9027fcfa-ab25-43d3-95cc-02427f10a3c8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:45.841607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f449c1a7-548b-4164-a543-ce563872be32 req-9027fcfa-ab25-43d3-95cc-02427f10a3c8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:45.854338 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f449c1a7-548b-4164-a543-ce563872be32 req-9027fcfa-ab25-43d3-95cc-02427f10a3c8 service nova] Creating event network-vif-plugged:eda49759-650f-472d-84a8-b76180f33c9c for instance 42984cfc-7066-4626-b537-5916ae2e2803 on nch2-master-1 Sep 10 21:16:45.859783 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f449c1a7-548b-4164-a543-ce563872be32 req-9027fcfa-ab25-43d3-95cc-02427f10a3c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037334 Sep 10 21:16:45.860198 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2961/5797] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:16:46.150206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-499d945d-a384-4ebe-bf5c-975ca97ba563 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:46.151243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-499d945d-a384-4ebe-bf5c-975ca97ba563 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:46.161962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-499d945d-a384-4ebe-bf5c-975ca97ba563 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:46.162494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-499d945d-a384-4ebe-bf5c-975ca97ba563 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:46.162938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-499d945d-a384-4ebe-bf5c-975ca97ba563 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:46.164269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-499d945d-a384-4ebe-bf5c-975ca97ba563 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:46.164739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-499d945d-a384-4ebe-bf5c-975ca97ba563 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:46.165444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-499d945d-a384-4ebe-bf5c-975ca97ba563 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:46.233338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0fd3c284-34b4-427b-9da2-acccbc08a91a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:46.234093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0fd3c284-34b4-427b-9da2-acccbc08a91a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:46.244160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3c284-34b4-427b-9da2-acccbc08a91a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:46.244666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3c284-34b4-427b-9da2-acccbc08a91a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:46.245114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3c284-34b4-427b-9da2-acccbc08a91a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:46.248047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3c284-34b4-427b-9da2-acccbc08a91a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:46.248541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3c284-34b4-427b-9da2-acccbc08a91a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:46.248988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3c284-34b4-427b-9da2-acccbc08a91a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:46.348844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-499d945d-a384-4ebe-bf5c-975ca97ba563 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:46.358183 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-499d945d-a384-4ebe-bf5c-975ca97ba563 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1666 microversion: 2.1 time: 0.213111 Sep 10 21:16:46.358782 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2837/5798] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:46 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1666 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:46.493514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0fd3c284-34b4-427b-9da2-acccbc08a91a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:46.501651 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0fd3c284-34b4-427b-9da2-acccbc08a91a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1313 microversion: 2.1 time: 0.272761 Sep 10 21:16:46.502287 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2962/5799] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:46 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:47.380724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a337cde-6ec5-4109-aa56-8e0b2ee9a94f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:47.381338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3a337cde-6ec5-4109-aa56-8e0b2ee9a94f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:47.390412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a337cde-6ec5-4109-aa56-8e0b2ee9a94f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:47.390907 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a337cde-6ec5-4109-aa56-8e0b2ee9a94f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:47.391414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a337cde-6ec5-4109-aa56-8e0b2ee9a94f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:47.392387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a337cde-6ec5-4109-aa56-8e0b2ee9a94f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:47.393047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a337cde-6ec5-4109-aa56-8e0b2ee9a94f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:47.393633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a337cde-6ec5-4109-aa56-8e0b2ee9a94f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:47.525535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81387f13-d424-418d-baa5-a031b4f17e3a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:47.526193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81387f13-d424-418d-baa5-a031b4f17e3a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:47.531568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:47.539356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:47.543460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81387f13-d424-418d-baa5-a031b4f17e3a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:47.546112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81387f13-d424-418d-baa5-a031b4f17e3a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:47.548766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81387f13-d424-418d-baa5-a031b4f17e3a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:47.550767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81387f13-d424-418d-baa5-a031b4f17e3a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:47.551297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81387f13-d424-418d-baa5-a031b4f17e3a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:47.551765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81387f13-d424-418d-baa5-a031b4f17e3a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:47.698457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a337cde-6ec5-4109-aa56-8e0b2ee9a94f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:47.710246 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3a337cde-6ec5-4109-aa56-8e0b2ee9a94f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.333148 Sep 10 21:16:47.711011 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2838/5800] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:47 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:47.711719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-81387f13-d424-418d-baa5-a031b4f17e3a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:47.720119 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81387f13-d424-418d-baa5-a031b4f17e3a tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1498 microversion: 2.1 time: 0.199464 Sep 10 21:16:47.720855 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2963/5801] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:47 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1498 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:47.734642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ce29f08-4f8d-4734-b99c-e757db6dd065 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:47.735265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ce29f08-4f8d-4734-b99c-e757db6dd065 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:47.749228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce29f08-4f8d-4734-b99c-e757db6dd065 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:47.749922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce29f08-4f8d-4734-b99c-e757db6dd065 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:47.750250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5341288f-c226-4193-a858-a373620c5bd5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:47.751066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce29f08-4f8d-4734-b99c-e757db6dd065 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:47.752087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce29f08-4f8d-4734-b99c-e757db6dd065 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:47.753256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5341288f-c226-4193-a858-a373620c5bd5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:47.753435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce29f08-4f8d-4734-b99c-e757db6dd065 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:47.754326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ce29f08-4f8d-4734-b99c-e757db6dd065 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:47.761910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5341288f-c226-4193-a858-a373620c5bd5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:47.762758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5341288f-c226-4193-a858-a373620c5bd5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:47.763418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5341288f-c226-4193-a858-a373620c5bd5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:47.764529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5341288f-c226-4193-a858-a373620c5bd5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:47.765182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5341288f-c226-4193-a858-a373620c5bd5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:47.766355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5341288f-c226-4193-a858-a373620c5bd5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:47.803834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-5341288f-c226-4193-a858-a373620c5bd5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lazy-loading 'flavor' on Instance uuid 42984cfc-7066-4626-b537-5916ae2e2803 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:16:47.842615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:47.902081 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5341288f-c226-4193-a858-a373620c5bd5 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "POST /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803/action" status: 200 len: 32 microversion: 2.1 time: 0.158007 Sep 10 21:16:47.902825 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2964/5802] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:16:47 2022] POST /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 21:16:47.917147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-98c2b09f-5b0f-4303-a4ed-dd07f448d6ab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:47.918071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-98c2b09f-5b0f-4303-a4ed-dd07f448d6ab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:47.925977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c2b09f-5b0f-4303-a4ed-dd07f448d6ab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:47.926478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c2b09f-5b0f-4303-a4ed-dd07f448d6ab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:47.927137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c2b09f-5b0f-4303-a4ed-dd07f448d6ab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:47.928207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c2b09f-5b0f-4303-a4ed-dd07f448d6ab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:47.928838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c2b09f-5b0f-4303-a4ed-dd07f448d6ab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:47.929641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98c2b09f-5b0f-4303-a4ed-dd07f448d6ab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:48.123565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-98c2b09f-5b0f-4303-a4ed-dd07f448d6ab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:48.133268 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-98c2b09f-5b0f-4303-a4ed-dd07f448d6ab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.220784 Sep 10 21:16:48.136781 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2965/5803] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:47 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:48.151561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1ce29f08-4f8d-4734-b99c-e757db6dd065 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:48.153866 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ce29f08-4f8d-4734-b99c-e757db6dd065 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.423157 Sep 10 21:16:48.158036 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2839/5804] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:47 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:48.181294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-03b31fed-3584-4c87-a1f7-6ed8fe58995b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:48.181960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-03b31fed-3584-4c87-a1f7-6ed8fe58995b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:48.188232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b31fed-3584-4c87-a1f7-6ed8fe58995b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:48.198478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b31fed-3584-4c87-a1f7-6ed8fe58995b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:48.198952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b31fed-3584-4c87-a1f7-6ed8fe58995b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:48.199728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b31fed-3584-4c87-a1f7-6ed8fe58995b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:48.200200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b31fed-3584-4c87-a1f7-6ed8fe58995b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:48.200637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03b31fed-3584-4c87-a1f7-6ed8fe58995b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:48.392136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-03b31fed-3584-4c87-a1f7-6ed8fe58995b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:48.405128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-03b31fed-3584-4c87-a1f7-6ed8fe58995b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.229613 Sep 10 21:16:48.405974 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2966/5805] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:48 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:48.432090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a448d206-09f8-4001-bffd-bad547baec41 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:48.433844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a448d206-09f8-4001-bffd-bad547baec41 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:48.442084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a448d206-09f8-4001-bffd-bad547baec41 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:48.442784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a448d206-09f8-4001-bffd-bad547baec41 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:48.443232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a448d206-09f8-4001-bffd-bad547baec41 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:48.443943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a448d206-09f8-4001-bffd-bad547baec41 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:48.444404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a448d206-09f8-4001-bffd-bad547baec41 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:48.444922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a448d206-09f8-4001-bffd-bad547baec41 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:48.765139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a448d206-09f8-4001-bffd-bad547baec41 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:48.776738 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a448d206-09f8-4001-bffd-bad547baec41 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.349994 Sep 10 21:16:48.777666 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2840/5806] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:48 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:48.800632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09eb4d89-ab41-4834-9647-c70cbcc9bd01 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:48.801791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09eb4d89-ab41-4834-9647-c70cbcc9bd01 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:48.809586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09eb4d89-ab41-4834-9647-c70cbcc9bd01 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:48.810102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09eb4d89-ab41-4834-9647-c70cbcc9bd01 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:48.810763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09eb4d89-ab41-4834-9647-c70cbcc9bd01 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:48.811627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09eb4d89-ab41-4834-9647-c70cbcc9bd01 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:48.812243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09eb4d89-ab41-4834-9647-c70cbcc9bd01 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:48.812827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09eb4d89-ab41-4834-9647-c70cbcc9bd01 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:48.979154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09eb4d89-ab41-4834-9647-c70cbcc9bd01 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:48.989730 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09eb4d89-ab41-4834-9647-c70cbcc9bd01 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.192852 Sep 10 21:16:48.990385 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2967/5807] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:48 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:49.024543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a8b63622-8690-4a43-95f7-f43bc9181f9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:49.025479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a8b63622-8690-4a43-95f7-f43bc9181f9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:49.036731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8b63622-8690-4a43-95f7-f43bc9181f9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:49.037759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8b63622-8690-4a43-95f7-f43bc9181f9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:49.038423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8b63622-8690-4a43-95f7-f43bc9181f9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:49.039838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8b63622-8690-4a43-95f7-f43bc9181f9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:49.040609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8b63622-8690-4a43-95f7-f43bc9181f9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:49.041621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8b63622-8690-4a43-95f7-f43bc9181f9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:49.068079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-a8b63622-8690-4a43-95f7-f43bc9181f9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lazy-loading 'flavor' on Instance uuid 010766a5-73d4-43bc-8b9b-915530aac069 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:16:49.146818 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a8b63622-8690-4a43-95f7-f43bc9181f9b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.132608 Sep 10 21:16:49.148001 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2841/5808] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:16:49 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:16:49.168654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5240e82-c5f5-43ca-82b7-ec4ffdc4fb43 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:49.170346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5240e82-c5f5-43ca-82b7-ec4ffdc4fb43 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:49.175118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e6203317-c24e-4a14-a6e1-e83a661b5072 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:49.176534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e6203317-c24e-4a14-a6e1-e83a661b5072 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:49.182983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5240e82-c5f5-43ca-82b7-ec4ffdc4fb43 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:49.183767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5240e82-c5f5-43ca-82b7-ec4ffdc4fb43 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:49.184496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5240e82-c5f5-43ca-82b7-ec4ffdc4fb43 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:49.186446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5240e82-c5f5-43ca-82b7-ec4ffdc4fb43 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:49.187450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5240e82-c5f5-43ca-82b7-ec4ffdc4fb43 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:49.188227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5240e82-c5f5-43ca-82b7-ec4ffdc4fb43 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:49.190862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6203317-c24e-4a14-a6e1-e83a661b5072 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:49.191704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6203317-c24e-4a14-a6e1-e83a661b5072 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:49.192231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6203317-c24e-4a14-a6e1-e83a661b5072 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:49.193623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6203317-c24e-4a14-a6e1-e83a661b5072 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:49.194329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6203317-c24e-4a14-a6e1-e83a661b5072 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:49.194832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6203317-c24e-4a14-a6e1-e83a661b5072 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:49.364797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5240e82-c5f5-43ca-82b7-ec4ffdc4fb43 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:49.385367 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5240e82-c5f5-43ca-82b7-ec4ffdc4fb43 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1678 microversion: 2.1 time: 0.228394 Sep 10 21:16:49.386174 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2968/5809] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:49 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:49.439591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e6203317-c24e-4a14-a6e1-e83a661b5072 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:49.449354 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e6203317-c24e-4a14-a6e1-e83a661b5072 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.282042 Sep 10 21:16:49.450177 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2842/5810] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:49 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:50.410533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a930e61f-adf7-4cf0-8e71-e83e60d07057 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:50.411151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a930e61f-adf7-4cf0-8e71-e83e60d07057 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:50.418980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a930e61f-adf7-4cf0-8e71-e83e60d07057 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:50.419472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a930e61f-adf7-4cf0-8e71-e83e60d07057 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:50.419909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a930e61f-adf7-4cf0-8e71-e83e60d07057 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:50.420618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a930e61f-adf7-4cf0-8e71-e83e60d07057 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:50.421077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a930e61f-adf7-4cf0-8e71-e83e60d07057 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:50.421508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a930e61f-adf7-4cf0-8e71-e83e60d07057 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:50.472616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7fc62dae-9624-41a9-88d5-ba308d79d819 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:50.473418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7fc62dae-9624-41a9-88d5-ba308d79d819 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:50.476979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=84 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:50.482746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fc62dae-9624-41a9-88d5-ba308d79d819 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:50.483241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fc62dae-9624-41a9-88d5-ba308d79d819 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:50.483688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fc62dae-9624-41a9-88d5-ba308d79d819 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:50.484390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fc62dae-9624-41a9-88d5-ba308d79d819 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:50.484848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fc62dae-9624-41a9-88d5-ba308d79d819 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:50.485277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fc62dae-9624-41a9-88d5-ba308d79d819 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:50.623370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7fc62dae-9624-41a9-88d5-ba308d79d819 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:50.631474 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7fc62dae-9624-41a9-88d5-ba308d79d819 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.162749 Sep 10 21:16:50.632159 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2843/5811] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:50 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:50.658759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a930e61f-adf7-4cf0-8e71-e83e60d07057 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:50.666970 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a930e61f-adf7-4cf0-8e71-e83e60d07057 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1661 microversion: 2.1 time: 0.260249 Sep 10 21:16:50.667570 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2969/5812] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:50 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1661 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:50.689622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5c95188e-695a-46e0-9382-458cf2e7120b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:50.690244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5c95188e-695a-46e0-9382-458cf2e7120b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:50.696896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c95188e-695a-46e0-9382-458cf2e7120b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:50.697397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c95188e-695a-46e0-9382-458cf2e7120b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:50.697855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c95188e-695a-46e0-9382-458cf2e7120b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:50.698566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c95188e-695a-46e0-9382-458cf2e7120b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:50.699025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c95188e-695a-46e0-9382-458cf2e7120b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:50.699459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c95188e-695a-46e0-9382-458cf2e7120b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:50.771871 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5c95188e-695a-46e0-9382-458cf2e7120b tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action" status: 202 len: 0 microversion: 2.1 time: 0.085890 Sep 10 21:16:50.772824 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2844/5813] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:16:50 2022] POST /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:16:50.781515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa326670-5180-4821-b97d-6434bad8e9c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:50.782309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aa326670-5180-4821-b97d-6434bad8e9c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:50.788468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa326670-5180-4821-b97d-6434bad8e9c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:50.789460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa326670-5180-4821-b97d-6434bad8e9c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:50.790069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa326670-5180-4821-b97d-6434bad8e9c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:50.790795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa326670-5180-4821-b97d-6434bad8e9c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:50.791263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa326670-5180-4821-b97d-6434bad8e9c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:50.791700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa326670-5180-4821-b97d-6434bad8e9c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:51.055079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aa326670-5180-4821-b97d-6434bad8e9c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:51.063393 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aa326670-5180-4821-b97d-6434bad8e9c5 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1667 microversion: 2.1 time: 0.285711 Sep 10 21:16:51.063993 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2970/5814] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:50 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1667 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:51.657594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-407b797d-221d-47a5-a80e-6571c68d8a33 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:51.658346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-407b797d-221d-47a5-a80e-6571c68d8a33 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:51.664921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-407b797d-221d-47a5-a80e-6571c68d8a33 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:51.665549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-407b797d-221d-47a5-a80e-6571c68d8a33 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:51.666046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-407b797d-221d-47a5-a80e-6571c68d8a33 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:51.666900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-407b797d-221d-47a5-a80e-6571c68d8a33 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:51.667369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-407b797d-221d-47a5-a80e-6571c68d8a33 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:51.667805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-407b797d-221d-47a5-a80e-6571c68d8a33 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:51.802711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-407b797d-221d-47a5-a80e-6571c68d8a33 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:51.810998 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-407b797d-221d-47a5-a80e-6571c68d8a33 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.159640 Sep 10 21:16:51.811670 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2845/5815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:51 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:52.088489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-45b6bdeb-0880-40dd-8ca2-cc7caf7aed34 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:52.089129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-45b6bdeb-0880-40dd-8ca2-cc7caf7aed34 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:52.096377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45b6bdeb-0880-40dd-8ca2-cc7caf7aed34 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:52.096911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45b6bdeb-0880-40dd-8ca2-cc7caf7aed34 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:52.097359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45b6bdeb-0880-40dd-8ca2-cc7caf7aed34 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:52.098115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45b6bdeb-0880-40dd-8ca2-cc7caf7aed34 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:52.098792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45b6bdeb-0880-40dd-8ca2-cc7caf7aed34 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:52.099244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45b6bdeb-0880-40dd-8ca2-cc7caf7aed34 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:52.263885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-45b6bdeb-0880-40dd-8ca2-cc7caf7aed34 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:52.275573 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-45b6bdeb-0880-40dd-8ca2-cc7caf7aed34 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.192086 Sep 10 21:16:52.276166 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2971/5816] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:52 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:52.298266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-97d0c4af-696f-4994-b181-3617a60a7870 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:52.298814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-97d0c4af-696f-4994-b181-3617a60a7870 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:52.305565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97d0c4af-696f-4994-b181-3617a60a7870 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:52.306320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97d0c4af-696f-4994-b181-3617a60a7870 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:52.307047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97d0c4af-696f-4994-b181-3617a60a7870 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:52.307767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97d0c4af-696f-4994-b181-3617a60a7870 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:52.308232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97d0c4af-696f-4994-b181-3617a60a7870 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:52.308662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-97d0c4af-696f-4994-b181-3617a60a7870 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:52.534715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-97d0c4af-696f-4994-b181-3617a60a7870 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:52.542607 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-97d0c4af-696f-4994-b181-3617a60a7870 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1670 microversion: 2.1 time: 0.248567 Sep 10 21:16:52.543196 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2846/5817] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:52 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1670 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:52.567778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:52.568371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:52.575080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:52.575836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:52.576355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:52.577153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:52.577688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:52.578217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:52.606282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:16:52.612709 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.compute.api [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Working on deleting snapshot 648943be-54ed-4276-8941-a2d43ae122f1 from shelved instance... Sep 10 21:16:52.834774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ed851687-3301-4e1d-8eb9-fdf059a961ed tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:52.835494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ed851687-3301-4e1d-8eb9-fdf059a961ed tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:52.853137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed851687-3301-4e1d-8eb9-fdf059a961ed tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:52.853772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed851687-3301-4e1d-8eb9-fdf059a961ed tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:52.854250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed851687-3301-4e1d-8eb9-fdf059a961ed tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:52.859789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed851687-3301-4e1d-8eb9-fdf059a961ed tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:52.860369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed851687-3301-4e1d-8eb9-fdf059a961ed tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:52.860739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ed851687-3301-4e1d-8eb9-fdf059a961ed tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:53.027582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ed851687-3301-4e1d-8eb9-fdf059a961ed tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:53.040489 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ed851687-3301-4e1d-8eb9-fdf059a961ed tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.209608 Sep 10 21:16:53.041233 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2847/5818] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:52 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:53.163897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Doing local delete in cell 2d5686ab-1410-4524-a86f-a6b89a7f772a(cell1) {{(pid=145772) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 10 21:16:53.164629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:53.165154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:53.165601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:53.166063 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.compute.api [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 10 21:16:53.169789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] deallocate_for_instance() {{(pid=145772) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 10 21:16:53.977984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-02981e27-d393-4891-ab26-4a257f0f473b req-c6e7d1aa-4c42-42fc-92a1-ae4f4a4085ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab021c5-f772-432f-8147-3b7f70eeae59", "name": "network-vif-deleted", "tag": "b471905b-b736-4e3b-9546-4c0558cb7edf"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:53.992094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Updating instance_info_cache with network_info: [] {{(pid=145772) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 21:16:53.999227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-02981e27-d393-4891-ab26-4a257f0f473b req-c6e7d1aa-4c42-42fc-92a1-ae4f4a4085ca service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:54.000680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-02981e27-d393-4891-ab26-4a257f0f473b req-c6e7d1aa-4c42-42fc-92a1-ae4f4a4085ca service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:54.002233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-02981e27-d393-4891-ab26-4a257f0f473b req-c6e7d1aa-4c42-42fc-92a1-ae4f4a4085ca service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:54.023687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.compute.server_external_events [req-02981e27-d393-4891-ab26-4a257f0f473b req-c6e7d1aa-4c42-42fc-92a1-ae4f4a4085ca service nova] Unable to find a host for instance 9ab021c5-f772-432f-8147-3b7f70eeae59. Dropping event network-vif-deleted {{(pid=145771) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 21:16:54.024871 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-02981e27-d393-4891-ab26-4a257f0f473b req-c6e7d1aa-4c42-42fc-92a1-ae4f4a4085ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.051112 Sep 10 21:16:54.027721 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2848/5819] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 10 21:16:54.071957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0b48d47-e5b1-4d04-8f95-8fdc7951fd36 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:54.072576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0b48d47-e5b1-4d04-8f95-8fdc7951fd36 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:54.089745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0b48d47-e5b1-4d04-8f95-8fdc7951fd36 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:54.091142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0b48d47-e5b1-4d04-8f95-8fdc7951fd36 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:54.091618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0b48d47-e5b1-4d04-8f95-8fdc7951fd36 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:54.092366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0b48d47-e5b1-4d04-8f95-8fdc7951fd36 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:54.092841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0b48d47-e5b1-4d04-8f95-8fdc7951fd36 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:54.093292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0b48d47-e5b1-4d04-8f95-8fdc7951fd36 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:54.287071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c0b48d47-e5b1-4d04-8f95-8fdc7951fd36 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:54.296944 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0b48d47-e5b1-4d04-8f95-8fdc7951fd36 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.234547 Sep 10 21:16:54.298768 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2849/5820] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:54 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:54.513039 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b569f6dc-9cb7-4298-ad6f-2e604dca31dd tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 204 len: 0 microversion: 2.1 time: 1.949399 Sep 10 21:16:54.514096 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2972/5821] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:16:52 2022] DELETE /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 0 bytes in 1951 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:16:54.521848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:54.522461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 9ab021c5-f772-432f-8147-3b7f70eeae59] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:54.528737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:54.529228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:54.529674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:54.530407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:54.530860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:54.531290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:54.546865 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] HTTP exception thrown: Instance 9ab021c5-f772-432f-8147-3b7f70eeae59 could not be found. Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Request method failure captured: Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 HTTP/1.1 Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP07LJkT0eqhQbcFK2cLpNXQ6K9cp7_Q7ooRPesMYBGiV5ZAWO0tgg0u9XsKAq-Lh655UeWg-VZnfaFjahgGEBoRwA9fWm4uBZBqkVn0zU5bMwf9wPV6zvYKIPMqvVJpU8RzpBN-qlcYr-8aj3HqcZ6QolRcIasDDFEHk_My4lrKqj8 Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_15a76a25754c42099c542fa13046f01b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/15a76a25754c42099c542fa13046f01b"}]}] Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d83b6ceb599746b394e379d52683b70c Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 9ab021c5-f772-432f-8147-3b7f70eeae59 could not be found. Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '9ab021c5-f772-432f-8147-3b7f70eeae59'} Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ab021c5-f772-432f-8147-3b7f70eeae59 could not be found. Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ab021c5-f772-432f-8147-3b7f70eeae59 could not be found. Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:16:54.548640 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:16:54.553428 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:16:54.553428 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:16:54.553428 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:16:54.553428 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:16:54.553428 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:16:54.553428 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ab021c5-f772-432f-8147-3b7f70eeae59 could not be found. Sep 10 21:16:54.553428 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:16:54.553428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Returning 404 to user: Instance 9ab021c5-f772-432f-8147-3b7f70eeae59 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:16:54.553428 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f2efcdc-0368-43d7-8b33-cf0351e96981 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59" status: 404 len: 111 microversion: 2.1 time: 0.032202 Sep 10 21:16:54.553428 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2850/5822] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:54 2022] GET /compute/v2.1/servers/9ab021c5-f772-432f-8147-3b7f70eeae59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:16:54.559541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07880940-f329-4783-bba1-7f5d5e2171db tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:54.560045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-07880940-f329-4783-bba1-7f5d5e2171db tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:54.562102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:54.567814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07880940-f329-4783-bba1-7f5d5e2171db tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:54.568321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07880940-f329-4783-bba1-7f5d5e2171db tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:54.568775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07880940-f329-4783-bba1-7f5d5e2171db tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:54.569500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07880940-f329-4783-bba1-7f5d5e2171db tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:54.570347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07880940-f329-4783-bba1-7f5d5e2171db tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:54.570795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07880940-f329-4783-bba1-7f5d5e2171db tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:54.598437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-07880940-f329-4783-bba1-7f5d5e2171db tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:16:54.613657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:54.690421 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-07880940-f329-4783-bba1-7f5d5e2171db tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "DELETE /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 204 len: 0 microversion: 2.1 time: 0.134490 Sep 10 21:16:54.691230 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2973/5823] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:16:54 2022] DELETE /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:16:54.700283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2ae8f3d9-31b1-4431-a910-9b15c28a26e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:54.701041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2ae8f3d9-31b1-4431-a910-9b15c28a26e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:54.707188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ae8f3d9-31b1-4431-a910-9b15c28a26e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:54.707708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ae8f3d9-31b1-4431-a910-9b15c28a26e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:54.708141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ae8f3d9-31b1-4431-a910-9b15c28a26e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:54.708835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ae8f3d9-31b1-4431-a910-9b15c28a26e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:54.709304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ae8f3d9-31b1-4431-a910-9b15c28a26e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:54.709978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ae8f3d9-31b1-4431-a910-9b15c28a26e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:54.734786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:16:54.806242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2ae8f3d9-31b1-4431-a910-9b15c28a26e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:54.814226 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2ae8f3d9-31b1-4431-a910-9b15c28a26e9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1466 microversion: 2.1 time: 0.118861 Sep 10 21:16:54.814916 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2851/5824] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:54 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1466 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:55.321855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-811bf7fd-71c4-4114-aa41-f2835a522aaf tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:55.322556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-811bf7fd-71c4-4114-aa41-f2835a522aaf tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:55.329410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-811bf7fd-71c4-4114-aa41-f2835a522aaf tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:55.329933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-811bf7fd-71c4-4114-aa41-f2835a522aaf tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:55.330381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-811bf7fd-71c4-4114-aa41-f2835a522aaf tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:55.331090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-811bf7fd-71c4-4114-aa41-f2835a522aaf tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:55.331555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-811bf7fd-71c4-4114-aa41-f2835a522aaf tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:55.331991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-811bf7fd-71c4-4114-aa41-f2835a522aaf tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:55.488909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-811bf7fd-71c4-4114-aa41-f2835a522aaf tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:55.497319 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-811bf7fd-71c4-4114-aa41-f2835a522aaf tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.180400 Sep 10 21:16:55.510018 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2974/5825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:55 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:55.838112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f65fe3e-92cd-4ea8-a14a-ace9883a21e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:55.838736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f65fe3e-92cd-4ea8-a14a-ace9883a21e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:55.845879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f65fe3e-92cd-4ea8-a14a-ace9883a21e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:55.846403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f65fe3e-92cd-4ea8-a14a-ace9883a21e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:55.846852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f65fe3e-92cd-4ea8-a14a-ace9883a21e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:55.847580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f65fe3e-92cd-4ea8-a14a-ace9883a21e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:55.848040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f65fe3e-92cd-4ea8-a14a-ace9883a21e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:55.848497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f65fe3e-92cd-4ea8-a14a-ace9883a21e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:55.936656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f65fe3e-92cd-4ea8-a14a-ace9883a21e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:55.944412 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f65fe3e-92cd-4ea8-a14a-ace9883a21e4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1466 microversion: 2.1 time: 0.110341 Sep 10 21:16:55.945693 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2852/5826] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:55 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1466 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:56.521054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b574a976-9a50-4123-a51e-56215305d72c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:56.522568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b574a976-9a50-4123-a51e-56215305d72c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:56.531417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b574a976-9a50-4123-a51e-56215305d72c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:56.532085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b574a976-9a50-4123-a51e-56215305d72c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:56.532751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b574a976-9a50-4123-a51e-56215305d72c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:56.533633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b574a976-9a50-4123-a51e-56215305d72c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:56.534315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b574a976-9a50-4123-a51e-56215305d72c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:56.534887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b574a976-9a50-4123-a51e-56215305d72c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:56.681264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2a58a0a1-bf02-4838-82d7-2c01804ec412 req-f5ddab65-93f2-40dd-ae2b-7d72ad7d7479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33229432-7e4c-40cb-8bbf-c5a11e562b94", "name": "network-vif-deleted", "tag": "4eee075f-3ed6-4e71-a2ea-73e196e4cb97"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:16:56.706043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2a58a0a1-bf02-4838-82d7-2c01804ec412 req-f5ddab65-93f2-40dd-ae2b-7d72ad7d7479 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:56.706612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2a58a0a1-bf02-4838-82d7-2c01804ec412 req-f5ddab65-93f2-40dd-ae2b-7d72ad7d7479 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:56.707309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2a58a0a1-bf02-4838-82d7-2c01804ec412 req-f5ddab65-93f2-40dd-ae2b-7d72ad7d7479 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:56.720665 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2a58a0a1-bf02-4838-82d7-2c01804ec412 req-f5ddab65-93f2-40dd-ae2b-7d72ad7d7479 service nova] Creating event network-vif-deleted:4eee075f-3ed6-4e71-a2ea-73e196e4cb97 for instance 33229432-7e4c-40cb-8bbf-c5a11e562b94 on nch2-master-1 Sep 10 21:16:56.727322 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2a58a0a1-bf02-4838-82d7-2c01804ec412 req-f5ddab65-93f2-40dd-ae2b-7d72ad7d7479 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051920 Sep 10 21:16:56.728048 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2853/5827] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:16:56.860509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b574a976-9a50-4123-a51e-56215305d72c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:56.871619 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b574a976-9a50-4123-a51e-56215305d72c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.354843 Sep 10 21:16:56.872669 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2975/5828] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:56 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:56.970833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:56.972221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:56.983715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:56.985174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:56.985873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:56.987011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:56.987864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:56.989170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:57.026736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:57.027266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:57.027888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:57.028423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lazy-loading 'fault' on Instance uuid 33229432-7e4c-40cb-8bbf-c5a11e562b94 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:16:57.078498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:57.089061 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6f68c45a-157c-4cb9-b3c2-b9a8eaa0c9ad tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 200 len: 1305 microversion: 2.1 time: 0.122504 Sep 10 21:16:57.105442 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2854/5829] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:56 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 1305 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:16:57.897482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b6727901-7485-4ad4-890b-50218f4b684c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:57.899506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b6727901-7485-4ad4-890b-50218f4b684c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:57.907749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6727901-7485-4ad4-890b-50218f4b684c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:57.908298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6727901-7485-4ad4-890b-50218f4b684c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:57.908784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6727901-7485-4ad4-890b-50218f4b684c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:57.909881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6727901-7485-4ad4-890b-50218f4b684c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:57.910519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6727901-7485-4ad4-890b-50218f4b684c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:57.910960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b6727901-7485-4ad4-890b-50218f4b684c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:58.114026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:58.114797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 33229432-7e4c-40cb-8bbf-c5a11e562b94] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:58.123968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:58.124657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:58.125290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:58.126884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:58.127468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:58.127989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:58.146473 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] HTTP exception thrown: Instance 33229432-7e4c-40cb-8bbf-c5a11e562b94 could not be found. Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Request method failure captured: Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 HTTP/1.1 Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP07LJkT0eqhQbcFK2cLpNXQ6K9cp7_Q7ooRPesMYBGiV5ZAWO0tgg0u9XsKAq-Lh655UeWg-VZnfaFjahgGEBoRwA9fWm4uBZBqkVn0zU5bMwf9wPV6zvYKIPMqvVJpU8RzpBN-qlcYr-8aj3HqcZ6QolRcIasDDFEHk_My4lrKqj8 Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_15a76a25754c42099c542fa13046f01b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/15a76a25754c42099c542fa13046f01b"}]}] Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d83b6ceb599746b394e379d52683b70c Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 33229432-7e4c-40cb-8bbf-c5a11e562b94 could not be found. Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '33229432-7e4c-40cb-8bbf-c5a11e562b94'} Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33229432-7e4c-40cb-8bbf-c5a11e562b94 could not be found. Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33229432-7e4c-40cb-8bbf-c5a11e562b94 could not be found. Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:16:58.149772 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:16:58.154748 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:16:58.154748 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:16:58.154748 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:16:58.154748 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:16:58.154748 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:16:58.154748 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33229432-7e4c-40cb-8bbf-c5a11e562b94 could not be found. Sep 10 21:16:58.154748 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:16:58.155176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b6727901-7485-4ad4-890b-50218f4b684c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:58.156726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Returning 404 to user: Instance 33229432-7e4c-40cb-8bbf-c5a11e562b94 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:16:58.157629 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-609777f9-92f9-4322-9694-bdace6dd3e2f tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94" status: 404 len: 111 microversion: 2.1 time: 0.048848 Sep 10 21:16:58.159283 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2855/5830] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:58 2022] GET /compute/v2.1/servers/33229432-7e4c-40cb-8bbf-c5a11e562b94 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:16:58.166172 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b6727901-7485-4ad4-890b-50218f4b684c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.272117 Sep 10 21:16:58.167628 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2976/5831] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:57 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:58.172117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7431f595-b325-47ae-ade3-4b1aafbe470a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:58.172642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7431f595-b325-47ae-ade3-4b1aafbe470a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:58.178700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7431f595-b325-47ae-ade3-4b1aafbe470a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:58.179997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7431f595-b325-47ae-ade3-4b1aafbe470a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:58.180447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7431f595-b325-47ae-ade3-4b1aafbe470a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:58.181160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7431f595-b325-47ae-ade3-4b1aafbe470a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:58.181619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7431f595-b325-47ae-ade3-4b1aafbe470a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:58.182079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7431f595-b325-47ae-ade3-4b1aafbe470a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:58.209369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7431f595-b325-47ae-ade3-4b1aafbe470a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:16:58.310224 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7431f595-b325-47ae-ade3-4b1aafbe470a tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 204 len: 0 microversion: 2.1 time: 0.146619 Sep 10 21:16:58.312095 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2856/5832] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:16:58 2022] DELETE /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:16:58.321222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49c45f23-bcd4-4900-9514-24cb20f801a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:58.321882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-49c45f23-bcd4-4900-9514-24cb20f801a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:58.328049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c45f23-bcd4-4900-9514-24cb20f801a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:58.328534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c45f23-bcd4-4900-9514-24cb20f801a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:58.329166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c45f23-bcd4-4900-9514-24cb20f801a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:58.329908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c45f23-bcd4-4900-9514-24cb20f801a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:58.330374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c45f23-bcd4-4900-9514-24cb20f801a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:58.330808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49c45f23-bcd4-4900-9514-24cb20f801a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:58.592233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-49c45f23-bcd4-4900-9514-24cb20f801a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:58.607306 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-49c45f23-bcd4-4900-9514-24cb20f801a7 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1509 microversion: 2.1 time: 0.291827 Sep 10 21:16:58.607896 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2977/5833] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:58 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1509 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:59.197315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5fa7fbce-09c5-49b5-b0b1-be8b6184bcf0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:59.199056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5fa7fbce-09c5-49b5-b0b1-be8b6184bcf0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:59.211829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fa7fbce-09c5-49b5-b0b1-be8b6184bcf0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:59.212583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fa7fbce-09c5-49b5-b0b1-be8b6184bcf0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:59.213515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fa7fbce-09c5-49b5-b0b1-be8b6184bcf0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:59.215110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fa7fbce-09c5-49b5-b0b1-be8b6184bcf0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:59.215810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fa7fbce-09c5-49b5-b0b1-be8b6184bcf0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:59.216869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fa7fbce-09c5-49b5-b0b1-be8b6184bcf0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:59.459685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5fa7fbce-09c5-49b5-b0b1-be8b6184bcf0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:59.475288 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5fa7fbce-09c5-49b5-b0b1-be8b6184bcf0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.286488 Sep 10 21:16:59.476595 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2857/5834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:59 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:16:59.630094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ab035ce-012b-4be3-83df-46c8067f9a50 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:16:59.631261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ab035ce-012b-4be3-83df-46c8067f9a50 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:16:59.644436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab035ce-012b-4be3-83df-46c8067f9a50 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:59.645299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab035ce-012b-4be3-83df-46c8067f9a50 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:59.646040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab035ce-012b-4be3-83df-46c8067f9a50 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:59.647120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab035ce-012b-4be3-83df-46c8067f9a50 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:16:59.647843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab035ce-012b-4be3-83df-46c8067f9a50 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:16:59.648395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ab035ce-012b-4be3-83df-46c8067f9a50 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:16:59.952134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5ab035ce-012b-4be3-83df-46c8067f9a50 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:16:59.963407 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ab035ce-012b-4be3-83df-46c8067f9a50 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1509 microversion: 2.1 time: 0.337253 Sep 10 21:16:59.965176 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2978/5835] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:16:59 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:00.503955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-891b2dd9-ebf6-4f7e-a180-a2c2bb048241 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:00.504540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-891b2dd9-ebf6-4f7e-a180-a2c2bb048241 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:00.510375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8070efab-2b3b-4f62-9568-6919f95f7330 req-474e97a8-1671-4708-aeed-aaea98c03c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a0156a-616b-48b0-9cc4-191d12c4bbaa", "name": "network-vif-deleted", "tag": "b267aeac-2c16-4b9e-8210-7ece1fbf8a01"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:00.521246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-891b2dd9-ebf6-4f7e-a180-a2c2bb048241 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:00.521756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-891b2dd9-ebf6-4f7e-a180-a2c2bb048241 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:00.522418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-891b2dd9-ebf6-4f7e-a180-a2c2bb048241 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:00.526148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-891b2dd9-ebf6-4f7e-a180-a2c2bb048241 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:00.527018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-891b2dd9-ebf6-4f7e-a180-a2c2bb048241 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:00.527615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-891b2dd9-ebf6-4f7e-a180-a2c2bb048241 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:00.544169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8070efab-2b3b-4f62-9568-6919f95f7330 req-474e97a8-1671-4708-aeed-aaea98c03c99 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:00.545259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8070efab-2b3b-4f62-9568-6919f95f7330 req-474e97a8-1671-4708-aeed-aaea98c03c99 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:00.546106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8070efab-2b3b-4f62-9568-6919f95f7330 req-474e97a8-1671-4708-aeed-aaea98c03c99 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:00.577673 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8070efab-2b3b-4f62-9568-6919f95f7330 req-474e97a8-1671-4708-aeed-aaea98c03c99 service nova] Creating event network-vif-deleted:b267aeac-2c16-4b9e-8210-7ece1fbf8a01 for instance c1a0156a-616b-48b0-9cc4-191d12c4bbaa on nch2-master-1 Sep 10 21:17:00.596906 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8070efab-2b3b-4f62-9568-6919f95f7330 req-474e97a8-1671-4708-aeed-aaea98c03c99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092384 Sep 10 21:17:00.597863 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2979/5836] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:00.839321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-891b2dd9-ebf6-4f7e-a180-a2c2bb048241 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:00.850092 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-891b2dd9-ebf6-4f7e-a180-a2c2bb048241 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.350334 Sep 10 21:17:00.851575 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2858/5837] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:00 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:00.989669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:00.990563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:01.014991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:01.016526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:01.018612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:01.026923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:01.029655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:01.030367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:01.109066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:01.109796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:01.110420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:01.115723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lazy-loading 'fault' on Instance uuid c1a0156a-616b-48b0-9cc4-191d12c4bbaa {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:17:01.193432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:01.204162 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6f9796dc-0a15-40a1-8ae8-ecc9620cfab1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 200 len: 1305 microversion: 2.1 time: 0.219801 Sep 10 21:17:01.205054 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2980/5838] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:00 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 1305 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:01.876833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a12ba39-7ef2-42c5-aeac-f198cda36cf8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:01.877453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4a12ba39-7ef2-42c5-aeac-f198cda36cf8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:01.895981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a12ba39-7ef2-42c5-aeac-f198cda36cf8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:01.896775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a12ba39-7ef2-42c5-aeac-f198cda36cf8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:01.901175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a12ba39-7ef2-42c5-aeac-f198cda36cf8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:01.903892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a12ba39-7ef2-42c5-aeac-f198cda36cf8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:01.904814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a12ba39-7ef2-42c5-aeac-f198cda36cf8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:01.905585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a12ba39-7ef2-42c5-aeac-f198cda36cf8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:02.233091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:02.234559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: c1a0156a-616b-48b0-9cc4-191d12c4bbaa] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:02.243298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:02.245136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:02.245707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:02.247332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:02.248544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:02.249283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:02.273789 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] HTTP exception thrown: Instance c1a0156a-616b-48b0-9cc4-191d12c4bbaa could not be found. Sep 10 21:17:02.275626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4a12ba39-7ef2-42c5-aeac-f198cda36cf8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Request method failure captured: Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa HTTP/1.1 Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP07LJkT0eqhQbcFK2cLpNXQ6K9cp7_Q7ooRPesMYBGiV5ZAWO0tgg0u9XsKAq-Lh655UeWg-VZnfaFjahgGEBoRwA9fWm4uBZBqkVn0zU5bMwf9wPV6zvYKIPMqvVJpU8RzpBN-qlcYr-8aj3HqcZ6QolRcIasDDFEHk_My4lrKqj8 Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_15a76a25754c42099c542fa13046f01b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/15a76a25754c42099c542fa13046f01b"}]}] Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d83b6ceb599746b394e379d52683b70c Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance c1a0156a-616b-48b0-9cc4-191d12c4bbaa could not be found. Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c1a0156a-616b-48b0-9cc4-191d12c4bbaa'} Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a0156a-616b-48b0-9cc4-191d12c4bbaa could not be found. Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a0156a-616b-48b0-9cc4-191d12c4bbaa could not be found. Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:02.276197 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:02.280741 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:02.280741 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:02.280741 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:02.280741 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:02.280741 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:02.280741 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a0156a-616b-48b0-9cc4-191d12c4bbaa could not be found. Sep 10 21:17:02.280741 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:02.283051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Returning 404 to user: Instance c1a0156a-616b-48b0-9cc4-191d12c4bbaa could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:02.284175 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-05cc6cbe-5183-4c00-9fcf-761cd0743aaa tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa" status: 404 len: 111 microversion: 2.1 time: 0.058770 Sep 10 21:17:02.284919 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2981/5839] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:02 2022] GET /compute/v2.1/servers/c1a0156a-616b-48b0-9cc4-191d12c4bbaa => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:17:02.291284 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a12ba39-7ef2-42c5-aeac-f198cda36cf8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.419420 Sep 10 21:17:02.295733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bc9b2db3-89a4-4cc6-9ce2-c1e648c61d3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:02.296411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bc9b2db3-89a4-4cc6-9ce2-c1e648c61d3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:02.306554 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2859/5840] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:01 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:02.309763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db3-89a4-4cc6-9ce2-c1e648c61d3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:02.310502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db3-89a4-4cc6-9ce2-c1e648c61d3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:02.311106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db3-89a4-4cc6-9ce2-c1e648c61d3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:02.312071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db3-89a4-4cc6-9ce2-c1e648c61d3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:02.313214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db3-89a4-4cc6-9ce2-c1e648c61d3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:02.313812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc9b2db3-89a4-4cc6-9ce2-c1e648c61d3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:02.346982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bc9b2db3-89a4-4cc6-9ce2-c1e648c61d3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:17:02.435510 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bc9b2db3-89a4-4cc6-9ce2-c1e648c61d3e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 204 len: 0 microversion: 2.1 time: 0.144432 Sep 10 21:17:02.436396 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2982/5841] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:17:02 2022] DELETE /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:17:02.445709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98e126ab-0bc0-46eb-aab0-d62d240a9044 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:02.446364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-98e126ab-0bc0-46eb-aab0-d62d240a9044 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:02.452844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e126ab-0bc0-46eb-aab0-d62d240a9044 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:02.453349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e126ab-0bc0-46eb-aab0-d62d240a9044 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:02.456911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e126ab-0bc0-46eb-aab0-d62d240a9044 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:02.457646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e126ab-0bc0-46eb-aab0-d62d240a9044 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:02.458758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e126ab-0bc0-46eb-aab0-d62d240a9044 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:02.459206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98e126ab-0bc0-46eb-aab0-d62d240a9044 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:02.948261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-98e126ab-0bc0-46eb-aab0-d62d240a9044 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:02.956072 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-98e126ab-0bc0-46eb-aab0-d62d240a9044 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1495 microversion: 2.1 time: 0.515131 Sep 10 21:17:02.956809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2860/5842] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:02 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1495 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:03.317253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b48fdd71-c2e0-4cbc-8a34-ebed5255631b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:03.317989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b48fdd71-c2e0-4cbc-8a34-ebed5255631b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:03.325142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b48fdd71-c2e0-4cbc-8a34-ebed5255631b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:03.325644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b48fdd71-c2e0-4cbc-8a34-ebed5255631b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:03.326132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b48fdd71-c2e0-4cbc-8a34-ebed5255631b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:03.326848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b48fdd71-c2e0-4cbc-8a34-ebed5255631b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:03.327478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b48fdd71-c2e0-4cbc-8a34-ebed5255631b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:03.327920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b48fdd71-c2e0-4cbc-8a34-ebed5255631b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:03.469702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b48fdd71-c2e0-4cbc-8a34-ebed5255631b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:03.478420 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b48fdd71-c2e0-4cbc-8a34-ebed5255631b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.165437 Sep 10 21:17:03.479009 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2983/5843] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:03 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:03.980116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0da245c9-f1fe-4565-a632-75d7c1eae88e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:03.981690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0da245c9-f1fe-4565-a632-75d7c1eae88e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:03.988460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0da245c9-f1fe-4565-a632-75d7c1eae88e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:03.989140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0da245c9-f1fe-4565-a632-75d7c1eae88e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:03.989655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0da245c9-f1fe-4565-a632-75d7c1eae88e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:03.990460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0da245c9-f1fe-4565-a632-75d7c1eae88e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:03.990991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0da245c9-f1fe-4565-a632-75d7c1eae88e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:03.992261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0da245c9-f1fe-4565-a632-75d7c1eae88e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:04.339782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0da245c9-f1fe-4565-a632-75d7c1eae88e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:04.347493 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0da245c9-f1fe-4565-a632-75d7c1eae88e tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 200 len: 1495 microversion: 2.1 time: 0.371981 Sep 10 21:17:04.348076 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2861/5844] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:03 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 1495 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:04.502199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0f247c2e-cd9b-43e9-8486-cc6e5e86241b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:04.502828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0f247c2e-cd9b-43e9-8486-cc6e5e86241b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:04.510841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f247c2e-cd9b-43e9-8486-cc6e5e86241b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:04.511584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f247c2e-cd9b-43e9-8486-cc6e5e86241b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:04.512026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f247c2e-cd9b-43e9-8486-cc6e5e86241b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:04.512912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f247c2e-cd9b-43e9-8486-cc6e5e86241b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:04.513526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f247c2e-cd9b-43e9-8486-cc6e5e86241b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:04.514271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f247c2e-cd9b-43e9-8486-cc6e5e86241b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:04.673283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-215a6d7c-7c1c-4211-a74a-27e8e39b2139 req-5e029ded-c83c-44e0-83a2-ea79e3a6c52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f661c48-654e-41b6-94a2-a8b9c4fa20fb", "name": "network-vif-deleted", "tag": "445b64b9-f81c-4c16-8ad9-e2a81f897746"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:04.687515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-215a6d7c-7c1c-4211-a74a-27e8e39b2139 req-5e029ded-c83c-44e0-83a2-ea79e3a6c52a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:04.688201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-215a6d7c-7c1c-4211-a74a-27e8e39b2139 req-5e029ded-c83c-44e0-83a2-ea79e3a6c52a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:04.688872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-215a6d7c-7c1c-4211-a74a-27e8e39b2139 req-5e029ded-c83c-44e0-83a2-ea79e3a6c52a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:04.711158 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-215a6d7c-7c1c-4211-a74a-27e8e39b2139 req-5e029ded-c83c-44e0-83a2-ea79e3a6c52a service nova] Creating event network-vif-deleted:445b64b9-f81c-4c16-8ad9-e2a81f897746 for instance 1f661c48-654e-41b6-94a2-a8b9c4fa20fb on nch1-master-1 Sep 10 21:17:04.716497 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-215a6d7c-7c1c-4211-a74a-27e8e39b2139 req-5e029ded-c83c-44e0-83a2-ea79e3a6c52a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046768 Sep 10 21:17:04.717541 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2862/5845] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:17:04.821044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f247c2e-cd9b-43e9-8486-cc6e5e86241b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:04.829420 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0f247c2e-cd9b-43e9-8486-cc6e5e86241b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.331149 Sep 10 21:17:04.837153 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2984/5846] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:04 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:05.374725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:05.375447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 1f661c48-654e-41b6-94a2-a8b9c4fa20fb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:05.382304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:05.383058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:05.383697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:05.384421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:05.384889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:05.385322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:05.400332 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] HTTP exception thrown: Instance 1f661c48-654e-41b6-94a2-a8b9c4fa20fb could not be found. Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Request method failure captured: Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb HTTP/1.1 Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP07LJkT0eqhQbcFK2cLpNXQ6K9cp7_Q7ooRPesMYBGiV5ZAWO0tgg0u9XsKAq-Lh655UeWg-VZnfaFjahgGEBoRwA9fWm4uBZBqkVn0zU5bMwf9wPV6zvYKIPMqvVJpU8RzpBN-qlcYr-8aj3HqcZ6QolRcIasDDFEHk_My4lrKqj8 Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_15a76a25754c42099c542fa13046f01b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/15a76a25754c42099c542fa13046f01b"}]}] Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: d83b6ceb599746b394e379d52683b70c Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 1f661c48-654e-41b6-94a2-a8b9c4fa20fb could not be found. Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '1f661c48-654e-41b6-94a2-a8b9c4fa20fb'} Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f661c48-654e-41b6-94a2-a8b9c4fa20fb could not be found. Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f661c48-654e-41b6-94a2-a8b9c4fa20fb could not be found. Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:05.402044 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:05.406274 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:05.406274 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:05.406274 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:05.406274 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:05.406274 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:05.406274 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f661c48-654e-41b6-94a2-a8b9c4fa20fb could not be found. Sep 10 21:17:05.406274 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:05.406274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Returning 404 to user: Instance 1f661c48-654e-41b6-94a2-a8b9c4fa20fb could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:05.406274 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9ddc6f47-1636-4571-bbbe-44028200ab83 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb" status: 404 len: 111 microversion: 2.1 time: 0.033966 Sep 10 21:17:05.406274 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2863/5847] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:05 2022] GET /compute/v2.1/servers/1f661c48-654e-41b6-94a2-a8b9c4fa20fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:17:05.412082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d4a6be62-c38a-4f63-ae09-ec89a6b547c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:05.412595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d4a6be62-c38a-4f63-ae09-ec89a6b547c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:05.419574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4a6be62-c38a-4f63-ae09-ec89a6b547c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:05.420071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4a6be62-c38a-4f63-ae09-ec89a6b547c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:05.420558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4a6be62-c38a-4f63-ae09-ec89a6b547c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:05.421276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4a6be62-c38a-4f63-ae09-ec89a6b547c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:05.421747 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4a6be62-c38a-4f63-ae09-ec89a6b547c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:05.422210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4a6be62-c38a-4f63-ae09-ec89a6b547c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:05.448981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d4a6be62-c38a-4f63-ae09-ec89a6b547c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:17:05.545157 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d4a6be62-c38a-4f63-ae09-ec89a6b547c0 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "DELETE /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 204 len: 0 microversion: 2.1 time: 0.136669 Sep 10 21:17:05.546434 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2985/5848] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:17:05 2022] DELETE /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:17:05.559586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e51a37b9-2577-47e7-b335-bddd28cc94a3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:05.561068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e51a37b9-2577-47e7-b335-bddd28cc94a3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:05.570351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e51a37b9-2577-47e7-b335-bddd28cc94a3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:05.571067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e51a37b9-2577-47e7-b335-bddd28cc94a3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:05.572289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e51a37b9-2577-47e7-b335-bddd28cc94a3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:05.573149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e51a37b9-2577-47e7-b335-bddd28cc94a3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:05.573705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e51a37b9-2577-47e7-b335-bddd28cc94a3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:05.574439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e51a37b9-2577-47e7-b335-bddd28cc94a3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:05.736334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e51a37b9-2577-47e7-b335-bddd28cc94a3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:05.745647 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e51a37b9-2577-47e7-b335-bddd28cc94a3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1676 microversion: 2.1 time: 0.195138 Sep 10 21:17:05.746333 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2864/5849] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:05 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:05.853674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8aeb85c2-5703-4b2f-bcef-6c7772212d31 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:05.854445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8aeb85c2-5703-4b2f-bcef-6c7772212d31 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:05.861335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8aeb85c2-5703-4b2f-bcef-6c7772212d31 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:05.861856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8aeb85c2-5703-4b2f-bcef-6c7772212d31 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:05.862306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8aeb85c2-5703-4b2f-bcef-6c7772212d31 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:05.863012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8aeb85c2-5703-4b2f-bcef-6c7772212d31 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:05.863472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8aeb85c2-5703-4b2f-bcef-6c7772212d31 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:05.863900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8aeb85c2-5703-4b2f-bcef-6c7772212d31 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:06.094572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8aeb85c2-5703-4b2f-bcef-6c7772212d31 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:06.097014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:06.105280 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8aeb85c2-5703-4b2f-bcef-6c7772212d31 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.256035 Sep 10 21:17:06.106005 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2986/5850] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:05 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:06.769623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e96c785d-3842-4959-b729-96a398a7b1b4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:06.770349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e96c785d-3842-4959-b729-96a398a7b1b4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:06.778068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c785d-3842-4959-b729-96a398a7b1b4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:06.778557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c785d-3842-4959-b729-96a398a7b1b4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:06.778992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c785d-3842-4959-b729-96a398a7b1b4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:06.779701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c785d-3842-4959-b729-96a398a7b1b4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:06.780160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c785d-3842-4959-b729-96a398a7b1b4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:06.780588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e96c785d-3842-4959-b729-96a398a7b1b4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:06.923004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e96c785d-3842-4959-b729-96a398a7b1b4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:06.931975 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e96c785d-3842-4959-b729-96a398a7b1b4 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1676 microversion: 2.1 time: 0.166215 Sep 10 21:17:06.932777 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2865/5851] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:06 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:07.135381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cbc2cfbf-39e6-44e8-b8a5-848b44d108d8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:07.136010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cbc2cfbf-39e6-44e8-b8a5-848b44d108d8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:07.143922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbc2cfbf-39e6-44e8-b8a5-848b44d108d8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:07.144431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbc2cfbf-39e6-44e8-b8a5-848b44d108d8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:07.144875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbc2cfbf-39e6-44e8-b8a5-848b44d108d8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:07.145590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbc2cfbf-39e6-44e8-b8a5-848b44d108d8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:07.146154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbc2cfbf-39e6-44e8-b8a5-848b44d108d8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:07.146593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cbc2cfbf-39e6-44e8-b8a5-848b44d108d8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:07.346836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cbc2cfbf-39e6-44e8-b8a5-848b44d108d8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:07.355555 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cbc2cfbf-39e6-44e8-b8a5-848b44d108d8 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.224903 Sep 10 21:17:07.356407 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2987/5852] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:07 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:07.956395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0053cc1f-02fd-4906-8daf-39870ff7a6a1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:07.957696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0053cc1f-02fd-4906-8daf-39870ff7a6a1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:07.974703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0053cc1f-02fd-4906-8daf-39870ff7a6a1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:07.976305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0053cc1f-02fd-4906-8daf-39870ff7a6a1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:07.976844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0053cc1f-02fd-4906-8daf-39870ff7a6a1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:07.977716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0053cc1f-02fd-4906-8daf-39870ff7a6a1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:07.978497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0053cc1f-02fd-4906-8daf-39870ff7a6a1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:07.978642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0053cc1f-02fd-4906-8daf-39870ff7a6a1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:08.379610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc961830-1a32-4fb4-9b6d-1eb1b0c990cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:08.380474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fc961830-1a32-4fb4-9b6d-1eb1b0c990cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:08.393160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc961830-1a32-4fb4-9b6d-1eb1b0c990cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:08.393971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc961830-1a32-4fb4-9b6d-1eb1b0c990cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:08.395012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc961830-1a32-4fb4-9b6d-1eb1b0c990cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:08.395888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0053cc1f-02fd-4906-8daf-39870ff7a6a1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:08.396831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc961830-1a32-4fb4-9b6d-1eb1b0c990cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:08.397387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc961830-1a32-4fb4-9b6d-1eb1b0c990cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:08.397983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc961830-1a32-4fb4-9b6d-1eb1b0c990cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:08.408194 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0053cc1f-02fd-4906-8daf-39870ff7a6a1 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1609 microversion: 2.1 time: 0.455916 Sep 10 21:17:08.423368 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2866/5853] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:07 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1609 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:08.558827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fc961830-1a32-4fb4-9b6d-1eb1b0c990cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:08.567638 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc961830-1a32-4fb4-9b6d-1eb1b0c990cc tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.192523 Sep 10 21:17:08.568234 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2988/5854] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:08 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:17:08.871961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0a466423-9d47-4c5f-bb0e-c8c1cc60716a req-022671cd-008a-48ed-ac1c-5728a44b6ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010766a5-73d4-43bc-8b9b-915530aac069", "name": "network-vif-deleted", "tag": "b3cfb9e7-e626-4a76-b620-73dfc70c87cd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:08.888992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0a466423-9d47-4c5f-bb0e-c8c1cc60716a req-022671cd-008a-48ed-ac1c-5728a44b6ef7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:08.889472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0a466423-9d47-4c5f-bb0e-c8c1cc60716a req-022671cd-008a-48ed-ac1c-5728a44b6ef7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:08.890167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0a466423-9d47-4c5f-bb0e-c8c1cc60716a req-022671cd-008a-48ed-ac1c-5728a44b6ef7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:08.903634 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0a466423-9d47-4c5f-bb0e-c8c1cc60716a req-022671cd-008a-48ed-ac1c-5728a44b6ef7 service nova] Creating event network-vif-deleted:b3cfb9e7-e626-4a76-b620-73dfc70c87cd for instance 010766a5-73d4-43bc-8b9b-915530aac069 on nch2-master-1 Sep 10 21:17:08.908751 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0a466423-9d47-4c5f-bb0e-c8c1cc60716a req-022671cd-008a-48ed-ac1c-5728a44b6ef7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045288 Sep 10 21:17:08.909358 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2867/5855] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:17:09.435544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:09.436296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:09.445188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:09.446472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:09.448265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:09.449733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:09.450671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:09.451297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:09.498951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:09.500611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:09.501460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:09.502584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lazy-loading 'fault' on Instance uuid 010766a5-73d4-43bc-8b9b-915530aac069 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:17:09.592050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83b6ceb599746b394e379d52683b70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a76a25754c42099c542fa13046f01b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:09.593983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e839c739-5765-4fb3-a150-da243dcf37ff tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:09.596724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e839c739-5765-4fb3-a150-da243dcf37ff tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:09.606245 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10dc1aaa-89fa-4d6a-afc0-1e74eb76e5b9 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 200 len: 1329 microversion: 2.1 time: 0.175900 Sep 10 21:17:09.607475 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2989/5856] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:09 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 1329 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:09.640319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e839c739-5765-4fb3-a150-da243dcf37ff tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:09.640800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e839c739-5765-4fb3-a150-da243dcf37ff tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:09.641279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e839c739-5765-4fb3-a150-da243dcf37ff tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:09.642068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e839c739-5765-4fb3-a150-da243dcf37ff tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:09.642547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e839c739-5765-4fb3-a150-da243dcf37ff tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:09.642984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e839c739-5765-4fb3-a150-da243dcf37ff tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:09.815822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e839c739-5765-4fb3-a150-da243dcf37ff tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:09.824952 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e839c739-5765-4fb3-a150-da243dcf37ff tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.236511 Sep 10 21:17:09.825937 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2868/5857] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:09 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:10.638881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:10.639500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] [instance: 010766a5-73d4-43bc-8b9b-915530aac069] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:10.653010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:10.653499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:10.666463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:10.667430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:10.668126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:10.668568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:10.698305 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] HTTP exception thrown: Instance 010766a5-73d4-43bc-8b9b-915530aac069 could not be found. Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Request method failure captured: Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 HTTP/1.1 Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP07LJkT0eqhQbcFK2cLpNXQ6K9cp7_Q7ooRPesMYBGiV5ZAWO0tgg0u9XsKAq-Lh655UeWg-VZnfaFjahgGEBoRwA9fWm4uBZBqkVn0zU5bMwf9wPV6zvYKIPMqvVJpU8RzpBN-qlcYr-8aj3HqcZ6QolRcIasDDFEHk_My4lrKqj8 Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15a76a25754c42099c542fa13046f01b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_15a76a25754c42099c542fa13046f01b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/15a76a25754c42099c542fa13046f01b"}]}] Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 15a76a25754c42099c542fa13046f01b Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerActionsTestJSON-1026058740 Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d83b6ceb599746b394e379d52683b70c Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerActionsTestJSON-1026058740-project Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 010766a5-73d4-43bc-8b9b-915530aac069 could not be found. Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '010766a5-73d4-43bc-8b9b-915530aac069'} Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010766a5-73d4-43bc-8b9b-915530aac069 could not be found. Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010766a5-73d4-43bc-8b9b-915530aac069 could not be found. Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:10.699998 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:10.704525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:10.704525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:10.704525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:10.704525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:10.704525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:10.704525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010766a5-73d4-43bc-8b9b-915530aac069 could not be found. Sep 10 21:17:10.704525 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:10.704525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Returning 404 to user: Instance 010766a5-73d4-43bc-8b9b-915530aac069 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:10.704525 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eec5cdea-492e-41ce-a469-6b43353db9d3 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069" status: 404 len: 111 microversion: 2.1 time: 0.066708 Sep 10 21:17:10.704525 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2990/5858] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:10 2022] GET /compute/v2.1/servers/010766a5-73d4-43bc-8b9b-915530aac069 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:17:10.710341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-26487409-6c5d-47de-a958-0e7db13527f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] Calling method '.version_select at 0x7f993f7b1820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:10.732622 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-26487409-6c5d-47de-a958-0e7db13527f8 tempest-ServerActionsTestJSON-1026058740 tempest-ServerActionsTestJSON-1026058740-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715849076" status: 202 len: 0 microversion: 2.1 time: 0.026142 Sep 10 21:17:10.733571 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2869/5859] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 21:17:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715849076 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:17:10.849396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d4311792-e0d0-4d34-a353-1f55e9df081e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:10.850434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d4311792-e0d0-4d34-a353-1f55e9df081e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:10.857855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4311792-e0d0-4d34-a353-1f55e9df081e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:10.858480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4311792-e0d0-4d34-a353-1f55e9df081e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:10.859356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4311792-e0d0-4d34-a353-1f55e9df081e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:10.860123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4311792-e0d0-4d34-a353-1f55e9df081e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:10.860590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4311792-e0d0-4d34-a353-1f55e9df081e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:10.861034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d4311792-e0d0-4d34-a353-1f55e9df081e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:11.038504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d4311792-e0d0-4d34-a353-1f55e9df081e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:11.047961 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d4311792-e0d0-4d34-a353-1f55e9df081e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.203161 Sep 10 21:17:11.048889 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2991/5860] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:10 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:12.074610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55911b9f-a2f7-4370-b10e-b682c5d74ad7 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:12.087717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55911b9f-a2f7-4370-b10e-b682c5d74ad7 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:12.101615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55911b9f-a2f7-4370-b10e-b682c5d74ad7 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:12.102170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55911b9f-a2f7-4370-b10e-b682c5d74ad7 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:12.102790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55911b9f-a2f7-4370-b10e-b682c5d74ad7 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:12.103441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55911b9f-a2f7-4370-b10e-b682c5d74ad7 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:12.104058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55911b9f-a2f7-4370-b10e-b682c5d74ad7 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:12.104276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55911b9f-a2f7-4370-b10e-b682c5d74ad7 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:12.130034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:12.329478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-55911b9f-a2f7-4370-b10e-b682c5d74ad7 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:12.339157 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55911b9f-a2f7-4370-b10e-b682c5d74ad7 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.270712 Sep 10 21:17:12.339902 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2870/5861] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:12 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:13.364734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d1b14b8-6277-468a-a0d5-85aefadc6616 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:13.365170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7d1b14b8-6277-468a-a0d5-85aefadc6616 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:13.377999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d1b14b8-6277-468a-a0d5-85aefadc6616 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:13.378502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d1b14b8-6277-468a-a0d5-85aefadc6616 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:13.378956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d1b14b8-6277-468a-a0d5-85aefadc6616 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:13.379803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d1b14b8-6277-468a-a0d5-85aefadc6616 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:13.380271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d1b14b8-6277-468a-a0d5-85aefadc6616 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:13.380714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d1b14b8-6277-468a-a0d5-85aefadc6616 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:13.762991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7d1b14b8-6277-468a-a0d5-85aefadc6616 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:13.776639 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7d1b14b8-6277-468a-a0d5-85aefadc6616 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.417470 Sep 10 21:17:13.793905 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2992/5862] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:13 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:14.801656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-60229642-cd08-4801-a777-3189b3030cea tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:14.802215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9a2a1156-7fe4-4e9d-8393-d7552711a0f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Action: 'create', calling method: .version_select at 0x7f993f760160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2080464911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuGefE3Rj2SddVYpguJDOMiSQstvBgdoHtpn3VH6HtLAt6B0iauDys1D8xRI5RWNlptGzDAEV6pZ5ds7JoCmsiepkzTkTBkNYS7XhRfxnFwfruB3om45yhzAgZSfAv00A=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:14.802644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-60229642-cd08-4801-a777-3189b3030cea tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:14.811126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60229642-cd08-4801-a777-3189b3030cea tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:14.811838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60229642-cd08-4801-a777-3189b3030cea tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:14.812294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60229642-cd08-4801-a777-3189b3030cea tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:14.813183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60229642-cd08-4801-a777-3189b3030cea tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:14.813719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60229642-cd08-4801-a777-3189b3030cea tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:14.814405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60229642-cd08-4801-a777-3189b3030cea tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:14.831191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-9a2a1156-7fe4-4e9d-8393-d7552711a0f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:17:14.847359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-9a2a1156-7fe4-4e9d-8393-d7552711a0f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for user 93648515d8fb42a7aaf61e245db0e07d and project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:17:14.887009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9a2a1156-7fe4-4e9d-8393-d7552711a0f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.091827 Sep 10 21:17:14.888261 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2871/5863] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:17:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:15.092129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-60229642-cd08-4801-a777-3189b3030cea tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:15.104931 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-60229642-cd08-4801-a777-3189b3030cea tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.306999 Sep 10 21:17:15.106691 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2993/5864] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:14 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:16.134369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85dfeaaa-8573-4f14-ab66-9076996bfb19 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:16.136814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-85dfeaaa-8573-4f14-ab66-9076996bfb19 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:16.154530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85dfeaaa-8573-4f14-ab66-9076996bfb19 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:16.155569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85dfeaaa-8573-4f14-ab66-9076996bfb19 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:16.156283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85dfeaaa-8573-4f14-ab66-9076996bfb19 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:16.157523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85dfeaaa-8573-4f14-ab66-9076996bfb19 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:16.158267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85dfeaaa-8573-4f14-ab66-9076996bfb19 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:16.167663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85dfeaaa-8573-4f14-ab66-9076996bfb19 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:16.506146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-85dfeaaa-8573-4f14-ab66-9076996bfb19 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:16.523036 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-85dfeaaa-8573-4f14-ab66-9076996bfb19 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.396462 Sep 10 21:17:16.526866 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2872/5865] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:16 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:17.167075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d73c825-f3e2-45d6-a3de-3cff03c72722 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:17.175469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7d73c825-f3e2-45d6-a3de-3cff03c72722 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:17.184563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d73c825-f3e2-45d6-a3de-3cff03c72722 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:17.185297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d73c825-f3e2-45d6-a3de-3cff03c72722 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:17.186964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d73c825-f3e2-45d6-a3de-3cff03c72722 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:17.187936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d73c825-f3e2-45d6-a3de-3cff03c72722 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:17.188619 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d73c825-f3e2-45d6-a3de-3cff03c72722 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:17.189436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d73c825-f3e2-45d6-a3de-3cff03c72722 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:17.270824 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7d73c825-f3e2-45d6-a3de-3cff03c72722 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.113463 Sep 10 21:17:17.271821 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2994/5866] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Sep 10 21:17:17 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:17.362518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1900844880", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f47f1012-8c82-4fc8-95b0-81f719151674"}], "key_name": "tempest-TestNetworkBasicOps-2080464911", "security_groups": [{"name": "tempest-secgroup-smoke-1968656083"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:17.375007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-02dbd800-bcb3-4ada-9903-713f8bb04037 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:17.375517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-02dbd800-bcb3-4ada-9903-713f8bb04037 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:17.382707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02dbd800-bcb3-4ada-9903-713f8bb04037 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:17.383455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02dbd800-bcb3-4ada-9903-713f8bb04037 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:17.384209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02dbd800-bcb3-4ada-9903-713f8bb04037 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:17.385264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02dbd800-bcb3-4ada-9903-713f8bb04037 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:17.389652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02dbd800-bcb3-4ada-9903-713f8bb04037 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:17.390164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-02dbd800-bcb3-4ada-9903-713f8bb04037 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:17.442942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-02dbd800-bcb3-4ada-9903-713f8bb04037 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:17:17.553330 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-02dbd800-bcb3-4ada-9903-713f8bb04037 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 204 len: 0 microversion: 2.20 time: 0.185174 Sep 10 21:17:17.556122 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2995/5867] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:17:17 2022] DELETE /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 21:17:17.563469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6cdc8a80-c0ad-443e-bf97-2f5f5be14eee tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:17.564450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6cdc8a80-c0ad-443e-bf97-2f5f5be14eee tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:17.576493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cdc8a80-c0ad-443e-bf97-2f5f5be14eee tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:17.577221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cdc8a80-c0ad-443e-bf97-2f5f5be14eee tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:17.577863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cdc8a80-c0ad-443e-bf97-2f5f5be14eee tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:17.578765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cdc8a80-c0ad-443e-bf97-2f5f5be14eee tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:17.579388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cdc8a80-c0ad-443e-bf97-2f5f5be14eee tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:17.579979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cdc8a80-c0ad-443e-bf97-2f5f5be14eee tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:17.636865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] validate_networks() for [('f47f1012-8c82-4fc8-95b0-81f719151674', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:17:17.846304 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6cdc8a80-c0ad-443e-bf97-2f5f5be14eee tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:17.861866 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6cdc8a80-c0ad-443e-bf97-2f5f5be14eee tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.304155 Sep 10 21:17:17.881144 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2996/5868] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:17 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:17.887938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:17.888904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:17.898313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:17.899780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:17.900741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:17.902658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:17.903594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:17.904718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:18.119237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:18.129384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:18.131152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:18.132842 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d3c3ac39-0482-476b-a4d6-8308fc746bd0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.248861 Sep 10 21:17:18.133841 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2997/5869] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:17 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:18.274642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:17:18.275360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:17:18.276003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:17:18.276555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:17:18.277666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:17:18.304244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:18.305172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:18.305915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:18.307550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:18.308298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:18.308956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:18.342435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:17:18.366955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for user 93648515d8fb42a7aaf61e245db0e07d and project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:17:18.400588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:17:18.415173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:17:18.481862 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-334521bb-4f0f-4478-a14b-463d278221e4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.133294 Sep 10 21:17:18.484917 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2873/5870] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:17:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:17:18.496444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e85ae986-2cf5-4954-9976-56a5156b5f46 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:18.499846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e85ae986-2cf5-4954-9976-56a5156b5f46 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:18.577549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e85ae986-2cf5-4954-9976-56a5156b5f46 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:18.587297 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e85ae986-2cf5-4954-9976-56a5156b5f46 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1249 microversion: 2.1 time: 0.096143 Sep 10 21:17:18.593615 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2998/5871] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:18 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1249 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:18.885789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a910f7d-6b79-445d-8cc6-a98717e49933 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:18.886615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7a910f7d-6b79-445d-8cc6-a98717e49933 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:18.897380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a910f7d-6b79-445d-8cc6-a98717e49933 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:18.897909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a910f7d-6b79-445d-8cc6-a98717e49933 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:18.898526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a910f7d-6b79-445d-8cc6-a98717e49933 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:18.899760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a910f7d-6b79-445d-8cc6-a98717e49933 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:18.900391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a910f7d-6b79-445d-8cc6-a98717e49933 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:18.900984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7a910f7d-6b79-445d-8cc6-a98717e49933 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:19.160228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:19.161087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:19.173423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:19.176888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:19.177618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:19.180736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:19.181470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:19.183291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:19.449199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:19.465564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:19.470480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:19.472387 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cfad63d4-3028-4ed9-8267-26591180f1d0 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1723 microversion: 2.20 time: 0.316130 Sep 10 21:17:19.487184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 2999/5872] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:19 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:19.524836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7a910f7d-6b79-445d-8cc6-a98717e49933 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:19.532860 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7a910f7d-6b79-445d-8cc6-a98717e49933 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.651183 Sep 10 21:17:19.533648 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2874/5873] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:18 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:19.614540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49fcadd9-8fce-4ad4-bb24-38477b334cf9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:19.615291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-49fcadd9-8fce-4ad4-bb24-38477b334cf9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:19.624871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49fcadd9-8fce-4ad4-bb24-38477b334cf9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:19.625442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49fcadd9-8fce-4ad4-bb24-38477b334cf9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:19.626201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49fcadd9-8fce-4ad4-bb24-38477b334cf9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:19.627153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49fcadd9-8fce-4ad4-bb24-38477b334cf9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:19.628682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49fcadd9-8fce-4ad4-bb24-38477b334cf9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:19.630050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49fcadd9-8fce-4ad4-bb24-38477b334cf9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:19.733421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-49fcadd9-8fce-4ad4-bb24-38477b334cf9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:19.747100 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-49fcadd9-8fce-4ad4-bb24-38477b334cf9 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1301 microversion: 2.1 time: 0.136429 Sep 10 21:17:19.747882 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3000/5874] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:19 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1301 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:20.239727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fa79a6b9-cfae-44e2-b80b-c47f9cf1241e tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f993f6deaf0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:20.304983 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fa79a6b9-cfae-44e2-b80b-c47f9cf1241e tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/66839180-beeb-4470-b265-04f9a5f818e2" status: 200 len: 344 microversion: 2.1 time: 0.069692 Sep 10 21:17:20.305725 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2875/5875] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:17:20 2022] GET /compute/v2.1/os-volumes/66839180-beeb-4470-b265-04f9a5f818e2 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:20.515786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:20.518989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:20.535836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:20.537309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:20.548266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:20.549929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:20.551680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:20.553587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:20.572070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bc39dffe-fc8e-4cc2-9536-317bc9e681d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:20.572916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bc39dffe-fc8e-4cc2-9536-317bc9e681d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:20.579425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:20.621441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc39dffe-fc8e-4cc2-9536-317bc9e681d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:20.622008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc39dffe-fc8e-4cc2-9536-317bc9e681d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:20.622459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc39dffe-fc8e-4cc2-9536-317bc9e681d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:20.623459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc39dffe-fc8e-4cc2-9536-317bc9e681d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:20.626579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc39dffe-fc8e-4cc2-9536-317bc9e681d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:20.634321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc39dffe-fc8e-4cc2-9536-317bc9e681d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:20.864336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:20.902557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:20.907127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:20.912076 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e8697450-7624-4624-a973-3f561742bc8e tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1655 microversion: 2.20 time: 0.409501 Sep 10 21:17:20.915128 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3001/5876] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:20 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1655 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:20.951027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-753f123a-6245-427e-be00-22fe132e3a09 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:20.954672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-753f123a-6245-427e-be00-22fe132e3a09 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:20.977677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753f123a-6245-427e-be00-22fe132e3a09 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:20.979025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753f123a-6245-427e-be00-22fe132e3a09 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:20.979485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753f123a-6245-427e-be00-22fe132e3a09 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:20.982538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753f123a-6245-427e-be00-22fe132e3a09 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:20.983041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753f123a-6245-427e-be00-22fe132e3a09 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:20.986294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-753f123a-6245-427e-be00-22fe132e3a09 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:21.128702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-753f123a-6245-427e-be00-22fe132e3a09 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:21.140876 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-753f123a-6245-427e-be00-22fe132e3a09 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1307 microversion: 2.1 time: 0.210520 Sep 10 21:17:21.141588 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3002/5877] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:20 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1307 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:21.314326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc39dffe-fc8e-4cc2-9536-317bc9e681d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:21.323387 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bc39dffe-fc8e-4cc2-9536-317bc9e681d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.766024 Sep 10 21:17:21.323991 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2876/5878] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:20 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:21.384587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6cde2e35-52b0-40f5-ba21-a6ff0dfb9ab2 req-8eefaf71-8ae4-461f-a728-8f5473d32e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26", "name": "network-vif-deleted", "tag": "0c8d8555-28a1-427f-b57c-affbeeda6daf"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:21.398778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6cde2e35-52b0-40f5-ba21-a6ff0dfb9ab2 req-8eefaf71-8ae4-461f-a728-8f5473d32e11 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:21.399676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6cde2e35-52b0-40f5-ba21-a6ff0dfb9ab2 req-8eefaf71-8ae4-461f-a728-8f5473d32e11 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:21.400495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6cde2e35-52b0-40f5-ba21-a6ff0dfb9ab2 req-8eefaf71-8ae4-461f-a728-8f5473d32e11 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:21.405400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:21.418814 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6cde2e35-52b0-40f5-ba21-a6ff0dfb9ab2 req-8eefaf71-8ae4-461f-a728-8f5473d32e11 service nova] Creating event network-vif-deleted:0c8d8555-28a1-427f-b57c-affbeeda6daf for instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 on nch2-master-1 Sep 10 21:17:21.427178 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6cde2e35-52b0-40f5-ba21-a6ff0dfb9ab2 req-8eefaf71-8ae4-461f-a728-8f5473d32e11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048514 Sep 10 21:17:21.429397 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3003/5879] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:21.884095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eaa5f291-c160-4062-af64-38dbb9199a8f tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f993f7a2940>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:21.949206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:21.952092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:21.971432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:21.974421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:21.975517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:21.977701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:21.981602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:21.982307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:22.074982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:22.075659 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eaa5f291-c160-4062-af64-38dbb9199a8f tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f49ec008-c59b-400e-aac1-787a1349222c" status: 200 len: 343 microversion: 2.1 time: 0.201323 Sep 10 21:17:22.076325 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2877/5880] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:17:21 2022] GET /compute/v2.1/os-volumes/f49ec008-c59b-400e-aac1-787a1349222c => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:22.076838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:22.078178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:22.078686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lazy-loading 'fault' on Instance uuid b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:17:22.166771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-66040276-fba5-466a-b69f-ccdea2b8fa9a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:22.169808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-66040276-fba5-466a-b69f-ccdea2b8fa9a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:22.198999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66040276-fba5-466a-b69f-ccdea2b8fa9a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:22.202634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66040276-fba5-466a-b69f-ccdea2b8fa9a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:22.203146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66040276-fba5-466a-b69f-ccdea2b8fa9a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:22.203933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66040276-fba5-466a-b69f-ccdea2b8fa9a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:22.204420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66040276-fba5-466a-b69f-ccdea2b8fa9a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:22.204871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-66040276-fba5-466a-b69f-ccdea2b8fa9a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:22.249591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:22.268276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:22.270962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f03d688d0ee4d2b951828a3f496c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d055111e2e44ed7afe3b335094df69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:22.273240 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-52589a77-8523-42ba-a8ed-7e283eba85e9 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 200 len: 1371 microversion: 2.20 time: 0.332079 Sep 10 21:17:22.274490 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3004/5881] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:21 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 1371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:17:22.353798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49dd6a3b-20f6-49f0-8f1b-96ff09cf119c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:22.354661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-49dd6a3b-20f6-49f0-8f1b-96ff09cf119c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:22.363813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49dd6a3b-20f6-49f0-8f1b-96ff09cf119c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:22.364484 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49dd6a3b-20f6-49f0-8f1b-96ff09cf119c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:22.365142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49dd6a3b-20f6-49f0-8f1b-96ff09cf119c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:22.367598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49dd6a3b-20f6-49f0-8f1b-96ff09cf119c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:22.368257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49dd6a3b-20f6-49f0-8f1b-96ff09cf119c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:22.368862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49dd6a3b-20f6-49f0-8f1b-96ff09cf119c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:22.670090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-49dd6a3b-20f6-49f0-8f1b-96ff09cf119c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:22.684594 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-49dd6a3b-20f6-49f0-8f1b-96ff09cf119c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1484 microversion: 2.1 time: 0.336042 Sep 10 21:17:22.688076 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3005/5882] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:22 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1484 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:17:22.709485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5716dc5e-55f8-41ac-947a-f0895fca3796 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:22.710336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5716dc5e-55f8-41ac-947a-f0895fca3796 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:22.725867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5716dc5e-55f8-41ac-947a-f0895fca3796 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:22.726631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5716dc5e-55f8-41ac-947a-f0895fca3796 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:22.730711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5716dc5e-55f8-41ac-947a-f0895fca3796 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:22.732793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5716dc5e-55f8-41ac-947a-f0895fca3796 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:22.733456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5716dc5e-55f8-41ac-947a-f0895fca3796 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:22.734092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5716dc5e-55f8-41ac-947a-f0895fca3796 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:22.778855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-66040276-fba5-466a-b69f-ccdea2b8fa9a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:22.791941 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-66040276-fba5-466a-b69f-ccdea2b8fa9a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1375 microversion: 2.1 time: 0.629645 Sep 10 21:17:22.809861 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2878/5883] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:22 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1375 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:22.918966 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5716dc5e-55f8-41ac-947a-f0895fca3796 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "POST /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803/action" status: 202 len: 0 microversion: 2.1 time: 0.213782 Sep 10 21:17:22.925536 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3006/5884] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:17:22 2022] POST /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:17:22.936306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7f9b64c4-8050-4eac-84ba-b138b61fe692 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:22.938843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7f9b64c4-8050-4eac-84ba-b138b61fe692 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:22.983312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f9b64c4-8050-4eac-84ba-b138b61fe692 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:22.983902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f9b64c4-8050-4eac-84ba-b138b61fe692 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:22.984607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f9b64c4-8050-4eac-84ba-b138b61fe692 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:22.985716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f9b64c4-8050-4eac-84ba-b138b61fe692 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:22.988827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f9b64c4-8050-4eac-84ba-b138b61fe692 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:22.990315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f9b64c4-8050-4eac-84ba-b138b61fe692 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:23.305798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:23.306659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:23.319621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:23.323738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:23.325480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:23.326717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:23.327777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:23.329437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:23.330406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:23.357250 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] HTTP exception thrown: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Request method failure captured: Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 HTTP/1.1 Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP1wfHaSCfCkRxOxIe4AM5SN10Bur9bpB2r-9zd49iOEi5encqdNrfNiphzy_K82vOgdeKvxMeZc7GatseKAzB0POCphvQ5xHyBzt8yC_8J-mzSyQMeSKD4E75KvzK5wLqcvsR8uyn4QZyJVcdITVdeyWq_qxNpDNrQdijUD8je0Cco Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d055111e2e44ed7afe3b335094df69a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d055111e2e44ed7afe3b335094df69a"}]}] Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 3f03d688d0ee4d2b951828a3f496c914 Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26'} Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:23.360015 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Returning 404 to user: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dded1aa3-3d3a-44d4-94dd-4063aa0bfcd7 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 404 len: 111 microversion: 2.20 time: 0.065088 Sep 10 21:17:23.372308 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3007/5885] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:23 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:17:23.377690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b45a42a6-e8c5-460f-97d7-8323a2d5c9c6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '.version_select at 0x7f9944fb3ee0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:23.402825 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b45a42a6-e8c5-460f-97d7-8323a2d5c9c6 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386136538" status: 204 len: 0 microversion: 2.20 time: 0.030982 Sep 10 21:17:23.403899 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3008/5886] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Sep 10 21:17:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386136538 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 21:17:23.415596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7f9b64c4-8050-4eac-84ba-b138b61fe692 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:23.425853 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7f9b64c4-8050-4eac-84ba-b138b61fe692 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1492 microversion: 2.1 time: 0.496688 Sep 10 21:17:23.427661 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2879/5887] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:22 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1492 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:23.546634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4a6aed39-47c7-4a6e-a2b2-a299b4c47a0a req-ea4bc4b0-9f5f-4ee1-b8d8-d1764f19bb9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c978c147-9ba5-4f10-b78d-90ddfdf37eca", "tag": "2a41a2d4-c64a-45e0-8232-1d45cf3c112c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:23.564700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4a6aed39-47c7-4a6e-a2b2-a299b4c47a0a req-ea4bc4b0-9f5f-4ee1-b8d8-d1764f19bb9d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:23.565395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4a6aed39-47c7-4a6e-a2b2-a299b4c47a0a req-ea4bc4b0-9f5f-4ee1-b8d8-d1764f19bb9d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:23.566028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4a6aed39-47c7-4a6e-a2b2-a299b4c47a0a req-ea4bc4b0-9f5f-4ee1-b8d8-d1764f19bb9d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:23.578028 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4a6aed39-47c7-4a6e-a2b2-a299b4c47a0a req-ea4bc4b0-9f5f-4ee1-b8d8-d1764f19bb9d service nova] Creating event network-changed:2a41a2d4-c64a-45e0-8232-1d45cf3c112c for instance c978c147-9ba5-4f10-b78d-90ddfdf37eca on nch1-master-1 Sep 10 21:17:23.592371 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4a6aed39-47c7-4a6e-a2b2-a299b4c47a0a req-ea4bc4b0-9f5f-4ee1-b8d8-d1764f19bb9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054018 Sep 10 21:17:23.592989 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3009/5888] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:23.825344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e09d02d5-0334-4f51-9171-9b04b09f57ef tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:23.826296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e09d02d5-0334-4f51-9171-9b04b09f57ef tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:23.832958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09d02d5-0334-4f51-9171-9b04b09f57ef tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:23.833677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09d02d5-0334-4f51-9171-9b04b09f57ef tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:23.834314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09d02d5-0334-4f51-9171-9b04b09f57ef tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:23.836161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09d02d5-0334-4f51-9171-9b04b09f57ef tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:23.836807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09d02d5-0334-4f51-9171-9b04b09f57ef tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:23.837391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09d02d5-0334-4f51-9171-9b04b09f57ef tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:23.889590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2640c484-a33b-43ed-af6f-aa9d598ebbe8 tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f99448af670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:23.984009 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2640c484-a33b-43ed-af6f-aa9d598ebbe8 tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2b19bce4-4c48-4f8e-9c8c-06672e41730a" status: 200 len: 344 microversion: 2.1 time: 0.098794 Sep 10 21:17:23.994879 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3010/5889] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Sep 10 21:17:23 2022] GET /compute/v2.1/os-volumes/2b19bce4-4c48-4f8e-9c8c-06672e41730a => generated 344 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:17:24.000137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-979ce2e5-b848-4f62-ba55-2b979793975a tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f99448e45e0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:24.089880 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-979ce2e5-b848-4f62-ba55-2b979793975a tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.093782 Sep 10 21:17:24.090809 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3011/5890] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Sep 10 21:17:23 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:24.106094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e631629c-cd8c-4f22-b54a-b71d06bf8e6d tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f99466c2ee0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:24.137729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e09d02d5-0334-4f51-9171-9b04b09f57ef tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:24.158773 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e09d02d5-0334-4f51-9171-9b04b09f57ef tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1375 microversion: 2.1 time: 0.337536 Sep 10 21:17:24.162565 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2880/5891] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:23 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1375 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:24.229653 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e631629c-cd8c-4f22-b54a-b71d06bf8e6d tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.127707 Sep 10 21:17:24.240606 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3012/5892] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Sep 10 21:17:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:24.247474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a3bc47e-b2dd-49d2-86de-a4c51223344f tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f993f7341f0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:24.347407 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2a3bc47e-b2dd-49d2-86de-a4c51223344f tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.104853 Sep 10 21:17:24.348319 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2881/5893] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Sep 10 21:17:24 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:17:24.364805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-83ee000f-851d-459c-bca0-b7f6bd4091f1 tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f99448e4ee0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:24.454690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9b79cda2-b10b-4da2-8ccf-3450a718f621 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:24.455484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9b79cda2-b10b-4da2-8ccf-3450a718f621 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:24.466157 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-83ee000f-851d-459c-bca0-b7f6bd4091f1 tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.101032 Sep 10 21:17:24.466728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b79cda2-b10b-4da2-8ccf-3450a718f621 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:24.467124 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3013/5894] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Sep 10 21:17:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:24.470548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b79cda2-b10b-4da2-8ccf-3450a718f621 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:24.470548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b79cda2-b10b-4da2-8ccf-3450a718f621 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:24.470548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b79cda2-b10b-4da2-8ccf-3450a718f621 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:24.470548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b79cda2-b10b-4da2-8ccf-3450a718f621 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:24.470548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b79cda2-b10b-4da2-8ccf-3450a718f621 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:24.492104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-941de3b4-15e3-4a2a-b1aa-14ee3533497d tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f99495b55e0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:24.601922 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-941de3b4-15e3-4a2a-b1aa-14ee3533497d tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.118756 Sep 10 21:17:24.602529 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3014/5895] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Sep 10 21:17:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:17:24.619246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d63a3cde-61e0-4bc9-a0a2-d2c1e7b0164e tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f9949704790>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:24.661785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9b79cda2-b10b-4da2-8ccf-3450a718f621 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:24.670372 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9b79cda2-b10b-4da2-8ccf-3450a718f621 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1492 microversion: 2.1 time: 0.222652 Sep 10 21:17:24.671636 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2882/5896] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:24 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1492 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:24.727160 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d63a3cde-61e0-4bc9-a0a2-d2c1e7b0164e tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.113313 Sep 10 21:17:24.733958 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3015/5897] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 21:17:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:17:24.743602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d2f9e402-034e-47cd-86ec-fe745a720904 tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f993f73ed30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:24.844728 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d2f9e402-034e-47cd-86ec-fe745a720904 tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.106515 Sep 10 21:17:24.845307 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2883/5898] 10.222.0.33 () {58 vars in 1188 bytes} [Sat Sep 10 21:17:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:24.860893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6784f725-56f7-46b0-b8a1-4dee744de91e tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] Calling method '.version_select at 0x7f99448e41f0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:24.953658 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6784f725-56f7-46b0-b8a1-4dee744de91e tempest-VolumesTestJSON-314279606 tempest-VolumesTestJSON-314279606-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.097448 Sep 10 21:17:24.954400 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3016/5899] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Sep 10 21:17:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:25.187467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-75684cfa-2d23-4789-858f-c0cd27d411c0 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:25.188083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-75684cfa-2d23-4789-858f-c0cd27d411c0 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:25.195847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75684cfa-2d23-4789-858f-c0cd27d411c0 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:25.196593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75684cfa-2d23-4789-858f-c0cd27d411c0 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:25.197041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75684cfa-2d23-4789-858f-c0cd27d411c0 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:25.197762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75684cfa-2d23-4789-858f-c0cd27d411c0 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:25.198257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75684cfa-2d23-4789-858f-c0cd27d411c0 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:25.198692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-75684cfa-2d23-4789-858f-c0cd27d411c0 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:25.359428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-75684cfa-2d23-4789-858f-c0cd27d411c0 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:25.369301 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-75684cfa-2d23-4789-858f-c0cd27d411c0 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1375 microversion: 2.1 time: 0.186550 Sep 10 21:17:25.370314 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2884/5900] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:25 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:25.584487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:25.586354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:25.594353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:25.594867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:25.595644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:25.596557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:25.597024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:25.597661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:25.617922 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] HTTP exception thrown: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Request method failure captured: Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 HTTP/1.1 Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP1wfHaSCfCkRxOxIe4AM5SN10Bur9bpB2r-9zd49iOEi5encqdNrfNiphzy_K82vOgdeKvxMeZc7GatseKAzB0POCphvQ5xHyBzt8yC_8J-mzSyQMeSKD4E75KvzK5wLqcvsR8uyn4QZyJVcdITVdeyWq_qxNpDNrQdijUD8je0Cco Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d055111e2e44ed7afe3b335094df69a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d055111e2e44ed7afe3b335094df69a"}]}] Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 3f03d688d0ee4d2b951828a3f496c914 Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26'} Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:25.619683 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Returning 404 to user: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4453e981-9bb8-429e-8939-6f5dcc7ee6ff tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 404 len: 111 microversion: 2.20 time: 0.042068 Sep 10 21:17:25.624934 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3017/5901] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:17:25 2022] DELETE /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:17:25.632144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:25.632414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:25.639260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:25.639952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:25.640556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:25.641304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:25.641752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:25.642205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:25.657211 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] HTTP exception thrown: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Request method failure captured: Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 HTTP/1.1 Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP1wfHaSCfCkRxOxIe4AM5SN10Bur9bpB2r-9zd49iOEi5encqdNrfNiphzy_K82vOgdeKvxMeZc7GatseKAzB0POCphvQ5xHyBzt8yC_8J-mzSyQMeSKD4E75KvzK5wLqcvsR8uyn4QZyJVcdITVdeyWq_qxNpDNrQdijUD8je0Cco Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d055111e2e44ed7afe3b335094df69a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d055111e2e44ed7afe3b335094df69a"}]}] Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 3f03d688d0ee4d2b951828a3f496c914 Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26'} Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:25.660584 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:25.665711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:25.665711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:25.665711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:25.665711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:25.665711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:25.665711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:25.665711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. Sep 10 21:17:25.665711 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:25.667134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Returning 404 to user: Instance b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:25.668374 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a7b5310c-f79d-46f5-87b7-1ee4e8177b99 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26" status: 404 len: 111 microversion: 2.20 time: 0.042423 Sep 10 21:17:25.669241 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2885/5902] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:25 2022] GET /compute/v2.1/servers/b87e0cb9-2c8b-4d45-b24f-8d3bd6095a26 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 10 21:17:25.699653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-05075f8d-a3ec-4b46-be4d-cd9dbeaf8aab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:25.700632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-05075f8d-a3ec-4b46-be4d-cd9dbeaf8aab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:25.708466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05075f8d-a3ec-4b46-be4d-cd9dbeaf8aab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:25.709711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05075f8d-a3ec-4b46-be4d-cd9dbeaf8aab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:25.710539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05075f8d-a3ec-4b46-be4d-cd9dbeaf8aab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:25.711576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05075f8d-a3ec-4b46-be4d-cd9dbeaf8aab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:25.712295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05075f8d-a3ec-4b46-be4d-cd9dbeaf8aab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:25.712937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05075f8d-a3ec-4b46-be4d-cd9dbeaf8aab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:25.915286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-05075f8d-a3ec-4b46-be4d-cd9dbeaf8aab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:25.924476 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-05075f8d-a3ec-4b46-be4d-cd9dbeaf8aab tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1498 microversion: 2.1 time: 0.233979 Sep 10 21:17:25.925272 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3018/5903] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:25 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1498 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:25.955815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2dff3571-8115-4b9e-9a5a-b9e62f14d686 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:25.956315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2dff3571-8115-4b9e-9a5a-b9e62f14d686 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:25.963063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dff3571-8115-4b9e-9a5a-b9e62f14d686 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:25.963824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dff3571-8115-4b9e-9a5a-b9e62f14d686 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:25.964408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dff3571-8115-4b9e-9a5a-b9e62f14d686 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:25.965302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dff3571-8115-4b9e-9a5a-b9e62f14d686 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:25.965935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dff3571-8115-4b9e-9a5a-b9e62f14d686 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:25.966513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2dff3571-8115-4b9e-9a5a-b9e62f14d686 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:25.999542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2dff3571-8115-4b9e-9a5a-b9e62f14d686 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:17:26.110888 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2dff3571-8115-4b9e-9a5a-b9e62f14d686 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "DELETE /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 204 len: 0 microversion: 2.1 time: 0.158022 Sep 10 21:17:26.112142 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2886/5904] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:17:25 2022] DELETE /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:17:26.124074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bdad252a-710e-48b5-ac6d-a6b3fe1b080b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:26.124875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bdad252a-710e-48b5-ac6d-a6b3fe1b080b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:26.134215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdad252a-710e-48b5-ac6d-a6b3fe1b080b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:26.135527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdad252a-710e-48b5-ac6d-a6b3fe1b080b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:26.136011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdad252a-710e-48b5-ac6d-a6b3fe1b080b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:26.136735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdad252a-710e-48b5-ac6d-a6b3fe1b080b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:26.137347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdad252a-710e-48b5-ac6d-a6b3fe1b080b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:26.137809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdad252a-710e-48b5-ac6d-a6b3fe1b080b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:26.324811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bdad252a-710e-48b5-ac6d-a6b3fe1b080b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:26.335358 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bdad252a-710e-48b5-ac6d-a6b3fe1b080b tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.217284 Sep 10 21:17:26.335952 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3019/5905] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:26 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:26.393234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-511bef84-2dc4-41e4-8fea-4c9e769b5d5c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:26.394682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-511bef84-2dc4-41e4-8fea-4c9e769b5d5c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:26.401678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-511bef84-2dc4-41e4-8fea-4c9e769b5d5c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:26.402229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-511bef84-2dc4-41e4-8fea-4c9e769b5d5c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:26.402920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-511bef84-2dc4-41e4-8fea-4c9e769b5d5c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:26.403736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-511bef84-2dc4-41e4-8fea-4c9e769b5d5c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:26.404296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-511bef84-2dc4-41e4-8fea-4c9e769b5d5c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:26.404790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-511bef84-2dc4-41e4-8fea-4c9e769b5d5c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:26.555330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-511bef84-2dc4-41e4-8fea-4c9e769b5d5c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:26.563937 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-511bef84-2dc4-41e4-8fea-4c9e769b5d5c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1375 microversion: 2.1 time: 0.174750 Sep 10 21:17:26.564522 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2887/5906] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:26 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:17:26.862455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:26.863547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:26.879066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:26.880375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:26.881989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:26.883115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:26.884902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:26.885563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:26.905328 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] HTTP exception thrown: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Request method failure captured: Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab HTTP/1.1 Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP1wfHaSCfCkRxOxIe4AM5SN10Bur9bpB2r-9zd49iOEi5encqdNrfNiphzy_K82vOgdeKvxMeZc7GatseKAzB0POCphvQ5xHyBzt8yC_8J-mzSyQMeSKD4E75KvzK5wLqcvsR8uyn4QZyJVcdITVdeyWq_qxNpDNrQdijUD8je0Cco Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d055111e2e44ed7afe3b335094df69a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d055111e2e44ed7afe3b335094df69a"}]}] Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 3f03d688d0ee4d2b951828a3f496c914 Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '7919a6b0-623c-440c-bece-f3879f6a89ab'} Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:26.907315 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:17:26.912253 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:17:26.914792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Returning 404 to user: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:26.915878 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0e31e4fa-3557-495c-9101-256db8a243f4 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 404 len: 111 microversion: 2.20 time: 0.057453 Sep 10 21:17:26.916863 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3020/5907] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:17:26 2022] DELETE /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:17:26.931978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:26.932524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] [instance: 7919a6b0-623c-440c-bece-f3879f6a89ab] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:26.941391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:26.942171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:26.942777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:26.944297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:26.945225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:26.946427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:26.983584 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] HTTP exception thrown: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Request method failure captured: Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab HTTP/1.1 Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP1wfHaSCfCkRxOxIe4AM5SN10Bur9bpB2r-9zd49iOEi5encqdNrfNiphzy_K82vOgdeKvxMeZc7GatseKAzB0POCphvQ5xHyBzt8yC_8J-mzSyQMeSKD4E75KvzK5wLqcvsR8uyn4QZyJVcdITVdeyWq_qxNpDNrQdijUD8je0Cco Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d055111e2e44ed7afe3b335094df69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d055111e2e44ed7afe3b335094df69a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d055111e2e44ed7afe3b335094df69a"}]}] Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 2d055111e2e44ed7afe3b335094df69a Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-111626410 Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 3f03d688d0ee4d2b951828a3f496c914 Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-111626410-project Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '7919a6b0-623c-440c-bece-f3879f6a89ab'} Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:26.985280 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:26.990157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:26.990157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:26.990157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:26.990157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:26.990157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:26.990157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:26.990157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. Sep 10 21:17:26.990157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:26.990157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] Returning 404 to user: Instance 7919a6b0-623c-440c-bece-f3879f6a89ab could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:26.990157 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a9fcbd9-3e73-4d17-aa6d-e47c75db3b52 tempest-AttachVolumeShelveTestJSON-111626410 tempest-AttachVolumeShelveTestJSON-111626410-project] 10.222.0.33 "GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab" status: 404 len: 111 microversion: 2.20 time: 0.065872 Sep 10 21:17:26.992434 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2888/5908] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:26 2022] GET /compute/v2.1/servers/7919a6b0-623c-440c-bece-f3879f6a89ab => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 10 21:17:27.359398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2fcf0e40-c474-469a-b661-e1d89614e3d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:27.360029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2fcf0e40-c474-469a-b661-e1d89614e3d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:27.377395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fcf0e40-c474-469a-b661-e1d89614e3d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:27.377923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fcf0e40-c474-469a-b661-e1d89614e3d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:27.378378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fcf0e40-c474-469a-b661-e1d89614e3d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:27.379103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fcf0e40-c474-469a-b661-e1d89614e3d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:27.379568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fcf0e40-c474-469a-b661-e1d89614e3d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:27.380027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2fcf0e40-c474-469a-b661-e1d89614e3d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:27.591812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a713bf3-4397-43cf-97f6-28400e4ff1d8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:27.592485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3a713bf3-4397-43cf-97f6-28400e4ff1d8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:27.605444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a713bf3-4397-43cf-97f6-28400e4ff1d8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:27.613015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a713bf3-4397-43cf-97f6-28400e4ff1d8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:27.613479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a713bf3-4397-43cf-97f6-28400e4ff1d8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:27.614275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a713bf3-4397-43cf-97f6-28400e4ff1d8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:27.614747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a713bf3-4397-43cf-97f6-28400e4ff1d8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:27.622639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a713bf3-4397-43cf-97f6-28400e4ff1d8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:27.863385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a713bf3-4397-43cf-97f6-28400e4ff1d8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:27.876605 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3a713bf3-4397-43cf-97f6-28400e4ff1d8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1375 microversion: 2.1 time: 0.292074 Sep 10 21:17:27.878039 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2889/5909] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:27 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1375 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:27.993682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2fcf0e40-c474-469a-b661-e1d89614e3d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:28.009107 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2fcf0e40-c474-469a-b661-e1d89614e3d0 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.653752 Sep 10 21:17:28.011748 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3021/5910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:27 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:28.901148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d89e671-a8ae-43bb-950c-47dd9c05a17e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:28.903743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d89e671-a8ae-43bb-950c-47dd9c05a17e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:28.905066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:28.906305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=10 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:28.912197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89e671-a8ae-43bb-950c-47dd9c05a17e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:28.913957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89e671-a8ae-43bb-950c-47dd9c05a17e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:28.914635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89e671-a8ae-43bb-950c-47dd9c05a17e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:28.915602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89e671-a8ae-43bb-950c-47dd9c05a17e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:28.916073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89e671-a8ae-43bb-950c-47dd9c05a17e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:28.916508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d89e671-a8ae-43bb-950c-47dd9c05a17e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:29.034894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7f1f8541-c1c8-47ed-bfc6-588873a14393 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:29.035574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7f1f8541-c1c8-47ed-bfc6-588873a14393 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:29.038077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:29.044900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f1f8541-c1c8-47ed-bfc6-588873a14393 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:29.045414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f1f8541-c1c8-47ed-bfc6-588873a14393 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:29.046389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f1f8541-c1c8-47ed-bfc6-588873a14393 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:29.047316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f1f8541-c1c8-47ed-bfc6-588873a14393 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:29.047953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f1f8541-c1c8-47ed-bfc6-588873a14393 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:29.048557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7f1f8541-c1c8-47ed-bfc6-588873a14393 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:29.178635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3d89e671-a8ae-43bb-950c-47dd9c05a17e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:29.188123 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d89e671-a8ae-43bb-950c-47dd9c05a17e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1375 microversion: 2.1 time: 0.291406 Sep 10 21:17:29.195145 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2890/5911] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:28 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1375 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:29.362373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7f1f8541-c1c8-47ed-bfc6-588873a14393 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:29.372230 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7f1f8541-c1c8-47ed-bfc6-588873a14393 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1504 microversion: 2.1 time: 0.341722 Sep 10 21:17:29.373122 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3022/5912] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:29 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:17:29.911504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e2313a00-b0cd-4dfd-940c-aa61be518e5c req-8813c2e2-2922-4043-a1d0-a7a7f2035f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c978c147-9ba5-4f10-b78d-90ddfdf37eca", "name": "network-vif-plugged", "status": "completed", "tag": "2a41a2d4-c64a-45e0-8232-1d45cf3c112c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:29.952106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e2313a00-b0cd-4dfd-940c-aa61be518e5c req-8813c2e2-2922-4043-a1d0-a7a7f2035f55 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:29.957652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e2313a00-b0cd-4dfd-940c-aa61be518e5c req-8813c2e2-2922-4043-a1d0-a7a7f2035f55 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:29.958177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e2313a00-b0cd-4dfd-940c-aa61be518e5c req-8813c2e2-2922-4043-a1d0-a7a7f2035f55 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:30.011152 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e2313a00-b0cd-4dfd-940c-aa61be518e5c req-8813c2e2-2922-4043-a1d0-a7a7f2035f55 service nova] Creating event network-vif-plugged:2a41a2d4-c64a-45e0-8232-1d45cf3c112c for instance c978c147-9ba5-4f10-b78d-90ddfdf37eca on nch1-master-1 Sep 10 21:17:30.027254 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e2313a00-b0cd-4dfd-940c-aa61be518e5c req-8813c2e2-2922-4043-a1d0-a7a7f2035f55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115760 Sep 10 21:17:30.031356 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2891/5913] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:30.216243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bc6cb809-3906-4b83-b98a-2a53d7a42925 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:30.217582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bc6cb809-3906-4b83-b98a-2a53d7a42925 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:30.234542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc6cb809-3906-4b83-b98a-2a53d7a42925 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:30.235521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc6cb809-3906-4b83-b98a-2a53d7a42925 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:30.238066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc6cb809-3906-4b83-b98a-2a53d7a42925 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:30.240383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc6cb809-3906-4b83-b98a-2a53d7a42925 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:30.241967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc6cb809-3906-4b83-b98a-2a53d7a42925 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:30.244509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc6cb809-3906-4b83-b98a-2a53d7a42925 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:30.273717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d4e0a07a-7548-4f98-b628-d57591ea3cc9 req-2118c9c6-2450-47a7-9062-d3167d1eb00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42984cfc-7066-4626-b537-5916ae2e2803", "name": "network-vif-deleted", "tag": "eda49759-650f-472d-84a8-b76180f33c9c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:30.310630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d4e0a07a-7548-4f98-b628-d57591ea3cc9 req-2118c9c6-2450-47a7-9062-d3167d1eb00c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:30.312334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d4e0a07a-7548-4f98-b628-d57591ea3cc9 req-2118c9c6-2450-47a7-9062-d3167d1eb00c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:30.316547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d4e0a07a-7548-4f98-b628-d57591ea3cc9 req-2118c9c6-2450-47a7-9062-d3167d1eb00c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:30.386706 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d4e0a07a-7548-4f98-b628-d57591ea3cc9 req-2118c9c6-2450-47a7-9062-d3167d1eb00c service nova] Creating event network-vif-deleted:eda49759-650f-472d-84a8-b76180f33c9c for instance 42984cfc-7066-4626-b537-5916ae2e2803 on nch2-master-1 Sep 10 21:17:30.405413 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d4e0a07a-7548-4f98-b628-d57591ea3cc9 req-2118c9c6-2450-47a7-9062-d3167d1eb00c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136049 Sep 10 21:17:30.418107 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2892/5914] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:17:30.439192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:30.442406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:30.464403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:30.464626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:30.472683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:30.473849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:30.480404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:30.481399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:30.557876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:30.572864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:30.573556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:30.575615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lazy-loading 'fault' on Instance uuid 42984cfc-7066-4626-b537-5916ae2e2803 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:17:30.586992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:30.657255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:30.666535 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fd3b3b67-bd34-49bd-8743-3d18fb723a1d tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 200 len: 1303 microversion: 2.1 time: 0.247096 Sep 10 21:17:30.667484 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2893/5915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:30 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 1303 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:30.778701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bc6cb809-3906-4b83-b98a-2a53d7a42925 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:30.807365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bc6cb809-3906-4b83-b98a-2a53d7a42925 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1375 microversion: 2.1 time: 0.594515 Sep 10 21:17:30.810365 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3023/5916] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:30 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1375 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:31.695528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:31.696163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: 42984cfc-7066-4626-b537-5916ae2e2803] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:31.707245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:31.707736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:31.711496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:31.712637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:31.714006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:31.715398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:31.757609 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] HTTP exception thrown: Instance 42984cfc-7066-4626-b537-5916ae2e2803 could not be found. Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Request method failure captured: Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 HTTP/1.1 Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP6B6fDYkTt8OUAcovCx09eBi2jS8lwQH2k0XVzXBj3rWQVyYJzPtugXTS5ehpBh1gIfE45XT4JL9RRZ1RB5b1IcKr6IwNL2NQxsqnmsJHZWFHgu6u_0rPiTOLYWr-BPGznmJJTd-Nx51ugWyw-8mWfH-aza7CgwF50jrvX-Be4Dx3M Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 3d9f98a3f93d409a94ee87eec97206c1 Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerRescueTestJSON-1729781690 Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3d9f98a3f93d409a94ee87eec97206c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3d9f98a3f93d409a94ee87eec97206c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3d9f98a3f93d409a94ee87eec97206c1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3d9f98a3f93d409a94ee87eec97206c1"}]}] Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerRescueTestJSON-1729781690 Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 3d9f98a3f93d409a94ee87eec97206c1 Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerRescueTestJSON-1729781690 Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerRescueTestJSON-1729781690-project Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: eac0a8d66da042e096cab5c715f40a27 Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerRescueTestJSON-1729781690-project Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 42984cfc-7066-4626-b537-5916ae2e2803 could not be found. Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '42984cfc-7066-4626-b537-5916ae2e2803'} Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42984cfc-7066-4626-b537-5916ae2e2803 could not be found. Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42984cfc-7066-4626-b537-5916ae2e2803 could not be found. Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:31.760533 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:31.765101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:31.765101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:31.765101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:31.765101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:31.765101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:31.765101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42984cfc-7066-4626-b537-5916ae2e2803 could not be found. Sep 10 21:17:31.765101 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:31.773946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Returning 404 to user: Instance 42984cfc-7066-4626-b537-5916ae2e2803 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:31.775661 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f36c0e42-f2dd-41c3-9e28-6bf3bdb4957e tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803" status: 404 len: 111 microversion: 2.1 time: 0.085553 Sep 10 21:17:31.776275 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2894/5917] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:31 2022] GET /compute/v2.1/servers/42984cfc-7066-4626-b537-5916ae2e2803 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:17:31.789311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-90f61ffd-9b41-41f6-88a1-ca160ed70d60 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:31.790539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-90f61ffd-9b41-41f6-88a1-ca160ed70d60 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:31.802244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90f61ffd-9b41-41f6-88a1-ca160ed70d60 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:31.805312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90f61ffd-9b41-41f6-88a1-ca160ed70d60 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:31.808046 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90f61ffd-9b41-41f6-88a1-ca160ed70d60 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:31.809098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90f61ffd-9b41-41f6-88a1-ca160ed70d60 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:31.809726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90f61ffd-9b41-41f6-88a1-ca160ed70d60 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:31.810353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90f61ffd-9b41-41f6-88a1-ca160ed70d60 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:31.837966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-84186e19-749a-46e3-aa56-5e3c519c96fa tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:31.838905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-84186e19-749a-46e3-aa56-5e3c519c96fa tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:31.855724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84186e19-749a-46e3-aa56-5e3c519c96fa tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:31.856752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84186e19-749a-46e3-aa56-5e3c519c96fa tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:31.857369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84186e19-749a-46e3-aa56-5e3c519c96fa tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:31.859295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84186e19-749a-46e3-aa56-5e3c519c96fa tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:31.862046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84186e19-749a-46e3-aa56-5e3c519c96fa tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:31.863855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84186e19-749a-46e3-aa56-5e3c519c96fa tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:31.888900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-90f61ffd-9b41-41f6-88a1-ca160ed70d60 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:17:32.165677 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-90f61ffd-9b41-41f6-88a1-ca160ed70d60 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 204 len: 0 microversion: 2.1 time: 0.384741 Sep 10 21:17:32.169295 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3024/5918] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:17:31 2022] DELETE /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:17:32.176872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-18d1dc03-7fa5-408a-843e-eac42dad9bd3 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:32.177853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-18d1dc03-7fa5-408a-843e-eac42dad9bd3 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:32.180755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-84186e19-749a-46e3-aa56-5e3c519c96fa tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:32.187384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18d1dc03-7fa5-408a-843e-eac42dad9bd3 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:32.188086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18d1dc03-7fa5-408a-843e-eac42dad9bd3 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:32.188645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18d1dc03-7fa5-408a-843e-eac42dad9bd3 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:32.190973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18d1dc03-7fa5-408a-843e-eac42dad9bd3 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:32.191618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18d1dc03-7fa5-408a-843e-eac42dad9bd3 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:32.192149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18d1dc03-7fa5-408a-843e-eac42dad9bd3 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:32.193287 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-84186e19-749a-46e3-aa56-5e3c519c96fa tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1375 microversion: 2.1 time: 0.364741 Sep 10 21:17:32.195541 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2895/5919] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:31 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1375 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:32.477862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-18d1dc03-7fa5-408a-843e-eac42dad9bd3 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:32.486400 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-18d1dc03-7fa5-408a-843e-eac42dad9bd3 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1490 microversion: 2.1 time: 0.314759 Sep 10 21:17:32.492252 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3025/5920] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:32 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1490 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:33.219788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c988827-622a-4325-b4e8-311a732b5361 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:33.220600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c988827-622a-4325-b4e8-311a732b5361 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:33.231974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c988827-622a-4325-b4e8-311a732b5361 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:33.233606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c988827-622a-4325-b4e8-311a732b5361 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:33.234307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c988827-622a-4325-b4e8-311a732b5361 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:33.235258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c988827-622a-4325-b4e8-311a732b5361 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:33.236002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c988827-622a-4325-b4e8-311a732b5361 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:33.236648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c988827-622a-4325-b4e8-311a732b5361 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:33.453274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6c988827-622a-4325-b4e8-311a732b5361 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:33.466596 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c988827-622a-4325-b4e8-311a732b5361 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1548 microversion: 2.1 time: 0.252814 Sep 10 21:17:33.467374 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2896/5921] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:33 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1548 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:33.495397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ff5011a4-7e1b-436a-91f2-eedb157ee93e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:33.495397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ff5011a4-7e1b-436a-91f2-eedb157ee93e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:33.501632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff5011a4-7e1b-436a-91f2-eedb157ee93e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:33.502145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff5011a4-7e1b-436a-91f2-eedb157ee93e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:33.502814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff5011a4-7e1b-436a-91f2-eedb157ee93e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:33.505572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff5011a4-7e1b-436a-91f2-eedb157ee93e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:33.507758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff5011a4-7e1b-436a-91f2-eedb157ee93e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:33.508656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff5011a4-7e1b-436a-91f2-eedb157ee93e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:33.511298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bb354a76-9efb-48e0-947e-384de0755a21 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:33.511981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bb354a76-9efb-48e0-947e-384de0755a21 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:33.524552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb354a76-9efb-48e0-947e-384de0755a21 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:33.525071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb354a76-9efb-48e0-947e-384de0755a21 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:33.525520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb354a76-9efb-48e0-947e-384de0755a21 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:33.529148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb354a76-9efb-48e0-947e-384de0755a21 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:33.529915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb354a76-9efb-48e0-947e-384de0755a21 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:33.531391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb354a76-9efb-48e0-947e-384de0755a21 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:33.762862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ff5011a4-7e1b-436a-91f2-eedb157ee93e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:33.772668 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ff5011a4-7e1b-436a-91f2-eedb157ee93e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1548 microversion: 2.1 time: 0.284127 Sep 10 21:17:33.773246 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3026/5922] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:33 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1548 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:33.807736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bb354a76-9efb-48e0-947e-384de0755a21 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:33.815833 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bb354a76-9efb-48e0-947e-384de0755a21 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1490 microversion: 2.1 time: 0.309376 Sep 10 21:17:33.816414 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2897/5923] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:33 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1490 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:17:34.846526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-55c6d2dc-116b-4376-aa41-c22f244849f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:34.846526 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-55c6d2dc-116b-4376-aa41-c22f244849f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:34.853900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55c6d2dc-116b-4376-aa41-c22f244849f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:34.854718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55c6d2dc-116b-4376-aa41-c22f244849f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:34.855260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55c6d2dc-116b-4376-aa41-c22f244849f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:34.857020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55c6d2dc-116b-4376-aa41-c22f244849f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:34.857555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55c6d2dc-116b-4376-aa41-c22f244849f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:34.858245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55c6d2dc-116b-4376-aa41-c22f244849f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:35.043872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-55c6d2dc-116b-4376-aa41-c22f244849f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:35.054985 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-55c6d2dc-116b-4376-aa41-c22f244849f9 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1490 microversion: 2.1 time: 0.217651 Sep 10 21:17:35.059275 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3027/5924] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:34 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1490 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:17:35.756812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-7f46af52-10ac-4b7d-8016-acad11896813 req-31f92d6c-53a5-452e-b9c9-0c9faafda809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5eb0bd1-784c-46dc-93eb-ac3ee145635d", "name": "network-vif-deleted", "tag": "8763e159-351b-434e-b3ac-c39d9396d62d"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:35.766169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7f46af52-10ac-4b7d-8016-acad11896813 req-31f92d6c-53a5-452e-b9c9-0c9faafda809 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:35.766664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7f46af52-10ac-4b7d-8016-acad11896813 req-31f92d6c-53a5-452e-b9c9-0c9faafda809 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:35.767103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-7f46af52-10ac-4b7d-8016-acad11896813 req-31f92d6c-53a5-452e-b9c9-0c9faafda809 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:35.783744 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-7f46af52-10ac-4b7d-8016-acad11896813 req-31f92d6c-53a5-452e-b9c9-0c9faafda809 service nova] Creating event network-vif-deleted:8763e159-351b-434e-b3ac-c39d9396d62d for instance b5eb0bd1-784c-46dc-93eb-ac3ee145635d on nch1-master-1 Sep 10 21:17:35.793579 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-7f46af52-10ac-4b7d-8016-acad11896813 req-31f92d6c-53a5-452e-b9c9-0c9faafda809 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045275 Sep 10 21:17:35.798569 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2898/5925] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:17:36.088315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:36.089043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:36.097782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:36.098454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:36.099080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:36.100025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:36.100564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:36.101138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:36.132480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:36.147745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:36.148588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:36.149236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:36.149955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lazy-loading 'fault' on Instance uuid b5eb0bd1-784c-46dc-93eb-ac3ee145635d {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:17:36.207174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac0a8d66da042e096cab5c715f40a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9f98a3f93d409a94ee87eec97206c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:36.217486 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-87a53c55-0355-4f07-87e4-21771a2ded96 tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 200 len: 1303 microversion: 2.1 time: 0.133841 Sep 10 21:17:36.218530 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3028/5926] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:36 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:37.251706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:37.252406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] [instance: b5eb0bd1-784c-46dc-93eb-ac3ee145635d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:37.268346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:37.273989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:37.274449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:37.275190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:37.275649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:37.276076 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:37.301060 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] HTTP exception thrown: Instance b5eb0bd1-784c-46dc-93eb-ac3ee145635d could not be found. Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Request method failure captured: Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d HTTP/1.1 Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP6B6fDYkTt8OUAcovCx09eBi2jS8lwQH2k0XVzXBj3rWQVyYJzPtugXTS5ehpBh1gIfE45XT4JL9RRZ1RB5b1IcKr6IwNL2NQxsqnmsJHZWFHgu6u_0rPiTOLYWr-BPGznmJJTd-Nx51ugWyw-8mWfH-aza7CgwF50jrvX-Be4Dx3M Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 3d9f98a3f93d409a94ee87eec97206c1 Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerRescueTestJSON-1729781690 Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3d9f98a3f93d409a94ee87eec97206c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3d9f98a3f93d409a94ee87eec97206c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3d9f98a3f93d409a94ee87eec97206c1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3d9f98a3f93d409a94ee87eec97206c1"}]}] Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerRescueTestJSON-1729781690 Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 3d9f98a3f93d409a94ee87eec97206c1 Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerRescueTestJSON-1729781690 Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerRescueTestJSON-1729781690-project Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: eac0a8d66da042e096cab5c715f40a27 Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerRescueTestJSON-1729781690-project Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b5eb0bd1-784c-46dc-93eb-ac3ee145635d could not be found. Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b5eb0bd1-784c-46dc-93eb-ac3ee145635d'} Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5eb0bd1-784c-46dc-93eb-ac3ee145635d could not be found. Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5eb0bd1-784c-46dc-93eb-ac3ee145635d could not be found. Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:37.303170 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:37.309078 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:37.309078 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:37.309078 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:37.309078 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:37.309078 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:37.309078 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5eb0bd1-784c-46dc-93eb-ac3ee145635d could not be found. Sep 10 21:17:37.309078 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:37.311383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] Returning 404 to user: Instance b5eb0bd1-784c-46dc-93eb-ac3ee145635d could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:37.312710 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2080db6b-f2cb-488d-9098-9fbadeb5711c tempest-ServerRescueTestJSON-1729781690 tempest-ServerRescueTestJSON-1729781690-project] 10.222.0.33 "GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d" status: 404 len: 111 microversion: 2.1 time: 0.069456 Sep 10 21:17:37.313724 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2899/5927] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:37 2022] GET /compute/v2.1/servers/b5eb0bd1-784c-46dc-93eb-ac3ee145635d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:17:39.604016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bd8bb473-a950-4956-9bd5-7d8e9fcc5bd9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:39.605244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bd8bb473-a950-4956-9bd5-7d8e9fcc5bd9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:39.613243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd8bb473-a950-4956-9bd5-7d8e9fcc5bd9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:39.619106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd8bb473-a950-4956-9bd5-7d8e9fcc5bd9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:39.619615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd8bb473-a950-4956-9bd5-7d8e9fcc5bd9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:39.620968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd8bb473-a950-4956-9bd5-7d8e9fcc5bd9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:39.621690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd8bb473-a950-4956-9bd5-7d8e9fcc5bd9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:39.622785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd8bb473-a950-4956-9bd5-7d8e9fcc5bd9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:39.779322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-bd8bb473-a950-4956-9bd5-7d8e9fcc5bd9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lazy-loading 'services' on Instance uuid 6bea937c-8d71-4a89-a3d2-73a337fe9e43 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:17:39.960705 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bd8bb473-a950-4956-9bd5-7d8e9fcc5bd9 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43/os-volume_attachments/17e9affe-6cc0-4457-a1df-c7bd87e924ce" status: 202 len: 0 microversion: 2.1 time: 0.360983 Sep 10 21:17:39.962022 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3029/5928] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 21:17:39 2022] DELETE /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43/os-volume_attachments/17e9affe-6cc0-4457-a1df-c7bd87e924ce => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:17:41.174350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db736d03-0be1-48e1-bfd4-3222551a1a42 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:41.175970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-db736d03-0be1-48e1-bfd4-3222551a1a42 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:41.199267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db736d03-0be1-48e1-bfd4-3222551a1a42 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:41.200566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db736d03-0be1-48e1-bfd4-3222551a1a42 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:41.202027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db736d03-0be1-48e1-bfd4-3222551a1a42 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:41.203121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db736d03-0be1-48e1-bfd4-3222551a1a42 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:41.205044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db736d03-0be1-48e1-bfd4-3222551a1a42 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:41.207569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db736d03-0be1-48e1-bfd4-3222551a1a42 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:41.835247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-db736d03-0be1-48e1-bfd4-3222551a1a42 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:17:41.983183 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-db736d03-0be1-48e1-bfd4-3222551a1a42 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 204 len: 0 microversion: 2.1 time: 0.812378 Sep 10 21:17:41.985053 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2900/5929] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:17:41 2022] DELETE /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:17:42.009687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ff6bc404-6827-4f54-bf47-abb7a99336b6 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:42.012837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ff6bc404-6827-4f54-bf47-abb7a99336b6 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:42.070247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff6bc404-6827-4f54-bf47-abb7a99336b6 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:42.072285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff6bc404-6827-4f54-bf47-abb7a99336b6 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:42.074459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff6bc404-6827-4f54-bf47-abb7a99336b6 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:42.075906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff6bc404-6827-4f54-bf47-abb7a99336b6 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:42.079636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff6bc404-6827-4f54-bf47-abb7a99336b6 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:42.080108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ff6bc404-6827-4f54-bf47-abb7a99336b6 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:42.891932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ff6bc404-6827-4f54-bf47-abb7a99336b6 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:42.902943 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ff6bc404-6827-4f54-bf47-abb7a99336b6 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1514 microversion: 2.1 time: 0.913496 Sep 10 21:17:42.918561 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3030/5930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:41 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1514 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:17:43.930022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bc3d2432-752d-40d2-ab0b-ddbbd99b0366 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:43.931403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bc3d2432-752d-40d2-ab0b-ddbbd99b0366 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:43.940123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3d2432-752d-40d2-ab0b-ddbbd99b0366 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:43.940928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3d2432-752d-40d2-ab0b-ddbbd99b0366 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:43.941553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3d2432-752d-40d2-ab0b-ddbbd99b0366 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:43.942608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3d2432-752d-40d2-ab0b-ddbbd99b0366 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:43.943230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3d2432-752d-40d2-ab0b-ddbbd99b0366 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:43.944249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3d2432-752d-40d2-ab0b-ddbbd99b0366 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:44.218349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc3d2432-752d-40d2-ab0b-ddbbd99b0366 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c96909ab4eb449d81769b4c1a52ec88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a0bb2cc874614b0061f4c71ce082d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:44.230225 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bc3d2432-752d-40d2-ab0b-ddbbd99b0366 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 200 len: 1514 microversion: 2.1 time: 0.305836 Sep 10 21:17:44.230812 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2901/5931] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:43 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 1514 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:17:44.434881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3f33f78d-4846-4ed4-9fc9-f14d25e9b5ee req-d0d506a3-1b2a-4530-bcac-d0d5c92ac4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bea937c-8d71-4a89-a3d2-73a337fe9e43", "name": "network-vif-deleted", "tag": "0ae638fe-5b88-4b4d-93a8-13bc37bb0641"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:44.446973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f33f78d-4846-4ed4-9fc9-f14d25e9b5ee req-d0d506a3-1b2a-4530-bcac-d0d5c92ac4d2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:44.447423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f33f78d-4846-4ed4-9fc9-f14d25e9b5ee req-d0d506a3-1b2a-4530-bcac-d0d5c92ac4d2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:44.448182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3f33f78d-4846-4ed4-9fc9-f14d25e9b5ee req-d0d506a3-1b2a-4530-bcac-d0d5c92ac4d2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:44.461322 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3f33f78d-4846-4ed4-9fc9-f14d25e9b5ee req-d0d506a3-1b2a-4530-bcac-d0d5c92ac4d2 service nova] Creating event network-vif-deleted:0ae638fe-5b88-4b4d-93a8-13bc37bb0641 for instance 6bea937c-8d71-4a89-a3d2-73a337fe9e43 on nch2-master-1 Sep 10 21:17:44.466941 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3f33f78d-4846-4ed4-9fc9-f14d25e9b5ee req-d0d506a3-1b2a-4530-bcac-d0d5c92ac4d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035613 Sep 10 21:17:44.467909 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3031/5932] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:17:45.257696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:45.258358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] [instance: 6bea937c-8d71-4a89-a3d2-73a337fe9e43] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:45.266748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:45.267484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:45.267936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:45.268665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:45.269135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:45.269573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:45.284793 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] HTTP exception thrown: Instance 6bea937c-8d71-4a89-a3d2-73a337fe9e43 could not be found. Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Request method failure captured: Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 HTTP/1.1 Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHPy6fR-f23NiKySWcGkRfOSL8oNw44bjIDd36MgRAlmsMLISWrlNZDrjQeICxb_FjSSmJAfEgxu81aYDrFt-IsIDaYbiG453RpY6rhCq7M8ULDSuC6L-MbhyCmkADePLbGaI1ewcasIQq0AhEQuwequfjnPoSNZLrhI5oRg1wajFZxQ Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e82a0bb2cc874614b0061f4c71ce082d Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1018573873 Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e82a0bb2cc874614b0061f4c71ce082d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e82a0bb2cc874614b0061f4c71ce082d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e82a0bb2cc874614b0061f4c71ce082d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e82a0bb2cc874614b0061f4c71ce082d"}]}] Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-VolumesSnapshotTestJSON-1018573873 Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e82a0bb2cc874614b0061f4c71ce082d Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1018573873 Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-VolumesSnapshotTestJSON-1018573873-project Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2c96909ab4eb449d81769b4c1a52ec88 Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-VolumesSnapshotTestJSON-1018573873-project Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 6bea937c-8d71-4a89-a3d2-73a337fe9e43 could not be found. Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '6bea937c-8d71-4a89-a3d2-73a337fe9e43'} Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bea937c-8d71-4a89-a3d2-73a337fe9e43 could not be found. Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bea937c-8d71-4a89-a3d2-73a337fe9e43 could not be found. Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:17:45.286887 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:45.291352 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:17:45.291352 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:17:45.291352 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:17:45.291352 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:17:45.291352 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:17:45.291352 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bea937c-8d71-4a89-a3d2-73a337fe9e43 could not be found. Sep 10 21:17:45.291352 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:17:45.291352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] Returning 404 to user: Instance 6bea937c-8d71-4a89-a3d2-73a337fe9e43 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:17:45.291352 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-16cb5dab-3428-4f18-8d64-1d6a87152167 tempest-VolumesSnapshotTestJSON-1018573873 tempest-VolumesSnapshotTestJSON-1018573873-project] 10.222.0.33 "GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43" status: 404 len: 111 microversion: 2.1 time: 0.036944 Sep 10 21:17:45.292783 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2902/5933] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:17:45 2022] GET /compute/v2.1/servers/6bea937c-8d71-4a89-a3d2-73a337fe9e43 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:17:46.217543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-378562271", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": "none"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:46.283187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:17:46.283623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:17:46.284219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:17:46.284829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:17:46.285246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:17:46.294910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:46.295810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:46.296250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:46.296979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:46.297424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:46.297866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:46.322553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Getting quotas for project dd7dc6344de94253979adb877c91e102. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:17:46.329633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Getting quotas for user d986a5c0854d4ba298481dd3c3b524c4 and project dd7dc6344de94253979adb877c91e102. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:17:46.343540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:17:46.346185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 675ba50a-d20f-4637-90f3-30dedb3cf1bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:17:46.401348 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e60dd019-90f2-45f6-b813-164e93b004d4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.465109 Sep 10 21:17:46.402339 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3032/5934] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 21:17:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 21:17:46.416366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38ee6322-cfa7-4ace-876c-ff5fee83b5d2 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:46.417133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38ee6322-cfa7-4ace-876c-ff5fee83b5d2 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 675ba50a-d20f-4637-90f3-30dedb3cf1bc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:46.500423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38ee6322-cfa7-4ace-876c-ff5fee83b5d2 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:46.510862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38ee6322-cfa7-4ace-876c-ff5fee83b5d2 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:46.512675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38ee6322-cfa7-4ace-876c-ff5fee83b5d2 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:46.514030 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38ee6322-cfa7-4ace-876c-ff5fee83b5d2 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc" status: 200 len: 1277 microversion: 2.47 time: 0.104599 Sep 10 21:17:46.529849 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2903/5935] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:46 2022] GET /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:46.716608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-73632438", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": "none"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:46.823746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:17:46.824262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:17:46.824951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:17:46.826050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:17:46.828340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:17:46.860443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:46.862462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:46.868509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:46.868509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:46.870053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:46.872112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:46.922161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Getting quotas for project dd7dc6344de94253979adb877c91e102. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:17:46.941029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Getting quotas for user d986a5c0854d4ba298481dd3c3b524c4 and project dd7dc6344de94253979adb877c91e102. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:17:46.982007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:17:46.985104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:17:47.069282 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3198d484-29b1-4ead-b96f-3a8719993bac tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.359273 Sep 10 21:17:47.070468 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3033/5936] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Sep 10 21:17:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 21:17:47.082660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7e1bb1d7-3b38-4275-a0f2-f62446b2478a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:47.086167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7e1bb1d7-3b38-4275-a0f2-f62446b2478a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:47.176728 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7e1bb1d7-3b38-4275-a0f2-f62446b2478a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "PUT /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 990 microversion: 2.47 time: 0.098788 Sep 10 21:17:47.178376 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2904/5937] 10.222.0.33 () {62 vars in 1297 bytes} [Sat Sep 10 21:17:47 2022] PUT /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 990 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:17:47.204949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10876fef-0161-48c3-b8af-8ad439e2ee00 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:47.207671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10876fef-0161-48c3-b8af-8ad439e2ee00 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:47.330206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10876fef-0161-48c3-b8af-8ad439e2ee00 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:47.342856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10876fef-0161-48c3-b8af-8ad439e2ee00 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:47.344224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10876fef-0161-48c3-b8af-8ad439e2ee00 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:47.345365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10876fef-0161-48c3-b8af-8ad439e2ee00 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1276 microversion: 2.47 time: 0.149602 Sep 10 21:17:47.370660 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3034/5938] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:47 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:48.379608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:48.380746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:48.397499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:48.398036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:48.398797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:48.399996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:48.401727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:48.402351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:48.486753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:48.497944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:48.499601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:48.500899 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f10251cf-f049-4da6-b8f2-c2484bf57a43 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1328 microversion: 2.47 time: 0.127353 Sep 10 21:17:48.501663 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2905/5939] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:48 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:49.535292 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:49.535950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:49.544101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:49.544597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:49.545043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:49.545758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:49.546256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:49.546693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:49.621173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:49.637343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:49.638996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:49.641325 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0c5961c1-5270-4938-9f20-ea9f60a784ff tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1336 microversion: 2.47 time: 0.112311 Sep 10 21:17:49.644261 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3035/5940] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:49 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1336 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:50.675050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:50.675912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:50.690962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:50.691727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:50.692446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:50.693403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:50.694652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:50.696224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:51.186620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:51.196748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:51.198249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:51.199423 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-06e0d7a7-fa51-4ed7-9a8e-cc457136bda0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1334 microversion: 2.47 time: 0.529851 Sep 10 21:17:51.199993 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2906/5941] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:50 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1334 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:52.228915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:52.229441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:52.236988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:52.237665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:52.238501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:52.239220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:52.239684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:52.240736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:52.317718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:52.329028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:52.330925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:52.332113 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-50bc02fd-bd9d-40fa-be9c-8cffa5b6fcd6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1334 microversion: 2.47 time: 0.108051 Sep 10 21:17:52.332994 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3036/5942] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:52 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:53.363784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:53.364405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:53.368246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:53.373567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:53.374099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:53.374717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:53.375743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:53.376387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:53.376821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:53.451369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:53.463931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:53.465548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:53.466813 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-39d0c3f1-296b-4c43-8e4a-e3447188c300 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1355 microversion: 2.47 time: 0.107153 Sep 10 21:17:53.467374 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2907/5943] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:53 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:53.496270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:17:53.499234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:53.503200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:53.510204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:53.510703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:53.511170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:53.511972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:53.512440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:53.512869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:53.595643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:17:53.596102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:17:53.596576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:17:53.596982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:17:53.597392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:17:53.661602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:53.668873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:53.669537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:53.670080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:53.671244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:53.672093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:53.672830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:53.707478 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-432d3fc9-534a-4e66-a227-6bea399779e8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "POST /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140/action" status: 202 len: 1077 microversion: 2.47 time: 0.215194 Sep 10 21:17:53.714385 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3037/5944] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Sep 10 21:17:53 2022] POST /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140/action => generated 1077 bytes in 217 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 10 21:17:53.729376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:53.730062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:53.748230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:53.748743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:53.751935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:53.752861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:53.753344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:53.753793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:53.853309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:53.863926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:53.876627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:53.878251 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f59f0923-3181-46ae-9d0a-0272db9ecc04 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.154005 Sep 10 21:17:53.878825 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2908/5945] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:53 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:54.907492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:54.908354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:54.917391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:54.917914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:54.918478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:54.919194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:54.919647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:54.920246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:55.033744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:55.049039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:55.051235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:55.053550 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a72728c1-fa4a-4db7-a120-598188a3d685 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.149547 Sep 10 21:17:55.054533 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3038/5946] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:54 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:17:56.090943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:56.091501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:56.102686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:56.103498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:56.104378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:56.105401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:56.106436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:56.107088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:56.202558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:56.212155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:56.214308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:56.215630 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-acdfe4ce-2805-47ca-9eee-2757d939b39f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.134997 Sep 10 21:17:56.216376 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2909/5947] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:56 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:57.249507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:57.251165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:57.258233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:57.264428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:57.266639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:57.267335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:57.268384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:57.269068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:57.269668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:57.335454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=14 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:57.355249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:57.365970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:57.367482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:57.369696 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-802828cb-ea96-45df-b8e4-37df28469fcf tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.130462 Sep 10 21:17:57.370312 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3039/5948] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:57 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:58.398386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:58.399000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:58.405226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:17:58.408299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:58.409238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:58.409888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:58.410776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:58.411292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:58.411770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:58.496563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:58.508233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:58.509788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:58.511039 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9faa0c4d-b40a-40b4-a8ea-7f5ee3d6ce78 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.118169 Sep 10 21:17:58.512106 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2910/5949] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:58 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:17:59.539067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:17:59.539709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:17:59.546594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:59.547081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:59.547516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:59.548214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:17:59.548671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:17:59.549112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:17:59.616461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:59.625531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:59.627216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:17:59.628361 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-48de49d1-cc9a-40a1-8f74-8cd2d8188ad8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.093901 Sep 10 21:17:59.629164 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3040/5950] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:17:59 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:00.656542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:00.657197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:00.664568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:00.665111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:00.665550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:00.666314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:00.666770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:00.667225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:00.672325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:00.736159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:00.745984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:00.747458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:00.748686 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0d4b17bd-548d-4d33-92fd-699017ee3275 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.096105 Sep 10 21:18:00.749249 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2911/5951] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:00 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:01.774975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:01.775595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:01.782563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:01.783100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:01.783544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:01.784251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:01.784713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:01.785147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:01.862535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:01.871362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:01.872914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:01.874165 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1f31aeea-ce16-452c-9458-405bfe3c1dcd tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.103822 Sep 10 21:18:01.874692 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3041/5952] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:01 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:02.901111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:02.902177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:02.909626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:02.910334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:02.910776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:02.911480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:02.912180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:02.912714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:02.995589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:03.004123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:03.007015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:03.008571 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-202880dc-bb9c-4a02-a3b3-a524d9fd11f5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.111748 Sep 10 21:18:03.009152 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2912/5953] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:02 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:04.034588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:04.035825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:04.045986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:04.047043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:04.047639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:04.048813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:04.050013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:04.051171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:04.125902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:04.135319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:04.136801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:04.138244 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e2183dbe-49f9-4d58-b9fa-f866ccaf9b25 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.107480 Sep 10 21:18:04.138631 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3042/5954] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:04 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:05.165507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:05.166612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:05.176639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:05.178191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:05.178191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:05.178935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:05.179385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:05.179816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:05.260365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:05.271639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:05.273983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:05.275650 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4b141689-1213-43bc-9b1b-0b57704334a5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.115031 Sep 10 21:18:05.276847 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2913/5955] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:05 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:06.303318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:06.303915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:06.311062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:06.311550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:06.312225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:06.313125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:06.313585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:06.314038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:06.319611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:06.402692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:06.416759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:06.418507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:06.420656 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-20ff9c30-aae2-4e69-b3ba-d95532f660da tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.121792 Sep 10 21:18:06.421925 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3043/5956] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:06 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:07.454951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:07.455762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:07.464040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:07.464905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:07.465650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:07.466777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:07.467487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:07.468143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:07.559279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:07.569631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:07.571400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:07.572818 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d9c4c6f1-b4b9-4681-ab3a-89bd3e9f3a07 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.122969 Sep 10 21:18:07.586535 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2914/5957] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:07 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:08.601372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:08.602360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:08.613649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:08.614425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:08.615238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:08.616369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:08.617038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:08.617726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:08.711380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:08.726415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:08.730319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:08.736661 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0013b35b-d77c-4722-a62b-80072402c1d1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.140384 Sep 10 21:18:08.738604 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3044/5958] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:08 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:09.776998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:09.779281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:09.794508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:09.795008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:09.795446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:09.796377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:09.797115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:09.797736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:09.888628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:09.898438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:09.900752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:09.903068 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b09cb4da-7937-4242-8c35-4f50d09bdc15 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.133943 Sep 10 21:18:09.904059 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2915/5959] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:09 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:10.577640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c29674d7-e97a-41ec-bd63-c7011791835c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'create', calling method: .version_select at 0x7f993f82c3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1851929461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWLf6Pk8cvnJVBWaa1sJ+LDFHczx5M73qF78+oJIOSlIeDfKbBEbGkGqu2mh8uyw91q5cDwWuREceEAmLEioKJyOLpjkveftdQJClDIchBHC0V2IegMvXkhMnMLoCh1WA=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:10.607522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-c29674d7-e97a-41ec-bd63-c7011791835c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for project f4f036f0122f4879aacb1db06eb8b588. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:18:10.616366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-c29674d7-e97a-41ec-bd63-c7011791835c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for user b4791d13ab1c45bf8fabec70191426da and project f4f036f0122f4879aacb1db06eb8b588. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:18:10.670211 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c29674d7-e97a-41ec-bd63-c7011791835c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.434766 Sep 10 21:18:10.670831 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3045/5960] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:18:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:18:10.809375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9105591-ed67-4a41-b524-debdbe7e097b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:10.809917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9105591-ed67-4a41-b524-debdbe7e097b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:10.825101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9105591-ed67-4a41-b524-debdbe7e097b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:10.825658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9105591-ed67-4a41-b524-debdbe7e097b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:10.826292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9105591-ed67-4a41-b524-debdbe7e097b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:10.827055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9105591-ed67-4a41-b524-debdbe7e097b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:10.827520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9105591-ed67-4a41-b524-debdbe7e097b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:10.827951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9105591-ed67-4a41-b524-debdbe7e097b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:10.881261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9105591-ed67-4a41-b524-debdbe7e097b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:18:10.932869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:10.933521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:10.948047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:10.948551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:10.948991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:10.949709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:10.950201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:10.960331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:11.065752 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9105591-ed67-4a41-b524-debdbe7e097b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 204 len: 0 microversion: 2.1 time: 0.260613 Sep 10 21:18:11.067148 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2916/5961] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:18:10 2022] DELETE /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:18:11.082214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7cb49192-dcc4-47c1-a626-3fa0c984724a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:11.083938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7cb49192-dcc4-47c1-a626-3fa0c984724a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:11.092941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb49192-dcc4-47c1-a626-3fa0c984724a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:11.093723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb49192-dcc4-47c1-a626-3fa0c984724a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:11.095292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb49192-dcc4-47c1-a626-3fa0c984724a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:11.096248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb49192-dcc4-47c1-a626-3fa0c984724a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:11.097320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb49192-dcc4-47c1-a626-3fa0c984724a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:11.098043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cb49192-dcc4-47c1-a626-3fa0c984724a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:11.306748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7cb49192-dcc4-47c1-a626-3fa0c984724a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:11.318851 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7cb49192-dcc4-47c1-a626-3fa0c984724a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1554 microversion: 2.1 time: 0.246114 Sep 10 21:18:11.333092 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2917/5962] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:11 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1554 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:11.499369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:11.515644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:11.517431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:11.518927 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8f0abb47-c870-4a5c-905d-a566724995d8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.590607 Sep 10 21:18:11.519853 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3046/5963] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:10 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:18:12.344494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e2bd1241-67c8-416c-afaa-cf22a55305f8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:12.345753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e2bd1241-67c8-416c-afaa-cf22a55305f8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:12.357726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2bd1241-67c8-416c-afaa-cf22a55305f8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:12.360390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2bd1241-67c8-416c-afaa-cf22a55305f8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:12.364130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2bd1241-67c8-416c-afaa-cf22a55305f8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:12.365416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2bd1241-67c8-416c-afaa-cf22a55305f8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:12.366106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2bd1241-67c8-416c-afaa-cf22a55305f8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:12.369482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2bd1241-67c8-416c-afaa-cf22a55305f8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:12.550200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:12.550903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:12.559925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:12.561368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:12.561754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:12.562612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:12.563317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:12.564502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:12.724188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:12.742450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:12.744147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:12.745614 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-73a3b31f-87cb-48c6-865c-5a27bd0cf60d tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.201951 Sep 10 21:18:12.746188 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3047/5964] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:12 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:18:13.094981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e2bd1241-67c8-416c-afaa-cf22a55305f8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:13.111281 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e2bd1241-67c8-416c-afaa-cf22a55305f8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 200 len: 1554 microversion: 2.1 time: 0.769031 Sep 10 21:18:13.113038 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2918/5965] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:12 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 1554 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:13.292307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7a4a9f6e-54db-430e-8a74-19732dd7485f req-7cf4d33e-2362-4f5c-b046-180b64834d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c978c147-9ba5-4f10-b78d-90ddfdf37eca", "name": "network-vif-deleted", "tag": "2a41a2d4-c64a-45e0-8232-1d45cf3c112c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:13.320191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a4a9f6e-54db-430e-8a74-19732dd7485f req-7cf4d33e-2362-4f5c-b046-180b64834d0a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:13.320515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a4a9f6e-54db-430e-8a74-19732dd7485f req-7cf4d33e-2362-4f5c-b046-180b64834d0a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:13.320956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7a4a9f6e-54db-430e-8a74-19732dd7485f req-7cf4d33e-2362-4f5c-b046-180b64834d0a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:13.334910 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7a4a9f6e-54db-430e-8a74-19732dd7485f req-7cf4d33e-2362-4f5c-b046-180b64834d0a service nova] Creating event network-vif-deleted:2a41a2d4-c64a-45e0-8232-1d45cf3c112c for instance c978c147-9ba5-4f10-b78d-90ddfdf37eca on nch1-master-1 Sep 10 21:18:13.340907 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7a4a9f6e-54db-430e-8a74-19732dd7485f req-7cf4d33e-2362-4f5c-b046-180b64834d0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052383 Sep 10 21:18:13.345352 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3048/5966] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:18:13.780520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:13.783017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:13.792563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:13.793421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:13.794180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:13.795138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:13.795892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:13.796544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:13.929593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:13.968670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:13.973507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:13.978595 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-51f01e01-72ca-4994-88c4-0bc8617633c8 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.199429 Sep 10 21:18:13.979786 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2919/5967] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:13 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:14.142119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:14.143540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c978c147-9ba5-4f10-b78d-90ddfdf37eca] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:14.158129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:14.159119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:14.159926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:14.162858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:14.163593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:14.164389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:14.187352 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] HTTP exception thrown: Instance c978c147-9ba5-4f10-b78d-90ddfdf37eca could not be found. Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Request method failure captured: Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca HTTP/1.1 Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP5tIhDsA9TV7k1iaLrLOtWiQ1UzQDRXvcJRltXoVuP9N4Nqa2l4KkeWNSaiyJ4KZVGfMzQzGIMiWryF4U99ueZ5qwyKcOeehNOneEUnhcMEm7xnWOMdNmKJ2uV26NNaDqKh7Fw2IYF_O1KCWZfv47GvmH-_GSt02NZ8ej6w7j6t_kw Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: fe0d9347a2d64323bb563b6f1f0b0cd6 Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestNetworkBasicOps-1762881754 Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe0d9347a2d64323bb563b6f1f0b0cd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe0d9347a2d64323bb563b6f1f0b0cd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe0d9347a2d64323bb563b6f1f0b0cd6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe0d9347a2d64323bb563b6f1f0b0cd6"}]}] Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestNetworkBasicOps-1762881754 Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: fe0d9347a2d64323bb563b6f1f0b0cd6 Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestNetworkBasicOps-1762881754 Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestNetworkBasicOps-1762881754-project Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 93648515d8fb42a7aaf61e245db0e07d Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestNetworkBasicOps-1762881754-project Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance c978c147-9ba5-4f10-b78d-90ddfdf37eca could not be found. Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c978c147-9ba5-4f10-b78d-90ddfdf37eca'} Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c978c147-9ba5-4f10-b78d-90ddfdf37eca could not be found. Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c978c147-9ba5-4f10-b78d-90ddfdf37eca could not be found. Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:18:14.204952 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:14.209905 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:14.209905 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:18:14.209905 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:18:14.209905 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:18:14.209905 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:18:14.209905 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c978c147-9ba5-4f10-b78d-90ddfdf37eca could not be found. Sep 10 21:18:14.209905 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:14.210465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Returning 404 to user: Instance c978c147-9ba5-4f10-b78d-90ddfdf37eca could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:18:14.211659 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f83eb5f0-47ec-4230-b228-005939c244ca tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca" status: 404 len: 111 microversion: 2.1 time: 0.074931 Sep 10 21:18:14.212709 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3049/5968] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:14 2022] GET /compute/v2.1/servers/c978c147-9ba5-4f10-b78d-90ddfdf37eca => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:18:14.476815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-990f43c7-0a0f-4b45-8629-7ecb252ce4e6 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '.version_select at 0x7f993f711040>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:14.511721 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-990f43c7-0a0f-4b45-8629-7ecb252ce4e6 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2080464911" status: 202 len: 0 microversion: 2.1 time: 0.039207 Sep 10 21:18:14.512330 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2920/5969] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Sep 10 21:18:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2080464911 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:18:15.012990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:15.013802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:15.022368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:15.022866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:15.023369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:15.024399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:15.025022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:15.025781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:15.106443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:15.131863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:15.133443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:15.134708 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9f37c112-45a0-4a12-a39c-3bd5a491a621 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.126124 Sep 10 21:18:15.140698 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3050/5970] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:15 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:16.161022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:16.162978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:16.179239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:16.182707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:16.183204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:16.183961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:16.184488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:16.186460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:16.335909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:16.355499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:16.358273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:16.359681 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae0e75f1-f244-4d56-9504-3c115b9d6c1a tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.203110 Sep 10 21:18:16.360418 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2921/5971] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:16 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:17.394062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:17.396113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:17.404711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:17.405260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:17.405985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:17.407719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:17.408433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:17.409766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:17.551081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:17.562364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:17.567146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:17.568437 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-052b2659-0a5e-47b2-8244-bebe7edaf9ee tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.180056 Sep 10 21:18:17.570559 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3051/5972] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:17 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:18.605320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d72ae81-2038-41a0-b061-583bbf98335e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:18.606961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:18.607607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:18.607960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6d72ae81-2038-41a0-b061-583bbf98335e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:18.626418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:18.627445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:18.628144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:18.628906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d72ae81-2038-41a0-b061-583bbf98335e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:18.629728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d72ae81-2038-41a0-b061-583bbf98335e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:18.630002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:18.630637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:18.630858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d72ae81-2038-41a0-b061-583bbf98335e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:18.631245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:18.632127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d72ae81-2038-41a0-b061-583bbf98335e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:18.632819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d72ae81-2038-41a0-b061-583bbf98335e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:18.633422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d72ae81-2038-41a0-b061-583bbf98335e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:18.680528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6d72ae81-2038-41a0-b061-583bbf98335e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:18:18.822061 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6d72ae81-2038-41a0-b061-583bbf98335e tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 204 len: 0 microversion: 2.1 time: 0.220469 Sep 10 21:18:18.822975 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3052/5973] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:18:18 2022] DELETE /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:18:18.829811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:18.838621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-add2bcf6-68f5-4606-ac16-444a51c45340 req-92420ef4-89c1-4ce4-84b1-cad395e45dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c119a968-8e9d-4f49-bdd9-1da99159cecc", "tag": "3584c8e9-718d-4a42-b791-17326796df18"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:18.850399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-add2bcf6-68f5-4606-ac16-444a51c45340 req-92420ef4-89c1-4ce4-84b1-cad395e45dc2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:18.851346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-add2bcf6-68f5-4606-ac16-444a51c45340 req-92420ef4-89c1-4ce4-84b1-cad395e45dc2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:18.851798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-add2bcf6-68f5-4606-ac16-444a51c45340 req-92420ef4-89c1-4ce4-84b1-cad395e45dc2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:18.852248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:18.853768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:18.855107 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-96aaffb3-3011-4e7a-a8d6-df59f0b6f390 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.259669 Sep 10 21:18:18.857069 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2922/5974] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:18 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:18.866929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-db19834b-3b43-4e05-96f0-9ea9217e4581 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:18.868602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-db19834b-3b43-4e05-96f0-9ea9217e4581 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:18.872336 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-add2bcf6-68f5-4606-ac16-444a51c45340 req-92420ef4-89c1-4ce4-84b1-cad395e45dc2 service nova] Creating event network-changed:3584c8e9-718d-4a42-b791-17326796df18 for instance c119a968-8e9d-4f49-bdd9-1da99159cecc on nch1-master-1 Sep 10 21:18:18.875448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db19834b-3b43-4e05-96f0-9ea9217e4581 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:18.875962 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db19834b-3b43-4e05-96f0-9ea9217e4581 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:18.876406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db19834b-3b43-4e05-96f0-9ea9217e4581 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:18.877166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db19834b-3b43-4e05-96f0-9ea9217e4581 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:18.878016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db19834b-3b43-4e05-96f0-9ea9217e4581 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:18.879161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-db19834b-3b43-4e05-96f0-9ea9217e4581 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:18.887420 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-add2bcf6-68f5-4606-ac16-444a51c45340 req-92420ef4-89c1-4ce4-84b1-cad395e45dc2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056538 Sep 10 21:18:18.888045 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3053/5975] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:18:19.350852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-db19834b-3b43-4e05-96f0-9ea9217e4581 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:19.372125 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-db19834b-3b43-4e05-96f0-9ea9217e4581 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1669 microversion: 2.1 time: 0.513072 Sep 10 21:18:19.376864 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2923/5976] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:18 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1669 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:19.889429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:19.890419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:19.927020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:19.927769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:19.928455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:19.929402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:19.929878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:19.930314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:20.416600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-14bffa85-2ccd-40cd-b108-6566bd8251d4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:20.417507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-14bffa85-2ccd-40cd-b108-6566bd8251d4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:20.435386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14bffa85-2ccd-40cd-b108-6566bd8251d4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:20.436202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14bffa85-2ccd-40cd-b108-6566bd8251d4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:20.437007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14bffa85-2ccd-40cd-b108-6566bd8251d4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:20.439418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14bffa85-2ccd-40cd-b108-6566bd8251d4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:20.440275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14bffa85-2ccd-40cd-b108-6566bd8251d4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:20.440964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-14bffa85-2ccd-40cd-b108-6566bd8251d4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:20.570512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:20.586912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:20.590691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:20.595117 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c286364d-75f7-4367-8428-c374f62b12e5 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1364 microversion: 2.47 time: 0.710244 Sep 10 21:18:20.596583 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3054/5977] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:19 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1364 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:21.626309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:21.627642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:21.634792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:21.639384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:21.640019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:21.642939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:21.644481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:21.645230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:21.646723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:21.728223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-14bffa85-2ccd-40cd-b108-6566bd8251d4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:21.755970 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-14bffa85-2ccd-40cd-b108-6566bd8251d4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1669 microversion: 2.1 time: 1.345426 Sep 10 21:18:21.757941 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2924/5978] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:20 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1669 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:21.864830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:21.892864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:21.896973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:21.899759 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f0647c7a-ab24-4ceb-9abb-f37240e996f4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1370 microversion: 2.47 time: 0.277693 Sep 10 21:18:21.900847 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3055/5979] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:21 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1370 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:18:22.788362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-22212444-fc27-4e64-b661-4684e5f32f59 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:22.789696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-22212444-fc27-4e64-b661-4684e5f32f59 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:22.798038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22212444-fc27-4e64-b661-4684e5f32f59 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:22.798819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22212444-fc27-4e64-b661-4684e5f32f59 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:22.799546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22212444-fc27-4e64-b661-4684e5f32f59 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:22.800480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22212444-fc27-4e64-b661-4684e5f32f59 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:22.801352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22212444-fc27-4e64-b661-4684e5f32f59 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:22.804332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22212444-fc27-4e64-b661-4684e5f32f59 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:22.847189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-34f94008-b8c4-4035-91b1-5b5d6f48ebd2 req-fb25f3b4-83f8-468a-b18e-ee064670a5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c119a968-8e9d-4f49-bdd9-1da99159cecc", "name": "network-vif-deleted", "tag": "3584c8e9-718d-4a42-b791-17326796df18"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:22.887962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-34f94008-b8c4-4035-91b1-5b5d6f48ebd2 req-fb25f3b4-83f8-468a-b18e-ee064670a5c6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:22.889640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-34f94008-b8c4-4035-91b1-5b5d6f48ebd2 req-fb25f3b4-83f8-468a-b18e-ee064670a5c6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:22.890636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-34f94008-b8c4-4035-91b1-5b5d6f48ebd2 req-fb25f3b4-83f8-468a-b18e-ee064670a5c6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:22.956096 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-34f94008-b8c4-4035-91b1-5b5d6f48ebd2 req-fb25f3b4-83f8-468a-b18e-ee064670a5c6 service nova] Creating event network-vif-deleted:3584c8e9-718d-4a42-b791-17326796df18 for instance c119a968-8e9d-4f49-bdd9-1da99159cecc on nch1-master-1 Sep 10 21:18:22.987402 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-34f94008-b8c4-4035-91b1-5b5d6f48ebd2 req-fb25f3b4-83f8-468a-b18e-ee064670a5c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146527 Sep 10 21:18:22.997457 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3056/5980] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:18:23.007968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:23.009171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:23.047102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:23.048626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:23.049273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:23.053792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:23.056016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:23.056844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:23.096579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-22212444-fc27-4e64-b661-4684e5f32f59 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:23.116140 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-22212444-fc27-4e64-b661-4684e5f32f59 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 200 len: 1484 microversion: 2.1 time: 0.333584 Sep 10 21:18:23.119015 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2925/5981] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:22 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 1484 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:23.233531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:23.247472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:23.253279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:23.260694 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ef93c8fb-27f0-4318-b7f6-efec69b968b6 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1355 microversion: 2.47 time: 0.261503 Sep 10 21:18:23.267483 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3057/5982] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:22 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1355 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:23.289779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:23.300583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:23.302730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Searching by: {'deleted': False, 'project_id': 'dd7dc6344de94253979adb877c91e102'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:18:23.314122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:23.319183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:23.319353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:23.320223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:23.322644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:23.323224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:23.497117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:18:23.519631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:23.593599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:23.600645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:23.603022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:23.603523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:23.603973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:23.625079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:23.639052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:23.796972 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fbc9d7ff-6c1e-4485-92ff-e2c82ca41e20 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 0.511295 Sep 10 21:18:23.797566 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2926/5983] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Sep 10 21:18:23 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:23.842269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eedf8f6f-2cb5-480b-9722-3eaf01950286 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:23.843029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eedf8f6f-2cb5-480b-9722-3eaf01950286 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:23.845614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:23.863099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eedf8f6f-2cb5-480b-9722-3eaf01950286 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:23.863780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eedf8f6f-2cb5-480b-9722-3eaf01950286 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:23.864736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eedf8f6f-2cb5-480b-9722-3eaf01950286 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:23.865533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eedf8f6f-2cb5-480b-9722-3eaf01950286 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:23.868829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eedf8f6f-2cb5-480b-9722-3eaf01950286 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:23.869317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eedf8f6f-2cb5-480b-9722-3eaf01950286 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:23.923313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eedf8f6f-2cb5-480b-9722-3eaf01950286 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:18:24.102638 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eedf8f6f-2cb5-480b-9722-3eaf01950286 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 204 len: 0 microversion: 2.47 time: 0.273807 Sep 10 21:18:24.106239 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3058/5984] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:18:23 2022] DELETE /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 21:18:24.113422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:24.114159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:24.134093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:24.140983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:24.144300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: c119a968-8e9d-4f49-bdd9-1da99159cecc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:24.153954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:24.154471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:24.156208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:24.156715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:24.162449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:24.167969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:24.171583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:24.175370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:24.176227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:24.181063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:24.182382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:24.238040 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] HTTP exception thrown: Instance c119a968-8e9d-4f49-bdd9-1da99159cecc could not be found. Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Request method failure captured: Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc HTTP/1.1 Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP5tIhDsA9TV7k1iaLrLOtWiQ1UzQDRXvcJRltXoVuP9N4Nqa2l4KkeWNSaiyJ4KZVGfMzQzGIMiWryF4U99ueZ5qwyKcOeehNOneEUnhcMEm7xnWOMdNmKJ2uV26NNaDqKh7Fw2IYF_O1KCWZfv47GvmH-_GSt02NZ8ej6w7j6t_kw Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: fe0d9347a2d64323bb563b6f1f0b0cd6 Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestNetworkBasicOps-1762881754 Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe0d9347a2d64323bb563b6f1f0b0cd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe0d9347a2d64323bb563b6f1f0b0cd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe0d9347a2d64323bb563b6f1f0b0cd6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe0d9347a2d64323bb563b6f1f0b0cd6"}]}] Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestNetworkBasicOps-1762881754 Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: fe0d9347a2d64323bb563b6f1f0b0cd6 Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestNetworkBasicOps-1762881754 Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestNetworkBasicOps-1762881754-project Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 93648515d8fb42a7aaf61e245db0e07d Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestNetworkBasicOps-1762881754-project Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance c119a968-8e9d-4f49-bdd9-1da99159cecc could not be found. Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c119a968-8e9d-4f49-bdd9-1da99159cecc'} Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c119a968-8e9d-4f49-bdd9-1da99159cecc could not be found. Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c119a968-8e9d-4f49-bdd9-1da99159cecc could not be found. Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:18:24.244387 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:24.249349 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:24.249349 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:18:24.249349 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:18:24.249349 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:18:24.249349 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:18:24.249349 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c119a968-8e9d-4f49-bdd9-1da99159cecc could not be found. Sep 10 21:18:24.249349 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:24.251872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Returning 404 to user: Instance c119a968-8e9d-4f49-bdd9-1da99159cecc could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:18:24.255626 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c823a272-f7b1-41ae-b9b8-cbba10670ea8 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc" status: 404 len: 111 microversion: 2.1 time: 0.119609 Sep 10 21:18:24.256560 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3059/5985] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:24 2022] GET /compute/v2.1/servers/c119a968-8e9d-4f49-bdd9-1da99159cecc => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:18:24.402515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:24.403805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1985648910", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "c1e0d19a-9cc5-46e3-b624-8df3c6280750"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1851929461", "security_groups": [{"name": "tempest-secgroup-smoke-2027277286"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:24.418594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:24.423862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:24.427570 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cb6c95df-3fbc-4c9c-8bcc-20283fff2fb4 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1361 microversion: 2.47 time: 0.319203 Sep 10 21:18:24.429650 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2927/5986] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:24 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:18:24.714992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] validate_networks() for [('c1e0d19a-9cc5-46e3-b624-8df3c6280750', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:18:24.827524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e5f2b3e-1684-461d-8264-7c7a5bd7fea3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '.version_select at 0x7f993f73e160>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:24.871464 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5e5f2b3e-1684-461d-8264-7c7a5bd7fea3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1251884827" status: 202 len: 0 microversion: 2.1 time: 0.047499 Sep 10 21:18:24.875640 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2928/5987] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Sep 10 21:18:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1251884827 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:18:25.457628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:25.458839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:25.473270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:25.479357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:25.479850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:25.480618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:25.481102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:25.481812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:25.634183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:25.643953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:25.651158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:25.652804 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9a8bd571-4687-4c88-af19-bd9cc849c8aa tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 200 len: 1361 microversion: 2.47 time: 0.200615 Sep 10 21:18:25.653656 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2929/5988] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:25 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 21:18:26.060185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:18:26.062426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:18:26.063317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:18:26.064158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:18:26.065021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:18:26.081398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:26.084250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:26.085110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:26.086399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:26.087219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:26.087824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:26.117064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for project f4f036f0122f4879aacb1db06eb8b588. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:18:26.128567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for user b4791d13ab1c45bf8fabec70191426da and project f4f036f0122f4879aacb1db06eb8b588. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:18:26.151270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:18:26.154836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:18:26.233895 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ebce2752-d91c-48f1-8d6e-ec3ff85757f9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.833768 Sep 10 21:18:26.235360 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3060/5989] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:18:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:18:26.248269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e4e2852f-b030-421a-9c6a-71686b8d839f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:26.249151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e4e2852f-b030-421a-9c6a-71686b8d839f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:26.364791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e4e2852f-b030-421a-9c6a-71686b8d839f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:26.377315 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e4e2852f-b030-421a-9c6a-71686b8d839f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1267 microversion: 2.1 time: 0.133054 Sep 10 21:18:26.378245 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2930/5990] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:26 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1267 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:26.703740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:26.704436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 0f160a6c-d362-45f8-94eb-1a30c219e140] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:26.731697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:26.732212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:26.732663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:26.733413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:26.736006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:26.737021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:26.769738 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] HTTP exception thrown: Instance 0f160a6c-d362-45f8-94eb-1a30c219e140 could not be found. Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Request method failure captured: Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 HTTP/1.1 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP75ISW0sdlqiuT1J5l0visuF-qth3RZrddGfa8RYZAUYFl0r9zDNRpUu-2647R1BHqWnFgi8OdTXUKWbqlYIKCeWhKd0nrPd-qMdu4lMxzygxr1_fYO5uUyj15QY5VOgEnaF8Yvash7dmOEDSpUVPkitPNgzKRAAawLbxUCYBEi2pY Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.47 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: dd7dc6344de94253979adb877c91e102 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerShowV247Test-1261218552 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd7dc6344de94253979adb877c91e102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd7dc6344de94253979adb877c91e102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "tempest-type-1389768809", "name": "tempest-service-304767702", "endpoints": [{"region": "tempest-region-1186730759", "internalURL": "https://url-1565089816.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd7dc6344de94253979adb877c91e102", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd7dc6344de94253979adb877c91e102"}]}, {"type": "tempest-type-808959127", "name": "tempest-service-1536042822", "endpoints": [{"region": "tempest-region-1333218139", "publicURL": "https://url-2066998329.com"}]}] Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerShowV247Test-1261218552 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: dd7dc6344de94253979adb877c91e102 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerShowV247Test-1261218552 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerShowV247Test-1261218552-project Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d986a5c0854d4ba298481dd3c3b524c4 Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerShowV247Test-1261218552-project Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 0f160a6c-d362-45f8-94eb-1a30c219e140 could not be found. Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '0f160a6c-d362-45f8-94eb-1a30c219e140'} Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f160a6c-d362-45f8-94eb-1a30c219e140 could not be found. Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:18:26.775558 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f160a6c-d362-45f8-94eb-1a30c219e140 could not be found. Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f160a6c-d362-45f8-94eb-1a30c219e140 could not be found. Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Returning 404 to user: Instance 0f160a6c-d362-45f8-94eb-1a30c219e140 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2538022b-c51c-49e1-8352-a71d3f3a87e0 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140" status: 404 len: 111 microversion: 2.47 time: 0.086737 Sep 10 21:18:26.783098 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3061/5991] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:26 2022] GET /compute/v2.1/servers/0f160a6c-d362-45f8-94eb-1a30c219e140 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:18:26.792278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3e4277f-d227-48e5-b713-7f6706f58c9e tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:26.792873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b3e4277f-d227-48e5-b713-7f6706f58c9e tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 675ba50a-d20f-4637-90f3-30dedb3cf1bc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:26.819996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e4277f-d227-48e5-b713-7f6706f58c9e tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:26.820829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e4277f-d227-48e5-b713-7f6706f58c9e tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:26.821287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e4277f-d227-48e5-b713-7f6706f58c9e tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:26.822045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e4277f-d227-48e5-b713-7f6706f58c9e tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:26.825209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e4277f-d227-48e5-b713-7f6706f58c9e tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:26.825661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b3e4277f-d227-48e5-b713-7f6706f58c9e tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:26.870023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b3e4277f-d227-48e5-b713-7f6706f58c9e tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 675ba50a-d20f-4637-90f3-30dedb3cf1bc] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:18:27.046114 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b3e4277f-d227-48e5-b713-7f6706f58c9e tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "DELETE /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc" status: 204 len: 0 microversion: 2.47 time: 0.262723 Sep 10 21:18:27.049310 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2931/5992] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Sep 10 21:18:26 2022] DELETE /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 21:18:27.058742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:27.059813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 675ba50a-d20f-4637-90f3-30dedb3cf1bc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:27.079049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:27.079615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:27.082146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:27.083677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:27.085159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:27.086373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:27.093555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:27.403366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1d30a658-0e3c-4cf4-9564-410610fe098b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:27.404500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1d30a658-0e3c-4cf4-9564-410610fe098b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:27.417165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d30a658-0e3c-4cf4-9564-410610fe098b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:27.418865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d30a658-0e3c-4cf4-9564-410610fe098b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:27.422266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d30a658-0e3c-4cf4-9564-410610fe098b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:27.423302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d30a658-0e3c-4cf4-9564-410610fe098b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:27.423941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d30a658-0e3c-4cf4-9564-410610fe098b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:27.426467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d30a658-0e3c-4cf4-9564-410610fe098b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:27.512882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:27.528750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:27.534593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:27.536145 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-29c13aa3-9cea-4a00-99fc-d7ec9277ecd1 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc" status: 200 len: 1362 microversion: 2.47 time: 0.482028 Sep 10 21:18:27.550181 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3062/5993] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:27 2022] GET /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc => generated 1362 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:27.663956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1d30a658-0e3c-4cf4-9564-410610fe098b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:27.675353 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1d30a658-0e3c-4cf4-9564-410610fe098b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1263 microversion: 2.1 time: 0.277552 Sep 10 21:18:27.678870 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2932/5994] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:27 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1263 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:28.571813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:28.572605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 675ba50a-d20f-4637-90f3-30dedb3cf1bc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:28.601246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:28.601995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:28.602599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:28.603543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:28.604210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:28.604870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:28.704905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c95c316f-01fc-4c1f-b68d-6fe469aab017 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:28.706147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c95c316f-01fc-4c1f-b68d-6fe469aab017 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:28.715696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c95c316f-01fc-4c1f-b68d-6fe469aab017 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:28.716519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c95c316f-01fc-4c1f-b68d-6fe469aab017 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:28.717347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c95c316f-01fc-4c1f-b68d-6fe469aab017 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:28.718597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c95c316f-01fc-4c1f-b68d-6fe469aab017 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:28.720436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c95c316f-01fc-4c1f-b68d-6fe469aab017 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:28.721138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c95c316f-01fc-4c1f-b68d-6fe469aab017 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:28.843264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:28.853640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:28.860980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd986a5c0854d4ba298481dd3c3b524c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7dc6344de94253979adb877c91e102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:28.869393 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d9cb193-4225-4896-8758-f0d854f86c4f tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc" status: 200 len: 1362 microversion: 2.47 time: 0.307250 Sep 10 21:18:28.870084 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3063/5995] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:28 2022] GET /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 21:18:28.893455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c95c316f-01fc-4c1f-b68d-6fe469aab017 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:28.904550 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c95c316f-01fc-4c1f-b68d-6fe469aab017 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1325 microversion: 2.1 time: 0.203962 Sep 10 21:18:28.915384 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2933/5996] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:28 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1325 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:29.903014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:29.904392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] [instance: 675ba50a-d20f-4637-90f3-30dedb3cf1bc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:29.920163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:29.923317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:29.925423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:29.927021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:29.930313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:29.930949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:29.931328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80e70381-01ab-4ffb-ab78-4ac7d2e37e34 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:29.931950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-80e70381-01ab-4ffb-ab78-4ac7d2e37e34 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:29.961493 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] HTTP exception thrown: Instance 675ba50a-d20f-4637-90f3-30dedb3cf1bc could not be found. Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Request method failure captured: Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc HTTP/1.1 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP75ISW0sdlqiuT1J5l0visuF-qth3RZrddGfa8RYZAUYFl0r9zDNRpUu-2647R1BHqWnFgi8OdTXUKWbqlYIKCeWhKd0nrPd-qMdu4lMxzygxr1_fYO5uUyj15QY5VOgEnaF8Yvash7dmOEDSpUVPkitPNgzKRAAawLbxUCYBEi2pY Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Openstack-Nova-Api-Version: 2.47 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: dd7dc6344de94253979adb877c91e102 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerShowV247Test-1261218552 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd7dc6344de94253979adb877c91e102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd7dc6344de94253979adb877c91e102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "tempest-type-1389768809", "name": "tempest-service-304767702", "endpoints": [{"region": "tempest-region-1186730759", "internalURL": "https://url-1565089816.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd7dc6344de94253979adb877c91e102", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd7dc6344de94253979adb877c91e102"}]}, {"type": "tempest-type-808959127", "name": "tempest-service-1536042822", "endpoints": [{"region": "tempest-region-1333218139", "publicURL": "https://url-2066998329.com"}]}] Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerShowV247Test-1261218552 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: dd7dc6344de94253979adb877c91e102 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerShowV247Test-1261218552 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerShowV247Test-1261218552-project Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: d986a5c0854d4ba298481dd3c3b524c4 Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerShowV247Test-1261218552-project Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 675ba50a-d20f-4637-90f3-30dedb3cf1bc could not be found. Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '675ba50a-d20f-4637-90f3-30dedb3cf1bc'} Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675ba50a-d20f-4637-90f3-30dedb3cf1bc could not be found. Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:18:29.967203 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675ba50a-d20f-4637-90f3-30dedb3cf1bc could not be found. Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675ba50a-d20f-4637-90f3-30dedb3cf1bc could not be found. Sep 10 21:18:29.972263 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:18:29.977722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] Returning 404 to user: Instance 675ba50a-d20f-4637-90f3-30dedb3cf1bc could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:18:29.978730 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b19e1437-ecbd-4434-978f-91e4b59bd7f7 tempest-ServerShowV247Test-1261218552 tempest-ServerShowV247Test-1261218552-project] 10.222.0.33 "GET /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc" status: 404 len: 111 microversion: 2.47 time: 0.080245 Sep 10 21:18:29.984518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e70381-01ab-4ffb-ab78-4ac7d2e37e34 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:29.985051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e70381-01ab-4ffb-ab78-4ac7d2e37e34 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:29.985512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e70381-01ab-4ffb-ab78-4ac7d2e37e34 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:29.986788 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3064/5997] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Sep 10 21:18:29 2022] GET /compute/v2.1/servers/675ba50a-d20f-4637-90f3-30dedb3cf1bc => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:18:30.001115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e70381-01ab-4ffb-ab78-4ac7d2e37e34 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:30.003089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e70381-01ab-4ffb-ab78-4ac7d2e37e34 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:30.003988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80e70381-01ab-4ffb-ab78-4ac7d2e37e34 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:31.257387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-80e70381-01ab-4ffb-ab78-4ac7d2e37e34 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:31.268034 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-80e70381-01ab-4ffb-ab78-4ac7d2e37e34 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1393 microversion: 2.1 time: 1.340981 Sep 10 21:18:31.269646 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2934/5998] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:29 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1393 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:32.297020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8fff705e-c21d-404a-8900-f41288db4300 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:32.297650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8fff705e-c21d-404a-8900-f41288db4300 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:32.311644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fff705e-c21d-404a-8900-f41288db4300 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:32.312146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fff705e-c21d-404a-8900-f41288db4300 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:32.312587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fff705e-c21d-404a-8900-f41288db4300 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:32.316611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fff705e-c21d-404a-8900-f41288db4300 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:32.319336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fff705e-c21d-404a-8900-f41288db4300 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:32.319822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8fff705e-c21d-404a-8900-f41288db4300 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:32.823563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8fff705e-c21d-404a-8900-f41288db4300 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:32.831418 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8fff705e-c21d-404a-8900-f41288db4300 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1393 microversion: 2.1 time: 0.538405 Sep 10 21:18:32.833265 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3065/5999] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:32 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1393 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:33.184011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-56a267a7-5c95-4e08-b8fe-82c271ce9e97 req-e3edd7da-ac02-4a9a-8595-20cf56561620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef02761-7222-43d2-af15-a1ee80eb9f92", "tag": "e7acbc98-7340-435f-aae6-84d92fbd81f4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:33.219194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-56a267a7-5c95-4e08-b8fe-82c271ce9e97 req-e3edd7da-ac02-4a9a-8595-20cf56561620 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:33.219681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-56a267a7-5c95-4e08-b8fe-82c271ce9e97 req-e3edd7da-ac02-4a9a-8595-20cf56561620 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:33.222777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-56a267a7-5c95-4e08-b8fe-82c271ce9e97 req-e3edd7da-ac02-4a9a-8595-20cf56561620 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:33.272056 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-56a267a7-5c95-4e08-b8fe-82c271ce9e97 req-e3edd7da-ac02-4a9a-8595-20cf56561620 service nova] Creating event network-changed:e7acbc98-7340-435f-aae6-84d92fbd81f4 for instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 on nch1-master-1 Sep 10 21:18:33.279887 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-56a267a7-5c95-4e08-b8fe-82c271ce9e97 req-e3edd7da-ac02-4a9a-8595-20cf56561620 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100363 Sep 10 21:18:33.280836 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2935/6000] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:18:33.855570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cc163d9d-fe88-46a7-9744-4f53ee6bf864 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:33.856191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cc163d9d-fe88-46a7-9744-4f53ee6bf864 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:33.865569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc163d9d-fe88-46a7-9744-4f53ee6bf864 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:33.866393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc163d9d-fe88-46a7-9744-4f53ee6bf864 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:33.867566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc163d9d-fe88-46a7-9744-4f53ee6bf864 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:33.868492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc163d9d-fe88-46a7-9744-4f53ee6bf864 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:33.869146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc163d9d-fe88-46a7-9744-4f53ee6bf864 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:33.869769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc163d9d-fe88-46a7-9744-4f53ee6bf864 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:34.360727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cc163d9d-fe88-46a7-9744-4f53ee6bf864 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:34.384901 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cc163d9d-fe88-46a7-9744-4f53ee6bf864 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1393 microversion: 2.1 time: 0.531008 Sep 10 21:18:34.398923 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3066/6001] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:33 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1393 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:35.415040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-11af60d8-8b11-4a5c-80be-92f68fd25654 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:35.416912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-11af60d8-8b11-4a5c-80be-92f68fd25654 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:35.427024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:35.431777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11af60d8-8b11-4a5c-80be-92f68fd25654 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:35.432609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11af60d8-8b11-4a5c-80be-92f68fd25654 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:35.433277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11af60d8-8b11-4a5c-80be-92f68fd25654 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:35.434536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11af60d8-8b11-4a5c-80be-92f68fd25654 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:35.435411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11af60d8-8b11-4a5c-80be-92f68fd25654 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:35.436010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11af60d8-8b11-4a5c-80be-92f68fd25654 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:35.989479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-11af60d8-8b11-4a5c-80be-92f68fd25654 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:36.009609 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-11af60d8-8b11-4a5c-80be-92f68fd25654 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1393 microversion: 2.1 time: 0.601949 Sep 10 21:18:36.013732 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2936/6002] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:35 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1393 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:37.036521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-312ae716-57f8-472b-b10d-7e61764d7108 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:37.037413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-312ae716-57f8-472b-b10d-7e61764d7108 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:37.057598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:37.062445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:37.070926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-312ae716-57f8-472b-b10d-7e61764d7108 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:37.074661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-312ae716-57f8-472b-b10d-7e61764d7108 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:37.074800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-312ae716-57f8-472b-b10d-7e61764d7108 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:37.075521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-312ae716-57f8-472b-b10d-7e61764d7108 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:37.076002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-312ae716-57f8-472b-b10d-7e61764d7108 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:37.076503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-312ae716-57f8-472b-b10d-7e61764d7108 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:37.382133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-312ae716-57f8-472b-b10d-7e61764d7108 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:37.390918 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-312ae716-57f8-472b-b10d-7e61764d7108 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1393 microversion: 2.1 time: 0.359061 Sep 10 21:18:37.391518 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3067/6003] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:37 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1393 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:38.418070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b6c0195-e41e-4799-9df7-7a6842d21a70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:38.421110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b6c0195-e41e-4799-9df7-7a6842d21a70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:38.429733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:38.433292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b6c0195-e41e-4799-9df7-7a6842d21a70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:38.434150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b6c0195-e41e-4799-9df7-7a6842d21a70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:38.434913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b6c0195-e41e-4799-9df7-7a6842d21a70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:38.435942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b6c0195-e41e-4799-9df7-7a6842d21a70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:38.436702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b6c0195-e41e-4799-9df7-7a6842d21a70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:38.437389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b6c0195-e41e-4799-9df7-7a6842d21a70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:39.014457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b6c0195-e41e-4799-9df7-7a6842d21a70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:39.028561 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6b6c0195-e41e-4799-9df7-7a6842d21a70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1393 microversion: 2.1 time: 0.614371 Sep 10 21:18:39.040665 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2937/6004] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:38 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1393 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:40.059604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-33c5ba46-0443-4555-bb12-30feb96214ae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:40.060875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-33c5ba46-0443-4555-bb12-30feb96214ae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:40.069988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33c5ba46-0443-4555-bb12-30feb96214ae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:40.070941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33c5ba46-0443-4555-bb12-30feb96214ae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:40.072363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33c5ba46-0443-4555-bb12-30feb96214ae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:40.073313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33c5ba46-0443-4555-bb12-30feb96214ae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:40.074029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33c5ba46-0443-4555-bb12-30feb96214ae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:40.080253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33c5ba46-0443-4555-bb12-30feb96214ae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:40.294890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3bb0b6f5-ccd0-435c-b8d8-174f11606995 req-afc5b70b-8c60-4bd7-bf90-280da9b32845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef02761-7222-43d2-af15-a1ee80eb9f92", "name": "network-vif-plugged", "status": "completed", "tag": "e7acbc98-7340-435f-aae6-84d92fbd81f4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:40.321077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3bb0b6f5-ccd0-435c-b8d8-174f11606995 req-afc5b70b-8c60-4bd7-bf90-280da9b32845 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:40.321567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3bb0b6f5-ccd0-435c-b8d8-174f11606995 req-afc5b70b-8c60-4bd7-bf90-280da9b32845 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:40.322040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3bb0b6f5-ccd0-435c-b8d8-174f11606995 req-afc5b70b-8c60-4bd7-bf90-280da9b32845 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:40.345550 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3bb0b6f5-ccd0-435c-b8d8-174f11606995 req-afc5b70b-8c60-4bd7-bf90-280da9b32845 service nova] Creating event network-vif-plugged:e7acbc98-7340-435f-aae6-84d92fbd81f4 for instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 on nch1-master-1 Sep 10 21:18:40.355647 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3bb0b6f5-ccd0-435c-b8d8-174f11606995 req-afc5b70b-8c60-4bd7-bf90-280da9b32845 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065312 Sep 10 21:18:40.357753 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2938/6005] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:18:40.372245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-33c5ba46-0443-4555-bb12-30feb96214ae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:40.403133 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-33c5ba46-0443-4555-bb12-30feb96214ae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1393 microversion: 2.1 time: 0.347925 Sep 10 21:18:40.405763 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3068/6006] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:40 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1393 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:41.436802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0b848cfc-97fe-4524-b5ca-51ba0eebf16a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:41.437772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0b848cfc-97fe-4524-b5ca-51ba0eebf16a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:41.456531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b848cfc-97fe-4524-b5ca-51ba0eebf16a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:41.457033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b848cfc-97fe-4524-b5ca-51ba0eebf16a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:41.458047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b848cfc-97fe-4524-b5ca-51ba0eebf16a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:41.458798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b848cfc-97fe-4524-b5ca-51ba0eebf16a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:41.459317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b848cfc-97fe-4524-b5ca-51ba0eebf16a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:41.459800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b848cfc-97fe-4524-b5ca-51ba0eebf16a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:42.516891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0b848cfc-97fe-4524-b5ca-51ba0eebf16a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:42.532343 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0b848cfc-97fe-4524-b5ca-51ba0eebf16a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1393 microversion: 2.1 time: 1.102672 Sep 10 21:18:42.533045 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2939/6007] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:41 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1393 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:43.557290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a578b5b7-609e-47a2-9abc-7ca7d54ac920 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:43.558536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a578b5b7-609e-47a2-9abc-7ca7d54ac920 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:43.573999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a578b5b7-609e-47a2-9abc-7ca7d54ac920 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:43.574646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a578b5b7-609e-47a2-9abc-7ca7d54ac920 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:43.575107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a578b5b7-609e-47a2-9abc-7ca7d54ac920 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:43.575871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a578b5b7-609e-47a2-9abc-7ca7d54ac920 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:43.576339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a578b5b7-609e-47a2-9abc-7ca7d54ac920 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:43.576777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a578b5b7-609e-47a2-9abc-7ca7d54ac920 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:44.028696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a578b5b7-609e-47a2-9abc-7ca7d54ac920 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:44.045447 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a578b5b7-609e-47a2-9abc-7ca7d54ac920 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1566 microversion: 2.1 time: 0.492020 Sep 10 21:18:44.053894 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3069/6008] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:43 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1566 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:44.074488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55cb2355-560e-452e-a1a4-944f38444c90 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:44.075156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55cb2355-560e-452e-a1a4-944f38444c90 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:44.091903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55cb2355-560e-452e-a1a4-944f38444c90 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:44.093319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55cb2355-560e-452e-a1a4-944f38444c90 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:44.100487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55cb2355-560e-452e-a1a4-944f38444c90 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:44.103445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55cb2355-560e-452e-a1a4-944f38444c90 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:44.103985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55cb2355-560e-452e-a1a4-944f38444c90 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:44.106309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55cb2355-560e-452e-a1a4-944f38444c90 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:44.515882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-55cb2355-560e-452e-a1a4-944f38444c90 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:44.540677 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55cb2355-560e-452e-a1a4-944f38444c90 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1566 microversion: 2.1 time: 0.472289 Sep 10 21:18:44.587277 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2940/6009] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:44 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1566 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:45.547943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1988172622", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:45.661444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:18:46.964641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:18:46.965734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:18:46.966627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:18:46.967212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:18:46.967812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:18:46.991905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:46.994144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:46.996348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:47.000005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:47.000801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:47.002488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:47.060592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Getting quotas for project b5963e3c1ac34aa29de539734a0c6466. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:18:47.084506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Getting quotas for user eaf8e35a0a6845768bd0ad61c9b87e22 and project b5963e3c1ac34aa29de539734a0c6466. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:18:47.117492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:18:47.127874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:18:47.223601 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cb7e2946-64f6-44c5-9537-dc47ba421eec tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.680944 Sep 10 21:18:47.231223 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3070/6010] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:18:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:18:47.236238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a4dc54d4-88d8-4a7e-ab3b-1a399199acf2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:47.237647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a4dc54d4-88d8-4a7e-ab3b-1a399199acf2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:47.390500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a4dc54d4-88d8-4a7e-ab3b-1a399199acf2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:47.400290 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a4dc54d4-88d8-4a7e-ab3b-1a399199acf2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1214 microversion: 2.1 time: 0.167994 Sep 10 21:18:47.420235 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2941/6011] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:47 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:48.435641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6783d8a5-42a9-4552-85d8-b831c019b256 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:48.436280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6783d8a5-42a9-4552-85d8-b831c019b256 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:48.663988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6783d8a5-42a9-4552-85d8-b831c019b256 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:48.678272 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6783d8a5-42a9-4552-85d8-b831c019b256 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1214 microversion: 2.1 time: 0.250566 Sep 10 21:18:48.679439 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3071/6012] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:48 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:48.871478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55fcfd90-754f-47a3-a4a1-e19e0f8bdd08 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Action: 'create', calling method: .version_select at 0x7f9944673790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-856188378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFASs8Avz72ZleyIcQS6oYz3h+ieaCzKpd0UpEHWn8Z+mJWp4f6bcPEqLCQv98HEXocsNNzYIFtbdGaxy2WRUtpB7qcp6YqK6F3Hi5apjUQSS8711e8SU022OmWsA8++9A=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:48.933555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-55fcfd90-754f-47a3-a4a1-e19e0f8bdd08 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:18:48.953245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-55fcfd90-754f-47a3-a4a1-e19e0f8bdd08 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for user 93648515d8fb42a7aaf61e245db0e07d and project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:18:48.986911 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55fcfd90-754f-47a3-a4a1-e19e0f8bdd08 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.119309 Sep 10 21:18:48.993469 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2942/6013] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:18:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:18:49.646522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b7f51d2-0437-43a8-8ec9-37fc15b1b11d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:49.650760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b7f51d2-0437-43a8-8ec9-37fc15b1b11d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:49.665726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-9a5e8fa4-aef0-49ec-aabb-7de71deec7d6 req-ac2fbd14-f846-4fa7-a144-27e352d43282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef02761-7222-43d2-af15-a1ee80eb9f92", "tag": "e7acbc98-7340-435f-aae6-84d92fbd81f4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:49.687765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7f51d2-0437-43a8-8ec9-37fc15b1b11d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:49.691024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7f51d2-0437-43a8-8ec9-37fc15b1b11d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:49.691205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9a5e8fa4-aef0-49ec-aabb-7de71deec7d6 req-ac2fbd14-f846-4fa7-a144-27e352d43282 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:49.696028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7f51d2-0437-43a8-8ec9-37fc15b1b11d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:49.697798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9a5e8fa4-aef0-49ec-aabb-7de71deec7d6 req-ac2fbd14-f846-4fa7-a144-27e352d43282 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:49.699286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-9a5e8fa4-aef0-49ec-aabb-7de71deec7d6 req-ac2fbd14-f846-4fa7-a144-27e352d43282 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:49.699419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7f51d2-0437-43a8-8ec9-37fc15b1b11d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:49.702316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7f51d2-0437-43a8-8ec9-37fc15b1b11d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:49.705177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7f51d2-0437-43a8-8ec9-37fc15b1b11d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:49.739737 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-9a5e8fa4-aef0-49ec-aabb-7de71deec7d6 req-ac2fbd14-f846-4fa7-a144-27e352d43282 service nova] Creating event network-changed:e7acbc98-7340-435f-aae6-84d92fbd81f4 for instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 on nch1-master-1 Sep 10 21:18:49.765464 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-9a5e8fa4-aef0-49ec-aabb-7de71deec7d6 req-ac2fbd14-f846-4fa7-a144-27e352d43282 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103666 Sep 10 21:18:49.771755 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2943/6014] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:18:49.810118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1b749794-f997-4b64-b05e-281370b36f1a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:49.810914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1b749794-f997-4b64-b05e-281370b36f1a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:49.824306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b749794-f997-4b64-b05e-281370b36f1a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:49.825081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b749794-f997-4b64-b05e-281370b36f1a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:49.825750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b749794-f997-4b64-b05e-281370b36f1a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:49.827305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b749794-f997-4b64-b05e-281370b36f1a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:49.827954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b749794-f997-4b64-b05e-281370b36f1a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:49.828579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b749794-f997-4b64-b05e-281370b36f1a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:50.109169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b7f51d2-0437-43a8-8ec9-37fc15b1b11d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:50.146239 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b7f51d2-0437-43a8-8ec9-37fc15b1b11d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1566 microversion: 2.1 time: 0.498146 Sep 10 21:18:50.152714 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3072/6015] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:49 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1566 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:50.589687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1b749794-f997-4b64-b05e-281370b36f1a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:50.611629 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1b749794-f997-4b64-b05e-281370b36f1a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1272 microversion: 2.1 time: 0.834518 Sep 10 21:18:50.613605 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2944/6016] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:49 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1272 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:51.652380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9f6a6c5b-89b4-4e14-8393-baeb21b4b4bb tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:51.653491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9f6a6c5b-89b4-4e14-8393-baeb21b4b4bb tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:51.699460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f6a6c5b-89b4-4e14-8393-baeb21b4b4bb tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:51.704185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f6a6c5b-89b4-4e14-8393-baeb21b4b4bb tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:51.704684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f6a6c5b-89b4-4e14-8393-baeb21b4b4bb tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:51.705445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f6a6c5b-89b4-4e14-8393-baeb21b4b4bb tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:51.709275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f6a6c5b-89b4-4e14-8393-baeb21b4b4bb tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:51.709740 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f6a6c5b-89b4-4e14-8393-baeb21b4b4bb tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:51.950334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9f6a6c5b-89b4-4e14-8393-baeb21b4b4bb tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:51.966015 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9f6a6c5b-89b4-4e14-8393-baeb21b4b4bb tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1272 microversion: 2.1 time: 0.324105 Sep 10 21:18:51.968765 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3073/6017] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:51 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1272 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:52.996592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-92fd01a6-f303-412b-a6e1-5ce3d4625e21 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:52.998129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-92fd01a6-f303-412b-a6e1-5ce3d4625e21 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:53.007221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92fd01a6-f303-412b-a6e1-5ce3d4625e21 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:53.008652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92fd01a6-f303-412b-a6e1-5ce3d4625e21 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:53.009734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92fd01a6-f303-412b-a6e1-5ce3d4625e21 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:53.010841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92fd01a6-f303-412b-a6e1-5ce3d4625e21 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:53.012409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92fd01a6-f303-412b-a6e1-5ce3d4625e21 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:53.013471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-92fd01a6-f303-412b-a6e1-5ce3d4625e21 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:53.174238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-92fd01a6-f303-412b-a6e1-5ce3d4625e21 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:53.186575 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-92fd01a6-f303-412b-a6e1-5ce3d4625e21 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1272 microversion: 2.1 time: 0.194000 Sep 10 21:18:53.187182 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2945/6018] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:52 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:53.374448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1549970139", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "7f1310b4-7979-4dfb-a2ea-5786a08cab01"}], "key_name": "tempest-TestNetworkBasicOps-856188378", "security_groups": [{"name": "tempest-secgroup-smoke-1912433885"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:53.590524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] validate_networks() for [('7f1310b4-7979-4dfb-a2ea-5786a08cab01', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:18:54.179317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:18:54.180023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:18:54.180987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:18:54.181140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:18:54.181497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:18:54.183957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:54.197295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:54.198414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:54.198941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:54.199693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:54.200569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:54.201245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:54.213973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f663b0a-d59d-446f-93c6-444396d8891b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:54.214605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f663b0a-d59d-446f-93c6-444396d8891b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:54.229799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:18:54.231906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:54.233551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f663b0a-d59d-446f-93c6-444396d8891b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:54.234164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f663b0a-d59d-446f-93c6-444396d8891b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:54.234676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f663b0a-d59d-446f-93c6-444396d8891b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:54.235445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f663b0a-d59d-446f-93c6-444396d8891b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:54.236008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f663b0a-d59d-446f-93c6-444396d8891b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:54.236437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f663b0a-d59d-446f-93c6-444396d8891b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:54.240475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:54.244849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Getting quotas for user 93648515d8fb42a7aaf61e245db0e07d and project fe0d9347a2d64323bb563b6f1f0b0cd6. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:18:54.265104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:18:54.268810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:18:54.326160 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6afa9069-2b17-4900-b4ea-70316766b80a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.957488 Sep 10 21:18:54.326917 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3074/6019] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:18:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:18:54.339605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-13257427-63c7-4300-a15b-7e11181e46a3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:54.340559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-13257427-63c7-4300-a15b-7e11181e46a3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:54.417450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13257427-63c7-4300-a15b-7e11181e46a3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:54.425092 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-13257427-63c7-4300-a15b-7e11181e46a3 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1248 microversion: 2.1 time: 0.089807 Sep 10 21:18:54.425711 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3075/6020] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:54 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:54.600176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f663b0a-d59d-446f-93c6-444396d8891b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:54.610136 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f663b0a-d59d-446f-93c6-444396d8891b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1314 microversion: 2.1 time: 0.400168 Sep 10 21:18:54.611341 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2946/6021] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:54 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:18:55.365258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-989b3027-26e1-48cc-94dc-729b824c6931 req-4f509609-e12d-497a-8435-7ce747f52816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fafcc8-1a4f-464e-ba5b-0b937b3a44f2", "tag": "9b158bb6-dd0e-498e-a279-c478b109b54d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:55.411445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-989b3027-26e1-48cc-94dc-729b824c6931 req-4f509609-e12d-497a-8435-7ce747f52816 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:55.411938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-989b3027-26e1-48cc-94dc-729b824c6931 req-4f509609-e12d-497a-8435-7ce747f52816 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:55.412379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-989b3027-26e1-48cc-94dc-729b824c6931 req-4f509609-e12d-497a-8435-7ce747f52816 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:55.450283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b24dfb90-eac5-4493-bfda-af2b8e73cc4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:55.450971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b24dfb90-eac5-4493-bfda-af2b8e73cc4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:55.454195 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-989b3027-26e1-48cc-94dc-729b824c6931 req-4f509609-e12d-497a-8435-7ce747f52816 service nova] Creating event network-changed:9b158bb6-dd0e-498e-a279-c478b109b54d for instance 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 on nch2-master-1 Sep 10 21:18:55.471999 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-989b3027-26e1-48cc-94dc-729b824c6931 req-4f509609-e12d-497a-8435-7ce747f52816 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110146 Sep 10 21:18:55.473428 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3076/6022] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:18:55.474037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b24dfb90-eac5-4493-bfda-af2b8e73cc4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:55.474654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b24dfb90-eac5-4493-bfda-af2b8e73cc4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:55.475119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b24dfb90-eac5-4493-bfda-af2b8e73cc4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:55.484397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b24dfb90-eac5-4493-bfda-af2b8e73cc4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:55.485241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b24dfb90-eac5-4493-bfda-af2b8e73cc4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:55.487073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b24dfb90-eac5-4493-bfda-af2b8e73cc4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:55.637848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8ccac8d-7e43-476d-afc5-9898ce02ecb5 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:55.638920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c8ccac8d-7e43-476d-afc5-9898ce02ecb5 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:55.649769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8ccac8d-7e43-476d-afc5-9898ce02ecb5 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:55.652958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8ccac8d-7e43-476d-afc5-9898ce02ecb5 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:55.655327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8ccac8d-7e43-476d-afc5-9898ce02ecb5 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:55.658130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8ccac8d-7e43-476d-afc5-9898ce02ecb5 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:55.658798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8ccac8d-7e43-476d-afc5-9898ce02ecb5 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:55.661251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8ccac8d-7e43-476d-afc5-9898ce02ecb5 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:56.007805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c8ccac8d-7e43-476d-afc5-9898ce02ecb5 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:56.026823 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c8ccac8d-7e43-476d-afc5-9898ce02ecb5 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1314 microversion: 2.1 time: 0.393152 Sep 10 21:18:56.027754 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3077/6023] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:55 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:56.065860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b24dfb90-eac5-4493-bfda-af2b8e73cc4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:56.076277 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b24dfb90-eac5-4493-bfda-af2b8e73cc4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1300 microversion: 2.1 time: 0.631199 Sep 10 21:18:56.076879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2947/6024] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:55 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1300 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:18:57.054391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c954951-d8c2-4159-bd71-caec031ff351 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:57.055020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c954951-d8c2-4159-bd71-caec031ff351 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:57.067764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c954951-d8c2-4159-bd71-caec031ff351 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:57.070440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c954951-d8c2-4159-bd71-caec031ff351 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:57.072870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c954951-d8c2-4159-bd71-caec031ff351 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:57.074102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c954951-d8c2-4159-bd71-caec031ff351 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:57.078820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c954951-d8c2-4159-bd71-caec031ff351 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:57.079572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c954951-d8c2-4159-bd71-caec031ff351 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:57.108321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d388c637-e341-4e25-871d-39c10398e3f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:57.109029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d388c637-e341-4e25-871d-39c10398e3f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:57.126347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d388c637-e341-4e25-871d-39c10398e3f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:57.127193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=71 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:57.127920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d388c637-e341-4e25-871d-39c10398e3f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:57.129557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d388c637-e341-4e25-871d-39c10398e3f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:57.130958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d388c637-e341-4e25-871d-39c10398e3f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:57.131839 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d388c637-e341-4e25-871d-39c10398e3f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:57.133756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d388c637-e341-4e25-871d-39c10398e3f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:57.248000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d388c637-e341-4e25-871d-39c10398e3f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:57.264895 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d388c637-e341-4e25-871d-39c10398e3f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1306 microversion: 2.1 time: 0.161918 Sep 10 21:18:57.265502 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2948/6025] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:57 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:57.412299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c954951-d8c2-4159-bd71-caec031ff351 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:57.427979 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c954951-d8c2-4159-bd71-caec031ff351 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1314 microversion: 2.1 time: 0.377475 Sep 10 21:18:57.429762 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3078/6026] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:57 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:58.295375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5aa1d8f-4452-4954-a561-9c3a07ee337c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:58.296255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e5aa1d8f-4452-4954-a561-9c3a07ee337c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:58.310552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5aa1d8f-4452-4954-a561-9c3a07ee337c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:58.312172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5aa1d8f-4452-4954-a561-9c3a07ee337c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:58.312894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5aa1d8f-4452-4954-a561-9c3a07ee337c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:58.318243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5aa1d8f-4452-4954-a561-9c3a07ee337c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:58.318639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5aa1d8f-4452-4954-a561-9c3a07ee337c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:58.319085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5aa1d8f-4452-4954-a561-9c3a07ee337c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:58.460103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-817ef86b-a00e-4c4e-b5e4-df743c3e160a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:58.461260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-817ef86b-a00e-4c4e-b5e4-df743c3e160a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:58.481411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-817ef86b-a00e-4c4e-b5e4-df743c3e160a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:58.484871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-817ef86b-a00e-4c4e-b5e4-df743c3e160a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:58.486321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-817ef86b-a00e-4c4e-b5e4-df743c3e160a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:58.491579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-817ef86b-a00e-4c4e-b5e4-df743c3e160a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:58.491791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-817ef86b-a00e-4c4e-b5e4-df743c3e160a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:58.492410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-817ef86b-a00e-4c4e-b5e4-df743c3e160a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:58.780703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e5aa1d8f-4452-4954-a561-9c3a07ee337c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:58.792151 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5aa1d8f-4452-4954-a561-9c3a07ee337c tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1374 microversion: 2.1 time: 0.501604 Sep 10 21:18:58.794708 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2949/6027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:58 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1374 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:59.015821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-817ef86b-a00e-4c4e-b5e4-df743c3e160a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:18:59.032222 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-817ef86b-a00e-4c4e-b5e4-df743c3e160a tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1314 microversion: 2.1 time: 0.582625 Sep 10 21:18:59.035079 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3079/6028] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:58 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:18:59.405795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-4070a75c-f089-4b2f-85d3-f042f283b813 req-28ede704-f7e1-4d55-acd4-7a6f9e87d72a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d237866-5abd-49e2-a390-338123e619e2", "tag": "b87a4c3c-8eba-4dc8-adf8-93456d35d980"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:18:59.422243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:18:59.437446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4070a75c-f089-4b2f-85d3-f042f283b813 req-28ede704-f7e1-4d55-acd4-7a6f9e87d72a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:59.438375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4070a75c-f089-4b2f-85d3-f042f283b813 req-28ede704-f7e1-4d55-acd4-7a6f9e87d72a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:59.439749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-4070a75c-f089-4b2f-85d3-f042f283b813 req-28ede704-f7e1-4d55-acd4-7a6f9e87d72a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:59.474040 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-4070a75c-f089-4b2f-85d3-f042f283b813 req-28ede704-f7e1-4d55-acd4-7a6f9e87d72a service nova] Creating event network-changed:b87a4c3c-8eba-4dc8-adf8-93456d35d980 for instance 0d237866-5abd-49e2-a390-338123e619e2 on nch1-master-1 Sep 10 21:18:59.480637 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-4070a75c-f089-4b2f-85d3-f042f283b813 req-28ede704-f7e1-4d55-acd4-7a6f9e87d72a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097668 Sep 10 21:18:59.482799 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2950/6029] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:18:59.823298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-97f8f47c-f47d-469d-91bf-adb7e49f061a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:18:59.823995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-97f8f47c-f47d-469d-91bf-adb7e49f061a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:18:59.840279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8f47c-f47d-469d-91bf-adb7e49f061a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:59.841468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8f47c-f47d-469d-91bf-adb7e49f061a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:59.842095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8f47c-f47d-469d-91bf-adb7e49f061a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:18:59.842999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8f47c-f47d-469d-91bf-adb7e49f061a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:18:59.843768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8f47c-f47d-469d-91bf-adb7e49f061a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:18:59.844832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97f8f47c-f47d-469d-91bf-adb7e49f061a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:00.061398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1d9da583-ba13-457a-92f7-800818b7e8bf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:00.062865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1d9da583-ba13-457a-92f7-800818b7e8bf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:00.080831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d9da583-ba13-457a-92f7-800818b7e8bf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:00.082304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d9da583-ba13-457a-92f7-800818b7e8bf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:00.083863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d9da583-ba13-457a-92f7-800818b7e8bf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:00.084706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d9da583-ba13-457a-92f7-800818b7e8bf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:00.086417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d9da583-ba13-457a-92f7-800818b7e8bf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:00.087104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d9da583-ba13-457a-92f7-800818b7e8bf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:00.322571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1d9da583-ba13-457a-92f7-800818b7e8bf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:00.331054 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1d9da583-ba13-457a-92f7-800818b7e8bf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1314 microversion: 2.1 time: 0.275204 Sep 10 21:19:00.332723 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2951/6030] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:00 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:00.418671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-97f8f47c-f47d-469d-91bf-adb7e49f061a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:00.451624 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-97f8f47c-f47d-469d-91bf-adb7e49f061a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1374 microversion: 2.1 time: 0.631914 Sep 10 21:19:00.467443 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3080/6031] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:18:59 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1374 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:01.355538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89c43a6b-a846-4a27-b3d4-74441d391ce4 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:01.356162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-89c43a6b-a846-4a27-b3d4-74441d391ce4 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:01.364629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c43a6b-a846-4a27-b3d4-74441d391ce4 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:01.365363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c43a6b-a846-4a27-b3d4-74441d391ce4 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:01.366033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c43a6b-a846-4a27-b3d4-74441d391ce4 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:01.366984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c43a6b-a846-4a27-b3d4-74441d391ce4 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:01.367849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c43a6b-a846-4a27-b3d4-74441d391ce4 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:01.368402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c43a6b-a846-4a27-b3d4-74441d391ce4 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:01.475990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a9601da1-d05b-43cf-aa70-23c64deb9c96 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:01.476605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9601da1-d05b-43cf-aa70-23c64deb9c96 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:01.486853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9601da1-d05b-43cf-aa70-23c64deb9c96 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:01.487483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9601da1-d05b-43cf-aa70-23c64deb9c96 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:01.487963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9601da1-d05b-43cf-aa70-23c64deb9c96 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:01.488782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9601da1-d05b-43cf-aa70-23c64deb9c96 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:01.489584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9601da1-d05b-43cf-aa70-23c64deb9c96 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:01.490508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9601da1-d05b-43cf-aa70-23c64deb9c96 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:01.522103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89c43a6b-a846-4a27-b3d4-74441d391ce4 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:01.531953 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-89c43a6b-a846-4a27-b3d4-74441d391ce4 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1314 microversion: 2.1 time: 0.180434 Sep 10 21:19:01.532820 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2952/6032] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:01 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:01.788745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a9601da1-d05b-43cf-aa70-23c64deb9c96 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:01.802917 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a9601da1-d05b-43cf-aa70-23c64deb9c96 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1374 microversion: 2.1 time: 0.331329 Sep 10 21:19:01.806544 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3081/6033] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:01 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1374 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:19:02.557308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-94a4ac43-7c4d-42dd-9623-759bc7c0daaf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:02.558975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-94a4ac43-7c4d-42dd-9623-759bc7c0daaf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:02.574790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94a4ac43-7c4d-42dd-9623-759bc7c0daaf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:02.578771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94a4ac43-7c4d-42dd-9623-759bc7c0daaf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:02.579502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94a4ac43-7c4d-42dd-9623-759bc7c0daaf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:02.583854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94a4ac43-7c4d-42dd-9623-759bc7c0daaf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:02.584938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94a4ac43-7c4d-42dd-9623-759bc7c0daaf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:02.585604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-94a4ac43-7c4d-42dd-9623-759bc7c0daaf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:02.698421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f5d1b3b2-af0d-46ee-bab3-fcc2c89a9ab5 req-21e41659-b219-44a3-9399-24be280c8414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fafcc8-1a4f-464e-ba5b-0b937b3a44f2", "name": "network-vif-plugged", "status": "completed", "tag": "9b158bb6-dd0e-498e-a279-c478b109b54d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:19:02.726217 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f5d1b3b2-af0d-46ee-bab3-fcc2c89a9ab5 req-21e41659-b219-44a3-9399-24be280c8414 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:02.729342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f5d1b3b2-af0d-46ee-bab3-fcc2c89a9ab5 req-21e41659-b219-44a3-9399-24be280c8414 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:02.729951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f5d1b3b2-af0d-46ee-bab3-fcc2c89a9ab5 req-21e41659-b219-44a3-9399-24be280c8414 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:02.766346 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f5d1b3b2-af0d-46ee-bab3-fcc2c89a9ab5 req-21e41659-b219-44a3-9399-24be280c8414 service nova] Creating event network-vif-plugged:9b158bb6-dd0e-498e-a279-c478b109b54d for instance 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 on nch2-master-1 Sep 10 21:19:02.786964 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f5d1b3b2-af0d-46ee-bab3-fcc2c89a9ab5 req-21e41659-b219-44a3-9399-24be280c8414 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093454 Sep 10 21:19:02.789317 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3082/6034] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:19:02.837508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fc0e99a2-2858-4340-b24d-469a08f18617 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:02.838449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fc0e99a2-2858-4340-b24d-469a08f18617 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:02.855328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc0e99a2-2858-4340-b24d-469a08f18617 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:02.856500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc0e99a2-2858-4340-b24d-469a08f18617 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:02.862375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc0e99a2-2858-4340-b24d-469a08f18617 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:02.866474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc0e99a2-2858-4340-b24d-469a08f18617 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:02.868565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc0e99a2-2858-4340-b24d-469a08f18617 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:02.869670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fc0e99a2-2858-4340-b24d-469a08f18617 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:03.088589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-94a4ac43-7c4d-42dd-9623-759bc7c0daaf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:03.102027 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-94a4ac43-7c4d-42dd-9623-759bc7c0daaf tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1314 microversion: 2.1 time: 0.548954 Sep 10 21:19:03.103454 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2953/6035] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:02 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:03.367882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fc0e99a2-2858-4340-b24d-469a08f18617 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:03.381782 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fc0e99a2-2858-4340-b24d-469a08f18617 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1374 microversion: 2.1 time: 0.550637 Sep 10 21:19:03.383341 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3083/6036] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:02 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1374 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:04.131831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0574c749-4e77-44a4-bab0-1dc59e131f1f tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:04.132470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0574c749-4e77-44a4-bab0-1dc59e131f1f tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:04.146713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0574c749-4e77-44a4-bab0-1dc59e131f1f tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:04.147227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0574c749-4e77-44a4-bab0-1dc59e131f1f tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:04.147678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0574c749-4e77-44a4-bab0-1dc59e131f1f tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:04.148414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0574c749-4e77-44a4-bab0-1dc59e131f1f tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:04.148898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0574c749-4e77-44a4-bab0-1dc59e131f1f tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:04.149314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0574c749-4e77-44a4-bab0-1dc59e131f1f tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:04.409510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3fb4c77d-1532-479a-9ed8-8aaeb625716d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:04.410803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3fb4c77d-1532-479a-9ed8-8aaeb625716d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:04.443278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:19:04.448693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=16 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:19:04.453512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fb4c77d-1532-479a-9ed8-8aaeb625716d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:04.458399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fb4c77d-1532-479a-9ed8-8aaeb625716d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:04.462759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fb4c77d-1532-479a-9ed8-8aaeb625716d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:04.464708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fb4c77d-1532-479a-9ed8-8aaeb625716d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:04.468824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fb4c77d-1532-479a-9ed8-8aaeb625716d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:04.470684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fb4c77d-1532-479a-9ed8-8aaeb625716d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:04.674868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0574c749-4e77-44a4-bab0-1dc59e131f1f tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:04.686362 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0574c749-4e77-44a4-bab0-1dc59e131f1f tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1314 microversion: 2.1 time: 0.559218 Sep 10 21:19:04.695096 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2954/6037] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:04 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:04.849286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3fb4c77d-1532-479a-9ed8-8aaeb625716d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:04.865125 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3fb4c77d-1532-479a-9ed8-8aaeb625716d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1374 microversion: 2.1 time: 0.461593 Sep 10 21:19:04.878878 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3084/6038] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:04 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1374 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:19:05.718909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bc3902e2-8556-4027-9809-85aa56866e74 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:05.721157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bc3902e2-8556-4027-9809-85aa56866e74 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:05.734861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3902e2-8556-4027-9809-85aa56866e74 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:05.736472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3902e2-8556-4027-9809-85aa56866e74 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:05.737695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3902e2-8556-4027-9809-85aa56866e74 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:05.738980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3902e2-8556-4027-9809-85aa56866e74 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:05.739733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3902e2-8556-4027-9809-85aa56866e74 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:05.740868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bc3902e2-8556-4027-9809-85aa56866e74 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:05.898322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1643eb85-4774-4985-924e-a32ec07da6f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:05.899586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1643eb85-4774-4985-924e-a32ec07da6f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:05.914006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1643eb85-4774-4985-924e-a32ec07da6f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:05.914830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1643eb85-4774-4985-924e-a32ec07da6f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:05.915840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1643eb85-4774-4985-924e-a32ec07da6f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:05.917141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1643eb85-4774-4985-924e-a32ec07da6f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:05.918135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1643eb85-4774-4985-924e-a32ec07da6f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:05.919228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1643eb85-4774-4985-924e-a32ec07da6f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:05.980334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bc3902e2-8556-4027-9809-85aa56866e74 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:05.994831 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bc3902e2-8556-4027-9809-85aa56866e74 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1464 microversion: 2.1 time: 0.281899 Sep 10 21:19:06.011121 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2955/6039] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:05 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1464 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:06.021787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3f43dbd2-e4dd-4f9a-9d99-2dd722d2293b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd9557a8-a0fc-4a01-b7e8-2d540ec46406", "device": "/dev/sdb"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:19:06.025638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3f43dbd2-e4dd-4f9a-9d99-2dd722d2293b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:06.031834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f43dbd2-e4dd-4f9a-9d99-2dd722d2293b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:06.032347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f43dbd2-e4dd-4f9a-9d99-2dd722d2293b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:06.032805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f43dbd2-e4dd-4f9a-9d99-2dd722d2293b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:06.033528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f43dbd2-e4dd-4f9a-9d99-2dd722d2293b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:06.034034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f43dbd2-e4dd-4f9a-9d99-2dd722d2293b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:06.034534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3f43dbd2-e4dd-4f9a-9d99-2dd722d2293b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:06.253224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1643eb85-4774-4985-924e-a32ec07da6f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:06.262603 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1643eb85-4774-4985-924e-a32ec07da6f4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1374 microversion: 2.1 time: 0.368967 Sep 10 21:19:06.269318 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3085/6040] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:05 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1374 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:19:06.337112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ecc4a2cf-eba7-4b1d-949c-9120db0d420b req-608d67d1-9540-4a63-9307-0374e01ac61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d237866-5abd-49e2-a390-338123e619e2", "name": "network-vif-plugged", "status": "completed", "tag": "b87a4c3c-8eba-4dc8-adf8-93456d35d980"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:19:06.357409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ecc4a2cf-eba7-4b1d-949c-9120db0d420b req-608d67d1-9540-4a63-9307-0374e01ac61c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:06.357928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ecc4a2cf-eba7-4b1d-949c-9120db0d420b req-608d67d1-9540-4a63-9307-0374e01ac61c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:06.358369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ecc4a2cf-eba7-4b1d-949c-9120db0d420b req-608d67d1-9540-4a63-9307-0374e01ac61c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:06.387426 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ecc4a2cf-eba7-4b1d-949c-9120db0d420b req-608d67d1-9540-4a63-9307-0374e01ac61c service nova] Creating event network-vif-plugged:b87a4c3c-8eba-4dc8-adf8-93456d35d980 for instance 0d237866-5abd-49e2-a390-338123e619e2 on nch1-master-1 Sep 10 21:19:06.400680 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ecc4a2cf-eba7-4b1d-949c-9120db0d420b req-608d67d1-9540-4a63-9307-0374e01ac61c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067967 Sep 10 21:19:06.401529 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3086/6041] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:19:06.426694 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3f43dbd2-e4dd-4f9a-9d99-2dd722d2293b tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "POST /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408569 Sep 10 21:19:06.432862 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2956/6042] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Sep 10 21:19:06 2022] POST /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:19:07.299384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9922aa73-c7fc-4c6e-9957-7f534b39219b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:07.301237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9922aa73-c7fc-4c6e-9957-7f534b39219b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:07.316432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9922aa73-c7fc-4c6e-9957-7f534b39219b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:07.316937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9922aa73-c7fc-4c6e-9957-7f534b39219b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:07.317386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9922aa73-c7fc-4c6e-9957-7f534b39219b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:07.318135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9922aa73-c7fc-4c6e-9957-7f534b39219b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:07.318605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9922aa73-c7fc-4c6e-9957-7f534b39219b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:07.319052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9922aa73-c7fc-4c6e-9957-7f534b39219b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:07.639539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9922aa73-c7fc-4c6e-9957-7f534b39219b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:07.648478 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9922aa73-c7fc-4c6e-9957-7f534b39219b tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1374 microversion: 2.1 time: 0.357362 Sep 10 21:19:07.649049 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3087/6043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:07 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1374 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:08.677171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-811e1ff0-ea8c-4f5f-a1a6-5854c6706da4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:08.678415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-811e1ff0-ea8c-4f5f-a1a6-5854c6706da4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:08.693311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-811e1ff0-ea8c-4f5f-a1a6-5854c6706da4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:08.694209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-811e1ff0-ea8c-4f5f-a1a6-5854c6706da4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:08.694853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-811e1ff0-ea8c-4f5f-a1a6-5854c6706da4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:08.695784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-811e1ff0-ea8c-4f5f-a1a6-5854c6706da4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:08.696761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-811e1ff0-ea8c-4f5f-a1a6-5854c6706da4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:08.697413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-811e1ff0-ea8c-4f5f-a1a6-5854c6706da4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:09.042167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-811e1ff0-ea8c-4f5f-a1a6-5854c6706da4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:09.052601 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-811e1ff0-ea8c-4f5f-a1a6-5854c6706da4 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1545 microversion: 2.1 time: 0.382218 Sep 10 21:19:09.068085 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2957/6044] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:08 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1545 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:09.080925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-752bddba-f67c-4894-b87a-7060165ebccb tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:09.081610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-752bddba-f67c-4894-b87a-7060165ebccb tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:09.103824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-752bddba-f67c-4894-b87a-7060165ebccb tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:09.104751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-752bddba-f67c-4894-b87a-7060165ebccb tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:09.105548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-752bddba-f67c-4894-b87a-7060165ebccb tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:09.106575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-752bddba-f67c-4894-b87a-7060165ebccb tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:09.107648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-752bddba-f67c-4894-b87a-7060165ebccb tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:09.108200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-752bddba-f67c-4894-b87a-7060165ebccb tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:09.356603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-752bddba-f67c-4894-b87a-7060165ebccb tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:09.368291 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-752bddba-f67c-4894-b87a-7060165ebccb tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1545 microversion: 2.1 time: 0.292692 Sep 10 21:19:09.370093 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3088/6045] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:09 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1545 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:13.946814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a6ede2f6-e1df-43ce-aa6d-96983caba566 req-4c9ee8bb-c1e7-4ad9-9c3f-75751e42d78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d237866-5abd-49e2-a390-338123e619e2", "tag": "b87a4c3c-8eba-4dc8-adf8-93456d35d980"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:19:13.980793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a6ede2f6-e1df-43ce-aa6d-96983caba566 req-4c9ee8bb-c1e7-4ad9-9c3f-75751e42d78e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:13.981312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a6ede2f6-e1df-43ce-aa6d-96983caba566 req-4c9ee8bb-c1e7-4ad9-9c3f-75751e42d78e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:13.982061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a6ede2f6-e1df-43ce-aa6d-96983caba566 req-4c9ee8bb-c1e7-4ad9-9c3f-75751e42d78e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:13.995691 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a6ede2f6-e1df-43ce-aa6d-96983caba566 req-4c9ee8bb-c1e7-4ad9-9c3f-75751e42d78e service nova] Creating event network-changed:b87a4c3c-8eba-4dc8-adf8-93456d35d980 for instance 0d237866-5abd-49e2-a390-338123e619e2 on nch1-master-1 Sep 10 21:19:14.006700 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a6ede2f6-e1df-43ce-aa6d-96983caba566 req-4c9ee8bb-c1e7-4ad9-9c3f-75751e42d78e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348978 Sep 10 21:19:14.011404 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2958/6046] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:19:16.606233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-94d21670-a444-41af-be27-ba2a9bcd1c4c tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:16.608587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-94d21670-a444-41af-be27-ba2a9bcd1c4c tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:16.624264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94d21670-a444-41af-be27-ba2a9bcd1c4c tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:16.626338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94d21670-a444-41af-be27-ba2a9bcd1c4c tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:16.626883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94d21670-a444-41af-be27-ba2a9bcd1c4c tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:16.627816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94d21670-a444-41af-be27-ba2a9bcd1c4c tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:16.629456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94d21670-a444-41af-be27-ba2a9bcd1c4c tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:16.630833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94d21670-a444-41af-be27-ba2a9bcd1c4c tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:16.760931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-94d21670-a444-41af-be27-ba2a9bcd1c4c tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lazy-loading 'services' on Instance uuid 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:19:16.908614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f5aef602-72f9-4d08-988f-e361c5503e83 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:19:16.912296 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-94d21670-a444-41af-be27-ba2a9bcd1c4c tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2/os-volume_attachments/dd9557a8-a0fc-4a01-b7e8-2d540ec46406" status: 202 len: 0 microversion: 2.1 time: 0.312111 Sep 10 21:19:16.913579 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3089/6047] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Sep 10 21:19:16 2022] DELETE /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2/os-volume_attachments/dd9557a8-a0fc-4a01-b7e8-2d540ec46406 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:19:16.915371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f5aef602-72f9-4d08-988f-e361c5503e83 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:16.949356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5aef602-72f9-4d08-988f-e361c5503e83 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:16.951347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5aef602-72f9-4d08-988f-e361c5503e83 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:16.952014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5aef602-72f9-4d08-988f-e361c5503e83 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:16.952921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5aef602-72f9-4d08-988f-e361c5503e83 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:16.953581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5aef602-72f9-4d08-988f-e361c5503e83 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:16.954238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5aef602-72f9-4d08-988f-e361c5503e83 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:17.077724 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f5aef602-72f9-4d08-988f-e361c5503e83 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92/action" status: 200 len: 24567 microversion: 2.1 time: 0.178921 Sep 10 21:19:17.078794 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2959/6048] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:19:16 2022] POST /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92/action => generated 24567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:19:18.118723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6749cc8a-0411-47e5-8297-6da0c0077253 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:18.119316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6749cc8a-0411-47e5-8297-6da0c0077253 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:18.152033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6749cc8a-0411-47e5-8297-6da0c0077253 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:18.152834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6749cc8a-0411-47e5-8297-6da0c0077253 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:18.154052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6749cc8a-0411-47e5-8297-6da0c0077253 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:18.154971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6749cc8a-0411-47e5-8297-6da0c0077253 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:18.155636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6749cc8a-0411-47e5-8297-6da0c0077253 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:18.156251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6749cc8a-0411-47e5-8297-6da0c0077253 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:18.201705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6749cc8a-0411-47e5-8297-6da0c0077253 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:19:18.321903 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6749cc8a-0411-47e5-8297-6da0c0077253 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 204 len: 0 microversion: 2.1 time: 0.207930 Sep 10 21:19:18.322549 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3090/6049] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:19:18 2022] DELETE /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:19:18.335444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-647cfc38-56de-447e-8df0-558318cd1ce2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:18.336217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-647cfc38-56de-447e-8df0-558318cd1ce2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:18.350141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-647cfc38-56de-447e-8df0-558318cd1ce2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:18.350660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-647cfc38-56de-447e-8df0-558318cd1ce2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:18.351462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-647cfc38-56de-447e-8df0-558318cd1ce2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:18.352206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-647cfc38-56de-447e-8df0-558318cd1ce2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:18.352669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-647cfc38-56de-447e-8df0-558318cd1ce2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:18.353534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-647cfc38-56de-447e-8df0-558318cd1ce2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:18.611339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-647cfc38-56de-447e-8df0-558318cd1ce2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:18.619728 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-647cfc38-56de-447e-8df0-558318cd1ce2 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1470 microversion: 2.1 time: 0.291691 Sep 10 21:19:18.621879 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2960/6050] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:18 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:19.644691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-13005815-b637-4df1-aeb8-8000e7459547 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:19.645640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-13005815-b637-4df1-aeb8-8000e7459547 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:19.652788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13005815-b637-4df1-aeb8-8000e7459547 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:19.653358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13005815-b637-4df1-aeb8-8000e7459547 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:19.653943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13005815-b637-4df1-aeb8-8000e7459547 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:19.654956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13005815-b637-4df1-aeb8-8000e7459547 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:19.655492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13005815-b637-4df1-aeb8-8000e7459547 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:19.655991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13005815-b637-4df1-aeb8-8000e7459547 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:19.968409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13005815-b637-4df1-aeb8-8000e7459547 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:19.980535 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-13005815-b637-4df1-aeb8-8000e7459547 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1470 microversion: 2.1 time: 0.340350 Sep 10 21:19:19.981345 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3091/6051] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:19 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1470 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:19:21.005599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2a0c053c-ac8e-4978-9d12-716845f58d02 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:21.006372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2a0c053c-ac8e-4978-9d12-716845f58d02 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:21.024139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a0c053c-ac8e-4978-9d12-716845f58d02 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:21.030377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a0c053c-ac8e-4978-9d12-716845f58d02 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:21.030980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a0c053c-ac8e-4978-9d12-716845f58d02 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:21.031845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a0c053c-ac8e-4978-9d12-716845f58d02 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:21.032414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a0c053c-ac8e-4978-9d12-716845f58d02 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:21.032936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2a0c053c-ac8e-4978-9d12-716845f58d02 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:21.123446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a1ada266-d3e4-472f-87ef-92ccd251d3fe req-04e07c57-2c12-4bb8-b2c3-1cb3558f341f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fafcc8-1a4f-464e-ba5b-0b937b3a44f2", "name": "network-vif-deleted", "tag": "9b158bb6-dd0e-498e-a279-c478b109b54d"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:19:21.141405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a1ada266-d3e4-472f-87ef-92ccd251d3fe req-04e07c57-2c12-4bb8-b2c3-1cb3558f341f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:21.141915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a1ada266-d3e4-472f-87ef-92ccd251d3fe req-04e07c57-2c12-4bb8-b2c3-1cb3558f341f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:21.142352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a1ada266-d3e4-472f-87ef-92ccd251d3fe req-04e07c57-2c12-4bb8-b2c3-1cb3558f341f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:21.166986 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a1ada266-d3e4-472f-87ef-92ccd251d3fe req-04e07c57-2c12-4bb8-b2c3-1cb3558f341f service nova] Creating event network-vif-deleted:9b158bb6-dd0e-498e-a279-c478b109b54d for instance 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 on nch2-master-1 Sep 10 21:19:21.174411 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a1ada266-d3e4-472f-87ef-92ccd251d3fe req-04e07c57-2c12-4bb8-b2c3-1cb3558f341f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054679 Sep 10 21:19:21.177927 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3092/6052] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:19:21.210527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2a0c053c-ac8e-4978-9d12-716845f58d02 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf8e35a0a6845768bd0ad61c9b87e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5963e3c1ac34aa29de539734a0c6466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:21.224225 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2a0c053c-ac8e-4978-9d12-716845f58d02 tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 200 len: 1428 microversion: 2.1 time: 0.223247 Sep 10 21:19:21.226213 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2961/6053] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:20 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 1428 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:22.252622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:22.254344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] [instance: 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:22.266460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:22.267596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:22.271761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:22.272730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:22.273374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:22.274001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:22.307268 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] HTTP exception thrown: Instance 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 could not be found. Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Request method failure captured: Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 HTTP/1.1 Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP8yjWgno5rUW26T6w34ajDDAW2NUnF--Zbeu2PN_13AllGFIk8xZaPC9Qx2MAaFpA35pflTLdj4a9tFbCKxAgwOzb1tzlthJWNw05xzSH-3F_VQWN8tID4KFIMMGnPFdYVl-xa2lxn0NbED-v6f2e2r6KGuO5c1MFsq6qpMOn3pACg Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: b5963e3c1ac34aa29de539734a0c6466 Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-VolumesBackupsTest-1090969172 Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5963e3c1ac34aa29de539734a0c6466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5963e3c1ac34aa29de539734a0c6466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b5963e3c1ac34aa29de539734a0c6466", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b5963e3c1ac34aa29de539734a0c6466"}]}] Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-VolumesBackupsTest-1090969172 Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: b5963e3c1ac34aa29de539734a0c6466 Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-VolumesBackupsTest-1090969172 Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-VolumesBackupsTest-1090969172-project Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: eaf8e35a0a6845768bd0ad61c9b87e22 Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-VolumesBackupsTest-1090969172-project Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 could not be found. Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '83fafcc8-1a4f-464e-ba5b-0b937b3a44f2'} Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 could not be found. Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 could not be found. Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:19:22.308995 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:19:22.315040 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:19:22.315040 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:19:22.315040 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:19:22.315040 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:19:22.315040 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:19:22.315040 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 could not be found. Sep 10 21:19:22.315040 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:19:22.315040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] Returning 404 to user: Instance 83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:19:22.315040 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0626b2be-72be-4066-b6b0-c627e1fd60fe tempest-VolumesBackupsTest-1090969172 tempest-VolumesBackupsTest-1090969172-project] 10.222.0.33 "GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2" status: 404 len: 111 microversion: 2.1 time: 0.065161 Sep 10 21:19:22.315040 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3093/6054] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:22 2022] GET /compute/v2.1/servers/83fafcc8-1a4f-464e-ba5b-0b937b3a44f2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:19:44.302105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a0540cd4-19de-420e-a47e-030b60996f70 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:19:44.305522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a0540cd4-19de-420e-a47e-030b60996f70 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:44.320476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=31 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:19:44.321309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:19:44.327046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0540cd4-19de-420e-a47e-030b60996f70 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:44.327772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0540cd4-19de-420e-a47e-030b60996f70 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:44.328220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0540cd4-19de-420e-a47e-030b60996f70 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:44.329021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0540cd4-19de-420e-a47e-030b60996f70 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:44.329494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0540cd4-19de-420e-a47e-030b60996f70 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:44.329936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0540cd4-19de-420e-a47e-030b60996f70 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:44.427039 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a0540cd4-19de-420e-a47e-030b60996f70 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "POST /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2/action" status: 200 len: 24574 microversion: 2.1 time: 0.130073 Sep 10 21:19:44.427732 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2962/6055] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:19:44 2022] POST /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2/action => generated 24574 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:19:47.526813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d9202e5a-8216-4f43-b0aa-86330b5f24bc tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:47.528226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d9202e5a-8216-4f43-b0aa-86330b5f24bc tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:47.530832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:19:47.531754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:19:47.539943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9202e5a-8216-4f43-b0aa-86330b5f24bc tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:47.540958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9202e5a-8216-4f43-b0aa-86330b5f24bc tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:47.541699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9202e5a-8216-4f43-b0aa-86330b5f24bc tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:47.543157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9202e5a-8216-4f43-b0aa-86330b5f24bc tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:47.544019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9202e5a-8216-4f43-b0aa-86330b5f24bc tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:47.544919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9202e5a-8216-4f43-b0aa-86330b5f24bc tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:48.108619 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d9202e5a-8216-4f43-b0aa-86330b5f24bc tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1835 microversion: 2.1 time: 0.585857 Sep 10 21:19:48.111064 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3094/6056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:47 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1835 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:48.133623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc6ebf07-ec11-45b7-a1ef-90414218737e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:48.134896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cc6ebf07-ec11-45b7-a1ef-90414218737e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:48.145243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc6ebf07-ec11-45b7-a1ef-90414218737e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:48.146105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc6ebf07-ec11-45b7-a1ef-90414218737e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:48.147295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc6ebf07-ec11-45b7-a1ef-90414218737e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:48.148728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc6ebf07-ec11-45b7-a1ef-90414218737e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:48.149378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc6ebf07-ec11-45b7-a1ef-90414218737e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:48.150541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cc6ebf07-ec11-45b7-a1ef-90414218737e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:48.382519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cc6ebf07-ec11-45b7-a1ef-90414218737e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:48.396117 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cc6ebf07-ec11-45b7-a1ef-90414218737e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1684 microversion: 2.1 time: 0.267480 Sep 10 21:19:48.397778 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2963/6057] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:48 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1684 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:48.568745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1dde886f-b3d0-4c16-8cb6-ba3cdb969404 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:19:48.573079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1dde886f-b3d0-4c16-8cb6-ba3cdb969404 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:48.582554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dde886f-b3d0-4c16-8cb6-ba3cdb969404 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:48.583155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dde886f-b3d0-4c16-8cb6-ba3cdb969404 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:48.584510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dde886f-b3d0-4c16-8cb6-ba3cdb969404 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:48.585493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dde886f-b3d0-4c16-8cb6-ba3cdb969404 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:48.586241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dde886f-b3d0-4c16-8cb6-ba3cdb969404 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:48.587604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1dde886f-b3d0-4c16-8cb6-ba3cdb969404 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:48.670226 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1dde886f-b3d0-4c16-8cb6-ba3cdb969404 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92/action" status: 200 len: 32644 microversion: 2.1 time: 0.104837 Sep 10 21:19:48.672606 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3095/6058] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:19:48 2022] POST /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92/action => generated 32644 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:19:48.863658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:19:48.864860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:48.874543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:48.875070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:48.878978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:48.879773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:48.882005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:48.882686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:48.955178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '09038e5611424270a0afa7928b3cf791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48270d4f7205461aa0563e2ef69c6c44', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:48.956908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] flavor_id is None. Assuming migration. {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 21:19:48.957495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:19:49.305646 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [c2425482-0410-4dae-a4e4-53f889d5d91e] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:19:50.319426 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [c2425482-0410-4dae-a4e4-53f889d5d91e] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 58730. Sep 10 21:19:50.324819 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-16ee96b3-4faa-4af2-9cdf-7bc4c8e5a0c9 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92/action" status: 202 len: 0 microversion: 2.1 time: 1.465646 Sep 10 21:19:50.325732 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2964/6059] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:19:48 2022] POST /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92/action => generated 0 bytes in 1467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:19:50.335117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4d68e094-7eb8-446d-93b1-af13c8caa70f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:50.335799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4d68e094-7eb8-446d-93b1-af13c8caa70f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:50.352384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d68e094-7eb8-446d-93b1-af13c8caa70f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:50.355077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d68e094-7eb8-446d-93b1-af13c8caa70f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:50.355703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d68e094-7eb8-446d-93b1-af13c8caa70f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:50.356618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d68e094-7eb8-446d-93b1-af13c8caa70f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:50.361092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d68e094-7eb8-446d-93b1-af13c8caa70f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:50.362082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4d68e094-7eb8-446d-93b1-af13c8caa70f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:50.764958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4d68e094-7eb8-446d-93b1-af13c8caa70f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:50.793528 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4d68e094-7eb8-446d-93b1-af13c8caa70f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1693 microversion: 2.1 time: 0.462005 Sep 10 21:19:50.796886 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3096/6060] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:50 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1693 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:51.834483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cd956031-430c-43f3-aa14-cff0a5cf0eb0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:51.838041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cd956031-430c-43f3-aa14-cff0a5cf0eb0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:51.884705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd956031-430c-43f3-aa14-cff0a5cf0eb0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:51.887814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd956031-430c-43f3-aa14-cff0a5cf0eb0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:51.892401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd956031-430c-43f3-aa14-cff0a5cf0eb0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:51.897233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd956031-430c-43f3-aa14-cff0a5cf0eb0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:51.898443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd956031-430c-43f3-aa14-cff0a5cf0eb0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:51.902230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cd956031-430c-43f3-aa14-cff0a5cf0eb0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:52.252575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cd956031-430c-43f3-aa14-cff0a5cf0eb0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:52.262081 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cd956031-430c-43f3-aa14-cff0a5cf0eb0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1693 microversion: 2.1 time: 0.442110 Sep 10 21:19:52.262674 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2965/6061] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:51 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1693 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:53.287509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b2a2483-0118-492e-97e4-8165bce4b4b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:53.289075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b2a2483-0118-492e-97e4-8165bce4b4b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:53.303969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2a2483-0118-492e-97e4-8165bce4b4b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:53.304474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2a2483-0118-492e-97e4-8165bce4b4b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:53.305054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2a2483-0118-492e-97e4-8165bce4b4b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:53.306034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2a2483-0118-492e-97e4-8165bce4b4b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:53.306666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2a2483-0118-492e-97e4-8165bce4b4b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:53.307104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b2a2483-0118-492e-97e4-8165bce4b4b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:53.584320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b2a2483-0118-492e-97e4-8165bce4b4b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:53.603226 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b2a2483-0118-492e-97e4-8165bce4b4b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1693 microversion: 2.1 time: 0.319668 Sep 10 21:19:53.604512 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3097/6062] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:53 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1693 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:54.630905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a098d749-09ad-4f8a-ae38-58cc2753103a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:54.632429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a098d749-09ad-4f8a-ae38-58cc2753103a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:54.641203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098d749-09ad-4f8a-ae38-58cc2753103a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:54.642123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098d749-09ad-4f8a-ae38-58cc2753103a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:54.643660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098d749-09ad-4f8a-ae38-58cc2753103a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:54.647174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098d749-09ad-4f8a-ae38-58cc2753103a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:54.648692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098d749-09ad-4f8a-ae38-58cc2753103a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:54.650039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a098d749-09ad-4f8a-ae38-58cc2753103a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:54.915687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a098d749-09ad-4f8a-ae38-58cc2753103a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:54.920983 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a098d749-09ad-4f8a-ae38-58cc2753103a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.296993 Sep 10 21:19:54.933392 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2966/6063] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:54 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:55.947825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9993733-0f55-4d08-a358-5e406fcfe87a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:55.948395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f9993733-0f55-4d08-a358-5e406fcfe87a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:55.970340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9993733-0f55-4d08-a358-5e406fcfe87a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:55.978697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9993733-0f55-4d08-a358-5e406fcfe87a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:55.979500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9993733-0f55-4d08-a358-5e406fcfe87a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:55.980745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9993733-0f55-4d08-a358-5e406fcfe87a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:55.981411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9993733-0f55-4d08-a358-5e406fcfe87a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:55.982567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9993733-0f55-4d08-a358-5e406fcfe87a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:56.245149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f9993733-0f55-4d08-a358-5e406fcfe87a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:56.274013 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f9993733-0f55-4d08-a358-5e406fcfe87a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.327992 Sep 10 21:19:56.278156 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3098/6064] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:55 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:57.302779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e55f0224-0aff-4b0c-a4a6-e45679a8ee07 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:57.304116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e55f0224-0aff-4b0c-a4a6-e45679a8ee07 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:57.311945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e55f0224-0aff-4b0c-a4a6-e45679a8ee07 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:57.312814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e55f0224-0aff-4b0c-a4a6-e45679a8ee07 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:57.313445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e55f0224-0aff-4b0c-a4a6-e45679a8ee07 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:57.315287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e55f0224-0aff-4b0c-a4a6-e45679a8ee07 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:57.315970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e55f0224-0aff-4b0c-a4a6-e45679a8ee07 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:57.316599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e55f0224-0aff-4b0c-a4a6-e45679a8ee07 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:57.624391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e55f0224-0aff-4b0c-a4a6-e45679a8ee07 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:57.643325 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e55f0224-0aff-4b0c-a4a6-e45679a8ee07 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.344214 Sep 10 21:19:57.643999 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2967/6065] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:57 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:19:58.668219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-78e09f33-93b1-4f14-ae1b-d0c23ba8ba4f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:58.669431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-78e09f33-93b1-4f14-ae1b-d0c23ba8ba4f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:58.680055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78e09f33-93b1-4f14-ae1b-d0c23ba8ba4f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:58.680993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78e09f33-93b1-4f14-ae1b-d0c23ba8ba4f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:58.681666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78e09f33-93b1-4f14-ae1b-d0c23ba8ba4f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:58.682574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78e09f33-93b1-4f14-ae1b-d0c23ba8ba4f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:58.683250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78e09f33-93b1-4f14-ae1b-d0c23ba8ba4f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:58.683888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-78e09f33-93b1-4f14-ae1b-d0c23ba8ba4f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:58.934701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-78e09f33-93b1-4f14-ae1b-d0c23ba8ba4f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:19:58.946187 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-78e09f33-93b1-4f14-ae1b-d0c23ba8ba4f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.282480 Sep 10 21:19:58.947591 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3099/6066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:58 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:19:59.980993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-67f68b42-35eb-4e71-9267-bd3216486c70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:19:59.981448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-67f68b42-35eb-4e71-9267-bd3216486c70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:19:59.989373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67f68b42-35eb-4e71-9267-bd3216486c70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:59.989976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67f68b42-35eb-4e71-9267-bd3216486c70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:59.990434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67f68b42-35eb-4e71-9267-bd3216486c70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:19:59.991162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67f68b42-35eb-4e71-9267-bd3216486c70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:19:59.991635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67f68b42-35eb-4e71-9267-bd3216486c70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:19:59.992078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67f68b42-35eb-4e71-9267-bd3216486c70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:00.220248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-67f68b42-35eb-4e71-9267-bd3216486c70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:00.229542 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-67f68b42-35eb-4e71-9267-bd3216486c70 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.252607 Sep 10 21:20:00.230277 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2968/6067] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:19:59 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:01.253326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2f1a44b2-58dc-43e8-ac89-a5e376f7dfbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:01.260209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2f1a44b2-58dc-43e8-ac89-a5e376f7dfbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:01.279769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f1a44b2-58dc-43e8-ac89-a5e376f7dfbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:01.284290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f1a44b2-58dc-43e8-ac89-a5e376f7dfbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:01.285013 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f1a44b2-58dc-43e8-ac89-a5e376f7dfbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:01.285961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f1a44b2-58dc-43e8-ac89-a5e376f7dfbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:01.286604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f1a44b2-58dc-43e8-ac89-a5e376f7dfbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:01.287044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2f1a44b2-58dc-43e8-ac89-a5e376f7dfbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:01.508676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2f1a44b2-58dc-43e8-ac89-a5e376f7dfbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:01.528258 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2f1a44b2-58dc-43e8-ac89-a5e376f7dfbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.279335 Sep 10 21:20:01.538955 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3100/6068] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:01 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:02.552540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-49d9f91e-d04f-4917-bc9a-8e0600092bd6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:02.553413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-49d9f91e-d04f-4917-bc9a-8e0600092bd6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:02.560641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d9f91e-d04f-4917-bc9a-8e0600092bd6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:02.561140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d9f91e-d04f-4917-bc9a-8e0600092bd6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:02.561587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d9f91e-d04f-4917-bc9a-8e0600092bd6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:02.562523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d9f91e-d04f-4917-bc9a-8e0600092bd6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:02.563068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d9f91e-d04f-4917-bc9a-8e0600092bd6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:02.563714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-49d9f91e-d04f-4917-bc9a-8e0600092bd6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:02.856004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-49d9f91e-d04f-4917-bc9a-8e0600092bd6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:02.866448 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-49d9f91e-d04f-4917-bc9a-8e0600092bd6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.317673 Sep 10 21:20:02.878496 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2969/6069] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:02 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:03.892470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6dfb49c4-f797-4133-bb88-416861951478 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:03.893133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6dfb49c4-f797-4133-bb88-416861951478 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:03.928058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfb49c4-f797-4133-bb88-416861951478 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:03.928579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfb49c4-f797-4133-bb88-416861951478 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:03.929029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfb49c4-f797-4133-bb88-416861951478 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:03.929789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfb49c4-f797-4133-bb88-416861951478 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:03.931458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfb49c4-f797-4133-bb88-416861951478 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:03.931905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6dfb49c4-f797-4133-bb88-416861951478 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:04.176845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6dfb49c4-f797-4133-bb88-416861951478 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:04.189920 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6dfb49c4-f797-4133-bb88-416861951478 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.298977 Sep 10 21:20:04.191162 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3101/6070] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:03 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:05.215419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-819dabe0-4d98-41c6-b194-66170f7cedee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:05.216081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-819dabe0-4d98-41c6-b194-66170f7cedee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:05.224577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-819dabe0-4d98-41c6-b194-66170f7cedee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:05.225090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-819dabe0-4d98-41c6-b194-66170f7cedee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:05.225542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-819dabe0-4d98-41c6-b194-66170f7cedee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:05.226313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-819dabe0-4d98-41c6-b194-66170f7cedee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:05.227038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-819dabe0-4d98-41c6-b194-66170f7cedee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:05.227493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-819dabe0-4d98-41c6-b194-66170f7cedee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:05.423256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-819dabe0-4d98-41c6-b194-66170f7cedee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:05.433231 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-819dabe0-4d98-41c6-b194-66170f7cedee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.221660 Sep 10 21:20:05.448380 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2970/6071] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:05 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:06.458681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1bfe1698-431e-4004-80e2-b504c9ef3fef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:06.459544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1bfe1698-431e-4004-80e2-b504c9ef3fef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:06.467187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bfe1698-431e-4004-80e2-b504c9ef3fef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:06.468147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bfe1698-431e-4004-80e2-b504c9ef3fef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:06.468686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bfe1698-431e-4004-80e2-b504c9ef3fef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:06.469627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bfe1698-431e-4004-80e2-b504c9ef3fef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:06.470167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bfe1698-431e-4004-80e2-b504c9ef3fef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:06.472293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1bfe1698-431e-4004-80e2-b504c9ef3fef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:06.720167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1bfe1698-431e-4004-80e2-b504c9ef3fef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:06.731181 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1bfe1698-431e-4004-80e2-b504c9ef3fef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.276837 Sep 10 21:20:06.737155 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3102/6072] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:06 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:07.756828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6e813255-a5b0-46e4-8a36-6a9e036d61a5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:07.757459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6e813255-a5b0-46e4-8a36-6a9e036d61a5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:07.765397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e813255-a5b0-46e4-8a36-6a9e036d61a5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:07.766428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e813255-a5b0-46e4-8a36-6a9e036d61a5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:07.767057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e813255-a5b0-46e4-8a36-6a9e036d61a5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:07.768720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e813255-a5b0-46e4-8a36-6a9e036d61a5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:07.769367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e813255-a5b0-46e4-8a36-6a9e036d61a5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:07.770001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e813255-a5b0-46e4-8a36-6a9e036d61a5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:08.016192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6e813255-a5b0-46e4-8a36-6a9e036d61a5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:08.029061 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6e813255-a5b0-46e4-8a36-6a9e036d61a5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.276794 Sep 10 21:20:08.039281 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2971/6073] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:07 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:09.060843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dfc9a88d-105f-4c08-89b8-89df55957037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:09.062291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dfc9a88d-105f-4c08-89b8-89df55957037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:09.077005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfc9a88d-105f-4c08-89b8-89df55957037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:09.077499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfc9a88d-105f-4c08-89b8-89df55957037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:09.078189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfc9a88d-105f-4c08-89b8-89df55957037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:09.078913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfc9a88d-105f-4c08-89b8-89df55957037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:09.079373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfc9a88d-105f-4c08-89b8-89df55957037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:09.080337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dfc9a88d-105f-4c08-89b8-89df55957037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:09.534258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dfc9a88d-105f-4c08-89b8-89df55957037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:09.543347 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dfc9a88d-105f-4c08-89b8-89df55957037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.490565 Sep 10 21:20:09.550266 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3103/6074] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:09 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:10.576899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-340acd32-e8e4-43cd-a444-1122d1eb183c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:10.578570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-340acd32-e8e4-43cd-a444-1122d1eb183c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:10.587157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-340acd32-e8e4-43cd-a444-1122d1eb183c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:10.587659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-340acd32-e8e4-43cd-a444-1122d1eb183c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:10.588289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-340acd32-e8e4-43cd-a444-1122d1eb183c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:10.589691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-340acd32-e8e4-43cd-a444-1122d1eb183c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:10.590394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-340acd32-e8e4-43cd-a444-1122d1eb183c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:10.591293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-340acd32-e8e4-43cd-a444-1122d1eb183c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:10.844806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-340acd32-e8e4-43cd-a444-1122d1eb183c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:10.862522 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-340acd32-e8e4-43cd-a444-1122d1eb183c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1698 microversion: 2.1 time: 0.291589 Sep 10 21:20:10.863848 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2972/6075] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:10 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1698 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:11.898879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bc03e2c2-260e-4429-9b82-20b9bbc829b1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:11.900911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bc03e2c2-260e-4429-9b82-20b9bbc829b1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:11.929918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc03e2c2-260e-4429-9b82-20b9bbc829b1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:11.931236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc03e2c2-260e-4429-9b82-20b9bbc829b1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:11.931709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc03e2c2-260e-4429-9b82-20b9bbc829b1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:11.933222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc03e2c2-260e-4429-9b82-20b9bbc829b1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:11.933565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc03e2c2-260e-4429-9b82-20b9bbc829b1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:11.934531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc03e2c2-260e-4429-9b82-20b9bbc829b1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:12.119903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1aedfc4f-bd33-461e-9a12-30fcf370cc2f req-198527c6-0aa7-477a-a9a3-ed9bb3cffb21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef02761-7222-43d2-af15-a1ee80eb9f92", "name": "network-vif-unplugged", "status": "completed", "tag": "e7acbc98-7340-435f-aae6-84d92fbd81f4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:12.163306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1aedfc4f-bd33-461e-9a12-30fcf370cc2f req-198527c6-0aa7-477a-a9a3-ed9bb3cffb21 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:12.164135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1aedfc4f-bd33-461e-9a12-30fcf370cc2f req-198527c6-0aa7-477a-a9a3-ed9bb3cffb21 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:12.165107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1aedfc4f-bd33-461e-9a12-30fcf370cc2f req-198527c6-0aa7-477a-a9a3-ed9bb3cffb21 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:12.207215 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1aedfc4f-bd33-461e-9a12-30fcf370cc2f req-198527c6-0aa7-477a-a9a3-ed9bb3cffb21 service nova] Creating event network-vif-unplugged:e7acbc98-7340-435f-aae6-84d92fbd81f4 for instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 on nch2-master-1 Sep 10 21:20:12.222269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-1aedfc4f-bd33-461e-9a12-30fcf370cc2f req-198527c6-0aa7-477a-a9a3-ed9bb3cffb21 service nova] Instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:20:12.259784 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1aedfc4f-bd33-461e-9a12-30fcf370cc2f req-198527c6-0aa7-477a-a9a3-ed9bb3cffb21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146665 Sep 10 21:20:12.260682 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2973/6076] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:20:12.333884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bc03e2c2-260e-4429-9b82-20b9bbc829b1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:12.343850 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bc03e2c2-260e-4429-9b82-20b9bbc829b1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1697 microversion: 2.1 time: 0.456058 Sep 10 21:20:12.349517 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3104/6077] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:11 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1697 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:13.379844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2b1a23e8-8928-406c-b39c-f3745b73c037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:13.381277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2b1a23e8-8928-406c-b39c-f3745b73c037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:13.388419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1a23e8-8928-406c-b39c-f3745b73c037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:13.389154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1a23e8-8928-406c-b39c-f3745b73c037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:13.390159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1a23e8-8928-406c-b39c-f3745b73c037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:13.390909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1a23e8-8928-406c-b39c-f3745b73c037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:13.391389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1a23e8-8928-406c-b39c-f3745b73c037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:13.391836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b1a23e8-8928-406c-b39c-f3745b73c037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:13.777000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2b1a23e8-8928-406c-b39c-f3745b73c037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:13.797808 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2b1a23e8-8928-406c-b39c-f3745b73c037 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1697 microversion: 2.1 time: 0.429410 Sep 10 21:20:13.816613 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2974/6078] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:13 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1697 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:14.758530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-723485d3-89b4-47b8-b775-51ed676d408d req-c17feb0d-2a6c-4e94-96dc-34b08e16beaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef02761-7222-43d2-af15-a1ee80eb9f92", "tag": "e7acbc98-7340-435f-aae6-84d92fbd81f4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:14.795238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-723485d3-89b4-47b8-b775-51ed676d408d req-c17feb0d-2a6c-4e94-96dc-34b08e16beaa service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:14.797281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-723485d3-89b4-47b8-b775-51ed676d408d req-c17feb0d-2a6c-4e94-96dc-34b08e16beaa service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:14.798931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-723485d3-89b4-47b8-b775-51ed676d408d req-c17feb0d-2a6c-4e94-96dc-34b08e16beaa service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:14.824360 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-723485d3-89b4-47b8-b775-51ed676d408d req-c17feb0d-2a6c-4e94-96dc-34b08e16beaa service nova] Creating event network-changed:e7acbc98-7340-435f-aae6-84d92fbd81f4 for instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 on nch2-master-1 Sep 10 21:20:14.826761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da04f2c0-1258-465a-9da9-1dfa829b3b23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:14.833540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-723485d3-89b4-47b8-b775-51ed676d408d req-c17feb0d-2a6c-4e94-96dc-34b08e16beaa service nova] Instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:20:14.835354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da04f2c0-1258-465a-9da9-1dfa829b3b23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:14.843860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=29 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:14.847980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da04f2c0-1258-465a-9da9-1dfa829b3b23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:14.848630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da04f2c0-1258-465a-9da9-1dfa829b3b23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:14.849325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da04f2c0-1258-465a-9da9-1dfa829b3b23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:14.849670 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-723485d3-89b4-47b8-b775-51ed676d408d req-c17feb0d-2a6c-4e94-96dc-34b08e16beaa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097800 Sep 10 21:20:14.851770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da04f2c0-1258-465a-9da9-1dfa829b3b23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:14.852268 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3105/6079] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:20:14.852818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da04f2c0-1258-465a-9da9-1dfa829b3b23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:14.853366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da04f2c0-1258-465a-9da9-1dfa829b3b23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:14.858196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:15.010024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-173bc561-f4da-4300-bb36-86fd8d88f240 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:15.012657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-173bc561-f4da-4300-bb36-86fd8d88f240 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:15.019922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-173bc561-f4da-4300-bb36-86fd8d88f240 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:15.020692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-173bc561-f4da-4300-bb36-86fd8d88f240 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:15.021330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-173bc561-f4da-4300-bb36-86fd8d88f240 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:15.022627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-173bc561-f4da-4300-bb36-86fd8d88f240 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:15.023263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-173bc561-f4da-4300-bb36-86fd8d88f240 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:15.024691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-173bc561-f4da-4300-bb36-86fd8d88f240 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:15.098137 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-173bc561-f4da-4300-bb36-86fd8d88f240 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "POST /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2/action" status: 200 len: 32645 microversion: 2.1 time: 0.092057 Sep 10 21:20:15.105593 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3106/6080] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:20:15 2022] POST /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2/action => generated 32645 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:20:15.915570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da04f2c0-1258-465a-9da9-1dfa829b3b23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:15.929851 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da04f2c0-1258-465a-9da9-1dfa829b3b23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1697 microversion: 2.1 time: 1.108238 Sep 10 21:20:15.930603 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2975/6081] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:14 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1697 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:16.957078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08009347-e7d9-494a-bba9-961f9a9f3266 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:16.957789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-08009347-e7d9-494a-bba9-961f9a9f3266 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:16.977925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08009347-e7d9-494a-bba9-961f9a9f3266 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:16.978715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08009347-e7d9-494a-bba9-961f9a9f3266 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:16.979344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08009347-e7d9-494a-bba9-961f9a9f3266 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:16.980245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08009347-e7d9-494a-bba9-961f9a9f3266 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:16.980876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08009347-e7d9-494a-bba9-961f9a9f3266 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:16.981471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08009347-e7d9-494a-bba9-961f9a9f3266 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:17.432781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-08009347-e7d9-494a-bba9-961f9a9f3266 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:17.459479 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-08009347-e7d9-494a-bba9-961f9a9f3266 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1692 microversion: 2.1 time: 0.508680 Sep 10 21:20:17.465126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f686404a-851a-4391-82ab-5137ce934b39 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:17.466366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f686404a-851a-4391-82ab-5137ce934b39 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:17.474140 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3107/6082] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:16 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1692 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:17.475936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f686404a-851a-4391-82ab-5137ce934b39 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:17.477650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f686404a-851a-4391-82ab-5137ce934b39 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:17.478510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f686404a-851a-4391-82ab-5137ce934b39 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:17.479403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f686404a-851a-4391-82ab-5137ce934b39 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:17.479859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f686404a-851a-4391-82ab-5137ce934b39 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:17.480465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f686404a-851a-4391-82ab-5137ce934b39 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:17.526733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f686404a-851a-4391-82ab-5137ce934b39 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:20:17.623248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-9d558780-e586-40a1-8619-d1286a3b2569 req-e6c3b70a-51e4-4326-9534-7549595b01ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d237866-5abd-49e2-a390-338123e619e2", "tag": "b87a4c3c-8eba-4dc8-adf8-93456d35d980"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:17.641754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=29 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:17.648445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9d558780-e586-40a1-8619-d1286a3b2569 req-e6c3b70a-51e4-4326-9534-7549595b01ad service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:17.649357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9d558780-e586-40a1-8619-d1286a3b2569 req-e6c3b70a-51e4-4326-9534-7549595b01ad service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:17.650112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9d558780-e586-40a1-8619-d1286a3b2569 req-e6c3b70a-51e4-4326-9534-7549595b01ad service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:17.656736 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f686404a-851a-4391-82ab-5137ce934b39 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 204 len: 0 microversion: 2.1 time: 0.195127 Sep 10 21:20:17.658149 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2976/6083] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:20:17 2022] DELETE /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:20:17.665274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=79 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:17.668777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62ac3c52-0659-42e3-8490-2cb8939a9fe0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:17.669629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62ac3c52-0659-42e3-8490-2cb8939a9fe0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:17.682634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ac3c52-0659-42e3-8490-2cb8939a9fe0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:17.683847 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-9d558780-e586-40a1-8619-d1286a3b2569 req-e6c3b70a-51e4-4326-9534-7549595b01ad service nova] Creating event network-changed:b87a4c3c-8eba-4dc8-adf8-93456d35d980 for instance 0d237866-5abd-49e2-a390-338123e619e2 on nch1-master-1 Sep 10 21:20:17.684212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ac3c52-0659-42e3-8490-2cb8939a9fe0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:17.684833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ac3c52-0659-42e3-8490-2cb8939a9fe0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:17.688862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ac3c52-0659-42e3-8490-2cb8939a9fe0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:17.690141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ac3c52-0659-42e3-8490-2cb8939a9fe0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:17.690796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ac3c52-0659-42e3-8490-2cb8939a9fe0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:17.695684 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-9d558780-e586-40a1-8619-d1286a3b2569 req-e6c3b70a-51e4-4326-9534-7549595b01ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210359 Sep 10 21:20:17.696315 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3108/6084] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:20:17.715185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09ec33f7-1662-41a8-b272-41e0d7c524dd tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:17.716675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09ec33f7-1662-41a8-b272-41e0d7c524dd tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:17.728210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ec33f7-1662-41a8-b272-41e0d7c524dd tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:17.734956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ec33f7-1662-41a8-b272-41e0d7c524dd tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:17.735686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ec33f7-1662-41a8-b272-41e0d7c524dd tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:17.736681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ec33f7-1662-41a8-b272-41e0d7c524dd tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:17.737328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ec33f7-1662-41a8-b272-41e0d7c524dd tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:17.738277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ec33f7-1662-41a8-b272-41e0d7c524dd tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:17.797005 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62ac3c52-0659-42e3-8490-2cb8939a9fe0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92/action" status: 204 len: 0 microversion: 2.1 time: 0.137019 Sep 10 21:20:17.799034 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2977/6085] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:20:17 2022] POST /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92/action => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:20:17.812735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3271b994-1ab7-4435-af8b-504c640592ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:17.813744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3271b994-1ab7-4435-af8b-504c640592ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:17.821774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3271b994-1ab7-4435-af8b-504c640592ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:17.822755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3271b994-1ab7-4435-af8b-504c640592ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:17.823393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3271b994-1ab7-4435-af8b-504c640592ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:17.824583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3271b994-1ab7-4435-af8b-504c640592ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:17.825226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3271b994-1ab7-4435-af8b-504c640592ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:17.825918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3271b994-1ab7-4435-af8b-504c640592ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:17.990346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09ec33f7-1662-41a8-b272-41e0d7c524dd tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:18.003377 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09ec33f7-1662-41a8-b272-41e0d7c524dd tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1670 microversion: 2.1 time: 0.305843 Sep 10 21:20:18.004579 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3109/6086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:17 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1670 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:18.112420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3271b994-1ab7-4435-af8b-504c640592ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:18.126079 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3271b994-1ab7-4435-af8b-504c640592ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1692 microversion: 2.1 time: 0.321313 Sep 10 21:20:18.129225 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2978/6087] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:17 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1692 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:19.029893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9ab4c348-bcf4-42bd-ab2a-7c5d21409f6a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:19.031786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9ab4c348-bcf4-42bd-ab2a-7c5d21409f6a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:19.040414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ab4c348-bcf4-42bd-ab2a-7c5d21409f6a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:19.041323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ab4c348-bcf4-42bd-ab2a-7c5d21409f6a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:19.041999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ab4c348-bcf4-42bd-ab2a-7c5d21409f6a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:19.042894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ab4c348-bcf4-42bd-ab2a-7c5d21409f6a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:19.046688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ab4c348-bcf4-42bd-ab2a-7c5d21409f6a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:19.047892 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ab4c348-bcf4-42bd-ab2a-7c5d21409f6a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:19.152960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b00e0a69-3f4a-4c54-b072-286c58f9770d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:19.153603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b00e0a69-3f4a-4c54-b072-286c58f9770d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:19.166680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b00e0a69-3f4a-4c54-b072-286c58f9770d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:19.167112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b00e0a69-3f4a-4c54-b072-286c58f9770d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:19.167571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b00e0a69-3f4a-4c54-b072-286c58f9770d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:19.168929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b00e0a69-3f4a-4c54-b072-286c58f9770d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:19.169415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b00e0a69-3f4a-4c54-b072-286c58f9770d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:19.169891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b00e0a69-3f4a-4c54-b072-286c58f9770d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:19.613560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9ab4c348-bcf4-42bd-ab2a-7c5d21409f6a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:19.625801 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9ab4c348-bcf4-42bd-ab2a-7c5d21409f6a tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1670 microversion: 2.1 time: 0.600329 Sep 10 21:20:19.644722 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3110/6088] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:19 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1670 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:19.762457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b00e0a69-3f4a-4c54-b072-286c58f9770d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:19.774733 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b00e0a69-3f4a-4c54-b072-286c58f9770d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1692 microversion: 2.1 time: 0.627122 Sep 10 21:20:19.776857 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2979/6089] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:19 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1692 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:20.652406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-717f59c9-8e4b-4a2c-8adf-fd56575b6d26 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:20.653051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-717f59c9-8e4b-4a2c-8adf-fd56575b6d26 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:20.673638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-717f59c9-8e4b-4a2c-8adf-fd56575b6d26 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:20.676042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-717f59c9-8e4b-4a2c-8adf-fd56575b6d26 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:20.676752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-717f59c9-8e4b-4a2c-8adf-fd56575b6d26 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:20.678508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-717f59c9-8e4b-4a2c-8adf-fd56575b6d26 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:20.679560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-717f59c9-8e4b-4a2c-8adf-fd56575b6d26 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:20.680641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-717f59c9-8e4b-4a2c-8adf-fd56575b6d26 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:20.765677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-65faedd8-a2d7-4200-9689-3f6413515c18 req-4b4d1fc3-f8f0-4bd1-af4e-efa545c9f6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef02761-7222-43d2-af15-a1ee80eb9f92", "name": "network-vif-plugged", "status": "completed", "tag": "e7acbc98-7340-435f-aae6-84d92fbd81f4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:20.776997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-65faedd8-a2d7-4200-9689-3f6413515c18 req-4b4d1fc3-f8f0-4bd1-af4e-efa545c9f6c2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:20.777887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-65faedd8-a2d7-4200-9689-3f6413515c18 req-4b4d1fc3-f8f0-4bd1-af4e-efa545c9f6c2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:20.778567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-65faedd8-a2d7-4200-9689-3f6413515c18 req-4b4d1fc3-f8f0-4bd1-af4e-efa545c9f6c2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:20.792516 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-65faedd8-a2d7-4200-9689-3f6413515c18 req-4b4d1fc3-f8f0-4bd1-af4e-efa545c9f6c2 service nova] Creating event network-vif-plugged:e7acbc98-7340-435f-aae6-84d92fbd81f4 for instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 on nch2-master-1 Sep 10 21:20:20.800644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-65faedd8-a2d7-4200-9689-3f6413515c18 req-4b4d1fc3-f8f0-4bd1-af4e-efa545c9f6c2 service nova] Instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:20:20.814037 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-65faedd8-a2d7-4200-9689-3f6413515c18 req-4b4d1fc3-f8f0-4bd1-af4e-efa545c9f6c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175218 Sep 10 21:20:20.815520 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3111/6090] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:20:20.822197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a66d6d13-038a-4891-b3db-5855ef706e15 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:20.823088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a66d6d13-038a-4891-b3db-5855ef706e15 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:20.831202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a66d6d13-038a-4891-b3db-5855ef706e15 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:20.832076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a66d6d13-038a-4891-b3db-5855ef706e15 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:20.832731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a66d6d13-038a-4891-b3db-5855ef706e15 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:20.833771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a66d6d13-038a-4891-b3db-5855ef706e15 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:20.835254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a66d6d13-038a-4891-b3db-5855ef706e15 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:20.835704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a66d6d13-038a-4891-b3db-5855ef706e15 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:21.085806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-717f59c9-8e4b-4a2c-8adf-fd56575b6d26 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:21.096415 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-717f59c9-8e4b-4a2c-8adf-fd56575b6d26 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1670 microversion: 2.1 time: 0.448839 Sep 10 21:20:21.097434 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2980/6091] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:20 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1670 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:21.193958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a66d6d13-038a-4891-b3db-5855ef706e15 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:21.203050 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a66d6d13-038a-4891-b3db-5855ef706e15 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1692 microversion: 2.1 time: 0.386098 Sep 10 21:20:21.203946 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3112/6092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:20 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1692 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:21.369624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-47f3bfff-72f5-4741-9b76-8be63f19eb35 req-092fc1fa-e6e7-4b88-af37-277af3daa7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d237866-5abd-49e2-a390-338123e619e2", "name": "network-vif-deleted", "tag": "b87a4c3c-8eba-4dc8-adf8-93456d35d980"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:21.383043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-47f3bfff-72f5-4741-9b76-8be63f19eb35 req-092fc1fa-e6e7-4b88-af37-277af3daa7e4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:21.383897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-47f3bfff-72f5-4741-9b76-8be63f19eb35 req-092fc1fa-e6e7-4b88-af37-277af3daa7e4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:21.384600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-47f3bfff-72f5-4741-9b76-8be63f19eb35 req-092fc1fa-e6e7-4b88-af37-277af3daa7e4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:21.398313 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-47f3bfff-72f5-4741-9b76-8be63f19eb35 req-092fc1fa-e6e7-4b88-af37-277af3daa7e4 service nova] Creating event network-vif-deleted:b87a4c3c-8eba-4dc8-adf8-93456d35d980 for instance 0d237866-5abd-49e2-a390-338123e619e2 on nch1-master-1 Sep 10 21:20:21.404364 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-47f3bfff-72f5-4741-9b76-8be63f19eb35 req-092fc1fa-e6e7-4b88-af37-277af3daa7e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038446 Sep 10 21:20:21.405557 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2981/6093] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:20:22.125603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:22.126867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:22.142698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:22.143418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:22.143875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:22.144828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:22.145294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:22.145720 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:22.216997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:22.217815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:22.218530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:22.219224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lazy-loading 'fault' on Instance uuid 0d237866-5abd-49e2-a390-338123e619e2 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:20:22.235037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-685c8d34-0383-47f4-acaf-65c3f0d50845 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:22.237195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-685c8d34-0383-47f4-acaf-65c3f0d50845 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:22.250463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685c8d34-0383-47f4-acaf-65c3f0d50845 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:22.253968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685c8d34-0383-47f4-acaf-65c3f0d50845 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:22.254387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685c8d34-0383-47f4-acaf-65c3f0d50845 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:22.255150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685c8d34-0383-47f4-acaf-65c3f0d50845 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:22.255630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685c8d34-0383-47f4-acaf-65c3f0d50845 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:22.256072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-685c8d34-0383-47f4-acaf-65c3f0d50845 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:22.312385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93648515d8fb42a7aaf61e245db0e07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0d9347a2d64323bb563b6f1f0b0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:22.322445 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a241becc-aa6d-43f8-894a-14f4db650f67 tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 200 len: 1338 microversion: 2.1 time: 0.200541 Sep 10 21:20:22.323558 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3113/6094] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:22 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 1338 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:22.608556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-685c8d34-0383-47f4-acaf-65c3f0d50845 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:22.618509 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-685c8d34-0383-47f4-acaf-65c3f0d50845 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1684 microversion: 2.1 time: 0.392668 Sep 10 21:20:22.619142 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2982/6095] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:22 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1684 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:23.351649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:23.354521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] [instance: 0d237866-5abd-49e2-a390-338123e619e2] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:23.370727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:23.372087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:23.373922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:23.375687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:23.377440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:23.379178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:23.438573 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] HTTP exception thrown: Instance 0d237866-5abd-49e2-a390-338123e619e2 could not be found. Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Request method failure captured: Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 HTTP/1.1 Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP5tIhDsA9TV7k1iaLrLOtWiQ1UzQDRXvcJRltXoVuP9N4Nqa2l4KkeWNSaiyJ4KZVGfMzQzGIMiWryF4U99ueZ5qwyKcOeehNOneEUnhcMEm7xnWOMdNmKJ2uV26NNaDqKh7Fw2IYF_O1KCWZfv47GvmH-_GSt02NZ8ej6w7j6t_kw Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: fe0d9347a2d64323bb563b6f1f0b0cd6 Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestNetworkBasicOps-1762881754 Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe0d9347a2d64323bb563b6f1f0b0cd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe0d9347a2d64323bb563b6f1f0b0cd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe0d9347a2d64323bb563b6f1f0b0cd6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe0d9347a2d64323bb563b6f1f0b0cd6"}]}] Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestNetworkBasicOps-1762881754 Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: fe0d9347a2d64323bb563b6f1f0b0cd6 Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestNetworkBasicOps-1762881754 Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestNetworkBasicOps-1762881754-project Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 93648515d8fb42a7aaf61e245db0e07d Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestNetworkBasicOps-1762881754-project Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 0d237866-5abd-49e2-a390-338123e619e2 could not be found. Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '0d237866-5abd-49e2-a390-338123e619e2'} Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d237866-5abd-49e2-a390-338123e619e2 could not be found. Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d237866-5abd-49e2-a390-338123e619e2 could not be found. Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:20:23.443795 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:20:23.448686 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:20:23.448686 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:20:23.448686 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:20:23.448686 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:20:23.448686 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:20:23.448686 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d237866-5abd-49e2-a390-338123e619e2 could not be found. Sep 10 21:20:23.448686 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:20:23.448686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Returning 404 to user: Instance 0d237866-5abd-49e2-a390-338123e619e2 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:20:23.448686 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-75fcb9bb-9dd9-49d4-9ca8-19ffb08225da tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2" status: 404 len: 111 microversion: 2.1 time: 0.103158 Sep 10 21:20:23.452348 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3114/6096] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:23 2022] GET /compute/v2.1/servers/0d237866-5abd-49e2-a390-338123e619e2 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:20:23.927619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-479a51bc-57dc-41cd-b629-d138cf2a0f4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] Calling method '.version_select at 0x7f9944feaaf0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:23.953299 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-479a51bc-57dc-41cd-b629-d138cf2a0f4d tempest-TestNetworkBasicOps-1762881754 tempest-TestNetworkBasicOps-1762881754-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-856188378" status: 202 len: 0 microversion: 2.1 time: 0.030869 Sep 10 21:20:23.960493 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2983/6097] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Sep 10 21:20:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-856188378 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:20:35.848338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=15 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:35.849456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=33 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:36.097093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d76e9b97-b72a-4929-8f91-95a80d1de397 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Action: 'create', calling method: .version_select at 0x7f9944192f70>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1810064900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrLhj5Sk+GxVb6KQwtYAiFEgYCscCvau+yUaSSq5pEWOpbjjyPiZ8FoB6I4cEagDf0bWbdQ9Xq9UTUwyCAC1AJVQEb7XpJQsu0JizCpAFo1TbFz/c35H8CHbizz29kXMQ=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:36.117050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d76e9b97-b72a-4929-8f91-95a80d1de397 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Getting quotas for project 371635a1edd041828749d00c5526197c. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:20:36.123052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d76e9b97-b72a-4929-8f91-95a80d1de397 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Getting quotas for user f5afa360fc4c40288b65c437519c2a7f and project 371635a1edd041828749d00c5526197c. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:20:36.151607 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d76e9b97-b72a-4929-8f91-95a80d1de397 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.310779 Sep 10 21:20:36.152360 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3115/6098] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:20:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:20:42.837623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3863e7a5-0db6-4167-9e53-bb56850dc4ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:42.841007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3863e7a5-0db6-4167-9e53-bb56850dc4ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:42.856213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:42.856939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:42.859499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3863e7a5-0db6-4167-9e53-bb56850dc4ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:42.860868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3863e7a5-0db6-4167-9e53-bb56850dc4ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:42.861644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3863e7a5-0db6-4167-9e53-bb56850dc4ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:42.862626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3863e7a5-0db6-4167-9e53-bb56850dc4ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:42.863339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3863e7a5-0db6-4167-9e53-bb56850dc4ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:42.864066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3863e7a5-0db6-4167-9e53-bb56850dc4ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:42.941757 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3863e7a5-0db6-4167-9e53-bb56850dc4ec tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92/action" status: 200 len: 24576 microversion: 2.1 time: 0.108448 Sep 10 21:20:42.942851 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2984/6099] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:20:42 2022] POST /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92/action => generated 24576 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:20:46.366271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1129996569-access_point-1630463286", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "d1621c7b-9a09-4297-9355-c7bc6be6d4df"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1810064900", "security_groups": [{"name": "tempest-secgroup_access--1872774106"}, {"name": "tempest-secgroup_general--902920221"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:46.390663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:46.392476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:46.770829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] validate_networks() for [('d1621c7b-9a09-4297-9355-c7bc6be6d4df', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:20:48.199054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:20:48.200757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:20:48.201428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:20:48.202061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:20:48.202669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:20:48.224223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:48.224725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:48.225388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:48.226947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:48.227621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:48.228066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:48.270662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Getting quotas for project 371635a1edd041828749d00c5526197c. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:20:48.277130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Getting quotas for user f5afa360fc4c40288b65c437519c2a7f and project 371635a1edd041828749d00c5526197c. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:20:48.298777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:20:48.300889 ncdv-master-1 devstack@n-api.service[145772]: WARNING nova.utils [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1129996569-access_point-1630463286 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1129996569-ac Sep 10 21:20:48.301672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:20:48.385501 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-12c3138b-4375-4e26-a6bd-f6fac3e94db0 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.020310 Sep 10 21:20:48.397417 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3116/6100] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:20:46 2022] POST /compute/v2.1/servers => generated 457 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:20:48.409636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-30da75b4-b55c-4dac-a4a3-6c7a19523be4 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:48.412650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-30da75b4-b55c-4dac-a4a3-6c7a19523be4 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:48.571976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-30da75b4-b55c-4dac-a4a3-6c7a19523be4 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:48.607499 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-30da75b4-b55c-4dac-a4a3-6c7a19523be4 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1295 microversion: 2.1 time: 0.188672 Sep 10 21:20:48.611208 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2985/6101] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:48 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1295 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:49.249573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c9ce67c1-a33c-49e3-ba0b-a23ede5b4d2a tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:49.250225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c9ce67c1-a33c-49e3-ba0b-a23ede5b4d2a tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:49.259252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9ce67c1-a33c-49e3-ba0b-a23ede5b4d2a tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:49.260073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9ce67c1-a33c-49e3-ba0b-a23ede5b4d2a tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:49.260745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9ce67c1-a33c-49e3-ba0b-a23ede5b4d2a tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:49.261662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9ce67c1-a33c-49e3-ba0b-a23ede5b4d2a tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:49.262338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9ce67c1-a33c-49e3-ba0b-a23ede5b4d2a tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:49.262947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c9ce67c1-a33c-49e3-ba0b-a23ede5b4d2a tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:49.482507 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c9ce67c1-a33c-49e3-ba0b-a23ede5b4d2a tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1835 microversion: 2.1 time: 0.237650 Sep 10 21:20:49.495213 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3117/6102] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:49 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1835 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:49.637629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a43a8b08-17ea-42af-acf0-882c6c645176 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:49.638943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a43a8b08-17ea-42af-acf0-882c6c645176 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:49.652236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43a8b08-17ea-42af-acf0-882c6c645176 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:49.655844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43a8b08-17ea-42af-acf0-882c6c645176 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:49.657755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43a8b08-17ea-42af-acf0-882c6c645176 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:49.672126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43a8b08-17ea-42af-acf0-882c6c645176 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:49.673147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43a8b08-17ea-42af-acf0-882c6c645176 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:49.674036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a43a8b08-17ea-42af-acf0-882c6c645176 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:49.810069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a43a8b08-17ea-42af-acf0-882c6c645176 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:49.818669 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a43a8b08-17ea-42af-acf0-882c6c645176 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1347 microversion: 2.1 time: 0.187133 Sep 10 21:20:49.819267 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2986/6103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:49 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1347 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:50.843473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e2c3a645-66b8-4629-be57-150a4b074a16 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:50.844104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e2c3a645-66b8-4629-be57-150a4b074a16 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:50.855897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2c3a645-66b8-4629-be57-150a4b074a16 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:50.855897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2c3a645-66b8-4629-be57-150a4b074a16 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:50.856200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2c3a645-66b8-4629-be57-150a4b074a16 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:50.856696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2c3a645-66b8-4629-be57-150a4b074a16 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:50.857356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2c3a645-66b8-4629-be57-150a4b074a16 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:50.858326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2c3a645-66b8-4629-be57-150a4b074a16 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:50.950478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e2c3a645-66b8-4629-be57-150a4b074a16 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:50.966842 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e2c3a645-66b8-4629-be57-150a4b074a16 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1353 microversion: 2.1 time: 0.127883 Sep 10 21:20:50.968055 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3118/6104] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:50 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:51.044668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e2c9ab1e-59f3-4dff-8972-d9ef725a60cf tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:51.047899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e2c9ab1e-59f3-4dff-8972-d9ef725a60cf tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:51.052215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b8c0b8d4-fe1f-4577-a99d-c4746b5f8b5d req-d55bfa8e-3341-4ea5-9249-dcc0b83f3610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef02761-7222-43d2-af15-a1ee80eb9f92", "tag": "e7acbc98-7340-435f-aae6-84d92fbd81f4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:51.079973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c9ab1e-59f3-4dff-8972-d9ef725a60cf tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:51.080847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c9ab1e-59f3-4dff-8972-d9ef725a60cf tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:51.086632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c9ab1e-59f3-4dff-8972-d9ef725a60cf tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:51.089091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c9ab1e-59f3-4dff-8972-d9ef725a60cf tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:51.091281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c9ab1e-59f3-4dff-8972-d9ef725a60cf tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:51.092922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e2c9ab1e-59f3-4dff-8972-d9ef725a60cf tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:51.095402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b8c0b8d4-fe1f-4577-a99d-c4746b5f8b5d req-d55bfa8e-3341-4ea5-9249-dcc0b83f3610 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:51.096205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b8c0b8d4-fe1f-4577-a99d-c4746b5f8b5d req-d55bfa8e-3341-4ea5-9249-dcc0b83f3610 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:51.096820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b8c0b8d4-fe1f-4577-a99d-c4746b5f8b5d req-d55bfa8e-3341-4ea5-9249-dcc0b83f3610 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:51.115104 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b8c0b8d4-fe1f-4577-a99d-c4746b5f8b5d req-d55bfa8e-3341-4ea5-9249-dcc0b83f3610 service nova] Creating event network-changed:e7acbc98-7340-435f-aae6-84d92fbd81f4 for instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 on nch2-master-1 Sep 10 21:20:51.127646 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b8c0b8d4-fe1f-4577-a99d-c4746b5f8b5d req-d55bfa8e-3341-4ea5-9249-dcc0b83f3610 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081813 Sep 10 21:20:51.136242 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3119/6105] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:20:51.159027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e2c9ab1e-59f3-4dff-8972-d9ef725a60cf tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:20:51.313694 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e2c9ab1e-59f3-4dff-8972-d9ef725a60cf tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 204 len: 0 microversion: 2.1 time: 0.276959 Sep 10 21:20:51.315412 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2987/6106] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:20:51 2022] DELETE /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:20:51.325017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3cdf87cb-0f9b-49ba-b0f7-1696f134dea6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:51.325745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3cdf87cb-0f9b-49ba-b0f7-1696f134dea6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:51.338957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cdf87cb-0f9b-49ba-b0f7-1696f134dea6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:51.339786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cdf87cb-0f9b-49ba-b0f7-1696f134dea6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:51.340434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cdf87cb-0f9b-49ba-b0f7-1696f134dea6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:51.341467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cdf87cb-0f9b-49ba-b0f7-1696f134dea6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:51.345114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cdf87cb-0f9b-49ba-b0f7-1696f134dea6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:51.345800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3cdf87cb-0f9b-49ba-b0f7-1696f134dea6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:51.644932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3cdf87cb-0f9b-49ba-b0f7-1696f134dea6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:51.654341 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3cdf87cb-0f9b-49ba-b0f7-1696f134dea6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1690 microversion: 2.1 time: 0.333625 Sep 10 21:20:51.654942 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3120/6107] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:51 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1690 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:51.991864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be888575-7df1-4514-9413-ec1cacef9563 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:51.993011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-be888575-7df1-4514-9413-ec1cacef9563 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:52.006898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be888575-7df1-4514-9413-ec1cacef9563 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:52.007518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be888575-7df1-4514-9413-ec1cacef9563 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:52.008121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be888575-7df1-4514-9413-ec1cacef9563 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:52.008804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be888575-7df1-4514-9413-ec1cacef9563 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:52.009338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be888575-7df1-4514-9413-ec1cacef9563 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:52.009801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be888575-7df1-4514-9413-ec1cacef9563 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:52.459131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-be888575-7df1-4514-9413-ec1cacef9563 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:52.471461 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be888575-7df1-4514-9413-ec1cacef9563 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1472 microversion: 2.1 time: 0.483658 Sep 10 21:20:52.472629 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2988/6108] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:51 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1472 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:52.686873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-762303fc-5b9d-447b-a883-c25de35e6b02 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:52.687708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-762303fc-5b9d-447b-a883-c25de35e6b02 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:52.695153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762303fc-5b9d-447b-a883-c25de35e6b02 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:52.698069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762303fc-5b9d-447b-a883-c25de35e6b02 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:52.706100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762303fc-5b9d-447b-a883-c25de35e6b02 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:52.706981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762303fc-5b9d-447b-a883-c25de35e6b02 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:52.708400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762303fc-5b9d-447b-a883-c25de35e6b02 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:52.710010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-762303fc-5b9d-447b-a883-c25de35e6b02 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:53.495818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ab9074c9-d1e0-4ff3-b8fb-5efad0c09bc1 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:53.497043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ab9074c9-d1e0-4ff3-b8fb-5efad0c09bc1 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:53.505895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab9074c9-d1e0-4ff3-b8fb-5efad0c09bc1 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:53.506602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab9074c9-d1e0-4ff3-b8fb-5efad0c09bc1 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:53.507216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab9074c9-d1e0-4ff3-b8fb-5efad0c09bc1 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:53.508131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab9074c9-d1e0-4ff3-b8fb-5efad0c09bc1 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:53.508648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab9074c9-d1e0-4ff3-b8fb-5efad0c09bc1 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:53.509245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ab9074c9-d1e0-4ff3-b8fb-5efad0c09bc1 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:53.780361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-762303fc-5b9d-447b-a883-c25de35e6b02 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:53.795753 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-762303fc-5b9d-447b-a883-c25de35e6b02 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1690 microversion: 2.1 time: 1.113475 Sep 10 21:20:53.809753 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3121/6109] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:52 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1690 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:53.847534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ab9074c9-d1e0-4ff3-b8fb-5efad0c09bc1 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:53.862564 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ab9074c9-d1e0-4ff3-b8fb-5efad0c09bc1 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1472 microversion: 2.1 time: 0.370278 Sep 10 21:20:53.862852 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2989/6110] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:53 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:20:54.633140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e2bdfbcc-f062-4d3a-bb46-04286dbbe691 req-415d438e-982d-4be3-ad73-7c51d6203164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7145a0-75e0-445e-b567-109c0abf6d1e", "tag": "3134b312-967b-4646-917a-05ec77bd0242"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:54.652616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e2bdfbcc-f062-4d3a-bb46-04286dbbe691 req-415d438e-982d-4be3-ad73-7c51d6203164 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:54.653212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e2bdfbcc-f062-4d3a-bb46-04286dbbe691 req-415d438e-982d-4be3-ad73-7c51d6203164 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:54.653929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e2bdfbcc-f062-4d3a-bb46-04286dbbe691 req-415d438e-982d-4be3-ad73-7c51d6203164 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:54.670338 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e2bdfbcc-f062-4d3a-bb46-04286dbbe691 req-415d438e-982d-4be3-ad73-7c51d6203164 service nova] Creating event network-changed:3134b312-967b-4646-917a-05ec77bd0242 for instance 2d7145a0-75e0-445e-b567-109c0abf6d1e on nch1-master-1 Sep 10 21:20:54.675912 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e2bdfbcc-f062-4d3a-bb46-04286dbbe691 req-415d438e-982d-4be3-ad73-7c51d6203164 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047845 Sep 10 21:20:54.677158 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3122/6111] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:20:54.829387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3a4fab6d-ef02-41bf-b50a-2a2fff9eb1a4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:54.830159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3a4fab6d-ef02-41bf-b50a-2a2fff9eb1a4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:54.836886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a4fab6d-ef02-41bf-b50a-2a2fff9eb1a4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:54.838705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a4fab6d-ef02-41bf-b50a-2a2fff9eb1a4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:54.839165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a4fab6d-ef02-41bf-b50a-2a2fff9eb1a4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:54.839904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a4fab6d-ef02-41bf-b50a-2a2fff9eb1a4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:54.840558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a4fab6d-ef02-41bf-b50a-2a2fff9eb1a4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:54.841002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3a4fab6d-ef02-41bf-b50a-2a2fff9eb1a4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:54.890637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a872a1c6-fe9e-469c-9e95-8ee314b2e06e tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:54.891401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a872a1c6-fe9e-469c-9e95-8ee314b2e06e tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:54.899482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a872a1c6-fe9e-469c-9e95-8ee314b2e06e tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:54.900213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a872a1c6-fe9e-469c-9e95-8ee314b2e06e tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:54.900834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a872a1c6-fe9e-469c-9e95-8ee314b2e06e tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:54.902103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a872a1c6-fe9e-469c-9e95-8ee314b2e06e tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:54.905251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a872a1c6-fe9e-469c-9e95-8ee314b2e06e tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:54.905922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a872a1c6-fe9e-469c-9e95-8ee314b2e06e tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:54.943340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3a4fab6d-ef02-41bf-b50a-2a2fff9eb1a4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:54.957794 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3a4fab6d-ef02-41bf-b50a-2a2fff9eb1a4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 200 len: 1352 microversion: 2.1 time: 0.132621 Sep 10 21:20:54.964324 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2990/6112] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:54 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 1352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:55.402684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a872a1c6-fe9e-469c-9e95-8ee314b2e06e tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:55.417410 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a872a1c6-fe9e-469c-9e95-8ee314b2e06e tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1472 microversion: 2.1 time: 0.530847 Sep 10 21:20:55.421212 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3123/6113] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:54 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:55.983334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:55.984912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 6ef02761-7222-43d2-af15-a1ee80eb9f92] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:55.996477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:55.999207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:56.001305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:56.005063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:56.007692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:56.009337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:56.051004 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] HTTP exception thrown: Instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 could not be found. Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Request method failure captured: Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 HTTP/1.1 Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP8RCbszCTk8Rfb2DQyKNfktIXNNdvFLz2bW8-nP1cDW_GuG2bKFDzDUddVaAIHTvYjEOsCDA-7JIDpvn8pEvREb35AL1k1f2O20PIdcCQ2Iik3pYFuvv0s3gD9GjhTnHn7wYf6z-n27pDMFT_KlhXxfhVuKNFI6JCZRswA-SPtcPt4 Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f4f036f0122f4879aacb1db06eb8b588 Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f036f0122f4879aacb1db06eb8b588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f036f0122f4879aacb1db06eb8b588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4f036f0122f4879aacb1db06eb8b588", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4f036f0122f4879aacb1db06eb8b588"}]}] Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f4f036f0122f4879aacb1db06eb8b588 Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TestNetworkAdvancedServerOps-2019920615-project Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: b4791d13ab1c45bf8fabec70191426da Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2019920615-project Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 could not be found. Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '6ef02761-7222-43d2-af15-a1ee80eb9f92'} Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 could not be found. Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 could not be found. Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:20:56.053053 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:20:56.059122 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:20:56.059122 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:20:56.059122 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:20:56.059122 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:20:56.059122 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:20:56.059122 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:20:56.059122 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 could not be found. Sep 10 21:20:56.059122 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:20:56.063182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Returning 404 to user: Instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:20:56.071476 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2df96a7a-f3b6-45ed-aaca-ae10c5806252 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92" status: 404 len: 111 microversion: 2.1 time: 0.094368 Sep 10 21:20:56.075824 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2991/6114] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:55 2022] GET /compute/v2.1/servers/6ef02761-7222-43d2-af15-a1ee80eb9f92 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:20:56.451128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c88cea4b-49a2-40d9-bcd3-6867df3e6774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:56.453111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c88cea4b-49a2-40d9-bcd3-6867df3e6774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:56.480981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c88cea4b-49a2-40d9-bcd3-6867df3e6774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:56.481790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c88cea4b-49a2-40d9-bcd3-6867df3e6774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:56.482852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c88cea4b-49a2-40d9-bcd3-6867df3e6774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:56.483778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c88cea4b-49a2-40d9-bcd3-6867df3e6774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:56.484417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c88cea4b-49a2-40d9-bcd3-6867df3e6774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:56.485239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c88cea4b-49a2-40d9-bcd3-6867df3e6774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:56.711542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3e6ffdc1-b737-423b-bbdc-d88a6743cf0a req-010acbbb-33fd-4efc-b133-37e5e911ec9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef02761-7222-43d2-af15-a1ee80eb9f92", "name": "network-vif-deleted", "tag": "e7acbc98-7340-435f-aae6-84d92fbd81f4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:20:56.727855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3e6ffdc1-b737-423b-bbdc-d88a6743cf0a req-010acbbb-33fd-4efc-b133-37e5e911ec9d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:56.730233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3e6ffdc1-b737-423b-bbdc-d88a6743cf0a req-010acbbb-33fd-4efc-b133-37e5e911ec9d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:56.730884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3e6ffdc1-b737-423b-bbdc-d88a6743cf0a req-010acbbb-33fd-4efc-b133-37e5e911ec9d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:56.765799 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3e6ffdc1-b737-423b-bbdc-d88a6743cf0a req-010acbbb-33fd-4efc-b133-37e5e911ec9d service nova] Creating event network-vif-deleted:e7acbc98-7340-435f-aae6-84d92fbd81f4 for instance 6ef02761-7222-43d2-af15-a1ee80eb9f92 on nch2-master-1 Sep 10 21:20:56.786020 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3e6ffdc1-b737-423b-bbdc-d88a6743cf0a req-010acbbb-33fd-4efc-b133-37e5e911ec9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078049 Sep 10 21:20:56.787213 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2992/6115] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:20:56.874831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c88cea4b-49a2-40d9-bcd3-6867df3e6774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:56.886494 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c88cea4b-49a2-40d9-bcd3-6867df3e6774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1472 microversion: 2.1 time: 0.441062 Sep 10 21:20:56.889813 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3124/6116] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:56 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:57.915978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d1a3c6f9-d7df-4f42-86af-a24a5fd58a11 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:57.916986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d1a3c6f9-d7df-4f42-86af-a24a5fd58a11 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:57.929996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1a3c6f9-d7df-4f42-86af-a24a5fd58a11 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:57.934390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1a3c6f9-d7df-4f42-86af-a24a5fd58a11 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:57.935118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1a3c6f9-d7df-4f42-86af-a24a5fd58a11 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:57.936573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1a3c6f9-d7df-4f42-86af-a24a5fd58a11 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:57.939683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1a3c6f9-d7df-4f42-86af-a24a5fd58a11 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:57.941348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1a3c6f9-d7df-4f42-86af-a24a5fd58a11 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:58.586842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:58.876097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d1a3c6f9-d7df-4f42-86af-a24a5fd58a11 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:20:58.885552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d1a3c6f9-d7df-4f42-86af-a24a5fd58a11 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1472 microversion: 2.1 time: 0.975022 Sep 10 21:20:58.886089 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2993/6117] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:57 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1472 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:20:59.912277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09ae2427-c621-417c-96d4-524c97533774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:20:59.913974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09ae2427-c621-417c-96d4-524c97533774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:20:59.940603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:59.951202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:20:59.954632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ae2427-c621-417c-96d4-524c97533774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:59.956140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ae2427-c621-417c-96d4-524c97533774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:59.959712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ae2427-c621-417c-96d4-524c97533774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:20:59.960611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ae2427-c621-417c-96d4-524c97533774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:20:59.967086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ae2427-c621-417c-96d4-524c97533774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:20:59.967086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09ae2427-c621-417c-96d4-524c97533774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:00.477458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09ae2427-c621-417c-96d4-524c97533774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:00.494857 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09ae2427-c621-417c-96d4-524c97533774 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1472 microversion: 2.1 time: 0.589552 Sep 10 21:21:00.496528 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3125/6118] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:20:59 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1472 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:01.447556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b48ecf40-2e17-4c04-88d9-f99d37a5484a req-129a3222-04fe-4cb0-a4f7-f33532a1ba43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7145a0-75e0-445e-b567-109c0abf6d1e", "name": "network-vif-plugged", "status": "completed", "tag": "3134b312-967b-4646-917a-05ec77bd0242"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:21:01.459454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b48ecf40-2e17-4c04-88d9-f99d37a5484a req-129a3222-04fe-4cb0-a4f7-f33532a1ba43 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:01.460153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b48ecf40-2e17-4c04-88d9-f99d37a5484a req-129a3222-04fe-4cb0-a4f7-f33532a1ba43 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:01.460765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b48ecf40-2e17-4c04-88d9-f99d37a5484a req-129a3222-04fe-4cb0-a4f7-f33532a1ba43 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:01.484768 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b48ecf40-2e17-4c04-88d9-f99d37a5484a req-129a3222-04fe-4cb0-a4f7-f33532a1ba43 service nova] Creating event network-vif-plugged:3134b312-967b-4646-917a-05ec77bd0242 for instance 2d7145a0-75e0-445e-b567-109c0abf6d1e on nch1-master-1 Sep 10 21:21:01.490489 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b48ecf40-2e17-4c04-88d9-f99d37a5484a req-129a3222-04fe-4cb0-a4f7-f33532a1ba43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046612 Sep 10 21:21:01.491659 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2994/6119] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:21:01.521042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1b5be5da-b86b-4644-b6f0-e02d32d03b8c tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:01.521856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1b5be5da-b86b-4644-b6f0-e02d32d03b8c tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:01.529870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5be5da-b86b-4644-b6f0-e02d32d03b8c tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:01.531031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5be5da-b86b-4644-b6f0-e02d32d03b8c tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:01.532483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5be5da-b86b-4644-b6f0-e02d32d03b8c tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:01.533386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5be5da-b86b-4644-b6f0-e02d32d03b8c tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:01.534070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5be5da-b86b-4644-b6f0-e02d32d03b8c tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:01.534681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b5be5da-b86b-4644-b6f0-e02d32d03b8c tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:02.050887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b5be5da-b86b-4644-b6f0-e02d32d03b8c tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:02.064690 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1b5be5da-b86b-4644-b6f0-e02d32d03b8c tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1472 microversion: 2.1 time: 0.548520 Sep 10 21:21:02.065958 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3126/6120] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:01 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1472 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:03.100110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38552fb9-2035-4d47-9e5f-65aa116b61fa tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:03.101476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38552fb9-2035-4d47-9e5f-65aa116b61fa tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:03.112612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38552fb9-2035-4d47-9e5f-65aa116b61fa tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:03.113605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38552fb9-2035-4d47-9e5f-65aa116b61fa tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:03.114432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38552fb9-2035-4d47-9e5f-65aa116b61fa tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:03.117310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38552fb9-2035-4d47-9e5f-65aa116b61fa tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:03.118351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38552fb9-2035-4d47-9e5f-65aa116b61fa tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:03.119024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38552fb9-2035-4d47-9e5f-65aa116b61fa tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:03.496049 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38552fb9-2035-4d47-9e5f-65aa116b61fa tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:03.508998 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38552fb9-2035-4d47-9e5f-65aa116b61fa tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1472 microversion: 2.1 time: 0.424077 Sep 10 21:21:03.510016 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2995/6121] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:03 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:03.623986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7201d8c-792d-4bae-8e11-3d12841de8ab tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '.version_select at 0x7f9944b26670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:03.654317 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f7201d8c-792d-4bae-8e11-3d12841de8ab tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1851929461" status: 202 len: 0 microversion: 2.1 time: 0.033689 Sep 10 21:21:03.655249 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3127/6122] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Sep 10 21:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1851929461 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:21:03.696436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b3b52fcf-f7ea-4e4d-919b-df8ea2e5c64e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'create', calling method: .version_select at 0x7f993f6f71f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1777191468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnNLpokPmDfrsRw9sxEGxGRatOJGeAsQpAKridWZ/oXAYV6pF7RFMFBPeqU9uvQdaIbDbM+rtvBdmrdrS9x8z7DbSYqQasBJQ7EhYAblWiX0GGq4BOX/iXwm8t2VXl5qg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:21:03.721069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-b3b52fcf-f7ea-4e4d-919b-df8ea2e5c64e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for project f4f036f0122f4879aacb1db06eb8b588. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:21:03.727102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-b3b52fcf-f7ea-4e4d-919b-df8ea2e5c64e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for user b4791d13ab1c45bf8fabec70191426da and project f4f036f0122f4879aacb1db06eb8b588. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:21:03.766465 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b3b52fcf-f7ea-4e4d-919b-df8ea2e5c64e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.073605 Sep 10 21:21:03.767238 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2996/6123] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:21:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:21:04.535489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10101cce-bd2a-46ba-91dc-c033311df0bd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:04.536519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10101cce-bd2a-46ba-91dc-c033311df0bd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:04.545108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10101cce-bd2a-46ba-91dc-c033311df0bd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:04.546075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10101cce-bd2a-46ba-91dc-c033311df0bd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:04.546705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10101cce-bd2a-46ba-91dc-c033311df0bd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:04.547655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10101cce-bd2a-46ba-91dc-c033311df0bd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:04.548294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10101cce-bd2a-46ba-91dc-c033311df0bd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:04.548972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10101cce-bd2a-46ba-91dc-c033311df0bd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:04.844836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10101cce-bd2a-46ba-91dc-c033311df0bd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:04.858427 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10101cce-bd2a-46ba-91dc-c033311df0bd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1645 microversion: 2.1 time: 0.327196 Sep 10 21:21:04.860417 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3128/6124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:04 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1645 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:04.890090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1d244c84-c98d-4c15-94b4-fdc7c9da7e74 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:04.892292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1d244c84-c98d-4c15-94b4-fdc7c9da7e74 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:04.902444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d244c84-c98d-4c15-94b4-fdc7c9da7e74 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:04.903304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d244c84-c98d-4c15-94b4-fdc7c9da7e74 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:04.903949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d244c84-c98d-4c15-94b4-fdc7c9da7e74 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:04.904913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d244c84-c98d-4c15-94b4-fdc7c9da7e74 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:04.905602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d244c84-c98d-4c15-94b4-fdc7c9da7e74 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:04.906238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1d244c84-c98d-4c15-94b4-fdc7c9da7e74 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:05.271998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1d244c84-c98d-4c15-94b4-fdc7c9da7e74 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:05.292227 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1d244c84-c98d-4c15-94b4-fdc7c9da7e74 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1645 microversion: 2.1 time: 0.410171 Sep 10 21:21:05.293615 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2997/6125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:04 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1645 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:21:05.330182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4bd76f4c-fea3-454d-8de6-08409506cef0 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:05.332367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4bd76f4c-fea3-454d-8de6-08409506cef0 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:05.354367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bd76f4c-fea3-454d-8de6-08409506cef0 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:05.358717 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bd76f4c-fea3-454d-8de6-08409506cef0 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:05.359206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bd76f4c-fea3-454d-8de6-08409506cef0 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:05.359998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bd76f4c-fea3-454d-8de6-08409506cef0 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:05.360469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bd76f4c-fea3-454d-8de6-08409506cef0 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:05.360906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4bd76f4c-fea3-454d-8de6-08409506cef0 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:06.014748 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4bd76f4c-fea3-454d-8de6-08409506cef0 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1796 microversion: 2.1 time: 0.698730 Sep 10 21:21:06.031902 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3129/6126] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:05 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1796 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:12.133447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b6e4b45a-7aa7-4289-8872-e6f6d1e12c7b req-5ed583ef-703a-4c62-b48a-93e9c0520887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7145a0-75e0-445e-b567-109c0abf6d1e", "tag": "3134b312-967b-4646-917a-05ec77bd0242"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:21:12.155841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b6e4b45a-7aa7-4289-8872-e6f6d1e12c7b req-5ed583ef-703a-4c62-b48a-93e9c0520887 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:12.157042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b6e4b45a-7aa7-4289-8872-e6f6d1e12c7b req-5ed583ef-703a-4c62-b48a-93e9c0520887 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:12.157475 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b6e4b45a-7aa7-4289-8872-e6f6d1e12c7b req-5ed583ef-703a-4c62-b48a-93e9c0520887 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:12.198581 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b6e4b45a-7aa7-4289-8872-e6f6d1e12c7b req-5ed583ef-703a-4c62-b48a-93e9c0520887 service nova] Creating event network-changed:3134b312-967b-4646-917a-05ec77bd0242 for instance 2d7145a0-75e0-445e-b567-109c0abf6d1e on nch1-master-1 Sep 10 21:21:12.210745 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b6e4b45a-7aa7-4289-8872-e6f6d1e12c7b req-5ed583ef-703a-4c62-b48a-93e9c0520887 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084403 Sep 10 21:21:12.213506 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2998/6127] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:21:15.779141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1257241360", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "1f32fcce-7d8d-4f1d-ba06-2db7d43a639f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1777191468", "security_groups": [{"name": "tempest-secgroup-smoke-1346936647"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:21:15.793298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:21:15.969522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] validate_networks() for [('1f32fcce-7d8d-4f1d-ba06-2db7d43a639f', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:21:16.010673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=66 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:21:16.632634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:21:16.633143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:21:16.633653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:21:16.634089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:21:16.634505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:21:16.657107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:16.666369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:16.669759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:16.671449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:16.674149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:16.674946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:16.706238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for project f4f036f0122f4879aacb1db06eb8b588. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:21:16.712373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for user b4791d13ab1c45bf8fabec70191426da and project f4f036f0122f4879aacb1db06eb8b588. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:21:16.729162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:21:16.732205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:21:16.819376 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-01a3c545-2a25-4843-a276-23560f5dcb58 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.045351 Sep 10 21:21:16.820101 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3130/6128] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:21:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:21:16.830373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:21:16.837901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6f43cc0-592d-4911-a8c3-dfd2f70afbb8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:16.838993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6f43cc0-592d-4911-a8c3-dfd2f70afbb8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:16.847471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:21:16.981534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c6f43cc0-592d-4911-a8c3-dfd2f70afbb8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:16.994775 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6f43cc0-592d-4911-a8c3-dfd2f70afbb8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1267 microversion: 2.1 time: 0.163879 Sep 10 21:21:17.009868 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 2999/6129] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:16 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:18.025094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-db5c1f48-d72c-4a25-a2c9-6f0cedee99fa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:18.025715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-db5c1f48-d72c-4a25-a2c9-6f0cedee99fa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:18.033268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db5c1f48-d72c-4a25-a2c9-6f0cedee99fa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:18.033779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db5c1f48-d72c-4a25-a2c9-6f0cedee99fa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:18.034483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db5c1f48-d72c-4a25-a2c9-6f0cedee99fa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:18.035200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db5c1f48-d72c-4a25-a2c9-6f0cedee99fa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:18.035656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db5c1f48-d72c-4a25-a2c9-6f0cedee99fa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:18.036085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-db5c1f48-d72c-4a25-a2c9-6f0cedee99fa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:18.177008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-db5c1f48-d72c-4a25-a2c9-6f0cedee99fa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:18.191683 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-db5c1f48-d72c-4a25-a2c9-6f0cedee99fa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1319 microversion: 2.1 time: 0.172026 Sep 10 21:21:18.194098 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3131/6130] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:18 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:19.224224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5a061878-6029-4cf4-b4d9-ab4aae257ee0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:19.225742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5a061878-6029-4cf4-b4d9-ab4aae257ee0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:19.238680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a061878-6029-4cf4-b4d9-ab4aae257ee0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:19.239912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a061878-6029-4cf4-b4d9-ab4aae257ee0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:19.240828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a061878-6029-4cf4-b4d9-ab4aae257ee0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:19.242115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a061878-6029-4cf4-b4d9-ab4aae257ee0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:19.244852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a061878-6029-4cf4-b4d9-ab4aae257ee0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:19.245554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a061878-6029-4cf4-b4d9-ab4aae257ee0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:19.256874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:21:19.351683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5a061878-6029-4cf4-b4d9-ab4aae257ee0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:19.366437 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5a061878-6029-4cf4-b4d9-ab4aae257ee0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1325 microversion: 2.1 time: 0.149112 Sep 10 21:21:19.368167 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3000/6131] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:19 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1325 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:20.391677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3aad8bf1-8374-465b-a039-4d745a0a064b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:20.392373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3aad8bf1-8374-465b-a039-4d745a0a064b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:20.402679 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aad8bf1-8374-465b-a039-4d745a0a064b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:20.404407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aad8bf1-8374-465b-a039-4d745a0a064b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:20.405398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aad8bf1-8374-465b-a039-4d745a0a064b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:20.408347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aad8bf1-8374-465b-a039-4d745a0a064b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:20.409031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aad8bf1-8374-465b-a039-4d745a0a064b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:20.409814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3aad8bf1-8374-465b-a039-4d745a0a064b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:20.784674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3aad8bf1-8374-465b-a039-4d745a0a064b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:20.792485 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3aad8bf1-8374-465b-a039-4d745a0a064b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1393 microversion: 2.1 time: 0.404750 Sep 10 21:21:20.793085 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3132/6132] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:20 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1393 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:21.616038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8fb25c0b-b959-40e1-92e7-7451a1f867c5 req-3d8a4e9e-be8a-4929-a58f-5fa6091cd2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:21:21.630282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8fb25c0b-b959-40e1-92e7-7451a1f867c5 req-3d8a4e9e-be8a-4929-a58f-5fa6091cd2b9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:21.631071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8fb25c0b-b959-40e1-92e7-7451a1f867c5 req-3d8a4e9e-be8a-4929-a58f-5fa6091cd2b9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:21.631706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8fb25c0b-b959-40e1-92e7-7451a1f867c5 req-3d8a4e9e-be8a-4929-a58f-5fa6091cd2b9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:21.646264 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8fb25c0b-b959-40e1-92e7-7451a1f867c5 req-3d8a4e9e-be8a-4929-a58f-5fa6091cd2b9 service nova] Creating event network-changed:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch2-master-1 Sep 10 21:21:21.654537 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8fb25c0b-b959-40e1-92e7-7451a1f867c5 req-3d8a4e9e-be8a-4929-a58f-5fa6091cd2b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042405 Sep 10 21:21:21.655406 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3001/6133] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:21:21.816187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ebc5156f-83c5-44fa-8ee5-7126cd734e8b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:21.816817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ebc5156f-83c5-44fa-8ee5-7126cd734e8b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:21.825211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebc5156f-83c5-44fa-8ee5-7126cd734e8b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:21.825713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebc5156f-83c5-44fa-8ee5-7126cd734e8b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:21.826270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebc5156f-83c5-44fa-8ee5-7126cd734e8b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:21.827014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebc5156f-83c5-44fa-8ee5-7126cd734e8b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:21.827477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebc5156f-83c5-44fa-8ee5-7126cd734e8b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:21.828532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ebc5156f-83c5-44fa-8ee5-7126cd734e8b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:22.651922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ebc5156f-83c5-44fa-8ee5-7126cd734e8b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:22.661022 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ebc5156f-83c5-44fa-8ee5-7126cd734e8b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1393 microversion: 2.1 time: 0.849181 Sep 10 21:21:22.661713 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3133/6134] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:21 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1393 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:23.690085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f60ab238-e20a-43d2-b6fc-5ffd992c22fe tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:23.691850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f60ab238-e20a-43d2-b6fc-5ffd992c22fe tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:23.701433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f60ab238-e20a-43d2-b6fc-5ffd992c22fe tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:23.702223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f60ab238-e20a-43d2-b6fc-5ffd992c22fe tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:23.703355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f60ab238-e20a-43d2-b6fc-5ffd992c22fe tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:23.704434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f60ab238-e20a-43d2-b6fc-5ffd992c22fe tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:23.705494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f60ab238-e20a-43d2-b6fc-5ffd992c22fe tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:23.706149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f60ab238-e20a-43d2-b6fc-5ffd992c22fe tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:23.961467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f60ab238-e20a-43d2-b6fc-5ffd992c22fe tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:23.977525 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f60ab238-e20a-43d2-b6fc-5ffd992c22fe tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1393 microversion: 2.1 time: 0.293355 Sep 10 21:21:23.986330 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3002/6135] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:23 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1393 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:25.002942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c280b079-48ef-4afe-a6bb-50490f488e18 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:25.003664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c280b079-48ef-4afe-a6bb-50490f488e18 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:25.024994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c280b079-48ef-4afe-a6bb-50490f488e18 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:25.025683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c280b079-48ef-4afe-a6bb-50490f488e18 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:25.026583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c280b079-48ef-4afe-a6bb-50490f488e18 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:25.027457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c280b079-48ef-4afe-a6bb-50490f488e18 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:25.027932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c280b079-48ef-4afe-a6bb-50490f488e18 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:25.028374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c280b079-48ef-4afe-a6bb-50490f488e18 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:25.260017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c280b079-48ef-4afe-a6bb-50490f488e18 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:25.273201 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c280b079-48ef-4afe-a6bb-50490f488e18 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1393 microversion: 2.1 time: 0.275625 Sep 10 21:21:25.287527 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3134/6136] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:24 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1393 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:21:26.298620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d256ba69-006b-4530-8445-2bd3ee69df84 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:26.299244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d256ba69-006b-4530-8445-2bd3ee69df84 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:26.306652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d256ba69-006b-4530-8445-2bd3ee69df84 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:26.307157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d256ba69-006b-4530-8445-2bd3ee69df84 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:26.307608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d256ba69-006b-4530-8445-2bd3ee69df84 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:26.308328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d256ba69-006b-4530-8445-2bd3ee69df84 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:26.308883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d256ba69-006b-4530-8445-2bd3ee69df84 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:26.309234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d256ba69-006b-4530-8445-2bd3ee69df84 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:26.482633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d256ba69-006b-4530-8445-2bd3ee69df84 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:26.491537 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d256ba69-006b-4530-8445-2bd3ee69df84 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1393 microversion: 2.1 time: 0.197304 Sep 10 21:21:26.492328 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3003/6137] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:26 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1393 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:27.518997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e58ec40b-2ad9-4d12-9a5e-6845e022e373 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:27.519621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e58ec40b-2ad9-4d12-9a5e-6845e022e373 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:27.522785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:21:27.526479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:21:27.538261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e58ec40b-2ad9-4d12-9a5e-6845e022e373 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:27.541590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e58ec40b-2ad9-4d12-9a5e-6845e022e373 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:27.542203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e58ec40b-2ad9-4d12-9a5e-6845e022e373 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:27.543632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e58ec40b-2ad9-4d12-9a5e-6845e022e373 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:27.544121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e58ec40b-2ad9-4d12-9a5e-6845e022e373 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:27.544566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e58ec40b-2ad9-4d12-9a5e-6845e022e373 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:27.702777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e58ec40b-2ad9-4d12-9a5e-6845e022e373 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:27.714588 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e58ec40b-2ad9-4d12-9a5e-6845e022e373 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1393 microversion: 2.1 time: 0.200638 Sep 10 21:21:27.715153 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3135/6138] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:27 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1393 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:28.738851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9337606d-b0c6-4367-bf3e-c14bbfb0d56a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:28.739485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9337606d-b0c6-4367-bf3e-c14bbfb0d56a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:28.742628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:21:28.753432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9337606d-b0c6-4367-bf3e-c14bbfb0d56a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:28.760444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9337606d-b0c6-4367-bf3e-c14bbfb0d56a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:28.761161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9337606d-b0c6-4367-bf3e-c14bbfb0d56a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:28.761944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9337606d-b0c6-4367-bf3e-c14bbfb0d56a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:28.762412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9337606d-b0c6-4367-bf3e-c14bbfb0d56a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:28.763058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9337606d-b0c6-4367-bf3e-c14bbfb0d56a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:28.934606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9337606d-b0c6-4367-bf3e-c14bbfb0d56a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:28.946575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-688d8a8e-00dd-42c2-808d-12e2a32300c8 req-0fefcdf9-0b20-4ad4-9b89-45c6e1efabbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "name": "network-vif-plugged", "status": "completed", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:21:28.950923 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9337606d-b0c6-4367-bf3e-c14bbfb0d56a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1393 microversion: 2.1 time: 0.214551 Sep 10 21:21:28.954474 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3004/6139] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:28 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1393 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:28.970580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-688d8a8e-00dd-42c2-808d-12e2a32300c8 req-0fefcdf9-0b20-4ad4-9b89-45c6e1efabbf service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:28.974509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-688d8a8e-00dd-42c2-808d-12e2a32300c8 req-0fefcdf9-0b20-4ad4-9b89-45c6e1efabbf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:28.975069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-688d8a8e-00dd-42c2-808d-12e2a32300c8 req-0fefcdf9-0b20-4ad4-9b89-45c6e1efabbf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:28.991303 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-688d8a8e-00dd-42c2-808d-12e2a32300c8 req-0fefcdf9-0b20-4ad4-9b89-45c6e1efabbf service nova] Creating event network-vif-plugged:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch2-master-1 Sep 10 21:21:28.998396 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-688d8a8e-00dd-42c2-808d-12e2a32300c8 req-0fefcdf9-0b20-4ad4-9b89-45c6e1efabbf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056063 Sep 10 21:21:29.002371 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3136/6140] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:21:29.976850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a5beee72-4683-4070-ba0f-fe355f6fb163 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:29.978117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a5beee72-4683-4070-ba0f-fe355f6fb163 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:29.987853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5beee72-4683-4070-ba0f-fe355f6fb163 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:29.988579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5beee72-4683-4070-ba0f-fe355f6fb163 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:29.989232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5beee72-4683-4070-ba0f-fe355f6fb163 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:29.990191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5beee72-4683-4070-ba0f-fe355f6fb163 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:29.990892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5beee72-4683-4070-ba0f-fe355f6fb163 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:29.991558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5beee72-4683-4070-ba0f-fe355f6fb163 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:30.162929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a5beee72-4683-4070-ba0f-fe355f6fb163 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:30.173293 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a5beee72-4683-4070-ba0f-fe355f6fb163 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1393 microversion: 2.1 time: 0.200373 Sep 10 21:21:30.173930 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3005/6141] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:29 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1393 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:31.206058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0afdba9-c531-4004-9b4d-30a98369ed4e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:31.207004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0afdba9-c531-4004-9b4d-30a98369ed4e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:31.234693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0afdba9-c531-4004-9b4d-30a98369ed4e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:31.241553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0afdba9-c531-4004-9b4d-30a98369ed4e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:31.242064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0afdba9-c531-4004-9b4d-30a98369ed4e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:31.242831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0afdba9-c531-4004-9b4d-30a98369ed4e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:31.243674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0afdba9-c531-4004-9b4d-30a98369ed4e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:31.254662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0afdba9-c531-4004-9b4d-30a98369ed4e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:31.493543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0afdba9-c531-4004-9b4d-30a98369ed4e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:31.505839 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0afdba9-c531-4004-9b4d-30a98369ed4e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1564 microversion: 2.1 time: 0.311711 Sep 10 21:21:31.506723 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3137/6142] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:31 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1564 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:31.529421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-59e34d80-8bc5-4172-b296-19c13ccf995e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:31.530144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-59e34d80-8bc5-4172-b296-19c13ccf995e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:31.539403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59e34d80-8bc5-4172-b296-19c13ccf995e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:31.540166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59e34d80-8bc5-4172-b296-19c13ccf995e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:31.540829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59e34d80-8bc5-4172-b296-19c13ccf995e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:31.541741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59e34d80-8bc5-4172-b296-19c13ccf995e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:31.542039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59e34d80-8bc5-4172-b296-19c13ccf995e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:31.542470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59e34d80-8bc5-4172-b296-19c13ccf995e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:31.727605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-59e34d80-8bc5-4172-b296-19c13ccf995e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:31.737869 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-59e34d80-8bc5-4172-b296-19c13ccf995e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1564 microversion: 2.1 time: 0.212660 Sep 10 21:21:31.739070 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3006/6143] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:31 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1564 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:34.521721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2847c6bc-e871-4738-9ba4-5591cba700cc tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:21:34.522440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2847c6bc-e871-4738-9ba4-5591cba700cc tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:34.530437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2847c6bc-e871-4738-9ba4-5591cba700cc tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:34.531215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2847c6bc-e871-4738-9ba4-5591cba700cc tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:34.532435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2847c6bc-e871-4738-9ba4-5591cba700cc tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:34.533360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2847c6bc-e871-4738-9ba4-5591cba700cc tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:34.534027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2847c6bc-e871-4738-9ba4-5591cba700cc tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:34.535289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2847c6bc-e871-4738-9ba4-5591cba700cc tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:34.535457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-49452c48-187d-4a69-b40e-3e153b227a41 req-8b875e49-fd7e-461f-a647-eec32c588fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:21:34.550412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-49452c48-187d-4a69-b40e-3e153b227a41 req-8b875e49-fd7e-461f-a647-eec32c588fd6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:34.551085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-49452c48-187d-4a69-b40e-3e153b227a41 req-8b875e49-fd7e-461f-a647-eec32c588fd6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:34.551779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-49452c48-187d-4a69-b40e-3e153b227a41 req-8b875e49-fd7e-461f-a647-eec32c588fd6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:34.570233 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-49452c48-187d-4a69-b40e-3e153b227a41 req-8b875e49-fd7e-461f-a647-eec32c588fd6 service nova] Creating event network-changed:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch2-master-1 Sep 10 21:21:34.576947 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-49452c48-187d-4a69-b40e-3e153b227a41 req-8b875e49-fd7e-461f-a647-eec32c588fd6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046886 Sep 10 21:21:34.581921 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3007/6144] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:21:34.812008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2847c6bc-e871-4738-9ba4-5591cba700cc tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:21:34.821424 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2847c6bc-e871-4738-9ba4-5591cba700cc tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1564 microversion: 2.1 time: 0.304274 Sep 10 21:21:34.822089 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3138/6145] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:21:34 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1564 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:21:57.290222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=19 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:21:57.291127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=39 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:21:57.296963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7cc22f05-2f03-4b3c-b894-39d09e7e5104 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:21:57.299558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7cc22f05-2f03-4b3c-b894-39d09e7e5104 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:21:57.306895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cc22f05-2f03-4b3c-b894-39d09e7e5104 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:57.307394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cc22f05-2f03-4b3c-b894-39d09e7e5104 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:57.307843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cc22f05-2f03-4b3c-b894-39d09e7e5104 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:57.308555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cc22f05-2f03-4b3c-b894-39d09e7e5104 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:21:57.309032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cc22f05-2f03-4b3c-b894-39d09e7e5104 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:21:57.309450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7cc22f05-2f03-4b3c-b894-39d09e7e5104 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:21:57.370935 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7cc22f05-2f03-4b3c-b894-39d09e7e5104 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0/action" status: 200 len: 24572 microversion: 2.1 time: 0.083649 Sep 10 21:21:57.371824 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3008/6146] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:21:57 2022] POST /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0/action => generated 24572 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 21:22:08.427501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-803becd5-dce3-4423-ad6a-d399a6383af5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:08.428121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-803becd5-dce3-4423-ad6a-d399a6383af5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:08.430776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:08.431525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=46 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:08.439205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803becd5-dce3-4423-ad6a-d399a6383af5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:08.439714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803becd5-dce3-4423-ad6a-d399a6383af5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:08.440166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803becd5-dce3-4423-ad6a-d399a6383af5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:08.440890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803becd5-dce3-4423-ad6a-d399a6383af5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:08.441354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803becd5-dce3-4423-ad6a-d399a6383af5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:08.442195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-803becd5-dce3-4423-ad6a-d399a6383af5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:08.602317 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-803becd5-dce3-4423-ad6a-d399a6383af5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1832 microversion: 2.1 time: 0.178828 Sep 10 21:22:08.603149 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3139/6147] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:08 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1832 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:08.630578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e987fe49-a985-4762-a7c1-73ec4405eb75 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:08.631312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e987fe49-a985-4762-a7c1-73ec4405eb75 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:08.634567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:08.635404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:08.642645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e987fe49-a985-4762-a7c1-73ec4405eb75 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:08.643147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e987fe49-a985-4762-a7c1-73ec4405eb75 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:08.643631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e987fe49-a985-4762-a7c1-73ec4405eb75 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:08.644563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e987fe49-a985-4762-a7c1-73ec4405eb75 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:08.645033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e987fe49-a985-4762-a7c1-73ec4405eb75 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:08.645466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e987fe49-a985-4762-a7c1-73ec4405eb75 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:08.867106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e987fe49-a985-4762-a7c1-73ec4405eb75 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:08.876857 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e987fe49-a985-4762-a7c1-73ec4405eb75 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1681 microversion: 2.1 time: 0.254841 Sep 10 21:22:08.877437 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3009/6148] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:08 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:08.986985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-38f1d3d4-5bcd-467c-a0ec-07a2020ce6c6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:08.989354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-38f1d3d4-5bcd-467c-a0ec-07a2020ce6c6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:08.996082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38f1d3d4-5bcd-467c-a0ec-07a2020ce6c6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:08.996602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38f1d3d4-5bcd-467c-a0ec-07a2020ce6c6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:08.997044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38f1d3d4-5bcd-467c-a0ec-07a2020ce6c6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:08.998034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38f1d3d4-5bcd-467c-a0ec-07a2020ce6c6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:08.999308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38f1d3d4-5bcd-467c-a0ec-07a2020ce6c6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:08.999742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-38f1d3d4-5bcd-467c-a0ec-07a2020ce6c6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:09.067933 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-38f1d3d4-5bcd-467c-a0ec-07a2020ce6c6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0/action" status: 200 len: 32641 microversion: 2.1 time: 0.085357 Sep 10 21:22:09.069770 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3140/6149] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:22:08 2022] POST /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0/action => generated 32641 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:22:09.243157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:09.243808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:09.252933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:09.253731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:09.254458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:09.255194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:09.255842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:09.256279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:09.288651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '09038e5611424270a0afa7928b3cf791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48270d4f7205461aa0563e2ef69c6c44', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:09.289350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] flavor_id is None. Assuming migration. {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 21:22:09.289889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:22:09.422632 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2d44d0ed-e08f-4271-8810-2f7838073fb6 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0/action" status: 202 len: 0 microversion: 2.1 time: 0.183776 Sep 10 21:22:09.423941 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3010/6150] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:22:09 2022] POST /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:22:09.432378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-90e2fde5-a5d2-4166-b3cf-5328996bb659 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:09.434080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-90e2fde5-a5d2-4166-b3cf-5328996bb659 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:09.444289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90e2fde5-a5d2-4166-b3cf-5328996bb659 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:09.445067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90e2fde5-a5d2-4166-b3cf-5328996bb659 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:09.445959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90e2fde5-a5d2-4166-b3cf-5328996bb659 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:09.446910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90e2fde5-a5d2-4166-b3cf-5328996bb659 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:09.447584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90e2fde5-a5d2-4166-b3cf-5328996bb659 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:09.448227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-90e2fde5-a5d2-4166-b3cf-5328996bb659 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:09.760947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-90e2fde5-a5d2-4166-b3cf-5328996bb659 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:09.777013 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-90e2fde5-a5d2-4166-b3cf-5328996bb659 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1690 microversion: 2.1 time: 0.348787 Sep 10 21:22:09.779917 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3141/6151] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:09 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1690 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:22:10.807276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4201c762-8295-446e-8dc7-b7005a038f5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:10.807923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4201c762-8295-446e-8dc7-b7005a038f5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:10.816557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4201c762-8295-446e-8dc7-b7005a038f5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:10.817059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4201c762-8295-446e-8dc7-b7005a038f5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:10.817505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4201c762-8295-446e-8dc7-b7005a038f5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:10.818253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4201c762-8295-446e-8dc7-b7005a038f5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:10.818713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4201c762-8295-446e-8dc7-b7005a038f5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:10.819146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4201c762-8295-446e-8dc7-b7005a038f5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:11.050186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4201c762-8295-446e-8dc7-b7005a038f5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:11.058645 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4201c762-8295-446e-8dc7-b7005a038f5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1690 microversion: 2.1 time: 0.255341 Sep 10 21:22:11.059243 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3011/6152] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:10 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:12.084126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5c9359b-bcbc-4ca4-a8a5-3b91efb5580a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:12.084812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5c9359b-bcbc-4ca4-a8a5-3b91efb5580a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:12.093908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5c9359b-bcbc-4ca4-a8a5-3b91efb5580a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:12.094339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5c9359b-bcbc-4ca4-a8a5-3b91efb5580a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:12.094790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5c9359b-bcbc-4ca4-a8a5-3b91efb5580a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:12.095496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5c9359b-bcbc-4ca4-a8a5-3b91efb5580a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:12.095968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5c9359b-bcbc-4ca4-a8a5-3b91efb5580a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:12.096505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5c9359b-bcbc-4ca4-a8a5-3b91efb5580a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:12.251408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5c9359b-bcbc-4ca4-a8a5-3b91efb5580a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:12.265226 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5c9359b-bcbc-4ca4-a8a5-3b91efb5580a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.184829 Sep 10 21:22:12.279992 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3142/6153] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:12 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:22:13.291444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0729c7fc-cc67-4e73-a957-df2a192261c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:13.292273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0729c7fc-cc67-4e73-a957-df2a192261c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:13.299318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0729c7fc-cc67-4e73-a957-df2a192261c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:13.300135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0729c7fc-cc67-4e73-a957-df2a192261c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:13.300821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0729c7fc-cc67-4e73-a957-df2a192261c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:13.301772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0729c7fc-cc67-4e73-a957-df2a192261c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:13.302474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0729c7fc-cc67-4e73-a957-df2a192261c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:13.303253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0729c7fc-cc67-4e73-a957-df2a192261c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:13.495549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0729c7fc-cc67-4e73-a957-df2a192261c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:13.503908 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0729c7fc-cc67-4e73-a957-df2a192261c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.216565 Sep 10 21:22:13.504501 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3012/6154] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:13 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:14.531795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-115f183e-bfce-4bff-ad00-974d417b8600 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:14.532522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-115f183e-bfce-4bff-ad00-974d417b8600 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:14.539838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-115f183e-bfce-4bff-ad00-974d417b8600 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:14.540336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-115f183e-bfce-4bff-ad00-974d417b8600 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:14.540783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-115f183e-bfce-4bff-ad00-974d417b8600 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:14.541498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-115f183e-bfce-4bff-ad00-974d417b8600 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:14.542191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-115f183e-bfce-4bff-ad00-974d417b8600 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:14.542630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-115f183e-bfce-4bff-ad00-974d417b8600 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:14.684145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-115f183e-bfce-4bff-ad00-974d417b8600 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:14.692868 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-115f183e-bfce-4bff-ad00-974d417b8600 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.166144 Sep 10 21:22:14.693460 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3143/6155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:14 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:22:15.716477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-28ea6cb2-7b98-438c-b4ad-bd869eb45a17 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:15.717555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-28ea6cb2-7b98-438c-b4ad-bd869eb45a17 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:15.725344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28ea6cb2-7b98-438c-b4ad-bd869eb45a17 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:15.726107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28ea6cb2-7b98-438c-b4ad-bd869eb45a17 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:15.726573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28ea6cb2-7b98-438c-b4ad-bd869eb45a17 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:15.727582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28ea6cb2-7b98-438c-b4ad-bd869eb45a17 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:15.728389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28ea6cb2-7b98-438c-b4ad-bd869eb45a17 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:15.729056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28ea6cb2-7b98-438c-b4ad-bd869eb45a17 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:15.947859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28ea6cb2-7b98-438c-b4ad-bd869eb45a17 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:15.956762 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-28ea6cb2-7b98-438c-b4ad-bd869eb45a17 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.244156 Sep 10 21:22:15.957377 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3013/6156] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:15 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:22:16.986590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1d588680-ce6f-4e45-9c82-fd1e9c4c9531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:16.987874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1d588680-ce6f-4e45-9c82-fd1e9c4c9531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:16.996283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d588680-ce6f-4e45-9c82-fd1e9c4c9531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:16.997382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d588680-ce6f-4e45-9c82-fd1e9c4c9531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:16.998148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d588680-ce6f-4e45-9c82-fd1e9c4c9531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:16.999186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d588680-ce6f-4e45-9c82-fd1e9c4c9531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:16.999875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d588680-ce6f-4e45-9c82-fd1e9c4c9531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:17.001644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1d588680-ce6f-4e45-9c82-fd1e9c4c9531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:17.248129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1d588680-ce6f-4e45-9c82-fd1e9c4c9531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:17.258329 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1d588680-ce6f-4e45-9c82-fd1e9c4c9531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.278936 Sep 10 21:22:17.259910 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3144/6157] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:16 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:18.288829 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c5154c00-dfcb-4b42-b509-8ca8dc499155 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:18.289460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c5154c00-dfcb-4b42-b509-8ca8dc499155 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:18.305511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5154c00-dfcb-4b42-b509-8ca8dc499155 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:18.308474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5154c00-dfcb-4b42-b509-8ca8dc499155 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:18.308947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5154c00-dfcb-4b42-b509-8ca8dc499155 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:18.312674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5154c00-dfcb-4b42-b509-8ca8dc499155 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:18.314097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5154c00-dfcb-4b42-b509-8ca8dc499155 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:18.315716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5154c00-dfcb-4b42-b509-8ca8dc499155 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:18.617213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c5154c00-dfcb-4b42-b509-8ca8dc499155 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:18.632319 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c5154c00-dfcb-4b42-b509-8ca8dc499155 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.343227 Sep 10 21:22:18.633606 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3014/6158] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:18 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:19.664083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ab5f5308-4dde-4b23-b669-a306c5978a2f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:19.666030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ab5f5308-4dde-4b23-b669-a306c5978a2f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:19.690017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab5f5308-4dde-4b23-b669-a306c5978a2f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:19.693316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab5f5308-4dde-4b23-b669-a306c5978a2f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:19.694744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab5f5308-4dde-4b23-b669-a306c5978a2f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:19.695704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab5f5308-4dde-4b23-b669-a306c5978a2f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:19.696221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab5f5308-4dde-4b23-b669-a306c5978a2f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:19.696819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab5f5308-4dde-4b23-b669-a306c5978a2f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:20.038633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ab5f5308-4dde-4b23-b669-a306c5978a2f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:20.049489 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ab5f5308-4dde-4b23-b669-a306c5978a2f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.392141 Sep 10 21:22:20.050735 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3145/6159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:19 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:21.074851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-253abe9e-e3e4-4b19-9a36-80b108bc95e7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:21.075558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-253abe9e-e3e4-4b19-9a36-80b108bc95e7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:21.089597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253abe9e-e3e4-4b19-9a36-80b108bc95e7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:21.090482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253abe9e-e3e4-4b19-9a36-80b108bc95e7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:21.091192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253abe9e-e3e4-4b19-9a36-80b108bc95e7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:21.092341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253abe9e-e3e4-4b19-9a36-80b108bc95e7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:21.093017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253abe9e-e3e4-4b19-9a36-80b108bc95e7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:21.093657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-253abe9e-e3e4-4b19-9a36-80b108bc95e7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:21.411578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-253abe9e-e3e4-4b19-9a36-80b108bc95e7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:21.424615 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-253abe9e-e3e4-4b19-9a36-80b108bc95e7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.353837 Sep 10 21:22:21.427974 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3015/6160] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:21 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:22.452001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96b0ed32-e199-4c7e-bcb2-3649883fcac8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:22.452609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96b0ed32-e199-4c7e-bcb2-3649883fcac8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:22.466183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b0ed32-e199-4c7e-bcb2-3649883fcac8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:22.468005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b0ed32-e199-4c7e-bcb2-3649883fcac8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:22.472993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b0ed32-e199-4c7e-bcb2-3649883fcac8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:22.474379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b0ed32-e199-4c7e-bcb2-3649883fcac8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:22.475122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b0ed32-e199-4c7e-bcb2-3649883fcac8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:22.476114 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96b0ed32-e199-4c7e-bcb2-3649883fcac8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:23.056254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-96b0ed32-e199-4c7e-bcb2-3649883fcac8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:23.066339 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96b0ed32-e199-4c7e-bcb2-3649883fcac8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.618807 Sep 10 21:22:23.085865 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3146/6161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:22 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:23.681078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1627483809", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "3746b1ce-46d6-45a6-b447-1d6cb0fe2503"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1810064900", "security_groups": []}, "os:scheduler_hints": {"different_host": ["2d7145a0-75e0-445e-b567-109c0abf6d1e"]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:23.749812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] validate_networks() for [('3746b1ce-46d6-45a6-b447-1d6cb0fe2503', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:22:24.118250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cdaf0380-d209-4d18-85f9-ffa77484176f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:24.118250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cdaf0380-d209-4d18-85f9-ffa77484176f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:24.132243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdaf0380-d209-4d18-85f9-ffa77484176f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:24.132902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdaf0380-d209-4d18-85f9-ffa77484176f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:24.133436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdaf0380-d209-4d18-85f9-ffa77484176f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:24.134102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdaf0380-d209-4d18-85f9-ffa77484176f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:24.135692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdaf0380-d209-4d18-85f9-ffa77484176f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:24.136158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdaf0380-d209-4d18-85f9-ffa77484176f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:24.360089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cdaf0380-d209-4d18-85f9-ffa77484176f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:24.369556 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cdaf0380-d209-4d18-85f9-ffa77484176f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.275239 Sep 10 21:22:24.370778 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3147/6162] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:24 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:22:24.849220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:22:24.849776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:22:24.850155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:22:24.850734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:22:24.851269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:22:24.862119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:24.862936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:24.863385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:24.864263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:24.864949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:24.865388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:24.885469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Getting quotas for project 371635a1edd041828749d00c5526197c. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:22:24.891918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Getting quotas for user f5afa360fc4c40288b65c437519c2a7f and project 371635a1edd041828749d00c5526197c. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:22:24.906871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:22:24.909651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:22:24.964314 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d69a807-fbbb-4d98-b5ca-6431a86b3aae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.288893 Sep 10 21:22:24.965284 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3016/6163] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:22:23 2022] POST /compute/v2.1/servers => generated 361 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:22:24.977575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-caa29e66-6dfa-4b61-b605-15fcab99b665 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:24.978610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-caa29e66-6dfa-4b61-b605-15fcab99b665 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:25.075481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-caa29e66-6dfa-4b61-b605-15fcab99b665 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:25.082981 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-caa29e66-6dfa-4b61-b605-15fcab99b665 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1242 microversion: 2.1 time: 0.109218 Sep 10 21:22:25.083587 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3148/6164] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:24 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:25.396744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ff39b8fe-f6e1-4b24-bf3d-c7cd680aa3c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:25.401750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ff39b8fe-f6e1-4b24-bf3d-c7cd680aa3c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:25.427500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff39b8fe-f6e1-4b24-bf3d-c7cd680aa3c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:25.428040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff39b8fe-f6e1-4b24-bf3d-c7cd680aa3c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:25.428564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff39b8fe-f6e1-4b24-bf3d-c7cd680aa3c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:25.429383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff39b8fe-f6e1-4b24-bf3d-c7cd680aa3c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:25.429846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff39b8fe-f6e1-4b24-bf3d-c7cd680aa3c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:25.431708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ff39b8fe-f6e1-4b24-bf3d-c7cd680aa3c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:25.626556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ff39b8fe-f6e1-4b24-bf3d-c7cd680aa3c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:25.634963 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ff39b8fe-f6e1-4b24-bf3d-c7cd680aa3c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.243059 Sep 10 21:22:25.635831 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3017/6165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:25 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:26.111287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-164d4ee7-a914-4ff2-992f-06e01d58ed62 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:26.111793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-164d4ee7-a914-4ff2-992f-06e01d58ed62 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:26.119872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-164d4ee7-a914-4ff2-992f-06e01d58ed62 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:26.120382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-164d4ee7-a914-4ff2-992f-06e01d58ed62 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:26.120825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-164d4ee7-a914-4ff2-992f-06e01d58ed62 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:26.121541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-164d4ee7-a914-4ff2-992f-06e01d58ed62 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:26.122258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-164d4ee7-a914-4ff2-992f-06e01d58ed62 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:26.122647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-164d4ee7-a914-4ff2-992f-06e01d58ed62 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:26.251111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-164d4ee7-a914-4ff2-992f-06e01d58ed62 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:26.277561 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-164d4ee7-a914-4ff2-992f-06e01d58ed62 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1294 microversion: 2.1 time: 0.173264 Sep 10 21:22:26.288156 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3149/6166] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:26 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1294 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:26.660768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62ba1c39-fba2-4335-8037-75b6cdecae86 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:26.662085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62ba1c39-fba2-4335-8037-75b6cdecae86 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:26.674464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ba1c39-fba2-4335-8037-75b6cdecae86 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:26.676875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ba1c39-fba2-4335-8037-75b6cdecae86 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:26.678323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ba1c39-fba2-4335-8037-75b6cdecae86 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:26.679282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ba1c39-fba2-4335-8037-75b6cdecae86 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:26.679755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ba1c39-fba2-4335-8037-75b6cdecae86 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:26.680225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62ba1c39-fba2-4335-8037-75b6cdecae86 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:26.863421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-62ba1c39-fba2-4335-8037-75b6cdecae86 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:26.874543 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62ba1c39-fba2-4335-8037-75b6cdecae86 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.218449 Sep 10 21:22:26.875460 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3018/6167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:26 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:27.312514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fbca057a-300d-4b7b-be94-fd5696aa7e15 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:27.314024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fbca057a-300d-4b7b-be94-fd5696aa7e15 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:27.322051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbca057a-300d-4b7b-be94-fd5696aa7e15 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:27.322757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbca057a-300d-4b7b-be94-fd5696aa7e15 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:27.323408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbca057a-300d-4b7b-be94-fd5696aa7e15 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:27.324515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbca057a-300d-4b7b-be94-fd5696aa7e15 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:27.326955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbca057a-300d-4b7b-be94-fd5696aa7e15 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:27.334457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fbca057a-300d-4b7b-be94-fd5696aa7e15 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:27.500300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fbca057a-300d-4b7b-be94-fd5696aa7e15 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:27.510455 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fbca057a-300d-4b7b-be94-fd5696aa7e15 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1300 microversion: 2.1 time: 0.203021 Sep 10 21:22:27.514421 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3150/6168] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:27 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1300 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:27.910349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-71f61991-02fa-4f93-81f8-99ef8eb66d68 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:27.911173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-71f61991-02fa-4f93-81f8-99ef8eb66d68 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:27.924324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71f61991-02fa-4f93-81f8-99ef8eb66d68 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:27.925172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71f61991-02fa-4f93-81f8-99ef8eb66d68 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:27.926139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71f61991-02fa-4f93-81f8-99ef8eb66d68 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:27.927128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71f61991-02fa-4f93-81f8-99ef8eb66d68 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:27.927778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71f61991-02fa-4f93-81f8-99ef8eb66d68 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:27.928495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71f61991-02fa-4f93-81f8-99ef8eb66d68 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:28.250419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-71f61991-02fa-4f93-81f8-99ef8eb66d68 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:28.260488 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-71f61991-02fa-4f93-81f8-99ef8eb66d68 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1695 microversion: 2.1 time: 0.354045 Sep 10 21:22:28.262127 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3019/6169] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:27 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1695 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:28.537367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-590c355b-bcdd-46be-817b-9262ba728fe6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:28.538022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-590c355b-bcdd-46be-817b-9262ba728fe6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:28.545439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-590c355b-bcdd-46be-817b-9262ba728fe6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:28.545984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-590c355b-bcdd-46be-817b-9262ba728fe6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:28.551120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-590c355b-bcdd-46be-817b-9262ba728fe6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:28.552005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-590c355b-bcdd-46be-817b-9262ba728fe6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:28.552501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-590c355b-bcdd-46be-817b-9262ba728fe6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:28.552948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-590c355b-bcdd-46be-817b-9262ba728fe6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:28.687461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-590c355b-bcdd-46be-817b-9262ba728fe6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:28.694753 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-590c355b-bcdd-46be-817b-9262ba728fe6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1300 microversion: 2.1 time: 0.162131 Sep 10 21:22:28.710403 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3151/6170] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:28 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1300 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:29.285701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cf568af4-4e21-48d1-9187-02f7376c22f7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:29.286371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cf568af4-4e21-48d1-9187-02f7376c22f7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:29.294182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf568af4-4e21-48d1-9187-02f7376c22f7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:29.294812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf568af4-4e21-48d1-9187-02f7376c22f7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:29.295335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf568af4-4e21-48d1-9187-02f7376c22f7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:29.296530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf568af4-4e21-48d1-9187-02f7376c22f7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:29.297214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf568af4-4e21-48d1-9187-02f7376c22f7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:29.297720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf568af4-4e21-48d1-9187-02f7376c22f7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:29.620770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cf568af4-4e21-48d1-9187-02f7376c22f7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:29.631761 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cf568af4-4e21-48d1-9187-02f7376c22f7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1694 microversion: 2.1 time: 0.349894 Sep 10 21:22:29.640865 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3020/6171] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:29 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1694 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:29.719557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c36390cf-be77-49bd-afa0-393e21a530e6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:29.720941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c36390cf-be77-49bd-afa0-393e21a530e6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:29.741957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36390cf-be77-49bd-afa0-393e21a530e6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:29.742781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36390cf-be77-49bd-afa0-393e21a530e6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:29.743458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36390cf-be77-49bd-afa0-393e21a530e6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:29.744439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36390cf-be77-49bd-afa0-393e21a530e6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:29.745171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36390cf-be77-49bd-afa0-393e21a530e6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:29.745847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c36390cf-be77-49bd-afa0-393e21a530e6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:29.993471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c36390cf-be77-49bd-afa0-393e21a530e6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:30.002105 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c36390cf-be77-49bd-afa0-393e21a530e6 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1300 microversion: 2.1 time: 0.287108 Sep 10 21:22:30.002703 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3152/6172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:29 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1300 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:30.028220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-58164ec2-9e0d-4fda-ad5c-b75078fa2036 req-c7e7ac83-e553-4889-b60b-0f5854b9646b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "name": "network-vif-unplugged", "status": "completed", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:30.040626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-58164ec2-9e0d-4fda-ad5c-b75078fa2036 req-c7e7ac83-e553-4889-b60b-0f5854b9646b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:30.041530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-58164ec2-9e0d-4fda-ad5c-b75078fa2036 req-c7e7ac83-e553-4889-b60b-0f5854b9646b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:30.042376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-58164ec2-9e0d-4fda-ad5c-b75078fa2036 req-c7e7ac83-e553-4889-b60b-0f5854b9646b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:30.056482 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-58164ec2-9e0d-4fda-ad5c-b75078fa2036 req-c7e7ac83-e553-4889-b60b-0f5854b9646b service nova] Creating event network-vif-unplugged:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch1-master-1 Sep 10 21:22:30.070065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-58164ec2-9e0d-4fda-ad5c-b75078fa2036 req-c7e7ac83-e553-4889-b60b-0f5854b9646b service nova] Instance 51e18921-80df-45ef-881a-9d56499bc7e0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:22:30.093473 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-58164ec2-9e0d-4fda-ad5c-b75078fa2036 req-c7e7ac83-e553-4889-b60b-0f5854b9646b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071861 Sep 10 21:22:30.094678 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3021/6173] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:22:30.669245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7946b537-6f17-4c05-abac-0ef3c0868556 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:30.670124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7946b537-6f17-4c05-abac-0ef3c0868556 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:30.676530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7946b537-6f17-4c05-abac-0ef3c0868556 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:30.677030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7946b537-6f17-4c05-abac-0ef3c0868556 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:30.677473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7946b537-6f17-4c05-abac-0ef3c0868556 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:30.678208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7946b537-6f17-4c05-abac-0ef3c0868556 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:30.678870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7946b537-6f17-4c05-abac-0ef3c0868556 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:30.679314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7946b537-6f17-4c05-abac-0ef3c0868556 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:31.026543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a3e0f6f0-39a7-415f-9b07-e9eb2a7717f8 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:31.027982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a3e0f6f0-39a7-415f-9b07-e9eb2a7717f8 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:31.035596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e0f6f0-39a7-415f-9b07-e9eb2a7717f8 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:31.036737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e0f6f0-39a7-415f-9b07-e9eb2a7717f8 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:31.037446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e0f6f0-39a7-415f-9b07-e9eb2a7717f8 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:31.038455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e0f6f0-39a7-415f-9b07-e9eb2a7717f8 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:31.039014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e0f6f0-39a7-415f-9b07-e9eb2a7717f8 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:31.039813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a3e0f6f0-39a7-415f-9b07-e9eb2a7717f8 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:31.192963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a3e0f6f0-39a7-415f-9b07-e9eb2a7717f8 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:31.209404 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a3e0f6f0-39a7-415f-9b07-e9eb2a7717f8 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1300 microversion: 2.1 time: 0.188361 Sep 10 21:22:31.210032 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3022/6174] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:31 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:22:31.289047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7946b537-6f17-4c05-abac-0ef3c0868556 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:31.297643 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7946b537-6f17-4c05-abac-0ef3c0868556 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1694 microversion: 2.1 time: 0.632929 Sep 10 21:22:31.298364 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3153/6175] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:30 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1694 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:32.121915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3953727d-6801-43c6-9ae2-b771b8931f5c req-7e2d4170-4086-4e3f-8bb0-59f3d3698884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4896be18-c24c-4985-a814-256713b0061e", "tag": "162155c8-7e65-4e8e-b899-9cdc9d514287"}, {"name": "network-changed", "server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:32.136737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3953727d-6801-43c6-9ae2-b771b8931f5c req-7e2d4170-4086-4e3f-8bb0-59f3d3698884 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:32.137422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3953727d-6801-43c6-9ae2-b771b8931f5c req-7e2d4170-4086-4e3f-8bb0-59f3d3698884 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:32.138078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3953727d-6801-43c6-9ae2-b771b8931f5c req-7e2d4170-4086-4e3f-8bb0-59f3d3698884 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:32.156724 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3953727d-6801-43c6-9ae2-b771b8931f5c req-7e2d4170-4086-4e3f-8bb0-59f3d3698884 service nova] Creating event network-changed:162155c8-7e65-4e8e-b899-9cdc9d514287 for instance 4896be18-c24c-4985-a814-256713b0061e on nch2-master-1 Sep 10 21:22:32.157247 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3953727d-6801-43c6-9ae2-b771b8931f5c req-7e2d4170-4086-4e3f-8bb0-59f3d3698884 service nova] Creating event network-changed:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch1-master-1 Sep 10 21:22:32.165363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-3953727d-6801-43c6-9ae2-b771b8931f5c req-7e2d4170-4086-4e3f-8bb0-59f3d3698884 service nova] Instance 51e18921-80df-45ef-881a-9d56499bc7e0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:22:32.182442 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3953727d-6801-43c6-9ae2-b771b8931f5c req-7e2d4170-4086-4e3f-8bb0-59f3d3698884 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063298 Sep 10 21:22:32.183539 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3023/6176] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:22:32.235560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-225f1538-6f68-4211-9c93-07535f2e427f tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:32.236553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-225f1538-6f68-4211-9c93-07535f2e427f tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:32.248477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-225f1538-6f68-4211-9c93-07535f2e427f tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:32.249279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-225f1538-6f68-4211-9c93-07535f2e427f tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:32.249949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-225f1538-6f68-4211-9c93-07535f2e427f tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:32.250880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-225f1538-6f68-4211-9c93-07535f2e427f tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:32.251518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-225f1538-6f68-4211-9c93-07535f2e427f tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:32.252789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-225f1538-6f68-4211-9c93-07535f2e427f tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:32.323835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-344c3f27-9dc1-40d7-84fd-d4a3f6afc209 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:32.324607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-344c3f27-9dc1-40d7-84fd-d4a3f6afc209 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:32.343691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-344c3f27-9dc1-40d7-84fd-d4a3f6afc209 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:32.344540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-344c3f27-9dc1-40d7-84fd-d4a3f6afc209 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:32.345173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-344c3f27-9dc1-40d7-84fd-d4a3f6afc209 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:32.346177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-344c3f27-9dc1-40d7-84fd-d4a3f6afc209 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:32.348569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-344c3f27-9dc1-40d7-84fd-d4a3f6afc209 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:32.349033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-344c3f27-9dc1-40d7-84fd-d4a3f6afc209 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:32.431655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-225f1538-6f68-4211-9c93-07535f2e427f tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:32.446022 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-225f1538-6f68-4211-9c93-07535f2e427f tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1300 microversion: 2.1 time: 0.216916 Sep 10 21:22:32.446637 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3154/6177] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:32 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1300 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:32.623785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-344c3f27-9dc1-40d7-84fd-d4a3f6afc209 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:32.636871 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-344c3f27-9dc1-40d7-84fd-d4a3f6afc209 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1692 microversion: 2.1 time: 0.317549 Sep 10 21:22:32.654853 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3024/6178] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:32 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1692 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:33.468770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f558115d-4483-4729-9289-971bde3ddc10 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:33.470130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f558115d-4483-4729-9289-971bde3ddc10 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:33.477065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f558115d-4483-4729-9289-971bde3ddc10 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:33.477570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f558115d-4483-4729-9289-971bde3ddc10 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:33.478035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f558115d-4483-4729-9289-971bde3ddc10 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:33.478751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f558115d-4483-4729-9289-971bde3ddc10 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:33.479426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f558115d-4483-4729-9289-971bde3ddc10 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:33.479866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f558115d-4483-4729-9289-971bde3ddc10 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:33.616290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f558115d-4483-4729-9289-971bde3ddc10 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:33.625888 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f558115d-4483-4729-9289-971bde3ddc10 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1300 microversion: 2.1 time: 0.161057 Sep 10 21:22:33.626906 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3155/6179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:33 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:33.670713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9e564030-d771-4eaf-9fb6-102aad276771 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:33.671404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9e564030-d771-4eaf-9fb6-102aad276771 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:33.678319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e564030-d771-4eaf-9fb6-102aad276771 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:33.678906 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e564030-d771-4eaf-9fb6-102aad276771 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:33.679417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e564030-d771-4eaf-9fb6-102aad276771 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:33.680223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e564030-d771-4eaf-9fb6-102aad276771 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:33.680757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e564030-d771-4eaf-9fb6-102aad276771 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:33.681247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9e564030-d771-4eaf-9fb6-102aad276771 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:33.712292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:33.886960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9e564030-d771-4eaf-9fb6-102aad276771 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:33.897333 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9e564030-d771-4eaf-9fb6-102aad276771 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1692 microversion: 2.1 time: 0.237291 Sep 10 21:22:33.898083 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3025/6180] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:33 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1692 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:34.649607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f665fa64-21e5-4542-8329-729922a0c90d tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:34.650306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f665fa64-21e5-4542-8329-729922a0c90d tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:34.659493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f665fa64-21e5-4542-8329-729922a0c90d tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:34.660291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f665fa64-21e5-4542-8329-729922a0c90d tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:34.660905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f665fa64-21e5-4542-8329-729922a0c90d tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:34.661795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f665fa64-21e5-4542-8329-729922a0c90d tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:34.662545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f665fa64-21e5-4542-8329-729922a0c90d tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:34.662975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f665fa64-21e5-4542-8329-729922a0c90d tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:34.763985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f665fa64-21e5-4542-8329-729922a0c90d tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:34.768017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=100 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:34.774827 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f665fa64-21e5-4542-8329-729922a0c90d tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1300 microversion: 2.1 time: 0.130053 Sep 10 21:22:34.775584 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3156/6181] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:34 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:34.921714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-251a11e2-867b-44e6-bf8b-9f39d944874e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:34.922738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-251a11e2-867b-44e6-bf8b-9f39d944874e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:34.926842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:34.932984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:34.950444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-251a11e2-867b-44e6-bf8b-9f39d944874e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:34.951074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-251a11e2-867b-44e6-bf8b-9f39d944874e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:34.951733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-251a11e2-867b-44e6-bf8b-9f39d944874e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:34.953248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-251a11e2-867b-44e6-bf8b-9f39d944874e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:34.953733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-251a11e2-867b-44e6-bf8b-9f39d944874e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:34.954793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-251a11e2-867b-44e6-bf8b-9f39d944874e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:35.160825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-251a11e2-867b-44e6-bf8b-9f39d944874e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:35.174000 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-251a11e2-867b-44e6-bf8b-9f39d944874e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1692 microversion: 2.1 time: 0.257045 Sep 10 21:22:35.177049 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3026/6182] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:34 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1692 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:35.803488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-82d93fd9-03f1-4fa2-8035-3c5634ee4c79 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:35.804603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-82d93fd9-03f1-4fa2-8035-3c5634ee4c79 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:35.809005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:35.815498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82d93fd9-03f1-4fa2-8035-3c5634ee4c79 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:35.818169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82d93fd9-03f1-4fa2-8035-3c5634ee4c79 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:35.821188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82d93fd9-03f1-4fa2-8035-3c5634ee4c79 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:35.822150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82d93fd9-03f1-4fa2-8035-3c5634ee4c79 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:35.822737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82d93fd9-03f1-4fa2-8035-3c5634ee4c79 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:35.824472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-82d93fd9-03f1-4fa2-8035-3c5634ee4c79 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:36.172962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-82d93fd9-03f1-4fa2-8035-3c5634ee4c79 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:36.182117 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-82d93fd9-03f1-4fa2-8035-3c5634ee4c79 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1300 microversion: 2.1 time: 0.385419 Sep 10 21:22:36.200161 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3157/6183] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:35 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1300 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:36.202341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dc7aacd4-f5a6-4721-b5df-40755e7589aa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:36.202973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dc7aacd4-f5a6-4721-b5df-40755e7589aa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:36.210958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc7aacd4-f5a6-4721-b5df-40755e7589aa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:36.211651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc7aacd4-f5a6-4721-b5df-40755e7589aa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:36.212240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc7aacd4-f5a6-4721-b5df-40755e7589aa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:36.213202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc7aacd4-f5a6-4721-b5df-40755e7589aa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:36.213987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc7aacd4-f5a6-4721-b5df-40755e7589aa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:36.214560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dc7aacd4-f5a6-4721-b5df-40755e7589aa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:36.387389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dc7aacd4-f5a6-4721-b5df-40755e7589aa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:36.396791 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dc7aacd4-f5a6-4721-b5df-40755e7589aa tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1689 microversion: 2.1 time: 0.198580 Sep 10 21:22:36.397871 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3027/6184] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:36 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1689 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:36.420876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-780c8a1e-6096-4442-b094-d6a14a5d0605 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:36.421428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-780c8a1e-6096-4442-b094-d6a14a5d0605 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:36.427724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-780c8a1e-6096-4442-b094-d6a14a5d0605 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:36.428224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-780c8a1e-6096-4442-b094-d6a14a5d0605 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:36.428672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-780c8a1e-6096-4442-b094-d6a14a5d0605 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:36.429388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-780c8a1e-6096-4442-b094-d6a14a5d0605 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:36.429872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-780c8a1e-6096-4442-b094-d6a14a5d0605 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:36.430318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-780c8a1e-6096-4442-b094-d6a14a5d0605 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:36.554868 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-780c8a1e-6096-4442-b094-d6a14a5d0605 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0/action" status: 202 len: 0 microversion: 2.1 time: 0.138313 Sep 10 21:22:36.555528 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3158/6185] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:22:36 2022] POST /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:22:36.564430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5efcad6d-bc02-4684-bc5c-c0c74da9b974 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:36.565111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5efcad6d-bc02-4684-bc5c-c0c74da9b974 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:36.580443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5efcad6d-bc02-4684-bc5c-c0c74da9b974 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:36.580961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5efcad6d-bc02-4684-bc5c-c0c74da9b974 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:36.581414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5efcad6d-bc02-4684-bc5c-c0c74da9b974 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:36.582194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5efcad6d-bc02-4684-bc5c-c0c74da9b974 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:36.582672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5efcad6d-bc02-4684-bc5c-c0c74da9b974 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:36.583146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5efcad6d-bc02-4684-bc5c-c0c74da9b974 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:36.799184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5efcad6d-bc02-4684-bc5c-c0c74da9b974 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:36.807068 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5efcad6d-bc02-4684-bc5c-c0c74da9b974 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1688 microversion: 2.1 time: 0.247341 Sep 10 21:22:36.807659 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3028/6186] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:36 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:37.208205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1258af90-651e-41d2-bd1b-3b2b8498f74b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:37.209462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1258af90-651e-41d2-bd1b-3b2b8498f74b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:37.218601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1258af90-651e-41d2-bd1b-3b2b8498f74b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:37.219306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1258af90-651e-41d2-bd1b-3b2b8498f74b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:37.219944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1258af90-651e-41d2-bd1b-3b2b8498f74b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:37.221305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1258af90-651e-41d2-bd1b-3b2b8498f74b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:37.221993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1258af90-651e-41d2-bd1b-3b2b8498f74b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:37.222554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1258af90-651e-41d2-bd1b-3b2b8498f74b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:37.250924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1c6a80c9-a11e-45f9-a31c-77041ce4bdad req-8d1a382b-9f0e-49fe-8626-40f8c943a44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4896be18-c24c-4985-a814-256713b0061e", "name": "network-vif-plugged", "status": "completed", "tag": "162155c8-7e65-4e8e-b899-9cdc9d514287"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:37.272767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1c6a80c9-a11e-45f9-a31c-77041ce4bdad req-8d1a382b-9f0e-49fe-8626-40f8c943a44e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:37.278381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1c6a80c9-a11e-45f9-a31c-77041ce4bdad req-8d1a382b-9f0e-49fe-8626-40f8c943a44e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:37.278914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1c6a80c9-a11e-45f9-a31c-77041ce4bdad req-8d1a382b-9f0e-49fe-8626-40f8c943a44e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:37.291454 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1c6a80c9-a11e-45f9-a31c-77041ce4bdad req-8d1a382b-9f0e-49fe-8626-40f8c943a44e service nova] Creating event network-vif-plugged:162155c8-7e65-4e8e-b899-9cdc9d514287 for instance 4896be18-c24c-4985-a814-256713b0061e on nch2-master-1 Sep 10 21:22:37.297981 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1c6a80c9-a11e-45f9-a31c-77041ce4bdad req-8d1a382b-9f0e-49fe-8626-40f8c943a44e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051553 Sep 10 21:22:37.299266 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3029/6187] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:22:37.391627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1258af90-651e-41d2-bd1b-3b2b8498f74b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:37.400848 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1258af90-651e-41d2-bd1b-3b2b8498f74b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1300 microversion: 2.1 time: 0.196837 Sep 10 21:22:37.418026 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3159/6188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:37 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:37.832703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-19cb5d3a-55bb-4818-85a8-c7f1c806cd3c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:37.833551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-19cb5d3a-55bb-4818-85a8-c7f1c806cd3c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:37.839923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19cb5d3a-55bb-4818-85a8-c7f1c806cd3c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:37.840423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19cb5d3a-55bb-4818-85a8-c7f1c806cd3c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:37.840868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19cb5d3a-55bb-4818-85a8-c7f1c806cd3c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:37.842134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19cb5d3a-55bb-4818-85a8-c7f1c806cd3c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:37.842610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19cb5d3a-55bb-4818-85a8-c7f1c806cd3c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:37.843043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-19cb5d3a-55bb-4818-85a8-c7f1c806cd3c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:38.000851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-19cb5d3a-55bb-4818-85a8-c7f1c806cd3c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:38.010503 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-19cb5d3a-55bb-4818-85a8-c7f1c806cd3c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1688 microversion: 2.1 time: 0.182094 Sep 10 21:22:38.012476 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3030/6189] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:37 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:38.429944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c2017989-5c73-499d-b888-a091a3e3c3f2 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:38.430777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c2017989-5c73-499d-b888-a091a3e3c3f2 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:38.441644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2017989-5c73-499d-b888-a091a3e3c3f2 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:38.442580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2017989-5c73-499d-b888-a091a3e3c3f2 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:38.443701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2017989-5c73-499d-b888-a091a3e3c3f2 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:38.445043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2017989-5c73-499d-b888-a091a3e3c3f2 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:38.445685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2017989-5c73-499d-b888-a091a3e3c3f2 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:38.446363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c2017989-5c73-499d-b888-a091a3e3c3f2 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:38.549598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c2017989-5c73-499d-b888-a091a3e3c3f2 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:38.558088 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c2017989-5c73-499d-b888-a091a3e3c3f2 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1300 microversion: 2.1 time: 0.132793 Sep 10 21:22:38.558863 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3160/6190] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:38 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:39.035886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f23c9ffe-76fc-41d8-a4c0-b6ee9b3d140a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:39.036851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f23c9ffe-76fc-41d8-a4c0-b6ee9b3d140a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:39.039874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:39.046509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f23c9ffe-76fc-41d8-a4c0-b6ee9b3d140a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:39.047029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f23c9ffe-76fc-41d8-a4c0-b6ee9b3d140a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:39.047478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f23c9ffe-76fc-41d8-a4c0-b6ee9b3d140a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:39.049248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f23c9ffe-76fc-41d8-a4c0-b6ee9b3d140a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:39.049722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f23c9ffe-76fc-41d8-a4c0-b6ee9b3d140a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:39.050191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f23c9ffe-76fc-41d8-a4c0-b6ee9b3d140a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:39.296514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f23c9ffe-76fc-41d8-a4c0-b6ee9b3d140a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:39.306286 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f23c9ffe-76fc-41d8-a4c0-b6ee9b3d140a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1688 microversion: 2.1 time: 0.274308 Sep 10 21:22:39.315047 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3031/6191] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:39 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1688 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:39.346160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8692f3ff-3956-44e7-b988-24e341a85bb1 req-f677a0c1-cf51-4bfd-8b9e-2a3ad63a693c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "name": "network-vif-plugged", "status": "completed", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:39.351872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=51 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:39.359022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8692f3ff-3956-44e7-b988-24e341a85bb1 req-f677a0c1-cf51-4bfd-8b9e-2a3ad63a693c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:39.359547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8692f3ff-3956-44e7-b988-24e341a85bb1 req-f677a0c1-cf51-4bfd-8b9e-2a3ad63a693c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:39.359981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8692f3ff-3956-44e7-b988-24e341a85bb1 req-f677a0c1-cf51-4bfd-8b9e-2a3ad63a693c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:39.376669 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8692f3ff-3956-44e7-b988-24e341a85bb1 req-f677a0c1-cf51-4bfd-8b9e-2a3ad63a693c service nova] Creating event network-vif-plugged:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch1-master-1 Sep 10 21:22:39.383878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-8692f3ff-3956-44e7-b988-24e341a85bb1 req-f677a0c1-cf51-4bfd-8b9e-2a3ad63a693c service nova] Instance 51e18921-80df-45ef-881a-9d56499bc7e0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:22:39.397904 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8692f3ff-3956-44e7-b988-24e341a85bb1 req-f677a0c1-cf51-4bfd-8b9e-2a3ad63a693c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055360 Sep 10 21:22:39.398706 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3161/6192] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:22:39.589381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10075f9b-45e9-4d54-ac4a-d28e5598682a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:39.590321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10075f9b-45e9-4d54-ac4a-d28e5598682a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:39.600840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10075f9b-45e9-4d54-ac4a-d28e5598682a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:39.602471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10075f9b-45e9-4d54-ac4a-d28e5598682a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:39.603191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10075f9b-45e9-4d54-ac4a-d28e5598682a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:39.604291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10075f9b-45e9-4d54-ac4a-d28e5598682a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:39.605031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10075f9b-45e9-4d54-ac4a-d28e5598682a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:39.606103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10075f9b-45e9-4d54-ac4a-d28e5598682a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:39.810513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10075f9b-45e9-4d54-ac4a-d28e5598682a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:39.819296 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-10075f9b-45e9-4d54-ac4a-d28e5598682a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1473 microversion: 2.1 time: 0.241721 Sep 10 21:22:39.820169 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3032/6193] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:39 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1473 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:22:39.843737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e52d1176-0794-4d15-a4bb-aa182871128b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:39.845338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e52d1176-0794-4d15-a4bb-aa182871128b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:39.854050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e52d1176-0794-4d15-a4bb-aa182871128b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:39.854905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e52d1176-0794-4d15-a4bb-aa182871128b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:39.855360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e52d1176-0794-4d15-a4bb-aa182871128b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:39.856073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e52d1176-0794-4d15-a4bb-aa182871128b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:39.857255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e52d1176-0794-4d15-a4bb-aa182871128b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:39.858166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e52d1176-0794-4d15-a4bb-aa182871128b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:39.997772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e52d1176-0794-4d15-a4bb-aa182871128b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:40.008580 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e52d1176-0794-4d15-a4bb-aa182871128b tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1473 microversion: 2.1 time: 0.169145 Sep 10 21:22:40.010159 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3162/6194] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:39 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1473 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:40.033081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ef37b597-da2a-4360-8bd3-2a5ce67ce4f4 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:40.033867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ef37b597-da2a-4360-8bd3-2a5ce67ce4f4 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:40.041645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef37b597-da2a-4360-8bd3-2a5ce67ce4f4 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:40.042405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef37b597-da2a-4360-8bd3-2a5ce67ce4f4 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:40.043142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef37b597-da2a-4360-8bd3-2a5ce67ce4f4 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:40.043890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef37b597-da2a-4360-8bd3-2a5ce67ce4f4 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:40.044434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef37b597-da2a-4360-8bd3-2a5ce67ce4f4 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:40.044881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ef37b597-da2a-4360-8bd3-2a5ce67ce4f4 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:40.169002 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ef37b597-da2a-4360-8bd3-2a5ce67ce4f4 tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1624 microversion: 2.1 time: 0.140502 Sep 10 21:22:40.170315 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3033/6195] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:40 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1624 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:40.193669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ef0bdf6b-02ca-4617-9eb0-1451b468381c tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:40.194727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ef0bdf6b-02ca-4617-9eb0-1451b468381c tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:40.203296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0bdf6b-02ca-4617-9eb0-1451b468381c tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:40.203913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0bdf6b-02ca-4617-9eb0-1451b468381c tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:40.204416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0bdf6b-02ca-4617-9eb0-1451b468381c tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:40.205139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0bdf6b-02ca-4617-9eb0-1451b468381c tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:40.205599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0bdf6b-02ca-4617-9eb0-1451b468381c tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:40.206054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ef0bdf6b-02ca-4617-9eb0-1451b468381c tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:40.331473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-74656d6c-8981-4f3c-84b6-6399d888f32d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:40.332106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-74656d6c-8981-4f3c-84b6-6399d888f32d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:40.347550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74656d6c-8981-4f3c-84b6-6399d888f32d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:40.350180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74656d6c-8981-4f3c-84b6-6399d888f32d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:40.356522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74656d6c-8981-4f3c-84b6-6399d888f32d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:40.358832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74656d6c-8981-4f3c-84b6-6399d888f32d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:40.361601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74656d6c-8981-4f3c-84b6-6399d888f32d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:40.363524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-74656d6c-8981-4f3c-84b6-6399d888f32d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:40.575317 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ef0bdf6b-02ca-4617-9eb0-1451b468381c tempest-TestSecurityGroupsBasicOps-1160677705 tempest-TestSecurityGroupsBasicOps-1160677705-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1913 microversion: 2.1 time: 0.385711 Sep 10 21:22:40.596223 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3163/6196] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:40 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1913 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:40.639912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-74656d6c-8981-4f3c-84b6-6399d888f32d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:40.651058 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-74656d6c-8981-4f3c-84b6-6399d888f32d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1688 microversion: 2.1 time: 0.322166 Sep 10 21:22:40.657749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d88d9040-d1ed-43cb-a32f-a292c90fed1a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:40.658284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d88d9040-d1ed-43cb-a32f-a292c90fed1a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:40.663554 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3034/6197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:40 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1688 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:40.664504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d88d9040-d1ed-43cb-a32f-a292c90fed1a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:40.665127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d88d9040-d1ed-43cb-a32f-a292c90fed1a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:40.665699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d88d9040-d1ed-43cb-a32f-a292c90fed1a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:40.666543 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d88d9040-d1ed-43cb-a32f-a292c90fed1a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:40.667006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d88d9040-d1ed-43cb-a32f-a292c90fed1a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:40.667432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d88d9040-d1ed-43cb-a32f-a292c90fed1a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:40.695867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d88d9040-d1ed-43cb-a32f-a292c90fed1a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:22:40.846947 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d88d9040-d1ed-43cb-a32f-a292c90fed1a tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 204 len: 0 microversion: 2.1 time: 0.193431 Sep 10 21:22:40.851072 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3164/6198] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:22:40 2022] DELETE /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:22:40.859779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0f928b14-9072-4c21-952e-d3aee7a99e30 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:40.862414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0f928b14-9072-4c21-952e-d3aee7a99e30 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:40.869769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f928b14-9072-4c21-952e-d3aee7a99e30 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:40.870807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f928b14-9072-4c21-952e-d3aee7a99e30 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:40.871460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f928b14-9072-4c21-952e-d3aee7a99e30 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:40.873114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f928b14-9072-4c21-952e-d3aee7a99e30 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:40.874007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f928b14-9072-4c21-952e-d3aee7a99e30 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:40.874562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0f928b14-9072-4c21-952e-d3aee7a99e30 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:41.036084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0f928b14-9072-4c21-952e-d3aee7a99e30 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:41.045512 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0f928b14-9072-4c21-952e-d3aee7a99e30 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1479 microversion: 2.1 time: 0.191707 Sep 10 21:22:41.046670 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3035/6199] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:40 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1479 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:41.100219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-60797c93-9835-4e04-9ec2-751beaaf5f17 req-1e26cd24-9438-4182-9c6a-97f54142b9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "name": "network-vif-unplugged", "status": "completed", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:41.117654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-60797c93-9835-4e04-9ec2-751beaaf5f17 req-1e26cd24-9438-4182-9c6a-97f54142b9c3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:41.118338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-60797c93-9835-4e04-9ec2-751beaaf5f17 req-1e26cd24-9438-4182-9c6a-97f54142b9c3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:41.118926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-60797c93-9835-4e04-9ec2-751beaaf5f17 req-1e26cd24-9438-4182-9c6a-97f54142b9c3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:41.131215 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-60797c93-9835-4e04-9ec2-751beaaf5f17 req-1e26cd24-9438-4182-9c6a-97f54142b9c3 service nova] Creating event network-vif-unplugged:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch2-master-1 Sep 10 21:22:41.136786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-60797c93-9835-4e04-9ec2-751beaaf5f17 req-1e26cd24-9438-4182-9c6a-97f54142b9c3 service nova] Instance 51e18921-80df-45ef-881a-9d56499bc7e0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:22:41.148118 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-60797c93-9835-4e04-9ec2-751beaaf5f17 req-1e26cd24-9438-4182-9c6a-97f54142b9c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052395 Sep 10 21:22:41.148780 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3165/6200] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:22:41.676863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5bbaba84-73fb-4bad-964d-c0be3b12c729 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:41.677560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5bbaba84-73fb-4bad-964d-c0be3b12c729 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:41.683748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bbaba84-73fb-4bad-964d-c0be3b12c729 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:41.684255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bbaba84-73fb-4bad-964d-c0be3b12c729 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:41.684707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bbaba84-73fb-4bad-964d-c0be3b12c729 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:41.685680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bbaba84-73fb-4bad-964d-c0be3b12c729 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:41.686421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bbaba84-73fb-4bad-964d-c0be3b12c729 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:41.687011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5bbaba84-73fb-4bad-964d-c0be3b12c729 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:42.001093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5bbaba84-73fb-4bad-964d-c0be3b12c729 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:42.008957 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5bbaba84-73fb-4bad-964d-c0be3b12c729 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1688 microversion: 2.1 time: 0.336160 Sep 10 21:22:42.009550 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3036/6201] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:41 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1688 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:42.070851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-58d8e92d-e0d0-4297-9ebe-4ba1d536bbae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:42.073041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-58d8e92d-e0d0-4297-9ebe-4ba1d536bbae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:42.080829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58d8e92d-e0d0-4297-9ebe-4ba1d536bbae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:42.082097 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58d8e92d-e0d0-4297-9ebe-4ba1d536bbae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:42.082798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58d8e92d-e0d0-4297-9ebe-4ba1d536bbae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:42.083675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58d8e92d-e0d0-4297-9ebe-4ba1d536bbae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:42.084952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58d8e92d-e0d0-4297-9ebe-4ba1d536bbae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:42.085597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58d8e92d-e0d0-4297-9ebe-4ba1d536bbae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:42.221843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58d8e92d-e0d0-4297-9ebe-4ba1d536bbae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:42.233388 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-58d8e92d-e0d0-4297-9ebe-4ba1d536bbae tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1479 microversion: 2.1 time: 0.166886 Sep 10 21:22:42.234405 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3166/6202] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:42 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1479 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:43.033514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8fba60e-2b16-40a3-b9d2-74dacc6c8367 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:43.034331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8fba60e-2b16-40a3-b9d2-74dacc6c8367 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:43.041442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fba60e-2b16-40a3-b9d2-74dacc6c8367 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:43.041971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fba60e-2b16-40a3-b9d2-74dacc6c8367 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:43.042422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fba60e-2b16-40a3-b9d2-74dacc6c8367 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:43.043435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fba60e-2b16-40a3-b9d2-74dacc6c8367 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:43.043594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fba60e-2b16-40a3-b9d2-74dacc6c8367 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:43.045165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8fba60e-2b16-40a3-b9d2-74dacc6c8367 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:43.192667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-5381805d-d84f-4ed1-838f-c6e40fe58185 req-6ee1ba83-2217-45e6-8c62-749f4baecc67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:43.203636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5381805d-d84f-4ed1-838f-c6e40fe58185 req-6ee1ba83-2217-45e6-8c62-749f4baecc67 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:43.204120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5381805d-d84f-4ed1-838f-c6e40fe58185 req-6ee1ba83-2217-45e6-8c62-749f4baecc67 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:43.204552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5381805d-d84f-4ed1-838f-c6e40fe58185 req-6ee1ba83-2217-45e6-8c62-749f4baecc67 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:43.217456 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-5381805d-d84f-4ed1-838f-c6e40fe58185 req-6ee1ba83-2217-45e6-8c62-749f4baecc67 service nova] Creating event network-changed:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch2-master-1 Sep 10 21:22:43.222915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-5381805d-d84f-4ed1-838f-c6e40fe58185 req-6ee1ba83-2217-45e6-8c62-749f4baecc67 service nova] Instance 51e18921-80df-45ef-881a-9d56499bc7e0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:22:43.235728 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-5381805d-d84f-4ed1-838f-c6e40fe58185 req-6ee1ba83-2217-45e6-8c62-749f4baecc67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046478 Sep 10 21:22:43.236535 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3167/6203] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:22:43.258092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6fed3dc7-98c4-475f-85af-a97288099bdf tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:43.258796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6fed3dc7-98c4-475f-85af-a97288099bdf tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:43.266544 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fed3dc7-98c4-475f-85af-a97288099bdf tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:43.267032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fed3dc7-98c4-475f-85af-a97288099bdf tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:43.267474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fed3dc7-98c4-475f-85af-a97288099bdf tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:43.268179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fed3dc7-98c4-475f-85af-a97288099bdf tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:43.268999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fed3dc7-98c4-475f-85af-a97288099bdf tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:43.269112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6fed3dc7-98c4-475f-85af-a97288099bdf tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:43.334013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8fba60e-2b16-40a3-b9d2-74dacc6c8367 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:43.343507 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8fba60e-2b16-40a3-b9d2-74dacc6c8367 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1688 microversion: 2.1 time: 0.314394 Sep 10 21:22:43.347586 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3037/6204] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:43 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1688 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:43.395225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6fed3dc7-98c4-475f-85af-a97288099bdf tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:43.407104 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6fed3dc7-98c4-475f-85af-a97288099bdf tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1479 microversion: 2.1 time: 0.152228 Sep 10 21:22:43.408343 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3168/6205] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:43 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1479 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:22:43.572803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-830293c3-e720-46b3-ab7f-849bfac48162 req-f422bc3a-7ba8-4f0c-ae21-757a0fb1bfb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4896be18-c24c-4985-a814-256713b0061e", "name": "network-vif-deleted", "tag": "162155c8-7e65-4e8e-b899-9cdc9d514287"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:43.584331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-830293c3-e720-46b3-ab7f-849bfac48162 req-f422bc3a-7ba8-4f0c-ae21-757a0fb1bfb6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:43.584863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-830293c3-e720-46b3-ab7f-849bfac48162 req-f422bc3a-7ba8-4f0c-ae21-757a0fb1bfb6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:43.585481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-830293c3-e720-46b3-ab7f-849bfac48162 req-f422bc3a-7ba8-4f0c-ae21-757a0fb1bfb6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:43.602303 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-830293c3-e720-46b3-ab7f-849bfac48162 req-f422bc3a-7ba8-4f0c-ae21-757a0fb1bfb6 service nova] Creating event network-vif-deleted:162155c8-7e65-4e8e-b899-9cdc9d514287 for instance 4896be18-c24c-4985-a814-256713b0061e on nch2-master-1 Sep 10 21:22:43.609616 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-830293c3-e720-46b3-ab7f-849bfac48162 req-f422bc3a-7ba8-4f0c-ae21-757a0fb1bfb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039946 Sep 10 21:22:43.611011 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3038/6206] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:22:44.367424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5673214d-0b01-4822-833e-e8ba77ce8c13 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:44.368072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5673214d-0b01-4822-833e-e8ba77ce8c13 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:44.375723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5673214d-0b01-4822-833e-e8ba77ce8c13 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:44.376247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5673214d-0b01-4822-833e-e8ba77ce8c13 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:44.376698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5673214d-0b01-4822-833e-e8ba77ce8c13 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:44.377453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5673214d-0b01-4822-833e-e8ba77ce8c13 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:44.378043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5673214d-0b01-4822-833e-e8ba77ce8c13 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:44.378482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5673214d-0b01-4822-833e-e8ba77ce8c13 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:44.431947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:44.432643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:44.440789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:44.441286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:44.441785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:44.442699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:44.443166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:44.443597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:44.515831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:44.516617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:44.517419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:44.518195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lazy-loading 'fault' on Instance uuid 4896be18-c24c-4985-a814-256713b0061e {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:22:44.636175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:44.645931 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-64aa0f1f-a06e-49f4-9562-9f34a4ee8a25 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 200 len: 1332 microversion: 2.1 time: 0.219175 Sep 10 21:22:44.663018 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3039/6207] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:44 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 1332 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:44.714491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5673214d-0b01-4822-833e-e8ba77ce8c13 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:44.730940 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5673214d-0b01-4822-833e-e8ba77ce8c13 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1688 microversion: 2.1 time: 0.364512 Sep 10 21:22:44.740041 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3169/6208] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:44 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1688 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:45.672843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:45.673470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 4896be18-c24c-4985-a814-256713b0061e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:45.684334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:45.684841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:45.685282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:45.686345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:45.687918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:45.688512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:45.722954 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] HTTP exception thrown: Instance 4896be18-c24c-4985-a814-256713b0061e could not be found. Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Request method failure captured: Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e HTTP/1.1 Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP-is2yoOXazzusg2LauQcWC6Nu1F-cBezLRz3RZBhlg0IVsXq9z4hqIPLfDQ8iUSjeRc6ItvFg5vGdf0yXhusiWfe4IL4h4a2CwLdrviDPx2ujMWaue-l5auUTuJh0eRgtj-VdJjR-hzvnm6-z4QH69v5s6JbRVrR_WMyCrSgK23g0 Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 371635a1edd041828749d00c5526197c Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1129996569 Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/371635a1edd041828749d00c5526197c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/371635a1edd041828749d00c5526197c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_371635a1edd041828749d00c5526197c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/371635a1edd041828749d00c5526197c"}]}] Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1129996569 Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 371635a1edd041828749d00c5526197c Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1129996569 Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TestSecurityGroupsBasicOps-1129996569-project Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: f5afa360fc4c40288b65c437519c2a7f Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1129996569-project Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 4896be18-c24c-4985-a814-256713b0061e could not be found. Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '4896be18-c24c-4985-a814-256713b0061e'} Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4896be18-c24c-4985-a814-256713b0061e could not be found. Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4896be18-c24c-4985-a814-256713b0061e could not be found. Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:22:45.725006 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:22:45.728121 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:22:45.728121 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:22:45.728121 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:22:45.728121 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:22:45.728121 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:22:45.728121 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:22:45.728121 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4896be18-c24c-4985-a814-256713b0061e could not be found. Sep 10 21:22:45.728121 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:22:45.729753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Returning 404 to user: Instance 4896be18-c24c-4985-a814-256713b0061e could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:22:45.730836 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8a7fad26-700f-4520-9ad2-50021f433d85 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e" status: 404 len: 111 microversion: 2.1 time: 0.062322 Sep 10 21:22:45.732085 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3040/6209] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:45 2022] GET /compute/v2.1/servers/4896be18-c24c-4985-a814-256713b0061e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:22:45.761008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a707abd2-9e53-4a43-b07f-13ba074979c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:45.762295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a707abd2-9e53-4a43-b07f-13ba074979c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:45.770014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a707abd2-9e53-4a43-b07f-13ba074979c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:45.770796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a707abd2-9e53-4a43-b07f-13ba074979c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:45.771422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a707abd2-9e53-4a43-b07f-13ba074979c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:45.772361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a707abd2-9e53-4a43-b07f-13ba074979c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:45.773003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a707abd2-9e53-4a43-b07f-13ba074979c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:45.773615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a707abd2-9e53-4a43-b07f-13ba074979c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:46.005768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a707abd2-9e53-4a43-b07f-13ba074979c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:46.026190 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a707abd2-9e53-4a43-b07f-13ba074979c8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1681 microversion: 2.1 time: 0.269098 Sep 10 21:22:46.027563 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3170/6210] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:45 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1681 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:49.886083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-42423532-f16b-4b5d-9dc1-1d724c884d12 req-14314679-81e8-439f-84b4-1dffdd40f1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "name": "network-vif-plugged", "status": "completed", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:49.910182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-42423532-f16b-4b5d-9dc1-1d724c884d12 req-14314679-81e8-439f-84b4-1dffdd40f1d7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:49.912291 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-42423532-f16b-4b5d-9dc1-1d724c884d12 req-14314679-81e8-439f-84b4-1dffdd40f1d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:49.915611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-42423532-f16b-4b5d-9dc1-1d724c884d12 req-14314679-81e8-439f-84b4-1dffdd40f1d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:49.948326 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-42423532-f16b-4b5d-9dc1-1d724c884d12 req-14314679-81e8-439f-84b4-1dffdd40f1d7 service nova] Creating event network-vif-plugged:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch2-master-1 Sep 10 21:22:49.960027 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-42423532-f16b-4b5d-9dc1-1d724c884d12 req-14314679-81e8-439f-84b4-1dffdd40f1d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077561 Sep 10 21:22:49.963456 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3041/6211] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:22:51.758318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a411d8af-2fbd-4c23-b4fa-3c160bbddddd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:51.759367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a411d8af-2fbd-4c23-b4fa-3c160bbddddd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:51.766835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d3381c02-1740-4933-8500-490c15e6f3a6 req-9d740ed9-519d-46ae-99c8-05a3102d8419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7145a0-75e0-445e-b567-109c0abf6d1e", "tag": "3134b312-967b-4646-917a-05ec77bd0242"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:51.768168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a411d8af-2fbd-4c23-b4fa-3c160bbddddd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:51.768676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a411d8af-2fbd-4c23-b4fa-3c160bbddddd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:51.769213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a411d8af-2fbd-4c23-b4fa-3c160bbddddd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:51.770147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a411d8af-2fbd-4c23-b4fa-3c160bbddddd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:51.770797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a411d8af-2fbd-4c23-b4fa-3c160bbddddd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:51.771377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a411d8af-2fbd-4c23-b4fa-3c160bbddddd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:51.775007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:22:51.788150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d3381c02-1740-4933-8500-490c15e6f3a6 req-9d740ed9-519d-46ae-99c8-05a3102d8419 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:51.789272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d3381c02-1740-4933-8500-490c15e6f3a6 req-9d740ed9-519d-46ae-99c8-05a3102d8419 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:51.790482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d3381c02-1740-4933-8500-490c15e6f3a6 req-9d740ed9-519d-46ae-99c8-05a3102d8419 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:51.804095 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d3381c02-1740-4933-8500-490c15e6f3a6 req-9d740ed9-519d-46ae-99c8-05a3102d8419 service nova] Creating event network-changed:3134b312-967b-4646-917a-05ec77bd0242 for instance 2d7145a0-75e0-445e-b567-109c0abf6d1e on nch1-master-1 Sep 10 21:22:51.812044 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d3381c02-1740-4933-8500-490c15e6f3a6 req-9d740ed9-519d-46ae-99c8-05a3102d8419 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050121 Sep 10 21:22:51.813949 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3042/6212] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:22:51.820745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a411d8af-2fbd-4c23-b4fa-3c160bbddddd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:22:51.985895 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a411d8af-2fbd-4c23-b4fa-3c160bbddddd tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 204 len: 0 microversion: 2.1 time: 0.231053 Sep 10 21:22:51.986464 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3171/6213] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:22:51 2022] DELETE /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:22:52.000034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0668e18d-2963-4dc1-bac4-8733ae35a350 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:52.001192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0668e18d-2963-4dc1-bac4-8733ae35a350 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:52.013497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0668e18d-2963-4dc1-bac4-8733ae35a350 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:52.017180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0668e18d-2963-4dc1-bac4-8733ae35a350 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:52.019524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0668e18d-2963-4dc1-bac4-8733ae35a350 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:52.022601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0668e18d-2963-4dc1-bac4-8733ae35a350 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:52.024273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0668e18d-2963-4dc1-bac4-8733ae35a350 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:52.024870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0668e18d-2963-4dc1-bac4-8733ae35a350 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:52.359311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0668e18d-2963-4dc1-bac4-8733ae35a350 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:52.371098 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0668e18d-2963-4dc1-bac4-8733ae35a350 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1768 microversion: 2.1 time: 0.379012 Sep 10 21:22:52.375884 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3043/6214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:51 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1768 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:53.395698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6de3fcdd-531a-43f1-a8c0-021ee0ef2080 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:53.396961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6de3fcdd-531a-43f1-a8c0-021ee0ef2080 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:53.404194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de3fcdd-531a-43f1-a8c0-021ee0ef2080 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:53.404869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de3fcdd-531a-43f1-a8c0-021ee0ef2080 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:53.405462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de3fcdd-531a-43f1-a8c0-021ee0ef2080 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:53.406359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de3fcdd-531a-43f1-a8c0-021ee0ef2080 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:53.406965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de3fcdd-531a-43f1-a8c0-021ee0ef2080 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:53.407613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de3fcdd-531a-43f1-a8c0-021ee0ef2080 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:53.639711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6de3fcdd-531a-43f1-a8c0-021ee0ef2080 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:53.648910 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6de3fcdd-531a-43f1-a8c0-021ee0ef2080 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1768 microversion: 2.1 time: 0.257513 Sep 10 21:22:53.649503 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3172/6215] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:53 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1768 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:22:54.289081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d9345e6a-066d-4465-9cf0-d90b2f55829b req-eb2dd4cf-3268-492f-9cea-7be8be325d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7145a0-75e0-445e-b567-109c0abf6d1e", "name": "network-vif-deleted", "tag": "3134b312-967b-4646-917a-05ec77bd0242"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:22:54.310608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d9345e6a-066d-4465-9cf0-d90b2f55829b req-eb2dd4cf-3268-492f-9cea-7be8be325d23 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:54.311507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d9345e6a-066d-4465-9cf0-d90b2f55829b req-eb2dd4cf-3268-492f-9cea-7be8be325d23 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:54.312525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d9345e6a-066d-4465-9cf0-d90b2f55829b req-eb2dd4cf-3268-492f-9cea-7be8be325d23 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:54.327665 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d9345e6a-066d-4465-9cf0-d90b2f55829b req-eb2dd4cf-3268-492f-9cea-7be8be325d23 service nova] Creating event network-vif-deleted:3134b312-967b-4646-917a-05ec77bd0242 for instance 2d7145a0-75e0-445e-b567-109c0abf6d1e on nch1-master-1 Sep 10 21:22:54.337657 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d9345e6a-066d-4465-9cf0-d90b2f55829b req-eb2dd4cf-3268-492f-9cea-7be8be325d23 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049475 Sep 10 21:22:54.338690 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3044/6216] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:22:54.675478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:54.676770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:54.686084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:54.687752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:54.688392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:54.689873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:54.690541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:54.691186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:54.736303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:54.736795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:54.737231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:54.738334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lazy-loading 'fault' on Instance uuid 2d7145a0-75e0-445e-b567-109c0abf6d1e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:22:54.793701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5afa360fc4c40288b65c437519c2a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371635a1edd041828749d00c5526197c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:22:54.816987 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2c6d7089-e003-4f27-9c33-9c36b5b66180 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 200 len: 1385 microversion: 2.1 time: 0.146407 Sep 10 21:22:54.830230 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3173/6217] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:54 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 1385 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:22:55.846854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:22:55.847562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] [instance: 2d7145a0-75e0-445e-b567-109c0abf6d1e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:22:55.853947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:55.854437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:55.854878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:55.855741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:22:55.856205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:22:55.857499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:22:55.872257 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] HTTP exception thrown: Instance 2d7145a0-75e0-445e-b567-109c0abf6d1e could not be found. Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Request method failure captured: Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e HTTP/1.1 Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP-is2yoOXazzusg2LauQcWC6Nu1F-cBezLRz3RZBhlg0IVsXq9z4hqIPLfDQ8iUSjeRc6ItvFg5vGdf0yXhusiWfe4IL4h4a2CwLdrviDPx2ujMWaue-l5auUTuJh0eRgtj-VdJjR-hzvnm6-z4QH69v5s6JbRVrR_WMyCrSgK23g0 Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 371635a1edd041828749d00c5526197c Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1129996569 Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/371635a1edd041828749d00c5526197c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/371635a1edd041828749d00c5526197c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_371635a1edd041828749d00c5526197c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/371635a1edd041828749d00c5526197c"}]}] Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1129996569 Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 371635a1edd041828749d00c5526197c Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1129996569 Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TestSecurityGroupsBasicOps-1129996569-project Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: f5afa360fc4c40288b65c437519c2a7f Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1129996569-project Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 2d7145a0-75e0-445e-b567-109c0abf6d1e could not be found. Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2d7145a0-75e0-445e-b567-109c0abf6d1e'} Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d7145a0-75e0-445e-b567-109c0abf6d1e could not be found. Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d7145a0-75e0-445e-b567-109c0abf6d1e could not be found. Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:22:55.874016 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d7145a0-75e0-445e-b567-109c0abf6d1e could not be found. Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Returning 404 to user: Instance 2d7145a0-75e0-445e-b567-109c0abf6d1e could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b99cd267-0eff-4b25-b63f-299c4157b0db tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e" status: 404 len: 111 microversion: 2.1 time: 0.034565 Sep 10 21:22:55.880623 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3045/6218] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:22:55 2022] GET /compute/v2.1/servers/2d7145a0-75e0-445e-b567-109c0abf6d1e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:22:59.978946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-65b74e65-c58e-4ac1-961a-1a33200b0e01 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] Calling method '.version_select at 0x7f994493bca0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:00.002572 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-65b74e65-c58e-4ac1-961a-1a33200b0e01 tempest-TestSecurityGroupsBasicOps-1129996569 tempest-TestSecurityGroupsBasicOps-1129996569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1810064900" status: 202 len: 0 microversion: 2.1 time: 0.027364 Sep 10 21:23:00.003355 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3174/6219] 10.222.0.33 () {58 vars in 1278 bytes} [Sat Sep 10 21:22:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1810064900 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:23:06.976882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=31 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:06.976882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:07.090164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1800166046", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "822ae7b7-bea1-4422-9050-71a32809c65c"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:07.146093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] validate_networks() for [('822ae7b7-bea1-4422-9050-71a32809c65c', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:23:08.075162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:23:08.075888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:23:08.076255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:23:08.076846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:23:08.077315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:23:08.086507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:08.087001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:08.087450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:08.088192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:08.088828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:08.089263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:08.107897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Getting quotas for project 6f238ca0ce6643da8fcbb2119e9f9424. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:23:08.113513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Getting quotas for user 4236471bb9824793a903f3a872976d42 and project 6f238ca0ce6643da8fcbb2119e9f9424. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:23:08.127062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:23:08.129417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:23:08.176769 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6f645cc9-b27a-4e38-8b9f-0e458cca09e8 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.208609 Sep 10 21:23:08.178384 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3046/6220] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:23:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:23:08.186866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:08.193803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d4af76e5-40f8-4694-911a-f802add0959b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:08.194811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d4af76e5-40f8-4694-911a-f802add0959b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:08.299883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d4af76e5-40f8-4694-911a-f802add0959b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:08.311056 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d4af76e5-40f8-4694-911a-f802add0959b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1215 microversion: 2.1 time: 0.126166 Sep 10 21:23:08.311707 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3175/6221] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:08 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:09.336660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b2a73b0c-0cb1-44d0-a2ff-16ac978645a1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:09.337910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b2a73b0c-0cb1-44d0-a2ff-16ac978645a1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:09.345910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2a73b0c-0cb1-44d0-a2ff-16ac978645a1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:09.346405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2a73b0c-0cb1-44d0-a2ff-16ac978645a1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:09.346849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2a73b0c-0cb1-44d0-a2ff-16ac978645a1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:09.347552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2a73b0c-0cb1-44d0-a2ff-16ac978645a1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:09.348009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2a73b0c-0cb1-44d0-a2ff-16ac978645a1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:09.349120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b2a73b0c-0cb1-44d0-a2ff-16ac978645a1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:09.491267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b2a73b0c-0cb1-44d0-a2ff-16ac978645a1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:09.502563 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b2a73b0c-0cb1-44d0-a2ff-16ac978645a1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1267 microversion: 2.1 time: 0.168479 Sep 10 21:23:09.503565 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3047/6222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:09 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:10.298840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fed1246e-41ac-47da-906d-a3db805e2003 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:10.302601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fed1246e-41ac-47da-906d-a3db805e2003 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:10.308187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:10.314832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fed1246e-41ac-47da-906d-a3db805e2003 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:10.315545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fed1246e-41ac-47da-906d-a3db805e2003 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:10.316279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fed1246e-41ac-47da-906d-a3db805e2003 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:10.317162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fed1246e-41ac-47da-906d-a3db805e2003 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:10.317769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fed1246e-41ac-47da-906d-a3db805e2003 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:10.318454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fed1246e-41ac-47da-906d-a3db805e2003 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:10.382398 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fed1246e-41ac-47da-906d-a3db805e2003 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0/action" status: 200 len: 63210 microversion: 2.1 time: 0.089083 Sep 10 21:23:10.383437 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3176/6223] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:23:10 2022] POST /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0/action => generated 63210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:23:10.526510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1877aaf2-3e5c-48fe-a11f-fd280d85ff3e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:10.527327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1877aaf2-3e5c-48fe-a11f-fd280d85ff3e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:10.538965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1877aaf2-3e5c-48fe-a11f-fd280d85ff3e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:10.539474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1877aaf2-3e5c-48fe-a11f-fd280d85ff3e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:10.539939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1877aaf2-3e5c-48fe-a11f-fd280d85ff3e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:10.540661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1877aaf2-3e5c-48fe-a11f-fd280d85ff3e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:10.541125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1877aaf2-3e5c-48fe-a11f-fd280d85ff3e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:10.541558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1877aaf2-3e5c-48fe-a11f-fd280d85ff3e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:10.839558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1877aaf2-3e5c-48fe-a11f-fd280d85ff3e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:10.847534 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1877aaf2-3e5c-48fe-a11f-fd280d85ff3e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1273 microversion: 2.1 time: 0.325076 Sep 10 21:23:10.848159 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3048/6224] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:10 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:11.871191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-45bb5f35-2086-4207-a7cf-74474df28d2b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:11.872030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-45bb5f35-2086-4207-a7cf-74474df28d2b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:11.891469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45bb5f35-2086-4207-a7cf-74474df28d2b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:11.892085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45bb5f35-2086-4207-a7cf-74474df28d2b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:11.892639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45bb5f35-2086-4207-a7cf-74474df28d2b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:11.895199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45bb5f35-2086-4207-a7cf-74474df28d2b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:11.897077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45bb5f35-2086-4207-a7cf-74474df28d2b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:11.898310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45bb5f35-2086-4207-a7cf-74474df28d2b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:12.022612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-28280eb1-cdb3-4e23-8f79-ddd839689208 req-a09e9dc2-7c77-4389-8726-c2252e796635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f7ff14-c9cf-4c08-9b74-3e305c322b87", "tag": "be622952-af84-4f10-9263-8370989fd5d0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:12.038388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-28280eb1-cdb3-4e23-8f79-ddd839689208 req-a09e9dc2-7c77-4389-8726-c2252e796635 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:12.042808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-28280eb1-cdb3-4e23-8f79-ddd839689208 req-a09e9dc2-7c77-4389-8726-c2252e796635 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:12.049739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-28280eb1-cdb3-4e23-8f79-ddd839689208 req-a09e9dc2-7c77-4389-8726-c2252e796635 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:12.070464 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-28280eb1-cdb3-4e23-8f79-ddd839689208 req-a09e9dc2-7c77-4389-8726-c2252e796635 service nova] Creating event network-changed:be622952-af84-4f10-9263-8370989fd5d0 for instance 74f7ff14-c9cf-4c08-9b74-3e305c322b87 on nch1-master-1 Sep 10 21:23:12.084692 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-28280eb1-cdb3-4e23-8f79-ddd839689208 req-a09e9dc2-7c77-4389-8726-c2252e796635 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066717 Sep 10 21:23:12.085646 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3049/6225] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:23:12.433849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-45bb5f35-2086-4207-a7cf-74474df28d2b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:12.442322 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-45bb5f35-2086-4207-a7cf-74474df28d2b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1315 microversion: 2.1 time: 0.575294 Sep 10 21:23:12.442910 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3177/6226] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:11 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:13.470259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7f225a43-49ed-4bef-9769-83062985a82b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:13.470983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7f225a43-49ed-4bef-9769-83062985a82b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:13.477422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f225a43-49ed-4bef-9769-83062985a82b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:13.478029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f225a43-49ed-4bef-9769-83062985a82b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:13.478459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f225a43-49ed-4bef-9769-83062985a82b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:13.479174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f225a43-49ed-4bef-9769-83062985a82b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:13.479852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f225a43-49ed-4bef-9769-83062985a82b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:13.480293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7f225a43-49ed-4bef-9769-83062985a82b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:13.808581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7f225a43-49ed-4bef-9769-83062985a82b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:13.817994 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7f225a43-49ed-4bef-9769-83062985a82b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1315 microversion: 2.1 time: 0.353660 Sep 10 21:23:13.818883 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3050/6227] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:13 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:14.843017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bf740ad4-6efb-4bae-8b49-b02fca565ae4 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:14.843713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bf740ad4-6efb-4bae-8b49-b02fca565ae4 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:14.851100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf740ad4-6efb-4bae-8b49-b02fca565ae4 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:14.851931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf740ad4-6efb-4bae-8b49-b02fca565ae4 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:14.852413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf740ad4-6efb-4bae-8b49-b02fca565ae4 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:14.853340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf740ad4-6efb-4bae-8b49-b02fca565ae4 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:14.853889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf740ad4-6efb-4bae-8b49-b02fca565ae4 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:14.854547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf740ad4-6efb-4bae-8b49-b02fca565ae4 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:15.022365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bf740ad4-6efb-4bae-8b49-b02fca565ae4 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:15.031064 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bf740ad4-6efb-4bae-8b49-b02fca565ae4 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1315 microversion: 2.1 time: 0.194191 Sep 10 21:23:15.031849 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3178/6228] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:14 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:16.058628 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7fbdb5b4-3e09-4e1a-9eb7-4a84f6a90454 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:16.061080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7fbdb5b4-3e09-4e1a-9eb7-4a84f6a90454 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:16.072558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fbdb5b4-3e09-4e1a-9eb7-4a84f6a90454 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:16.073385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fbdb5b4-3e09-4e1a-9eb7-4a84f6a90454 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:16.075911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fbdb5b4-3e09-4e1a-9eb7-4a84f6a90454 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:16.078286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fbdb5b4-3e09-4e1a-9eb7-4a84f6a90454 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:16.079438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fbdb5b4-3e09-4e1a-9eb7-4a84f6a90454 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:16.080216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7fbdb5b4-3e09-4e1a-9eb7-4a84f6a90454 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:16.356398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7fbdb5b4-3e09-4e1a-9eb7-4a84f6a90454 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:16.365266 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7fbdb5b4-3e09-4e1a-9eb7-4a84f6a90454 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1315 microversion: 2.1 time: 0.313540 Sep 10 21:23:16.381132 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3051/6229] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:16 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:17.050157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-08c5272b-7892-4a01-a2da-39753b8e4e8b tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:17.050780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-08c5272b-7892-4a01-a2da-39753b8e4e8b tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:17.057408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08c5272b-7892-4a01-a2da-39753b8e4e8b tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:17.057927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08c5272b-7892-4a01-a2da-39753b8e4e8b tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:17.058373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08c5272b-7892-4a01-a2da-39753b8e4e8b tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:17.059288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08c5272b-7892-4a01-a2da-39753b8e4e8b tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:17.059835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08c5272b-7892-4a01-a2da-39753b8e4e8b tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:17.060315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-08c5272b-7892-4a01-a2da-39753b8e4e8b tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:17.309452 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-08c5272b-7892-4a01-a2da-39753b8e4e8b tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1832 microversion: 2.1 time: 0.403246 Sep 10 21:23:17.310197 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3179/6230] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:16 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1832 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:17.315835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5229f471-1958-445a-8c40-91a4e1e2f4d5 req-3b4f659e-1c87-4655-89d2-1c9034d93063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f7ff14-c9cf-4c08-9b74-3e305c322b87", "name": "network-vif-plugged", "status": "completed", "tag": "be622952-af84-4f10-9263-8370989fd5d0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:17.331747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5229f471-1958-445a-8c40-91a4e1e2f4d5 req-3b4f659e-1c87-4655-89d2-1c9034d93063 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:17.332466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5229f471-1958-445a-8c40-91a4e1e2f4d5 req-3b4f659e-1c87-4655-89d2-1c9034d93063 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:17.332984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5229f471-1958-445a-8c40-91a4e1e2f4d5 req-3b4f659e-1c87-4655-89d2-1c9034d93063 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:17.348434 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5229f471-1958-445a-8c40-91a4e1e2f4d5 req-3b4f659e-1c87-4655-89d2-1c9034d93063 service nova] Creating event network-vif-plugged:be622952-af84-4f10-9263-8370989fd5d0 for instance 74f7ff14-c9cf-4c08-9b74-3e305c322b87 on nch1-master-1 Sep 10 21:23:17.354416 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5229f471-1958-445a-8c40-91a4e1e2f4d5 req-3b4f659e-1c87-4655-89d2-1c9034d93063 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042058 Sep 10 21:23:17.355189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3052/6231] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:23:17.389631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-31d10797-5baa-4c38-9adc-663c1442e734 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:17.390542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-31d10797-5baa-4c38-9adc-663c1442e734 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:17.396952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31d10797-5baa-4c38-9adc-663c1442e734 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:17.397435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31d10797-5baa-4c38-9adc-663c1442e734 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:17.398096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31d10797-5baa-4c38-9adc-663c1442e734 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:17.398985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31d10797-5baa-4c38-9adc-663c1442e734 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:17.399598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31d10797-5baa-4c38-9adc-663c1442e734 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:17.400607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31d10797-5baa-4c38-9adc-663c1442e734 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:17.938089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31d10797-5baa-4c38-9adc-663c1442e734 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:17.946042 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-31d10797-5baa-4c38-9adc-663c1442e734 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1315 microversion: 2.1 time: 0.561246 Sep 10 21:23:17.946821 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3180/6232] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:17 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:18.498245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:18.499035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:18.505617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70048e40-96a4-4b83-aec4-8f56c654ceb2 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:18.506259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-70048e40-96a4-4b83-aec4-8f56c654ceb2 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:18.520956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-00a4c895-8f9f-46ac-85a2-b849a68aeaec req-0ef0416b-7d51-40a4-b37c-fa9ce3ada13e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:18.521511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70048e40-96a4-4b83-aec4-8f56c654ceb2 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:18.521639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70048e40-96a4-4b83-aec4-8f56c654ceb2 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:18.522117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70048e40-96a4-4b83-aec4-8f56c654ceb2 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:18.523026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70048e40-96a4-4b83-aec4-8f56c654ceb2 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:18.523640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70048e40-96a4-4b83-aec4-8f56c654ceb2 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:18.524233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70048e40-96a4-4b83-aec4-8f56c654ceb2 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:18.527180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:18.546499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-00a4c895-8f9f-46ac-85a2-b849a68aeaec req-0ef0416b-7d51-40a4-b37c-fa9ce3ada13e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:18.546991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-00a4c895-8f9f-46ac-85a2-b849a68aeaec req-0ef0416b-7d51-40a4-b37c-fa9ce3ada13e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:18.547429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-00a4c895-8f9f-46ac-85a2-b849a68aeaec req-0ef0416b-7d51-40a4-b37c-fa9ce3ada13e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:18.559248 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-70048e40-96a4-4b83-aec4-8f56c654ceb2 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:23:18.572247 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-00a4c895-8f9f-46ac-85a2-b849a68aeaec req-0ef0416b-7d51-40a4-b37c-fa9ce3ada13e service nova] Creating event network-changed:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch2-master-1 Sep 10 21:23:18.584419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-00a4c895-8f9f-46ac-85a2-b849a68aeaec req-0ef0416b-7d51-40a4-b37c-fa9ce3ada13e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067317 Sep 10 21:23:18.585053 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3181/6233] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:23:18.691210 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-70048e40-96a4-4b83-aec4-8f56c654ceb2 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "DELETE /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 204 len: 0 microversion: 2.1 time: 0.194399 Sep 10 21:23:18.692275 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3053/6234] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:23:18 2022] DELETE /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:23:18.702939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6cfdde1c-4084-4f2e-9153-bf35e154160a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:18.703979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6cfdde1c-4084-4f2e-9153-bf35e154160a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:18.716882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfdde1c-4084-4f2e-9153-bf35e154160a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:18.717518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfdde1c-4084-4f2e-9153-bf35e154160a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:18.718172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfdde1c-4084-4f2e-9153-bf35e154160a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:18.719274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfdde1c-4084-4f2e-9153-bf35e154160a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:18.720198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfdde1c-4084-4f2e-9153-bf35e154160a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:18.720705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6cfdde1c-4084-4f2e-9153-bf35e154160a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:18.970924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b60e96cb-9fed-4310-af06-07b7171dbce3 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:18.972240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b60e96cb-9fed-4310-af06-07b7171dbce3 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:18.978685 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b60e96cb-9fed-4310-af06-07b7171dbce3 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:18.979972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b60e96cb-9fed-4310-af06-07b7171dbce3 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:18.980530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b60e96cb-9fed-4310-af06-07b7171dbce3 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:18.981401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b60e96cb-9fed-4310-af06-07b7171dbce3 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:18.982157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b60e96cb-9fed-4310-af06-07b7171dbce3 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:18.982694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b60e96cb-9fed-4310-af06-07b7171dbce3 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:19.115310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6cfdde1c-4084-4f2e-9153-bf35e154160a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:19.127145 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6cfdde1c-4084-4f2e-9153-bf35e154160a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1687 microversion: 2.1 time: 0.430213 Sep 10 21:23:19.127914 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3182/6235] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:18 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1687 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:19.203627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b60e96cb-9fed-4310-af06-07b7171dbce3 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:19.221155 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b60e96cb-9fed-4310-af06-07b7171dbce3 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1315 microversion: 2.1 time: 0.254365 Sep 10 21:23:19.225908 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3054/6236] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:18 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:20.154205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d50702b-68a8-49a8-a31e-c8654d2cd61d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:20.155380 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7d50702b-68a8-49a8-a31e-c8654d2cd61d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:20.165301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d50702b-68a8-49a8-a31e-c8654d2cd61d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:20.166053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d50702b-68a8-49a8-a31e-c8654d2cd61d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:20.166688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d50702b-68a8-49a8-a31e-c8654d2cd61d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:20.167574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d50702b-68a8-49a8-a31e-c8654d2cd61d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:20.168045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d50702b-68a8-49a8-a31e-c8654d2cd61d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:20.168648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7d50702b-68a8-49a8-a31e-c8654d2cd61d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:20.256326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-925ad342-1039-462b-8a7a-a657f215ef51 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:20.258107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-925ad342-1039-462b-8a7a-a657f215ef51 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:20.293999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-925ad342-1039-462b-8a7a-a657f215ef51 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:20.294849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-925ad342-1039-462b-8a7a-a657f215ef51 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:20.295520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-925ad342-1039-462b-8a7a-a657f215ef51 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:20.298201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-925ad342-1039-462b-8a7a-a657f215ef51 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:20.299142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-925ad342-1039-462b-8a7a-a657f215ef51 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:20.300134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-925ad342-1039-462b-8a7a-a657f215ef51 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:20.449256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7d50702b-68a8-49a8-a31e-c8654d2cd61d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:20.460030 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7d50702b-68a8-49a8-a31e-c8654d2cd61d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 200 len: 1687 microversion: 2.1 time: 0.312098 Sep 10 21:23:20.461276 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3183/6237] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:20 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 1687 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:20.762425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-adf88c2c-13a0-4f9f-9a69-b018602826ff req-1d448a5a-015a-48da-be30-0d39eaaa0d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e18921-80df-45ef-881a-9d56499bc7e0", "name": "network-vif-deleted", "tag": "bafacac4-2c1a-4bb6-ab8a-7069755e4634"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:20.788436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-925ad342-1039-462b-8a7a-a657f215ef51 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:20.800022 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-925ad342-1039-462b-8a7a-a657f215ef51 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1503 microversion: 2.1 time: 0.559086 Sep 10 21:23:20.801942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-adf88c2c-13a0-4f9f-9a69-b018602826ff req-1d448a5a-015a-48da-be30-0d39eaaa0d46 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:20.804264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-adf88c2c-13a0-4f9f-9a69-b018602826ff req-1d448a5a-015a-48da-be30-0d39eaaa0d46 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:20.805387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-adf88c2c-13a0-4f9f-9a69-b018602826ff req-1d448a5a-015a-48da-be30-0d39eaaa0d46 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:20.809666 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3055/6238] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:20 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1503 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:23:20.834494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d07cf27-4d29-4bb5-83a2-47beccc1a73e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:20.842109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d07cf27-4d29-4bb5-83a2-47beccc1a73e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:20.850541 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-adf88c2c-13a0-4f9f-9a69-b018602826ff req-1d448a5a-015a-48da-be30-0d39eaaa0d46 service nova] Creating event network-vif-deleted:bafacac4-2c1a-4bb6-ab8a-7069755e4634 for instance 51e18921-80df-45ef-881a-9d56499bc7e0 on nch2-master-1 Sep 10 21:23:20.860101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d07cf27-4d29-4bb5-83a2-47beccc1a73e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:20.860364 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-adf88c2c-13a0-4f9f-9a69-b018602826ff req-1d448a5a-015a-48da-be30-0d39eaaa0d46 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102309 Sep 10 21:23:20.860900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d07cf27-4d29-4bb5-83a2-47beccc1a73e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:20.861918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d07cf27-4d29-4bb5-83a2-47beccc1a73e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:20.862206 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3184/6239] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:23:20.864997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d07cf27-4d29-4bb5-83a2-47beccc1a73e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:20.866300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d07cf27-4d29-4bb5-83a2-47beccc1a73e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:20.867026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d07cf27-4d29-4bb5-83a2-47beccc1a73e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:21.038873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9d07cf27-4d29-4bb5-83a2-47beccc1a73e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:21.048407 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d07cf27-4d29-4bb5-83a2-47beccc1a73e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1503 microversion: 2.1 time: 0.219713 Sep 10 21:23:21.049321 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3056/6240] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:20 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:21.072471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7e1c4a35-1ff7-458e-8667-eae0d38f785b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:21.073325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7e1c4a35-1ff7-458e-8667-eae0d38f785b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:21.080553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a35-1ff7-458e-8667-eae0d38f785b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:21.081313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a35-1ff7-458e-8667-eae0d38f785b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:21.081950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a35-1ff7-458e-8667-eae0d38f785b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:21.083006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a35-1ff7-458e-8667-eae0d38f785b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:21.083755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a35-1ff7-458e-8667-eae0d38f785b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:21.084391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a35-1ff7-458e-8667-eae0d38f785b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:21.112577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-7e1c4a35-1ff7-458e-8667-eae0d38f785b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lazy-loading 'flavor' on Instance uuid 74f7ff14-c9cf-4c08-9b74-3e305c322b87 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:23:21.211881 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7e1c4a35-1ff7-458e-8667-eae0d38f785b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "POST /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87/action" status: 202 len: 0 microversion: 2.1 time: 0.143494 Sep 10 21:23:21.212863 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3185/6241] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:23:21 2022] POST /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:23:21.222827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-419990b8-0f13-4181-98e1-607c9d7bce83 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:21.223717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-419990b8-0f13-4181-98e1-607c9d7bce83 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:21.233002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-419990b8-0f13-4181-98e1-607c9d7bce83 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:21.234771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-419990b8-0f13-4181-98e1-607c9d7bce83 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:21.235988 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-419990b8-0f13-4181-98e1-607c9d7bce83 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:21.237199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-419990b8-0f13-4181-98e1-607c9d7bce83 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:21.238267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-419990b8-0f13-4181-98e1-607c9d7bce83 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:21.238982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-419990b8-0f13-4181-98e1-607c9d7bce83 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:21.476985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-419990b8-0f13-4181-98e1-607c9d7bce83 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:21.485622 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-419990b8-0f13-4181-98e1-607c9d7bce83 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1511 microversion: 2.1 time: 0.267860 Sep 10 21:23:21.486698 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3057/6242] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:21 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:21.487124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:21.488039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 51e18921-80df-45ef-881a-9d56499bc7e0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:21.494363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:21.494845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:21.495518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:21.497032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:21.497649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:21.498483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:21.516818 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] HTTP exception thrown: Instance 51e18921-80df-45ef-881a-9d56499bc7e0 could not be found. Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Request method failure captured: Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 HTTP/1.1 Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP8RCbszCTk8Rfb2DQyKNfktIXNNdvFLz2bW8-nP1cDW_GuG2bKFDzDUddVaAIHTvYjEOsCDA-7JIDpvn8pEvREb35AL1k1f2O20PIdcCQ2Iik3pYFuvv0s3gD9GjhTnHn7wYf6z-n27pDMFT_KlhXxfhVuKNFI6JCZRswA-SPtcPt4 Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f4f036f0122f4879aacb1db06eb8b588 Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f036f0122f4879aacb1db06eb8b588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f036f0122f4879aacb1db06eb8b588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4f036f0122f4879aacb1db06eb8b588", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4f036f0122f4879aacb1db06eb8b588"}]}] Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f4f036f0122f4879aacb1db06eb8b588 Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestNetworkAdvancedServerOps-2019920615-project Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: b4791d13ab1c45bf8fabec70191426da Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2019920615-project Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 51e18921-80df-45ef-881a-9d56499bc7e0 could not be found. Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '51e18921-80df-45ef-881a-9d56499bc7e0'} Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e18921-80df-45ef-881a-9d56499bc7e0 could not be found. Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e18921-80df-45ef-881a-9d56499bc7e0 could not be found. Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:23:21.518552 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e18921-80df-45ef-881a-9d56499bc7e0 could not be found. Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Returning 404 to user: Instance 51e18921-80df-45ef-881a-9d56499bc7e0 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bcd95a24-db2f-4b28-84c1-7fe1086b257f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0" status: 404 len: 111 microversion: 2.1 time: 0.037750 Sep 10 21:23:21.522306 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3186/6243] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:21 2022] GET /compute/v2.1/servers/51e18921-80df-45ef-881a-9d56499bc7e0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:23:22.510933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c15980cc-ad69-4cf4-9a11-5890be07fb66 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:22.511627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c15980cc-ad69-4cf4-9a11-5890be07fb66 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:22.520381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c15980cc-ad69-4cf4-9a11-5890be07fb66 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:22.520899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c15980cc-ad69-4cf4-9a11-5890be07fb66 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:22.521353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c15980cc-ad69-4cf4-9a11-5890be07fb66 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:22.522318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c15980cc-ad69-4cf4-9a11-5890be07fb66 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:22.523472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c15980cc-ad69-4cf4-9a11-5890be07fb66 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:22.524068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c15980cc-ad69-4cf4-9a11-5890be07fb66 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:22.688598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c15980cc-ad69-4cf4-9a11-5890be07fb66 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:22.702718 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c15980cc-ad69-4cf4-9a11-5890be07fb66 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1494 microversion: 2.1 time: 0.196018 Sep 10 21:23:22.704308 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3058/6244] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:22 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1494 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:22.727366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c313fb4-f80f-41c5-aefc-a993773eda46 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:22.727921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c313fb4-f80f-41c5-aefc-a993773eda46 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:22.736326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c313fb4-f80f-41c5-aefc-a993773eda46 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:22.736886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c313fb4-f80f-41c5-aefc-a993773eda46 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:22.737336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c313fb4-f80f-41c5-aefc-a993773eda46 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:22.738086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c313fb4-f80f-41c5-aefc-a993773eda46 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:22.738548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c313fb4-f80f-41c5-aefc-a993773eda46 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:22.738986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c313fb4-f80f-41c5-aefc-a993773eda46 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:22.850482 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c313fb4-f80f-41c5-aefc-a993773eda46 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "POST /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87/action" status: 202 len: 0 microversion: 2.1 time: 0.126657 Sep 10 21:23:22.851152 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3187/6245] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:23:22 2022] POST /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:23:22.863004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-00552d06-6fc5-44dc-bb02-e9049ee2749e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:22.864247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-00552d06-6fc5-44dc-bb02-e9049ee2749e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:22.872001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00552d06-6fc5-44dc-bb02-e9049ee2749e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:22.872637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00552d06-6fc5-44dc-bb02-e9049ee2749e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:22.873328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00552d06-6fc5-44dc-bb02-e9049ee2749e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:22.874592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00552d06-6fc5-44dc-bb02-e9049ee2749e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:22.875059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00552d06-6fc5-44dc-bb02-e9049ee2749e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:22.875653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-00552d06-6fc5-44dc-bb02-e9049ee2749e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:23.143087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-00552d06-6fc5-44dc-bb02-e9049ee2749e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:23.154865 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-00552d06-6fc5-44dc-bb02-e9049ee2749e tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1500 microversion: 2.1 time: 0.299142 Sep 10 21:23:23.156419 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3059/6246] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:22 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1500 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:24.179957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bbc89bf2-4695-452f-a123-b2edcd51ce82 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:24.181220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bbc89bf2-4695-452f-a123-b2edcd51ce82 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:24.187998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc89bf2-4695-452f-a123-b2edcd51ce82 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:24.188505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc89bf2-4695-452f-a123-b2edcd51ce82 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:24.188949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc89bf2-4695-452f-a123-b2edcd51ce82 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:24.189667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc89bf2-4695-452f-a123-b2edcd51ce82 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:24.190162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc89bf2-4695-452f-a123-b2edcd51ce82 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:24.190598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bbc89bf2-4695-452f-a123-b2edcd51ce82 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:24.626048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bbc89bf2-4695-452f-a123-b2edcd51ce82 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:24.647712 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bbc89bf2-4695-452f-a123-b2edcd51ce82 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1500 microversion: 2.1 time: 0.472764 Sep 10 21:23:24.663995 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3188/6247] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:24 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1500 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:25.676615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4e970dfe-ff91-4b30-8d3e-1f6000ed926f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:25.677317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4e970dfe-ff91-4b30-8d3e-1f6000ed926f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:25.685132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e970dfe-ff91-4b30-8d3e-1f6000ed926f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:25.685799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e970dfe-ff91-4b30-8d3e-1f6000ed926f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:25.686531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e970dfe-ff91-4b30-8d3e-1f6000ed926f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:25.687360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e970dfe-ff91-4b30-8d3e-1f6000ed926f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:25.688309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e970dfe-ff91-4b30-8d3e-1f6000ed926f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:25.688963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4e970dfe-ff91-4b30-8d3e-1f6000ed926f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:25.868796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4e970dfe-ff91-4b30-8d3e-1f6000ed926f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:25.879635 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4e970dfe-ff91-4b30-8d3e-1f6000ed926f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1503 microversion: 2.1 time: 0.207031 Sep 10 21:23:25.880212 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3060/6248] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:25 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:25.902812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c6a24026-0ea7-41fd-b859-8acc0d5be0f6 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:25.903514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c6a24026-0ea7-41fd-b859-8acc0d5be0f6 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:25.910221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6a24026-0ea7-41fd-b859-8acc0d5be0f6 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:25.910704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6a24026-0ea7-41fd-b859-8acc0d5be0f6 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:25.911140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6a24026-0ea7-41fd-b859-8acc0d5be0f6 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:25.911840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6a24026-0ea7-41fd-b859-8acc0d5be0f6 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:25.912297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6a24026-0ea7-41fd-b859-8acc0d5be0f6 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:25.912900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6a24026-0ea7-41fd-b859-8acc0d5be0f6 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:25.937162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-c6a24026-0ea7-41fd-b859-8acc0d5be0f6 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lazy-loading 'flavor' on Instance uuid 74f7ff14-c9cf-4c08-9b74-3e305c322b87 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:23:26.010554 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c6a24026-0ea7-41fd-b859-8acc0d5be0f6 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "POST /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87/action" status: 202 len: 0 microversion: 2.1 time: 0.111321 Sep 10 21:23:26.016004 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3189/6249] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:23:25 2022] POST /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:23:26.026302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e85022f8-4251-4cf5-b78d-5b25913cfacb tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:26.026936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e85022f8-4251-4cf5-b78d-5b25913cfacb tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:26.038086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e85022f8-4251-4cf5-b78d-5b25913cfacb tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:26.038387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e85022f8-4251-4cf5-b78d-5b25913cfacb tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:26.039101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e85022f8-4251-4cf5-b78d-5b25913cfacb tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:26.039871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e85022f8-4251-4cf5-b78d-5b25913cfacb tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:26.040394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e85022f8-4251-4cf5-b78d-5b25913cfacb tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:26.040836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e85022f8-4251-4cf5-b78d-5b25913cfacb tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:26.199422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e85022f8-4251-4cf5-b78d-5b25913cfacb tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:26.207699 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e85022f8-4251-4cf5-b78d-5b25913cfacb tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1511 microversion: 2.1 time: 0.190382 Sep 10 21:23:26.208751 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3061/6250] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:26 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:27.232466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e1b048aa-8a06-496f-8dd5-660d4157cdd1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:27.233179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e1b048aa-8a06-496f-8dd5-660d4157cdd1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:27.240700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1b048aa-8a06-496f-8dd5-660d4157cdd1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:27.241199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1b048aa-8a06-496f-8dd5-660d4157cdd1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:27.241874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1b048aa-8a06-496f-8dd5-660d4157cdd1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:27.242601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1b048aa-8a06-496f-8dd5-660d4157cdd1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:27.243224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1b048aa-8a06-496f-8dd5-660d4157cdd1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:27.244050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e1b048aa-8a06-496f-8dd5-660d4157cdd1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:27.274032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:27.457200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e1b048aa-8a06-496f-8dd5-660d4157cdd1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:27.468837 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e1b048aa-8a06-496f-8dd5-660d4157cdd1 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1494 microversion: 2.1 time: 0.241673 Sep 10 21:23:27.469438 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3190/6251] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:27 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1494 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:27.493226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b483a25c-4a85-481c-8484-13cce3190861 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:27.493783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b483a25c-4a85-481c-8484-13cce3190861 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:27.501428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b483a25c-4a85-481c-8484-13cce3190861 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:27.501737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b483a25c-4a85-481c-8484-13cce3190861 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:27.502220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b483a25c-4a85-481c-8484-13cce3190861 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:27.503146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b483a25c-4a85-481c-8484-13cce3190861 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:27.503767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b483a25c-4a85-481c-8484-13cce3190861 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:27.504358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b483a25c-4a85-481c-8484-13cce3190861 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:27.543400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:27.613015 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b483a25c-4a85-481c-8484-13cce3190861 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "POST /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87/action" status: 202 len: 0 microversion: 2.1 time: 0.123416 Sep 10 21:23:27.621971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-36fcb9e9-68c5-4bbb-9a03-ee31fbe57de7 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:27.623279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-36fcb9e9-68c5-4bbb-9a03-ee31fbe57de7 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:27.633020 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3062/6252] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:23:27 2022] POST /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:23:27.644422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36fcb9e9-68c5-4bbb-9a03-ee31fbe57de7 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:27.645072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36fcb9e9-68c5-4bbb-9a03-ee31fbe57de7 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:27.645627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36fcb9e9-68c5-4bbb-9a03-ee31fbe57de7 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:27.648065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36fcb9e9-68c5-4bbb-9a03-ee31fbe57de7 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:27.649286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36fcb9e9-68c5-4bbb-9a03-ee31fbe57de7 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:27.650108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36fcb9e9-68c5-4bbb-9a03-ee31fbe57de7 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:27.902375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-36fcb9e9-68c5-4bbb-9a03-ee31fbe57de7 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:27.911517 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-36fcb9e9-68c5-4bbb-9a03-ee31fbe57de7 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1500 microversion: 2.1 time: 0.293617 Sep 10 21:23:27.912446 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3191/6253] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:27 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1500 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:27.934857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-61bcea68-497e-49f0-bfca-b8a69c98ccf9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '.version_select at 0x7f9944bc1a60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:27.972230 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-61bcea68-497e-49f0-bfca-b8a69c98ccf9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1777191468" status: 202 len: 0 microversion: 2.1 time: 0.042569 Sep 10 21:23:27.973003 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3063/6254] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Sep 10 21:23:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1777191468 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:23:28.010111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c6d1ec8c-ab27-4415-8e4a-c8f1967d013f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'create', calling method: .version_select at 0x7f9944086670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-627356151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmmR9c1XDzYVef1xJPoMNN94aln9TV7htW21x+yUhn1hJ7hA6c5nN2NfUR5QdCs3MUzIzu+NIkTU4S8TLwJQOgDYo4oECiLs1YngsfrHkGYDOJUADIPik3R5bBi3YhjSw=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:28.026483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-c6d1ec8c-ab27-4415-8e4a-c8f1967d013f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for project f4f036f0122f4879aacb1db06eb8b588. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:23:28.032385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-c6d1ec8c-ab27-4415-8e4a-c8f1967d013f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for user b4791d13ab1c45bf8fabec70191426da and project f4f036f0122f4879aacb1db06eb8b588. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:23:28.057150 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c6d1ec8c-ab27-4415-8e4a-c8f1967d013f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050974 Sep 10 21:23:28.058418 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3192/6255] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:23:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:23:28.935924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7181d725-b7d5-47a7-bb15-671f6463620f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:28.937473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7181d725-b7d5-47a7-bb15-671f6463620f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:28.948578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7181d725-b7d5-47a7-bb15-671f6463620f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:28.949763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7181d725-b7d5-47a7-bb15-671f6463620f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:28.950663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7181d725-b7d5-47a7-bb15-671f6463620f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:28.951851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7181d725-b7d5-47a7-bb15-671f6463620f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:28.952561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7181d725-b7d5-47a7-bb15-671f6463620f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:28.953190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7181d725-b7d5-47a7-bb15-671f6463620f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:29.179444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7181d725-b7d5-47a7-bb15-671f6463620f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:29.198373 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7181d725-b7d5-47a7-bb15-671f6463620f tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1500 microversion: 2.1 time: 0.267653 Sep 10 21:23:29.198980 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3064/6256] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:28 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1500 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:30.222743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0f3c560d-a4c2-42ff-9d53-828619c99945 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:30.224061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0f3c560d-a4c2-42ff-9d53-828619c99945 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:30.232348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f3c560d-a4c2-42ff-9d53-828619c99945 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:30.232941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f3c560d-a4c2-42ff-9d53-828619c99945 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:30.233459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f3c560d-a4c2-42ff-9d53-828619c99945 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:30.234548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f3c560d-a4c2-42ff-9d53-828619c99945 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:30.235072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f3c560d-a4c2-42ff-9d53-828619c99945 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:30.235654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f3c560d-a4c2-42ff-9d53-828619c99945 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:30.510305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0f3c560d-a4c2-42ff-9d53-828619c99945 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:30.520921 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0f3c560d-a4c2-42ff-9d53-828619c99945 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1503 microversion: 2.1 time: 0.302386 Sep 10 21:23:30.521787 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3193/6257] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:30 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1503 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:30.544399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8cd433b1-71f7-4165-b20b-9d5301e45f5a tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:30.546060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8cd433b1-71f7-4165-b20b-9d5301e45f5a tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:30.553386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cd433b1-71f7-4165-b20b-9d5301e45f5a tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:30.554210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cd433b1-71f7-4165-b20b-9d5301e45f5a tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:30.554805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cd433b1-71f7-4165-b20b-9d5301e45f5a tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:30.555688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cd433b1-71f7-4165-b20b-9d5301e45f5a tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:30.556321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cd433b1-71f7-4165-b20b-9d5301e45f5a tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:30.556755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cd433b1-71f7-4165-b20b-9d5301e45f5a tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:30.584892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8cd433b1-71f7-4165-b20b-9d5301e45f5a tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:23:30.676746 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8cd433b1-71f7-4165-b20b-9d5301e45f5a tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 204 len: 0 microversion: 2.1 time: 0.135960 Sep 10 21:23:30.677695 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3065/6258] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:23:30 2022] DELETE /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:23:30.688802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-74263450-a38a-440f-8ee3-829ef3485b5b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:30.689857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-74263450-a38a-440f-8ee3-829ef3485b5b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:30.696655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74263450-a38a-440f-8ee3-829ef3485b5b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:30.697199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74263450-a38a-440f-8ee3-829ef3485b5b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:30.697943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74263450-a38a-440f-8ee3-829ef3485b5b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:30.698878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74263450-a38a-440f-8ee3-829ef3485b5b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:30.700926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74263450-a38a-440f-8ee3-829ef3485b5b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:30.701612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74263450-a38a-440f-8ee3-829ef3485b5b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:30.914140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-74263450-a38a-440f-8ee3-829ef3485b5b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:30.924129 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-74263450-a38a-440f-8ee3-829ef3485b5b tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1509 microversion: 2.1 time: 0.241509 Sep 10 21:23:30.925215 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3194/6259] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:30 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:23:31.960744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fafe9a01-7ddc-4d5e-877c-1f3f5c38e9d0 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:31.963523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fafe9a01-7ddc-4d5e-877c-1f3f5c38e9d0 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:31.989634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fafe9a01-7ddc-4d5e-877c-1f3f5c38e9d0 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:31.990516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fafe9a01-7ddc-4d5e-877c-1f3f5c38e9d0 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:31.990911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fafe9a01-7ddc-4d5e-877c-1f3f5c38e9d0 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:32.002169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fafe9a01-7ddc-4d5e-877c-1f3f5c38e9d0 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:32.002788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fafe9a01-7ddc-4d5e-877c-1f3f5c38e9d0 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:32.003228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fafe9a01-7ddc-4d5e-877c-1f3f5c38e9d0 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:32.219627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fafe9a01-7ddc-4d5e-877c-1f3f5c38e9d0 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:32.232564 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fafe9a01-7ddc-4d5e-877c-1f3f5c38e9d0 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1509 microversion: 2.1 time: 0.287626 Sep 10 21:23:32.234934 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3066/6260] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:31 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:33.259395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-98b466af-8678-43f1-b6ca-f10e53e48e59 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:33.261246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-98b466af-8678-43f1-b6ca-f10e53e48e59 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:33.279738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98b466af-8678-43f1-b6ca-f10e53e48e59 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:33.280545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98b466af-8678-43f1-b6ca-f10e53e48e59 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:33.282010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98b466af-8678-43f1-b6ca-f10e53e48e59 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:33.283424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98b466af-8678-43f1-b6ca-f10e53e48e59 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:33.285045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98b466af-8678-43f1-b6ca-f10e53e48e59 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:33.286163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-98b466af-8678-43f1-b6ca-f10e53e48e59 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:33.550808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-98b466af-8678-43f1-b6ca-f10e53e48e59 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4236471bb9824793a903f3a872976d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f238ca0ce6643da8fcbb2119e9f9424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:33.559049 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-98b466af-8678-43f1-b6ca-f10e53e48e59 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 200 len: 1509 microversion: 2.1 time: 0.305719 Sep 10 21:23:33.575106 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3195/6261] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:33 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:33.646306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b5813c9f-7bd8-4536-87c1-555a29cd0b5b req-6bcef1a0-dfba-4344-8c6c-c7a4bb76cf15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f7ff14-c9cf-4c08-9b74-3e305c322b87", "name": "network-vif-deleted", "tag": "be622952-af84-4f10-9263-8370989fd5d0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:33.658797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b5813c9f-7bd8-4536-87c1-555a29cd0b5b req-6bcef1a0-dfba-4344-8c6c-c7a4bb76cf15 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:33.660357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b5813c9f-7bd8-4536-87c1-555a29cd0b5b req-6bcef1a0-dfba-4344-8c6c-c7a4bb76cf15 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:33.660987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b5813c9f-7bd8-4536-87c1-555a29cd0b5b req-6bcef1a0-dfba-4344-8c6c-c7a4bb76cf15 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:33.673529 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b5813c9f-7bd8-4536-87c1-555a29cd0b5b req-6bcef1a0-dfba-4344-8c6c-c7a4bb76cf15 service nova] Creating event network-vif-deleted:be622952-af84-4f10-9263-8370989fd5d0 for instance 74f7ff14-c9cf-4c08-9b74-3e305c322b87 on nch1-master-1 Sep 10 21:23:33.679602 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b5813c9f-7bd8-4536-87c1-555a29cd0b5b req-6bcef1a0-dfba-4344-8c6c-c7a4bb76cf15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042792 Sep 10 21:23:33.681094 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3067/6262] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:23:34.583682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:34.584205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] [instance: 74f7ff14-c9cf-4c08-9b74-3e305c322b87] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:34.601723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:34.602485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:34.603080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:34.603984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:34.604767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:34.609220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:34.642087 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] HTTP exception thrown: Instance 74f7ff14-c9cf-4c08-9b74-3e305c322b87 could not be found. Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Request method failure captured: Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 HTTP/1.1 Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQA4b_wdlLZu1j39rXJWN1M4wc2cQ0yE1DNN-7wZKIfxnU661bWVvNjRx_SywEfVoHikJOV4YEVyvPlZZWbESNt7dW8dqunkibdFjptHNbpqcWUfxr6s6q0V8oqK5JO6PhEAA1076k6qYzs4oIXqBKIKCJuhMIBF1RYyW-wBHEE3htk Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 6f238ca0ce6643da8fcbb2119e9f9424 Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestServerAdvancedOps-1532852111 Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6f238ca0ce6643da8fcbb2119e9f9424"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6f238ca0ce6643da8fcbb2119e9f9424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6f238ca0ce6643da8fcbb2119e9f9424", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6f238ca0ce6643da8fcbb2119e9f9424"}]}] Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestServerAdvancedOps-1532852111 Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 6f238ca0ce6643da8fcbb2119e9f9424 Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestServerAdvancedOps-1532852111 Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestServerAdvancedOps-1532852111-project Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4236471bb9824793a903f3a872976d42 Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestServerAdvancedOps-1532852111-project Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 74f7ff14-c9cf-4c08-9b74-3e305c322b87 could not be found. Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '74f7ff14-c9cf-4c08-9b74-3e305c322b87'} Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f7ff14-c9cf-4c08-9b74-3e305c322b87 could not be found. Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f7ff14-c9cf-4c08-9b74-3e305c322b87 could not be found. Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:23:34.643999 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:23:34.649666 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:23:34.649666 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:23:34.649666 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:23:34.649666 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:23:34.649666 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:23:34.649666 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f7ff14-c9cf-4c08-9b74-3e305c322b87 could not be found. Sep 10 21:23:34.649666 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:23:34.651252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] Returning 404 to user: Instance 74f7ff14-c9cf-4c08-9b74-3e305c322b87 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:23:34.652821 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2c7be1fa-67b2-41e7-aa5b-683851bcd548 tempest-TestServerAdvancedOps-1532852111 tempest-TestServerAdvancedOps-1532852111-project] 10.222.0.33 "GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87" status: 404 len: 111 microversion: 2.1 time: 0.072717 Sep 10 21:23:34.664073 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3196/6263] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:34 2022] GET /compute/v2.1/servers/74f7ff14-c9cf-4c08-9b74-3e305c322b87 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:23:36.880091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1376679798", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "a3546721-7600-46c3-b1c5-b6a9ac0eaf95"}], "key_name": "tempest-TestNetworkAdvancedServerOps-627356151", "security_groups": [{"name": "tempest-secgroup-smoke-1114036332"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:37.126109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] validate_networks() for [('a3546721-7600-46c3-b1c5-b6a9ac0eaf95', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:23:37.600665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:37.992429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:23:37.992994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:23:37.994443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:23:37.995397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:23:37.996399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:23:38.011075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:38.012863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:38.013506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:38.014520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:38.015168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:38.015785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:38.048044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for project f4f036f0122f4879aacb1db06eb8b588. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:23:38.056193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for user b4791d13ab1c45bf8fabec70191426da and project f4f036f0122f4879aacb1db06eb8b588. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:23:38.079860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:23:38.084240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:23:38.221788 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-604a6d52-d43c-4ee5-a43e-ea7f980b8435 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.345818 Sep 10 21:23:38.225926 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3068/6264] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:23:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:23:38.239052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e9c86726-2a39-47dc-833d-98260eed257c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:38.239398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e9c86726-2a39-47dc-833d-98260eed257c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:38.242029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:38.353925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e9c86726-2a39-47dc-833d-98260eed257c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:38.367933 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e9c86726-2a39-47dc-833d-98260eed257c tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1266 microversion: 2.1 time: 0.133327 Sep 10 21:23:38.368971 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3197/6265] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:38 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:39.403139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-159d6944-080a-4136-8d41-2f5a1c1f39b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:39.403889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-159d6944-080a-4136-8d41-2f5a1c1f39b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:39.416609 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159d6944-080a-4136-8d41-2f5a1c1f39b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:39.417686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159d6944-080a-4136-8d41-2f5a1c1f39b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:39.418847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159d6944-080a-4136-8d41-2f5a1c1f39b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:39.421690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159d6944-080a-4136-8d41-2f5a1c1f39b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:39.422356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159d6944-080a-4136-8d41-2f5a1c1f39b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:39.424111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-159d6944-080a-4136-8d41-2f5a1c1f39b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:39.528089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-159d6944-080a-4136-8d41-2f5a1c1f39b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:39.536440 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-159d6944-080a-4136-8d41-2f5a1c1f39b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1318 microversion: 2.1 time: 0.142402 Sep 10 21:23:39.546099 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3069/6266] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:39 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:40.565598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cfb5dd60-2999-48ec-b628-efd322bf94b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:40.566198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cfb5dd60-2999-48ec-b628-efd322bf94b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:40.573365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:40.586310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb5dd60-2999-48ec-b628-efd322bf94b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:40.586879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb5dd60-2999-48ec-b628-efd322bf94b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:40.587342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb5dd60-2999-48ec-b628-efd322bf94b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:40.588106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb5dd60-2999-48ec-b628-efd322bf94b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:40.595882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb5dd60-2999-48ec-b628-efd322bf94b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:40.597367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb5dd60-2999-48ec-b628-efd322bf94b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:40.784923 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cfb5dd60-2999-48ec-b628-efd322bf94b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:40.794569 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cfb5dd60-2999-48ec-b628-efd322bf94b4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1324 microversion: 2.1 time: 0.235925 Sep 10 21:23:40.795806 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3198/6267] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:40 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:41.824587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a943d4de-3c33-4195-9eca-c3892dac12c9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:41.842910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a943d4de-3c33-4195-9eca-c3892dac12c9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:41.854312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a943d4de-3c33-4195-9eca-c3892dac12c9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:41.854805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a943d4de-3c33-4195-9eca-c3892dac12c9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:41.855471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a943d4de-3c33-4195-9eca-c3892dac12c9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:41.856333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a943d4de-3c33-4195-9eca-c3892dac12c9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:41.856798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a943d4de-3c33-4195-9eca-c3892dac12c9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:41.857228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a943d4de-3c33-4195-9eca-c3892dac12c9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:42.136536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a943d4de-3c33-4195-9eca-c3892dac12c9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:42.149534 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a943d4de-3c33-4195-9eca-c3892dac12c9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1392 microversion: 2.1 time: 0.330188 Sep 10 21:23:42.150173 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3070/6268] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:41 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1392 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:42.487116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-4e7225c4-6c71-4f78-b01c-abd4b0e83030 req-7cd3cfb5-2476-4f2a-a194-e0ea6d98052c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f710250a-cb3a-446c-bfda-3745ab85163c", "tag": "065c3c6f-0619-480a-b1e3-7eb4e4ea78ea"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:42.509060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4e7225c4-6c71-4f78-b01c-abd4b0e83030 req-7cd3cfb5-2476-4f2a-a194-e0ea6d98052c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:42.510192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4e7225c4-6c71-4f78-b01c-abd4b0e83030 req-7cd3cfb5-2476-4f2a-a194-e0ea6d98052c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:42.511846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-4e7225c4-6c71-4f78-b01c-abd4b0e83030 req-7cd3cfb5-2476-4f2a-a194-e0ea6d98052c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:42.532205 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-4e7225c4-6c71-4f78-b01c-abd4b0e83030 req-7cd3cfb5-2476-4f2a-a194-e0ea6d98052c service nova] Creating event network-changed:065c3c6f-0619-480a-b1e3-7eb4e4ea78ea for instance f710250a-cb3a-446c-bfda-3745ab85163c on nch2-master-1 Sep 10 21:23:42.540948 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-4e7225c4-6c71-4f78-b01c-abd4b0e83030 req-7cd3cfb5-2476-4f2a-a194-e0ea6d98052c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057951 Sep 10 21:23:42.543855 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3199/6269] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:23:43.173563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6efbcbb6-8cd8-4d3c-87b5-745b16668d5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:43.174975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6efbcbb6-8cd8-4d3c-87b5-745b16668d5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:43.182671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6efbcbb6-8cd8-4d3c-87b5-745b16668d5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:43.183824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6efbcbb6-8cd8-4d3c-87b5-745b16668d5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:43.184537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6efbcbb6-8cd8-4d3c-87b5-745b16668d5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:43.185535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6efbcbb6-8cd8-4d3c-87b5-745b16668d5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:43.186300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6efbcbb6-8cd8-4d3c-87b5-745b16668d5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:43.187257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6efbcbb6-8cd8-4d3c-87b5-745b16668d5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:43.559345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6efbcbb6-8cd8-4d3c-87b5-745b16668d5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:43.567222 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6efbcbb6-8cd8-4d3c-87b5-745b16668d5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1392 microversion: 2.1 time: 0.397799 Sep 10 21:23:43.583475 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3071/6270] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:43 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1392 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:23:44.594497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e14fd3b-17ef-4dd2-8cd3-c5290b813c24 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:44.595213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e14fd3b-17ef-4dd2-8cd3-c5290b813c24 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:44.608300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e14fd3b-17ef-4dd2-8cd3-c5290b813c24 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:44.608805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e14fd3b-17ef-4dd2-8cd3-c5290b813c24 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:44.609714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e14fd3b-17ef-4dd2-8cd3-c5290b813c24 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:44.610465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e14fd3b-17ef-4dd2-8cd3-c5290b813c24 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:44.611683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e14fd3b-17ef-4dd2-8cd3-c5290b813c24 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:44.612390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e14fd3b-17ef-4dd2-8cd3-c5290b813c24 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:44.956781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e14fd3b-17ef-4dd2-8cd3-c5290b813c24 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:44.967210 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e14fd3b-17ef-4dd2-8cd3-c5290b813c24 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1392 microversion: 2.1 time: 0.378231 Sep 10 21:23:44.978710 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3200/6271] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:44 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1392 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:45.991820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ee97cb41-b45a-491b-b0d0-93223e783c0f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:45.992757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ee97cb41-b45a-491b-b0d0-93223e783c0f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:46.005011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee97cb41-b45a-491b-b0d0-93223e783c0f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:46.006344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee97cb41-b45a-491b-b0d0-93223e783c0f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:46.012145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee97cb41-b45a-491b-b0d0-93223e783c0f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:46.013274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee97cb41-b45a-491b-b0d0-93223e783c0f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:46.014208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee97cb41-b45a-491b-b0d0-93223e783c0f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:46.014801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee97cb41-b45a-491b-b0d0-93223e783c0f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:46.263537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ee97cb41-b45a-491b-b0d0-93223e783c0f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:46.272607 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ee97cb41-b45a-491b-b0d0-93223e783c0f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1392 microversion: 2.1 time: 0.284597 Sep 10 21:23:46.299127 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3072/6272] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:45 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1392 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:47.297708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9e4464d6-14d1-4859-a2c2-077161ef5d91 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:47.299187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9e4464d6-14d1-4859-a2c2-077161ef5d91 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:47.320960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e4464d6-14d1-4859-a2c2-077161ef5d91 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:47.321844 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e4464d6-14d1-4859-a2c2-077161ef5d91 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:47.322536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e4464d6-14d1-4859-a2c2-077161ef5d91 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:47.324759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e4464d6-14d1-4859-a2c2-077161ef5d91 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:47.326436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e4464d6-14d1-4859-a2c2-077161ef5d91 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:47.327175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e4464d6-14d1-4859-a2c2-077161ef5d91 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:47.517913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9e4464d6-14d1-4859-a2c2-077161ef5d91 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:47.531486 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9e4464d6-14d1-4859-a2c2-077161ef5d91 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1392 microversion: 2.1 time: 0.238282 Sep 10 21:23:47.532466 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3201/6273] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:47 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1392 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:48.556345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fa7d0168-4eed-433a-8183-8451751618b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:48.556874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fa7d0168-4eed-433a-8183-8451751618b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:48.559777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:48.560621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:48.570885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7d0168-4eed-433a-8183-8451751618b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:48.571768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7d0168-4eed-433a-8183-8451751618b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:48.572442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7d0168-4eed-433a-8183-8451751618b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:48.573450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7d0168-4eed-433a-8183-8451751618b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:48.595819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7d0168-4eed-433a-8183-8451751618b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:48.597031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fa7d0168-4eed-433a-8183-8451751618b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:48.907259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fa7d0168-4eed-433a-8183-8451751618b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:48.923412 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fa7d0168-4eed-433a-8183-8451751618b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1392 microversion: 2.1 time: 0.370789 Sep 10 21:23:48.925693 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3073/6274] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:48 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1392 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:49.951877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-13ff1dba-7401-40d7-900d-9f0b5443ee96 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:49.953092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-13ff1dba-7401-40d7-900d-9f0b5443ee96 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:49.959494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:23:49.961788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13ff1dba-7401-40d7-900d-9f0b5443ee96 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:49.962575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13ff1dba-7401-40d7-900d-9f0b5443ee96 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:49.963199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13ff1dba-7401-40d7-900d-9f0b5443ee96 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:49.964666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13ff1dba-7401-40d7-900d-9f0b5443ee96 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:49.965328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13ff1dba-7401-40d7-900d-9f0b5443ee96 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:49.966167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13ff1dba-7401-40d7-900d-9f0b5443ee96 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:50.326957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13ff1dba-7401-40d7-900d-9f0b5443ee96 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:50.342942 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-13ff1dba-7401-40d7-900d-9f0b5443ee96 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1392 microversion: 2.1 time: 0.394953 Sep 10 21:23:50.343354 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3202/6275] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:49 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1392 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:51.381433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5837d87-7a94-4477-8def-654031c1533a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:51.382855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e5837d87-7a94-4477-8def-654031c1533a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:51.392098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5837d87-7a94-4477-8def-654031c1533a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:51.398734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5837d87-7a94-4477-8def-654031c1533a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:51.404005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5837d87-7a94-4477-8def-654031c1533a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:51.405193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5837d87-7a94-4477-8def-654031c1533a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:51.408467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5837d87-7a94-4477-8def-654031c1533a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:51.412477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5837d87-7a94-4477-8def-654031c1533a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:51.879397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-27ec107b-cd74-44b8-873e-14d4fd9c2e6b req-e8134ccf-b172-4b2b-84ba-543e95904da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f710250a-cb3a-446c-bfda-3745ab85163c", "name": "network-vif-plugged", "status": "completed", "tag": "065c3c6f-0619-480a-b1e3-7eb4e4ea78ea"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:23:51.901360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-27ec107b-cd74-44b8-873e-14d4fd9c2e6b req-e8134ccf-b172-4b2b-84ba-543e95904da0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:51.903043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-27ec107b-cd74-44b8-873e-14d4fd9c2e6b req-e8134ccf-b172-4b2b-84ba-543e95904da0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:51.903496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-27ec107b-cd74-44b8-873e-14d4fd9c2e6b req-e8134ccf-b172-4b2b-84ba-543e95904da0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:51.945875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e5837d87-7a94-4477-8def-654031c1533a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:51.962991 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5837d87-7a94-4477-8def-654031c1533a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1392 microversion: 2.1 time: 0.590453 Sep 10 21:23:51.967192 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3074/6276] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:51 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1392 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:51.970454 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-27ec107b-cd74-44b8-873e-14d4fd9c2e6b req-e8134ccf-b172-4b2b-84ba-543e95904da0 service nova] Creating event network-vif-plugged:065c3c6f-0619-480a-b1e3-7eb4e4ea78ea for instance f710250a-cb3a-446c-bfda-3745ab85163c on nch2-master-1 Sep 10 21:23:52.005074 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-27ec107b-cd74-44b8-873e-14d4fd9c2e6b req-e8134ccf-b172-4b2b-84ba-543e95904da0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104266 Sep 10 21:23:52.005799 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3203/6277] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:23:52.994435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-88a84366-23e1-409a-86c9-89d908b39ddd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:52.995279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-88a84366-23e1-409a-86c9-89d908b39ddd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:53.008510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a84366-23e1-409a-86c9-89d908b39ddd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:53.009025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a84366-23e1-409a-86c9-89d908b39ddd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:53.010329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a84366-23e1-409a-86c9-89d908b39ddd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:53.011775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a84366-23e1-409a-86c9-89d908b39ddd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:53.012929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a84366-23e1-409a-86c9-89d908b39ddd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:53.013810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a84366-23e1-409a-86c9-89d908b39ddd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:53.337753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-88a84366-23e1-409a-86c9-89d908b39ddd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:53.348076 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-88a84366-23e1-409a-86c9-89d908b39ddd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1392 microversion: 2.1 time: 0.358885 Sep 10 21:23:53.349646 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3075/6278] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:52 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1392 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:54.374701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-384b069c-a348-4801-a540-38588f33d3ee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:54.375414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-384b069c-a348-4801-a540-38588f33d3ee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:54.388107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384b069c-a348-4801-a540-38588f33d3ee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:54.388617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384b069c-a348-4801-a540-38588f33d3ee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:54.389066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384b069c-a348-4801-a540-38588f33d3ee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:54.389799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384b069c-a348-4801-a540-38588f33d3ee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:54.394933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384b069c-a348-4801-a540-38588f33d3ee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:54.395323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-384b069c-a348-4801-a540-38588f33d3ee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:54.730519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-384b069c-a348-4801-a540-38588f33d3ee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:54.743694 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-384b069c-a348-4801-a540-38588f33d3ee tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1563 microversion: 2.1 time: 0.373389 Sep 10 21:23:54.757855 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3204/6279] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:54 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1563 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:23:54.771543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d822722e-a602-4edf-9e29-0b5f942c2eac tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:23:54.772181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d822722e-a602-4edf-9e29-0b5f942c2eac tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:23:54.785322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d822722e-a602-4edf-9e29-0b5f942c2eac tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:54.785856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d822722e-a602-4edf-9e29-0b5f942c2eac tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:54.787752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d822722e-a602-4edf-9e29-0b5f942c2eac tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:54.789640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d822722e-a602-4edf-9e29-0b5f942c2eac tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:23:54.791153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d822722e-a602-4edf-9e29-0b5f942c2eac tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:23:54.791619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d822722e-a602-4edf-9e29-0b5f942c2eac tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:23:55.690651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d822722e-a602-4edf-9e29-0b5f942c2eac tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:23:55.701735 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d822722e-a602-4edf-9e29-0b5f942c2eac tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1563 microversion: 2.1 time: 0.934552 Sep 10 21:23:55.705857 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3076/6280] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:23:54 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1563 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:24:00.955693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e407933-e3c1-4303-a348-4d604d448834 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:00.957001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e407933-e3c1-4303-a348-4d604d448834 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:00.975421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e407933-e3c1-4303-a348-4d604d448834 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:00.981470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e407933-e3c1-4303-a348-4d604d448834 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:00.983078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e407933-e3c1-4303-a348-4d604d448834 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:00.986497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e407933-e3c1-4303-a348-4d604d448834 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:00.987322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e407933-e3c1-4303-a348-4d604d448834 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:00.988376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e407933-e3c1-4303-a348-4d604d448834 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:01.004219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c0238dd0-f4f0-4cda-ba94-c86436ac4132 req-dcc01cde-6f3f-461e-a9e0-e05b69be0855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f710250a-cb3a-446c-bfda-3745ab85163c", "tag": "065c3c6f-0619-480a-b1e3-7eb4e4ea78ea"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:01.010510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=63 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:24:01.025109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c0238dd0-f4f0-4cda-ba94-c86436ac4132 req-dcc01cde-6f3f-461e-a9e0-e05b69be0855 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:01.033109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c0238dd0-f4f0-4cda-ba94-c86436ac4132 req-dcc01cde-6f3f-461e-a9e0-e05b69be0855 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:01.033913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c0238dd0-f4f0-4cda-ba94-c86436ac4132 req-dcc01cde-6f3f-461e-a9e0-e05b69be0855 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:01.042741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:24:01.074362 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c0238dd0-f4f0-4cda-ba94-c86436ac4132 req-dcc01cde-6f3f-461e-a9e0-e05b69be0855 service nova] Creating event network-changed:065c3c6f-0619-480a-b1e3-7eb4e4ea78ea for instance f710250a-cb3a-446c-bfda-3745ab85163c on nch2-master-1 Sep 10 21:24:01.083699 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c0238dd0-f4f0-4cda-ba94-c86436ac4132 req-dcc01cde-6f3f-461e-a9e0-e05b69be0855 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083626 Sep 10 21:24:01.086095 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3077/6281] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:24:01.361090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e407933-e3c1-4303-a348-4d604d448834 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:01.379386 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e407933-e3c1-4303-a348-4d604d448834 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1563 microversion: 2.1 time: 0.427793 Sep 10 21:24:01.380980 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3205/6282] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:00 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1563 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:04.998518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b0466b1c-c28d-4ec3-bda1-bd5c1fd4c6f1 tempest-TestVolumeBootPattern-856716296 tempest-TestVolumeBootPattern-856716296-project] Action: 'create', calling method: .version_select at 0x7f99494e2e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-674890192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrp8iPNyVRVRpYBYBoGCiXWFf0drghLTvdEmw+TsZ+3EMGYC/s/SNYdIqFwTU8O5FClbMP0Fy364PrXM/uNTTUSGN0QAHKmvwZ6ptTnmCnfPOQe9vf2y/HfiHANh6MWSw=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:05.054561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-b0466b1c-c28d-4ec3-bda1-bd5c1fd4c6f1 tempest-TestVolumeBootPattern-856716296 tempest-TestVolumeBootPattern-856716296-project] Getting quotas for project 9a75b7945f9c4494bfbc75922e8620d3. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:24:05.065416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-b0466b1c-c28d-4ec3-bda1-bd5c1fd4c6f1 tempest-TestVolumeBootPattern-856716296 tempest-TestVolumeBootPattern-856716296-project] Getting quotas for user 24695f4aa38e411a9ac4cc4eb0727839 and project 9a75b7945f9c4494bfbc75922e8620d3. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:24:05.099951 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b0466b1c-c28d-4ec3-bda1-bd5c1fd4c6f1 tempest-TestVolumeBootPattern-856716296 tempest-TestVolumeBootPattern-856716296-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.107300 Sep 10 21:24:05.101433 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3078/6283] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:24:04 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:24:08.659071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4cde19cd-83bd-497f-9e1f-a3a682177e4f tempest-TestVolumeBootPattern-856716296 tempest-TestVolumeBootPattern-856716296-project] Calling method '.version_select at 0x7f993ff2b940>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:08.688649 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4cde19cd-83bd-497f-9e1f-a3a682177e4f tempest-TestVolumeBootPattern-856716296 tempest-TestVolumeBootPattern-856716296-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-674890192" status: 202 len: 0 microversion: 2.1 time: 0.033651 Sep 10 21:24:08.691160 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3206/6284] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Sep 10 21:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-674890192 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:24:19.929590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-aea4d923-a911-4a0e-9da6-755d61c80e60 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:19.931969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-aea4d923-a911-4a0e-9da6-755d61c80e60 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:19.935984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:24:19.936666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:24:19.937277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:24:19.944361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aea4d923-a911-4a0e-9da6-755d61c80e60 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:19.944853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aea4d923-a911-4a0e-9da6-755d61c80e60 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:19.945295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aea4d923-a911-4a0e-9da6-755d61c80e60 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:19.946027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aea4d923-a911-4a0e-9da6-755d61c80e60 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:19.946485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aea4d923-a911-4a0e-9da6-755d61c80e60 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:19.946930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-aea4d923-a911-4a0e-9da6-755d61c80e60 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:20.002855 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-aea4d923-a911-4a0e-9da6-755d61c80e60 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c/action" status: 200 len: 24572 microversion: 2.1 time: 0.077346 Sep 10 21:24:20.003546 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3079/6285] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:24:19 2022] POST /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c/action => generated 24572 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:24:31.067179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6b3403d9-eec0-45e3-aaa6-a188748093a7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:31.068454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6b3403d9-eec0-45e3-aaa6-a188748093a7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:31.073882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=5 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:24:31.074626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:24:31.079126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b3403d9-eec0-45e3-aaa6-a188748093a7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:31.079622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b3403d9-eec0-45e3-aaa6-a188748093a7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:31.080063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b3403d9-eec0-45e3-aaa6-a188748093a7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:31.080775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b3403d9-eec0-45e3-aaa6-a188748093a7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:31.081228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b3403d9-eec0-45e3-aaa6-a188748093a7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:31.081820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b3403d9-eec0-45e3-aaa6-a188748093a7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:31.316400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6b3403d9-eec0-45e3-aaa6-a188748093a7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:31.325131 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6b3403d9-eec0-45e3-aaa6-a188748093a7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1682 microversion: 2.1 time: 0.261719 Sep 10 21:24:31.325737 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3207/6286] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:31 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1682 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:31.442866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-03025690-efa2-48bb-afee-6566c27d1612 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:31.445151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-03025690-efa2-48bb-afee-6566c27d1612 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:31.448921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:24:31.449588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:24:31.455832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03025690-efa2-48bb-afee-6566c27d1612 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:31.456593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03025690-efa2-48bb-afee-6566c27d1612 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:31.457259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03025690-efa2-48bb-afee-6566c27d1612 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:31.458315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03025690-efa2-48bb-afee-6566c27d1612 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:31.458870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03025690-efa2-48bb-afee-6566c27d1612 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:31.459369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03025690-efa2-48bb-afee-6566c27d1612 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:31.521555 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-03025690-efa2-48bb-afee-6566c27d1612 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c/action" status: 200 len: 32643 microversion: 2.1 time: 0.082690 Sep 10 21:24:31.529328 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3080/6287] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:24:31 2022] POST /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c/action => generated 32643 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:24:31.684829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0f50329a-9d45-481d-9af0-22ac482eee75 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:31.685583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0f50329a-9d45-481d-9af0-22ac482eee75 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:31.692505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f50329a-9d45-481d-9af0-22ac482eee75 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:31.693085 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f50329a-9d45-481d-9af0-22ac482eee75 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:31.693588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f50329a-9d45-481d-9af0-22ac482eee75 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:31.694567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f50329a-9d45-481d-9af0-22ac482eee75 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:31.695023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f50329a-9d45-481d-9af0-22ac482eee75 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:31.695609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0f50329a-9d45-481d-9af0-22ac482eee75 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:31.872141 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0f50329a-9d45-481d-9af0-22ac482eee75 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1833 microversion: 2.1 time: 0.192775 Sep 10 21:24:31.873418 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3208/6288] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:31 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1833 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:31.906172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:31.909019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:31.916963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:31.917553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:31.918038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:31.918761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:31.919227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:31.920295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:31.946207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lazy-loading 'flavor' on Instance uuid f710250a-cb3a-446c-bfda-3745ab85163c {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:24:31.959441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Going to try to live migrate instance to another host {{(pid=145771) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 21:24:33.736063 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-987ad5e4-67f2-4a9d-8475-e30d53dc213c tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c/action" status: 202 len: 0 microversion: 2.1 time: 1.834091 Sep 10 21:24:33.737042 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3081/6289] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:24:31 2022] POST /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c/action => generated 0 bytes in 1836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:24:33.746565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3405e43c-683d-4ec0-9f0c-0f0f9f86ef22 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:33.747187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3405e43c-683d-4ec0-9f0c-0f0f9f86ef22 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:33.754213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3405e43c-683d-4ec0-9f0c-0f0f9f86ef22 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:33.754935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3405e43c-683d-4ec0-9f0c-0f0f9f86ef22 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:33.755519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3405e43c-683d-4ec0-9f0c-0f0f9f86ef22 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:33.756583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3405e43c-683d-4ec0-9f0c-0f0f9f86ef22 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:33.757594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3405e43c-683d-4ec0-9f0c-0f0f9f86ef22 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:33.758245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3405e43c-683d-4ec0-9f0c-0f0f9f86ef22 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:34.035545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3405e43c-683d-4ec0-9f0c-0f0f9f86ef22 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:34.046582 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3405e43c-683d-4ec0-9f0c-0f0f9f86ef22 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1692 microversion: 2.1 time: 0.304380 Sep 10 21:24:34.047210 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3209/6290] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:33 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1692 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:35.071699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ba2b4a8f-d21f-4a1e-bd73-b1b19f68ec23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:35.072888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ba2b4a8f-d21f-4a1e-bd73-b1b19f68ec23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:35.083726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba2b4a8f-d21f-4a1e-bd73-b1b19f68ec23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:35.087505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba2b4a8f-d21f-4a1e-bd73-b1b19f68ec23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:35.090055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba2b4a8f-d21f-4a1e-bd73-b1b19f68ec23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:35.093402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba2b4a8f-d21f-4a1e-bd73-b1b19f68ec23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:35.094191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba2b4a8f-d21f-4a1e-bd73-b1b19f68ec23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:35.094835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba2b4a8f-d21f-4a1e-bd73-b1b19f68ec23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:35.471690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-44b5d4ce-6f58-42b7-bb53-1602c6549493 req-05a0f0c0-3fb5-461c-b17c-852c94a2d6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f710250a-cb3a-446c-bfda-3745ab85163c", "name": "network-vif-unplugged", "status": "completed", "tag": "065c3c6f-0619-480a-b1e3-7eb4e4ea78ea"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:35.489303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-44b5d4ce-6f58-42b7-bb53-1602c6549493 req-05a0f0c0-3fb5-461c-b17c-852c94a2d6c6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:35.489803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-44b5d4ce-6f58-42b7-bb53-1602c6549493 req-05a0f0c0-3fb5-461c-b17c-852c94a2d6c6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:35.490466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-44b5d4ce-6f58-42b7-bb53-1602c6549493 req-05a0f0c0-3fb5-461c-b17c-852c94a2d6c6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:35.515346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ba2b4a8f-d21f-4a1e-bd73-b1b19f68ec23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:35.537440 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ba2b4a8f-d21f-4a1e-bd73-b1b19f68ec23 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1692 microversion: 2.1 time: 0.469753 Sep 10 21:24:35.538419 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3082/6291] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:35 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1692 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:35.539370 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-44b5d4ce-6f58-42b7-bb53-1602c6549493 req-05a0f0c0-3fb5-461c-b17c-852c94a2d6c6 service nova] Creating event network-vif-unplugged:065c3c6f-0619-480a-b1e3-7eb4e4ea78ea for instance f710250a-cb3a-446c-bfda-3745ab85163c on nch2-master-1 Sep 10 21:24:35.552435 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-44b5d4ce-6f58-42b7-bb53-1602c6549493 req-05a0f0c0-3fb5-461c-b17c-852c94a2d6c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.380868 Sep 10 21:24:35.554963 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3210/6292] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:24:36.562108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a0409572-24c7-4e00-89f3-988771a6a626 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:36.562759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a0409572-24c7-4e00-89f3-988771a6a626 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:36.570254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0409572-24c7-4e00-89f3-988771a6a626 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:36.570751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0409572-24c7-4e00-89f3-988771a6a626 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:36.571199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0409572-24c7-4e00-89f3-988771a6a626 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:36.571914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0409572-24c7-4e00-89f3-988771a6a626 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:36.572884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0409572-24c7-4e00-89f3-988771a6a626 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:36.573321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0409572-24c7-4e00-89f3-988771a6a626 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:36.804390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a0409572-24c7-4e00-89f3-988771a6a626 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:36.812590 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a0409572-24c7-4e00-89f3-988771a6a626 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1692 microversion: 2.1 time: 0.254447 Sep 10 21:24:36.813415 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3083/6293] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:36 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1692 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:37.622423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8b325d72-e46a-43eb-beef-a6d7f8ea851e req-a8f4f319-7a9a-4b7f-ad3e-db80d6573752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f710250a-cb3a-446c-bfda-3745ab85163c", "tag": "065c3c6f-0619-480a-b1e3-7eb4e4ea78ea"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:37.634336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8b325d72-e46a-43eb-beef-a6d7f8ea851e req-a8f4f319-7a9a-4b7f-ad3e-db80d6573752 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:37.635672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8b325d72-e46a-43eb-beef-a6d7f8ea851e req-a8f4f319-7a9a-4b7f-ad3e-db80d6573752 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:37.636271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8b325d72-e46a-43eb-beef-a6d7f8ea851e req-a8f4f319-7a9a-4b7f-ad3e-db80d6573752 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:37.652687 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8b325d72-e46a-43eb-beef-a6d7f8ea851e req-a8f4f319-7a9a-4b7f-ad3e-db80d6573752 service nova] Creating event network-changed:065c3c6f-0619-480a-b1e3-7eb4e4ea78ea for instance f710250a-cb3a-446c-bfda-3745ab85163c on nch2-master-1 Sep 10 21:24:37.659572 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8b325d72-e46a-43eb-beef-a6d7f8ea851e req-a8f4f319-7a9a-4b7f-ad3e-db80d6573752 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053190 Sep 10 21:24:37.662830 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3211/6294] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:24:37.838073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2c4c66a3-0827-4fdb-b56c-fc506014d848 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:37.839750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2c4c66a3-0827-4fdb-b56c-fc506014d848 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:37.847393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c4c66a3-0827-4fdb-b56c-fc506014d848 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:37.847987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c4c66a3-0827-4fdb-b56c-fc506014d848 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:37.848499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c4c66a3-0827-4fdb-b56c-fc506014d848 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:37.849283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c4c66a3-0827-4fdb-b56c-fc506014d848 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:37.849864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c4c66a3-0827-4fdb-b56c-fc506014d848 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:37.850367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2c4c66a3-0827-4fdb-b56c-fc506014d848 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:38.190870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2c4c66a3-0827-4fdb-b56c-fc506014d848 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:38.200667 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2c4c66a3-0827-4fdb-b56c-fc506014d848 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1692 microversion: 2.1 time: 0.366875 Sep 10 21:24:38.201364 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3084/6295] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:37 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1692 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:39.226395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b76899fb-93b9-4110-9acc-df02a9d316b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:39.227072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b76899fb-93b9-4110-9acc-df02a9d316b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:39.235468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b76899fb-93b9-4110-9acc-df02a9d316b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:39.236222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b76899fb-93b9-4110-9acc-df02a9d316b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:39.236675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b76899fb-93b9-4110-9acc-df02a9d316b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:39.237399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b76899fb-93b9-4110-9acc-df02a9d316b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:39.238059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b76899fb-93b9-4110-9acc-df02a9d316b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:39.238497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b76899fb-93b9-4110-9acc-df02a9d316b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:39.471881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b76899fb-93b9-4110-9acc-df02a9d316b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:39.480757 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b76899fb-93b9-4110-9acc-df02a9d316b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1692 microversion: 2.1 time: 0.259802 Sep 10 21:24:39.481803 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3212/6296] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:39 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1692 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:40.506064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-21f77f8f-2c2c-48c1-8437-11679d216970 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:40.507282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-21f77f8f-2c2c-48c1-8437-11679d216970 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:40.514871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21f77f8f-2c2c-48c1-8437-11679d216970 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:40.515622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21f77f8f-2c2c-48c1-8437-11679d216970 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:40.516340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21f77f8f-2c2c-48c1-8437-11679d216970 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:40.517221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21f77f8f-2c2c-48c1-8437-11679d216970 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:40.517874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21f77f8f-2c2c-48c1-8437-11679d216970 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:40.518327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-21f77f8f-2c2c-48c1-8437-11679d216970 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:40.686728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-21f77f8f-2c2c-48c1-8437-11679d216970 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:40.696194 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-21f77f8f-2c2c-48c1-8437-11679d216970 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1692 microversion: 2.1 time: 0.194565 Sep 10 21:24:40.697543 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3085/6297] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:40 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1692 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:41.720473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a2a17803-8c22-4a12-8e59-19f20bf4a311 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:41.721095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a2a17803-8c22-4a12-8e59-19f20bf4a311 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:41.728632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a17803-8c22-4a12-8e59-19f20bf4a311 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:41.729244 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a17803-8c22-4a12-8e59-19f20bf4a311 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:41.729915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a17803-8c22-4a12-8e59-19f20bf4a311 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:41.730808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a17803-8c22-4a12-8e59-19f20bf4a311 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:41.731282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a17803-8c22-4a12-8e59-19f20bf4a311 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:41.731745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a17803-8c22-4a12-8e59-19f20bf4a311 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:41.937452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a2a17803-8c22-4a12-8e59-19f20bf4a311 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:41.949689 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a2a17803-8c22-4a12-8e59-19f20bf4a311 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1692 microversion: 2.1 time: 0.233052 Sep 10 21:24:41.967756 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3213/6298] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:41 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1692 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:42.977197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-44606137-f121-4a02-a2e0-2e8fb2545cc1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:42.977903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-44606137-f121-4a02-a2e0-2e8fb2545cc1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:42.985681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44606137-f121-4a02-a2e0-2e8fb2545cc1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:42.986854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44606137-f121-4a02-a2e0-2e8fb2545cc1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:42.987495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44606137-f121-4a02-a2e0-2e8fb2545cc1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:42.988590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44606137-f121-4a02-a2e0-2e8fb2545cc1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:42.989235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44606137-f121-4a02-a2e0-2e8fb2545cc1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:42.989855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44606137-f121-4a02-a2e0-2e8fb2545cc1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:43.188696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-44606137-f121-4a02-a2e0-2e8fb2545cc1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:43.199668 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-44606137-f121-4a02-a2e0-2e8fb2545cc1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1692 microversion: 2.1 time: 0.226846 Sep 10 21:24:43.200904 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3086/6299] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:42 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1692 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:44.228868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3fc4b67e-1bc9-4ff9-9ef3-48bc5f97d95e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:44.229662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3fc4b67e-1bc9-4ff9-9ef3-48bc5f97d95e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:44.237327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc4b67e-1bc9-4ff9-9ef3-48bc5f97d95e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:44.238403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc4b67e-1bc9-4ff9-9ef3-48bc5f97d95e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:44.238973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc4b67e-1bc9-4ff9-9ef3-48bc5f97d95e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:44.239952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc4b67e-1bc9-4ff9-9ef3-48bc5f97d95e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:44.240627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc4b67e-1bc9-4ff9-9ef3-48bc5f97d95e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:44.241148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fc4b67e-1bc9-4ff9-9ef3-48bc5f97d95e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:44.520631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3fc4b67e-1bc9-4ff9-9ef3-48bc5f97d95e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:44.529184 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3fc4b67e-1bc9-4ff9-9ef3-48bc5f97d95e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1692 microversion: 2.1 time: 0.304882 Sep 10 21:24:44.529772 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3214/6300] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:44 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1692 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:45.559104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6ef6b1ae-a509-434c-b9f3-c562fc28ce0e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:45.560436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6ef6b1ae-a509-434c-b9f3-c562fc28ce0e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:45.567799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef6b1ae-a509-434c-b9f3-c562fc28ce0e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:45.568478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef6b1ae-a509-434c-b9f3-c562fc28ce0e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:45.569111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef6b1ae-a509-434c-b9f3-c562fc28ce0e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:45.570026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef6b1ae-a509-434c-b9f3-c562fc28ce0e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:45.570495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef6b1ae-a509-434c-b9f3-c562fc28ce0e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:45.571085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ef6b1ae-a509-434c-b9f3-c562fc28ce0e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:45.867805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6ef6b1ae-a509-434c-b9f3-c562fc28ce0e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:45.877364 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6ef6b1ae-a509-434c-b9f3-c562fc28ce0e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1692 microversion: 2.1 time: 0.322169 Sep 10 21:24:45.878293 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3087/6301] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:45 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1692 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:46.903655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-36633c5a-9439-4d74-8772-16c7f4e35a0b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:46.904338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-36633c5a-9439-4d74-8772-16c7f4e35a0b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:46.911367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36633c5a-9439-4d74-8772-16c7f4e35a0b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:46.911859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36633c5a-9439-4d74-8772-16c7f4e35a0b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:46.912300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36633c5a-9439-4d74-8772-16c7f4e35a0b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:46.912990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36633c5a-9439-4d74-8772-16c7f4e35a0b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:46.913441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36633c5a-9439-4d74-8772-16c7f4e35a0b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:46.913884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-36633c5a-9439-4d74-8772-16c7f4e35a0b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:47.070045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-36633c5a-9439-4d74-8772-16c7f4e35a0b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:47.079324 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-36633c5a-9439-4d74-8772-16c7f4e35a0b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1682 microversion: 2.1 time: 0.180522 Sep 10 21:24:47.079958 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3215/6302] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:46 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:24:47.107650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-96ef3f57-f606-4f97-886c-eb15ee43e8b5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:47.108840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-96ef3f57-f606-4f97-886c-eb15ee43e8b5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:47.117588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96ef3f57-f606-4f97-886c-eb15ee43e8b5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:47.118365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96ef3f57-f606-4f97-886c-eb15ee43e8b5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:47.119709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96ef3f57-f606-4f97-886c-eb15ee43e8b5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:47.120612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96ef3f57-f606-4f97-886c-eb15ee43e8b5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:47.121226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96ef3f57-f606-4f97-886c-eb15ee43e8b5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:47.121813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96ef3f57-f606-4f97-886c-eb15ee43e8b5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:47.356473 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-96ef3f57-f606-4f97-886c-eb15ee43e8b5 tempest-TestNetworkAdvancedServerOps-1309670099 tempest-TestNetworkAdvancedServerOps-1309670099-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1833 microversion: 2.1 time: 0.253089 Sep 10 21:24:47.357225 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3088/6303] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:47 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1833 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:24:47.380762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b95142da-43f7-46cf-b5eb-a81153c2e013 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:47.382435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b95142da-43f7-46cf-b5eb-a81153c2e013 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:47.389033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b95142da-43f7-46cf-b5eb-a81153c2e013 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:47.389516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b95142da-43f7-46cf-b5eb-a81153c2e013 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:47.389991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b95142da-43f7-46cf-b5eb-a81153c2e013 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:47.390696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b95142da-43f7-46cf-b5eb-a81153c2e013 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:47.391152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b95142da-43f7-46cf-b5eb-a81153c2e013 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:47.391582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b95142da-43f7-46cf-b5eb-a81153c2e013 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:47.532765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b95142da-43f7-46cf-b5eb-a81153c2e013 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:47.546213 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b95142da-43f7-46cf-b5eb-a81153c2e013 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1682 microversion: 2.1 time: 0.169051 Sep 10 21:24:47.546753 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3216/6304] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:47 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:47.648347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0d98ec30-df48-4bbc-9c48-3daeb7f9416f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:47.651644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0d98ec30-df48-4bbc-9c48-3daeb7f9416f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:47.658893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d98ec30-df48-4bbc-9c48-3daeb7f9416f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:47.659478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d98ec30-df48-4bbc-9c48-3daeb7f9416f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:47.659949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d98ec30-df48-4bbc-9c48-3daeb7f9416f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:47.660698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d98ec30-df48-4bbc-9c48-3daeb7f9416f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:47.661165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d98ec30-df48-4bbc-9c48-3daeb7f9416f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:47.661603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0d98ec30-df48-4bbc-9c48-3daeb7f9416f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:47.732850 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0d98ec30-df48-4bbc-9c48-3daeb7f9416f tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c/action" status: 200 len: 38621 microversion: 2.1 time: 0.087543 Sep 10 21:24:47.737867 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3089/6305] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:24:47 2022] POST /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c/action => generated 38621 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:24:48.747551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-26823dcd-4967-4aa4-8b1a-c065660117b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:48.748810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e644bc0c-ea78-4f6b-a52b-299ab40e9a8a req-6f1d2fe7-b742-4384-9e31-997c482a9bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f710250a-cb3a-446c-bfda-3745ab85163c", "tag": "065c3c6f-0619-480a-b1e3-7eb4e4ea78ea"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:48.749215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-26823dcd-4967-4aa4-8b1a-c065660117b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:48.763159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e644bc0c-ea78-4f6b-a52b-299ab40e9a8a req-6f1d2fe7-b742-4384-9e31-997c482a9bb1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:48.764087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e644bc0c-ea78-4f6b-a52b-299ab40e9a8a req-6f1d2fe7-b742-4384-9e31-997c482a9bb1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:48.764729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e644bc0c-ea78-4f6b-a52b-299ab40e9a8a req-6f1d2fe7-b742-4384-9e31-997c482a9bb1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:48.765253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26823dcd-4967-4aa4-8b1a-c065660117b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:48.771590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26823dcd-4967-4aa4-8b1a-c065660117b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:48.771590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26823dcd-4967-4aa4-8b1a-c065660117b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:48.771590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26823dcd-4967-4aa4-8b1a-c065660117b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:48.771590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26823dcd-4967-4aa4-8b1a-c065660117b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:48.771590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26823dcd-4967-4aa4-8b1a-c065660117b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:48.786211 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e644bc0c-ea78-4f6b-a52b-299ab40e9a8a req-6f1d2fe7-b742-4384-9e31-997c482a9bb1 service nova] Creating event network-changed:065c3c6f-0619-480a-b1e3-7eb4e4ea78ea for instance f710250a-cb3a-446c-bfda-3745ab85163c on nch1-master-1 Sep 10 21:24:48.792220 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e644bc0c-ea78-4f6b-a52b-299ab40e9a8a req-6f1d2fe7-b742-4384-9e31-997c482a9bb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048288 Sep 10 21:24:48.793756 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3090/6306] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:24:48.806264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-26823dcd-4967-4aa4-8b1a-c065660117b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:24:48.912374 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-26823dcd-4967-4aa4-8b1a-c065660117b0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 204 len: 0 microversion: 2.1 time: 0.170568 Sep 10 21:24:48.913446 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3217/6307] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:24:48 2022] DELETE /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:24:48.923140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-53fd6309-9c78-4a42-8577-f095ef0ecbb9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:48.924205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-53fd6309-9c78-4a42-8577-f095ef0ecbb9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:48.932471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53fd6309-9c78-4a42-8577-f095ef0ecbb9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:48.933069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53fd6309-9c78-4a42-8577-f095ef0ecbb9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:48.933596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53fd6309-9c78-4a42-8577-f095ef0ecbb9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:48.934537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53fd6309-9c78-4a42-8577-f095ef0ecbb9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:48.935081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53fd6309-9c78-4a42-8577-f095ef0ecbb9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:48.935634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-53fd6309-9c78-4a42-8577-f095ef0ecbb9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:49.223443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-53fd6309-9c78-4a42-8577-f095ef0ecbb9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:49.231944 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-53fd6309-9c78-4a42-8577-f095ef0ecbb9 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1688 microversion: 2.1 time: 0.313954 Sep 10 21:24:49.235475 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3091/6308] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:48 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1688 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:50.244093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c1625a51-6a4c-4922-b45f-c7e49773261e req-ebf5924b-1da3-42c8-9fdb-e437d67a4d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f710250a-cb3a-446c-bfda-3745ab85163c", "name": "network-vif-deleted", "tag": "065c3c6f-0619-480a-b1e3-7eb4e4ea78ea"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:50.255904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c1625a51-6a4c-4922-b45f-c7e49773261e req-ebf5924b-1da3-42c8-9fdb-e437d67a4d69 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:50.261692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fd61b9d6-831b-4ea8-a744-9ce563da5a7d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:50.262356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fd61b9d6-831b-4ea8-a744-9ce563da5a7d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:50.262581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c1625a51-6a4c-4922-b45f-c7e49773261e req-ebf5924b-1da3-42c8-9fdb-e437d67a4d69 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:50.263038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c1625a51-6a4c-4922-b45f-c7e49773261e req-ebf5924b-1da3-42c8-9fdb-e437d67a4d69 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:50.270899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd61b9d6-831b-4ea8-a744-9ce563da5a7d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:50.271887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd61b9d6-831b-4ea8-a744-9ce563da5a7d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:50.272802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd61b9d6-831b-4ea8-a744-9ce563da5a7d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:50.273786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd61b9d6-831b-4ea8-a744-9ce563da5a7d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:50.274346 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c1625a51-6a4c-4922-b45f-c7e49773261e req-ebf5924b-1da3-42c8-9fdb-e437d67a4d69 service nova] Creating event network-vif-deleted:065c3c6f-0619-480a-b1e3-7eb4e4ea78ea for instance f710250a-cb3a-446c-bfda-3745ab85163c on nch1-master-1 Sep 10 21:24:50.274701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd61b9d6-831b-4ea8-a744-9ce563da5a7d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:50.276347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fd61b9d6-831b-4ea8-a744-9ce563da5a7d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:50.279683 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c1625a51-6a4c-4922-b45f-c7e49773261e req-ebf5924b-1da3-42c8-9fdb-e437d67a4d69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039860 Sep 10 21:24:50.280623 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3218/6309] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:24:50.353673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fd61b9d6-831b-4ea8-a744-9ce563da5a7d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:24:50.367364 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fd61b9d6-831b-4ea8-a744-9ce563da5a7d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 200 len: 1351 microversion: 2.1 time: 0.110548 Sep 10 21:24:50.368374 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3092/6310] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:50 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:24:51.393015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:51.393988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: f710250a-cb3a-446c-bfda-3745ab85163c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:24:51.402027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:51.402530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:51.403008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:51.403729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:24:51.404391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:24:51.404823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:24:51.420505 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] HTTP exception thrown: Instance f710250a-cb3a-446c-bfda-3745ab85163c could not be found. Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Request method failure captured: Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c HTTP/1.1 Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHP8RCbszCTk8Rfb2DQyKNfktIXNNdvFLz2bW8-nP1cDW_GuG2bKFDzDUddVaAIHTvYjEOsCDA-7JIDpvn8pEvREb35AL1k1f2O20PIdcCQ2Iik3pYFuvv0s3gD9GjhTnHn7wYf6z-n27pDMFT_KlhXxfhVuKNFI6JCZRswA-SPtcPt4 Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f4f036f0122f4879aacb1db06eb8b588 Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f036f0122f4879aacb1db06eb8b588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f036f0122f4879aacb1db06eb8b588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4f036f0122f4879aacb1db06eb8b588", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4f036f0122f4879aacb1db06eb8b588"}]}] Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f4f036f0122f4879aacb1db06eb8b588 Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestNetworkAdvancedServerOps-2019920615-project Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: b4791d13ab1c45bf8fabec70191426da Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2019920615-project Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance f710250a-cb3a-446c-bfda-3745ab85163c could not be found. Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'f710250a-cb3a-446c-bfda-3745ab85163c'} Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f710250a-cb3a-446c-bfda-3745ab85163c could not be found. Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f710250a-cb3a-446c-bfda-3745ab85163c could not be found. Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:24:51.422539 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f710250a-cb3a-446c-bfda-3745ab85163c could not be found. Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Returning 404 to user: Instance f710250a-cb3a-446c-bfda-3745ab85163c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-378dcd56-8f0f-4e24-9094-507475b0688b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c" status: 404 len: 111 microversion: 2.1 time: 0.036297 Sep 10 21:24:51.427278 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3219/6311] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:24:51 2022] GET /compute/v2.1/servers/f710250a-cb3a-446c-bfda-3745ab85163c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:24:55.946071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2f08483c-6775-482b-a535-acd53deb015d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '.version_select at 0x7f99445f23a0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:24:55.977355 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2f08483c-6775-482b-a535-acd53deb015d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-627356151" status: 202 len: 0 microversion: 2.1 time: 0.036301 Sep 10 21:24:55.981402 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3093/6312] 10.222.0.33 () {58 vars in 1281 bytes} [Sat Sep 10 21:24:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-627356151 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:24:56.016215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9e378185-3e14-401e-843b-7a9477eaf340 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'create', calling method: .version_select at 0x7f993fff3c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2138708909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxIu6s2nPQ5j1ZuVC0dYOf+B5DBV8G4JVUGXYekK0F384JZsBzTutl61nADEPxF7B3RIPrKU4LefgE60QMP42Euzpv4jSzEdlKSzDIXWrvkUpMxbdwUSucrd3IPGsBjvw=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:24:56.035651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-9e378185-3e14-401e-843b-7a9477eaf340 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for project f4f036f0122f4879aacb1db06eb8b588. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:24:56.043099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-9e378185-3e14-401e-843b-7a9477eaf340 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for user b4791d13ab1c45bf8fabec70191426da and project f4f036f0122f4879aacb1db06eb8b588. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:24:56.082881 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9e378185-3e14-401e-843b-7a9477eaf340 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.078372 Sep 10 21:24:56.084817 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3220/6313] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:24:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:25:04.282109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:04.286948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-698387157", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "37c05d96-f995-4a59-8992-adf3715b674b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2138708909", "security_groups": [{"name": "tempest-secgroup-smoke-555905413"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:25:04.303501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:04.431632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] validate_networks() for [('37c05d96-f995-4a59-8992-adf3715b674b', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:25:05.110797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:25:05.111435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:25:05.111948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:25:05.112512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:25:05.112951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:25:05.133339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:05.137787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:05.138473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:05.140488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:05.141766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:05.143094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:05.180608 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for project f4f036f0122f4879aacb1db06eb8b588. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:25:05.189363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Getting quotas for user b4791d13ab1c45bf8fabec70191426da and project f4f036f0122f4879aacb1db06eb8b588. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:25:05.244780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:25:05.245860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:25:05.349864 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8591f3f-fd47-4231-9d80-9e37826522b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.069164 Sep 10 21:25:05.357284 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3094/6314] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:25:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:25:05.366506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ebe4b086-56e9-4fd9-a239-dd505f1bd781 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:05.370069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ebe4b086-56e9-4fd9-a239-dd505f1bd781 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:05.381060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:05.385197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:05.529004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ebe4b086-56e9-4fd9-a239-dd505f1bd781 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:05.542375 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ebe4b086-56e9-4fd9-a239-dd505f1bd781 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1266 microversion: 2.1 time: 0.183051 Sep 10 21:25:05.556631 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3221/6315] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:05 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:06.569594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c07144a4-aab6-4923-a623-01434d96de11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:06.570264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c07144a4-aab6-4923-a623-01434d96de11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:06.591011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c07144a4-aab6-4923-a623-01434d96de11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:06.614362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c07144a4-aab6-4923-a623-01434d96de11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:06.621266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c07144a4-aab6-4923-a623-01434d96de11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:06.622205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c07144a4-aab6-4923-a623-01434d96de11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:06.622713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c07144a4-aab6-4923-a623-01434d96de11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:06.623176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c07144a4-aab6-4923-a623-01434d96de11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:06.755010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c07144a4-aab6-4923-a623-01434d96de11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:06.768112 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c07144a4-aab6-4923-a623-01434d96de11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1270 microversion: 2.1 time: 0.202971 Sep 10 21:25:06.768724 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3095/6316] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:06 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:07.794556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4931a158-eeb5-4bae-9f7d-fcdf48817a2a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:07.795189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4931a158-eeb5-4bae-9f7d-fcdf48817a2a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:07.816208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4931a158-eeb5-4bae-9f7d-fcdf48817a2a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:07.816682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4931a158-eeb5-4bae-9f7d-fcdf48817a2a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:07.817151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4931a158-eeb5-4bae-9f7d-fcdf48817a2a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:07.824133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4931a158-eeb5-4bae-9f7d-fcdf48817a2a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:07.824790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4931a158-eeb5-4bae-9f7d-fcdf48817a2a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:07.825259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4931a158-eeb5-4bae-9f7d-fcdf48817a2a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:07.948719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4931a158-eeb5-4bae-9f7d-fcdf48817a2a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:07.963947 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4931a158-eeb5-4bae-9f7d-fcdf48817a2a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1324 microversion: 2.1 time: 0.171988 Sep 10 21:25:07.966055 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3222/6317] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:07 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:08.993998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-826ebd28-ac20-49a5-8a0c-9f2ba945c000 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:08.995313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-826ebd28-ac20-49a5-8a0c-9f2ba945c000 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:09.010751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-826ebd28-ac20-49a5-8a0c-9f2ba945c000 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:09.011263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-826ebd28-ac20-49a5-8a0c-9f2ba945c000 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:09.011715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-826ebd28-ac20-49a5-8a0c-9f2ba945c000 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:09.016612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-826ebd28-ac20-49a5-8a0c-9f2ba945c000 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:09.017341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-826ebd28-ac20-49a5-8a0c-9f2ba945c000 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:09.017799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-826ebd28-ac20-49a5-8a0c-9f2ba945c000 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:09.373065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-826ebd28-ac20-49a5-8a0c-9f2ba945c000 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:09.388943 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-826ebd28-ac20-49a5-8a0c-9f2ba945c000 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1391 microversion: 2.1 time: 0.396492 Sep 10 21:25:09.391872 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3096/6318] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:08 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1391 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:09.958874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b1490b12-6b0f-4b53-9c28-e32da3d7ca29 req-bdcd997f-0e3c-4462-bdd3-b82673a40db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807a80c5-4cb7-428e-ad2c-62dc6c783cfe", "tag": "617bc9a4-cd72-4cba-a63e-1e22eb50a479"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:25:09.983502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b1490b12-6b0f-4b53-9c28-e32da3d7ca29 req-bdcd997f-0e3c-4462-bdd3-b82673a40db2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:09.984008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b1490b12-6b0f-4b53-9c28-e32da3d7ca29 req-bdcd997f-0e3c-4462-bdd3-b82673a40db2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:09.984452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b1490b12-6b0f-4b53-9c28-e32da3d7ca29 req-bdcd997f-0e3c-4462-bdd3-b82673a40db2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:10.005929 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b1490b12-6b0f-4b53-9c28-e32da3d7ca29 req-bdcd997f-0e3c-4462-bdd3-b82673a40db2 service nova] Creating event network-changed:617bc9a4-cd72-4cba-a63e-1e22eb50a479 for instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe on nch2-master-1 Sep 10 21:25:10.013551 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b1490b12-6b0f-4b53-9c28-e32da3d7ca29 req-bdcd997f-0e3c-4462-bdd3-b82673a40db2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056566 Sep 10 21:25:10.014769 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3223/6319] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:25:10.413298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8cc17f19-4114-4840-8a79-8e6047ecd8b8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:10.414562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8cc17f19-4114-4840-8a79-8e6047ecd8b8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:10.427194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cc17f19-4114-4840-8a79-8e6047ecd8b8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:10.433971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cc17f19-4114-4840-8a79-8e6047ecd8b8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:10.435184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cc17f19-4114-4840-8a79-8e6047ecd8b8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:10.439684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cc17f19-4114-4840-8a79-8e6047ecd8b8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:10.440419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cc17f19-4114-4840-8a79-8e6047ecd8b8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:10.442728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cc17f19-4114-4840-8a79-8e6047ecd8b8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:10.735445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8cc17f19-4114-4840-8a79-8e6047ecd8b8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:10.753192 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8cc17f19-4114-4840-8a79-8e6047ecd8b8 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1391 microversion: 2.1 time: 0.343895 Sep 10 21:25:10.754240 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3097/6320] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:10 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1391 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:11.778439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8841cafe-afe4-4bb6-a23d-3510f4b0f5ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:11.779765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8841cafe-afe4-4bb6-a23d-3510f4b0f5ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:11.786662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8841cafe-afe4-4bb6-a23d-3510f4b0f5ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:11.787412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8841cafe-afe4-4bb6-a23d-3510f4b0f5ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:11.792994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8841cafe-afe4-4bb6-a23d-3510f4b0f5ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:11.794034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8841cafe-afe4-4bb6-a23d-3510f4b0f5ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:11.794696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8841cafe-afe4-4bb6-a23d-3510f4b0f5ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:11.795315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8841cafe-afe4-4bb6-a23d-3510f4b0f5ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:12.123237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8841cafe-afe4-4bb6-a23d-3510f4b0f5ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:12.142397 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8841cafe-afe4-4bb6-a23d-3510f4b0f5ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1391 microversion: 2.1 time: 0.364033 Sep 10 21:25:12.145620 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3224/6321] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:11 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1391 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:13.195130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8d35d1ac-46bc-43bf-a8f2-e7ba584d2420 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:13.196383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8d35d1ac-46bc-43bf-a8f2-e7ba584d2420 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:13.214384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d35d1ac-46bc-43bf-a8f2-e7ba584d2420 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:13.215016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d35d1ac-46bc-43bf-a8f2-e7ba584d2420 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:13.215574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d35d1ac-46bc-43bf-a8f2-e7ba584d2420 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:13.216408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d35d1ac-46bc-43bf-a8f2-e7ba584d2420 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:13.216980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d35d1ac-46bc-43bf-a8f2-e7ba584d2420 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:13.217674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8d35d1ac-46bc-43bf-a8f2-e7ba584d2420 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:13.433742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8d35d1ac-46bc-43bf-a8f2-e7ba584d2420 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:13.444030 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8d35d1ac-46bc-43bf-a8f2-e7ba584d2420 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1391 microversion: 2.1 time: 0.264957 Sep 10 21:25:13.445292 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3098/6322] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:13 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:14.471614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-229401de-3ffa-4da5-9cab-8f1eed0de67d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:14.473788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-229401de-3ffa-4da5-9cab-8f1eed0de67d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:14.506339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-229401de-3ffa-4da5-9cab-8f1eed0de67d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:14.506339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-229401de-3ffa-4da5-9cab-8f1eed0de67d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:14.506339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-229401de-3ffa-4da5-9cab-8f1eed0de67d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:14.506339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-229401de-3ffa-4da5-9cab-8f1eed0de67d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:14.506339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-229401de-3ffa-4da5-9cab-8f1eed0de67d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:14.506936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-229401de-3ffa-4da5-9cab-8f1eed0de67d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:15.016127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-229401de-3ffa-4da5-9cab-8f1eed0de67d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:15.028822 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-229401de-3ffa-4da5-9cab-8f1eed0de67d tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1391 microversion: 2.1 time: 0.562048 Sep 10 21:25:15.030120 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3225/6323] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:14 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1391 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:16.070641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:16.072756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:16.078957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09273b9e-e0a1-41fb-a4d2-d12682934ae1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:16.079947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-09273b9e-e0a1-41fb-a4d2-d12682934ae1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:16.089159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09273b9e-e0a1-41fb-a4d2-d12682934ae1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:16.089353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6b9cd1cd-b45a-4a03-a6e7-5214fe8791d0 req-b91a0974-b7c8-4f7b-9758-3ae1767ee9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807a80c5-4cb7-428e-ad2c-62dc6c783cfe", "name": "network-vif-plugged", "status": "completed", "tag": "617bc9a4-cd72-4cba-a63e-1e22eb50a479"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:25:16.090682 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09273b9e-e0a1-41fb-a4d2-d12682934ae1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:16.091367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09273b9e-e0a1-41fb-a4d2-d12682934ae1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:16.092530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09273b9e-e0a1-41fb-a4d2-d12682934ae1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:16.093215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09273b9e-e0a1-41fb-a4d2-d12682934ae1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:16.094110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09273b9e-e0a1-41fb-a4d2-d12682934ae1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:16.096427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:16.108580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6b9cd1cd-b45a-4a03-a6e7-5214fe8791d0 req-b91a0974-b7c8-4f7b-9758-3ae1767ee9b5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:16.111000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6b9cd1cd-b45a-4a03-a6e7-5214fe8791d0 req-b91a0974-b7c8-4f7b-9758-3ae1767ee9b5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:16.113673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6b9cd1cd-b45a-4a03-a6e7-5214fe8791d0 req-b91a0974-b7c8-4f7b-9758-3ae1767ee9b5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:16.162337 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6b9cd1cd-b45a-4a03-a6e7-5214fe8791d0 req-b91a0974-b7c8-4f7b-9758-3ae1767ee9b5 service nova] Creating event network-vif-plugged:617bc9a4-cd72-4cba-a63e-1e22eb50a479 for instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe on nch2-master-1 Sep 10 21:25:16.177271 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6b9cd1cd-b45a-4a03-a6e7-5214fe8791d0 req-b91a0974-b7c8-4f7b-9758-3ae1767ee9b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100120 Sep 10 21:25:16.178637 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3226/6324] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:25:16.447853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09273b9e-e0a1-41fb-a4d2-d12682934ae1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:16.465020 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09273b9e-e0a1-41fb-a4d2-d12682934ae1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1391 microversion: 2.1 time: 0.401344 Sep 10 21:25:16.466030 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3099/6325] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:16 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1391 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:17.494278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f86287f0-db4e-4627-8475-d7ca5118d74b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:17.495569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f86287f0-db4e-4627-8475-d7ca5118d74b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:17.503385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f86287f0-db4e-4627-8475-d7ca5118d74b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:17.504335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f86287f0-db4e-4627-8475-d7ca5118d74b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:17.505038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f86287f0-db4e-4627-8475-d7ca5118d74b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:17.506011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f86287f0-db4e-4627-8475-d7ca5118d74b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:17.506657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f86287f0-db4e-4627-8475-d7ca5118d74b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:17.507294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f86287f0-db4e-4627-8475-d7ca5118d74b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:17.723157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f86287f0-db4e-4627-8475-d7ca5118d74b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:17.732371 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f86287f0-db4e-4627-8475-d7ca5118d74b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1391 microversion: 2.1 time: 0.242744 Sep 10 21:25:17.732950 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3227/6326] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:17 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1391 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:18.756673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-35b1438d-fc32-4420-8d29-fc6ae9a0d6d3 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:18.757307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-35b1438d-fc32-4420-8d29-fc6ae9a0d6d3 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:18.764982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b1438d-fc32-4420-8d29-fc6ae9a0d6d3 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:18.765489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b1438d-fc32-4420-8d29-fc6ae9a0d6d3 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:18.765966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b1438d-fc32-4420-8d29-fc6ae9a0d6d3 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:18.766729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b1438d-fc32-4420-8d29-fc6ae9a0d6d3 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:18.767203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b1438d-fc32-4420-8d29-fc6ae9a0d6d3 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:18.767647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-35b1438d-fc32-4420-8d29-fc6ae9a0d6d3 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:18.909819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-35b1438d-fc32-4420-8d29-fc6ae9a0d6d3 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:18.918659 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-35b1438d-fc32-4420-8d29-fc6ae9a0d6d3 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1564 microversion: 2.1 time: 0.165803 Sep 10 21:25:18.919278 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3100/6327] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:18 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:18.942529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b44ad450-7ab6-4aa4-9f61-2f211b10c531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:18.943276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b44ad450-7ab6-4aa4-9f61-2f211b10c531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:18.951446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b44ad450-7ab6-4aa4-9f61-2f211b10c531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:18.951957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b44ad450-7ab6-4aa4-9f61-2f211b10c531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:18.952501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b44ad450-7ab6-4aa4-9f61-2f211b10c531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:18.953300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b44ad450-7ab6-4aa4-9f61-2f211b10c531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:18.953862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b44ad450-7ab6-4aa4-9f61-2f211b10c531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:18.954362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b44ad450-7ab6-4aa4-9f61-2f211b10c531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:19.182956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b44ad450-7ab6-4aa4-9f61-2f211b10c531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:19.191149 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b44ad450-7ab6-4aa4-9f61-2f211b10c531 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1564 microversion: 2.1 time: 0.252588 Sep 10 21:25:19.191733 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3228/6328] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:18 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1564 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:21.066819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0c0f3a8e-f1b1-4ef6-82f5-b1c5b0e80e50 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:21.067997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0c0f3a8e-f1b1-4ef6-82f5-b1c5b0e80e50 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:21.079110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c0f3a8e-f1b1-4ef6-82f5-b1c5b0e80e50 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:21.079815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c0f3a8e-f1b1-4ef6-82f5-b1c5b0e80e50 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:21.080411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c0f3a8e-f1b1-4ef6-82f5-b1c5b0e80e50 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:21.081367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c0f3a8e-f1b1-4ef6-82f5-b1c5b0e80e50 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:21.082013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c0f3a8e-f1b1-4ef6-82f5-b1c5b0e80e50 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:21.082596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0c0f3a8e-f1b1-4ef6-82f5-b1c5b0e80e50 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:21.089312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-894ea1a2-18f1-409c-becd-4acb8ca331c4 req-09f34c0d-f2fc-4405-ba63-681b1b7d6209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807a80c5-4cb7-428e-ad2c-62dc6c783cfe", "tag": "617bc9a4-cd72-4cba-a63e-1e22eb50a479"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:25:21.110936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-894ea1a2-18f1-409c-becd-4acb8ca331c4 req-09f34c0d-f2fc-4405-ba63-681b1b7d6209 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:21.115838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-894ea1a2-18f1-409c-becd-4acb8ca331c4 req-09f34c0d-f2fc-4405-ba63-681b1b7d6209 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:21.127743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-894ea1a2-18f1-409c-becd-4acb8ca331c4 req-09f34c0d-f2fc-4405-ba63-681b1b7d6209 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:21.159620 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-894ea1a2-18f1-409c-becd-4acb8ca331c4 req-09f34c0d-f2fc-4405-ba63-681b1b7d6209 service nova] Creating event network-changed:617bc9a4-cd72-4cba-a63e-1e22eb50a479 for instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe on nch2-master-1 Sep 10 21:25:21.176152 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-894ea1a2-18f1-409c-becd-4acb8ca331c4 req-09f34c0d-f2fc-4405-ba63-681b1b7d6209 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096947 Sep 10 21:25:21.178289 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3229/6329] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:25:21.391104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0c0f3a8e-f1b1-4ef6-82f5-b1c5b0e80e50 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:21.399909 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0c0f3a8e-f1b1-4ef6-82f5-b1c5b0e80e50 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1564 microversion: 2.1 time: 0.336922 Sep 10 21:25:21.400778 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3101/6330] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:21 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1564 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:44.730799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=19 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:44.732383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=36 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:44.738441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cfd56332-4d52-4398-98c8-cf5b0188ee12 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:25:44.744521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cfd56332-4d52-4398-98c8-cf5b0188ee12 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:44.757107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfd56332-4d52-4398-98c8-cf5b0188ee12 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:44.757527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfd56332-4d52-4398-98c8-cf5b0188ee12 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:44.767351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfd56332-4d52-4398-98c8-cf5b0188ee12 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:44.768226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfd56332-4d52-4398-98c8-cf5b0188ee12 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:44.770323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfd56332-4d52-4398-98c8-cf5b0188ee12 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:44.770940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfd56332-4d52-4398-98c8-cf5b0188ee12 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:44.866770 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cfd56332-4d52-4398-98c8-cf5b0188ee12 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe/action" status: 200 len: 24575 microversion: 2.1 time: 0.138441 Sep 10 21:25:44.874925 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3230/6331] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:25:44 2022] POST /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe/action => generated 24575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:25:50.121591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:50.123535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=44 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:25:50.348235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-209f2e8b-50b5-413a-bc9f-7d25750bb493 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Action: 'create', calling method: .version_select at 0x7f99440b1310>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2006747472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr410RUdM1YMH6y5e2p+UXiav4LFQtW1NGikdxUdJigoidd+yxS283ttok/W/lzQViedAUGIIPlzOo4Qk9QmbclUo6zBbE9AngJfoV+g5G7qZvRkNFGouY/NWiJAQpCXA=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:25:50.370123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-209f2e8b-50b5-413a-bc9f-7d25750bb493 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Getting quotas for project 92f59058d6274eb7b3472a96ab56b55c. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:25:50.376647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-209f2e8b-50b5-413a-bc9f-7d25750bb493 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Getting quotas for user 87cb7cceef924db79e4add131992b8e1 and project 92f59058d6274eb7b3472a96ab56b55c. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:25:50.404608 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-209f2e8b-50b5-413a-bc9f-7d25750bb493 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.290320 Sep 10 21:25:50.405311 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3102/6332] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:25:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:25:51.471243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1042568319", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2006747472", "security_groups": [{"name": "tempest-secgroup-smoke-614997587"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "acfe56b7-1c85-4a6c-bc4b-b7dc65c0966d"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:25:51.615765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] validate_networks() for [('acfe56b7-1c85-4a6c-bc4b-b7dc65c0966d', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:25:52.226203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Getting quotas for project 92f59058d6274eb7b3472a96ab56b55c. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:25:52.233849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Getting quotas for user 87cb7cceef924db79e4add131992b8e1 and project 92f59058d6274eb7b3472a96ab56b55c. Resources: dict_keys(['metadata_items']) {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:25:52.250791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:25:52.251253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:25:52.251908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:25:52.252661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:25:52.253088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:25:52.264293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:52.265072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:52.265514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:52.266289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:52.267464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:52.267464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:52.285231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Getting quotas for project 92f59058d6274eb7b3472a96ab56b55c. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:25:52.293145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Getting quotas for user 87cb7cceef924db79e4add131992b8e1 and project 92f59058d6274eb7b3472a96ab56b55c. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:25:52.307667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:25:52.312798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:25:52.375132 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f276ffcd-6099-4f67-8e07-4ee82eb25ca9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.908233 Sep 10 21:25:52.376047 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3231/6333] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:25:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:25:52.390469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9ddf41d3-2562-4476-8c42-0da82d8716d4 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:52.391915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9ddf41d3-2562-4476-8c42-0da82d8716d4 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:52.459281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9ddf41d3-2562-4476-8c42-0da82d8716d4 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:52.467221 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9ddf41d3-2562-4476-8c42-0da82d8716d4 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1303 microversion: 2.1 time: 0.081380 Sep 10 21:25:52.484041 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3103/6334] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:52 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:53.492830 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5a9470ba-29a6-48fc-a73a-52b40509bb9c tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:53.493564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a9470ba-29a6-48fc-a73a-52b40509bb9c tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:53.500716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a9470ba-29a6-48fc-a73a-52b40509bb9c tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:53.501196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a9470ba-29a6-48fc-a73a-52b40509bb9c tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:53.501659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a9470ba-29a6-48fc-a73a-52b40509bb9c tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:53.502382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a9470ba-29a6-48fc-a73a-52b40509bb9c tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:53.502837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a9470ba-29a6-48fc-a73a-52b40509bb9c tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:53.503260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a9470ba-29a6-48fc-a73a-52b40509bb9c tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:53.564365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5a9470ba-29a6-48fc-a73a-52b40509bb9c tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:53.573293 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5a9470ba-29a6-48fc-a73a-52b40509bb9c tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1355 microversion: 2.1 time: 0.085332 Sep 10 21:25:53.573885 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3232/6335] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:53 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1355 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:54.596593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e5a20466-6e55-4715-b3b9-54a5038d9498 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:54.597221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e5a20466-6e55-4715-b3b9-54a5038d9498 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:54.604546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a20466-6e55-4715-b3b9-54a5038d9498 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:54.605088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a20466-6e55-4715-b3b9-54a5038d9498 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:54.605487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a20466-6e55-4715-b3b9-54a5038d9498 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:54.606407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a20466-6e55-4715-b3b9-54a5038d9498 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:54.607031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a20466-6e55-4715-b3b9-54a5038d9498 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:54.607466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e5a20466-6e55-4715-b3b9-54a5038d9498 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:54.682870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e5a20466-6e55-4715-b3b9-54a5038d9498 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:54.695680 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e5a20466-6e55-4715-b3b9-54a5038d9498 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1361 microversion: 2.1 time: 0.102468 Sep 10 21:25:54.696937 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3104/6336] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:54 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1361 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:55.720296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-752afc00-2264-44bb-a1c3-fd15403068e6 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:55.721641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-752afc00-2264-44bb-a1c3-fd15403068e6 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:55.728336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-1a84b33d-376e-41eb-8398-60892e05301f req-d648a923-7004-4f27-bf1c-39a57478c3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d8fd32-68c8-42a9-bf82-3e59da2cba26", "tag": "18ebebaa-b979-441a-ac37-1a91e6c03a63"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:25:55.730157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-752afc00-2264-44bb-a1c3-fd15403068e6 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:55.730842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-752afc00-2264-44bb-a1c3-fd15403068e6 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:55.731437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-752afc00-2264-44bb-a1c3-fd15403068e6 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:55.732294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-752afc00-2264-44bb-a1c3-fd15403068e6 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:55.732903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-752afc00-2264-44bb-a1c3-fd15403068e6 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:55.733480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-752afc00-2264-44bb-a1c3-fd15403068e6 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:55.737979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1a84b33d-376e-41eb-8398-60892e05301f req-d648a923-7004-4f27-bf1c-39a57478c3a0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:55.738457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1a84b33d-376e-41eb-8398-60892e05301f req-d648a923-7004-4f27-bf1c-39a57478c3a0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:55.738905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1a84b33d-376e-41eb-8398-60892e05301f req-d648a923-7004-4f27-bf1c-39a57478c3a0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:55.754145 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-1a84b33d-376e-41eb-8398-60892e05301f req-d648a923-7004-4f27-bf1c-39a57478c3a0 service nova] Creating event network-changed:18ebebaa-b979-441a-ac37-1a91e6c03a63 for instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 on nch1-master-1 Sep 10 21:25:55.759284 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-1a84b33d-376e-41eb-8398-60892e05301f req-d648a923-7004-4f27-bf1c-39a57478c3a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261877 Sep 10 21:25:55.760414 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3233/6337] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:25:55.882351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-752afc00-2264-44bb-a1c3-fd15403068e6 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:55.891008 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-752afc00-2264-44bb-a1c3-fd15403068e6 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1428 microversion: 2.1 time: 0.174751 Sep 10 21:25:55.891603 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3105/6338] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:55 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1428 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:25:55.950081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:25:55.953056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:55.959538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:55.960146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:55.961129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:55.961879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:55.962575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:55.963008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:56.055446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:25:56.056523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:25:56.057339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:25:56.058067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:25:56.058647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:25:56.130346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:56.141873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:56.142807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:56.143826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:56.146649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:56.147505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:56.148158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:56.182784 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ad740cd6-2afa-4c5d-a7ac-9152c172ed01 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe/action" status: 202 len: 1137 microversion: 2.1 time: 0.237319 Sep 10 21:25:56.183641 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3234/6339] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:25:55 2022] POST /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe/action => generated 1137 bytes in 239 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 21:25:56.209094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-89c094dc-a11f-420b-a6ae-5d6f45c8d9df tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:56.209733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-89c094dc-a11f-420b-a6ae-5d6f45c8d9df tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:56.217033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c094dc-a11f-420b-a6ae-5d6f45c8d9df tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:56.217548 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c094dc-a11f-420b-a6ae-5d6f45c8d9df tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:56.218032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c094dc-a11f-420b-a6ae-5d6f45c8d9df tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:56.218944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c094dc-a11f-420b-a6ae-5d6f45c8d9df tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:56.219558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c094dc-a11f-420b-a6ae-5d6f45c8d9df tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:56.220167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-89c094dc-a11f-420b-a6ae-5d6f45c8d9df tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:56.390214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-89c094dc-a11f-420b-a6ae-5d6f45c8d9df tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:56.398703 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-89c094dc-a11f-420b-a6ae-5d6f45c8d9df tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.198122 Sep 10 21:25:56.399296 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3106/6340] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:56 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:56.915141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28984b49-0ad3-4723-b383-2d47584c16d9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:56.915767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-28984b49-0ad3-4723-b383-2d47584c16d9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:56.922968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28984b49-0ad3-4723-b383-2d47584c16d9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:56.923721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28984b49-0ad3-4723-b383-2d47584c16d9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:56.924160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28984b49-0ad3-4723-b383-2d47584c16d9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:56.924872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28984b49-0ad3-4723-b383-2d47584c16d9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:56.925331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28984b49-0ad3-4723-b383-2d47584c16d9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:56.925763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28984b49-0ad3-4723-b383-2d47584c16d9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:57.075586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-28984b49-0ad3-4723-b383-2d47584c16d9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:57.083652 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-28984b49-0ad3-4723-b383-2d47584c16d9 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1428 microversion: 2.1 time: 0.172622 Sep 10 21:25:57.084243 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3235/6341] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:56 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1428 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:57.422779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a439a76a-6f10-4c4a-b28a-cd733bfa56e4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:57.423337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a439a76a-6f10-4c4a-b28a-cd733bfa56e4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:57.431167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a439a76a-6f10-4c4a-b28a-cd733bfa56e4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:57.431658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a439a76a-6f10-4c4a-b28a-cd733bfa56e4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:57.432102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a439a76a-6f10-4c4a-b28a-cd733bfa56e4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:57.432807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a439a76a-6f10-4c4a-b28a-cd733bfa56e4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:57.433271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a439a76a-6f10-4c4a-b28a-cd733bfa56e4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:57.433706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a439a76a-6f10-4c4a-b28a-cd733bfa56e4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:57.568819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a439a76a-6f10-4c4a-b28a-cd733bfa56e4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:57.576692 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a439a76a-6f10-4c4a-b28a-cd733bfa56e4 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.157923 Sep 10 21:25:57.577274 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3107/6342] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:57 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:58.108179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5159dc80-7950-4989-8b35-679fd6c93394 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:58.108796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5159dc80-7950-4989-8b35-679fd6c93394 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:58.116054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5159dc80-7950-4989-8b35-679fd6c93394 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:58.116538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5159dc80-7950-4989-8b35-679fd6c93394 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:58.116981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5159dc80-7950-4989-8b35-679fd6c93394 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:58.117681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5159dc80-7950-4989-8b35-679fd6c93394 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:58.118174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5159dc80-7950-4989-8b35-679fd6c93394 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:58.118611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5159dc80-7950-4989-8b35-679fd6c93394 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:58.343444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5159dc80-7950-4989-8b35-679fd6c93394 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:58.351318 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5159dc80-7950-4989-8b35-679fd6c93394 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1428 microversion: 2.1 time: 0.247671 Sep 10 21:25:58.351906 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3236/6343] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:58 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1428 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:58.599865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-725fca84-e7a8-4bf5-be16-2d021252b5fb tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:58.600489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-725fca84-e7a8-4bf5-be16-2d021252b5fb tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:58.608122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725fca84-e7a8-4bf5-be16-2d021252b5fb tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:58.609422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725fca84-e7a8-4bf5-be16-2d021252b5fb tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:58.609902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725fca84-e7a8-4bf5-be16-2d021252b5fb tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:58.610882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725fca84-e7a8-4bf5-be16-2d021252b5fb tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:58.611350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725fca84-e7a8-4bf5-be16-2d021252b5fb tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:58.611791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725fca84-e7a8-4bf5-be16-2d021252b5fb tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:58.746194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-725fca84-e7a8-4bf5-be16-2d021252b5fb tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:58.754464 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-725fca84-e7a8-4bf5-be16-2d021252b5fb tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.158510 Sep 10 21:25:58.755041 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3108/6344] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:58 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:59.375043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da40d5bf-9bcb-4e27-a8bf-131f08fdad4a tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:59.375652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-da40d5bf-9bcb-4e27-a8bf-131f08fdad4a tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:59.382569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da40d5bf-9bcb-4e27-a8bf-131f08fdad4a tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:59.383055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da40d5bf-9bcb-4e27-a8bf-131f08fdad4a tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:59.383498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da40d5bf-9bcb-4e27-a8bf-131f08fdad4a tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:59.384192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da40d5bf-9bcb-4e27-a8bf-131f08fdad4a tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:59.385323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da40d5bf-9bcb-4e27-a8bf-131f08fdad4a tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:59.385774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da40d5bf-9bcb-4e27-a8bf-131f08fdad4a tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:59.519361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-da40d5bf-9bcb-4e27-a8bf-131f08fdad4a tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:59.527239 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da40d5bf-9bcb-4e27-a8bf-131f08fdad4a tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1428 microversion: 2.1 time: 0.156057 Sep 10 21:25:59.527814 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3237/6345] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:59 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1428 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:25:59.777642 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d9407b93-365d-4ff9-b4e3-de97c1515cca tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:25:59.778267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d9407b93-365d-4ff9-b4e3-de97c1515cca tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:25:59.785089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9407b93-365d-4ff9-b4e3-de97c1515cca tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:59.785582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9407b93-365d-4ff9-b4e3-de97c1515cca tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:59.786136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9407b93-365d-4ff9-b4e3-de97c1515cca tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:59.786841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9407b93-365d-4ff9-b4e3-de97c1515cca tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:25:59.787303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9407b93-365d-4ff9-b4e3-de97c1515cca tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:25:59.787737 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9407b93-365d-4ff9-b4e3-de97c1515cca tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:25:59.925622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d9407b93-365d-4ff9-b4e3-de97c1515cca tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:25:59.934450 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d9407b93-365d-4ff9-b4e3-de97c1515cca tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.160866 Sep 10 21:25:59.935046 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3109/6346] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:25:59 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:00.549893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9941342-06bd-4926-99a6-f8f62bd9a526 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:00.550510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f9941342-06bd-4926-99a6-f8f62bd9a526 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:00.557608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9941342-06bd-4926-99a6-f8f62bd9a526 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:00.558375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9941342-06bd-4926-99a6-f8f62bd9a526 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:00.558880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9941342-06bd-4926-99a6-f8f62bd9a526 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:00.559587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9941342-06bd-4926-99a6-f8f62bd9a526 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:00.560053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9941342-06bd-4926-99a6-f8f62bd9a526 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:00.560473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9941342-06bd-4926-99a6-f8f62bd9a526 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:00.700595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f9941342-06bd-4926-99a6-f8f62bd9a526 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:00.708661 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f9941342-06bd-4926-99a6-f8f62bd9a526 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1428 microversion: 2.1 time: 0.162632 Sep 10 21:26:00.709244 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3238/6347] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:00 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1428 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:00.957989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4dbf4332-031b-47b4-bf35-13998138f7b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:00.958557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4dbf4332-031b-47b4-bf35-13998138f7b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:00.965757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4dbf4332-031b-47b4-bf35-13998138f7b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:00.966294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4dbf4332-031b-47b4-bf35-13998138f7b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:00.966741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4dbf4332-031b-47b4-bf35-13998138f7b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:00.967457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4dbf4332-031b-47b4-bf35-13998138f7b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:00.967923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4dbf4332-031b-47b4-bf35-13998138f7b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:00.968363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4dbf4332-031b-47b4-bf35-13998138f7b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:01.105074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4dbf4332-031b-47b4-bf35-13998138f7b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:01.113304 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4dbf4332-031b-47b4-bf35-13998138f7b5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.159458 Sep 10 21:26:01.113905 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3110/6348] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:00 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:01.731059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85222af4-9f29-4541-887f-b46422350fef tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:01.731646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-85222af4-9f29-4541-887f-b46422350fef tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:01.738754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85222af4-9f29-4541-887f-b46422350fef tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:01.739236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85222af4-9f29-4541-887f-b46422350fef tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:01.739669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85222af4-9f29-4541-887f-b46422350fef tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:01.740358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85222af4-9f29-4541-887f-b46422350fef tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:01.740805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85222af4-9f29-4541-887f-b46422350fef tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:01.741226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85222af4-9f29-4541-887f-b46422350fef tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:01.877756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-85222af4-9f29-4541-887f-b46422350fef tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:01.886213 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-85222af4-9f29-4541-887f-b46422350fef tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1428 microversion: 2.1 time: 0.158842 Sep 10 21:26:01.887036 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3239/6349] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:01 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:02.099574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-595aa61b-135a-4df0-ae21-a9a558753814 req-cfb28796-2c15-4620-9406-3e828fd8e09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d8fd32-68c8-42a9-bf82-3e59da2cba26", "name": "network-vif-plugged", "status": "completed", "tag": "18ebebaa-b979-441a-ac37-1a91e6c03a63"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:26:02.109980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-595aa61b-135a-4df0-ae21-a9a558753814 req-cfb28796-2c15-4620-9406-3e828fd8e09c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:02.110757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-595aa61b-135a-4df0-ae21-a9a558753814 req-cfb28796-2c15-4620-9406-3e828fd8e09c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:02.111202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-595aa61b-135a-4df0-ae21-a9a558753814 req-cfb28796-2c15-4620-9406-3e828fd8e09c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:02.122751 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-595aa61b-135a-4df0-ae21-a9a558753814 req-cfb28796-2c15-4620-9406-3e828fd8e09c service nova] Creating event network-vif-plugged:18ebebaa-b979-441a-ac37-1a91e6c03a63 for instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 on nch1-master-1 Sep 10 21:26:02.127737 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-595aa61b-135a-4df0-ae21-a9a558753814 req-cfb28796-2c15-4620-9406-3e828fd8e09c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103035 Sep 10 21:26:02.128344 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3111/6350] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:26:02.136501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-145178bc-f771-488a-8977-9751f1d47924 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:02.137124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-145178bc-f771-488a-8977-9751f1d47924 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:02.143158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-145178bc-f771-488a-8977-9751f1d47924 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:02.143659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-145178bc-f771-488a-8977-9751f1d47924 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:02.144095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-145178bc-f771-488a-8977-9751f1d47924 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:02.144793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-145178bc-f771-488a-8977-9751f1d47924 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:02.145259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-145178bc-f771-488a-8977-9751f1d47924 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:02.145693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-145178bc-f771-488a-8977-9751f1d47924 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:02.276974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:02.300684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=10 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:02.332591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-145178bc-f771-488a-8977-9751f1d47924 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:02.341164 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-145178bc-f771-488a-8977-9751f1d47924 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.208595 Sep 10 21:26:02.341751 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3240/6351] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:02 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:02.905817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:02.910401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38e2ef26-2bf5-49d2-9e0a-311297e1cf87 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:02.911094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38e2ef26-2bf5-49d2-9e0a-311297e1cf87 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:02.918203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e2ef26-2bf5-49d2-9e0a-311297e1cf87 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:02.918697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e2ef26-2bf5-49d2-9e0a-311297e1cf87 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:02.919137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e2ef26-2bf5-49d2-9e0a-311297e1cf87 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:02.919842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e2ef26-2bf5-49d2-9e0a-311297e1cf87 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:02.920301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e2ef26-2bf5-49d2-9e0a-311297e1cf87 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:02.920732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38e2ef26-2bf5-49d2-9e0a-311297e1cf87 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:03.061285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38e2ef26-2bf5-49d2-9e0a-311297e1cf87 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:03.069107 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38e2ef26-2bf5-49d2-9e0a-311297e1cf87 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1428 microversion: 2.1 time: 0.164259 Sep 10 21:26:03.069698 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3112/6352] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:02 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1428 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:03.365860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e9fc6ed8-c6c6-4d88-9d82-7cb247ced6d7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:03.366540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e9fc6ed8-c6c6-4d88-9d82-7cb247ced6d7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:03.374002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9fc6ed8-c6c6-4d88-9d82-7cb247ced6d7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:03.374356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9fc6ed8-c6c6-4d88-9d82-7cb247ced6d7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:03.374802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9fc6ed8-c6c6-4d88-9d82-7cb247ced6d7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:03.375505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9fc6ed8-c6c6-4d88-9d82-7cb247ced6d7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:03.375964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9fc6ed8-c6c6-4d88-9d82-7cb247ced6d7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:03.376398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e9fc6ed8-c6c6-4d88-9d82-7cb247ced6d7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:03.511160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e9fc6ed8-c6c6-4d88-9d82-7cb247ced6d7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:03.519418 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e9fc6ed8-c6c6-4d88-9d82-7cb247ced6d7 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.157778 Sep 10 21:26:03.520009 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3241/6353] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:03 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:04.091922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d76d0539-529d-4c78-99f6-efcae8d6a104 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:04.092547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d76d0539-529d-4c78-99f6-efcae8d6a104 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:04.099116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d76d0539-529d-4c78-99f6-efcae8d6a104 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:04.099615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d76d0539-529d-4c78-99f6-efcae8d6a104 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:04.100058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d76d0539-529d-4c78-99f6-efcae8d6a104 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:04.100765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d76d0539-529d-4c78-99f6-efcae8d6a104 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:04.101235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d76d0539-529d-4c78-99f6-efcae8d6a104 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:04.101774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d76d0539-529d-4c78-99f6-efcae8d6a104 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:04.234756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d76d0539-529d-4c78-99f6-efcae8d6a104 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:04.242865 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d76d0539-529d-4c78-99f6-efcae8d6a104 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1608 microversion: 2.1 time: 0.155200 Sep 10 21:26:04.243488 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3113/6354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:04 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1608 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:04.265573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dd7d296c-1a71-445f-b195-ccad251ee3b2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:04.266220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dd7d296c-1a71-445f-b195-ccad251ee3b2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:04.272229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd7d296c-1a71-445f-b195-ccad251ee3b2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:04.272718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd7d296c-1a71-445f-b195-ccad251ee3b2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:04.273161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd7d296c-1a71-445f-b195-ccad251ee3b2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:04.273877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd7d296c-1a71-445f-b195-ccad251ee3b2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:04.274339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd7d296c-1a71-445f-b195-ccad251ee3b2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:04.274767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd7d296c-1a71-445f-b195-ccad251ee3b2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:04.410218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dd7d296c-1a71-445f-b195-ccad251ee3b2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:04.418638 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dd7d296c-1a71-445f-b195-ccad251ee3b2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1608 microversion: 2.1 time: 0.156941 Sep 10 21:26:04.419299 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3242/6355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:04 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1608 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:04.440966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-491dbc04-0dcd-4237-9a87-1784df517da1 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:04.441582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-491dbc04-0dcd-4237-9a87-1784df517da1 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:04.447592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-491dbc04-0dcd-4237-9a87-1784df517da1 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:04.448086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-491dbc04-0dcd-4237-9a87-1784df517da1 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:04.448526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-491dbc04-0dcd-4237-9a87-1784df517da1 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:04.449262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-491dbc04-0dcd-4237-9a87-1784df517da1 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:04.449726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-491dbc04-0dcd-4237-9a87-1784df517da1 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:04.450194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-491dbc04-0dcd-4237-9a87-1784df517da1 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:04.543208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-67175f5e-a78a-4605-8000-ddb34e1cdf11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:04.543828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-67175f5e-a78a-4605-8000-ddb34e1cdf11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:04.549782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67175f5e-a78a-4605-8000-ddb34e1cdf11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:04.550319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67175f5e-a78a-4605-8000-ddb34e1cdf11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:04.550760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67175f5e-a78a-4605-8000-ddb34e1cdf11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:04.551493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67175f5e-a78a-4605-8000-ddb34e1cdf11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:04.551949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67175f5e-a78a-4605-8000-ddb34e1cdf11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:04.552386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-67175f5e-a78a-4605-8000-ddb34e1cdf11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:04.585220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-491dbc04-0dcd-4237-9a87-1784df517da1 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:04.593922 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-491dbc04-0dcd-4237-9a87-1784df517da1 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1608 microversion: 2.1 time: 0.156736 Sep 10 21:26:04.594519 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3114/6356] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:04 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1608 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:04.694530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-67175f5e-a78a-4605-8000-ddb34e1cdf11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:04.702722 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-67175f5e-a78a-4605-8000-ddb34e1cdf11 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.164346 Sep 10 21:26:04.703396 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3243/6357] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:04 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:26:05.727575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5112275a-38db-41ff-bf0e-a8a3a931ed5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:05.728389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5112275a-38db-41ff-bf0e-a8a3a931ed5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:05.736740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5112275a-38db-41ff-bf0e-a8a3a931ed5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:05.737236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5112275a-38db-41ff-bf0e-a8a3a931ed5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:05.737676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5112275a-38db-41ff-bf0e-a8a3a931ed5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:05.738826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5112275a-38db-41ff-bf0e-a8a3a931ed5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:05.740083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5112275a-38db-41ff-bf0e-a8a3a931ed5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:05.740083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5112275a-38db-41ff-bf0e-a8a3a931ed5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:06.162937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5112275a-38db-41ff-bf0e-a8a3a931ed5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:06.172419 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5112275a-38db-41ff-bf0e-a8a3a931ed5a tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.448790 Sep 10 21:26:06.173056 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3115/6358] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:05 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:06.761688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-db37fcbc-8b94-4d70-bdfd-959ee0e1e0a3 req-a720b0e1-3b44-41de-b63e-0f1040957326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d8fd32-68c8-42a9-bf82-3e59da2cba26", "tag": "18ebebaa-b979-441a-ac37-1a91e6c03a63"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:26:06.771921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-db37fcbc-8b94-4d70-bdfd-959ee0e1e0a3 req-a720b0e1-3b44-41de-b63e-0f1040957326 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:06.772402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-db37fcbc-8b94-4d70-bdfd-959ee0e1e0a3 req-a720b0e1-3b44-41de-b63e-0f1040957326 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:06.772835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-db37fcbc-8b94-4d70-bdfd-959ee0e1e0a3 req-a720b0e1-3b44-41de-b63e-0f1040957326 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:06.787754 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-db37fcbc-8b94-4d70-bdfd-959ee0e1e0a3 req-a720b0e1-3b44-41de-b63e-0f1040957326 service nova] Creating event network-changed:18ebebaa-b979-441a-ac37-1a91e6c03a63 for instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 on nch1-master-1 Sep 10 21:26:06.793177 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-db37fcbc-8b94-4d70-bdfd-959ee0e1e0a3 req-a720b0e1-3b44-41de-b63e-0f1040957326 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035554 Sep 10 21:26:06.794203 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3244/6359] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:26:07.196807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ec3f0d5f-ee37-4573-b102-634b89cdc463 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:07.198312 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ec3f0d5f-ee37-4573-b102-634b89cdc463 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:07.205894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec3f0d5f-ee37-4573-b102-634b89cdc463 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:07.207175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec3f0d5f-ee37-4573-b102-634b89cdc463 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:07.207725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec3f0d5f-ee37-4573-b102-634b89cdc463 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:07.208539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec3f0d5f-ee37-4573-b102-634b89cdc463 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:07.209100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec3f0d5f-ee37-4573-b102-634b89cdc463 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:07.209644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec3f0d5f-ee37-4573-b102-634b89cdc463 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:07.365265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ec3f0d5f-ee37-4573-b102-634b89cdc463 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:07.374792 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ec3f0d5f-ee37-4573-b102-634b89cdc463 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.182554 Sep 10 21:26:07.375398 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3116/6360] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:07 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:08.399871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3a4ea2c8-7189-4070-baac-21e727bd7fbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:08.401447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3a4ea2c8-7189-4070-baac-21e727bd7fbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:08.408376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2c8-7189-4070-baac-21e727bd7fbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:08.408862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2c8-7189-4070-baac-21e727bd7fbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:08.409306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2c8-7189-4070-baac-21e727bd7fbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:08.410038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2c8-7189-4070-baac-21e727bd7fbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:08.410501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2c8-7189-4070-baac-21e727bd7fbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:08.410932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3a4ea2c8-7189-4070-baac-21e727bd7fbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:08.547118 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3a4ea2c8-7189-4070-baac-21e727bd7fbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:08.554866 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3a4ea2c8-7189-4070-baac-21e727bd7fbd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.159356 Sep 10 21:26:08.555433 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3245/6361] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:08 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:09.578792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-125b08a8-f158-43b6-9589-8e34eb2975ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:09.579469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-125b08a8-f158-43b6-9589-8e34eb2975ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:09.586394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-125b08a8-f158-43b6-9589-8e34eb2975ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:09.586886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-125b08a8-f158-43b6-9589-8e34eb2975ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:09.587335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-125b08a8-f158-43b6-9589-8e34eb2975ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:09.588852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-125b08a8-f158-43b6-9589-8e34eb2975ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:09.589369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-125b08a8-f158-43b6-9589-8e34eb2975ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:09.589802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-125b08a8-f158-43b6-9589-8e34eb2975ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:09.730174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-125b08a8-f158-43b6-9589-8e34eb2975ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:09.740367 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-125b08a8-f158-43b6-9589-8e34eb2975ef tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.165582 Sep 10 21:26:09.745958 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3117/6362] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:09 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:10.764752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-03dd7bbd-0105-4136-af80-90566d692bae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:10.765391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-03dd7bbd-0105-4136-af80-90566d692bae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:10.772307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03dd7bbd-0105-4136-af80-90566d692bae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:10.772789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03dd7bbd-0105-4136-af80-90566d692bae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:10.773228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03dd7bbd-0105-4136-af80-90566d692bae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:10.773943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03dd7bbd-0105-4136-af80-90566d692bae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:10.774403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03dd7bbd-0105-4136-af80-90566d692bae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:10.774828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-03dd7bbd-0105-4136-af80-90566d692bae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:10.907257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-03dd7bbd-0105-4136-af80-90566d692bae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:10.910945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:10.916045 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-03dd7bbd-0105-4136-af80-90566d692bae tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.156061 Sep 10 21:26:10.916903 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3246/6363] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:10 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:11.940044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b21294d4-c4c2-4571-ab09-b255cd9d02c5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:11.940571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b21294d4-c4c2-4571-ab09-b255cd9d02c5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:11.948793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b21294d4-c4c2-4571-ab09-b255cd9d02c5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:11.949302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b21294d4-c4c2-4571-ab09-b255cd9d02c5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:11.949750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b21294d4-c4c2-4571-ab09-b255cd9d02c5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:11.950481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b21294d4-c4c2-4571-ab09-b255cd9d02c5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:11.950943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b21294d4-c4c2-4571-ab09-b255cd9d02c5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:11.951369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b21294d4-c4c2-4571-ab09-b255cd9d02c5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:12.093120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b21294d4-c4c2-4571-ab09-b255cd9d02c5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:12.101594 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b21294d4-c4c2-4571-ab09-b255cd9d02c5 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1691 microversion: 2.1 time: 0.165462 Sep 10 21:26:12.102219 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3118/6364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:11 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:13.126655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96a203e1-2918-4957-bb53-38c05a952424 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:13.127301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96a203e1-2918-4957-bb53-38c05a952424 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:13.135857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96a203e1-2918-4957-bb53-38c05a952424 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:13.136474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96a203e1-2918-4957-bb53-38c05a952424 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:13.136982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96a203e1-2918-4957-bb53-38c05a952424 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:13.137769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96a203e1-2918-4957-bb53-38c05a952424 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:13.138263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96a203e1-2918-4957-bb53-38c05a952424 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:13.138845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96a203e1-2918-4957-bb53-38c05a952424 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:13.278497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-96a203e1-2918-4957-bb53-38c05a952424 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:13.286496 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96a203e1-2918-4957-bb53-38c05a952424 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1709 microversion: 2.1 time: 0.164625 Sep 10 21:26:13.287085 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3247/6365] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:13 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1709 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:14.311580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a779ae8b-82c3-46a8-82ff-3da8c1cbc68e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:14.312286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a779ae8b-82c3-46a8-82ff-3da8c1cbc68e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:14.319359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a779ae8b-82c3-46a8-82ff-3da8c1cbc68e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:14.319854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a779ae8b-82c3-46a8-82ff-3da8c1cbc68e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:14.320299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a779ae8b-82c3-46a8-82ff-3da8c1cbc68e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:14.321063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a779ae8b-82c3-46a8-82ff-3da8c1cbc68e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:14.321525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a779ae8b-82c3-46a8-82ff-3da8c1cbc68e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:14.321992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a779ae8b-82c3-46a8-82ff-3da8c1cbc68e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:14.512960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a779ae8b-82c3-46a8-82ff-3da8c1cbc68e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:14.521066 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a779ae8b-82c3-46a8-82ff-3da8c1cbc68e tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1697 microversion: 2.1 time: 0.214238 Sep 10 21:26:14.521663 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3119/6366] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:14 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1697 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:15.546410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e8c671d4-3708-4e84-9fbc-7304441a5364 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:15.547060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e8c671d4-3708-4e84-9fbc-7304441a5364 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:15.551092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:15.554753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8c671d4-3708-4e84-9fbc-7304441a5364 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:15.555262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8c671d4-3708-4e84-9fbc-7304441a5364 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:15.555703 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8c671d4-3708-4e84-9fbc-7304441a5364 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:15.556441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8c671d4-3708-4e84-9fbc-7304441a5364 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:15.556914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8c671d4-3708-4e84-9fbc-7304441a5364 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:15.557424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e8c671d4-3708-4e84-9fbc-7304441a5364 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:15.696920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e8c671d4-3708-4e84-9fbc-7304441a5364 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:15.706951 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e8c671d4-3708-4e84-9fbc-7304441a5364 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1682 microversion: 2.1 time: 0.164642 Sep 10 21:26:15.707740 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3248/6367] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:15 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:16.100573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1a80d5e3-a6e4-47fe-84d8-6cd35be0aaf5 req-4b1db4e6-6771-42a4-b310-11a50b4fb3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807a80c5-4cb7-428e-ad2c-62dc6c783cfe", "name": "network-vif-unplugged", "status": "completed", "tag": "617bc9a4-cd72-4cba-a63e-1e22eb50a479"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:26:16.112436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1a80d5e3-a6e4-47fe-84d8-6cd35be0aaf5 req-4b1db4e6-6771-42a4-b310-11a50b4fb3a4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:16.112930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1a80d5e3-a6e4-47fe-84d8-6cd35be0aaf5 req-4b1db4e6-6771-42a4-b310-11a50b4fb3a4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:16.113384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1a80d5e3-a6e4-47fe-84d8-6cd35be0aaf5 req-4b1db4e6-6771-42a4-b310-11a50b4fb3a4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:16.125519 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1a80d5e3-a6e4-47fe-84d8-6cd35be0aaf5 req-4b1db4e6-6771-42a4-b310-11a50b4fb3a4 service nova] Creating event network-vif-unplugged:617bc9a4-cd72-4cba-a63e-1e22eb50a479 for instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe on nch2-master-1 Sep 10 21:26:16.130616 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1a80d5e3-a6e4-47fe-84d8-6cd35be0aaf5 req-4b1db4e6-6771-42a4-b310-11a50b4fb3a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033853 Sep 10 21:26:16.131312 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3120/6368] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:26:18.146719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ac49873a-ae33-40f7-8637-ab5ae6d5dfb5 req-96b3a3ed-7beb-4a4f-95b4-9d4b50de9ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807a80c5-4cb7-428e-ad2c-62dc6c783cfe", "name": "network-vif-plugged", "status": "completed", "tag": "617bc9a4-cd72-4cba-a63e-1e22eb50a479"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:26:18.157422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ac49873a-ae33-40f7-8637-ab5ae6d5dfb5 req-96b3a3ed-7beb-4a4f-95b4-9d4b50de9ccf service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:18.157929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ac49873a-ae33-40f7-8637-ab5ae6d5dfb5 req-96b3a3ed-7beb-4a4f-95b4-9d4b50de9ccf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:18.158372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ac49873a-ae33-40f7-8637-ab5ae6d5dfb5 req-96b3a3ed-7beb-4a4f-95b4-9d4b50de9ccf service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:18.169867 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ac49873a-ae33-40f7-8637-ab5ae6d5dfb5 req-96b3a3ed-7beb-4a4f-95b4-9d4b50de9ccf service nova] Creating event network-vif-plugged:617bc9a4-cd72-4cba-a63e-1e22eb50a479 for instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe on nch2-master-1 Sep 10 21:26:18.174812 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ac49873a-ae33-40f7-8637-ab5ae6d5dfb5 req-96b3a3ed-7beb-4a4f-95b4-9d4b50de9ccf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031762 Sep 10 21:26:18.175398 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3249/6369] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:26:41.936360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:41.937125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=94 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:41.941639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-af8a0f38-a1d5-4263-ac0d-7df7778b6021 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:26:41.944020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-af8a0f38-a1d5-4263-ac0d-7df7778b6021 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:41.953113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af8a0f38-a1d5-4263-ac0d-7df7778b6021 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:41.953612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af8a0f38-a1d5-4263-ac0d-7df7778b6021 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:41.954091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af8a0f38-a1d5-4263-ac0d-7df7778b6021 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:41.954807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af8a0f38-a1d5-4263-ac0d-7df7778b6021 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:41.955263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af8a0f38-a1d5-4263-ac0d-7df7778b6021 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:41.955689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af8a0f38-a1d5-4263-ac0d-7df7778b6021 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:42.015718 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-af8a0f38-a1d5-4263-ac0d-7df7778b6021 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "POST /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe/action" status: 200 len: 24570 microversion: 2.1 time: 0.081179 Sep 10 21:26:42.016640 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3121/6370] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:26:41 2022] POST /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe/action => generated 24570 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:26:53.787677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:53.788532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=14 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:53.792306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-3347259b-fc8d-4fcc-87ad-3fc68ffc857a req-91ec54cf-42e8-43f2-930a-659a57cd867a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807a80c5-4cb7-428e-ad2c-62dc6c783cfe", "tag": "617bc9a4-cd72-4cba-a63e-1e22eb50a479"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:26:53.793631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e71df3e0-262f-4a3c-8c0e-863fb37522bd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:53.794255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e71df3e0-262f-4a3c-8c0e-863fb37522bd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:53.798558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:53.799530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:26:53.801665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e71df3e0-262f-4a3c-8c0e-863fb37522bd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:53.802417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e71df3e0-262f-4a3c-8c0e-863fb37522bd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:53.803074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e71df3e0-262f-4a3c-8c0e-863fb37522bd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:53.804002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e71df3e0-262f-4a3c-8c0e-863fb37522bd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:53.804722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e71df3e0-262f-4a3c-8c0e-863fb37522bd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:53.805356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e71df3e0-262f-4a3c-8c0e-863fb37522bd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:53.808562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3347259b-fc8d-4fcc-87ad-3fc68ffc857a req-91ec54cf-42e8-43f2-930a-659a57cd867a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:53.809163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3347259b-fc8d-4fcc-87ad-3fc68ffc857a req-91ec54cf-42e8-43f2-930a-659a57cd867a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:53.809599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-3347259b-fc8d-4fcc-87ad-3fc68ffc857a req-91ec54cf-42e8-43f2-930a-659a57cd867a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:53.821159 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-3347259b-fc8d-4fcc-87ad-3fc68ffc857a req-91ec54cf-42e8-43f2-930a-659a57cd867a service nova] Creating event network-changed:617bc9a4-cd72-4cba-a63e-1e22eb50a479 for instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe on nch2-master-1 Sep 10 21:26:53.827422 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-3347259b-fc8d-4fcc-87ad-3fc68ffc857a req-91ec54cf-42e8-43f2-930a-659a57cd867a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039544 Sep 10 21:26:53.828556 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3122/6371] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:26:53.832368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e71df3e0-262f-4a3c-8c0e-863fb37522bd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:26:53.926061 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e71df3e0-262f-4a3c-8c0e-863fb37522bd tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "DELETE /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 204 len: 0 microversion: 2.1 time: 0.139200 Sep 10 21:26:53.929232 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3250/6372] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:26:53 2022] DELETE /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:26:53.940156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-32f9d244-5a90-4378-a050-c1cd0ba408a1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:53.940920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-32f9d244-5a90-4378-a050-c1cd0ba408a1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:53.948731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32f9d244-5a90-4378-a050-c1cd0ba408a1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:53.950192 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32f9d244-5a90-4378-a050-c1cd0ba408a1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:53.950914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32f9d244-5a90-4378-a050-c1cd0ba408a1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:53.951834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32f9d244-5a90-4378-a050-c1cd0ba408a1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:53.952588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32f9d244-5a90-4378-a050-c1cd0ba408a1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:53.953215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32f9d244-5a90-4378-a050-c1cd0ba408a1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:54.118173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-32f9d244-5a90-4378-a050-c1cd0ba408a1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:54.128184 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-32f9d244-5a90-4378-a050-c1cd0ba408a1 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1688 microversion: 2.1 time: 0.193551 Sep 10 21:26:54.128767 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3123/6373] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:53 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1688 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:55.153880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3b4e7cb4-d22f-4cd0-b4f9-abd775ab88f6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:55.154576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3b4e7cb4-d22f-4cd0-b4f9-abd775ab88f6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:55.161340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b4e7cb4-d22f-4cd0-b4f9-abd775ab88f6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:55.161847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b4e7cb4-d22f-4cd0-b4f9-abd775ab88f6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:55.162301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b4e7cb4-d22f-4cd0-b4f9-abd775ab88f6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:55.163000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b4e7cb4-d22f-4cd0-b4f9-abd775ab88f6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:55.163488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b4e7cb4-d22f-4cd0-b4f9-abd775ab88f6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:55.163918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3b4e7cb4-d22f-4cd0-b4f9-abd775ab88f6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:55.300020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3b4e7cb4-d22f-4cd0-b4f9-abd775ab88f6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:55.307947 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3b4e7cb4-d22f-4cd0-b4f9-abd775ab88f6 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1688 microversion: 2.1 time: 0.159195 Sep 10 21:26:55.308624 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3251/6374] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:55 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:55.843617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b3b5773d-0261-4060-8cc2-ab99d7a1b9ba req-ea5ac83c-125d-4996-a7ad-1b4f02ba8783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807a80c5-4cb7-428e-ad2c-62dc6c783cfe", "name": "network-vif-deleted", "tag": "617bc9a4-cd72-4cba-a63e-1e22eb50a479"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:26:55.855092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b3b5773d-0261-4060-8cc2-ab99d7a1b9ba req-ea5ac83c-125d-4996-a7ad-1b4f02ba8783 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:55.856471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b3b5773d-0261-4060-8cc2-ab99d7a1b9ba req-ea5ac83c-125d-4996-a7ad-1b4f02ba8783 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:55.857117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b3b5773d-0261-4060-8cc2-ab99d7a1b9ba req-ea5ac83c-125d-4996-a7ad-1b4f02ba8783 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:55.872732 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b3b5773d-0261-4060-8cc2-ab99d7a1b9ba req-ea5ac83c-125d-4996-a7ad-1b4f02ba8783 service nova] Creating event network-vif-deleted:617bc9a4-cd72-4cba-a63e-1e22eb50a479 for instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe on nch2-master-1 Sep 10 21:26:55.878191 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b3b5773d-0261-4060-8cc2-ab99d7a1b9ba req-ea5ac83c-125d-4996-a7ad-1b4f02ba8783 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040139 Sep 10 21:26:55.878819 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3124/6375] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:26:56.332701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:56.333277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:56.340561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:56.341080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:56.341525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:56.342269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:56.342738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:56.343177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:56.377024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:56.377492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:56.377973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:56.378439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lazy-loading 'fault' on Instance uuid 807a80c5-4cb7-428e-ad2c-62dc6c783cfe {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:26:56.423537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4791d13ab1c45bf8fabec70191426da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f036f0122f4879aacb1db06eb8b588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:26:56.432201 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-796e5f59-7066-46da-b982-129c5b9de38b tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 200 len: 1356 microversion: 2.1 time: 0.103586 Sep 10 21:26:56.432788 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3252/6376] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:56 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:26:57.457850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:26:57.458562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] [instance: 807a80c5-4cb7-428e-ad2c-62dc6c783cfe] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:26:57.465456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:57.465994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:57.466522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:57.467236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:26:57.467693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:26:57.468127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:26:57.484546 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] HTTP exception thrown: Instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe could not be found. Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Request method failure captured: Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe HTTP/1.1 Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHP8RCbszCTk8Rfb2DQyKNfktIXNNdvFLz2bW8-nP1cDW_GuG2bKFDzDUddVaAIHTvYjEOsCDA-7JIDpvn8pEvREb35AL1k1f2O20PIdcCQ2Iik3pYFuvv0s3gD9GjhTnHn7wYf6z-n27pDMFT_KlhXxfhVuKNFI6JCZRswA-SPtcPt4 Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: f4f036f0122f4879aacb1db06eb8b588 Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f036f0122f4879aacb1db06eb8b588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4f036f0122f4879aacb1db06eb8b588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4f036f0122f4879aacb1db06eb8b588", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4f036f0122f4879aacb1db06eb8b588"}]}] Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: f4f036f0122f4879aacb1db06eb8b588 Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2019920615 Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TestNetworkAdvancedServerOps-2019920615-project Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: b4791d13ab1c45bf8fabec70191426da Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2019920615-project Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe could not be found. Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '807a80c5-4cb7-428e-ad2c-62dc6c783cfe'} Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe could not be found. Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe could not be found. Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:26:57.486490 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe could not be found. Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Returning 404 to user: Instance 807a80c5-4cb7-428e-ad2c-62dc6c783cfe could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-70d2cedb-51e6-465f-a335-1c28191622c0 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe" status: 404 len: 111 microversion: 2.1 time: 0.035362 Sep 10 21:26:57.491330 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3125/6377] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:26:57 2022] GET /compute/v2.1/servers/807a80c5-4cb7-428e-ad2c-62dc6c783cfe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:27:00.856219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-16d7e1b8-6b61-47d7-b744-377dc3972231 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] Calling method '.version_select at 0x7f993f932b80>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:27:00.885005 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-16d7e1b8-6b61-47d7-b744-377dc3972231 tempest-TestNetworkAdvancedServerOps-2019920615 tempest-TestNetworkAdvancedServerOps-2019920615-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2138708909" status: 202 len: 0 microversion: 2.1 time: 0.032726 Sep 10 21:27:00.885633 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3253/6378] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Sep 10 21:27:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2138708909 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:27:11.128191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7949e66b-5e42-40b8-b63a-c5fbc28b6f70 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:27:11.128672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7949e66b-5e42-40b8-b63a-c5fbc28b6f70 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:27:11.131793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:27:11.132443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=12 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:27:11.140305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7949e66b-5e42-40b8-b63a-c5fbc28b6f70 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:27:11.140802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7949e66b-5e42-40b8-b63a-c5fbc28b6f70 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:27:11.141246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7949e66b-5e42-40b8-b63a-c5fbc28b6f70 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:27:11.141985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7949e66b-5e42-40b8-b63a-c5fbc28b6f70 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:27:11.142447 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7949e66b-5e42-40b8-b63a-c5fbc28b6f70 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:27:11.142879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7949e66b-5e42-40b8-b63a-c5fbc28b6f70 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:27:11.168512 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7949e66b-5e42-40b8-b63a-c5fbc28b6f70 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.044271 Sep 10 21:27:11.169092 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3126/6379] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Sep 10 21:27:11 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26/os-server-password => generated 116 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:31:14.602195 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b1f4ed7-24bd-4569-af9f-d6241352bd2e] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:31:14.603014 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c8ac8451-8bb7-4c61-8ae1-41d1ffcbab32] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:31:14.603569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:31:14.604312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:31:14.606282 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 21:31:14.606448 ncdv-master-1 devstack@n-api.service[145772]: Sat Sep 10 21:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 (ip 10.222.0.33) !!! Sep 10 21:31:14.607790 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 21:31:14.607953 ncdv-master-1 devstack@n-api.service[145772]: Sat Sep 10 21:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 (ip 10.222.0.33) !!! Sep 10 21:31:14.609411 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 21:31:14.609525 ncdv-master-1 devstack@n-api.service[145772]: Sat Sep 10 21:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 (ip 10.222.0.33) !!! Sep 10 21:31:14.823863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-caaa286b-ec5a-41a7-985e-4c8bfbb62b24 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:31:14.824370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-caaa286b-ec5a-41a7-985e-4c8bfbb62b24 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:31:14.830476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caaa286b-ec5a-41a7-985e-4c8bfbb62b24 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:14.830964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caaa286b-ec5a-41a7-985e-4c8bfbb62b24 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:14.831396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caaa286b-ec5a-41a7-985e-4c8bfbb62b24 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:14.832082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caaa286b-ec5a-41a7-985e-4c8bfbb62b24 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:14.832530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caaa286b-ec5a-41a7-985e-4c8bfbb62b24 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:14.832953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caaa286b-ec5a-41a7-985e-4c8bfbb62b24 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:14.859168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-caaa286b-ec5a-41a7-985e-4c8bfbb62b24 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:31:14.939694 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-caaa286b-ec5a-41a7-985e-4c8bfbb62b24 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 204 len: 0 microversion: 2.1 time: 0.339016 Sep 10 21:31:14.940293 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3254/6380] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:31:14 2022] DELETE /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:31:14.947600 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9be06a9-4f21-4508-84c9-22f4b31441dc] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 21:31:14.948608 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d92fd74e-3a75-4708-a33b-c44a50e0eba4] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 21:31:14.949355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:31:14.950153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:31:14.951470 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 21:31:14.951665 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 21:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 (ip 10.222.0.33) !!! Sep 10 21:31:14.952910 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 21:31:14.953030 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 21:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 (ip 10.222.0.33) !!! Sep 10 21:31:14.954333 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 21:31:14.954445 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 21:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 (ip 10.222.0.33) !!! Sep 10 21:31:14.958551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be62ad33-1c2d-4fd8-ae84-414a750630d2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:31:14.959294 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-be62ad33-1c2d-4fd8-ae84-414a750630d2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:31:14.972493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be62ad33-1c2d-4fd8-ae84-414a750630d2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:14.972955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be62ad33-1c2d-4fd8-ae84-414a750630d2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:14.973402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be62ad33-1c2d-4fd8-ae84-414a750630d2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:14.974263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be62ad33-1c2d-4fd8-ae84-414a750630d2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:14.974820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be62ad33-1c2d-4fd8-ae84-414a750630d2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:14.975246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be62ad33-1c2d-4fd8-ae84-414a750630d2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:15.175015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-be62ad33-1c2d-4fd8-ae84-414a750630d2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:31:15.183338 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be62ad33-1c2d-4fd8-ae84-414a750630d2 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1733 microversion: 2.1 time: 0.237667 Sep 10 21:31:15.183921 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3127/6381] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:31:14 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1733 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:31:16.213733 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] [c8ac8451-8bb7-4c61-8ae1-41d1ffcbab32] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37160. Sep 10 21:31:16.219469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-69bf6022-ae12-4d3f-bce8-e6ca180208fa tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:31:16.220189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-69bf6022-ae12-4d3f-bce8-e6ca180208fa tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:31:16.242735 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b1f4ed7-24bd-4569-af9f-d6241352bd2e] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37158. Sep 10 21:31:16.244222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69bf6022-ae12-4d3f-bce8-e6ca180208fa tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:16.245007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69bf6022-ae12-4d3f-bce8-e6ca180208fa tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:16.245476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69bf6022-ae12-4d3f-bce8-e6ca180208fa tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:16.246301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69bf6022-ae12-4d3f-bce8-e6ca180208fa tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:16.246763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69bf6022-ae12-4d3f-bce8-e6ca180208fa tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:16.247212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-69bf6022-ae12-4d3f-bce8-e6ca180208fa tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:16.377936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-69bf6022-ae12-4d3f-bce8-e6ca180208fa tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87cb7cceef924db79e4add131992b8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f59058d6274eb7b3472a96ab56b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:31:16.386530 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-69bf6022-ae12-4d3f-bce8-e6ca180208fa tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 200 len: 1666 microversion: 2.1 time: 0.183443 Sep 10 21:31:16.387116 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3255/6382] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:31:16 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 1666 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:31:16.559496 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] [d92fd74e-3a75-4708-a33b-c44a50e0eba4] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37170. Sep 10 21:31:16.585012 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9be06a9-4f21-4508-84c9-22f4b31441dc] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37168. Sep 10 21:31:16.657251 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c85d11c0-6cae-402c-a4f3-d997b478985f req-259c64e7-f2aa-4f1c-ae33-97744fbb91d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d8fd32-68c8-42a9-bf82-3e59da2cba26", "name": "network-vif-deleted", "tag": "18ebebaa-b979-441a-ac37-1a91e6c03a63"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:31:16.676804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c85d11c0-6cae-402c-a4f3-d997b478985f req-259c64e7-f2aa-4f1c-ae33-97744fbb91d6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:16.678602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c85d11c0-6cae-402c-a4f3-d997b478985f req-259c64e7-f2aa-4f1c-ae33-97744fbb91d6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:16.679218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c85d11c0-6cae-402c-a4f3-d997b478985f req-259c64e7-f2aa-4f1c-ae33-97744fbb91d6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:16.691917 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c85d11c0-6cae-402c-a4f3-d997b478985f req-259c64e7-f2aa-4f1c-ae33-97744fbb91d6 service nova] Creating event network-vif-deleted:18ebebaa-b979-441a-ac37-1a91e6c03a63 for instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 on nch1-master-1 Sep 10 21:31:16.699062 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c85d11c0-6cae-402c-a4f3-d997b478985f req-259c64e7-f2aa-4f1c-ae33-97744fbb91d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161148 Sep 10 21:31:16.700317 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3128/6383] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:31:17.410402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:31:17.411166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:31:17.419597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:17.420089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:17.420523 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:17.421602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:17.422251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:17.422691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:17.437749 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] HTTP exception thrown: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Request method failure captured: Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 HTTP/1.1 Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQDYa0ww7bV6S1vaCPWANPLp96_hU_-pIk-S6qbqbJ2FWJn_WLxlW8MgNvJoDVC9vtkBygjbQ_JeYggCG2kg2P1NIKanK5B16a3v3YWsulVZrZyf57j2rq4AfTTIfZMsaKCTN3qi9AhpY7segw117nHOOf9GfoiG8u46KRMlfjBt7Ms Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 92f59058d6274eb7b3472a96ab56b55c Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestServerBasicOps-549191097 Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92f59058d6274eb7b3472a96ab56b55c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92f59058d6274eb7b3472a96ab56b55c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92f59058d6274eb7b3472a96ab56b55c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92f59058d6274eb7b3472a96ab56b55c"}]}] Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestServerBasicOps-549191097 Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 92f59058d6274eb7b3472a96ab56b55c Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestServerBasicOps-549191097 Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestServerBasicOps-549191097-project Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 87cb7cceef924db79e4add131992b8e1 Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestServerBasicOps-549191097-project Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '63d8fd32-68c8-42a9-bf82-3e59da2cba26'} Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:31:17.439494 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.443933 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:31:17.443933 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:31:17.443933 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:31:17.443933 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:31:17.443933 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:31:17.443933 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.443933 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.443933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Returning 404 to user: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:31:17.443933 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6027ccba-40d1-4209-93f6-b0b1af8bcd88 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 404 len: 111 microversion: 2.1 time: 0.034727 Sep 10 21:31:17.443933 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3256/6384] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:31:17 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:31:17.906348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:31:17.906948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:31:17.914056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:17.914541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:17.914984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:17.915683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:17.916142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:17.916572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:17.930516 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] HTTP exception thrown: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Request method failure captured: Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 HTTP/1.1 Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQDYa0ww7bV6S1vaCPWANPLp96_hU_-pIk-S6qbqbJ2FWJn_WLxlW8MgNvJoDVC9vtkBygjbQ_JeYggCG2kg2P1NIKanK5B16a3v3YWsulVZrZyf57j2rq4AfTTIfZMsaKCTN3qi9AhpY7segw117nHOOf9GfoiG8u46KRMlfjBt7Ms Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 92f59058d6274eb7b3472a96ab56b55c Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TestServerBasicOps-549191097 Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92f59058d6274eb7b3472a96ab56b55c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92f59058d6274eb7b3472a96ab56b55c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92f59058d6274eb7b3472a96ab56b55c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92f59058d6274eb7b3472a96ab56b55c"}]}] Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TestServerBasicOps-549191097 Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 92f59058d6274eb7b3472a96ab56b55c Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TestServerBasicOps-549191097 Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TestServerBasicOps-549191097-project Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 87cb7cceef924db79e4add131992b8e1 Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TestServerBasicOps-549191097-project Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '63d8fd32-68c8-42a9-bf82-3e59da2cba26'} Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:31:17.932144 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Returning 404 to user: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5fb34306-2574-4858-a969-912034981e4d tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 404 len: 111 microversion: 2.1 time: 0.032360 Sep 10 21:31:17.936761 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3129/6385] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:31:17 2022] DELETE /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:31:17.942600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:31:17.943889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] [instance: 63d8fd32-68c8-42a9-bf82-3e59da2cba26] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:31:17.949887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:17.950405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:17.950874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:17.951568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:31:17.952051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:31:17.952482 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:31:17.969022 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] HTTP exception thrown: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Request method failure captured: Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 HTTP/1.1 Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQDYa0ww7bV6S1vaCPWANPLp96_hU_-pIk-S6qbqbJ2FWJn_WLxlW8MgNvJoDVC9vtkBygjbQ_JeYggCG2kg2P1NIKanK5B16a3v3YWsulVZrZyf57j2rq4AfTTIfZMsaKCTN3qi9AhpY7segw117nHOOf9GfoiG8u46KRMlfjBt7Ms Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 92f59058d6274eb7b3472a96ab56b55c Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestServerBasicOps-549191097 Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92f59058d6274eb7b3472a96ab56b55c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92f59058d6274eb7b3472a96ab56b55c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92f59058d6274eb7b3472a96ab56b55c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92f59058d6274eb7b3472a96ab56b55c"}]}] Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestServerBasicOps-549191097 Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 92f59058d6274eb7b3472a96ab56b55c Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestServerBasicOps-549191097 Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestServerBasicOps-549191097-project Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 87cb7cceef924db79e4add131992b8e1 Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestServerBasicOps-549191097-project Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '63d8fd32-68c8-42a9-bf82-3e59da2cba26'} Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:31:17.971004 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.974672 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:31:17.974672 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:31:17.974672 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:31:17.974672 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:31:17.974672 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:31:17.974672 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. Sep 10 21:31:17.974672 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:31:17.974672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Returning 404 to user: Instance 63d8fd32-68c8-42a9-bf82-3e59da2cba26 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:31:17.974672 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-266bbf6a-e8a4-4717-a6cc-a5d5e8849b60 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26" status: 404 len: 111 microversion: 2.1 time: 0.033735 Sep 10 21:31:17.974672 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3257/6386] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:31:17 2022] GET /compute/v2.1/servers/63d8fd32-68c8-42a9-bf82-3e59da2cba26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:31:18.142571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ba8e7857-f8b7-41ea-88bd-4375f9890625 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] Calling method '.version_select at 0x7f993fab1d30>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:31:18.172369 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ba8e7857-f8b7-41ea-88bd-4375f9890625 tempest-TestServerBasicOps-549191097 tempest-TestServerBasicOps-549191097-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2006747472" status: 202 len: 0 microversion: 2.1 time: 0.033855 Sep 10 21:31:18.172938 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3130/6387] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Sep 10 21:31:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2006747472 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:32:04.148262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:04.149004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:04.262936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1135123847", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:04.312886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] validate_networks() for None {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:32:04.593645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:32:04.594123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:32:04.594996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:32:04.595126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:32:04.595446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:32:04.605126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:04.605611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:04.606088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:04.606831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:04.607287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:04.607714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:04.626307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Getting quotas for project 474a67ba997844588d0fb15769b8da21. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:32:04.631694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Getting quotas for user 6c2d7fb5ad6842a082c7fb21f0be87a9 and project 474a67ba997844588d0fb15769b8da21. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:32:04.643829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:32:04.646789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:32:04.692923 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bf153c36-a218-43dc-b2e3-6c15a34bcb49 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549958 Sep 10 21:32:04.693582 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3258/6388] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:32:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:32:04.706165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7276d85e-daac-4724-8c62-e26bfb1b0121 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:04.707667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7276d85e-daac-4724-8c62-e26bfb1b0121 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:04.711203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=10 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:04.712068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:04.772587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7276d85e-daac-4724-8c62-e26bfb1b0121 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:04.781142 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7276d85e-daac-4724-8c62-e26bfb1b0121 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1222 microversion: 2.1 time: 0.078988 Sep 10 21:32:04.781710 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3131/6389] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:04 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:32:05.806430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3978d724-7374-474e-971d-51685d8330f8 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:05.807049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3978d724-7374-474e-971d-51685d8330f8 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:05.813163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3978d724-7374-474e-971d-51685d8330f8 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:05.813649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3978d724-7374-474e-971d-51685d8330f8 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:05.814113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3978d724-7374-474e-971d-51685d8330f8 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:05.814814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3978d724-7374-474e-971d-51685d8330f8 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:05.815270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3978d724-7374-474e-971d-51685d8330f8 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:05.815718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3978d724-7374-474e-971d-51685d8330f8 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:05.888670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3978d724-7374-474e-971d-51685d8330f8 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:05.901968 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3978d724-7374-474e-971d-51685d8330f8 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1274 microversion: 2.1 time: 0.100373 Sep 10 21:32:05.913851 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3259/6390] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:05 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:06.927869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9b4c7fe8-ae7c-44a6-8636-77b71f5dd4f6 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:06.928503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9b4c7fe8-ae7c-44a6-8636-77b71f5dd4f6 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:06.936270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b4c7fe8-ae7c-44a6-8636-77b71f5dd4f6 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:06.936713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b4c7fe8-ae7c-44a6-8636-77b71f5dd4f6 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:06.937163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b4c7fe8-ae7c-44a6-8636-77b71f5dd4f6 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:06.938054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b4c7fe8-ae7c-44a6-8636-77b71f5dd4f6 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:06.938513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b4c7fe8-ae7c-44a6-8636-77b71f5dd4f6 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:06.938953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9b4c7fe8-ae7c-44a6-8636-77b71f5dd4f6 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:07.075788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9b4c7fe8-ae7c-44a6-8636-77b71f5dd4f6 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:07.083685 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9b4c7fe8-ae7c-44a6-8636-77b71f5dd4f6 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1322 microversion: 2.1 time: 0.160591 Sep 10 21:32:07.084271 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3132/6391] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:06 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:07.522973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-18db1a30-dd91-4d07-8c1d-6774b90cfd3b req-73f14231-6eab-4bbf-9cf4-c0928ca6e623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b816a727-213f-486d-a023-f5fd9b5aafd6", "tag": "198e1495-1a0c-42c1-a38f-129c37c09f42"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:07.535678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-18db1a30-dd91-4d07-8c1d-6774b90cfd3b req-73f14231-6eab-4bbf-9cf4-c0928ca6e623 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:07.536233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-18db1a30-dd91-4d07-8c1d-6774b90cfd3b req-73f14231-6eab-4bbf-9cf4-c0928ca6e623 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:07.536676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-18db1a30-dd91-4d07-8c1d-6774b90cfd3b req-73f14231-6eab-4bbf-9cf4-c0928ca6e623 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:07.552126 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-18db1a30-dd91-4d07-8c1d-6774b90cfd3b req-73f14231-6eab-4bbf-9cf4-c0928ca6e623 service nova] Creating event network-changed:198e1495-1a0c-42c1-a38f-129c37c09f42 for instance b816a727-213f-486d-a023-f5fd9b5aafd6 on nch2-master-1 Sep 10 21:32:07.558228 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-18db1a30-dd91-4d07-8c1d-6774b90cfd3b req-73f14231-6eab-4bbf-9cf4-c0928ca6e623 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039307 Sep 10 21:32:07.559328 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3260/6392] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:32:08.108073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5851bf2f-f60f-4389-bef5-4758ea7dc7c7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:08.108951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5851bf2f-f60f-4389-bef5-4758ea7dc7c7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:08.116711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5851bf2f-f60f-4389-bef5-4758ea7dc7c7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:08.117194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5851bf2f-f60f-4389-bef5-4758ea7dc7c7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:08.117632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5851bf2f-f60f-4389-bef5-4758ea7dc7c7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:08.118346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5851bf2f-f60f-4389-bef5-4758ea7dc7c7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:08.118804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5851bf2f-f60f-4389-bef5-4758ea7dc7c7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:08.119232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5851bf2f-f60f-4389-bef5-4758ea7dc7c7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:08.248631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5851bf2f-f60f-4389-bef5-4758ea7dc7c7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:08.257016 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5851bf2f-f60f-4389-bef5-4758ea7dc7c7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1322 microversion: 2.1 time: 0.152903 Sep 10 21:32:08.257597 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3133/6393] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:08 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:09.280696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c98be8d8-e18d-46a9-bd78-331a0a83e4d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:09.281442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c98be8d8-e18d-46a9-bd78-331a0a83e4d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:09.289083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c98be8d8-e18d-46a9-bd78-331a0a83e4d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:09.289571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c98be8d8-e18d-46a9-bd78-331a0a83e4d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:09.290048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c98be8d8-e18d-46a9-bd78-331a0a83e4d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:09.290749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c98be8d8-e18d-46a9-bd78-331a0a83e4d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:09.291205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c98be8d8-e18d-46a9-bd78-331a0a83e4d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:09.291670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c98be8d8-e18d-46a9-bd78-331a0a83e4d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:09.498353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c98be8d8-e18d-46a9-bd78-331a0a83e4d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:09.506413 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c98be8d8-e18d-46a9-bd78-331a0a83e4d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1322 microversion: 2.1 time: 0.230048 Sep 10 21:32:09.507331 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3261/6394] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:09 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:10.529864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-03659934-4693-4009-9fa6-733212143eec tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:10.530493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-03659934-4693-4009-9fa6-733212143eec tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:10.537375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03659934-4693-4009-9fa6-733212143eec tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:10.537896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03659934-4693-4009-9fa6-733212143eec tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:10.538342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03659934-4693-4009-9fa6-733212143eec tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:10.539038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03659934-4693-4009-9fa6-733212143eec tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:10.539499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03659934-4693-4009-9fa6-733212143eec tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:10.539929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-03659934-4693-4009-9fa6-733212143eec tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:10.677818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-03659934-4693-4009-9fa6-733212143eec tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:10.686143 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-03659934-4693-4009-9fa6-733212143eec tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1322 microversion: 2.1 time: 0.160010 Sep 10 21:32:10.686736 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3134/6395] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:10 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:11.710529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eeb7f66e-dea7-4b80-93ee-62f431d653bd tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:11.711144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eeb7f66e-dea7-4b80-93ee-62f431d653bd tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:11.718370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb7f66e-dea7-4b80-93ee-62f431d653bd tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:11.718854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb7f66e-dea7-4b80-93ee-62f431d653bd tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:11.719321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb7f66e-dea7-4b80-93ee-62f431d653bd tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:11.720012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb7f66e-dea7-4b80-93ee-62f431d653bd tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:11.720463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb7f66e-dea7-4b80-93ee-62f431d653bd tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:11.720890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eeb7f66e-dea7-4b80-93ee-62f431d653bd tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:11.852250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eeb7f66e-dea7-4b80-93ee-62f431d653bd tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:11.860441 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eeb7f66e-dea7-4b80-93ee-62f431d653bd tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1322 microversion: 2.1 time: 0.154018 Sep 10 21:32:11.861029 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3262/6396] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:11 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:12.884301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f5447f61-a986-4419-a899-934e492c8eac tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:12.884819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f5447f61-a986-4419-a899-934e492c8eac tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:12.891614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5447f61-a986-4419-a899-934e492c8eac tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:12.892101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5447f61-a986-4419-a899-934e492c8eac tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:12.892539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5447f61-a986-4419-a899-934e492c8eac tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:12.893227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5447f61-a986-4419-a899-934e492c8eac tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:12.893720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5447f61-a986-4419-a899-934e492c8eac tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:12.894347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5447f61-a986-4419-a899-934e492c8eac tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:13.029570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f5447f61-a986-4419-a899-934e492c8eac tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:13.038170 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f5447f61-a986-4419-a899-934e492c8eac tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1322 microversion: 2.1 time: 0.157794 Sep 10 21:32:13.038746 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3135/6397] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:12 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:13.921767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7c4169c4-f9c5-4a73-89da-4ccb7ac16981 req-4218f850-0d8f-495b-87ed-65972f8b17d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b816a727-213f-486d-a023-f5fd9b5aafd6", "name": "network-vif-plugged", "status": "completed", "tag": "198e1495-1a0c-42c1-a38f-129c37c09f42"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:13.931719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7c4169c4-f9c5-4a73-89da-4ccb7ac16981 req-4218f850-0d8f-495b-87ed-65972f8b17d1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:13.932198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7c4169c4-f9c5-4a73-89da-4ccb7ac16981 req-4218f850-0d8f-495b-87ed-65972f8b17d1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:13.932633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7c4169c4-f9c5-4a73-89da-4ccb7ac16981 req-4218f850-0d8f-495b-87ed-65972f8b17d1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:13.944064 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7c4169c4-f9c5-4a73-89da-4ccb7ac16981 req-4218f850-0d8f-495b-87ed-65972f8b17d1 service nova] Creating event network-vif-plugged:198e1495-1a0c-42c1-a38f-129c37c09f42 for instance b816a727-213f-486d-a023-f5fd9b5aafd6 on nch2-master-1 Sep 10 21:32:13.949080 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7c4169c4-f9c5-4a73-89da-4ccb7ac16981 req-4218f850-0d8f-495b-87ed-65972f8b17d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094339 Sep 10 21:32:13.949683 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3263/6398] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:32:14.063571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ee05235-a726-41ef-9e09-a41d989b6139 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:14.064187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0ee05235-a726-41ef-9e09-a41d989b6139 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:14.071380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee05235-a726-41ef-9e09-a41d989b6139 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:14.071874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee05235-a726-41ef-9e09-a41d989b6139 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:14.072315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee05235-a726-41ef-9e09-a41d989b6139 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:14.073111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee05235-a726-41ef-9e09-a41d989b6139 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:14.073612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee05235-a726-41ef-9e09-a41d989b6139 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:14.074125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ee05235-a726-41ef-9e09-a41d989b6139 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:14.210720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0ee05235-a726-41ef-9e09-a41d989b6139 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:14.218398 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0ee05235-a726-41ef-9e09-a41d989b6139 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1322 microversion: 2.1 time: 0.158731 Sep 10 21:32:14.218969 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3136/6399] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:14 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:15.239313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:15.240124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:15.245178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-55b846f2-b6c9-40df-bd80-ddd8e8a001be tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:15.245899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-55b846f2-b6c9-40df-bd80-ddd8e8a001be tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:15.253092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55b846f2-b6c9-40df-bd80-ddd8e8a001be tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:15.253606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55b846f2-b6c9-40df-bd80-ddd8e8a001be tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:15.254081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55b846f2-b6c9-40df-bd80-ddd8e8a001be tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:15.255296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55b846f2-b6c9-40df-bd80-ddd8e8a001be tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:15.255775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55b846f2-b6c9-40df-bd80-ddd8e8a001be tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:15.256272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-55b846f2-b6c9-40df-bd80-ddd8e8a001be tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:15.387456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-55b846f2-b6c9-40df-bd80-ddd8e8a001be tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:15.395866 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-55b846f2-b6c9-40df-bd80-ddd8e8a001be tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1322 microversion: 2.1 time: 0.157018 Sep 10 21:32:15.396441 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3264/6400] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:15 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:16.418883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4096565b-02ae-4810-b753-0d469a7ee3d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:16.419520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4096565b-02ae-4810-b753-0d469a7ee3d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:16.421426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:16.428649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4096565b-02ae-4810-b753-0d469a7ee3d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:16.429137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4096565b-02ae-4810-b753-0d469a7ee3d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:16.429573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4096565b-02ae-4810-b753-0d469a7ee3d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:16.430300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4096565b-02ae-4810-b753-0d469a7ee3d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:16.430756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4096565b-02ae-4810-b753-0d469a7ee3d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:16.431180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4096565b-02ae-4810-b753-0d469a7ee3d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:16.560857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4096565b-02ae-4810-b753-0d469a7ee3d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:16.569499 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4096565b-02ae-4810-b753-0d469a7ee3d7 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1471 microversion: 2.1 time: 0.154536 Sep 10 21:32:16.570126 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3137/6401] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:16 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:16.647802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fe029f1c-da86-467d-af1e-37fe9e7eebc8 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Calling method '.version_select at 0x7f993feda9d0>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:16.717241 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fe029f1c-da86-467d-af1e-37fe9e7eebc8 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/8401746486cd43369ed2cca6a7ac7603" status: 200 len: 371 microversion: 2.1 time: 0.126271 Sep 10 21:32:16.717849 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3265/6402] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Sep 10 21:32:16 2022] GET /compute/v2.1/os-quota-sets/8401746486cd43369ed2cca6a7ac7603 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:32:16.730338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e45e61bf-2336-4d88-8957-a034d92959a9 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-342280518", "id": 1172134910, "os-flavor-access:is_public": "True"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:16.749984 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e45e61bf-2336-4d88-8957-a034d92959a9 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023387 Sep 10 21:32:16.750612 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3138/6403] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:32:16 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:32:16.763108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1172134910"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:16.765352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:16.771472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:16.771958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:16.772402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:16.773099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:16.773559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:16.774022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:16.916559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5436bb53ff54427e808fcffd2203619c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8401746486cd43369ed2cca6a7ac7603', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:16.922790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-342280518 {{(pid=145772) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:32:16.930321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:16.930857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:16.931242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:16.931974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:16.932427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:16.932854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:16.952751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Getting quotas for project 474a67ba997844588d0fb15769b8da21. Resources: {'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:32:16.957783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Getting quotas for user 6c2d7fb5ad6842a082c7fb21f0be87a9 and project 474a67ba997844588d0fb15769b8da21. Resources: {'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:32:16.971294 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.compute.api [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] ram quota exceeded for 8401746486cd43369ed2cca6a7ac7603, tried to resize instance. Sep 10 21:32:16.971840 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Request method failure captured: Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6/action HTTP/1.1 Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 39 Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQJTCCMX5hEtTynu05Kj42lL00fPdn4A8iiKTTZWr64OGpRnTE_M42CPwS2XNJfwWFkmsS-A3iXC-fCNhMiugmj66YpeYaJsXHnMCfSe-LbsBkj9PGGkVzElXAW4VvOoYUN-1XmbCsnKkmM45Kav-UqINM-rowWOlipJR7ZnO76nFbY Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 8401746486cd43369ed2cca6a7ac7603 Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-420190226 Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,admin,reader Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,admin,reader Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8401746486cd43369ed2cca6a7ac7603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8401746486cd43369ed2cca6a7ac7603"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8401746486cd43369ed2cca6a7ac7603", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8401746486cd43369ed2cca6a7ac7603"}]}] Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersAdminNegativeTestJSON-420190226 Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 8401746486cd43369ed2cca6a7ac7603 Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-420190226 Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersAdminNegativeTestJSON-420190226-project-admin Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5436bb53ff54427e808fcffd2203619c Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersAdminNegativeTestJSON-420190226-project-admin Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: {"resize": {"flavorRef": "1172134910"}} Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'b816a727-213f-486d-a023-f5fd9b5aafd6', 'body': {'resize': {'flavorRef': '1172134910'}}} Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:32:16.977480 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5e47e41a-5b73-4812-90cf-f2276e0d9be6 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6/action" status: 403 len: 118 microversion: 2.1 time: 0.219789 Sep 10 21:32:16.981629 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3266/6404] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:32:16 2022] POST /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6/action => generated 118 bytes in 221 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:32:16.988360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d478f57b-3c9b-45bd-beb6-ca6d6128bb31 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:17.005956 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d478f57b-3c9b-45bd-beb6-ca6d6128bb31 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1172134910" status: 202 len: 0 microversion: 2.1 time: 0.021307 Sep 10 21:32:17.006521 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3139/6405] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Sep 10 21:32:16 2022] DELETE /compute/v2.1/flavors/1172134910 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:32:17.014365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-79d1e5c8-f0ef-423e-9231-c36824f6e964 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:17.034931 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-79d1e5c8-f0ef-423e-9231-c36824f6e964 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024126 Sep 10 21:32:17.035506 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3267/6406] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 21:32:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:17.057172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7a01796a-2aaf-47c3-81a1-70a69797c523 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Calling method '.version_select at 0x7f993f8c9310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:17.133398 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7a01796a-2aaf-47c3-81a1-70a69797c523 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/8401746486cd43369ed2cca6a7ac7603" status: 200 len: 371 microversion: 2.1 time: 0.079868 Sep 10 21:32:17.134082 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3140/6407] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Sep 10 21:32:17 2022] GET /compute/v2.1/os-quota-sets/8401746486cd43369ed2cca6a7ac7603 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:32:17.147049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-209bf7ef-bd75-4dd2-acc9-2d4962876134 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1845315050", "id": 242603460, "os-flavor-access:is_public": "True"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:17.164398 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-209bf7ef-bd75-4dd2-acc9-2d4962876134 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021656 Sep 10 21:32:17.164976 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3268/6408] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:32:17 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:32:17.177527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "242603460"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:17.179919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:17.186026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:17.186449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:17.186880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:17.187570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:17.188018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:17.188443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:17.331225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5436bb53ff54427e808fcffd2203619c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8401746486cd43369ed2cca6a7ac7603', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:17.337544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1845315050 {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:32:17.344227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:17.344708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:17.345175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:17.345943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:17.346400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:17.346827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:17.371862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Getting quotas for project 474a67ba997844588d0fb15769b8da21. Resources: {'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:32:17.376838 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Getting quotas for user 6c2d7fb5ad6842a082c7fb21f0be87a9 and project 474a67ba997844588d0fb15769b8da21. Resources: {'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:32:17.389465 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.compute.api [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] cores quota exceeded for 8401746486cd43369ed2cca6a7ac7603, tried to resize instance. Sep 10 21:32:17.390319 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Request method failure captured: Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6/action HTTP/1.1 Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 38 Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQJTCCMX5hEtTynu05Kj42lL00fPdn4A8iiKTTZWr64OGpRnTE_M42CPwS2XNJfwWFkmsS-A3iXC-fCNhMiugmj66YpeYaJsXHnMCfSe-LbsBkj9PGGkVzElXAW4VvOoYUN-1XmbCsnKkmM45Kav-UqINM-rowWOlipJR7ZnO76nFbY Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 8401746486cd43369ed2cca6a7ac7603 Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-420190226 Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,admin,reader Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,admin,reader Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8401746486cd43369ed2cca6a7ac7603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8401746486cd43369ed2cca6a7ac7603"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8401746486cd43369ed2cca6a7ac7603", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8401746486cd43369ed2cca6a7ac7603"}]}] Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersAdminNegativeTestJSON-420190226 Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 8401746486cd43369ed2cca6a7ac7603 Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-420190226 Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersAdminNegativeTestJSON-420190226-project-admin Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5436bb53ff54427e808fcffd2203619c Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersAdminNegativeTestJSON-420190226-project-admin Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: {"resize": {"flavorRef": "242603460"}} Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b816a727-213f-486d-a023-f5fd9b5aafd6', 'body': {'resize': {'flavorRef': '242603460'}}} Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:32:17.405257 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b4d2eda1-d753-4034-ac6e-5baad3e58860 tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6/action" status: 403 len: 113 microversion: 2.1 time: 0.233559 Sep 10 21:32:17.409381 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3141/6409] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:32:17 2022] POST /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6/action => generated 113 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:32:17.415551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-12f39255-af12-4075-9522-59fb654bfacb tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:17.433595 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-12f39255-af12-4075-9522-59fb654bfacb tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/242603460" status: 202 len: 0 microversion: 2.1 time: 0.021722 Sep 10 21:32:17.434564 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3269/6410] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Sep 10 21:32:17 2022] DELETE /compute/v2.1/flavors/242603460 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:32:17.443005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b8f462d-6031-4a2f-a798-3fde3384c30c tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:17.462586 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5b8f462d-6031-4a2f-a798-3fde3384c30c tempest-ServersAdminNegativeTestJSON-420190226 tempest-ServersAdminNegativeTestJSON-420190226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024058 Sep 10 21:32:17.463147 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3142/6411] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Sep 10 21:32:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:17.485861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cdcbe6ae-8fd3-4e1a-8c12-cb0020daaba1 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:17.486368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cdcbe6ae-8fd3-4e1a-8c12-cb0020daaba1 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:17.494048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdcbe6ae-8fd3-4e1a-8c12-cb0020daaba1 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:17.494731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdcbe6ae-8fd3-4e1a-8c12-cb0020daaba1 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:17.495275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdcbe6ae-8fd3-4e1a-8c12-cb0020daaba1 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:17.495976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdcbe6ae-8fd3-4e1a-8c12-cb0020daaba1 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:17.496433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdcbe6ae-8fd3-4e1a-8c12-cb0020daaba1 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:17.496860 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cdcbe6ae-8fd3-4e1a-8c12-cb0020daaba1 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:17.522796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cdcbe6ae-8fd3-4e1a-8c12-cb0020daaba1 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:32:17.599307 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cdcbe6ae-8fd3-4e1a-8c12-cb0020daaba1 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 204 len: 0 microversion: 2.1 time: 0.116527 Sep 10 21:32:17.600071 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3270/6412] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:32:17 2022] DELETE /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:32:17.608386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f0ee10ad-3989-4672-b475-a2110f74af78 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:17.609305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f0ee10ad-3989-4672-b475-a2110f74af78 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:17.617117 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0ee10ad-3989-4672-b475-a2110f74af78 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:17.617611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0ee10ad-3989-4672-b475-a2110f74af78 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:17.618113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0ee10ad-3989-4672-b475-a2110f74af78 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:17.618813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0ee10ad-3989-4672-b475-a2110f74af78 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:17.619278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0ee10ad-3989-4672-b475-a2110f74af78 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:17.619716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f0ee10ad-3989-4672-b475-a2110f74af78 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:17.749912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f0ee10ad-3989-4672-b475-a2110f74af78 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:17.757786 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f0ee10ad-3989-4672-b475-a2110f74af78 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1477 microversion: 2.1 time: 0.153305 Sep 10 21:32:17.758390 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3143/6413] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:17 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:18.782442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9e1c4fba-ef5b-4890-9973-f9a0b86dbf8f tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:18.783062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9e1c4fba-ef5b-4890-9973-f9a0b86dbf8f tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:18.791044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1c4fba-ef5b-4890-9973-f9a0b86dbf8f tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:18.791534 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1c4fba-ef5b-4890-9973-f9a0b86dbf8f tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:18.791980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1c4fba-ef5b-4890-9973-f9a0b86dbf8f tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:18.792685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1c4fba-ef5b-4890-9973-f9a0b86dbf8f tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:18.793140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1c4fba-ef5b-4890-9973-f9a0b86dbf8f tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:18.793571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9e1c4fba-ef5b-4890-9973-f9a0b86dbf8f tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:18.922393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9e1c4fba-ef5b-4890-9973-f9a0b86dbf8f tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:18.930772 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9e1c4fba-ef5b-4890-9973-f9a0b86dbf8f tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1477 microversion: 2.1 time: 0.152724 Sep 10 21:32:18.931354 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3271/6414] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:18 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:19.456694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-56426b84-248e-4fb8-8103-7f8018e2142b req-02d72b89-a732-4839-a67d-5ac25b693c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b816a727-213f-486d-a023-f5fd9b5aafd6", "name": "network-vif-deleted", "tag": "198e1495-1a0c-42c1-a38f-129c37c09f42"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:19.470309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-56426b84-248e-4fb8-8103-7f8018e2142b req-02d72b89-a732-4839-a67d-5ac25b693c9c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:19.470797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-56426b84-248e-4fb8-8103-7f8018e2142b req-02d72b89-a732-4839-a67d-5ac25b693c9c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:19.471245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-56426b84-248e-4fb8-8103-7f8018e2142b req-02d72b89-a732-4839-a67d-5ac25b693c9c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:19.495529 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-56426b84-248e-4fb8-8103-7f8018e2142b req-02d72b89-a732-4839-a67d-5ac25b693c9c service nova] Creating event network-vif-deleted:198e1495-1a0c-42c1-a38f-129c37c09f42 for instance b816a727-213f-486d-a023-f5fd9b5aafd6 on nch2-master-1 Sep 10 21:32:19.502672 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-56426b84-248e-4fb8-8103-7f8018e2142b req-02d72b89-a732-4839-a67d-5ac25b693c9c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050847 Sep 10 21:32:19.503675 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3144/6415] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:32:19.954158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:19.954774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:19.961977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:19.962468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:19.963092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:19.963887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:19.964515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:19.964949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:20.004193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:20.005131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:20.005781 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:20.006370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lazy-loading 'fault' on Instance uuid b816a727-213f-486d-a023-f5fd9b5aafd6 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:32:20.049696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2d7fb5ad6842a082c7fb21f0be87a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474a67ba997844588d0fb15769b8da21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:20.057884 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ce2c0e02-9451-42e4-9033-41542c62f235 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 200 len: 1312 microversion: 2.1 time: 0.107682 Sep 10 21:32:20.058483 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3272/6416] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:19 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:21.081000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:21.081691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] [instance: b816a727-213f-486d-a023-f5fd9b5aafd6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:21.089150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:21.089635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:21.090387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:21.091087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:21.091541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:21.091995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:21.105565 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] HTTP exception thrown: Instance b816a727-213f-486d-a023-f5fd9b5aafd6 could not be found. Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Request method failure captured: Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 HTTP/1.1 Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQJTS_XWAIWHfFRuHTwR1UML4Mr54N2I9PPuRNznDWtIOJnG8HsNQCGK-Obe-bFJD0mNt3DH_0VtODdN4QptgwuabSBCSi3slUxWKUVwRno6sWzjHQaanARbF0jZYwDqmlFYobzPEgBMA5NDSvYmnRCRCotspuCRurgrxc7OXvAVBFA Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 474a67ba997844588d0fb15769b8da21 Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1667196504 Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/474a67ba997844588d0fb15769b8da21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/474a67ba997844588d0fb15769b8da21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_474a67ba997844588d0fb15769b8da21", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/474a67ba997844588d0fb15769b8da21"}]}] Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1667196504 Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 474a67ba997844588d0fb15769b8da21 Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1667196504 Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersAdminNegativeTestJSON-1667196504-project Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 6c2d7fb5ad6842a082c7fb21f0be87a9 Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1667196504-project Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance b816a727-213f-486d-a023-f5fd9b5aafd6 could not be found. Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'b816a727-213f-486d-a023-f5fd9b5aafd6'} Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b816a727-213f-486d-a023-f5fd9b5aafd6 could not be found. Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b816a727-213f-486d-a023-f5fd9b5aafd6 could not be found. Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:21.107188 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b816a727-213f-486d-a023-f5fd9b5aafd6 could not be found. Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] Returning 404 to user: Instance b816a727-213f-486d-a023-f5fd9b5aafd6 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d5e78ae1-086d-4e12-854e-e0eac4deabd0 tempest-ServersAdminNegativeTestJSON-1667196504 tempest-ServersAdminNegativeTestJSON-1667196504-project] 10.222.0.33 "GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6" status: 404 len: 111 microversion: 2.1 time: 0.031832 Sep 10 21:32:21.112157 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3145/6417] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:21 2022] GET /compute/v2.1/servers/b816a727-213f-486d-a023-f5fd9b5aafd6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:32:27.575181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:27.576797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:27.722914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1076374145", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "36f502d5-ce0f-4ef4-9538-34a8ddf69cc6"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:27.785812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] validate_networks() for [('36f502d5-ce0f-4ef4-9538-34a8ddf69cc6', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:32:28.196954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:32:28.197386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:32:28.197905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:32:28.198326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:32:28.198744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:32:28.208525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:28.209175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:28.209721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:28.210510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:28.210975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:28.211410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:28.231006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Getting quotas for project 3671b4249813424fb1afb48dcaacc44d. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:32:28.236914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Getting quotas for user 12f7ddc093ef459f97956ed5c7d74449 and project 3671b4249813424fb1afb48dcaacc44d. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:32:28.250120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:32:28.252602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:32:28.302498 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6d1e0c03-ff84-4287-bb04-372e2e87eed1 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732538 Sep 10 21:32:28.304083 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3273/6418] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:32:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:32:28.315752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0967113d-d620-46ec-8202-b31b8c102ea9 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:28.316528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0967113d-d620-46ec-8202-b31b8c102ea9 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:28.320732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:28.321852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:28.388960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0967113d-d620-46ec-8202-b31b8c102ea9 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:28.398816 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0967113d-d620-46ec-8202-b31b8c102ea9 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1215 microversion: 2.1 time: 0.087352 Sep 10 21:32:28.401934 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3146/6419] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:28 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:29.423698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a88e9d54-b841-4b3e-bcfa-124cef34cac3 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:29.424389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a88e9d54-b841-4b3e-bcfa-124cef34cac3 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:29.432843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a88e9d54-b841-4b3e-bcfa-124cef34cac3 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:29.433466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a88e9d54-b841-4b3e-bcfa-124cef34cac3 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:29.434184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a88e9d54-b841-4b3e-bcfa-124cef34cac3 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:29.434992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a88e9d54-b841-4b3e-bcfa-124cef34cac3 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:29.435528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a88e9d54-b841-4b3e-bcfa-124cef34cac3 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:29.436047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a88e9d54-b841-4b3e-bcfa-124cef34cac3 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:29.537563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a88e9d54-b841-4b3e-bcfa-124cef34cac3 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:29.547755 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a88e9d54-b841-4b3e-bcfa-124cef34cac3 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1275 microversion: 2.1 time: 0.129229 Sep 10 21:32:29.549674 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3274/6420] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:29 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1275 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:30.573362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-987a0090-3316-47a5-8ec4-12ccf4e999bb tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:30.574999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-987a0090-3316-47a5-8ec4-12ccf4e999bb tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:30.582871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987a0090-3316-47a5-8ec4-12ccf4e999bb tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:30.584075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987a0090-3316-47a5-8ec4-12ccf4e999bb tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:30.585026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987a0090-3316-47a5-8ec4-12ccf4e999bb tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:30.585814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987a0090-3316-47a5-8ec4-12ccf4e999bb tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:30.586705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987a0090-3316-47a5-8ec4-12ccf4e999bb tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:30.587226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-987a0090-3316-47a5-8ec4-12ccf4e999bb tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:30.757480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-987a0090-3316-47a5-8ec4-12ccf4e999bb tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:30.765754 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-987a0090-3316-47a5-8ec4-12ccf4e999bb tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1315 microversion: 2.1 time: 0.196476 Sep 10 21:32:30.768922 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3147/6421] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:30 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:30.975090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-77166700-c5aa-4bb8-8f08-2a80bb15cd49 req-8f8e90dd-94ee-418d-8e20-7691aae95a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73268625-e2a5-4868-9838-5acbe9967b8c", "tag": "c3a3acc7-d5d2-47a9-a845-9bcc4c31f257"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:30.996558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-77166700-c5aa-4bb8-8f08-2a80bb15cd49 req-8f8e90dd-94ee-418d-8e20-7691aae95a7e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:30.997135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-77166700-c5aa-4bb8-8f08-2a80bb15cd49 req-8f8e90dd-94ee-418d-8e20-7691aae95a7e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:30.997570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-77166700-c5aa-4bb8-8f08-2a80bb15cd49 req-8f8e90dd-94ee-418d-8e20-7691aae95a7e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:31.011528 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-77166700-c5aa-4bb8-8f08-2a80bb15cd49 req-8f8e90dd-94ee-418d-8e20-7691aae95a7e service nova] Creating event network-changed:c3a3acc7-d5d2-47a9-a845-9bcc4c31f257 for instance 73268625-e2a5-4868-9838-5acbe9967b8c on nch2-master-1 Sep 10 21:32:31.017784 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-77166700-c5aa-4bb8-8f08-2a80bb15cd49 req-8f8e90dd-94ee-418d-8e20-7691aae95a7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053493 Sep 10 21:32:31.018664 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3275/6422] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:32:31.789789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-30093906-59e7-4c3e-b310-1500dceacda6 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:31.790349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-30093906-59e7-4c3e-b310-1500dceacda6 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:31.797199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30093906-59e7-4c3e-b310-1500dceacda6 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:31.797711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30093906-59e7-4c3e-b310-1500dceacda6 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:31.798190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30093906-59e7-4c3e-b310-1500dceacda6 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:31.798882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30093906-59e7-4c3e-b310-1500dceacda6 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:31.799332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30093906-59e7-4c3e-b310-1500dceacda6 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:31.799753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-30093906-59e7-4c3e-b310-1500dceacda6 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:31.933097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-30093906-59e7-4c3e-b310-1500dceacda6 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:31.940925 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-30093906-59e7-4c3e-b310-1500dceacda6 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1315 microversion: 2.1 time: 0.155130 Sep 10 21:32:31.941503 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3148/6423] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:31 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:32.965617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8941f3f-c837-4a55-8ced-5d336e519b44 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:32.966274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8941f3f-c837-4a55-8ced-5d336e519b44 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:32.973596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8941f3f-c837-4a55-8ced-5d336e519b44 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:32.974391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8941f3f-c837-4a55-8ced-5d336e519b44 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:32.974845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8941f3f-c837-4a55-8ced-5d336e519b44 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:32.975567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8941f3f-c837-4a55-8ced-5d336e519b44 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:32.976031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8941f3f-c837-4a55-8ced-5d336e519b44 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:32.976467 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8941f3f-c837-4a55-8ced-5d336e519b44 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:33.109194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8941f3f-c837-4a55-8ced-5d336e519b44 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:33.117899 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8941f3f-c837-4a55-8ced-5d336e519b44 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1315 microversion: 2.1 time: 0.156739 Sep 10 21:32:33.118474 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3276/6424] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:32 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:34.142503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7e25d50b-0c52-4b8d-a0ad-0ef76d392c1a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:34.143041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7e25d50b-0c52-4b8d-a0ad-0ef76d392c1a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:34.150570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e25d50b-0c52-4b8d-a0ad-0ef76d392c1a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:34.151056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e25d50b-0c52-4b8d-a0ad-0ef76d392c1a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:34.151498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e25d50b-0c52-4b8d-a0ad-0ef76d392c1a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:34.152187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e25d50b-0c52-4b8d-a0ad-0ef76d392c1a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:34.152639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e25d50b-0c52-4b8d-a0ad-0ef76d392c1a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:34.153062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e25d50b-0c52-4b8d-a0ad-0ef76d392c1a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:34.286249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7e25d50b-0c52-4b8d-a0ad-0ef76d392c1a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:34.294688 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7e25d50b-0c52-4b8d-a0ad-0ef76d392c1a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1315 microversion: 2.1 time: 0.156168 Sep 10 21:32:34.295283 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3149/6425] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:34 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:35.318949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-63e5ef0b-73e1-4d45-8ad3-59ce04f89bea tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:35.319577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-63e5ef0b-73e1-4d45-8ad3-59ce04f89bea tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:35.324571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:35.328488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63e5ef0b-73e1-4d45-8ad3-59ce04f89bea tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:35.328989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63e5ef0b-73e1-4d45-8ad3-59ce04f89bea tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:35.329433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63e5ef0b-73e1-4d45-8ad3-59ce04f89bea tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:35.330192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63e5ef0b-73e1-4d45-8ad3-59ce04f89bea tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:35.330652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63e5ef0b-73e1-4d45-8ad3-59ce04f89bea tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:35.331145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-63e5ef0b-73e1-4d45-8ad3-59ce04f89bea tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:35.334603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:35.495134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-63e5ef0b-73e1-4d45-8ad3-59ce04f89bea tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:35.502861 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-63e5ef0b-73e1-4d45-8ad3-59ce04f89bea tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1315 microversion: 2.1 time: 0.188773 Sep 10 21:32:35.503451 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3277/6426] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:35 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:32:36.526946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e09a5347-e9f5-451b-97ea-9b0d0558d5ba tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:36.527504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e09a5347-e9f5-451b-97ea-9b0d0558d5ba tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:36.530212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:36.535670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09a5347-e9f5-451b-97ea-9b0d0558d5ba tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:36.536153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09a5347-e9f5-451b-97ea-9b0d0558d5ba tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:36.536660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09a5347-e9f5-451b-97ea-9b0d0558d5ba tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:36.537643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09a5347-e9f5-451b-97ea-9b0d0558d5ba tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:36.538132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09a5347-e9f5-451b-97ea-9b0d0558d5ba tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:36.538586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e09a5347-e9f5-451b-97ea-9b0d0558d5ba tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:36.543996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=78 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:36.672085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e09a5347-e9f5-451b-97ea-9b0d0558d5ba tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:36.682555 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e09a5347-e9f5-451b-97ea-9b0d0558d5ba tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1315 microversion: 2.1 time: 0.159524 Sep 10 21:32:36.683148 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3150/6427] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:36 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:32:37.707050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-13e4d640-98ff-4ef1-9ed2-64f366d1d923 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:37.707697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-13e4d640-98ff-4ef1-9ed2-64f366d1d923 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:37.715239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13e4d640-98ff-4ef1-9ed2-64f366d1d923 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:37.715730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13e4d640-98ff-4ef1-9ed2-64f366d1d923 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:37.716173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13e4d640-98ff-4ef1-9ed2-64f366d1d923 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:37.716874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13e4d640-98ff-4ef1-9ed2-64f366d1d923 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:37.717331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13e4d640-98ff-4ef1-9ed2-64f366d1d923 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:37.717760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13e4d640-98ff-4ef1-9ed2-64f366d1d923 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:37.854968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13e4d640-98ff-4ef1-9ed2-64f366d1d923 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:37.863120 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-13e4d640-98ff-4ef1-9ed2-64f366d1d923 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1315 microversion: 2.1 time: 0.159990 Sep 10 21:32:37.863833 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3278/6428] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:37 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:37.923919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-10a7c1e4-8252-4aec-87a7-ba3577fa215d req-61bd673c-e00f-4e8f-820b-e1846a8d57cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73268625-e2a5-4868-9838-5acbe9967b8c", "name": "network-vif-plugged", "status": "completed", "tag": "c3a3acc7-d5d2-47a9-a845-9bcc4c31f257"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:37.935454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-10a7c1e4-8252-4aec-87a7-ba3577fa215d req-61bd673c-e00f-4e8f-820b-e1846a8d57cb service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:37.935995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-10a7c1e4-8252-4aec-87a7-ba3577fa215d req-61bd673c-e00f-4e8f-820b-e1846a8d57cb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:37.936496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-10a7c1e4-8252-4aec-87a7-ba3577fa215d req-61bd673c-e00f-4e8f-820b-e1846a8d57cb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:37.948799 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-10a7c1e4-8252-4aec-87a7-ba3577fa215d req-61bd673c-e00f-4e8f-820b-e1846a8d57cb service nova] Creating event network-vif-plugged:c3a3acc7-d5d2-47a9-a845-9bcc4c31f257 for instance 73268625-e2a5-4868-9838-5acbe9967b8c on nch2-master-1 Sep 10 21:32:37.953779 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-10a7c1e4-8252-4aec-87a7-ba3577fa215d req-61bd673c-e00f-4e8f-820b-e1846a8d57cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033502 Sep 10 21:32:37.954429 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3151/6429] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:32:38.887527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5074f6e-9509-44bb-9660-4042917ee691 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:38.888138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5074f6e-9509-44bb-9660-4042917ee691 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:38.890035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:38.890727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:38.898064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5074f6e-9509-44bb-9660-4042917ee691 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:38.898550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5074f6e-9509-44bb-9660-4042917ee691 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:38.898989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5074f6e-9509-44bb-9660-4042917ee691 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:38.899677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5074f6e-9509-44bb-9660-4042917ee691 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:38.900129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5074f6e-9509-44bb-9660-4042917ee691 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:38.900556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5074f6e-9509-44bb-9660-4042917ee691 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:39.033575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a5074f6e-9509-44bb-9660-4042917ee691 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:39.041610 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5074f6e-9509-44bb-9660-4042917ee691 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1315 microversion: 2.1 time: 0.158131 Sep 10 21:32:39.042223 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3279/6430] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:38 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:40.062727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:32:40.068149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e06c7e00-8a4f-4fe3-a9dd-dd9c7dbea3cf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:40.068923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e06c7e00-8a4f-4fe3-a9dd-dd9c7dbea3cf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:40.075489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e06c7e00-8a4f-4fe3-a9dd-dd9c7dbea3cf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:40.075977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e06c7e00-8a4f-4fe3-a9dd-dd9c7dbea3cf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:40.076408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e06c7e00-8a4f-4fe3-a9dd-dd9c7dbea3cf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:40.077105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e06c7e00-8a4f-4fe3-a9dd-dd9c7dbea3cf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:40.077556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e06c7e00-8a4f-4fe3-a9dd-dd9c7dbea3cf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:40.078020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e06c7e00-8a4f-4fe3-a9dd-dd9c7dbea3cf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:40.215580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e06c7e00-8a4f-4fe3-a9dd-dd9c7dbea3cf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:40.224020 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e06c7e00-8a4f-4fe3-a9dd-dd9c7dbea3cf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1502 microversion: 2.1 time: 0.162259 Sep 10 21:32:40.224968 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3152/6431] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:40 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:40.247348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:32:40.249571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:40.256965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:40.257442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:40.257914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:40.258637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:40.259091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:40.259520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:40.290302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:40.295846 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Old instance type m1.heat2, new instance type m1.heat {{(pid=145772) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:32:40.303033 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:32:40.303457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:32:40.303939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:32:40.304353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:32:40.304766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:32:40.366635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c042c3dd-6571-4b74-829d-596cc3f7b69d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "POST /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c/action" status: 202 len: 0 microversion: 2.1 time: 0.123303 Sep 10 21:32:40.367260 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3280/6432] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:32:40 2022] POST /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:32:40.375570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1b55dc39-ecdf-4cdd-af10-67bdc7d7e81c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:40.376185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1b55dc39-ecdf-4cdd-af10-67bdc7d7e81c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:40.383280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b55dc39-ecdf-4cdd-af10-67bdc7d7e81c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:40.383818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b55dc39-ecdf-4cdd-af10-67bdc7d7e81c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:40.384266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b55dc39-ecdf-4cdd-af10-67bdc7d7e81c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:40.384960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b55dc39-ecdf-4cdd-af10-67bdc7d7e81c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:40.385415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b55dc39-ecdf-4cdd-af10-67bdc7d7e81c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:40.385858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b55dc39-ecdf-4cdd-af10-67bdc7d7e81c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:40.521929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1b55dc39-ecdf-4cdd-af10-67bdc7d7e81c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:40.529922 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1b55dc39-ecdf-4cdd-af10-67bdc7d7e81c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1511 microversion: 2.1 time: 0.158189 Sep 10 21:32:40.530509 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3153/6433] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:40 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:41.556483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a30d5929-e315-4781-b7c1-2b954af0460a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:41.557109 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a30d5929-e315-4781-b7c1-2b954af0460a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:41.564684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a30d5929-e315-4781-b7c1-2b954af0460a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:41.565216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a30d5929-e315-4781-b7c1-2b954af0460a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:41.565661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a30d5929-e315-4781-b7c1-2b954af0460a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:41.566495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a30d5929-e315-4781-b7c1-2b954af0460a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:41.567019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a30d5929-e315-4781-b7c1-2b954af0460a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:41.567464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a30d5929-e315-4781-b7c1-2b954af0460a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:41.699196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a30d5929-e315-4781-b7c1-2b954af0460a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:41.706968 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a30d5929-e315-4781-b7c1-2b954af0460a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1511 microversion: 2.1 time: 0.155940 Sep 10 21:32:41.707544 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3281/6434] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:41 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:32:42.729182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-813f3709-9824-4838-b7b1-ced3f87512e8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:42.729955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-813f3709-9824-4838-b7b1-ced3f87512e8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:42.736978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-813f3709-9824-4838-b7b1-ced3f87512e8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:42.737465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-813f3709-9824-4838-b7b1-ced3f87512e8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:42.737927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-813f3709-9824-4838-b7b1-ced3f87512e8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:42.738618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-813f3709-9824-4838-b7b1-ced3f87512e8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:42.739073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-813f3709-9824-4838-b7b1-ced3f87512e8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:42.740052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-813f3709-9824-4838-b7b1-ced3f87512e8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:42.869646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-813f3709-9824-4838-b7b1-ced3f87512e8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:42.877392 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-813f3709-9824-4838-b7b1-ced3f87512e8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.152092 Sep 10 21:32:42.878002 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3154/6435] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:42 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:32:43.902235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bb78f41c-0faa-4009-b806-dcc55197d0fe tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:43.902855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bb78f41c-0faa-4009-b806-dcc55197d0fe tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:43.909782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb78f41c-0faa-4009-b806-dcc55197d0fe tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:43.910300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb78f41c-0faa-4009-b806-dcc55197d0fe tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:43.910746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb78f41c-0faa-4009-b806-dcc55197d0fe tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:43.911473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb78f41c-0faa-4009-b806-dcc55197d0fe tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:43.912020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb78f41c-0faa-4009-b806-dcc55197d0fe tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:43.912471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bb78f41c-0faa-4009-b806-dcc55197d0fe tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:44.044834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bb78f41c-0faa-4009-b806-dcc55197d0fe tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:44.053481 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bb78f41c-0faa-4009-b806-dcc55197d0fe tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.155227 Sep 10 21:32:44.054092 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3282/6436] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:43 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:45.077504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-970dabab-b771-4a73-a4aa-25bddbd5fc43 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:45.078140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-970dabab-b771-4a73-a4aa-25bddbd5fc43 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:45.085195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-970dabab-b771-4a73-a4aa-25bddbd5fc43 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:45.085675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-970dabab-b771-4a73-a4aa-25bddbd5fc43 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:45.086155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-970dabab-b771-4a73-a4aa-25bddbd5fc43 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:45.086847 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-970dabab-b771-4a73-a4aa-25bddbd5fc43 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:45.087303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-970dabab-b771-4a73-a4aa-25bddbd5fc43 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:45.087725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-970dabab-b771-4a73-a4aa-25bddbd5fc43 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:45.219633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-970dabab-b771-4a73-a4aa-25bddbd5fc43 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:45.228092 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-970dabab-b771-4a73-a4aa-25bddbd5fc43 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.154389 Sep 10 21:32:45.228578 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3155/6437] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:45 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:46.252551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f9d37620-354b-41a8-81e8-63f060eeb866 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:46.253110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f9d37620-354b-41a8-81e8-63f060eeb866 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:46.259519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9d37620-354b-41a8-81e8-63f060eeb866 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:46.260007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9d37620-354b-41a8-81e8-63f060eeb866 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:46.260448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9d37620-354b-41a8-81e8-63f060eeb866 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:46.261145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9d37620-354b-41a8-81e8-63f060eeb866 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:46.261604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9d37620-354b-41a8-81e8-63f060eeb866 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:46.262068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f9d37620-354b-41a8-81e8-63f060eeb866 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:46.394928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f9d37620-354b-41a8-81e8-63f060eeb866 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:46.403502 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f9d37620-354b-41a8-81e8-63f060eeb866 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.155297 Sep 10 21:32:46.404085 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3283/6438] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:46 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:47.427889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85d84dd2-e9bb-4d84-a823-9a76bdedf349 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:47.428495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-85d84dd2-e9bb-4d84-a823-9a76bdedf349 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:47.434894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85d84dd2-e9bb-4d84-a823-9a76bdedf349 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:47.435398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85d84dd2-e9bb-4d84-a823-9a76bdedf349 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:47.435833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85d84dd2-e9bb-4d84-a823-9a76bdedf349 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:47.436529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85d84dd2-e9bb-4d84-a823-9a76bdedf349 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:47.436993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85d84dd2-e9bb-4d84-a823-9a76bdedf349 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:47.437425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85d84dd2-e9bb-4d84-a823-9a76bdedf349 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:47.575018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-85d84dd2-e9bb-4d84-a823-9a76bdedf349 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:47.582766 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-85d84dd2-e9bb-4d84-a823-9a76bdedf349 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.158803 Sep 10 21:32:47.583980 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3156/6439] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:47 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:32:48.607141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a4abc48d-771e-4f89-bc88-b66fb48bbcc8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:48.607757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a4abc48d-771e-4f89-bc88-b66fb48bbcc8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:48.615932 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4abc48d-771e-4f89-bc88-b66fb48bbcc8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:48.616485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4abc48d-771e-4f89-bc88-b66fb48bbcc8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:48.616630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4abc48d-771e-4f89-bc88-b66fb48bbcc8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:48.617485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4abc48d-771e-4f89-bc88-b66fb48bbcc8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:48.617979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4abc48d-771e-4f89-bc88-b66fb48bbcc8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:48.618412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4abc48d-771e-4f89-bc88-b66fb48bbcc8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:48.747702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a4abc48d-771e-4f89-bc88-b66fb48bbcc8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:48.756160 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a4abc48d-771e-4f89-bc88-b66fb48bbcc8 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.152923 Sep 10 21:32:48.756743 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3284/6440] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:48 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:49.779534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-160116ee-b9f9-40c5-a734-518b303ea97a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:49.780143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-160116ee-b9f9-40c5-a734-518b303ea97a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:49.787031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-160116ee-b9f9-40c5-a734-518b303ea97a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:49.787541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-160116ee-b9f9-40c5-a734-518b303ea97a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:49.787977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-160116ee-b9f9-40c5-a734-518b303ea97a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:49.788741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-160116ee-b9f9-40c5-a734-518b303ea97a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:49.789193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-160116ee-b9f9-40c5-a734-518b303ea97a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:49.789617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-160116ee-b9f9-40c5-a734-518b303ea97a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:49.924709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-160116ee-b9f9-40c5-a734-518b303ea97a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:49.933135 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-160116ee-b9f9-40c5-a734-518b303ea97a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.157499 Sep 10 21:32:49.933703 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3157/6441] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:49 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:50.959673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-89fa96d0-92f5-4a27-9ba5-415dd7851f8f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:50.960291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-89fa96d0-92f5-4a27-9ba5-415dd7851f8f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:50.967470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89fa96d0-92f5-4a27-9ba5-415dd7851f8f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:50.967968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89fa96d0-92f5-4a27-9ba5-415dd7851f8f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:50.968409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89fa96d0-92f5-4a27-9ba5-415dd7851f8f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:50.969108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89fa96d0-92f5-4a27-9ba5-415dd7851f8f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:50.969565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89fa96d0-92f5-4a27-9ba5-415dd7851f8f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:50.970031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-89fa96d0-92f5-4a27-9ba5-415dd7851f8f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:51.104136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-89fa96d0-92f5-4a27-9ba5-415dd7851f8f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:51.112078 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-89fa96d0-92f5-4a27-9ba5-415dd7851f8f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.157525 Sep 10 21:32:51.112654 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3285/6442] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:50 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:52.137200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-10da3b34-2a54-4950-887b-5b7a5ae8656f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:52.137819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-10da3b34-2a54-4950-887b-5b7a5ae8656f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:52.144823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10da3b34-2a54-4950-887b-5b7a5ae8656f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:52.145316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10da3b34-2a54-4950-887b-5b7a5ae8656f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:52.146031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10da3b34-2a54-4950-887b-5b7a5ae8656f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:52.146727 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10da3b34-2a54-4950-887b-5b7a5ae8656f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:52.147191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10da3b34-2a54-4950-887b-5b7a5ae8656f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:52.147624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-10da3b34-2a54-4950-887b-5b7a5ae8656f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:52.283036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-10da3b34-2a54-4950-887b-5b7a5ae8656f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:52.291638 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-10da3b34-2a54-4950-887b-5b7a5ae8656f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.159260 Sep 10 21:32:52.292218 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3158/6443] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:52 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:53.315652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-edd732b1-f406-4f09-91c4-5c3d3e83cbd2 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:53.316527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-edd732b1-f406-4f09-91c4-5c3d3e83cbd2 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:53.324064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edd732b1-f406-4f09-91c4-5c3d3e83cbd2 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:53.324542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edd732b1-f406-4f09-91c4-5c3d3e83cbd2 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:53.324984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edd732b1-f406-4f09-91c4-5c3d3e83cbd2 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:53.325673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edd732b1-f406-4f09-91c4-5c3d3e83cbd2 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:53.326152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edd732b1-f406-4f09-91c4-5c3d3e83cbd2 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:53.326578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-edd732b1-f406-4f09-91c4-5c3d3e83cbd2 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:53.459315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-edd732b1-f406-4f09-91c4-5c3d3e83cbd2 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:53.467149 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-edd732b1-f406-4f09-91c4-5c3d3e83cbd2 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.155396 Sep 10 21:32:53.467718 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3286/6444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:53 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:54.492599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-44863f05-6f9a-4a88-885f-462d1eb03b31 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:54.493244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-44863f05-6f9a-4a88-885f-462d1eb03b31 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:54.500177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44863f05-6f9a-4a88-885f-462d1eb03b31 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:54.500662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44863f05-6f9a-4a88-885f-462d1eb03b31 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:54.501101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44863f05-6f9a-4a88-885f-462d1eb03b31 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:54.501793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44863f05-6f9a-4a88-885f-462d1eb03b31 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:54.502281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44863f05-6f9a-4a88-885f-462d1eb03b31 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:54.502712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-44863f05-6f9a-4a88-885f-462d1eb03b31 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:54.634309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-44863f05-6f9a-4a88-885f-462d1eb03b31 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:54.642233 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-44863f05-6f9a-4a88-885f-462d1eb03b31 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.154238 Sep 10 21:32:54.642810 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3159/6445] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:54 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:55.665767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-841deec9-e074-434f-a22a-c803bdab75ab tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:55.666417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-841deec9-e074-434f-a22a-c803bdab75ab tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:55.673776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-841deec9-e074-434f-a22a-c803bdab75ab tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:55.674587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-841deec9-e074-434f-a22a-c803bdab75ab tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:55.675026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-841deec9-e074-434f-a22a-c803bdab75ab tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:55.675715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-841deec9-e074-434f-a22a-c803bdab75ab tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:55.676167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-841deec9-e074-434f-a22a-c803bdab75ab tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:55.676622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-841deec9-e074-434f-a22a-c803bdab75ab tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:55.808461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-841deec9-e074-434f-a22a-c803bdab75ab tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:55.816128 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-841deec9-e074-434f-a22a-c803bdab75ab tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.154260 Sep 10 21:32:55.816830 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3287/6446] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:55 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:56.839969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3367817-0915-4975-abfa-18ab4b088b13 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:56.840711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e3367817-0915-4975-abfa-18ab4b088b13 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:56.849019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3367817-0915-4975-abfa-18ab4b088b13 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:56.849513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3367817-0915-4975-abfa-18ab4b088b13 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:56.849980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3367817-0915-4975-abfa-18ab4b088b13 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:56.850713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3367817-0915-4975-abfa-18ab4b088b13 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:56.851180 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3367817-0915-4975-abfa-18ab4b088b13 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:56.851611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3367817-0915-4975-abfa-18ab4b088b13 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:56.980439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e3367817-0915-4975-abfa-18ab4b088b13 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:56.989694 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3367817-0915-4975-abfa-18ab4b088b13 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.153538 Sep 10 21:32:56.990315 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3160/6447] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:56 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:58.013858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1fc143ce-70ea-43c2-9e38-f1a2a5a01945 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:58.014489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1fc143ce-70ea-43c2-9e38-f1a2a5a01945 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:58.021806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fc143ce-70ea-43c2-9e38-f1a2a5a01945 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:58.022353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fc143ce-70ea-43c2-9e38-f1a2a5a01945 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:58.022818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fc143ce-70ea-43c2-9e38-f1a2a5a01945 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:58.023541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fc143ce-70ea-43c2-9e38-f1a2a5a01945 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:58.024009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fc143ce-70ea-43c2-9e38-f1a2a5a01945 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:58.024477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fc143ce-70ea-43c2-9e38-f1a2a5a01945 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:58.167196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1fc143ce-70ea-43c2-9e38-f1a2a5a01945 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:58.174990 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1fc143ce-70ea-43c2-9e38-f1a2a5a01945 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.165080 Sep 10 21:32:58.175574 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3288/6448] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:58 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:32:59.198537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e93aaeff-d8d7-4812-9158-4f849f44530f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:32:59.199148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e93aaeff-d8d7-4812-9158-4f849f44530f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:32:59.206040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e93aaeff-d8d7-4812-9158-4f849f44530f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:59.206527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e93aaeff-d8d7-4812-9158-4f849f44530f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:59.206959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e93aaeff-d8d7-4812-9158-4f849f44530f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:59.207719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e93aaeff-d8d7-4812-9158-4f849f44530f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:32:59.208179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e93aaeff-d8d7-4812-9158-4f849f44530f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:32:59.208595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e93aaeff-d8d7-4812-9158-4f849f44530f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:32:59.342659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e93aaeff-d8d7-4812-9158-4f849f44530f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:32:59.350878 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e93aaeff-d8d7-4812-9158-4f849f44530f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.156356 Sep 10 21:32:59.351452 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3161/6449] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:32:59 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:33:00.375003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0f5fea9-f533-4684-ad74-19a32eb5a41b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:00.375618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0f5fea9-f533-4684-ad74-19a32eb5a41b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:00.383282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0f5fea9-f533-4684-ad74-19a32eb5a41b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:00.383766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0f5fea9-f533-4684-ad74-19a32eb5a41b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:00.384234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0f5fea9-f533-4684-ad74-19a32eb5a41b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:00.384933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0f5fea9-f533-4684-ad74-19a32eb5a41b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:00.385386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0f5fea9-f533-4684-ad74-19a32eb5a41b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:00.385809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0f5fea9-f533-4684-ad74-19a32eb5a41b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:00.515096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0f5fea9-f533-4684-ad74-19a32eb5a41b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:00.523462 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0f5fea9-f533-4684-ad74-19a32eb5a41b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.152432 Sep 10 21:33:00.524039 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3289/6450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:00 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:01.546927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0839b06e-4f4e-4dcc-9346-522092471f2e tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:01.547546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0839b06e-4f4e-4dcc-9346-522092471f2e tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:01.555252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0839b06e-4f4e-4dcc-9346-522092471f2e tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:01.555740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0839b06e-4f4e-4dcc-9346-522092471f2e tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:01.556179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0839b06e-4f4e-4dcc-9346-522092471f2e tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:01.556872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0839b06e-4f4e-4dcc-9346-522092471f2e tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:01.557330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0839b06e-4f4e-4dcc-9346-522092471f2e tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:01.557758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0839b06e-4f4e-4dcc-9346-522092471f2e tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:01.692956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0839b06e-4f4e-4dcc-9346-522092471f2e tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:01.700804 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0839b06e-4f4e-4dcc-9346-522092471f2e tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.157826 Sep 10 21:33:01.701396 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3162/6451] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:01 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:02.725437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3116b632-f94c-4642-99c0-334c39b3c15b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:02.726065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3116b632-f94c-4642-99c0-334c39b3c15b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:02.732983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3116b632-f94c-4642-99c0-334c39b3c15b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:02.733463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3116b632-f94c-4642-99c0-334c39b3c15b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:02.734177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3116b632-f94c-4642-99c0-334c39b3c15b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:02.734865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3116b632-f94c-4642-99c0-334c39b3c15b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:02.735319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3116b632-f94c-4642-99c0-334c39b3c15b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:02.735744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3116b632-f94c-4642-99c0-334c39b3c15b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:02.869449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3116b632-f94c-4642-99c0-334c39b3c15b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:02.877140 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3116b632-f94c-4642-99c0-334c39b3c15b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.156441 Sep 10 21:33:02.877715 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3290/6452] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:02 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:03.900699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-190e111f-a251-45b7-891a-44f44e0cdd32 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:03.901300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-190e111f-a251-45b7-891a-44f44e0cdd32 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:03.908254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-190e111f-a251-45b7-891a-44f44e0cdd32 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:03.908730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-190e111f-a251-45b7-891a-44f44e0cdd32 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:03.909172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-190e111f-a251-45b7-891a-44f44e0cdd32 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:03.909884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-190e111f-a251-45b7-891a-44f44e0cdd32 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:03.910347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-190e111f-a251-45b7-891a-44f44e0cdd32 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:03.911285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-190e111f-a251-45b7-891a-44f44e0cdd32 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:04.046186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-190e111f-a251-45b7-891a-44f44e0cdd32 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:04.054767 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-190e111f-a251-45b7-891a-44f44e0cdd32 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.157923 Sep 10 21:33:04.055347 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3163/6453] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:03 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:05.078117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-45923d26-bece-4a8d-82f4-c260c8c0192b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:05.078729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-45923d26-bece-4a8d-82f4-c260c8c0192b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:05.085616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45923d26-bece-4a8d-82f4-c260c8c0192b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:05.086131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45923d26-bece-4a8d-82f4-c260c8c0192b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:05.086569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45923d26-bece-4a8d-82f4-c260c8c0192b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:05.087260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45923d26-bece-4a8d-82f4-c260c8c0192b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:05.087714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45923d26-bece-4a8d-82f4-c260c8c0192b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:05.088139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-45923d26-bece-4a8d-82f4-c260c8c0192b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:05.217392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-45923d26-bece-4a8d-82f4-c260c8c0192b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:05.225446 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-45923d26-bece-4a8d-82f4-c260c8c0192b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.151204 Sep 10 21:33:05.226193 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3291/6454] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:05 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:06.250108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bb196a7e-d645-4866-967e-378bc638486d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:06.250644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bb196a7e-d645-4866-967e-378bc638486d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:06.258165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb196a7e-d645-4866-967e-378bc638486d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:06.258663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb196a7e-d645-4866-967e-378bc638486d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:06.259105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb196a7e-d645-4866-967e-378bc638486d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:06.259799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb196a7e-d645-4866-967e-378bc638486d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:06.260260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb196a7e-d645-4866-967e-378bc638486d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:06.260688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb196a7e-d645-4866-967e-378bc638486d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:06.389408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bb196a7e-d645-4866-967e-378bc638486d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:06.398069 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bb196a7e-d645-4866-967e-378bc638486d tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.151920 Sep 10 21:33:06.398653 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3164/6455] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:06 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:07.421509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-97eb6270-947d-405c-8b84-b2a923310ad0 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:07.422149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-97eb6270-947d-405c-8b84-b2a923310ad0 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:07.424867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=34 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:07.431004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97eb6270-947d-405c-8b84-b2a923310ad0 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:07.431448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97eb6270-947d-405c-8b84-b2a923310ad0 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:07.431887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97eb6270-947d-405c-8b84-b2a923310ad0 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:07.432621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97eb6270-947d-405c-8b84-b2a923310ad0 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:07.433105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97eb6270-947d-405c-8b84-b2a923310ad0 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:07.433536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97eb6270-947d-405c-8b84-b2a923310ad0 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:07.436674 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:07.570170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-97eb6270-947d-405c-8b84-b2a923310ad0 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:07.578009 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-97eb6270-947d-405c-8b84-b2a923310ad0 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.160439 Sep 10 21:33:07.578597 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3292/6456] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:07 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:08.601900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-28eb29c0-dae7-4764-a582-d92be2cf9684 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:08.602507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-28eb29c0-dae7-4764-a582-d92be2cf9684 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:08.605274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=30 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:08.611275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28eb29c0-dae7-4764-a582-d92be2cf9684 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:08.611770 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28eb29c0-dae7-4764-a582-d92be2cf9684 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:08.612208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28eb29c0-dae7-4764-a582-d92be2cf9684 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:08.612912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28eb29c0-dae7-4764-a582-d92be2cf9684 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:08.613372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28eb29c0-dae7-4764-a582-d92be2cf9684 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:08.614414 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-28eb29c0-dae7-4764-a582-d92be2cf9684 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:08.617235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=86 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:08.750801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-28eb29c0-dae7-4764-a582-d92be2cf9684 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:08.758654 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-28eb29c0-dae7-4764-a582-d92be2cf9684 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1516 microversion: 2.1 time: 0.161430 Sep 10 21:33:08.759231 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3165/6457] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:08 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:09.782738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a85aedc1-6cba-445d-910a-0650dceac937 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:09.783316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a85aedc1-6cba-445d-910a-0650dceac937 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:09.790321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85aedc1-6cba-445d-910a-0650dceac937 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:09.790812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85aedc1-6cba-445d-910a-0650dceac937 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:09.791254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85aedc1-6cba-445d-910a-0650dceac937 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:09.791960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85aedc1-6cba-445d-910a-0650dceac937 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:09.792415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85aedc1-6cba-445d-910a-0650dceac937 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:09.792843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a85aedc1-6cba-445d-910a-0650dceac937 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:10.062903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a85aedc1-6cba-445d-910a-0650dceac937 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:10.070949 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a85aedc1-6cba-445d-910a-0650dceac937 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1515 microversion: 2.1 time: 0.292188 Sep 10 21:33:10.071537 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3293/6458] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:09 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:10.182690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0bd23de4-70e6-4d07-b1fc-8954721c99a7 req-32d6606e-8693-4fe5-b3a9-80b2a34855e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73268625-e2a5-4868-9838-5acbe9967b8c", "name": "network-vif-unplugged", "status": "completed", "tag": "c3a3acc7-d5d2-47a9-a845-9bcc4c31f257"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:33:10.193582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0bd23de4-70e6-4d07-b1fc-8954721c99a7 req-32d6606e-8693-4fe5-b3a9-80b2a34855e4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:10.194136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0bd23de4-70e6-4d07-b1fc-8954721c99a7 req-32d6606e-8693-4fe5-b3a9-80b2a34855e4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:10.194873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0bd23de4-70e6-4d07-b1fc-8954721c99a7 req-32d6606e-8693-4fe5-b3a9-80b2a34855e4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:10.209007 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0bd23de4-70e6-4d07-b1fc-8954721c99a7 req-32d6606e-8693-4fe5-b3a9-80b2a34855e4 service nova] Creating event network-vif-unplugged:c3a3acc7-d5d2-47a9-a845-9bcc4c31f257 for instance 73268625-e2a5-4868-9838-5acbe9967b8c on nch1-master-1 Sep 10 21:33:10.214632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-0bd23de4-70e6-4d07-b1fc-8954721c99a7 req-32d6606e-8693-4fe5-b3a9-80b2a34855e4 service nova] Instance 73268625-e2a5-4868-9838-5acbe9967b8c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:33:10.227162 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0bd23de4-70e6-4d07-b1fc-8954721c99a7 req-32d6606e-8693-4fe5-b3a9-80b2a34855e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048291 Sep 10 21:33:10.227778 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3166/6459] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:33:11.095150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-31f34e9c-fedd-4a1b-aeb3-990dedeebc1f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:11.095662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-31f34e9c-fedd-4a1b-aeb3-990dedeebc1f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:11.103161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31f34e9c-fedd-4a1b-aeb3-990dedeebc1f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:11.103648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31f34e9c-fedd-4a1b-aeb3-990dedeebc1f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:11.104089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31f34e9c-fedd-4a1b-aeb3-990dedeebc1f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:11.104789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31f34e9c-fedd-4a1b-aeb3-990dedeebc1f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:11.105249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31f34e9c-fedd-4a1b-aeb3-990dedeebc1f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:11.105705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-31f34e9c-fedd-4a1b-aeb3-990dedeebc1f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:11.239819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31f34e9c-fedd-4a1b-aeb3-990dedeebc1f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:11.247629 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-31f34e9c-fedd-4a1b-aeb3-990dedeebc1f tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1513 microversion: 2.1 time: 0.156538 Sep 10 21:33:11.248217 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3294/6460] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:11 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:12.245589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b1ad3a06-7584-4760-9fce-c19fed05451a req-9935f60b-1b62-4ab2-8934-207341cc0fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73268625-e2a5-4868-9838-5acbe9967b8c", "tag": "c3a3acc7-d5d2-47a9-a845-9bcc4c31f257"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:33:12.256214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b1ad3a06-7584-4760-9fce-c19fed05451a req-9935f60b-1b62-4ab2-8934-207341cc0fd7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:12.256695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b1ad3a06-7584-4760-9fce-c19fed05451a req-9935f60b-1b62-4ab2-8934-207341cc0fd7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:12.257130 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b1ad3a06-7584-4760-9fce-c19fed05451a req-9935f60b-1b62-4ab2-8934-207341cc0fd7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:12.268499 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b1ad3a06-7584-4760-9fce-c19fed05451a req-9935f60b-1b62-4ab2-8934-207341cc0fd7 service nova] Creating event network-changed:c3a3acc7-d5d2-47a9-a845-9bcc4c31f257 for instance 73268625-e2a5-4868-9838-5acbe9967b8c on nch1-master-1 Sep 10 21:33:12.271430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-da79bc89-8c35-488b-9d07-df7d00594cce tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:12.272044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-da79bc89-8c35-488b-9d07-df7d00594cce tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:12.274191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-b1ad3a06-7584-4760-9fce-c19fed05451a req-9935f60b-1b62-4ab2-8934-207341cc0fd7 service nova] Instance 73268625-e2a5-4868-9838-5acbe9967b8c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:33:12.279833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da79bc89-8c35-488b-9d07-df7d00594cce tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:12.280470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da79bc89-8c35-488b-9d07-df7d00594cce tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:12.280905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da79bc89-8c35-488b-9d07-df7d00594cce tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:12.281603 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da79bc89-8c35-488b-9d07-df7d00594cce tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:12.282381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da79bc89-8c35-488b-9d07-df7d00594cce tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:12.282806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-da79bc89-8c35-488b-9d07-df7d00594cce tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:12.285082 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b1ad3a06-7584-4760-9fce-c19fed05451a req-9935f60b-1b62-4ab2-8934-207341cc0fd7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043447 Sep 10 21:33:12.286945 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3167/6461] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:33:12.494954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-da79bc89-8c35-488b-9d07-df7d00594cce tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:12.502842 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-da79bc89-8c35-488b-9d07-df7d00594cce tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1513 microversion: 2.1 time: 0.235392 Sep 10 21:33:12.503431 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3295/6462] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:12 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:33:13.527264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f29ef50-6ddf-459c-851b-f951cf78685b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:13.527963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8f29ef50-6ddf-459c-851b-f951cf78685b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:13.534175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f29ef50-6ddf-459c-851b-f951cf78685b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:13.534663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f29ef50-6ddf-459c-851b-f951cf78685b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:13.535112 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f29ef50-6ddf-459c-851b-f951cf78685b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:13.535797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f29ef50-6ddf-459c-851b-f951cf78685b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:13.536255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f29ef50-6ddf-459c-851b-f951cf78685b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:13.536683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f29ef50-6ddf-459c-851b-f951cf78685b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:13.667819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8f29ef50-6ddf-459c-851b-f951cf78685b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:13.675668 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8f29ef50-6ddf-459c-851b-f951cf78685b tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1513 microversion: 2.1 time: 0.153538 Sep 10 21:33:13.677060 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3168/6463] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:13 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:14.700851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bd34a22c-9c31-48a6-93fe-37e08c00db02 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:14.701457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bd34a22c-9c31-48a6-93fe-37e08c00db02 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:14.708540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd34a22c-9c31-48a6-93fe-37e08c00db02 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:14.709018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd34a22c-9c31-48a6-93fe-37e08c00db02 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:14.709449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd34a22c-9c31-48a6-93fe-37e08c00db02 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:14.710166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd34a22c-9c31-48a6-93fe-37e08c00db02 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:14.710616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd34a22c-9c31-48a6-93fe-37e08c00db02 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:14.711042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bd34a22c-9c31-48a6-93fe-37e08c00db02 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:14.841030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bd34a22c-9c31-48a6-93fe-37e08c00db02 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:14.849707 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bd34a22c-9c31-48a6-93fe-37e08c00db02 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1510 microversion: 2.1 time: 0.152727 Sep 10 21:33:14.850312 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3296/6464] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:14 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:14.872723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:14.873252 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:14.880471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:14.880952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:14.881388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:14.882101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:14.882554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:14.882974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:14.912630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:33:14.962095 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.compute.api [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Found an unconfirmed migration during delete, id: 16, status: finished Sep 10 21:33:16.769026 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ca6fc608-22c5-4504-a9fa-d37c6b63680a tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "DELETE /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 204 len: 0 microversion: 2.1 time: 1.899866 Sep 10 21:33:16.769944 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3169/6465] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:33:14 2022] DELETE /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 0 bytes in 1901 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:33:16.778213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5637a4e-5215-481c-84bc-1a7c412855bc tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:16.778966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e5637a4e-5215-481c-84bc-1a7c412855bc tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:16.785707 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5637a4e-5215-481c-84bc-1a7c412855bc tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:16.786475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5637a4e-5215-481c-84bc-1a7c412855bc tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:16.787136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5637a4e-5215-481c-84bc-1a7c412855bc tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:16.787854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5637a4e-5215-481c-84bc-1a7c412855bc tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:16.788316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5637a4e-5215-481c-84bc-1a7c412855bc tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:16.788750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e5637a4e-5215-481c-84bc-1a7c412855bc tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:16.918980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e5637a4e-5215-481c-84bc-1a7c412855bc tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:16.927098 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5637a4e-5215-481c-84bc-1a7c412855bc tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1502 microversion: 2.1 time: 0.152830 Sep 10 21:33:16.927683 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3297/6466] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:16 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:17.951696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0572842-beff-4c07-95b7-fc31193e6fdf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:17.952451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0572842-beff-4c07-95b7-fc31193e6fdf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:17.959843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0572842-beff-4c07-95b7-fc31193e6fdf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:17.960332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0572842-beff-4c07-95b7-fc31193e6fdf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:17.960775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0572842-beff-4c07-95b7-fc31193e6fdf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:17.961474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0572842-beff-4c07-95b7-fc31193e6fdf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:17.961958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0572842-beff-4c07-95b7-fc31193e6fdf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:17.962396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0572842-beff-4c07-95b7-fc31193e6fdf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:18.104686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c0572842-beff-4c07-95b7-fc31193e6fdf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7ddc093ef459f97956ed5c7d74449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3671b4249813424fb1afb48dcaacc44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:18.113057 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0572842-beff-4c07-95b7-fc31193e6fdf tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 200 len: 1502 microversion: 2.1 time: 0.165610 Sep 10 21:33:18.114031 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3170/6467] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:17 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:18.213859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-88daa7ac-ab00-44a8-bbb8-fd1be8135b59 req-99ba8a2e-4d39-4b40-a206-2405af73c61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73268625-e2a5-4868-9838-5acbe9967b8c", "name": "network-vif-plugged", "status": "completed", "tag": "c3a3acc7-d5d2-47a9-a845-9bcc4c31f257"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:33:18.226267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-88daa7ac-ab00-44a8-bbb8-fd1be8135b59 req-99ba8a2e-4d39-4b40-a206-2405af73c61d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:18.227113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-88daa7ac-ab00-44a8-bbb8-fd1be8135b59 req-99ba8a2e-4d39-4b40-a206-2405af73c61d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:18.227422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-88daa7ac-ab00-44a8-bbb8-fd1be8135b59 req-99ba8a2e-4d39-4b40-a206-2405af73c61d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:18.239779 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-88daa7ac-ab00-44a8-bbb8-fd1be8135b59 req-99ba8a2e-4d39-4b40-a206-2405af73c61d service nova] Creating event network-vif-plugged:c3a3acc7-d5d2-47a9-a845-9bcc4c31f257 for instance 73268625-e2a5-4868-9838-5acbe9967b8c on nch1-master-1 Sep 10 21:33:18.244831 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-88daa7ac-ab00-44a8-bbb8-fd1be8135b59 req-99ba8a2e-4d39-4b40-a206-2405af73c61d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037859 Sep 10 21:33:18.245434 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3298/6468] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:33:18.847891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a01b3714-7fe9-400d-b862-e9b2adad5d4a req-54b7a132-9d08-4acb-b158-893e5c307950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73268625-e2a5-4868-9838-5acbe9967b8c", "name": "network-vif-deleted", "tag": "c3a3acc7-d5d2-47a9-a845-9bcc4c31f257"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:33:18.859452 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a01b3714-7fe9-400d-b862-e9b2adad5d4a req-54b7a132-9d08-4acb-b158-893e5c307950 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:18.859929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a01b3714-7fe9-400d-b862-e9b2adad5d4a req-54b7a132-9d08-4acb-b158-893e5c307950 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:18.860358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a01b3714-7fe9-400d-b862-e9b2adad5d4a req-54b7a132-9d08-4acb-b158-893e5c307950 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:18.873457 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a01b3714-7fe9-400d-b862-e9b2adad5d4a req-54b7a132-9d08-4acb-b158-893e5c307950 service nova] Creating event network-vif-deleted:c3a3acc7-d5d2-47a9-a845-9bcc4c31f257 for instance 73268625-e2a5-4868-9838-5acbe9967b8c on nch1-master-1 Sep 10 21:33:18.879721 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a01b3714-7fe9-400d-b862-e9b2adad5d4a req-54b7a132-9d08-4acb-b158-893e5c307950 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034867 Sep 10 21:33:18.880728 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3171/6469] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:33:19.137372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:19.138106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:19.144627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:19.145238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:19.145686 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:19.146512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:19.146977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:19.147409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:19.163594 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] HTTP exception thrown: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Request method failure captured: Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c HTTP/1.1 Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQJrgmWJZ8Emc4CeXGt471Ct_8dochxdVJ9jEKhrMi1fFlrHwfje6eg8W35roYEhEHC7Od3uUgru1JWyoCV_sfmpZKbJ73-e9fdwv62Ve1JDukXMxH_fYzH8H42jf6CMi2AZNddtmwx1bRz7N72YI-W9XzgMYQ6KHwB5N-de9wTAO8g Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 3671b4249813424fb1afb48dcaacc44d Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersTestJSON-1288285622 Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3671b4249813424fb1afb48dcaacc44d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3671b4249813424fb1afb48dcaacc44d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3671b4249813424fb1afb48dcaacc44d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3671b4249813424fb1afb48dcaacc44d"}]}] Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersTestJSON-1288285622 Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 3671b4249813424fb1afb48dcaacc44d Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersTestJSON-1288285622 Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersTestJSON-1288285622-project Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 12f7ddc093ef459f97956ed5c7d74449 Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersTestJSON-1288285622-project Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '73268625-e2a5-4868-9838-5acbe9967b8c'} Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:33:19.165280 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.170191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:33:19.170191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:33:19.170191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:33:19.170191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:33:19.170191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:33:19.170191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.170191 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.170191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Returning 404 to user: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:33:19.170191 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8eb48311-4fb7-4d91-b726-a7d143c51f14 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 404 len: 111 microversion: 2.1 time: 0.033736 Sep 10 21:33:19.170191 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3299/6470] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:19 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:33:19.181338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:19.182126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:19.189498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:19.190042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:19.190488 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:19.191726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:19.192373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:19.192819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:19.207662 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] HTTP exception thrown: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Request method failure captured: Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: request: DELETE /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c HTTP/1.1 Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQJrgmWJZ8Emc4CeXGt471Ct_8dochxdVJ9jEKhrMi1fFlrHwfje6eg8W35roYEhEHC7Od3uUgru1JWyoCV_sfmpZKbJ73-e9fdwv62Ve1JDukXMxH_fYzH8H42jf6CMi2AZNddtmwx1bRz7N72YI-W9XzgMYQ6KHwB5N-de9wTAO8g Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 3671b4249813424fb1afb48dcaacc44d Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-DeleteServersTestJSON-1288285622 Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3671b4249813424fb1afb48dcaacc44d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3671b4249813424fb1afb48dcaacc44d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3671b4249813424fb1afb48dcaacc44d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3671b4249813424fb1afb48dcaacc44d"}]}] Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-DeleteServersTestJSON-1288285622 Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 3671b4249813424fb1afb48dcaacc44d Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-DeleteServersTestJSON-1288285622 Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-DeleteServersTestJSON-1288285622-project Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 12f7ddc093ef459f97956ed5c7d74449 Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-DeleteServersTestJSON-1288285622-project Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '73268625-e2a5-4868-9838-5acbe9967b8c'} Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:33:19.209431 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Returning 404 to user: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eaa0efbc-765d-462a-b5fa-4c5b2271704c tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "DELETE /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 404 len: 111 microversion: 2.1 time: 0.034810 Sep 10 21:33:19.214760 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3172/6471] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:33:19 2022] DELETE /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:33:19.219564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:19.220480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] [instance: 73268625-e2a5-4868-9838-5acbe9967b8c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:19.227508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:19.228029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:19.228474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:19.229183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:19.229649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:19.230117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:19.244239 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] HTTP exception thrown: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Request method failure captured: Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c HTTP/1.1 Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQJrgmWJZ8Emc4CeXGt471Ct_8dochxdVJ9jEKhrMi1fFlrHwfje6eg8W35roYEhEHC7Od3uUgru1JWyoCV_sfmpZKbJ73-e9fdwv62Ve1JDukXMxH_fYzH8H42jf6CMi2AZNddtmwx1bRz7N72YI-W9XzgMYQ6KHwB5N-de9wTAO8g Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 3671b4249813424fb1afb48dcaacc44d Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-DeleteServersTestJSON-1288285622 Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3671b4249813424fb1afb48dcaacc44d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3671b4249813424fb1afb48dcaacc44d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3671b4249813424fb1afb48dcaacc44d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3671b4249813424fb1afb48dcaacc44d"}]}] Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-DeleteServersTestJSON-1288285622 Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 3671b4249813424fb1afb48dcaacc44d Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-DeleteServersTestJSON-1288285622 Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-DeleteServersTestJSON-1288285622-project Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 12f7ddc093ef459f97956ed5c7d74449 Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-DeleteServersTestJSON-1288285622-project Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '73268625-e2a5-4868-9838-5acbe9967b8c'} Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:33:19.245861 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.250059 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:33:19.250059 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:33:19.250059 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:33:19.250059 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:33:19.250059 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:33:19.250059 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. Sep 10 21:33:19.250059 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:33:19.250059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] Returning 404 to user: Instance 73268625-e2a5-4868-9838-5acbe9967b8c could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:33:19.250059 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-39e0075d-fb88-4002-8728-f8c05d3b27e7 tempest-DeleteServersTestJSON-1288285622 tempest-DeleteServersTestJSON-1288285622-project] 10.222.0.33 "GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c" status: 404 len: 111 microversion: 2.1 time: 0.031594 Sep 10 21:33:19.250059 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3300/6472] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:19 2022] GET /compute/v2.1/servers/73268625-e2a5-4868-9838-5acbe9967b8c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:33:28.296132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1670526724", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "279bd1b1-61c4-4913-bce9-054b4d4c40cf"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:33:28.350854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] validate_networks() for [('279bd1b1-61c4-4913-bce9-054b4d4c40cf', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:33:28.736036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:33:28.736470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:33:28.736950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:33:28.737559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:33:28.738105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:33:28.752588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:28.753087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:28.754733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:28.755533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:28.755991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:28.756421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:28.774501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Getting quotas for project 3b494efae18f494a8a8b1d6aa53c4327. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:33:28.785651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Getting quotas for user cf26d0546ef846cb845be454c0e4ad76 and project 3b494efae18f494a8a8b1d6aa53c4327. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:33:28.799547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:33:28.802099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:33:28.850758 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2cffdedc-79af-40f9-ab4f-9705bd658589 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678190 Sep 10 21:33:28.851771 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3173/6473] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:33:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:33:28.863510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b8d800a-a99d-43f0-8b81-bfd78efa19bf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:28.864729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b8d800a-a99d-43f0-8b81-bfd78efa19bf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:28.953414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b8d800a-a99d-43f0-8b81-bfd78efa19bf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:28.968161 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b8d800a-a99d-43f0-8b81-bfd78efa19bf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1218 microversion: 2.1 time: 0.108742 Sep 10 21:33:28.968762 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3301/6474] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:28 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:29.994358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-99f3b622-fa76-4c5a-8946-c7a948688906 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:29.996367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99f3b622-fa76-4c5a-8946-c7a948688906 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:30.004687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99f3b622-fa76-4c5a-8946-c7a948688906 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:30.005186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99f3b622-fa76-4c5a-8946-c7a948688906 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:30.005636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99f3b622-fa76-4c5a-8946-c7a948688906 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:30.006564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99f3b622-fa76-4c5a-8946-c7a948688906 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:30.007043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99f3b622-fa76-4c5a-8946-c7a948688906 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:30.007482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99f3b622-fa76-4c5a-8946-c7a948688906 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:30.089232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-99f3b622-fa76-4c5a-8946-c7a948688906 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:30.100452 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-99f3b622-fa76-4c5a-8946-c7a948688906 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1270 microversion: 2.1 time: 0.110839 Sep 10 21:33:30.101591 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3174/6475] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:29 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:33:31.125990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-81589f35-7663-40f2-bf6e-138e7a75a01f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:31.133442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-81589f35-7663-40f2-bf6e-138e7a75a01f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:31.140646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=41 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:31.143549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81589f35-7663-40f2-bf6e-138e7a75a01f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:31.145169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81589f35-7663-40f2-bf6e-138e7a75a01f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:31.146111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81589f35-7663-40f2-bf6e-138e7a75a01f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:31.148587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81589f35-7663-40f2-bf6e-138e7a75a01f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:31.148587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81589f35-7663-40f2-bf6e-138e7a75a01f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:31.148587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-81589f35-7663-40f2-bf6e-138e7a75a01f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:31.381948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-81589f35-7663-40f2-bf6e-138e7a75a01f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:31.390530 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-81589f35-7663-40f2-bf6e-138e7a75a01f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1318 microversion: 2.1 time: 0.268461 Sep 10 21:33:31.404012 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3302/6476] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:31 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:31.707689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b8c061dd-8ce0-46b4-ad13-f9c594855fe3 req-492aaf59-3e14-41f3-bb02-fa4656b95650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f617c0-2e3f-4c28-b159-eae575fa0ab6", "tag": "a380cb8b-2981-4cae-b897-ac3797a108c0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:33:31.723329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b8c061dd-8ce0-46b4-ad13-f9c594855fe3 req-492aaf59-3e14-41f3-bb02-fa4656b95650 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:31.724311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b8c061dd-8ce0-46b4-ad13-f9c594855fe3 req-492aaf59-3e14-41f3-bb02-fa4656b95650 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:31.724977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b8c061dd-8ce0-46b4-ad13-f9c594855fe3 req-492aaf59-3e14-41f3-bb02-fa4656b95650 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:31.739525 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b8c061dd-8ce0-46b4-ad13-f9c594855fe3 req-492aaf59-3e14-41f3-bb02-fa4656b95650 service nova] Creating event network-changed:a380cb8b-2981-4cae-b897-ac3797a108c0 for instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 on nch2-master-1 Sep 10 21:33:31.744816 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b8c061dd-8ce0-46b4-ad13-f9c594855fe3 req-492aaf59-3e14-41f3-bb02-fa4656b95650 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047639 Sep 10 21:33:31.745515 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3175/6477] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:33:32.415400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a9df74dd-72d4-4655-9639-3f3ff4ea0c85 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:32.416009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9df74dd-72d4-4655-9639-3f3ff4ea0c85 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:32.422863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9df74dd-72d4-4655-9639-3f3ff4ea0c85 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:32.423344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9df74dd-72d4-4655-9639-3f3ff4ea0c85 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:32.423779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9df74dd-72d4-4655-9639-3f3ff4ea0c85 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:32.424468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9df74dd-72d4-4655-9639-3f3ff4ea0c85 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:32.424916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9df74dd-72d4-4655-9639-3f3ff4ea0c85 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:32.426396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9df74dd-72d4-4655-9639-3f3ff4ea0c85 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:32.559676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a9df74dd-72d4-4655-9639-3f3ff4ea0c85 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:32.567808 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a9df74dd-72d4-4655-9639-3f3ff4ea0c85 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1318 microversion: 2.1 time: 0.156265 Sep 10 21:33:32.568373 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3303/6478] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:32 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:33.592280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-88a55e96-2c10-4569-b608-c9f40330b0ae tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:33.593008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-88a55e96-2c10-4569-b608-c9f40330b0ae tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:33.599279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a55e96-2c10-4569-b608-c9f40330b0ae tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:33.599766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a55e96-2c10-4569-b608-c9f40330b0ae tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:33.600201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a55e96-2c10-4569-b608-c9f40330b0ae tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:33.600893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a55e96-2c10-4569-b608-c9f40330b0ae tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:33.601360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a55e96-2c10-4569-b608-c9f40330b0ae tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:33.601769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88a55e96-2c10-4569-b608-c9f40330b0ae tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:33.740775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-88a55e96-2c10-4569-b608-c9f40330b0ae tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:33.748548 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-88a55e96-2c10-4569-b608-c9f40330b0ae tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1318 microversion: 2.1 time: 0.161361 Sep 10 21:33:33.749143 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3176/6479] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:33 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:34.776349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c445850-fe41-452d-9e2e-50b8ceced6b3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:34.776986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1c445850-fe41-452d-9e2e-50b8ceced6b3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:34.783759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c445850-fe41-452d-9e2e-50b8ceced6b3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:34.784236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c445850-fe41-452d-9e2e-50b8ceced6b3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:34.784992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c445850-fe41-452d-9e2e-50b8ceced6b3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:34.785888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c445850-fe41-452d-9e2e-50b8ceced6b3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:34.786345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c445850-fe41-452d-9e2e-50b8ceced6b3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:34.786771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c445850-fe41-452d-9e2e-50b8ceced6b3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:34.921020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1c445850-fe41-452d-9e2e-50b8ceced6b3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:34.929649 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1c445850-fe41-452d-9e2e-50b8ceced6b3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1318 microversion: 2.1 time: 0.157207 Sep 10 21:33:34.930251 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3304/6480] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:34 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:35.953596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70b5166e-a2d1-4ff4-a93a-fe323f474f0e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:35.954376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-70b5166e-a2d1-4ff4-a93a-fe323f474f0e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:35.962281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70b5166e-a2d1-4ff4-a93a-fe323f474f0e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:35.962776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70b5166e-a2d1-4ff4-a93a-fe323f474f0e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:35.963225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70b5166e-a2d1-4ff4-a93a-fe323f474f0e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:35.963934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70b5166e-a2d1-4ff4-a93a-fe323f474f0e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:35.965518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70b5166e-a2d1-4ff4-a93a-fe323f474f0e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:35.965987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70b5166e-a2d1-4ff4-a93a-fe323f474f0e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:36.119413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-70b5166e-a2d1-4ff4-a93a-fe323f474f0e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:36.130201 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-70b5166e-a2d1-4ff4-a93a-fe323f474f0e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1318 microversion: 2.1 time: 0.181165 Sep 10 21:33:36.131026 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3177/6481] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:35 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:37.155440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1699a67e-de69-4b29-8dc0-39dc65cbc531 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:37.156088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1699a67e-de69-4b29-8dc0-39dc65cbc531 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:37.163029 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1699a67e-de69-4b29-8dc0-39dc65cbc531 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:37.163515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1699a67e-de69-4b29-8dc0-39dc65cbc531 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:37.163956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1699a67e-de69-4b29-8dc0-39dc65cbc531 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:37.164656 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1699a67e-de69-4b29-8dc0-39dc65cbc531 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:37.165142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1699a67e-de69-4b29-8dc0-39dc65cbc531 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:37.165575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1699a67e-de69-4b29-8dc0-39dc65cbc531 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:37.293408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1699a67e-de69-4b29-8dc0-39dc65cbc531 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:37.301704 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1699a67e-de69-4b29-8dc0-39dc65cbc531 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1318 microversion: 2.1 time: 0.150191 Sep 10 21:33:37.302325 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3305/6482] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:37 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:38.234622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-656aeb4d-74e1-47c8-bc1c-e2eb0e5d4420 req-552e4a86-2bf3-4029-a9a4-53028d013548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f617c0-2e3f-4c28-b159-eae575fa0ab6", "name": "network-vif-plugged", "status": "completed", "tag": "a380cb8b-2981-4cae-b897-ac3797a108c0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:33:38.247229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-656aeb4d-74e1-47c8-bc1c-e2eb0e5d4420 req-552e4a86-2bf3-4029-a9a4-53028d013548 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:38.247729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-656aeb4d-74e1-47c8-bc1c-e2eb0e5d4420 req-552e4a86-2bf3-4029-a9a4-53028d013548 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:38.248172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-656aeb4d-74e1-47c8-bc1c-e2eb0e5d4420 req-552e4a86-2bf3-4029-a9a4-53028d013548 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:38.260814 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-656aeb4d-74e1-47c8-bc1c-e2eb0e5d4420 req-552e4a86-2bf3-4029-a9a4-53028d013548 service nova] Creating event network-vif-plugged:a380cb8b-2981-4cae-b897-ac3797a108c0 for instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 on nch2-master-1 Sep 10 21:33:38.266050 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-656aeb4d-74e1-47c8-bc1c-e2eb0e5d4420 req-552e4a86-2bf3-4029-a9a4-53028d013548 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035495 Sep 10 21:33:38.266845 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3178/6483] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:33:38.325756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7c826e20-1b2e-4d01-911f-8b0cf3a65bd7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:38.326411 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7c826e20-1b2e-4d01-911f-8b0cf3a65bd7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:38.329137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=30 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:38.335701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c826e20-1b2e-4d01-911f-8b0cf3a65bd7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:38.336434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c826e20-1b2e-4d01-911f-8b0cf3a65bd7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:38.336960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c826e20-1b2e-4d01-911f-8b0cf3a65bd7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:38.337673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c826e20-1b2e-4d01-911f-8b0cf3a65bd7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:38.338185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c826e20-1b2e-4d01-911f-8b0cf3a65bd7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:38.338632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c826e20-1b2e-4d01-911f-8b0cf3a65bd7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:38.505661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7c826e20-1b2e-4d01-911f-8b0cf3a65bd7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:38.513284 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7c826e20-1b2e-4d01-911f-8b0cf3a65bd7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1318 microversion: 2.1 time: 0.192231 Sep 10 21:33:38.513877 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3306/6484] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:38 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:39.539379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5f161ed2-921f-4f5b-bee8-ba0a66193eaa tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:39.539996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5f161ed2-921f-4f5b-bee8-ba0a66193eaa tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:39.541998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:39.542659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:39.544798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:39.552341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f161ed2-921f-4f5b-bee8-ba0a66193eaa tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:39.552911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f161ed2-921f-4f5b-bee8-ba0a66193eaa tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:39.553351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f161ed2-921f-4f5b-bee8-ba0a66193eaa tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:39.554069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f161ed2-921f-4f5b-bee8-ba0a66193eaa tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:39.554850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f161ed2-921f-4f5b-bee8-ba0a66193eaa tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:39.555280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5f161ed2-921f-4f5b-bee8-ba0a66193eaa tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:39.559716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:39.698673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5f161ed2-921f-4f5b-bee8-ba0a66193eaa tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:39.707132 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5f161ed2-921f-4f5b-bee8-ba0a66193eaa tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1318 microversion: 2.1 time: 0.173374 Sep 10 21:33:39.707820 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3179/6485] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:39 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:40.730464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-97126a64-6c5a-4267-9575-0c54eb0bd90d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:40.731077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-97126a64-6c5a-4267-9575-0c54eb0bd90d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:40.732989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:40.740396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97126a64-6c5a-4267-9575-0c54eb0bd90d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:40.740883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97126a64-6c5a-4267-9575-0c54eb0bd90d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:40.741323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97126a64-6c5a-4267-9575-0c54eb0bd90d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:40.742058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97126a64-6c5a-4267-9575-0c54eb0bd90d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:40.742510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97126a64-6c5a-4267-9575-0c54eb0bd90d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:40.742960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-97126a64-6c5a-4267-9575-0c54eb0bd90d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:40.879222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-97126a64-6c5a-4267-9575-0c54eb0bd90d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:40.887134 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-97126a64-6c5a-4267-9575-0c54eb0bd90d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1509 microversion: 2.1 time: 0.160574 Sep 10 21:33:40.887733 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3307/6486] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:40 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:40.910214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-54e64f06-f1b8-4f26-ad3a-08014db39a1f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:40.910713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-54e64f06-f1b8-4f26-ad3a-08014db39a1f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:40.917530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54e64f06-f1b8-4f26-ad3a-08014db39a1f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:40.918057 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54e64f06-f1b8-4f26-ad3a-08014db39a1f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:40.918500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54e64f06-f1b8-4f26-ad3a-08014db39a1f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:40.919194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54e64f06-f1b8-4f26-ad3a-08014db39a1f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:40.919652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54e64f06-f1b8-4f26-ad3a-08014db39a1f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:40.920084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-54e64f06-f1b8-4f26-ad3a-08014db39a1f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.055477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-54e64f06-f1b8-4f26-ad3a-08014db39a1f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:41.063227 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-54e64f06-f1b8-4f26-ad3a-08014db39a1f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1509 microversion: 2.1 time: 0.157677 Sep 10 21:33:41.063804 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3180/6487] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:40 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:41.085926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cc1c6f49-f341-47f4-9c4f-da6bbfc2bc97 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:33:41.088462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cc1c6f49-f341-47f4-9c4f-da6bbfc2bc97 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:41.094598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc1c6f49-f341-47f4-9c4f-da6bbfc2bc97 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:41.095091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc1c6f49-f341-47f4-9c4f-da6bbfc2bc97 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:41.095532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc1c6f49-f341-47f4-9c4f-da6bbfc2bc97 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.096268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc1c6f49-f341-47f4-9c4f-da6bbfc2bc97 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:41.096963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc1c6f49-f341-47f4-9c4f-da6bbfc2bc97 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:41.097456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc1c6f49-f341-47f4-9c4f-da6bbfc2bc97 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.162179 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cc1c6f49-f341-47f4-9c4f-da6bbfc2bc97 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "PUT /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1081 microversion: 2.1 time: 0.080600 Sep 10 21:33:41.162734 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3308/6488] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Sep 10 21:33:41 2022] PUT /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1081 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:41.181779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3e4a77ec-210c-4721-8dca-c4bb1e9bc826 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:41.182422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3e4a77ec-210c-4721-8dca-c4bb1e9bc826 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:41.188424 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e4a77ec-210c-4721-8dca-c4bb1e9bc826 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:41.188910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e4a77ec-210c-4721-8dca-c4bb1e9bc826 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:41.189349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e4a77ec-210c-4721-8dca-c4bb1e9bc826 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.190078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e4a77ec-210c-4721-8dca-c4bb1e9bc826 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:41.191172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e4a77ec-210c-4721-8dca-c4bb1e9bc826 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:41.191594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e4a77ec-210c-4721-8dca-c4bb1e9bc826 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.321368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3e4a77ec-210c-4721-8dca-c4bb1e9bc826 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:41.329109 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3e4a77ec-210c-4721-8dca-c4bb1e9bc826 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1507 microversion: 2.1 time: 0.151337 Sep 10 21:33:41.329683 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3181/6489] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:41 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:41.352454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-53b226a0-b13e-46e9-955a-09af98b5e204 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:41.353126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-53b226a0-b13e-46e9-955a-09af98b5e204 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:41.359672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53b226a0-b13e-46e9-955a-09af98b5e204 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:41.360157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53b226a0-b13e-46e9-955a-09af98b5e204 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:41.360593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53b226a0-b13e-46e9-955a-09af98b5e204 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.361317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53b226a0-b13e-46e9-955a-09af98b5e204 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:41.361774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53b226a0-b13e-46e9-955a-09af98b5e204 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:41.362754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-53b226a0-b13e-46e9-955a-09af98b5e204 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.493170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-53b226a0-b13e-46e9-955a-09af98b5e204 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:41.501196 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-53b226a0-b13e-46e9-955a-09af98b5e204 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1507 microversion: 2.1 time: 0.152639 Sep 10 21:33:41.501782 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3309/6490] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:41 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:33:41.523317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:33:41.525673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:41.531757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:41.532243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:41.532683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.533374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:41.533848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:41.534941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.611272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:41.617402 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Old instance type m1.heat2, new instance type m1.heat {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:33:41.623949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:33:41.624372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:33:41.624844 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:33:41.625256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:33:41.625671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:33:41.734161 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f8c59d97-b8c4-4fd7-a35b-b93e4c63587f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "POST /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6/action" status: 202 len: 0 microversion: 2.1 time: 0.214297 Sep 10 21:33:41.734745 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3182/6491] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:33:41 2022] POST /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:33:41.743723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fd49eac5-b947-4ab7-853a-b2a56e84efe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:41.744461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fd49eac5-b947-4ab7-853a-b2a56e84efe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:41.751286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd49eac5-b947-4ab7-853a-b2a56e84efe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:41.751774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd49eac5-b947-4ab7-853a-b2a56e84efe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:41.752220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd49eac5-b947-4ab7-853a-b2a56e84efe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.753012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd49eac5-b947-4ab7-853a-b2a56e84efe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:41.753521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd49eac5-b947-4ab7-853a-b2a56e84efe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:41.754007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd49eac5-b947-4ab7-853a-b2a56e84efe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:41.915100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fd49eac5-b947-4ab7-853a-b2a56e84efe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:41.923705 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fd49eac5-b947-4ab7-853a-b2a56e84efe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1518 microversion: 2.1 time: 0.183891 Sep 10 21:33:41.924274 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3310/6492] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:41 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1518 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:42.948385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b18b8030-e161-4172-88ff-f9d0d65535d4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:42.948928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b18b8030-e161-4172-88ff-f9d0d65535d4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:42.955867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b18b8030-e161-4172-88ff-f9d0d65535d4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:42.957454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b18b8030-e161-4172-88ff-f9d0d65535d4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:42.957932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b18b8030-e161-4172-88ff-f9d0d65535d4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:42.958651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b18b8030-e161-4172-88ff-f9d0d65535d4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:42.959123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b18b8030-e161-4172-88ff-f9d0d65535d4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:42.959553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b18b8030-e161-4172-88ff-f9d0d65535d4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:43.110208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b18b8030-e161-4172-88ff-f9d0d65535d4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:43.118602 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b18b8030-e161-4172-88ff-f9d0d65535d4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1518 microversion: 2.1 time: 0.175097 Sep 10 21:33:43.119189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3183/6493] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:42 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:44.143790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c99cffc7-644a-4aa0-9fa6-823ebdc99b4a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:44.144414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c99cffc7-644a-4aa0-9fa6-823ebdc99b4a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:44.151392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c99cffc7-644a-4aa0-9fa6-823ebdc99b4a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:44.151878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c99cffc7-644a-4aa0-9fa6-823ebdc99b4a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:44.152322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c99cffc7-644a-4aa0-9fa6-823ebdc99b4a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:44.153017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c99cffc7-644a-4aa0-9fa6-823ebdc99b4a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:44.153472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c99cffc7-644a-4aa0-9fa6-823ebdc99b4a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:44.153927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c99cffc7-644a-4aa0-9fa6-823ebdc99b4a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:44.288574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c99cffc7-644a-4aa0-9fa6-823ebdc99b4a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:44.296247 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c99cffc7-644a-4aa0-9fa6-823ebdc99b4a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.156905 Sep 10 21:33:44.296815 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3311/6494] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:44 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:45.320179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-314febc9-a9fe-4d60-916f-48bd87eb7727 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:45.320788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-314febc9-a9fe-4d60-916f-48bd87eb7727 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:45.327756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-314febc9-a9fe-4d60-916f-48bd87eb7727 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:45.328236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-314febc9-a9fe-4d60-916f-48bd87eb7727 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:45.328667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-314febc9-a9fe-4d60-916f-48bd87eb7727 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:45.329352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-314febc9-a9fe-4d60-916f-48bd87eb7727 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:45.329849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-314febc9-a9fe-4d60-916f-48bd87eb7727 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:45.330274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-314febc9-a9fe-4d60-916f-48bd87eb7727 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:45.460783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-314febc9-a9fe-4d60-916f-48bd87eb7727 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:45.468500 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-314febc9-a9fe-4d60-916f-48bd87eb7727 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.152263 Sep 10 21:33:45.469065 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3184/6495] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:45 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:46.493770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1b667638-d05d-4f81-91f9-501cb75ce706 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:46.494446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1b667638-d05d-4f81-91f9-501cb75ce706 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:46.501034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b667638-d05d-4f81-91f9-501cb75ce706 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:46.501520 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b667638-d05d-4f81-91f9-501cb75ce706 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:46.502000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b667638-d05d-4f81-91f9-501cb75ce706 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:46.503312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b667638-d05d-4f81-91f9-501cb75ce706 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:46.503793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b667638-d05d-4f81-91f9-501cb75ce706 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:46.504320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b667638-d05d-4f81-91f9-501cb75ce706 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:46.636399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b667638-d05d-4f81-91f9-501cb75ce706 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:46.644518 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1b667638-d05d-4f81-91f9-501cb75ce706 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.154657 Sep 10 21:33:46.645102 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3312/6496] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:46 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:47.668762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4b119b27-e1d0-4877-9c55-10c56157dcf5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:47.669401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4b119b27-e1d0-4877-9c55-10c56157dcf5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:47.676018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b119b27-e1d0-4877-9c55-10c56157dcf5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:47.676508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b119b27-e1d0-4877-9c55-10c56157dcf5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:47.676948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b119b27-e1d0-4877-9c55-10c56157dcf5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:47.677653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b119b27-e1d0-4877-9c55-10c56157dcf5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:47.678145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b119b27-e1d0-4877-9c55-10c56157dcf5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:47.678580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4b119b27-e1d0-4877-9c55-10c56157dcf5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:47.814618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4b119b27-e1d0-4877-9c55-10c56157dcf5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:47.823318 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4b119b27-e1d0-4877-9c55-10c56157dcf5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.158680 Sep 10 21:33:47.823904 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3185/6497] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:47 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:48.847446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c11603e5-5da4-46ed-94df-b51274a436b8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:48.848057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c11603e5-5da4-46ed-94df-b51274a436b8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:48.854931 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11603e5-5da4-46ed-94df-b51274a436b8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:48.855413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11603e5-5da4-46ed-94df-b51274a436b8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:48.855847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11603e5-5da4-46ed-94df-b51274a436b8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:48.856536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11603e5-5da4-46ed-94df-b51274a436b8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:48.857016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11603e5-5da4-46ed-94df-b51274a436b8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:48.857444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11603e5-5da4-46ed-94df-b51274a436b8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:48.992757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c11603e5-5da4-46ed-94df-b51274a436b8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:49.000533 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c11603e5-5da4-46ed-94df-b51274a436b8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.157373 Sep 10 21:33:49.001108 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3313/6498] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:48 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:50.024702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-25ac72be-fc5d-477c-8a6b-55320ae342d8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:50.025357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-25ac72be-fc5d-477c-8a6b-55320ae342d8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:50.032398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25ac72be-fc5d-477c-8a6b-55320ae342d8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:50.032878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25ac72be-fc5d-477c-8a6b-55320ae342d8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:50.033308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25ac72be-fc5d-477c-8a6b-55320ae342d8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:50.034084 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25ac72be-fc5d-477c-8a6b-55320ae342d8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:50.034543 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25ac72be-fc5d-477c-8a6b-55320ae342d8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:50.035018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-25ac72be-fc5d-477c-8a6b-55320ae342d8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:50.167387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-25ac72be-fc5d-477c-8a6b-55320ae342d8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:50.175617 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-25ac72be-fc5d-477c-8a6b-55320ae342d8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.154986 Sep 10 21:33:50.176188 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3186/6499] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:50 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:51.199617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-715cac5e-c3ae-4b0a-b3a0-eb92c284f13a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:51.200258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-715cac5e-c3ae-4b0a-b3a0-eb92c284f13a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:51.207801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-715cac5e-c3ae-4b0a-b3a0-eb92c284f13a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:51.208280 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-715cac5e-c3ae-4b0a-b3a0-eb92c284f13a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:51.208748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-715cac5e-c3ae-4b0a-b3a0-eb92c284f13a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:51.209440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-715cac5e-c3ae-4b0a-b3a0-eb92c284f13a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:51.209917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-715cac5e-c3ae-4b0a-b3a0-eb92c284f13a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:51.210347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-715cac5e-c3ae-4b0a-b3a0-eb92c284f13a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:51.339367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-715cac5e-c3ae-4b0a-b3a0-eb92c284f13a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:51.347381 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-715cac5e-c3ae-4b0a-b3a0-eb92c284f13a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.151590 Sep 10 21:33:51.347958 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3314/6500] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:51 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:52.371318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e986a8a9-fa92-40eb-8a3f-33068c7d69ef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:52.372314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e986a8a9-fa92-40eb-8a3f-33068c7d69ef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:52.379673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e986a8a9-fa92-40eb-8a3f-33068c7d69ef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:52.380173 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e986a8a9-fa92-40eb-8a3f-33068c7d69ef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:52.380615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e986a8a9-fa92-40eb-8a3f-33068c7d69ef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:52.381316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e986a8a9-fa92-40eb-8a3f-33068c7d69ef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:52.381773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e986a8a9-fa92-40eb-8a3f-33068c7d69ef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:52.382227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e986a8a9-fa92-40eb-8a3f-33068c7d69ef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:52.516824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e986a8a9-fa92-40eb-8a3f-33068c7d69ef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:52.525586 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e986a8a9-fa92-40eb-8a3f-33068c7d69ef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.158167 Sep 10 21:33:52.526209 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3187/6501] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:52 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:53.550854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-986e2847-c9a5-48ff-a7cb-03d9bd69fd05 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:53.551469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-986e2847-c9a5-48ff-a7cb-03d9bd69fd05 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:53.558684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-986e2847-c9a5-48ff-a7cb-03d9bd69fd05 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:53.559173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-986e2847-c9a5-48ff-a7cb-03d9bd69fd05 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:53.559613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-986e2847-c9a5-48ff-a7cb-03d9bd69fd05 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:53.560312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-986e2847-c9a5-48ff-a7cb-03d9bd69fd05 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:53.560771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-986e2847-c9a5-48ff-a7cb-03d9bd69fd05 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:53.561201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-986e2847-c9a5-48ff-a7cb-03d9bd69fd05 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:53.689975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-986e2847-c9a5-48ff-a7cb-03d9bd69fd05 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:53.697649 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-986e2847-c9a5-48ff-a7cb-03d9bd69fd05 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.151551 Sep 10 21:33:53.698263 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3315/6502] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:53 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:54.720695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e83dfcd8-ee3c-40cb-9352-a99300846eab tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:54.722010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e83dfcd8-ee3c-40cb-9352-a99300846eab tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:54.728862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e83dfcd8-ee3c-40cb-9352-a99300846eab tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:54.729346 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e83dfcd8-ee3c-40cb-9352-a99300846eab tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:54.729785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e83dfcd8-ee3c-40cb-9352-a99300846eab tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:54.730578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e83dfcd8-ee3c-40cb-9352-a99300846eab tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:54.731034 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e83dfcd8-ee3c-40cb-9352-a99300846eab tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:54.731464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e83dfcd8-ee3c-40cb-9352-a99300846eab tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:54.860659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e83dfcd8-ee3c-40cb-9352-a99300846eab tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:54.868420 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e83dfcd8-ee3c-40cb-9352-a99300846eab tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.151648 Sep 10 21:33:54.869003 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3188/6503] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:54 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:55.891480 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b24ef255-3376-4c10-9005-19db121fee65 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:55.892070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b24ef255-3376-4c10-9005-19db121fee65 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:55.899919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24ef255-3376-4c10-9005-19db121fee65 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:55.900398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24ef255-3376-4c10-9005-19db121fee65 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:55.900834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24ef255-3376-4c10-9005-19db121fee65 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:55.901522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24ef255-3376-4c10-9005-19db121fee65 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:55.902027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24ef255-3376-4c10-9005-19db121fee65 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:55.902451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b24ef255-3376-4c10-9005-19db121fee65 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:56.036098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b24ef255-3376-4c10-9005-19db121fee65 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:56.043774 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b24ef255-3376-4c10-9005-19db121fee65 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.156208 Sep 10 21:33:56.044348 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3316/6504] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:55 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:57.068338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f217a436-761b-4928-a84f-16c66ca098df tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:57.068948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f217a436-761b-4928-a84f-16c66ca098df tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:57.075790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f217a436-761b-4928-a84f-16c66ca098df tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:57.076273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f217a436-761b-4928-a84f-16c66ca098df tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:57.076709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f217a436-761b-4928-a84f-16c66ca098df tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:57.077395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f217a436-761b-4928-a84f-16c66ca098df tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:57.077867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f217a436-761b-4928-a84f-16c66ca098df tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:57.078298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f217a436-761b-4928-a84f-16c66ca098df tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:57.211118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f217a436-761b-4928-a84f-16c66ca098df tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:57.218916 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f217a436-761b-4928-a84f-16c66ca098df tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.154915 Sep 10 21:33:57.219503 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3189/6505] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:57 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:33:58.243145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-72efaa79-f331-4c49-96b7-73911d39bdea tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:58.243684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-72efaa79-f331-4c49-96b7-73911d39bdea tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:58.250611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72efaa79-f331-4c49-96b7-73911d39bdea tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:58.251104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72efaa79-f331-4c49-96b7-73911d39bdea tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:58.251547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72efaa79-f331-4c49-96b7-73911d39bdea tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:58.252247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72efaa79-f331-4c49-96b7-73911d39bdea tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:58.252708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72efaa79-f331-4c49-96b7-73911d39bdea tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:58.253142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72efaa79-f331-4c49-96b7-73911d39bdea tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:58.382798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-72efaa79-f331-4c49-96b7-73911d39bdea tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:58.386226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:33:58.391284 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-72efaa79-f331-4c49-96b7-73911d39bdea tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.152145 Sep 10 21:33:58.391855 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3317/6506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:58 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:33:59.416099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4f64498d-977c-4a47-9010-b6530c4a50a4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:33:59.416715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4f64498d-977c-4a47-9010-b6530c4a50a4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:33:59.423594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f64498d-977c-4a47-9010-b6530c4a50a4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:59.424082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f64498d-977c-4a47-9010-b6530c4a50a4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:59.424520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f64498d-977c-4a47-9010-b6530c4a50a4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:59.425216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f64498d-977c-4a47-9010-b6530c4a50a4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:33:59.425673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f64498d-977c-4a47-9010-b6530c4a50a4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:33:59.426129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f64498d-977c-4a47-9010-b6530c4a50a4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:33:59.558354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4f64498d-977c-4a47-9010-b6530c4a50a4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:33:59.566141 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4f64498d-977c-4a47-9010-b6530c4a50a4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.153921 Sep 10 21:33:59.566716 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3190/6507] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:33:59 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:00.590958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0a7dd970-1b43-4db2-90e1-514a676102b0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:00.591566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0a7dd970-1b43-4db2-90e1-514a676102b0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:00.599184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a7dd970-1b43-4db2-90e1-514a676102b0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:00.599666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a7dd970-1b43-4db2-90e1-514a676102b0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:00.600104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a7dd970-1b43-4db2-90e1-514a676102b0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:00.600803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a7dd970-1b43-4db2-90e1-514a676102b0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:00.601258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a7dd970-1b43-4db2-90e1-514a676102b0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:00.601688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0a7dd970-1b43-4db2-90e1-514a676102b0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:00.736215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0a7dd970-1b43-4db2-90e1-514a676102b0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:00.744934 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0a7dd970-1b43-4db2-90e1-514a676102b0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.158571 Sep 10 21:34:00.745526 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3318/6508] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:00 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:01.768396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-abcb3b7a-d3bb-4d5c-84f5-110099480b47 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:01.769010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-abcb3b7a-d3bb-4d5c-84f5-110099480b47 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:01.776045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abcb3b7a-d3bb-4d5c-84f5-110099480b47 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:01.776555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abcb3b7a-d3bb-4d5c-84f5-110099480b47 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:01.776986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abcb3b7a-d3bb-4d5c-84f5-110099480b47 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:01.777670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abcb3b7a-d3bb-4d5c-84f5-110099480b47 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:01.778144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abcb3b7a-d3bb-4d5c-84f5-110099480b47 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:01.778567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abcb3b7a-d3bb-4d5c-84f5-110099480b47 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:01.911872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-abcb3b7a-d3bb-4d5c-84f5-110099480b47 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:01.919750 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-abcb3b7a-d3bb-4d5c-84f5-110099480b47 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.155261 Sep 10 21:34:01.920332 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3191/6509] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:01 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:02.944075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9f7d4729-9288-4bc5-84a4-905b9e249336 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:02.944594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9f7d4729-9288-4bc5-84a4-905b9e249336 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:02.951588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f7d4729-9288-4bc5-84a4-905b9e249336 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:02.952080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f7d4729-9288-4bc5-84a4-905b9e249336 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:02.952521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f7d4729-9288-4bc5-84a4-905b9e249336 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:02.953219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f7d4729-9288-4bc5-84a4-905b9e249336 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:02.953678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f7d4729-9288-4bc5-84a4-905b9e249336 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:02.954137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9f7d4729-9288-4bc5-84a4-905b9e249336 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:03.087842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9f7d4729-9288-4bc5-84a4-905b9e249336 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:03.095900 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9f7d4729-9288-4bc5-84a4-905b9e249336 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.156297 Sep 10 21:34:03.096483 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3319/6510] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:02 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:04.119655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-27f3c4d5-51f7-4c39-a744-a2a8f87ee277 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:04.120270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-27f3c4d5-51f7-4c39-a744-a2a8f87ee277 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:04.127277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f3c4d5-51f7-4c39-a744-a2a8f87ee277 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:04.127765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f3c4d5-51f7-4c39-a744-a2a8f87ee277 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:04.128204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f3c4d5-51f7-4c39-a744-a2a8f87ee277 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:04.128902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f3c4d5-51f7-4c39-a744-a2a8f87ee277 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:04.129989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f3c4d5-51f7-4c39-a744-a2a8f87ee277 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:04.130431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-27f3c4d5-51f7-4c39-a744-a2a8f87ee277 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:04.266416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-27f3c4d5-51f7-4c39-a744-a2a8f87ee277 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:04.274233 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-27f3c4d5-51f7-4c39-a744-a2a8f87ee277 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.158415 Sep 10 21:34:04.274826 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3192/6511] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:04 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:34:05.298315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-74acaa7c-9fcd-4242-8d2d-feb0d907e326 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:05.298848 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-74acaa7c-9fcd-4242-8d2d-feb0d907e326 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:05.306599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74acaa7c-9fcd-4242-8d2d-feb0d907e326 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:05.307080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74acaa7c-9fcd-4242-8d2d-feb0d907e326 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:05.307515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74acaa7c-9fcd-4242-8d2d-feb0d907e326 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:05.308200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74acaa7c-9fcd-4242-8d2d-feb0d907e326 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:05.308649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74acaa7c-9fcd-4242-8d2d-feb0d907e326 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:05.309070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-74acaa7c-9fcd-4242-8d2d-feb0d907e326 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:05.441795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-74acaa7c-9fcd-4242-8d2d-feb0d907e326 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:05.449773 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-74acaa7c-9fcd-4242-8d2d-feb0d907e326 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.155562 Sep 10 21:34:05.450366 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3320/6512] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:05 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:06.473999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-11bbf94f-3004-4544-91fc-30f4b0fb5c5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:06.474645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-11bbf94f-3004-4544-91fc-30f4b0fb5c5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:06.481466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11bbf94f-3004-4544-91fc-30f4b0fb5c5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:06.481993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11bbf94f-3004-4544-91fc-30f4b0fb5c5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:06.482460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11bbf94f-3004-4544-91fc-30f4b0fb5c5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:06.483162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11bbf94f-3004-4544-91fc-30f4b0fb5c5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:06.483886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11bbf94f-3004-4544-91fc-30f4b0fb5c5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:06.484315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-11bbf94f-3004-4544-91fc-30f4b0fb5c5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:06.614336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-11bbf94f-3004-4544-91fc-30f4b0fb5c5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:06.622047 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-11bbf94f-3004-4544-91fc-30f4b0fb5c5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.152080 Sep 10 21:34:06.622627 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3193/6513] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:06 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:07.648356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4cf39a9f-b0b9-41c7-8a2c-5d8cb7e83021 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:07.649067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4cf39a9f-b0b9-41c7-8a2c-5d8cb7e83021 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:07.657248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cf39a9f-b0b9-41c7-8a2c-5d8cb7e83021 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:07.657729 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cf39a9f-b0b9-41c7-8a2c-5d8cb7e83021 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:07.658222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cf39a9f-b0b9-41c7-8a2c-5d8cb7e83021 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:07.658911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cf39a9f-b0b9-41c7-8a2c-5d8cb7e83021 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:07.659362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cf39a9f-b0b9-41c7-8a2c-5d8cb7e83021 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:07.659786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4cf39a9f-b0b9-41c7-8a2c-5d8cb7e83021 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:07.792654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4cf39a9f-b0b9-41c7-8a2c-5d8cb7e83021 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:07.800649 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4cf39a9f-b0b9-41c7-8a2c-5d8cb7e83021 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.158408 Sep 10 21:34:07.802192 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3321/6514] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:07 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:08.826537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-061033b7-2ac9-417f-8bb4-54d0fd697f6b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:08.827171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-061033b7-2ac9-417f-8bb4-54d0fd697f6b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:08.834098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-061033b7-2ac9-417f-8bb4-54d0fd697f6b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:08.834581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-061033b7-2ac9-417f-8bb4-54d0fd697f6b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:08.835015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-061033b7-2ac9-417f-8bb4-54d0fd697f6b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:08.835693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-061033b7-2ac9-417f-8bb4-54d0fd697f6b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:08.836175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-061033b7-2ac9-417f-8bb4-54d0fd697f6b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:08.836597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-061033b7-2ac9-417f-8bb4-54d0fd697f6b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:08.851714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:34:08.968212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-061033b7-2ac9-417f-8bb4-54d0fd697f6b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:08.978673 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-061033b7-2ac9-417f-8bb4-54d0fd697f6b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.154085 Sep 10 21:34:08.978673 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3194/6515] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:08 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:10.000994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ccd63760-de7c-4490-968d-26f2b5da6f5a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:10.001616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ccd63760-de7c-4490-968d-26f2b5da6f5a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:10.004379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=32 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:34:10.009810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd63760-de7c-4490-968d-26f2b5da6f5a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:10.010327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd63760-de7c-4490-968d-26f2b5da6f5a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:10.010799 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd63760-de7c-4490-968d-26f2b5da6f5a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:10.011508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd63760-de7c-4490-968d-26f2b5da6f5a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:10.012000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd63760-de7c-4490-968d-26f2b5da6f5a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:10.012431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ccd63760-de7c-4490-968d-26f2b5da6f5a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:10.143546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ccd63760-de7c-4490-968d-26f2b5da6f5a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:10.151901 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ccd63760-de7c-4490-968d-26f2b5da6f5a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1523 microversion: 2.1 time: 0.154769 Sep 10 21:34:10.152492 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3322/6516] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:09 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:11.145584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-6648f7ca-abbe-4e2e-86cc-15e7dacdec76 req-fe12687c-d56e-4654-a429-b936617c0050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f617c0-2e3f-4c28-b159-eae575fa0ab6", "name": "network-vif-unplugged", "status": "completed", "tag": "a380cb8b-2981-4cae-b897-ac3797a108c0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:34:11.151506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=36 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:34:11.157700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6648f7ca-abbe-4e2e-86cc-15e7dacdec76 req-fe12687c-d56e-4654-a429-b936617c0050 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:11.158384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6648f7ca-abbe-4e2e-86cc-15e7dacdec76 req-fe12687c-d56e-4654-a429-b936617c0050 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:11.159023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6648f7ca-abbe-4e2e-86cc-15e7dacdec76 req-fe12687c-d56e-4654-a429-b936617c0050 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:11.173497 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-6648f7ca-abbe-4e2e-86cc-15e7dacdec76 req-fe12687c-d56e-4654-a429-b936617c0050 service nova] Creating event network-vif-unplugged:a380cb8b-2981-4cae-b897-ac3797a108c0 for instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 on nch1-master-1 Sep 10 21:34:11.177134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1fb8f401-8600-4631-a803-770ae06e3295 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:11.178002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1fb8f401-8600-4631-a803-770ae06e3295 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:11.180602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-6648f7ca-abbe-4e2e-86cc-15e7dacdec76 req-fe12687c-d56e-4654-a429-b936617c0050 service nova] Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:34:11.184950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb8f401-8600-4631-a803-770ae06e3295 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:11.185454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb8f401-8600-4631-a803-770ae06e3295 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:11.188142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb8f401-8600-4631-a803-770ae06e3295 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:11.189010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb8f401-8600-4631-a803-770ae06e3295 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:11.189517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb8f401-8600-4631-a803-770ae06e3295 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:11.189999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fb8f401-8600-4631-a803-770ae06e3295 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:11.193221 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-6648f7ca-abbe-4e2e-86cc-15e7dacdec76 req-fe12687c-d56e-4654-a429-b936617c0050 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052367 Sep 10 21:34:11.194150 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3195/6517] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:34:11.411133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1fb8f401-8600-4631-a803-770ae06e3295 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:11.419062 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1fb8f401-8600-4631-a803-770ae06e3295 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1522 microversion: 2.1 time: 0.247003 Sep 10 21:34:11.419906 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3323/6518] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:11 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:12.445159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b6422cdc-b032-4140-88e2-316e74ba104b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:12.445784 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b6422cdc-b032-4140-88e2-316e74ba104b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:12.453007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6422cdc-b032-4140-88e2-316e74ba104b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:12.453498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6422cdc-b032-4140-88e2-316e74ba104b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:12.453979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6422cdc-b032-4140-88e2-316e74ba104b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:12.454671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6422cdc-b032-4140-88e2-316e74ba104b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:12.455129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6422cdc-b032-4140-88e2-316e74ba104b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:12.455562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6422cdc-b032-4140-88e2-316e74ba104b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:12.589769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b6422cdc-b032-4140-88e2-316e74ba104b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:12.597607 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b6422cdc-b032-4140-88e2-316e74ba104b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1520 microversion: 2.1 time: 0.157716 Sep 10 21:34:12.598885 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3196/6519] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:12 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:13.217420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-5ce77efb-4148-4d51-a368-998b96e6cf2b req-64233d2d-bc5c-47ac-bdf6-3f0670892c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f617c0-2e3f-4c28-b159-eae575fa0ab6", "tag": "a380cb8b-2981-4cae-b897-ac3797a108c0"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:34:13.228936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5ce77efb-4148-4d51-a368-998b96e6cf2b req-64233d2d-bc5c-47ac-bdf6-3f0670892c72 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:13.229351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5ce77efb-4148-4d51-a368-998b96e6cf2b req-64233d2d-bc5c-47ac-bdf6-3f0670892c72 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:13.229778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-5ce77efb-4148-4d51-a368-998b96e6cf2b req-64233d2d-bc5c-47ac-bdf6-3f0670892c72 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:13.241586 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-5ce77efb-4148-4d51-a368-998b96e6cf2b req-64233d2d-bc5c-47ac-bdf6-3f0670892c72 service nova] Creating event network-changed:a380cb8b-2981-4cae-b897-ac3797a108c0 for instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 on nch1-master-1 Sep 10 21:34:13.246810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-5ce77efb-4148-4d51-a368-998b96e6cf2b req-64233d2d-bc5c-47ac-bdf6-3f0670892c72 service nova] Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:34:13.258663 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-5ce77efb-4148-4d51-a368-998b96e6cf2b req-64233d2d-bc5c-47ac-bdf6-3f0670892c72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044897 Sep 10 21:34:13.259268 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3324/6520] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:34:13.622824 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9978b372-cda0-4659-bd9d-544a9d81511c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:13.623555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9978b372-cda0-4659-bd9d-544a9d81511c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:13.631423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9978b372-cda0-4659-bd9d-544a9d81511c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:13.631911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9978b372-cda0-4659-bd9d-544a9d81511c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:13.632344 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9978b372-cda0-4659-bd9d-544a9d81511c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:13.633041 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9978b372-cda0-4659-bd9d-544a9d81511c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:13.633517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9978b372-cda0-4659-bd9d-544a9d81511c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:13.633965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9978b372-cda0-4659-bd9d-544a9d81511c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:13.768085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9978b372-cda0-4659-bd9d-544a9d81511c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:13.775899 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9978b372-cda0-4659-bd9d-544a9d81511c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1520 microversion: 2.1 time: 0.156903 Sep 10 21:34:13.776673 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3197/6521] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:13 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:14.802567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f3c96a4d-956a-4354-868c-494b34dc0ddf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:14.803841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f3c96a4d-956a-4354-868c-494b34dc0ddf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:14.810086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3c96a4d-956a-4354-868c-494b34dc0ddf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:14.810585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3c96a4d-956a-4354-868c-494b34dc0ddf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:14.810988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3c96a4d-956a-4354-868c-494b34dc0ddf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:14.811684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3c96a4d-956a-4354-868c-494b34dc0ddf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:14.812136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3c96a4d-956a-4354-868c-494b34dc0ddf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:14.812559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f3c96a4d-956a-4354-868c-494b34dc0ddf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:14.997719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f3c96a4d-956a-4354-868c-494b34dc0ddf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:15.005944 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f3c96a4d-956a-4354-868c-494b34dc0ddf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1520 microversion: 2.1 time: 0.209684 Sep 10 21:34:15.006538 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3325/6522] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:14 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:16.029153 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23dd65fa-7ef5-43a0-b678-ef9a2fa61e79 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:16.029771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23dd65fa-7ef5-43a0-b678-ef9a2fa61e79 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:16.036831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23dd65fa-7ef5-43a0-b678-ef9a2fa61e79 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:16.037326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23dd65fa-7ef5-43a0-b678-ef9a2fa61e79 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:16.037765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23dd65fa-7ef5-43a0-b678-ef9a2fa61e79 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:16.038495 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23dd65fa-7ef5-43a0-b678-ef9a2fa61e79 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:16.038953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23dd65fa-7ef5-43a0-b678-ef9a2fa61e79 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:16.039383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23dd65fa-7ef5-43a0-b678-ef9a2fa61e79 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:16.179222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-23dd65fa-7ef5-43a0-b678-ef9a2fa61e79 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:16.186990 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23dd65fa-7ef5-43a0-b678-ef9a2fa61e79 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1517 microversion: 2.1 time: 0.161697 Sep 10 21:34:16.187577 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3198/6523] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:16 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:16.210241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0d8ed464-da8b-4b89-968a-7d0fa0091f55 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:34:16.210784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0d8ed464-da8b-4b89-968a-7d0fa0091f55 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:16.217759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d8ed464-da8b-4b89-968a-7d0fa0091f55 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:16.218294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d8ed464-da8b-4b89-968a-7d0fa0091f55 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:16.218738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d8ed464-da8b-4b89-968a-7d0fa0091f55 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:16.219438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d8ed464-da8b-4b89-968a-7d0fa0091f55 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:16.219901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d8ed464-da8b-4b89-968a-7d0fa0091f55 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:16.220330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d8ed464-da8b-4b89-968a-7d0fa0091f55 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:16.277087 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0d8ed464-da8b-4b89-968a-7d0fa0091f55 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "POST /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6/action" status: 204 len: 0 microversion: 2.1 time: 0.070559 Sep 10 21:34:16.277663 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3326/6524] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:34:16 2022] POST /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:34:16.286521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-84b3b7e6-8fc8-4182-9c53-943a920d0773 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:16.287136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-84b3b7e6-8fc8-4182-9c53-943a920d0773 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:16.293185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84b3b7e6-8fc8-4182-9c53-943a920d0773 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:16.293673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84b3b7e6-8fc8-4182-9c53-943a920d0773 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:16.294358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84b3b7e6-8fc8-4182-9c53-943a920d0773 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:16.294896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84b3b7e6-8fc8-4182-9c53-943a920d0773 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:16.295336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84b3b7e6-8fc8-4182-9c53-943a920d0773 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:16.295768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-84b3b7e6-8fc8-4182-9c53-943a920d0773 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:16.436816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-84b3b7e6-8fc8-4182-9c53-943a920d0773 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:16.445404 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-84b3b7e6-8fc8-4182-9c53-943a920d0773 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1517 microversion: 2.1 time: 0.163463 Sep 10 21:34:16.449089 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3199/6525] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:16 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:17.470321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-663723d2-048b-4054-90fa-058760c3770c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:17.471111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-663723d2-048b-4054-90fa-058760c3770c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:17.478726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-663723d2-048b-4054-90fa-058760c3770c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:17.479641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-663723d2-048b-4054-90fa-058760c3770c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:17.480092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-663723d2-048b-4054-90fa-058760c3770c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:17.480804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-663723d2-048b-4054-90fa-058760c3770c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:17.481266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-663723d2-048b-4054-90fa-058760c3770c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:17.481697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-663723d2-048b-4054-90fa-058760c3770c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:17.615562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-663723d2-048b-4054-90fa-058760c3770c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:17.623477 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-663723d2-048b-4054-90fa-058760c3770c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1517 microversion: 2.1 time: 0.158530 Sep 10 21:34:17.624274 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3327/6526] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:17 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:34:18.470236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1d45ad30-10c2-4648-8c8d-2515f20c69e3 req-2162eb39-29ab-44b0-8bae-ce6c04fb3a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f617c0-2e3f-4c28-b159-eae575fa0ab6", "name": "network-vif-plugged", "status": "completed", "tag": "a380cb8b-2981-4cae-b897-ac3797a108c0"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:34:18.480542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1d45ad30-10c2-4648-8c8d-2515f20c69e3 req-2162eb39-29ab-44b0-8bae-ce6c04fb3a49 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:18.481036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1d45ad30-10c2-4648-8c8d-2515f20c69e3 req-2162eb39-29ab-44b0-8bae-ce6c04fb3a49 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:18.481559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1d45ad30-10c2-4648-8c8d-2515f20c69e3 req-2162eb39-29ab-44b0-8bae-ce6c04fb3a49 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:18.494540 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1d45ad30-10c2-4648-8c8d-2515f20c69e3 req-2162eb39-29ab-44b0-8bae-ce6c04fb3a49 service nova] Creating event network-vif-plugged:a380cb8b-2981-4cae-b897-ac3797a108c0 for instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 on nch1-master-1 Sep 10 21:34:18.500552 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1d45ad30-10c2-4648-8c8d-2515f20c69e3 req-2162eb39-29ab-44b0-8bae-ce6c04fb3a49 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Sep 10 21:34:18.501170 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3200/6527] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:34:18.648496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ca659790-c276-4ae1-8d05-a5e8a93acb45 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:18.649041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ca659790-c276-4ae1-8d05-a5e8a93acb45 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:18.655913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca659790-c276-4ae1-8d05-a5e8a93acb45 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:18.656716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca659790-c276-4ae1-8d05-a5e8a93acb45 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:18.657161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca659790-c276-4ae1-8d05-a5e8a93acb45 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:18.657880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca659790-c276-4ae1-8d05-a5e8a93acb45 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:18.658348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca659790-c276-4ae1-8d05-a5e8a93acb45 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:18.658777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ca659790-c276-4ae1-8d05-a5e8a93acb45 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:18.789031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ca659790-c276-4ae1-8d05-a5e8a93acb45 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:18.796856 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ca659790-c276-4ae1-8d05-a5e8a93acb45 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1509 microversion: 2.1 time: 0.152993 Sep 10 21:34:18.797440 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3328/6528] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:18 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:18.820298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-705297ea-298e-470f-892d-578113c90ad2 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:18.821021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-705297ea-298e-470f-892d-578113c90ad2 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:18.827304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-705297ea-298e-470f-892d-578113c90ad2 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:18.827782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-705297ea-298e-470f-892d-578113c90ad2 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:18.828216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-705297ea-298e-470f-892d-578113c90ad2 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:18.828899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-705297ea-298e-470f-892d-578113c90ad2 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:18.829349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-705297ea-298e-470f-892d-578113c90ad2 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:18.829779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-705297ea-298e-470f-892d-578113c90ad2 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:18.962928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-705297ea-298e-470f-892d-578113c90ad2 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:18.970819 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-705297ea-298e-470f-892d-578113c90ad2 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1509 microversion: 2.1 time: 0.155451 Sep 10 21:34:18.971405 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3201/6529] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:18 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:18.998197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3c7a4d80-fa21-4d79-b370-ab036a25101f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Action: 'create', calling method: .version_select at 0x7f993f90b820>, body: {"keypair": {"name": "tempest-keypair-1081370945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGf4zvVsTKcLWf0vLMPgsdx2jmJl7oa0C6rI1UdFKlZ0cY4KTRAA3ZRasC4RKdBVde+B5AL8fjmvYQ9FYkBRbMrwjXca8OCCgA5sB5zMO3zbe+lC5FL5moZNvQQ8AcG+A=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:34:19.014708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3c7a4d80-fa21-4d79-b370-ab036a25101f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Getting quotas for project 3b494efae18f494a8a8b1d6aa53c4327. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:34:19.019921 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-3c7a4d80-fa21-4d79-b370-ab036a25101f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Getting quotas for user cf26d0546ef846cb845be454c0e4ad76 and project 3b494efae18f494a8a8b1d6aa53c4327. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:34:19.032732 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c7a4d80-fa21-4d79-b370-ab036a25101f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [80ac8596-1959-43fe-97fe-8b193e3e5de9] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:34:20.040548 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c7a4d80-fa21-4d79-b370-ab036a25101f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [80ac8596-1959-43fe-97fe-8b193e3e5de9] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 38376. Sep 10 21:34:20.057261 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3c7a4d80-fa21-4d79-b370-ab036a25101f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.063035 Sep 10 21:34:20.057919 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3329/6530] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:34:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:34:21.232986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-40e99bdf-5551-41ea-aecc-f493f5dca136 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:21.234027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-40e99bdf-5551-41ea-aecc-f493f5dca136 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:21.241067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40e99bdf-5551-41ea-aecc-f493f5dca136 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:21.241557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40e99bdf-5551-41ea-aecc-f493f5dca136 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:21.242024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40e99bdf-5551-41ea-aecc-f493f5dca136 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:21.242722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40e99bdf-5551-41ea-aecc-f493f5dca136 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:21.243276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40e99bdf-5551-41ea-aecc-f493f5dca136 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:21.243707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40e99bdf-5551-41ea-aecc-f493f5dca136 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:21.372287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-40e99bdf-5551-41ea-aecc-f493f5dca136 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:21.380411 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-40e99bdf-5551-41ea-aecc-f493f5dca136 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 200 len: 1509 microversion: 2.1 time: 0.151199 Sep 10 21:34:21.380928 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3202/6531] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:21 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:21.404551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-18c1bf23-6a7d-42ed-9b6b-c71237d2c9cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:21.405106 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-18c1bf23-6a7d-42ed-9b6b-c71237d2c9cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:21.411770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18c1bf23-6a7d-42ed-9b6b-c71237d2c9cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:21.412260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18c1bf23-6a7d-42ed-9b6b-c71237d2c9cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:21.412710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18c1bf23-6a7d-42ed-9b6b-c71237d2c9cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:21.413440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18c1bf23-6a7d-42ed-9b6b-c71237d2c9cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:21.413929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18c1bf23-6a7d-42ed-9b6b-c71237d2c9cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:21.414364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-18c1bf23-6a7d-42ed-9b6b-c71237d2c9cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:21.438361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-18c1bf23-6a7d-42ed-9b6b-c71237d2c9cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:34:21.512275 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-18c1bf23-6a7d-42ed-9b6b-c71237d2c9cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 204 len: 0 microversion: 2.1 time: 0.112862 Sep 10 21:34:21.513159 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3330/6532] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:34:21 2022] DELETE /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:34:21.566889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-988629380", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "279bd1b1-61c4-4913-bce9-054b4d4c40cf"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:34:21.620195 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] validate_networks() for [('279bd1b1-61c4-4913-bce9-054b4d4c40cf', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:34:21.991189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:34:21.991613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:34:21.992090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:34:21.992500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:34:21.992910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:34:22.001716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:22.002230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:22.002661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:22.003387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:22.004501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:22.004928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:22.021348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Getting quotas for project 3b494efae18f494a8a8b1d6aa53c4327. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:34:22.026579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Getting quotas for user cf26d0546ef846cb845be454c0e4ad76 and project 3b494efae18f494a8a8b1d6aa53c4327. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:34:22.039741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:34:22.042038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:34:22.090261 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d458d45a-bad7-453c-b08c-0055e6d9e162 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527654 Sep 10 21:34:22.090927 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3203/6533] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:34:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:34:22.102742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cea5d534-f3ee-4fa9-a86b-753893e3222d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:22.103710 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cea5d534-f3ee-4fa9-a86b-753893e3222d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:22.162541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cea5d534-f3ee-4fa9-a86b-753893e3222d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:22.169505 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cea5d534-f3ee-4fa9-a86b-753893e3222d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1217 microversion: 2.1 time: 0.071145 Sep 10 21:34:22.170128 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3331/6534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:22 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:23.194920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-67a0726b-4e42-4f11-9495-2965f142de17 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:23.196552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-67a0726b-4e42-4f11-9495-2965f142de17 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:23.203995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a0726b-4e42-4f11-9495-2965f142de17 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:23.204489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a0726b-4e42-4f11-9495-2965f142de17 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:23.204923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a0726b-4e42-4f11-9495-2965f142de17 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:23.205621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a0726b-4e42-4f11-9495-2965f142de17 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:23.206097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a0726b-4e42-4f11-9495-2965f142de17 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:23.206553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-67a0726b-4e42-4f11-9495-2965f142de17 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:23.291097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-67a0726b-4e42-4f11-9495-2965f142de17 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:23.300272 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-67a0726b-4e42-4f11-9495-2965f142de17 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1269 microversion: 2.1 time: 0.111551 Sep 10 21:34:23.303683 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3204/6535] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:23 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1269 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:23.475786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d1e68974-7ab7-466d-b2a1-873685e0836d req-05daec56-2124-4066-9b24-bcf3792775f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f617c0-2e3f-4c28-b159-eae575fa0ab6", "name": "network-vif-deleted", "tag": "a380cb8b-2981-4cae-b897-ac3797a108c0"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:34:23.488751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d1e68974-7ab7-466d-b2a1-873685e0836d req-05daec56-2124-4066-9b24-bcf3792775f7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:23.489435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d1e68974-7ab7-466d-b2a1-873685e0836d req-05daec56-2124-4066-9b24-bcf3792775f7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:23.489912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d1e68974-7ab7-466d-b2a1-873685e0836d req-05daec56-2124-4066-9b24-bcf3792775f7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:23.502435 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d1e68974-7ab7-466d-b2a1-873685e0836d req-05daec56-2124-4066-9b24-bcf3792775f7 service nova] Creating event network-vif-deleted:a380cb8b-2981-4cae-b897-ac3797a108c0 for instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 on nch1-master-1 Sep 10 21:34:23.507938 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d1e68974-7ab7-466d-b2a1-873685e0836d req-05daec56-2124-4066-9b24-bcf3792775f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036848 Sep 10 21:34:23.509984 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3332/6536] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:34:24.325566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b592a8e8-9c1e-4152-83d5-ba1174ed9eb1 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:24.326188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b592a8e8-9c1e-4152-83d5-ba1174ed9eb1 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:24.333715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b592a8e8-9c1e-4152-83d5-ba1174ed9eb1 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:24.334235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b592a8e8-9c1e-4152-83d5-ba1174ed9eb1 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:24.334670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b592a8e8-9c1e-4152-83d5-ba1174ed9eb1 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:24.335359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b592a8e8-9c1e-4152-83d5-ba1174ed9eb1 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:24.335813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b592a8e8-9c1e-4152-83d5-ba1174ed9eb1 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:24.336429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b592a8e8-9c1e-4152-83d5-ba1174ed9eb1 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:24.557498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b592a8e8-9c1e-4152-83d5-ba1174ed9eb1 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:24.565464 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b592a8e8-9c1e-4152-83d5-ba1174ed9eb1 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1317 microversion: 2.1 time: 0.244155 Sep 10 21:34:24.566325 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3205/6537] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:24 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:25.014325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a065d7b2-6a83-4d7a-b603-b1d93330cbdc req-94eb6e88-3d5f-460b-919d-fa5ee4efc947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf", "tag": "6353ff7b-3aea-4769-9245-cbd549bdbe7c"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:34:25.028371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a065d7b2-6a83-4d7a-b603-b1d93330cbdc req-94eb6e88-3d5f-460b-919d-fa5ee4efc947 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:25.028856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a065d7b2-6a83-4d7a-b603-b1d93330cbdc req-94eb6e88-3d5f-460b-919d-fa5ee4efc947 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:25.029300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a065d7b2-6a83-4d7a-b603-b1d93330cbdc req-94eb6e88-3d5f-460b-919d-fa5ee4efc947 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:25.040510 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a065d7b2-6a83-4d7a-b603-b1d93330cbdc req-94eb6e88-3d5f-460b-919d-fa5ee4efc947 service nova] Creating event network-changed:6353ff7b-3aea-4769-9245-cbd549bdbe7c for instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf on nch1-master-1 Sep 10 21:34:25.046251 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a065d7b2-6a83-4d7a-b603-b1d93330cbdc req-94eb6e88-3d5f-460b-919d-fa5ee4efc947 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120868 Sep 10 21:34:25.046866 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3333/6538] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:34:25.590141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3de47034-d826-4a96-8bd0-aebb464aedbd tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:25.590765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3de47034-d826-4a96-8bd0-aebb464aedbd tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:25.597619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3de47034-d826-4a96-8bd0-aebb464aedbd tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:25.598406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3de47034-d826-4a96-8bd0-aebb464aedbd tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:25.598860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3de47034-d826-4a96-8bd0-aebb464aedbd tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:25.599560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3de47034-d826-4a96-8bd0-aebb464aedbd tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:25.600022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3de47034-d826-4a96-8bd0-aebb464aedbd tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:25.600457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3de47034-d826-4a96-8bd0-aebb464aedbd tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:25.733135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3de47034-d826-4a96-8bd0-aebb464aedbd tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:25.741595 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3de47034-d826-4a96-8bd0-aebb464aedbd tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1317 microversion: 2.1 time: 0.155741 Sep 10 21:34:25.742210 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3206/6539] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:25 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:26.765677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-25514f6d-8d40-48c1-8490-25afc54b7d74 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:26.766448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-25514f6d-8d40-48c1-8490-25afc54b7d74 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:26.774434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25514f6d-8d40-48c1-8490-25afc54b7d74 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:26.774925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25514f6d-8d40-48c1-8490-25afc54b7d74 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:26.775369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25514f6d-8d40-48c1-8490-25afc54b7d74 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:26.776071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25514f6d-8d40-48c1-8490-25afc54b7d74 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:26.776531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25514f6d-8d40-48c1-8490-25afc54b7d74 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:26.776965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-25514f6d-8d40-48c1-8490-25afc54b7d74 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:26.912001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-25514f6d-8d40-48c1-8490-25afc54b7d74 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:26.919599 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-25514f6d-8d40-48c1-8490-25afc54b7d74 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1317 microversion: 2.1 time: 0.158123 Sep 10 21:34:26.920170 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3334/6540] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:26 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:27.944119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-70457d90-0c8b-4467-82af-a7844b5eae5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:27.944654 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-70457d90-0c8b-4467-82af-a7844b5eae5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:27.951520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70457d90-0c8b-4467-82af-a7844b5eae5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:27.952004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70457d90-0c8b-4467-82af-a7844b5eae5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:27.952440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70457d90-0c8b-4467-82af-a7844b5eae5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:27.953128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70457d90-0c8b-4467-82af-a7844b5eae5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:27.953587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70457d90-0c8b-4467-82af-a7844b5eae5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:27.954047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-70457d90-0c8b-4467-82af-a7844b5eae5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:28.088255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-70457d90-0c8b-4467-82af-a7844b5eae5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:28.096017 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-70457d90-0c8b-4467-82af-a7844b5eae5b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1317 microversion: 2.1 time: 0.156503 Sep 10 21:34:28.096596 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3207/6541] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:27 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:29.120401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-615a0d5b-ff71-4449-b195-27ab246c4f75 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:29.121021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-615a0d5b-ff71-4449-b195-27ab246c4f75 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:29.128324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-615a0d5b-ff71-4449-b195-27ab246c4f75 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:29.128821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-615a0d5b-ff71-4449-b195-27ab246c4f75 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:29.129267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-615a0d5b-ff71-4449-b195-27ab246c4f75 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:29.130008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-615a0d5b-ff71-4449-b195-27ab246c4f75 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:29.130470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-615a0d5b-ff71-4449-b195-27ab246c4f75 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:29.130901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-615a0d5b-ff71-4449-b195-27ab246c4f75 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:29.145847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:34:29.264828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-615a0d5b-ff71-4449-b195-27ab246c4f75 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:29.273339 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-615a0d5b-ff71-4449-b195-27ab246c4f75 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1317 microversion: 2.1 time: 0.156861 Sep 10 21:34:29.273938 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3335/6542] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:29 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:30.296570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5c072a9b-1e77-4006-a0b7-ee3458c5eec8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:30.297115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5c072a9b-1e77-4006-a0b7-ee3458c5eec8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:30.304690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c072a9b-1e77-4006-a0b7-ee3458c5eec8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:30.305172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c072a9b-1e77-4006-a0b7-ee3458c5eec8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:30.305604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c072a9b-1e77-4006-a0b7-ee3458c5eec8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:30.306325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c072a9b-1e77-4006-a0b7-ee3458c5eec8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:30.306777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c072a9b-1e77-4006-a0b7-ee3458c5eec8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:30.307202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5c072a9b-1e77-4006-a0b7-ee3458c5eec8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:30.439255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5c072a9b-1e77-4006-a0b7-ee3458c5eec8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:30.447493 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5c072a9b-1e77-4006-a0b7-ee3458c5eec8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1317 microversion: 2.1 time: 0.154855 Sep 10 21:34:30.448106 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3208/6543] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:30 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:31.471596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e61476c0-f06f-460e-8abd-8bf0c9ef9305 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:31.472366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e61476c0-f06f-460e-8abd-8bf0c9ef9305 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:31.479328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e61476c0-f06f-460e-8abd-8bf0c9ef9305 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:31.479926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e61476c0-f06f-460e-8abd-8bf0c9ef9305 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:31.480376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e61476c0-f06f-460e-8abd-8bf0c9ef9305 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:31.481073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e61476c0-f06f-460e-8abd-8bf0c9ef9305 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:31.481525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e61476c0-f06f-460e-8abd-8bf0c9ef9305 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:31.481976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e61476c0-f06f-460e-8abd-8bf0c9ef9305 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:31.612165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e61476c0-f06f-460e-8abd-8bf0c9ef9305 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:31.620520 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e61476c0-f06f-460e-8abd-8bf0c9ef9305 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1317 microversion: 2.1 time: 0.153043 Sep 10 21:34:31.621131 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3336/6544] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:31 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:32.547469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d4cd072d-32d6-4d9d-b970-952a7544702a req-359e68fb-6d6a-4684-9b2b-12e4e93c227f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf", "name": "network-vif-plugged", "status": "completed", "tag": "6353ff7b-3aea-4769-9245-cbd549bdbe7c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:34:32.554513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:34:32.555257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:34:32.563374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d4cd072d-32d6-4d9d-b970-952a7544702a req-359e68fb-6d6a-4684-9b2b-12e4e93c227f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:32.563862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d4cd072d-32d6-4d9d-b970-952a7544702a req-359e68fb-6d6a-4684-9b2b-12e4e93c227f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:32.564301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d4cd072d-32d6-4d9d-b970-952a7544702a req-359e68fb-6d6a-4684-9b2b-12e4e93c227f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:32.577406 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d4cd072d-32d6-4d9d-b970-952a7544702a req-359e68fb-6d6a-4684-9b2b-12e4e93c227f service nova] Creating event network-vif-plugged:6353ff7b-3aea-4769-9245-cbd549bdbe7c for instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf on nch1-master-1 Sep 10 21:34:32.583404 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d4cd072d-32d6-4d9d-b970-952a7544702a req-359e68fb-6d6a-4684-9b2b-12e4e93c227f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039647 Sep 10 21:34:32.584371 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3209/6545] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:34:32.645271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d9a63331-df3c-4dc0-acde-bbc5d56b9fe4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:32.645954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d9a63331-df3c-4dc0-acde-bbc5d56b9fe4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:32.647879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:34:32.654146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9a63331-df3c-4dc0-acde-bbc5d56b9fe4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:32.654637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9a63331-df3c-4dc0-acde-bbc5d56b9fe4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:32.655083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9a63331-df3c-4dc0-acde-bbc5d56b9fe4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:32.655973 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9a63331-df3c-4dc0-acde-bbc5d56b9fe4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:32.656417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9a63331-df3c-4dc0-acde-bbc5d56b9fe4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:32.656861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d9a63331-df3c-4dc0-acde-bbc5d56b9fe4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:32.794878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d9a63331-df3c-4dc0-acde-bbc5d56b9fe4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:32.803376 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d9a63331-df3c-4dc0-acde-bbc5d56b9fe4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1317 microversion: 2.1 time: 0.162837 Sep 10 21:34:32.803965 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3337/6546] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:32 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:33.827413 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-edb7e21c-2cb9-4214-84d6-6b0f0dd350d5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:33.828161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-edb7e21c-2cb9-4214-84d6-6b0f0dd350d5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:33.836016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edb7e21c-2cb9-4214-84d6-6b0f0dd350d5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:33.836498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edb7e21c-2cb9-4214-84d6-6b0f0dd350d5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:33.836933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edb7e21c-2cb9-4214-84d6-6b0f0dd350d5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:33.837612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edb7e21c-2cb9-4214-84d6-6b0f0dd350d5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:33.838102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edb7e21c-2cb9-4214-84d6-6b0f0dd350d5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:33.838552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-edb7e21c-2cb9-4214-84d6-6b0f0dd350d5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:33.968915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-edb7e21c-2cb9-4214-84d6-6b0f0dd350d5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:33.977902 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-edb7e21c-2cb9-4214-84d6-6b0f0dd350d5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1317 microversion: 2.1 time: 0.154359 Sep 10 21:34:33.978297 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3210/6547] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:33 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:35.002489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-51d8193f-6431-41ba-bc8a-9f43ab235ca8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:35.003337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-51d8193f-6431-41ba-bc8a-9f43ab235ca8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:35.010928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51d8193f-6431-41ba-bc8a-9f43ab235ca8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:35.011407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51d8193f-6431-41ba-bc8a-9f43ab235ca8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:35.011836 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51d8193f-6431-41ba-bc8a-9f43ab235ca8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:35.012521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51d8193f-6431-41ba-bc8a-9f43ab235ca8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:35.012972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51d8193f-6431-41ba-bc8a-9f43ab235ca8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:35.013396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-51d8193f-6431-41ba-bc8a-9f43ab235ca8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:35.144585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-51d8193f-6431-41ba-bc8a-9f43ab235ca8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:35.153074 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-51d8193f-6431-41ba-bc8a-9f43ab235ca8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1508 microversion: 2.1 time: 0.154531 Sep 10 21:34:35.153650 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3338/6548] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:34 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:35.177125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2521c6cc-3a9a-46e0-8f18-b752eba7c63b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:35.177743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2521c6cc-3a9a-46e0-8f18-b752eba7c63b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:35.184615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2521c6cc-3a9a-46e0-8f18-b752eba7c63b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:35.185108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2521c6cc-3a9a-46e0-8f18-b752eba7c63b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:35.185547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2521c6cc-3a9a-46e0-8f18-b752eba7c63b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:35.186288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2521c6cc-3a9a-46e0-8f18-b752eba7c63b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:35.186748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2521c6cc-3a9a-46e0-8f18-b752eba7c63b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:35.187188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2521c6cc-3a9a-46e0-8f18-b752eba7c63b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:35.319120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2521c6cc-3a9a-46e0-8f18-b752eba7c63b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:35.326889 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2521c6cc-3a9a-46e0-8f18-b752eba7c63b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1508 microversion: 2.1 time: 0.154530 Sep 10 21:34:35.327468 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3211/6549] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:35 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:35.349540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:34:35.351908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:35.357861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:35.358353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:35.359043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:35.359733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:35.360186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:35.360611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:35.391356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:35.397368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Old instance type m1.heat2, new instance type m1.heat {{(pid=145772) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:34:35.403827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:34:35.404252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:34:35.404851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:34:35.405141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:34:35.405565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:34:35.471021 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b552327b-a78f-47a9-9f50-1b692de913dc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "POST /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf/action" status: 202 len: 0 microversion: 2.1 time: 0.125505 Sep 10 21:34:35.471646 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3339/6550] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:34:35 2022] POST /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:34:35.480858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-af3b75c4-7899-4baf-873a-49538050b725 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:35.481474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-af3b75c4-7899-4baf-873a-49538050b725 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:35.488639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af3b75c4-7899-4baf-873a-49538050b725 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:35.489137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af3b75c4-7899-4baf-873a-49538050b725 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:35.489694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af3b75c4-7899-4baf-873a-49538050b725 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:35.490432 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af3b75c4-7899-4baf-873a-49538050b725 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:35.490891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af3b75c4-7899-4baf-873a-49538050b725 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:35.491321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-af3b75c4-7899-4baf-873a-49538050b725 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:35.627160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-af3b75c4-7899-4baf-873a-49538050b725 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:35.637547 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-af3b75c4-7899-4baf-873a-49538050b725 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1515 microversion: 2.1 time: 0.160543 Sep 10 21:34:35.638240 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3212/6551] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:35 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:34:36.661691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dbf5e17f-e754-4bf9-921a-822a6dfff0ca tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:36.663119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dbf5e17f-e754-4bf9-921a-822a6dfff0ca tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:36.671540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbf5e17f-e754-4bf9-921a-822a6dfff0ca tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:36.672194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbf5e17f-e754-4bf9-921a-822a6dfff0ca tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:36.672962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbf5e17f-e754-4bf9-921a-822a6dfff0ca tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:36.674259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbf5e17f-e754-4bf9-921a-822a6dfff0ca tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:36.675082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbf5e17f-e754-4bf9-921a-822a6dfff0ca tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:36.675870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbf5e17f-e754-4bf9-921a-822a6dfff0ca tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:36.834649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dbf5e17f-e754-4bf9-921a-822a6dfff0ca tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:36.842744 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dbf5e17f-e754-4bf9-921a-822a6dfff0ca tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1515 microversion: 2.1 time: 0.185703 Sep 10 21:34:36.843395 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3340/6552] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:36 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:37.868441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be2bd521-06b1-4907-b6b5-ea5cac076307 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:37.869038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-be2bd521-06b1-4907-b6b5-ea5cac076307 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:37.872426 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 21:34:37.872570 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 21:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf (ip 10.222.0.33) !!! Sep 10 21:34:37.880098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be2bd521-06b1-4907-b6b5-ea5cac076307 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:37.880594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be2bd521-06b1-4907-b6b5-ea5cac076307 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:37.881036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be2bd521-06b1-4907-b6b5-ea5cac076307 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:37.881735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be2bd521-06b1-4907-b6b5-ea5cac076307 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:37.882219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be2bd521-06b1-4907-b6b5-ea5cac076307 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:37.882647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-be2bd521-06b1-4907-b6b5-ea5cac076307 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:37.897948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:34:38.018023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-be2bd521-06b1-4907-b6b5-ea5cac076307 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:38.026487 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be2bd521-06b1-4907-b6b5-ea5cac076307 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.161995 Sep 10 21:34:38.027069 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3213/6553] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:37 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:39.050451 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f66654c2-ac2d-47ff-96e5-cbb12ac24904 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:39.051592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f66654c2-ac2d-47ff-96e5-cbb12ac24904 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:39.058673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f66654c2-ac2d-47ff-96e5-cbb12ac24904 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:39.059171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f66654c2-ac2d-47ff-96e5-cbb12ac24904 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:39.059632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f66654c2-ac2d-47ff-96e5-cbb12ac24904 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:39.060315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f66654c2-ac2d-47ff-96e5-cbb12ac24904 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:39.060769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f66654c2-ac2d-47ff-96e5-cbb12ac24904 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:39.061197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f66654c2-ac2d-47ff-96e5-cbb12ac24904 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:39.202751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f66654c2-ac2d-47ff-96e5-cbb12ac24904 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:39.211589 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f66654c2-ac2d-47ff-96e5-cbb12ac24904 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.165047 Sep 10 21:34:39.212199 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3341/6554] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:39 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:40.235595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5e399ff5-c111-453e-9758-322294882a8a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:40.236119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5e399ff5-c111-453e-9758-322294882a8a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:40.243347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e399ff5-c111-453e-9758-322294882a8a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:40.243830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e399ff5-c111-453e-9758-322294882a8a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:40.244265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e399ff5-c111-453e-9758-322294882a8a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:40.244964 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e399ff5-c111-453e-9758-322294882a8a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:40.245417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e399ff5-c111-453e-9758-322294882a8a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:40.245862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5e399ff5-c111-453e-9758-322294882a8a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:40.379587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5e399ff5-c111-453e-9758-322294882a8a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:40.387343 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5e399ff5-c111-453e-9758-322294882a8a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.156035 Sep 10 21:34:40.387930 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3214/6555] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:40 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:41.412218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bda72e71-7aed-42f6-8038-1e43d30c650e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:41.412864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bda72e71-7aed-42f6-8038-1e43d30c650e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:41.415571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:34:41.420901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bda72e71-7aed-42f6-8038-1e43d30c650e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:41.421396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bda72e71-7aed-42f6-8038-1e43d30c650e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:41.421857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bda72e71-7aed-42f6-8038-1e43d30c650e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:41.422564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bda72e71-7aed-42f6-8038-1e43d30c650e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:41.423025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bda72e71-7aed-42f6-8038-1e43d30c650e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:41.423460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bda72e71-7aed-42f6-8038-1e43d30c650e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:41.557937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bda72e71-7aed-42f6-8038-1e43d30c650e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:41.565671 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bda72e71-7aed-42f6-8038-1e43d30c650e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.158149 Sep 10 21:34:41.566884 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3342/6556] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:41 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:42.590458 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-93fe7d34-979c-46db-8e06-22fbaf2698da tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:42.591071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-93fe7d34-979c-46db-8e06-22fbaf2698da tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:42.593898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:34:42.599420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93fe7d34-979c-46db-8e06-22fbaf2698da tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:42.599905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93fe7d34-979c-46db-8e06-22fbaf2698da tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:42.600342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93fe7d34-979c-46db-8e06-22fbaf2698da tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:42.601042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93fe7d34-979c-46db-8e06-22fbaf2698da tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:42.601502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93fe7d34-979c-46db-8e06-22fbaf2698da tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:42.602023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93fe7d34-979c-46db-8e06-22fbaf2698da tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:42.731357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-93fe7d34-979c-46db-8e06-22fbaf2698da tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:42.740167 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-93fe7d34-979c-46db-8e06-22fbaf2698da tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.153613 Sep 10 21:34:42.740750 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3215/6557] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:42 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:43.764392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8d939cb5-e8c5-4bad-b3bf-178b685f69b7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:43.765003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8d939cb5-e8c5-4bad-b3bf-178b685f69b7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:43.772425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d939cb5-e8c5-4bad-b3bf-178b685f69b7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:43.772911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d939cb5-e8c5-4bad-b3bf-178b685f69b7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:43.773350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d939cb5-e8c5-4bad-b3bf-178b685f69b7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:43.774070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d939cb5-e8c5-4bad-b3bf-178b685f69b7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:43.774530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d939cb5-e8c5-4bad-b3bf-178b685f69b7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:43.774958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8d939cb5-e8c5-4bad-b3bf-178b685f69b7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:43.906825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8d939cb5-e8c5-4bad-b3bf-178b685f69b7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:43.914888 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8d939cb5-e8c5-4bad-b3bf-178b685f69b7 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.154423 Sep 10 21:34:43.915459 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3343/6558] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:43 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:44.938981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-200a3c52-6d81-4bb7-906f-4df32996461b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:44.939509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-200a3c52-6d81-4bb7-906f-4df32996461b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:44.947148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-200a3c52-6d81-4bb7-906f-4df32996461b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:44.947650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-200a3c52-6d81-4bb7-906f-4df32996461b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:44.948079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-200a3c52-6d81-4bb7-906f-4df32996461b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:44.948776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-200a3c52-6d81-4bb7-906f-4df32996461b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:44.949235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-200a3c52-6d81-4bb7-906f-4df32996461b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:44.949666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-200a3c52-6d81-4bb7-906f-4df32996461b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:45.084700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-200a3c52-6d81-4bb7-906f-4df32996461b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:45.092506 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-200a3c52-6d81-4bb7-906f-4df32996461b tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.157505 Sep 10 21:34:45.093080 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3216/6559] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:44 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:46.117077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1e9baa51-b9da-4e05-b002-91d5c528e92c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:46.117691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1e9baa51-b9da-4e05-b002-91d5c528e92c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:46.124633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9baa51-b9da-4e05-b002-91d5c528e92c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:46.125115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9baa51-b9da-4e05-b002-91d5c528e92c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:46.125551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9baa51-b9da-4e05-b002-91d5c528e92c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:46.126279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9baa51-b9da-4e05-b002-91d5c528e92c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:46.126735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9baa51-b9da-4e05-b002-91d5c528e92c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:46.127163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1e9baa51-b9da-4e05-b002-91d5c528e92c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:46.263696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1e9baa51-b9da-4e05-b002-91d5c528e92c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:46.271984 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1e9baa51-b9da-4e05-b002-91d5c528e92c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.159337 Sep 10 21:34:46.272571 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3344/6560] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:46 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:47.295966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-50ca9a89-22d5-4ac5-9b34-395850907c25 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:47.296534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-50ca9a89-22d5-4ac5-9b34-395850907c25 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:47.302708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50ca9a89-22d5-4ac5-9b34-395850907c25 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:47.303193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50ca9a89-22d5-4ac5-9b34-395850907c25 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:47.303626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50ca9a89-22d5-4ac5-9b34-395850907c25 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:47.304322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50ca9a89-22d5-4ac5-9b34-395850907c25 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:47.304775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50ca9a89-22d5-4ac5-9b34-395850907c25 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:47.305198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-50ca9a89-22d5-4ac5-9b34-395850907c25 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:47.434615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-50ca9a89-22d5-4ac5-9b34-395850907c25 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:47.443307 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-50ca9a89-22d5-4ac5-9b34-395850907c25 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.151559 Sep 10 21:34:47.443878 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3217/6561] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:47 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:48.466515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5cab4b1-73ef-43ea-bdc4-660abf132ccf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:48.467126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5cab4b1-73ef-43ea-bdc4-660abf132ccf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:48.474675 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5cab4b1-73ef-43ea-bdc4-660abf132ccf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:48.475151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5cab4b1-73ef-43ea-bdc4-660abf132ccf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:48.475583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5cab4b1-73ef-43ea-bdc4-660abf132ccf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:48.476294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5cab4b1-73ef-43ea-bdc4-660abf132ccf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:48.476742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5cab4b1-73ef-43ea-bdc4-660abf132ccf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:48.477159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5cab4b1-73ef-43ea-bdc4-660abf132ccf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:48.612430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5cab4b1-73ef-43ea-bdc4-660abf132ccf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:48.620227 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5cab4b1-73ef-43ea-bdc4-660abf132ccf tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.157538 Sep 10 21:34:48.620811 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3345/6562] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:48 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:49.644694 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ee8cab31-69c2-4292-8b5b-4c941b53ec63 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:49.645571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ee8cab31-69c2-4292-8b5b-4c941b53ec63 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:49.652393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee8cab31-69c2-4292-8b5b-4c941b53ec63 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:49.652881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee8cab31-69c2-4292-8b5b-4c941b53ec63 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:49.653313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee8cab31-69c2-4292-8b5b-4c941b53ec63 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:49.654029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee8cab31-69c2-4292-8b5b-4c941b53ec63 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:49.654482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee8cab31-69c2-4292-8b5b-4c941b53ec63 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:49.654905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee8cab31-69c2-4292-8b5b-4c941b53ec63 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:49.786574 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ee8cab31-69c2-4292-8b5b-4c941b53ec63 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:49.794246 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ee8cab31-69c2-4292-8b5b-4c941b53ec63 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.153994 Sep 10 21:34:49.794832 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3218/6563] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:49 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:50.818548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4fc0be61-bb2d-4200-a153-4130e9a0fad6 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:50.819153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4fc0be61-bb2d-4200-a153-4130e9a0fad6 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:50.825981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fc0be61-bb2d-4200-a153-4130e9a0fad6 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:50.826460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fc0be61-bb2d-4200-a153-4130e9a0fad6 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:50.826891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fc0be61-bb2d-4200-a153-4130e9a0fad6 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:50.827579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fc0be61-bb2d-4200-a153-4130e9a0fad6 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:50.828030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fc0be61-bb2d-4200-a153-4130e9a0fad6 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:50.828454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4fc0be61-bb2d-4200-a153-4130e9a0fad6 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:50.958637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4fc0be61-bb2d-4200-a153-4130e9a0fad6 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:50.966429 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4fc0be61-bb2d-4200-a153-4130e9a0fad6 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.152431 Sep 10 21:34:50.967016 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3346/6564] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:50 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:51.989936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3cb0cfa7-2f6b-4623-9c01-567d1b1ec003 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:51.991379 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3cb0cfa7-2f6b-4623-9c01-567d1b1ec003 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:51.997154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb0cfa7-2f6b-4623-9c01-567d1b1ec003 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:51.997641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb0cfa7-2f6b-4623-9c01-567d1b1ec003 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:51.998118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb0cfa7-2f6b-4623-9c01-567d1b1ec003 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:51.998810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb0cfa7-2f6b-4623-9c01-567d1b1ec003 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:51.999266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb0cfa7-2f6b-4623-9c01-567d1b1ec003 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:51.999692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3cb0cfa7-2f6b-4623-9c01-567d1b1ec003 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:52.138925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3cb0cfa7-2f6b-4623-9c01-567d1b1ec003 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:52.147291 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3cb0cfa7-2f6b-4623-9c01-567d1b1ec003 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.161335 Sep 10 21:34:52.147860 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3219/6565] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:51 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:53.170697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1fe4b06d-e343-4b8f-af9c-8453736b86c8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:53.171367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1fe4b06d-e343-4b8f-af9c-8453736b86c8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:53.178972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fe4b06d-e343-4b8f-af9c-8453736b86c8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:53.179500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fe4b06d-e343-4b8f-af9c-8453736b86c8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:53.179939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fe4b06d-e343-4b8f-af9c-8453736b86c8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:53.180670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fe4b06d-e343-4b8f-af9c-8453736b86c8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:53.181127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fe4b06d-e343-4b8f-af9c-8453736b86c8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:53.181588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1fe4b06d-e343-4b8f-af9c-8453736b86c8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:53.319167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1fe4b06d-e343-4b8f-af9c-8453736b86c8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:53.326937 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1fe4b06d-e343-4b8f-af9c-8453736b86c8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.160213 Sep 10 21:34:53.327518 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3347/6566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:53 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:54.351709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-81d25753-23ac-4d05-a673-4e9d662f5836 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:54.352371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-81d25753-23ac-4d05-a673-4e9d662f5836 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:54.359539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81d25753-23ac-4d05-a673-4e9d662f5836 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:54.360028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81d25753-23ac-4d05-a673-4e9d662f5836 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:54.360470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81d25753-23ac-4d05-a673-4e9d662f5836 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:54.361166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81d25753-23ac-4d05-a673-4e9d662f5836 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:54.361624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81d25753-23ac-4d05-a673-4e9d662f5836 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:54.362081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81d25753-23ac-4d05-a673-4e9d662f5836 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:54.494864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-81d25753-23ac-4d05-a673-4e9d662f5836 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:54.502620 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-81d25753-23ac-4d05-a673-4e9d662f5836 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.155412 Sep 10 21:34:54.503738 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3220/6567] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:54 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:55.527762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6535cd7f-1607-402f-973c-3972c95fb274 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:55.528383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6535cd7f-1607-402f-973c-3972c95fb274 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:55.535929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6535cd7f-1607-402f-973c-3972c95fb274 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:55.536415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6535cd7f-1607-402f-973c-3972c95fb274 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:55.536858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6535cd7f-1607-402f-973c-3972c95fb274 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:55.537560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6535cd7f-1607-402f-973c-3972c95fb274 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:55.538061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6535cd7f-1607-402f-973c-3972c95fb274 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:55.538500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6535cd7f-1607-402f-973c-3972c95fb274 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:55.668864 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6535cd7f-1607-402f-973c-3972c95fb274 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:55.676838 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6535cd7f-1607-402f-973c-3972c95fb274 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.153030 Sep 10 21:34:55.677418 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3348/6568] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:55 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:56.700783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-779b6fbc-b6a0-4492-a06e-640b7350e06c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:56.701426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-779b6fbc-b6a0-4492-a06e-640b7350e06c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:56.708967 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-779b6fbc-b6a0-4492-a06e-640b7350e06c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:56.709444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-779b6fbc-b6a0-4492-a06e-640b7350e06c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:56.709898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-779b6fbc-b6a0-4492-a06e-640b7350e06c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:56.710591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-779b6fbc-b6a0-4492-a06e-640b7350e06c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:56.711045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-779b6fbc-b6a0-4492-a06e-640b7350e06c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:56.711469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-779b6fbc-b6a0-4492-a06e-640b7350e06c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:56.844931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-779b6fbc-b6a0-4492-a06e-640b7350e06c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:56.852816 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-779b6fbc-b6a0-4492-a06e-640b7350e06c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.156043 Sep 10 21:34:56.853403 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3221/6569] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:56 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:57.876822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c0effeb1-e390-4b8d-9d5e-3c4a8c9a862d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:57.877442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c0effeb1-e390-4b8d-9d5e-3c4a8c9a862d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:57.885147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0effeb1-e390-4b8d-9d5e-3c4a8c9a862d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:57.885637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0effeb1-e390-4b8d-9d5e-3c4a8c9a862d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:57.886120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0effeb1-e390-4b8d-9d5e-3c4a8c9a862d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:57.886820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0effeb1-e390-4b8d-9d5e-3c4a8c9a862d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:57.887286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0effeb1-e390-4b8d-9d5e-3c4a8c9a862d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:57.887719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0effeb1-e390-4b8d-9d5e-3c4a8c9a862d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:58.022372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c0effeb1-e390-4b8d-9d5e-3c4a8c9a862d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:58.030123 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c0effeb1-e390-4b8d-9d5e-3c4a8c9a862d tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.157270 Sep 10 21:34:58.030696 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3349/6570] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:57 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:34:59.059172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-468e2570-2e44-4774-ab08-e89098ac896e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:34:59.059787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-468e2570-2e44-4774-ab08-e89098ac896e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:34:59.070927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-468e2570-2e44-4774-ab08-e89098ac896e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:59.071417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-468e2570-2e44-4774-ab08-e89098ac896e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:59.071853 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-468e2570-2e44-4774-ab08-e89098ac896e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:59.072557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-468e2570-2e44-4774-ab08-e89098ac896e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:34:59.073012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-468e2570-2e44-4774-ab08-e89098ac896e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:34:59.073441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-468e2570-2e44-4774-ab08-e89098ac896e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:34:59.204818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-468e2570-2e44-4774-ab08-e89098ac896e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:34:59.212887 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-468e2570-2e44-4774-ab08-e89098ac896e tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.161920 Sep 10 21:34:59.213457 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3222/6571] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:34:59 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:00.236879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5534420d-84f4-4a8d-b2fa-4f137df78bef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:00.237794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5534420d-84f4-4a8d-b2fa-4f137df78bef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:00.244642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5534420d-84f4-4a8d-b2fa-4f137df78bef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:00.245126 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5534420d-84f4-4a8d-b2fa-4f137df78bef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:00.245575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5534420d-84f4-4a8d-b2fa-4f137df78bef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:00.246299 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5534420d-84f4-4a8d-b2fa-4f137df78bef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:00.246762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5534420d-84f4-4a8d-b2fa-4f137df78bef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:00.247192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5534420d-84f4-4a8d-b2fa-4f137df78bef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:00.251112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:35:00.378648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5534420d-84f4-4a8d-b2fa-4f137df78bef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:00.386408 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5534420d-84f4-4a8d-b2fa-4f137df78bef tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.153682 Sep 10 21:35:00.386984 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3350/6572] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:00 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:01.410436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-24228af9-1b7e-4601-b0c4-56a7709a9a94 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:01.411056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-24228af9-1b7e-4601-b0c4-56a7709a9a94 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:01.417878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24228af9-1b7e-4601-b0c4-56a7709a9a94 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:01.418361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24228af9-1b7e-4601-b0c4-56a7709a9a94 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:01.418797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24228af9-1b7e-4601-b0c4-56a7709a9a94 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:01.419478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24228af9-1b7e-4601-b0c4-56a7709a9a94 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:01.419929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24228af9-1b7e-4601-b0c4-56a7709a9a94 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:01.420351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-24228af9-1b7e-4601-b0c4-56a7709a9a94 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:01.549046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-24228af9-1b7e-4601-b0c4-56a7709a9a94 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:01.557685 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-24228af9-1b7e-4601-b0c4-56a7709a9a94 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.151712 Sep 10 21:35:01.558286 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3223/6573] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:01 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:02.580552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dad6b5c2-a6ce-498c-bfde-60b5b6a468f0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:02.581248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dad6b5c2-a6ce-498c-bfde-60b5b6a468f0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:02.588131 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad6b5c2-a6ce-498c-bfde-60b5b6a468f0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:02.588613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad6b5c2-a6ce-498c-bfde-60b5b6a468f0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:02.589064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad6b5c2-a6ce-498c-bfde-60b5b6a468f0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:02.589759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad6b5c2-a6ce-498c-bfde-60b5b6a468f0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:02.590248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad6b5c2-a6ce-498c-bfde-60b5b6a468f0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:02.590681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad6b5c2-a6ce-498c-bfde-60b5b6a468f0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:02.729789 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dad6b5c2-a6ce-498c-bfde-60b5b6a468f0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:02.738685 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dad6b5c2-a6ce-498c-bfde-60b5b6a468f0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.161895 Sep 10 21:35:02.739282 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3351/6574] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:02 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:03.761996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-312f302e-219a-4154-9578-5b17d1739239 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:03.762611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-312f302e-219a-4154-9578-5b17d1739239 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:03.770114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f302e-219a-4154-9578-5b17d1739239 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:03.770600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f302e-219a-4154-9578-5b17d1739239 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:03.771043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f302e-219a-4154-9578-5b17d1739239 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:03.771734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f302e-219a-4154-9578-5b17d1739239 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:03.772189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f302e-219a-4154-9578-5b17d1739239 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:03.772618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-312f302e-219a-4154-9578-5b17d1739239 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:03.904003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-312f302e-219a-4154-9578-5b17d1739239 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:03.911765 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-312f302e-219a-4154-9578-5b17d1739239 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1520 microversion: 2.1 time: 0.153693 Sep 10 21:35:03.912348 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3224/6575] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:03 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:04.935444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d3785794-a101-450d-8085-90b4c6791072 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:04.936170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d3785794-a101-450d-8085-90b4c6791072 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:04.943552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3785794-a101-450d-8085-90b4c6791072 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:04.944035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3785794-a101-450d-8085-90b4c6791072 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:04.944466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3785794-a101-450d-8085-90b4c6791072 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:04.945155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3785794-a101-450d-8085-90b4c6791072 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:04.945604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3785794-a101-450d-8085-90b4c6791072 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:04.946079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d3785794-a101-450d-8085-90b4c6791072 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:05.154069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d3785794-a101-450d-8085-90b4c6791072 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:05.163606 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d3785794-a101-450d-8085-90b4c6791072 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1519 microversion: 2.1 time: 0.231784 Sep 10 21:35:05.164224 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3352/6576] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:04 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:05.169363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-11757bf3-818a-4b87-b5b2-9cff5cd23cf8 req-c0bfd96d-7121-48f2-8cb4-b26f6690f329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf", "name": "network-vif-unplugged", "status": "completed", "tag": "6353ff7b-3aea-4769-9245-cbd549bdbe7c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:35:05.181398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-11757bf3-818a-4b87-b5b2-9cff5cd23cf8 req-c0bfd96d-7121-48f2-8cb4-b26f6690f329 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:05.181868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-11757bf3-818a-4b87-b5b2-9cff5cd23cf8 req-c0bfd96d-7121-48f2-8cb4-b26f6690f329 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:05.182295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-11757bf3-818a-4b87-b5b2-9cff5cd23cf8 req-c0bfd96d-7121-48f2-8cb4-b26f6690f329 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:05.197688 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-11757bf3-818a-4b87-b5b2-9cff5cd23cf8 req-c0bfd96d-7121-48f2-8cb4-b26f6690f329 service nova] Creating event network-vif-unplugged:6353ff7b-3aea-4769-9245-cbd549bdbe7c for instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf on nch2-master-1 Sep 10 21:35:05.203230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-11757bf3-818a-4b87-b5b2-9cff5cd23cf8 req-c0bfd96d-7121-48f2-8cb4-b26f6690f329 service nova] Instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:35:05.215079 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-11757bf3-818a-4b87-b5b2-9cff5cd23cf8 req-c0bfd96d-7121-48f2-8cb4-b26f6690f329 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049737 Sep 10 21:35:05.216189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3225/6577] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:35:06.188258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eb5cb6bc-5ae8-485d-8926-40daeef05ff3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:06.188926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eb5cb6bc-5ae8-485d-8926-40daeef05ff3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:06.196048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb5cb6bc-5ae8-485d-8926-40daeef05ff3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:06.196567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb5cb6bc-5ae8-485d-8926-40daeef05ff3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:06.197063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb5cb6bc-5ae8-485d-8926-40daeef05ff3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:06.197705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb5cb6bc-5ae8-485d-8926-40daeef05ff3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:06.198189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb5cb6bc-5ae8-485d-8926-40daeef05ff3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:06.198620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eb5cb6bc-5ae8-485d-8926-40daeef05ff3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:06.330170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eb5cb6bc-5ae8-485d-8926-40daeef05ff3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:06.338505 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eb5cb6bc-5ae8-485d-8926-40daeef05ff3 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1517 microversion: 2.1 time: 0.154142 Sep 10 21:35:06.339091 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3353/6578] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:06 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:07.232870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-850107ef-920f-4b8d-ac70-aaefd6d6ffb5 req-9a8eb9f6-e70c-49f3-bfb4-46b76e6e24d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf", "tag": "6353ff7b-3aea-4769-9245-cbd549bdbe7c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:35:07.244316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-850107ef-920f-4b8d-ac70-aaefd6d6ffb5 req-9a8eb9f6-e70c-49f3-bfb4-46b76e6e24d8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:07.244794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-850107ef-920f-4b8d-ac70-aaefd6d6ffb5 req-9a8eb9f6-e70c-49f3-bfb4-46b76e6e24d8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:07.245222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-850107ef-920f-4b8d-ac70-aaefd6d6ffb5 req-9a8eb9f6-e70c-49f3-bfb4-46b76e6e24d8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:07.256745 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-850107ef-920f-4b8d-ac70-aaefd6d6ffb5 req-9a8eb9f6-e70c-49f3-bfb4-46b76e6e24d8 service nova] Creating event network-changed:6353ff7b-3aea-4769-9245-cbd549bdbe7c for instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf on nch2-master-1 Sep 10 21:35:07.262308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-850107ef-920f-4b8d-ac70-aaefd6d6ffb5 req-9a8eb9f6-e70c-49f3-bfb4-46b76e6e24d8 service nova] Instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:35:07.272883 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-850107ef-920f-4b8d-ac70-aaefd6d6ffb5 req-9a8eb9f6-e70c-49f3-bfb4-46b76e6e24d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044136 Sep 10 21:35:07.273489 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3226/6579] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:35:07.363339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40165033-3727-4aa0-97fc-0b3563b2b955 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:07.364064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-40165033-3727-4aa0-97fc-0b3563b2b955 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:07.371203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40165033-3727-4aa0-97fc-0b3563b2b955 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:07.371699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40165033-3727-4aa0-97fc-0b3563b2b955 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:07.372143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40165033-3727-4aa0-97fc-0b3563b2b955 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:07.372855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40165033-3727-4aa0-97fc-0b3563b2b955 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:07.373319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40165033-3727-4aa0-97fc-0b3563b2b955 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:07.373755 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40165033-3727-4aa0-97fc-0b3563b2b955 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:07.590811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40165033-3727-4aa0-97fc-0b3563b2b955 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:07.599547 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40165033-3727-4aa0-97fc-0b3563b2b955 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1517 microversion: 2.1 time: 0.241142 Sep 10 21:35:07.600241 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3354/6580] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:07 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:08.625782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9246b06f-fd83-4c19-9b9a-9913758412d9 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:08.626519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9246b06f-fd83-4c19-9b9a-9913758412d9 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:08.633453 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9246b06f-fd83-4c19-9b9a-9913758412d9 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:08.634537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9246b06f-fd83-4c19-9b9a-9913758412d9 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:08.634993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9246b06f-fd83-4c19-9b9a-9913758412d9 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:08.635708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9246b06f-fd83-4c19-9b9a-9913758412d9 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:08.636178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9246b06f-fd83-4c19-9b9a-9913758412d9 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:08.636612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9246b06f-fd83-4c19-9b9a-9913758412d9 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:08.640893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=78 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:35:08.777893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9246b06f-fd83-4c19-9b9a-9913758412d9 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:08.786479 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9246b06f-fd83-4c19-9b9a-9913758412d9 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1514 microversion: 2.1 time: 0.166043 Sep 10 21:35:08.787085 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3227/6581] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:08 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:08.809593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9dd1739b-4108-4930-ac76-6f498e742fe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:35:08.810136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9dd1739b-4108-4930-ac76-6f498e742fe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:08.817944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd1739b-4108-4930-ac76-6f498e742fe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:08.818433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd1739b-4108-4930-ac76-6f498e742fe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:08.818875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd1739b-4108-4930-ac76-6f498e742fe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:08.819574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd1739b-4108-4930-ac76-6f498e742fe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:08.820032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd1739b-4108-4930-ac76-6f498e742fe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:08.820461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9dd1739b-4108-4930-ac76-6f498e742fe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:08.879276 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9dd1739b-4108-4930-ac76-6f498e742fe0 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "POST /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf/action" status: 204 len: 0 microversion: 2.1 time: 0.073394 Sep 10 21:35:08.880037 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3355/6582] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:35:08 2022] POST /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:35:08.888321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d1449b34-1b0e-4826-89fc-47d83299631f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:08.888938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d1449b34-1b0e-4826-89fc-47d83299631f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:08.894939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1449b34-1b0e-4826-89fc-47d83299631f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:08.895427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1449b34-1b0e-4826-89fc-47d83299631f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:08.895868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1449b34-1b0e-4826-89fc-47d83299631f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:08.896663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1449b34-1b0e-4826-89fc-47d83299631f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:08.897029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1449b34-1b0e-4826-89fc-47d83299631f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:08.897460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d1449b34-1b0e-4826-89fc-47d83299631f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:09.162763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d1449b34-1b0e-4826-89fc-47d83299631f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:09.170474 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d1449b34-1b0e-4826-89fc-47d83299631f tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1514 microversion: 2.1 time: 0.286042 Sep 10 21:35:09.171058 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3228/6583] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:08 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:10.194529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cecbcdbd-ff82-4592-89d1-ae743a3de66a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:10.195264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cecbcdbd-ff82-4592-89d1-ae743a3de66a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:10.202820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecbcdbd-ff82-4592-89d1-ae743a3de66a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.203332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecbcdbd-ff82-4592-89d1-ae743a3de66a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.203794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecbcdbd-ff82-4592-89d1-ae743a3de66a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.204496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecbcdbd-ff82-4592-89d1-ae743a3de66a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.204948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecbcdbd-ff82-4592-89d1-ae743a3de66a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.205373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cecbcdbd-ff82-4592-89d1-ae743a3de66a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.351636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cecbcdbd-ff82-4592-89d1-ae743a3de66a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:10.360589 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cecbcdbd-ff82-4592-89d1-ae743a3de66a tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1506 microversion: 2.1 time: 0.170782 Sep 10 21:35:10.361177 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3356/6584] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:10 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:10.384633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91ab3d9f-0dba-4e36-8a99-49b8a280369c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:10.385253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-91ab3d9f-0dba-4e36-8a99-49b8a280369c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:10.392368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ab3d9f-0dba-4e36-8a99-49b8a280369c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.392864 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ab3d9f-0dba-4e36-8a99-49b8a280369c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.393310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ab3d9f-0dba-4e36-8a99-49b8a280369c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.394171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ab3d9f-0dba-4e36-8a99-49b8a280369c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.394638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ab3d9f-0dba-4e36-8a99-49b8a280369c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.395072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91ab3d9f-0dba-4e36-8a99-49b8a280369c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.531711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-91ab3d9f-0dba-4e36-8a99-49b8a280369c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:10.540241 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91ab3d9f-0dba-4e36-8a99-49b8a280369c tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1506 microversion: 2.1 time: 0.159488 Sep 10 21:35:10.540833 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3229/6585] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:10 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:10.563232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0977f57c-3dce-4104-bbdf-f42678999ef5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:10.563855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0977f57c-3dce-4104-bbdf-f42678999ef5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:10.570036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0977f57c-3dce-4104-bbdf-f42678999ef5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.570524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0977f57c-3dce-4104-bbdf-f42678999ef5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.570965 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0977f57c-3dce-4104-bbdf-f42678999ef5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.571665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0977f57c-3dce-4104-bbdf-f42678999ef5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.572123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0977f57c-3dce-4104-bbdf-f42678999ef5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.572556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0977f57c-3dce-4104-bbdf-f42678999ef5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.671891 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e6645e0d-54c8-4852-a7e5-0bb9632e927e req-62cb9f8b-0d17-463a-a6f5-511389f2acf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf", "name": "network-vif-plugged", "status": "completed", "tag": "6353ff7b-3aea-4769-9245-cbd549bdbe7c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:35:10.683528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e6645e0d-54c8-4852-a7e5-0bb9632e927e req-62cb9f8b-0d17-463a-a6f5-511389f2acf4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.684141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e6645e0d-54c8-4852-a7e5-0bb9632e927e req-62cb9f8b-0d17-463a-a6f5-511389f2acf4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.684669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e6645e0d-54c8-4852-a7e5-0bb9632e927e req-62cb9f8b-0d17-463a-a6f5-511389f2acf4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.700806 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e6645e0d-54c8-4852-a7e5-0bb9632e927e req-62cb9f8b-0d17-463a-a6f5-511389f2acf4 service nova] Creating event network-vif-plugged:6353ff7b-3aea-4769-9245-cbd549bdbe7c for instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf on nch2-master-1 Sep 10 21:35:10.707336 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e6645e0d-54c8-4852-a7e5-0bb9632e927e req-62cb9f8b-0d17-463a-a6f5-511389f2acf4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039626 Sep 10 21:35:10.708154 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3230/6586] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:35:10.716392 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0977f57c-3dce-4104-bbdf-f42678999ef5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:10.728839 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0977f57c-3dce-4104-bbdf-f42678999ef5 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1506 microversion: 2.1 time: 0.169477 Sep 10 21:35:10.729428 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3357/6587] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:10 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:10.752719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6ceb12df-2c8e-4d71-8814-4c972fa76050 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:10.754368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6ceb12df-2c8e-4d71-8814-4c972fa76050 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:10.761044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ceb12df-2c8e-4d71-8814-4c972fa76050 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.761525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ceb12df-2c8e-4d71-8814-4c972fa76050 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.762045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ceb12df-2c8e-4d71-8814-4c972fa76050 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.762804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ceb12df-2c8e-4d71-8814-4c972fa76050 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.763288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ceb12df-2c8e-4d71-8814-4c972fa76050 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.763715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ceb12df-2c8e-4d71-8814-4c972fa76050 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.788884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6ceb12df-2c8e-4d71-8814-4c972fa76050 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:35:10.865498 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6ceb12df-2c8e-4d71-8814-4c972fa76050 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 204 len: 0 microversion: 2.1 time: 0.116139 Sep 10 21:35:10.866471 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3231/6588] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:35:10 2022] DELETE /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:35:10.881285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:10.881790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:10.887801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.888293 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.888735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.889433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.889986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.890425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.915083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:35:10.959528 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.compute.api [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Instance is already in deleting state, ignoring this request Sep 10 21:35:10.960356 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-44095a72-8991-443d-be62-d6a10fa7c563 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 204 len: 0 microversion: 2.1 time: 0.083784 Sep 10 21:35:10.960929 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3358/6589] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:35:10 2022] DELETE /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:35:10.969450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1f87003a-99c6-4333-aee3-d96e6ad1d6f8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:10.970193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1f87003a-99c6-4333-aee3-d96e6ad1d6f8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:10.977181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f87003a-99c6-4333-aee3-d96e6ad1d6f8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.977669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f87003a-99c6-4333-aee3-d96e6ad1d6f8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.978133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f87003a-99c6-4333-aee3-d96e6ad1d6f8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:10.978926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f87003a-99c6-4333-aee3-d96e6ad1d6f8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:10.979275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f87003a-99c6-4333-aee3-d96e6ad1d6f8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:10.979730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f87003a-99c6-4333-aee3-d96e6ad1d6f8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:11.115659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1f87003a-99c6-4333-aee3-d96e6ad1d6f8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:11.123746 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1f87003a-99c6-4333-aee3-d96e6ad1d6f8 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1512 microversion: 2.1 time: 0.158456 Sep 10 21:35:11.124333 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3232/6590] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:10 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:12.148188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a8a19e26-3fc4-46c5-8ed8-b79e225be255 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:12.148935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a8a19e26-3fc4-46c5-8ed8-b79e225be255 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:12.151734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=34 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:35:12.157263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a19e26-3fc4-46c5-8ed8-b79e225be255 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:12.157779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a19e26-3fc4-46c5-8ed8-b79e225be255 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:12.158276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a19e26-3fc4-46c5-8ed8-b79e225be255 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:12.159035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a19e26-3fc4-46c5-8ed8-b79e225be255 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:12.159629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a19e26-3fc4-46c5-8ed8-b79e225be255 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:12.160066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a8a19e26-3fc4-46c5-8ed8-b79e225be255 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:12.287810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a8a19e26-3fc4-46c5-8ed8-b79e225be255 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf26d0546ef846cb845be454c0e4ad76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b494efae18f494a8a8b1d6aa53c4327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:12.295586 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a8a19e26-3fc4-46c5-8ed8-b79e225be255 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 200 len: 1512 microversion: 2.1 time: 0.152095 Sep 10 21:35:12.296171 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3359/6591] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:12 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:12.775285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-67458894-8ace-4b9d-9523-78bd00f45507 req-da867ddb-8b2d-4113-bbec-00e3def6a385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf", "name": "network-vif-deleted", "tag": "6353ff7b-3aea-4769-9245-cbd549bdbe7c"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:35:12.785456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:35:12.791429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-67458894-8ace-4b9d-9523-78bd00f45507 req-da867ddb-8b2d-4113-bbec-00e3def6a385 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:12.792162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-67458894-8ace-4b9d-9523-78bd00f45507 req-da867ddb-8b2d-4113-bbec-00e3def6a385 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:12.792671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-67458894-8ace-4b9d-9523-78bd00f45507 req-da867ddb-8b2d-4113-bbec-00e3def6a385 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:12.809100 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-67458894-8ace-4b9d-9523-78bd00f45507 req-da867ddb-8b2d-4113-bbec-00e3def6a385 service nova] Creating event network-vif-deleted:6353ff7b-3aea-4769-9245-cbd549bdbe7c for instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf on nch2-master-1 Sep 10 21:35:12.814286 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-67458894-8ace-4b9d-9523-78bd00f45507 req-da867ddb-8b2d-4113-bbec-00e3def6a385 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043399 Sep 10 21:35:12.814895 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3233/6592] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:35:13.319303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:13.319904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:13.326763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:13.327248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:13.327687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:13.328376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:13.328833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:13.329261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:13.343252 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] HTTP exception thrown: Instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf could not be found. Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Request method failure captured: Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf HTTP/1.1 Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQKo-hxxz7gVFE2YSyL-B4SGrHvX6Mu8HRcgnZIgSF5wtR_BX4sj_H0GkDh-ftphc8ARxhVZgA6xEWEEIaxCOyA5GJA5m7GJT8I8Q4BnH35ppm1T02ymW_Dmz1OrXCu6pDBiEKTvOb2oa4UvwAe2173xS3CUGYiiPg2Bnzo0s1qIL4g Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 3b494efae18f494a8a8b1d6aa53c4327 Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1055986414 Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b494efae18f494a8a8b1d6aa53c4327"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b494efae18f494a8a8b1d6aa53c4327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b494efae18f494a8a8b1d6aa53c4327", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b494efae18f494a8a8b1d6aa53c4327"}]}] Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerDiskConfigTestJSON-1055986414 Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 3b494efae18f494a8a8b1d6aa53c4327 Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1055986414 Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerDiskConfigTestJSON-1055986414-project Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: cf26d0546ef846cb845be454c0e4ad76 Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerDiskConfigTestJSON-1055986414-project Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf could not be found. Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf'} Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf could not be found. Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf could not be found. Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:35:13.344898 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:35:13.350549 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:35:13.350549 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:35:13.350549 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:35:13.350549 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:35:13.350549 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:35:13.350549 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf could not be found. Sep 10 21:35:13.350549 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:35:13.350549 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Returning 404 to user: Instance c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:35:13.350549 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-efbaae09-ef8a-4273-af9d-37f804542aa4 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf" status: 404 len: 111 microversion: 2.1 time: 0.031573 Sep 10 21:35:13.350549 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3360/6593] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:13 2022] GET /compute/v2.1/servers/c4b96fad-414e-492d-9f0b-1fbeb4c6dcdf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:35:13.355879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0b7851ab-0927-47cf-a689-84c7817e27cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '.version_select at 0x7f993f584310>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:13.379196 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0b7851ab-0927-47cf-a689-84c7817e27cc tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081370945" status: 202 len: 0 microversion: 2.1 time: 0.027675 Sep 10 21:35:13.379766 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3234/6594] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Sep 10 21:35:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081370945 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:35:13.974130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:13.974655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:13.980654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:13.981137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:13.981571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:13.982302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:13.982753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:13.983179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:13.996687 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] HTTP exception thrown: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Request method failure captured: Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 HTTP/1.1 Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQKo-hxxz7gVFE2YSyL-B4SGrHvX6Mu8HRcgnZIgSF5wtR_BX4sj_H0GkDh-ftphc8ARxhVZgA6xEWEEIaxCOyA5GJA5m7GJT8I8Q4BnH35ppm1T02ymW_Dmz1OrXCu6pDBiEKTvOb2oa4UvwAe2173xS3CUGYiiPg2Bnzo0s1qIL4g Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 3b494efae18f494a8a8b1d6aa53c4327 Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1055986414 Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b494efae18f494a8a8b1d6aa53c4327"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b494efae18f494a8a8b1d6aa53c4327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b494efae18f494a8a8b1d6aa53c4327", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b494efae18f494a8a8b1d6aa53c4327"}]}] Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerDiskConfigTestJSON-1055986414 Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 3b494efae18f494a8a8b1d6aa53c4327 Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1055986414 Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerDiskConfigTestJSON-1055986414-project Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: cf26d0546ef846cb845be454c0e4ad76 Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerDiskConfigTestJSON-1055986414-project Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '80f617c0-2e3f-4c28-b159-eae575fa0ab6'} Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:35:13.998260 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Returning 404 to user: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a2a5e9c0-42fb-47d2-ae7e-0d2f12be0e29 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 404 len: 111 microversion: 2.1 time: 0.030643 Sep 10 21:35:14.002365 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3361/6595] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:35:13 2022] DELETE /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:35:14.010172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:14.010944 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] [instance: 80f617c0-2e3f-4c28-b159-eae575fa0ab6] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:14.017633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:14.018139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:14.019201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:14.019871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:14.020326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:14.020755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:14.033914 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] HTTP exception thrown: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Request method failure captured: Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 HTTP/1.1 Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQKo-hxxz7gVFE2YSyL-B4SGrHvX6Mu8HRcgnZIgSF5wtR_BX4sj_H0GkDh-ftphc8ARxhVZgA6xEWEEIaxCOyA5GJA5m7GJT8I8Q4BnH35ppm1T02ymW_Dmz1OrXCu6pDBiEKTvOb2oa4UvwAe2173xS3CUGYiiPg2Bnzo0s1qIL4g Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 3b494efae18f494a8a8b1d6aa53c4327 Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1055986414 Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b494efae18f494a8a8b1d6aa53c4327"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b494efae18f494a8a8b1d6aa53c4327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b494efae18f494a8a8b1d6aa53c4327", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b494efae18f494a8a8b1d6aa53c4327"}]}] Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerDiskConfigTestJSON-1055986414 Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 3b494efae18f494a8a8b1d6aa53c4327 Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1055986414 Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerDiskConfigTestJSON-1055986414-project Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: cf26d0546ef846cb845be454c0e4ad76 Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerDiskConfigTestJSON-1055986414-project Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '80f617c0-2e3f-4c28-b159-eae575fa0ab6'} Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:35:14.035563 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:35:14.039701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:35:14.039701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:35:14.039701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:35:14.039701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:35:14.039701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:35:14.039701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. Sep 10 21:35:14.039701 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:35:14.039701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] Returning 404 to user: Instance 80f617c0-2e3f-4c28-b159-eae575fa0ab6 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:35:14.039701 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-98a1411b-25d8-452e-b807-581bd8bda314 tempest-ServerDiskConfigTestJSON-1055986414 tempest-ServerDiskConfigTestJSON-1055986414-project] 10.222.0.33 "GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6" status: 404 len: 111 microversion: 2.1 time: 0.031619 Sep 10 21:35:14.039701 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3235/6596] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:14 2022] GET /compute/v2.1/servers/80f617c0-2e3f-4c28-b159-eae575fa0ab6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:35:22.350207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-209fa56a-43fd-4acb-9308-5b739ba5e914 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'create', calling method: .version_select at 0x7f993f7abaf0>, body: {"keypair": {"name": "tempest-keypair-955803444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAScvXx9xRrWJRBarmYiN3BzScg/lNcvtlSBjyHIEhF0vnc1DmJsd3X3WtJQGBLWduFxtinIzyyxRKhD5H1JHGCRTy0z9I349B3UVftgAcVLwGoJBjWZp/NVvGnQPUARwA=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:35:22.366727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-209fa56a-43fd-4acb-9308-5b739ba5e914 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for project e767567d02b24a5eb0a01b9ead34449f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:35:22.371894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-209fa56a-43fd-4acb-9308-5b739ba5e914 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for user 5e00195042734152b7ab7a71fc7b9e3b and project e767567d02b24a5eb0a01b9ead34449f. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:35:22.397142 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-209fa56a-43fd-4acb-9308-5b739ba5e914 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170500 Sep 10 21:35:22.397785 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3362/6597] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:35:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:35:24.089531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-235667653", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1cb3c97f-0c08-4804-b456-564eec6cad8b"}], "security_groups": [{"name": "tempest-securitygroup--309256126"}], "key_name": "tempest-keypair-955803444", "user_data": "}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:35:24.100077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:35:24.100733 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:35:24.220159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] validate_networks() for [('1cb3c97f-0c08-4804-b456-564eec6cad8b', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:35:24.597810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:35:24.598273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:35:24.598755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:35:24.599171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:35:24.599594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:35:24.608462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:24.609207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:24.609648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:24.610420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:24.610878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:24.611309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:24.629253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for project e767567d02b24a5eb0a01b9ead34449f. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:35:24.634817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for user 5e00195042734152b7ab7a71fc7b9e3b and project e767567d02b24a5eb0a01b9ead34449f. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:35:24.648001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:35:24.650429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:35:24.697958 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8c400a20-64f7-4855-8bc8-d2eeb5414d80 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.611886 Sep 10 21:35:24.697958 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3236/6598] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:35:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:35:24.706360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:35:24.710908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-31d9d376-c0b2-4264-bfd7-d588ce871f03 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:24.711525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-31d9d376-c0b2-4264-bfd7-d588ce871f03 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:24.781386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-31d9d376-c0b2-4264-bfd7-d588ce871f03 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:24.789720 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-31d9d376-c0b2-4264-bfd7-d588ce871f03 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1237 microversion: 2.1 time: 0.084939 Sep 10 21:35:24.790864 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3363/6599] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:24 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:25.814933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-abf24796-2cf4-4be0-9951-b2eeafd81b86 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:25.816602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-abf24796-2cf4-4be0-9951-b2eeafd81b86 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:25.824016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf24796-2cf4-4be0-9951-b2eeafd81b86 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:25.824530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf24796-2cf4-4be0-9951-b2eeafd81b86 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:25.824966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf24796-2cf4-4be0-9951-b2eeafd81b86 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:25.825721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf24796-2cf4-4be0-9951-b2eeafd81b86 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:25.826750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf24796-2cf4-4be0-9951-b2eeafd81b86 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:25.827240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-abf24796-2cf4-4be0-9951-b2eeafd81b86 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:25.905613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-abf24796-2cf4-4be0-9951-b2eeafd81b86 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:25.914434 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-abf24796-2cf4-4be0-9951-b2eeafd81b86 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1289 microversion: 2.1 time: 0.104342 Sep 10 21:35:25.915172 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3237/6600] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:25 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:26.939302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e74c9ba-ff6d-47f4-8ca9-86a8f7554ef7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:26.940458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e74c9ba-ff6d-47f4-8ca9-86a8f7554ef7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:26.947667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e74c9ba-ff6d-47f4-8ca9-86a8f7554ef7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:26.948191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e74c9ba-ff6d-47f4-8ca9-86a8f7554ef7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:26.948617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e74c9ba-ff6d-47f4-8ca9-86a8f7554ef7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:26.949331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e74c9ba-ff6d-47f4-8ca9-86a8f7554ef7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:26.950032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e74c9ba-ff6d-47f4-8ca9-86a8f7554ef7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:26.950448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e74c9ba-ff6d-47f4-8ca9-86a8f7554ef7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:27.155986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e74c9ba-ff6d-47f4-8ca9-86a8f7554ef7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:27.164738 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e74c9ba-ff6d-47f4-8ca9-86a8f7554ef7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1362 microversion: 2.1 time: 0.229581 Sep 10 21:35:27.165324 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3364/6601] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:26 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:27.489365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-db192281-3216-4c9c-96f4-7c97dcbcba0d req-e04e5930-b034-4dc8-8aca-d8cf8daa5f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c54fd1-9552-4f3e-89d4-14273e79bd57", "tag": "f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:35:27.502896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-db192281-3216-4c9c-96f4-7c97dcbcba0d req-e04e5930-b034-4dc8-8aca-d8cf8daa5f46 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:27.503612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-db192281-3216-4c9c-96f4-7c97dcbcba0d req-e04e5930-b034-4dc8-8aca-d8cf8daa5f46 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:27.504045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-db192281-3216-4c9c-96f4-7c97dcbcba0d req-e04e5930-b034-4dc8-8aca-d8cf8daa5f46 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:27.516661 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-db192281-3216-4c9c-96f4-7c97dcbcba0d req-e04e5930-b034-4dc8-8aca-d8cf8daa5f46 service nova] Creating event network-changed:f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc for instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 on nch2-master-1 Sep 10 21:35:27.521969 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-db192281-3216-4c9c-96f4-7c97dcbcba0d req-e04e5930-b034-4dc8-8aca-d8cf8daa5f46 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038118 Sep 10 21:35:27.522581 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3238/6602] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:35:28.188519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa851434-d97e-4692-ae2e-f8962a752441 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:28.189160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aa851434-d97e-4692-ae2e-f8962a752441 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:28.196413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa851434-d97e-4692-ae2e-f8962a752441 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:28.196894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa851434-d97e-4692-ae2e-f8962a752441 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:28.197332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa851434-d97e-4692-ae2e-f8962a752441 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:28.198050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa851434-d97e-4692-ae2e-f8962a752441 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:28.198504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa851434-d97e-4692-ae2e-f8962a752441 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:28.198927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa851434-d97e-4692-ae2e-f8962a752441 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:28.405556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aa851434-d97e-4692-ae2e-f8962a752441 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:28.414794 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aa851434-d97e-4692-ae2e-f8962a752441 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1362 microversion: 2.1 time: 0.230095 Sep 10 21:35:28.415472 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3365/6603] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:28 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:29.439470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-913da851-3a29-46fe-842b-1c2c9e4edf98 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:29.440731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-913da851-3a29-46fe-842b-1c2c9e4edf98 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:29.447237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-913da851-3a29-46fe-842b-1c2c9e4edf98 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:29.447717 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-913da851-3a29-46fe-842b-1c2c9e4edf98 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:29.448149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-913da851-3a29-46fe-842b-1c2c9e4edf98 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:29.448951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-913da851-3a29-46fe-842b-1c2c9e4edf98 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:29.449409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-913da851-3a29-46fe-842b-1c2c9e4edf98 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:29.449953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-913da851-3a29-46fe-842b-1c2c9e4edf98 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:29.582957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-913da851-3a29-46fe-842b-1c2c9e4edf98 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:29.590970 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-913da851-3a29-46fe-842b-1c2c9e4edf98 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1362 microversion: 2.1 time: 0.156558 Sep 10 21:35:29.591551 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3239/6604] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:29 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:35:30.614969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1be0ebd2-b61c-4a36-a34b-5d9002c77572 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:30.615586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1be0ebd2-b61c-4a36-a34b-5d9002c77572 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:30.622434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be0ebd2-b61c-4a36-a34b-5d9002c77572 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:30.622911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be0ebd2-b61c-4a36-a34b-5d9002c77572 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:30.623345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be0ebd2-b61c-4a36-a34b-5d9002c77572 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:30.624034 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be0ebd2-b61c-4a36-a34b-5d9002c77572 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:30.624487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be0ebd2-b61c-4a36-a34b-5d9002c77572 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:30.624910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1be0ebd2-b61c-4a36-a34b-5d9002c77572 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:30.765219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1be0ebd2-b61c-4a36-a34b-5d9002c77572 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:30.773569 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1be0ebd2-b61c-4a36-a34b-5d9002c77572 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1362 microversion: 2.1 time: 0.162336 Sep 10 21:35:30.774186 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3366/6605] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:30 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:31.796611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6141362f-0bdd-49fa-bc6f-ef680da9ce2e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:31.797256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6141362f-0bdd-49fa-bc6f-ef680da9ce2e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:31.804171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6141362f-0bdd-49fa-bc6f-ef680da9ce2e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:31.804657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6141362f-0bdd-49fa-bc6f-ef680da9ce2e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:31.805096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6141362f-0bdd-49fa-bc6f-ef680da9ce2e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:31.805786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6141362f-0bdd-49fa-bc6f-ef680da9ce2e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:31.806299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6141362f-0bdd-49fa-bc6f-ef680da9ce2e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:31.806726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6141362f-0bdd-49fa-bc6f-ef680da9ce2e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:31.936267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6141362f-0bdd-49fa-bc6f-ef680da9ce2e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:31.943970 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6141362f-0bdd-49fa-bc6f-ef680da9ce2e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1362 microversion: 2.1 time: 0.151327 Sep 10 21:35:31.944553 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3240/6606] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:31 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:32.735803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7acc667e-34a4-4cff-89fc-b48ff71b6727 req-aa336014-e6e4-40c8-9f73-7d9ed09975f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c54fd1-9552-4f3e-89d4-14273e79bd57", "name": "network-vif-plugged", "status": "completed", "tag": "f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:35:32.747524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7acc667e-34a4-4cff-89fc-b48ff71b6727 req-aa336014-e6e4-40c8-9f73-7d9ed09975f5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:32.748014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7acc667e-34a4-4cff-89fc-b48ff71b6727 req-aa336014-e6e4-40c8-9f73-7d9ed09975f5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:32.748458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7acc667e-34a4-4cff-89fc-b48ff71b6727 req-aa336014-e6e4-40c8-9f73-7d9ed09975f5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:32.759872 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7acc667e-34a4-4cff-89fc-b48ff71b6727 req-aa336014-e6e4-40c8-9f73-7d9ed09975f5 service nova] Creating event network-vif-plugged:f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc for instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 on nch2-master-1 Sep 10 21:35:32.764840 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7acc667e-34a4-4cff-89fc-b48ff71b6727 req-aa336014-e6e4-40c8-9f73-7d9ed09975f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 Sep 10 21:35:32.765441 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3367/6607] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:35:32.967415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eb7e2cec-6a92-4178-8df0-28e390cc3345 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:32.968035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eb7e2cec-6a92-4178-8df0-28e390cc3345 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:32.975858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb7e2cec-6a92-4178-8df0-28e390cc3345 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:32.976352 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb7e2cec-6a92-4178-8df0-28e390cc3345 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:32.976798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb7e2cec-6a92-4178-8df0-28e390cc3345 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:32.977954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb7e2cec-6a92-4178-8df0-28e390cc3345 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:32.977954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb7e2cec-6a92-4178-8df0-28e390cc3345 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:32.978391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb7e2cec-6a92-4178-8df0-28e390cc3345 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:33.120602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eb7e2cec-6a92-4178-8df0-28e390cc3345 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:33.129194 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eb7e2cec-6a92-4178-8df0-28e390cc3345 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1362 microversion: 2.1 time: 0.165625 Sep 10 21:35:33.129719 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3241/6608] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:32 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:34.153162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-71c8ea56-7d94-41dc-bd84-1acce5c00acd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:34.153896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-71c8ea56-7d94-41dc-bd84-1acce5c00acd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:34.161784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71c8ea56-7d94-41dc-bd84-1acce5c00acd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:34.162828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71c8ea56-7d94-41dc-bd84-1acce5c00acd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:34.163271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71c8ea56-7d94-41dc-bd84-1acce5c00acd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:34.163981 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71c8ea56-7d94-41dc-bd84-1acce5c00acd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:34.164445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71c8ea56-7d94-41dc-bd84-1acce5c00acd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:34.164878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-71c8ea56-7d94-41dc-bd84-1acce5c00acd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:34.298222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-71c8ea56-7d94-41dc-bd84-1acce5c00acd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:35:34.306367 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-71c8ea56-7d94-41dc-bd84-1acce5c00acd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1548 microversion: 2.1 time: 0.157727 Sep 10 21:35:34.306935 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3368/6609] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:35:34 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:35:34.330032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ec22735b-fec0-41e3-b2be-c8dc4a9cb7e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:35:34.330840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ec22735b-fec0-41e3-b2be-c8dc4a9cb7e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:35:34.337554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec22735b-fec0-41e3-b2be-c8dc4a9cb7e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:34.338069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec22735b-fec0-41e3-b2be-c8dc4a9cb7e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:34.338509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec22735b-fec0-41e3-b2be-c8dc4a9cb7e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:34.339190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec22735b-fec0-41e3-b2be-c8dc4a9cb7e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:34.339641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec22735b-fec0-41e3-b2be-c8dc4a9cb7e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:34.340062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec22735b-fec0-41e3-b2be-c8dc4a9cb7e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:34.416742 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ec22735b-fec0-41e3-b2be-c8dc4a9cb7e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090509 Sep 10 21:35:34.417348 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3242/6610] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:35:34 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:35:35.362741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f3e649e8-f89d-46e1-a807-47f543d6f5a5 req-819c5430-745d-45fc-9fbe-4d1e1fbfccb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c54fd1-9552-4f3e-89d4-14273e79bd57", "tag": "f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:35:35.367617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:35:35.374545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f3e649e8-f89d-46e1-a807-47f543d6f5a5 req-819c5430-745d-45fc-9fbe-4d1e1fbfccb1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:35:35.375037 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f3e649e8-f89d-46e1-a807-47f543d6f5a5 req-819c5430-745d-45fc-9fbe-4d1e1fbfccb1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:35:35.375454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f3e649e8-f89d-46e1-a807-47f543d6f5a5 req-819c5430-745d-45fc-9fbe-4d1e1fbfccb1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:35:35.387059 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f3e649e8-f89d-46e1-a807-47f543d6f5a5 req-819c5430-745d-45fc-9fbe-4d1e1fbfccb1 service nova] Creating event network-changed:f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc for instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 on nch2-master-1 Sep 10 21:35:35.392173 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f3e649e8-f89d-46e1-a807-47f543d6f5a5 req-819c5430-745d-45fc-9fbe-4d1e1fbfccb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033300 Sep 10 21:35:35.394301 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3369/6611] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:36:11.223405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:11.224281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:11.225989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:11.226630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=32 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:11.230999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e1382ecd-2789-463d-b6a0-51dd251631be tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:11.231561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e1382ecd-2789-463d-b6a0-51dd251631be tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:11.240451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1382ecd-2789-463d-b6a0-51dd251631be tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:11.240936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1382ecd-2789-463d-b6a0-51dd251631be tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:11.241382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1382ecd-2789-463d-b6a0-51dd251631be tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:11.242124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1382ecd-2789-463d-b6a0-51dd251631be tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:11.242587 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1382ecd-2789-463d-b6a0-51dd251631be tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:11.243015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e1382ecd-2789-463d-b6a0-51dd251631be tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:11.372241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e1382ecd-2789-463d-b6a0-51dd251631be tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:11.380270 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e1382ecd-2789-463d-b6a0-51dd251631be tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1667 microversion: 2.1 time: 0.158240 Sep 10 21:36:11.380860 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3243/6612] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:11 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:11.404502 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c1d6351c-33d0-4b48-bef6-d8b60b7f4037 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:11.405214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c1d6351c-33d0-4b48-bef6-d8b60b7f4037 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:11.407677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:11.408472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=28 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:11.415749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1d6351c-33d0-4b48-bef6-d8b60b7f4037 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:11.416238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1d6351c-33d0-4b48-bef6-d8b60b7f4037 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:11.416681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1d6351c-33d0-4b48-bef6-d8b60b7f4037 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:11.417386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1d6351c-33d0-4b48-bef6-d8b60b7f4037 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:11.417884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1d6351c-33d0-4b48-bef6-d8b60b7f4037 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:11.418323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1d6351c-33d0-4b48-bef6-d8b60b7f4037 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:11.548075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c1d6351c-33d0-4b48-bef6-d8b60b7f4037 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:11.556038 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c1d6351c-33d0-4b48-bef6-d8b60b7f4037 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1667 microversion: 2.1 time: 0.155742 Sep 10 21:36:11.556612 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3370/6613] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:11 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:11.578127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-838d67e3-e04f-46e7-b25c-c68a0cc6e399 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:11.578740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-838d67e3-e04f-46e7-b25c-c68a0cc6e399 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:11.585267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-838d67e3-e04f-46e7-b25c-c68a0cc6e399 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:11.585750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-838d67e3-e04f-46e7-b25c-c68a0cc6e399 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:11.586232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-838d67e3-e04f-46e7-b25c-c68a0cc6e399 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:11.586908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-838d67e3-e04f-46e7-b25c-c68a0cc6e399 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:11.587357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-838d67e3-e04f-46e7-b25c-c68a0cc6e399 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:11.587785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-838d67e3-e04f-46e7-b25c-c68a0cc6e399 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:11.716088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-838d67e3-e04f-46e7-b25c-c68a0cc6e399 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:11.723886 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-838d67e3-e04f-46e7-b25c-c68a0cc6e399 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1667 microversion: 2.1 time: 0.149637 Sep 10 21:36:11.724462 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3244/6614] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:11 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:11.746641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:36:11.749074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:11.755739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:11.756229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:11.756676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:11.757373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:11.757857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:11.758294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:11.786289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:11.791668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Old instance type m1.heat2, new instance type m1.heat {{(pid=145772) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:36:11.798122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:36:11.798555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:36:11.799036 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:36:11.799471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:36:11.799873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:36:11.862666 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a27d7714-11ec-4161-a94c-6ca134d557c3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57/action" status: 202 len: 0 microversion: 2.1 time: 0.119906 Sep 10 21:36:11.863290 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3371/6615] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:36:11 2022] POST /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:36:11.871536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-68a29956-b22f-44b2-9b0b-b78832f07b47 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:11.872154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-68a29956-b22f-44b2-9b0b-b78832f07b47 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:11.878721 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68a29956-b22f-44b2-9b0b-b78832f07b47 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:11.879842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68a29956-b22f-44b2-9b0b-b78832f07b47 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:11.880503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68a29956-b22f-44b2-9b0b-b78832f07b47 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:11.881212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68a29956-b22f-44b2-9b0b-b78832f07b47 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:11.881670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68a29956-b22f-44b2-9b0b-b78832f07b47 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:11.882145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68a29956-b22f-44b2-9b0b-b78832f07b47 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:12.022762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-68a29956-b22f-44b2-9b0b-b78832f07b47 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:12.031277 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-68a29956-b22f-44b2-9b0b-b78832f07b47 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1676 microversion: 2.1 time: 0.163717 Sep 10 21:36:12.031840 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3245/6616] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:11 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:13.055827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7b4d0803-8ddd-4e53-b650-36bc08b5b1d8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:13.056435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7b4d0803-8ddd-4e53-b650-36bc08b5b1d8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:13.063405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4d0803-8ddd-4e53-b650-36bc08b5b1d8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:13.063896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4d0803-8ddd-4e53-b650-36bc08b5b1d8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:13.064335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4d0803-8ddd-4e53-b650-36bc08b5b1d8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:13.065031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4d0803-8ddd-4e53-b650-36bc08b5b1d8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:13.065495 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4d0803-8ddd-4e53-b650-36bc08b5b1d8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:13.065956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b4d0803-8ddd-4e53-b650-36bc08b5b1d8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:13.280566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7b4d0803-8ddd-4e53-b650-36bc08b5b1d8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:13.289756 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7b4d0803-8ddd-4e53-b650-36bc08b5b1d8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1676 microversion: 2.1 time: 0.238813 Sep 10 21:36:13.290462 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3372/6617] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:13 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:14.313899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-adb9a638-63b0-43de-a3de-2f442c4c1eb8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:14.314510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-adb9a638-63b0-43de-a3de-2f442c4c1eb8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:14.322354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb9a638-63b0-43de-a3de-2f442c4c1eb8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:14.322837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb9a638-63b0-43de-a3de-2f442c4c1eb8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:14.323269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb9a638-63b0-43de-a3de-2f442c4c1eb8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:14.323949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb9a638-63b0-43de-a3de-2f442c4c1eb8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:14.324400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb9a638-63b0-43de-a3de-2f442c4c1eb8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:14.324842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adb9a638-63b0-43de-a3de-2f442c4c1eb8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:14.457530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-adb9a638-63b0-43de-a3de-2f442c4c1eb8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:14.468283 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-adb9a638-63b0-43de-a3de-2f442c4c1eb8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.158261 Sep 10 21:36:14.468853 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3246/6618] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:14 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:15.492516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-700cb936-4d8c-4a83-8c59-b4af0e916540 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:15.493141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-700cb936-4d8c-4a83-8c59-b4af0e916540 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:15.499949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700cb936-4d8c-4a83-8c59-b4af0e916540 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:15.500430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700cb936-4d8c-4a83-8c59-b4af0e916540 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:15.500871 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700cb936-4d8c-4a83-8c59-b4af0e916540 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:15.501565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700cb936-4d8c-4a83-8c59-b4af0e916540 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:15.502064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700cb936-4d8c-4a83-8c59-b4af0e916540 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:15.502491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-700cb936-4d8c-4a83-8c59-b4af0e916540 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:15.755058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-700cb936-4d8c-4a83-8c59-b4af0e916540 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:15.763503 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-700cb936-4d8c-4a83-8c59-b4af0e916540 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.275129 Sep 10 21:36:15.764084 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3373/6619] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:15 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:16.787765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-292d2b52-da14-4ef5-8042-db762523ad14 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:16.788376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-292d2b52-da14-4ef5-8042-db762523ad14 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:16.794765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292d2b52-da14-4ef5-8042-db762523ad14 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:16.795186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292d2b52-da14-4ef5-8042-db762523ad14 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:16.795623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292d2b52-da14-4ef5-8042-db762523ad14 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:16.796307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292d2b52-da14-4ef5-8042-db762523ad14 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:16.796759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292d2b52-da14-4ef5-8042-db762523ad14 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:16.797182 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-292d2b52-da14-4ef5-8042-db762523ad14 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:17.020171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-292d2b52-da14-4ef5-8042-db762523ad14 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:17.028900 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-292d2b52-da14-4ef5-8042-db762523ad14 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.245399 Sep 10 21:36:17.029508 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3247/6620] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:16 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:18.052783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6ba15ee6-c267-449d-bc4d-8ed87fb697f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:18.053394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6ba15ee6-c267-449d-bc4d-8ed87fb697f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:18.061163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba15ee6-c267-449d-bc4d-8ed87fb697f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:18.061643 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba15ee6-c267-449d-bc4d-8ed87fb697f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:18.062117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba15ee6-c267-449d-bc4d-8ed87fb697f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:18.062811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba15ee6-c267-449d-bc4d-8ed87fb697f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:18.063267 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba15ee6-c267-449d-bc4d-8ed87fb697f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:18.063693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6ba15ee6-c267-449d-bc4d-8ed87fb697f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:18.194020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6ba15ee6-c267-449d-bc4d-8ed87fb697f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:18.201872 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6ba15ee6-c267-449d-bc4d-8ed87fb697f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.153130 Sep 10 21:36:18.202451 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3374/6621] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:18 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:19.226992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ce48786d-cbec-4b50-bd30-aae1896398b7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:19.227645 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ce48786d-cbec-4b50-bd30-aae1896398b7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:19.237007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce48786d-cbec-4b50-bd30-aae1896398b7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:19.237512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce48786d-cbec-4b50-bd30-aae1896398b7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:19.238011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce48786d-cbec-4b50-bd30-aae1896398b7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:19.239310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce48786d-cbec-4b50-bd30-aae1896398b7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:19.239785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce48786d-cbec-4b50-bd30-aae1896398b7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:19.240226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce48786d-cbec-4b50-bd30-aae1896398b7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:19.382152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ce48786d-cbec-4b50-bd30-aae1896398b7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:19.390380 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ce48786d-cbec-4b50-bd30-aae1896398b7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.167853 Sep 10 21:36:19.390983 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3248/6622] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:19 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:36:20.414329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e32aafcb-abb8-4bee-b133-60d3bd621da7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:20.414942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e32aafcb-abb8-4bee-b133-60d3bd621da7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:20.421709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e32aafcb-abb8-4bee-b133-60d3bd621da7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:20.422228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e32aafcb-abb8-4bee-b133-60d3bd621da7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:20.422667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e32aafcb-abb8-4bee-b133-60d3bd621da7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:20.423355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e32aafcb-abb8-4bee-b133-60d3bd621da7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:20.423824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e32aafcb-abb8-4bee-b133-60d3bd621da7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:20.424239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e32aafcb-abb8-4bee-b133-60d3bd621da7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:20.560904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e32aafcb-abb8-4bee-b133-60d3bd621da7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:20.568716 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e32aafcb-abb8-4bee-b133-60d3bd621da7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.158349 Sep 10 21:36:20.569288 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3375/6623] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:20 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:21.592817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80ec58ef-74be-4087-b34b-ed904fb5a1ed tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:21.593487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-80ec58ef-74be-4087-b34b-ed904fb5a1ed tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:21.600535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80ec58ef-74be-4087-b34b-ed904fb5a1ed tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:21.601586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80ec58ef-74be-4087-b34b-ed904fb5a1ed tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:21.602059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80ec58ef-74be-4087-b34b-ed904fb5a1ed tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:21.602764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80ec58ef-74be-4087-b34b-ed904fb5a1ed tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:21.603226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80ec58ef-74be-4087-b34b-ed904fb5a1ed tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:21.603664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80ec58ef-74be-4087-b34b-ed904fb5a1ed tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:21.738199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-80ec58ef-74be-4087-b34b-ed904fb5a1ed tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:21.746224 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-80ec58ef-74be-4087-b34b-ed904fb5a1ed tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.157260 Sep 10 21:36:21.746809 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3249/6624] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:21 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:22.769349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b02a8666-c932-4799-9a5f-30ff4ee9af87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:22.769999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b02a8666-c932-4799-9a5f-30ff4ee9af87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:22.777056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b02a8666-c932-4799-9a5f-30ff4ee9af87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:22.777548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b02a8666-c932-4799-9a5f-30ff4ee9af87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:22.778025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b02a8666-c932-4799-9a5f-30ff4ee9af87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:22.778745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b02a8666-c932-4799-9a5f-30ff4ee9af87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:22.779207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b02a8666-c932-4799-9a5f-30ff4ee9af87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:22.779636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b02a8666-c932-4799-9a5f-30ff4ee9af87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:22.915488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b02a8666-c932-4799-9a5f-30ff4ee9af87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:22.923153 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b02a8666-c932-4799-9a5f-30ff4ee9af87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.157695 Sep 10 21:36:22.923724 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3376/6625] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:22 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:23.946984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a848b49e-6d59-4bd1-a475-8f82a84abc33 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:23.947590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a848b49e-6d59-4bd1-a475-8f82a84abc33 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:23.954532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a848b49e-6d59-4bd1-a475-8f82a84abc33 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:23.955010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a848b49e-6d59-4bd1-a475-8f82a84abc33 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:23.955444 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a848b49e-6d59-4bd1-a475-8f82a84abc33 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:23.956128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a848b49e-6d59-4bd1-a475-8f82a84abc33 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:23.956601 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a848b49e-6d59-4bd1-a475-8f82a84abc33 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:23.957023 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a848b49e-6d59-4bd1-a475-8f82a84abc33 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:24.086562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a848b49e-6d59-4bd1-a475-8f82a84abc33 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:24.094275 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a848b49e-6d59-4bd1-a475-8f82a84abc33 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.151356 Sep 10 21:36:24.094852 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3250/6626] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:23 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:25.120095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dbb54340-4519-4e91-9a63-2a3a668b822b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:25.120702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dbb54340-4519-4e91-9a63-2a3a668b822b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:25.127642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbb54340-4519-4e91-9a63-2a3a668b822b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:25.128124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbb54340-4519-4e91-9a63-2a3a668b822b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:25.128563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbb54340-4519-4e91-9a63-2a3a668b822b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:25.129248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbb54340-4519-4e91-9a63-2a3a668b822b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:25.129704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbb54340-4519-4e91-9a63-2a3a668b822b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:25.130223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dbb54340-4519-4e91-9a63-2a3a668b822b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:25.268905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dbb54340-4519-4e91-9a63-2a3a668b822b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:25.277199 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dbb54340-4519-4e91-9a63-2a3a668b822b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.161827 Sep 10 21:36:25.277769 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3377/6627] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:25 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:26.300650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0bd2baee-628b-422a-b0b9-d61795f1c2bd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:26.301264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0bd2baee-628b-422a-b0b9-d61795f1c2bd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:26.308386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bd2baee-628b-422a-b0b9-d61795f1c2bd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:26.308871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bd2baee-628b-422a-b0b9-d61795f1c2bd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:26.309303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bd2baee-628b-422a-b0b9-d61795f1c2bd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:26.310825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bd2baee-628b-422a-b0b9-d61795f1c2bd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:26.310825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bd2baee-628b-422a-b0b9-d61795f1c2bd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:26.311026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0bd2baee-628b-422a-b0b9-d61795f1c2bd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:26.447128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0bd2baee-628b-422a-b0b9-d61795f1c2bd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:26.454997 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0bd2baee-628b-422a-b0b9-d61795f1c2bd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.158296 Sep 10 21:36:26.455568 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3251/6628] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:26 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:27.479418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7c3c542d-dd43-4364-82ae-9a10700ffe50 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:27.480016 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7c3c542d-dd43-4364-82ae-9a10700ffe50 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:27.487146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c3c542d-dd43-4364-82ae-9a10700ffe50 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:27.487636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c3c542d-dd43-4364-82ae-9a10700ffe50 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:27.488071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c3c542d-dd43-4364-82ae-9a10700ffe50 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:27.488765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c3c542d-dd43-4364-82ae-9a10700ffe50 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:27.489219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c3c542d-dd43-4364-82ae-9a10700ffe50 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:27.489645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7c3c542d-dd43-4364-82ae-9a10700ffe50 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:27.624594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7c3c542d-dd43-4364-82ae-9a10700ffe50 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:27.633183 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7c3c542d-dd43-4364-82ae-9a10700ffe50 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.157908 Sep 10 21:36:27.633778 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3378/6629] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:27 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:28.658282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-22ee56e7-9e3b-40f6-a692-b12a03296f58 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:28.658904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-22ee56e7-9e3b-40f6-a692-b12a03296f58 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:28.666603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22ee56e7-9e3b-40f6-a692-b12a03296f58 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:28.667099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22ee56e7-9e3b-40f6-a692-b12a03296f58 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:28.667544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22ee56e7-9e3b-40f6-a692-b12a03296f58 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:28.668245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22ee56e7-9e3b-40f6-a692-b12a03296f58 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:28.668707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22ee56e7-9e3b-40f6-a692-b12a03296f58 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:28.669142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22ee56e7-9e3b-40f6-a692-b12a03296f58 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:28.798347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-22ee56e7-9e3b-40f6-a692-b12a03296f58 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:28.807434 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-22ee56e7-9e3b-40f6-a692-b12a03296f58 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.153096 Sep 10 21:36:28.808020 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3252/6630] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:28 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:29.832346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-58f6b467-7de1-45e5-a28e-6e5d43914b61 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:29.832968 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-58f6b467-7de1-45e5-a28e-6e5d43914b61 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:29.839915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f6b467-7de1-45e5-a28e-6e5d43914b61 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:29.840407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f6b467-7de1-45e5-a28e-6e5d43914b61 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:29.840852 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f6b467-7de1-45e5-a28e-6e5d43914b61 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:29.841551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f6b467-7de1-45e5-a28e-6e5d43914b61 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:29.842047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f6b467-7de1-45e5-a28e-6e5d43914b61 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:29.842481 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-58f6b467-7de1-45e5-a28e-6e5d43914b61 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:29.980941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-58f6b467-7de1-45e5-a28e-6e5d43914b61 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:29.989040 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-58f6b467-7de1-45e5-a28e-6e5d43914b61 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1681 microversion: 2.1 time: 0.160575 Sep 10 21:36:29.989611 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3379/6631] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:29 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:31.013147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6638a08b-48de-4ace-92e2-f5df3c0447bb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:31.013672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6638a08b-48de-4ace-92e2-f5df3c0447bb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:31.021316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6638a08b-48de-4ace-92e2-f5df3c0447bb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:31.022088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6638a08b-48de-4ace-92e2-f5df3c0447bb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:31.023232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6638a08b-48de-4ace-92e2-f5df3c0447bb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:31.024313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6638a08b-48de-4ace-92e2-f5df3c0447bb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:31.024821 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6638a08b-48de-4ace-92e2-f5df3c0447bb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:31.025287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6638a08b-48de-4ace-92e2-f5df3c0447bb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:31.194171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6638a08b-48de-4ace-92e2-f5df3c0447bb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:31.202229 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6638a08b-48de-4ace-92e2-f5df3c0447bb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1680 microversion: 2.1 time: 0.193049 Sep 10 21:36:31.202824 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3253/6632] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:31 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:31.539742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-eda5e0cf-3002-4acb-8e28-97f24e9b4adc req-8d7b6664-d2b8-47d7-a0c4-36bf4134730c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c54fd1-9552-4f3e-89d4-14273e79bd57", "name": "network-vif-unplugged", "status": "completed", "tag": "f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:36:31.550021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-eda5e0cf-3002-4acb-8e28-97f24e9b4adc req-8d7b6664-d2b8-47d7-a0c4-36bf4134730c service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:31.550509 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-eda5e0cf-3002-4acb-8e28-97f24e9b4adc req-8d7b6664-d2b8-47d7-a0c4-36bf4134730c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:31.550933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-eda5e0cf-3002-4acb-8e28-97f24e9b4adc req-8d7b6664-d2b8-47d7-a0c4-36bf4134730c service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:31.563559 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-eda5e0cf-3002-4acb-8e28-97f24e9b4adc req-8d7b6664-d2b8-47d7-a0c4-36bf4134730c service nova] Creating event network-vif-unplugged:f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc for instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 on nch1-master-1 Sep 10 21:36:31.569315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-eda5e0cf-3002-4acb-8e28-97f24e9b4adc req-8d7b6664-d2b8-47d7-a0c4-36bf4134730c service nova] Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:36:31.583367 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-eda5e0cf-3002-4acb-8e28-97f24e9b4adc req-8d7b6664-d2b8-47d7-a0c4-36bf4134730c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047677 Sep 10 21:36:31.583992 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3380/6633] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:36:32.226232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-52d70378-a89d-49c4-94e1-696dadbf8cf7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:32.226975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-52d70378-a89d-49c4-94e1-696dadbf8cf7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:32.234576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52d70378-a89d-49c4-94e1-696dadbf8cf7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:32.235068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52d70378-a89d-49c4-94e1-696dadbf8cf7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:32.235546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52d70378-a89d-49c4-94e1-696dadbf8cf7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:32.236254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52d70378-a89d-49c4-94e1-696dadbf8cf7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:32.236711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52d70378-a89d-49c4-94e1-696dadbf8cf7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:32.237139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-52d70378-a89d-49c4-94e1-696dadbf8cf7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:32.470511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-52d70378-a89d-49c4-94e1-696dadbf8cf7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:32.479892 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-52d70378-a89d-49c4-94e1-696dadbf8cf7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1680 microversion: 2.1 time: 0.257796 Sep 10 21:36:32.480489 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3254/6634] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:32 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1680 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:33.504180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0eac21c-1af6-4004-9dd5-edd67a7c71cc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:33.504876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0eac21c-1af6-4004-9dd5-edd67a7c71cc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:33.511383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0eac21c-1af6-4004-9dd5-edd67a7c71cc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:33.511872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0eac21c-1af6-4004-9dd5-edd67a7c71cc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:33.512306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0eac21c-1af6-4004-9dd5-edd67a7c71cc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:33.512990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0eac21c-1af6-4004-9dd5-edd67a7c71cc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:33.513444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0eac21c-1af6-4004-9dd5-edd67a7c71cc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:33.513908 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0eac21c-1af6-4004-9dd5-edd67a7c71cc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:33.624521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-82957551-d664-4019-acf8-f36635aac8c8 req-86a8304a-abd2-42a1-8c1a-07e3bf96778f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c54fd1-9552-4f3e-89d4-14273e79bd57", "tag": "f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:36:33.635047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-82957551-d664-4019-acf8-f36635aac8c8 req-86a8304a-abd2-42a1-8c1a-07e3bf96778f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:33.635692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-82957551-d664-4019-acf8-f36635aac8c8 req-86a8304a-abd2-42a1-8c1a-07e3bf96778f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:33.636162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-82957551-d664-4019-acf8-f36635aac8c8 req-86a8304a-abd2-42a1-8c1a-07e3bf96778f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:33.647475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0eac21c-1af6-4004-9dd5-edd67a7c71cc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:33.647942 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-82957551-d664-4019-acf8-f36635aac8c8 req-86a8304a-abd2-42a1-8c1a-07e3bf96778f service nova] Creating event network-changed:f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc for instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 on nch1-master-1 Sep 10 21:36:33.653509 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-82957551-d664-4019-acf8-f36635aac8c8 req-86a8304a-abd2-42a1-8c1a-07e3bf96778f service nova] Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:36:33.655463 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0eac21c-1af6-4004-9dd5-edd67a7c71cc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1678 microversion: 2.1 time: 0.156418 Sep 10 21:36:33.656240 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3381/6635] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:33 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:33.665120 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-82957551-d664-4019-acf8-f36635aac8c8 req-86a8304a-abd2-42a1-8c1a-07e3bf96778f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044310 Sep 10 21:36:33.666067 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3255/6636] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:36:34.680457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9914dcea-1d5c-4806-90e1-579b6c3ee665 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:34.681680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9914dcea-1d5c-4806-90e1-579b6c3ee665 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:34.688760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9914dcea-1d5c-4806-90e1-579b6c3ee665 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:34.689252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9914dcea-1d5c-4806-90e1-579b6c3ee665 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:34.689692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9914dcea-1d5c-4806-90e1-579b6c3ee665 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:34.690429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9914dcea-1d5c-4806-90e1-579b6c3ee665 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:34.690953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9914dcea-1d5c-4806-90e1-579b6c3ee665 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:34.691388 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9914dcea-1d5c-4806-90e1-579b6c3ee665 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:34.824115 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9914dcea-1d5c-4806-90e1-579b6c3ee665 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:34.831917 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9914dcea-1d5c-4806-90e1-579b6c3ee665 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1678 microversion: 2.1 time: 0.155907 Sep 10 21:36:34.832518 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3382/6637] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:34 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:35.856552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-32930273-c183-4545-a32a-aa7dfa536bf2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:35.857607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-32930273-c183-4545-a32a-aa7dfa536bf2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:35.867941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32930273-c183-4545-a32a-aa7dfa536bf2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:35.868738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32930273-c183-4545-a32a-aa7dfa536bf2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:35.869388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32930273-c183-4545-a32a-aa7dfa536bf2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:35.870304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32930273-c183-4545-a32a-aa7dfa536bf2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:35.870985 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32930273-c183-4545-a32a-aa7dfa536bf2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:35.872278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-32930273-c183-4545-a32a-aa7dfa536bf2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:36.085572 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-32930273-c183-4545-a32a-aa7dfa536bf2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:36.094185 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-32930273-c183-4545-a32a-aa7dfa536bf2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1675 microversion: 2.1 time: 0.241807 Sep 10 21:36:36.094790 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3256/6638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:35 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:36.118503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8a8d5979-1702-469d-865a-744e27d697f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:36:36.119063 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8a8d5979-1702-469d-865a-744e27d697f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:36.125975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8d5979-1702-469d-865a-744e27d697f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:36.126560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8d5979-1702-469d-865a-744e27d697f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:36.126999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8d5979-1702-469d-865a-744e27d697f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:36.127695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8d5979-1702-469d-865a-744e27d697f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:36.128148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8d5979-1702-469d-865a-744e27d697f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:36.128572 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a8d5979-1702-469d-865a-744e27d697f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:36.186327 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8a8d5979-1702-469d-865a-744e27d697f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57/action" status: 204 len: 0 microversion: 2.1 time: 0.072133 Sep 10 21:36:36.186965 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3383/6639] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:36:36 2022] POST /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:36:36.196544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1f4ade54-d388-4d17-9063-9ce7fdf3c639 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:36.198281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1f4ade54-d388-4d17-9063-9ce7fdf3c639 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:36.204805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f4ade54-d388-4d17-9063-9ce7fdf3c639 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:36.205305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f4ade54-d388-4d17-9063-9ce7fdf3c639 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:36.205748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f4ade54-d388-4d17-9063-9ce7fdf3c639 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:36.206506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f4ade54-d388-4d17-9063-9ce7fdf3c639 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:36.206968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f4ade54-d388-4d17-9063-9ce7fdf3c639 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:36.207468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1f4ade54-d388-4d17-9063-9ce7fdf3c639 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:36.345249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1f4ade54-d388-4d17-9063-9ce7fdf3c639 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:36.353697 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1f4ade54-d388-4d17-9063-9ce7fdf3c639 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1675 microversion: 2.1 time: 0.162271 Sep 10 21:36:36.354361 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3257/6640] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:36 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:37.378600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-29ac1f58-7630-4280-abf1-ec152015a173 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:37.379302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-29ac1f58-7630-4280-abf1-ec152015a173 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:37.386057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29ac1f58-7630-4280-abf1-ec152015a173 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:37.386444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29ac1f58-7630-4280-abf1-ec152015a173 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:37.386961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29ac1f58-7630-4280-abf1-ec152015a173 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:37.387638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29ac1f58-7630-4280-abf1-ec152015a173 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:37.388084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29ac1f58-7630-4280-abf1-ec152015a173 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:37.388529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-29ac1f58-7630-4280-abf1-ec152015a173 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:37.403653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:37.527202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-29ac1f58-7630-4280-abf1-ec152015a173 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:37.535889 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-29ac1f58-7630-4280-abf1-ec152015a173 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1675 microversion: 2.1 time: 0.162485 Sep 10 21:36:37.536468 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3384/6641] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:37 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:38.561812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-02c1b5d8-8bc3-42fc-97ba-f9095c1108b3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:38.562892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-02c1b5d8-8bc3-42fc-97ba-f9095c1108b3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:38.570711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02c1b5d8-8bc3-42fc-97ba-f9095c1108b3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:38.572010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02c1b5d8-8bc3-42fc-97ba-f9095c1108b3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:38.572532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02c1b5d8-8bc3-42fc-97ba-f9095c1108b3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:38.573376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02c1b5d8-8bc3-42fc-97ba-f9095c1108b3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:38.573983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02c1b5d8-8bc3-42fc-97ba-f9095c1108b3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:38.574482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-02c1b5d8-8bc3-42fc-97ba-f9095c1108b3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:38.790184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-02c1b5d8-8bc3-42fc-97ba-f9095c1108b3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:38.798033 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-02c1b5d8-8bc3-42fc-97ba-f9095c1108b3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1667 microversion: 2.1 time: 0.241993 Sep 10 21:36:38.798617 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3258/6642] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:38 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1667 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:38.821592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e53556d8-196f-4283-9198-da64a0345c94 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:38.822233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e53556d8-196f-4283-9198-da64a0345c94 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:38.829082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e53556d8-196f-4283-9198-da64a0345c94 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:38.829567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e53556d8-196f-4283-9198-da64a0345c94 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:38.830042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e53556d8-196f-4283-9198-da64a0345c94 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:38.830742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e53556d8-196f-4283-9198-da64a0345c94 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:38.831199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e53556d8-196f-4283-9198-da64a0345c94 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:38.831627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e53556d8-196f-4283-9198-da64a0345c94 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:38.970574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e53556d8-196f-4283-9198-da64a0345c94 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:38.978668 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e53556d8-196f-4283-9198-da64a0345c94 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1667 microversion: 2.1 time: 0.161723 Sep 10 21:36:38.979485 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3385/6643] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:38 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:39.002630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-22f493aa-edcd-48b7-a197-b8fefe2b9109 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:39.003174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-22f493aa-edcd-48b7-a197-b8fefe2b9109 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:39.009972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22f493aa-edcd-48b7-a197-b8fefe2b9109 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:39.010471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22f493aa-edcd-48b7-a197-b8fefe2b9109 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:39.010915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22f493aa-edcd-48b7-a197-b8fefe2b9109 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:39.011617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22f493aa-edcd-48b7-a197-b8fefe2b9109 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:39.012074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22f493aa-edcd-48b7-a197-b8fefe2b9109 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:39.012503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-22f493aa-edcd-48b7-a197-b8fefe2b9109 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:39.159993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-8eec275d-2520-4a63-be21-099fc1662631 req-35a58392-ea31-47f9-841e-167e42489dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c54fd1-9552-4f3e-89d4-14273e79bd57", "name": "network-vif-plugged", "status": "completed", "tag": "f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:36:39.170916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8eec275d-2520-4a63-be21-099fc1662631 req-35a58392-ea31-47f9-841e-167e42489dcc service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:39.171637 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8eec275d-2520-4a63-be21-099fc1662631 req-35a58392-ea31-47f9-841e-167e42489dcc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:39.172083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-8eec275d-2520-4a63-be21-099fc1662631 req-35a58392-ea31-47f9-841e-167e42489dcc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:39.186169 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-8eec275d-2520-4a63-be21-099fc1662631 req-35a58392-ea31-47f9-841e-167e42489dcc service nova] Creating event network-vif-plugged:f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc for instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 on nch1-master-1 Sep 10 21:36:39.191500 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-8eec275d-2520-4a63-be21-099fc1662631 req-35a58392-ea31-47f9-841e-167e42489dcc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035647 Sep 10 21:36:39.192281 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3386/6644] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:36:39.565953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-22f493aa-edcd-48b7-a197-b8fefe2b9109 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:39.571354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=100 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:39.576110 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-22f493aa-edcd-48b7-a197-b8fefe2b9109 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1667 microversion: 2.1 time: 0.577366 Sep 10 21:36:39.576704 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3259/6645] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:38 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1667 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:39.603629 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1355a9b4-da3a-4ffc-a1b0-6c870050a3e7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:39.604014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1355a9b4-da3a-4ffc-a1b0-6c870050a3e7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:39.610434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1355a9b4-da3a-4ffc-a1b0-6c870050a3e7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:39.610925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1355a9b4-da3a-4ffc-a1b0-6c870050a3e7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:39.611362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1355a9b4-da3a-4ffc-a1b0-6c870050a3e7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:39.612057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1355a9b4-da3a-4ffc-a1b0-6c870050a3e7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:39.612585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1355a9b4-da3a-4ffc-a1b0-6c870050a3e7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:39.613022 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1355a9b4-da3a-4ffc-a1b0-6c870050a3e7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:39.638602 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1355a9b4-da3a-4ffc-a1b0-6c870050a3e7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:36:39.711656 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1355a9b4-da3a-4ffc-a1b0-6c870050a3e7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 204 len: 0 microversion: 2.1 time: 0.112413 Sep 10 21:36:39.712802 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3387/6646] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:36:39 2022] DELETE /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:36:39.722546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a629cf4f-38a2-45d2-ba15-ccd3e5f1464d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:39.723159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a629cf4f-38a2-45d2-ba15-ccd3e5f1464d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:39.729541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a629cf4f-38a2-45d2-ba15-ccd3e5f1464d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:39.730079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a629cf4f-38a2-45d2-ba15-ccd3e5f1464d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:39.730533 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a629cf4f-38a2-45d2-ba15-ccd3e5f1464d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:39.731228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a629cf4f-38a2-45d2-ba15-ccd3e5f1464d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:39.731693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a629cf4f-38a2-45d2-ba15-ccd3e5f1464d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:39.732151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a629cf4f-38a2-45d2-ba15-ccd3e5f1464d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:39.862494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a629cf4f-38a2-45d2-ba15-ccd3e5f1464d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:39.870981 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a629cf4f-38a2-45d2-ba15-ccd3e5f1464d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1673 microversion: 2.1 time: 0.152574 Sep 10 21:36:39.871555 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3260/6647] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:39 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:36:40.894984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8f1c61ec-26d4-4d0d-a95f-0c7990f5a779 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:40.895692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8f1c61ec-26d4-4d0d-a95f-0c7990f5a779 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:40.903186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f1c61ec-26d4-4d0d-a95f-0c7990f5a779 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:40.903677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f1c61ec-26d4-4d0d-a95f-0c7990f5a779 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:40.904128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f1c61ec-26d4-4d0d-a95f-0c7990f5a779 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:40.904831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f1c61ec-26d4-4d0d-a95f-0c7990f5a779 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:40.905296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f1c61ec-26d4-4d0d-a95f-0c7990f5a779 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:40.905731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8f1c61ec-26d4-4d0d-a95f-0c7990f5a779 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:41.041435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8f1c61ec-26d4-4d0d-a95f-0c7990f5a779 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:41.049375 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8f1c61ec-26d4-4d0d-a95f-0c7990f5a779 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1673 microversion: 2.1 time: 0.158673 Sep 10 21:36:41.050006 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3388/6648] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:40 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:42.073073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0278d562-67f4-4692-8a8e-5c049556171f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:42.073695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0278d562-67f4-4692-8a8e-5c049556171f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:42.076467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=37 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:42.082037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0278d562-67f4-4692-8a8e-5c049556171f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:42.082536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0278d562-67f4-4692-8a8e-5c049556171f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:42.082973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0278d562-67f4-4692-8a8e-5c049556171f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:42.083681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0278d562-67f4-4692-8a8e-5c049556171f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:42.084133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0278d562-67f4-4692-8a8e-5c049556171f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:42.085338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0278d562-67f4-4692-8a8e-5c049556171f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:42.177690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0278d562-67f4-4692-8a8e-5c049556171f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:42.189555 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0278d562-67f4-4692-8a8e-5c049556171f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 200 len: 1606 microversion: 2.1 time: 0.120724 Sep 10 21:36:42.190181 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3261/6649] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:42 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 1606 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:42.306782 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-7ae48e3c-2fa7-4779-9e52-3a9bcbaf111d req-eda7bcfb-dbec-40f4-9a77-609215e69e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c54fd1-9552-4f3e-89d4-14273e79bd57", "name": "network-vif-deleted", "tag": "f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:36:42.313361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:42.320122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7ae48e3c-2fa7-4779-9e52-3a9bcbaf111d req-eda7bcfb-dbec-40f4-9a77-609215e69e87 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:42.320600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7ae48e3c-2fa7-4779-9e52-3a9bcbaf111d req-eda7bcfb-dbec-40f4-9a77-609215e69e87 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:42.321225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-7ae48e3c-2fa7-4779-9e52-3a9bcbaf111d req-eda7bcfb-dbec-40f4-9a77-609215e69e87 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:42.332967 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-7ae48e3c-2fa7-4779-9e52-3a9bcbaf111d req-eda7bcfb-dbec-40f4-9a77-609215e69e87 service nova] Creating event network-vif-deleted:f0e82c16-dcfe-46fb-8eec-9a4b3cfd10fc for instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 on nch1-master-1 Sep 10 21:36:42.338889 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-7ae48e3c-2fa7-4779-9e52-3a9bcbaf111d req-eda7bcfb-dbec-40f4-9a77-609215e69e87 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035756 Sep 10 21:36:42.339696 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3389/6650] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:36:43.215266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:43.215877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:43.223009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:43.223459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:43.223894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:43.224586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:43.225244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:43.225765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:43.239896 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 HTTP/1.1 Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'a7c54fd1-9552-4f3e-89d4-14273e79bd57'} Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:36:43.242113 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:36:43.246557 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:36:43.246557 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:36:43.246557 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:36:43.246557 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:36:43.246557 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:36:43.246557 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:36:43.246557 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:36:43.246557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:36:43.246557 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-80b5eb8d-6440-4b0b-9a82-1ff03a1d35c1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 404 len: 111 microversion: 2.1 time: 0.032266 Sep 10 21:36:43.246557 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3262/6651] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:43 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:36:43.259112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:43.260127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:43.268203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:43.269313 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:43.270191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:43.271133 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:43.271821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:43.273229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:43.290567 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 HTTP/1.1 Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a7c54fd1-9552-4f3e-89d4-14273e79bd57'} Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:36:43.292259 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:36:43.305214 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:36:43.305214 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:36:43.305214 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:36:43.305214 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:36:43.305214 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:36:43.305214 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:36:43.305214 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:36:43.305214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:36:43.305214 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fddbaa52-31de-4d96-8aaa-c604f1b7c4aa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 404 len: 111 microversion: 2.1 time: 0.041167 Sep 10 21:36:43.305214 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3390/6652] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:43 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:36:43.345450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-897200535", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "1cb3c97f-0c08-4804-b456-564eec6cad8b"}], "security_groups": [{"name": "tempest-securitygroup--309256126"}], "key_name": "tempest-keypair-955803444", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:36:43.460629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] validate_networks() for [('1cb3c97f-0c08-4804-b456-564eec6cad8b', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:36:43.830827 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:36:43.831289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:36:43.831799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:36:43.832220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:36:43.832638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:36:43.841912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:43.842404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:43.842848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:43.843577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:43.844039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:43.844471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:43.861978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for project e767567d02b24a5eb0a01b9ead34449f. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:36:43.867865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for user 5e00195042734152b7ab7a71fc7b9e3b and project e767567d02b24a5eb0a01b9ead34449f. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:36:43.880179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:36:43.882551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:36:43.928996 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1b504610-81dc-42c3-a876-768ca9478a9c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.586931 Sep 10 21:36:43.929703 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3263/6653] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:36:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:36:43.941017 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ea3a857c-6f6e-4a99-925d-2c9801ae6f37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:43.941632 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ea3a857c-6f6e-4a99-925d-2c9801ae6f37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:43.999410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ea3a857c-6f6e-4a99-925d-2c9801ae6f37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:44.008392 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ea3a857c-6f6e-4a99-925d-2c9801ae6f37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1237 microversion: 2.1 time: 0.071190 Sep 10 21:36:44.008966 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3391/6654] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:43 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:45.032841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da4fe971-7534-4ff2-bce4-75b43a495f46 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:45.033662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da4fe971-7534-4ff2-bce4-75b43a495f46 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:45.043904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da4fe971-7534-4ff2-bce4-75b43a495f46 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:45.044494 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da4fe971-7534-4ff2-bce4-75b43a495f46 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:45.045008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da4fe971-7534-4ff2-bce4-75b43a495f46 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:45.045790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da4fe971-7534-4ff2-bce4-75b43a495f46 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:45.046373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da4fe971-7534-4ff2-bce4-75b43a495f46 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:45.046879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da4fe971-7534-4ff2-bce4-75b43a495f46 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:45.130695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da4fe971-7534-4ff2-bce4-75b43a495f46 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:45.141960 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da4fe971-7534-4ff2-bce4-75b43a495f46 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1289 microversion: 2.1 time: 0.113147 Sep 10 21:36:45.143545 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3264/6655] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:45 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:46.168209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-26c3e9ce-42ed-43e5-84a6-89fc58920e2f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:46.169020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-26c3e9ce-42ed-43e5-84a6-89fc58920e2f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:46.176070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c3e9ce-42ed-43e5-84a6-89fc58920e2f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:46.176651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c3e9ce-42ed-43e5-84a6-89fc58920e2f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:46.177168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c3e9ce-42ed-43e5-84a6-89fc58920e2f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:46.177914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c3e9ce-42ed-43e5-84a6-89fc58920e2f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:46.179186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c3e9ce-42ed-43e5-84a6-89fc58920e2f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:46.179622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-26c3e9ce-42ed-43e5-84a6-89fc58920e2f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:46.318506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-26c3e9ce-42ed-43e5-84a6-89fc58920e2f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:46.326376 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-26c3e9ce-42ed-43e5-84a6-89fc58920e2f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1362 microversion: 2.1 time: 0.162262 Sep 10 21:36:46.326953 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3392/6656] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:46 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:46.573242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-fbd8ffc0-6b3e-4200-b078-47e4c78bb0a7 req-b0f0539d-0878-45b8-93cc-72ba89ef6085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3df5ff7-de71-4849-a0d0-00003135f363", "tag": "1c786c6f-1930-482d-b775-9e3f73c235a4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:36:46.585693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fbd8ffc0-6b3e-4200-b078-47e4c78bb0a7 req-b0f0539d-0878-45b8-93cc-72ba89ef6085 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:46.586227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fbd8ffc0-6b3e-4200-b078-47e4c78bb0a7 req-b0f0539d-0878-45b8-93cc-72ba89ef6085 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:46.586860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-fbd8ffc0-6b3e-4200-b078-47e4c78bb0a7 req-b0f0539d-0878-45b8-93cc-72ba89ef6085 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:46.598059 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-fbd8ffc0-6b3e-4200-b078-47e4c78bb0a7 req-b0f0539d-0878-45b8-93cc-72ba89ef6085 service nova] Creating event network-changed:1c786c6f-1930-482d-b775-9e3f73c235a4 for instance c3df5ff7-de71-4849-a0d0-00003135f363 on nch1-master-1 Sep 10 21:36:46.604117 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-fbd8ffc0-6b3e-4200-b078-47e4c78bb0a7 req-b0f0539d-0878-45b8-93cc-72ba89ef6085 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035251 Sep 10 21:36:46.604799 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3265/6657] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:36:47.351273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-619d1396-d437-43f0-b35f-2c805c4f8243 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:47.351889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-619d1396-d437-43f0-b35f-2c805c4f8243 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:47.359139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-619d1396-d437-43f0-b35f-2c805c4f8243 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:47.359609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-619d1396-d437-43f0-b35f-2c805c4f8243 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:47.360048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-619d1396-d437-43f0-b35f-2c805c4f8243 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:47.360738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-619d1396-d437-43f0-b35f-2c805c4f8243 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:47.361196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-619d1396-d437-43f0-b35f-2c805c4f8243 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:47.361623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-619d1396-d437-43f0-b35f-2c805c4f8243 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:47.493414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-619d1396-d437-43f0-b35f-2c805c4f8243 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:47.501087 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-619d1396-d437-43f0-b35f-2c805c4f8243 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1362 microversion: 2.1 time: 0.154259 Sep 10 21:36:47.501706 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3393/6658] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:47 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:36:48.525705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6985d32a-72a8-4d9f-a677-8899dc35aea9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:48.526446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6985d32a-72a8-4d9f-a677-8899dc35aea9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:48.533578 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6985d32a-72a8-4d9f-a677-8899dc35aea9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:48.534106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6985d32a-72a8-4d9f-a677-8899dc35aea9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:48.534544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6985d32a-72a8-4d9f-a677-8899dc35aea9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:48.535236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6985d32a-72a8-4d9f-a677-8899dc35aea9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:48.535691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6985d32a-72a8-4d9f-a677-8899dc35aea9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:48.536116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6985d32a-72a8-4d9f-a677-8899dc35aea9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:48.671977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6985d32a-72a8-4d9f-a677-8899dc35aea9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:48.680273 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6985d32a-72a8-4d9f-a677-8899dc35aea9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1362 microversion: 2.1 time: 0.159315 Sep 10 21:36:48.680850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3266/6659] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:48 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:49.704215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eabbe967-def9-40c2-a705-133b45bac01a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:49.704819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eabbe967-def9-40c2-a705-133b45bac01a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:49.712488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eabbe967-def9-40c2-a705-133b45bac01a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:49.713000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eabbe967-def9-40c2-a705-133b45bac01a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:49.713437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eabbe967-def9-40c2-a705-133b45bac01a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:49.714181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eabbe967-def9-40c2-a705-133b45bac01a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:49.714636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eabbe967-def9-40c2-a705-133b45bac01a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:49.715061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eabbe967-def9-40c2-a705-133b45bac01a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:49.846314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-eabbe967-def9-40c2-a705-133b45bac01a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:49.854466 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eabbe967-def9-40c2-a705-133b45bac01a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1362 microversion: 2.1 time: 0.154202 Sep 10 21:36:49.855040 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3394/6660] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:49 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:50.878536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c9f4127b-8a02-4d61-9841-ddfe2b9ed871 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:50.879148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c9f4127b-8a02-4d61-9841-ddfe2b9ed871 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:50.886761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9f4127b-8a02-4d61-9841-ddfe2b9ed871 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:50.887250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9f4127b-8a02-4d61-9841-ddfe2b9ed871 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:50.887690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9f4127b-8a02-4d61-9841-ddfe2b9ed871 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:50.888390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9f4127b-8a02-4d61-9841-ddfe2b9ed871 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:50.888846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9f4127b-8a02-4d61-9841-ddfe2b9ed871 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:50.889275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9f4127b-8a02-4d61-9841-ddfe2b9ed871 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:51.025476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c9f4127b-8a02-4d61-9841-ddfe2b9ed871 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:51.033859 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c9f4127b-8a02-4d61-9841-ddfe2b9ed871 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1362 microversion: 2.1 time: 0.159144 Sep 10 21:36:51.034443 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3267/6661] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:50 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:36:52.058797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9488f732-b5ce-4695-a099-e6395a079798 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:52.059340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9488f732-b5ce-4695-a099-e6395a079798 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:52.066231 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9488f732-b5ce-4695-a099-e6395a079798 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:52.066716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9488f732-b5ce-4695-a099-e6395a079798 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:52.067150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9488f732-b5ce-4695-a099-e6395a079798 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:52.067840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9488f732-b5ce-4695-a099-e6395a079798 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:52.068294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9488f732-b5ce-4695-a099-e6395a079798 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:52.069356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9488f732-b5ce-4695-a099-e6395a079798 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:52.200199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9488f732-b5ce-4695-a099-e6395a079798 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:52.208025 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9488f732-b5ce-4695-a099-e6395a079798 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1362 microversion: 2.1 time: 0.153133 Sep 10 21:36:52.208601 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3395/6662] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:52 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:53.232354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cad91052-735c-4a63-934c-6879e324790f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:53.233231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cad91052-735c-4a63-934c-6879e324790f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:53.239784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e526ac9c-332f-4445-b73c-2baa54e09abd req-f2d06e9d-30db-46f6-8b50-01586d7fedeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3df5ff7-de71-4849-a0d0-00003135f363", "name": "network-vif-plugged", "status": "completed", "tag": "1c786c6f-1930-482d-b775-9e3f73c235a4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:36:53.240833 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad91052-735c-4a63-934c-6879e324790f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:53.241391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad91052-735c-4a63-934c-6879e324790f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:53.241852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad91052-735c-4a63-934c-6879e324790f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:53.242558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad91052-735c-4a63-934c-6879e324790f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:53.243008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad91052-735c-4a63-934c-6879e324790f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:53.244211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cad91052-735c-4a63-934c-6879e324790f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:53.251198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e526ac9c-332f-4445-b73c-2baa54e09abd req-f2d06e9d-30db-46f6-8b50-01586d7fedeb service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:53.251681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e526ac9c-332f-4445-b73c-2baa54e09abd req-f2d06e9d-30db-46f6-8b50-01586d7fedeb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:53.252524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e526ac9c-332f-4445-b73c-2baa54e09abd req-f2d06e9d-30db-46f6-8b50-01586d7fedeb service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:53.267525 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e526ac9c-332f-4445-b73c-2baa54e09abd req-f2d06e9d-30db-46f6-8b50-01586d7fedeb service nova] Creating event network-vif-plugged:1c786c6f-1930-482d-b775-9e3f73c235a4 for instance c3df5ff7-de71-4849-a0d0-00003135f363 on nch1-master-1 Sep 10 21:36:53.273678 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e526ac9c-332f-4445-b73c-2baa54e09abd req-f2d06e9d-30db-46f6-8b50-01586d7fedeb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037616 Sep 10 21:36:53.274553 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3396/6663] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:36:53.419436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cad91052-735c-4a63-934c-6879e324790f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:53.427183 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cad91052-735c-4a63-934c-6879e324790f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1362 microversion: 2.1 time: 0.198826 Sep 10 21:36:53.428289 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3268/6664] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:53 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:54.449081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:54.454376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40c52614-16e4-4bf7-a70f-1e7a1f7164d1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:54.455083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-40c52614-16e4-4bf7-a70f-1e7a1f7164d1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:54.461732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40c52614-16e4-4bf7-a70f-1e7a1f7164d1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:54.462250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40c52614-16e4-4bf7-a70f-1e7a1f7164d1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:54.462696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40c52614-16e4-4bf7-a70f-1e7a1f7164d1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:54.463398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40c52614-16e4-4bf7-a70f-1e7a1f7164d1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:54.463858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40c52614-16e4-4bf7-a70f-1e7a1f7164d1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:54.464291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40c52614-16e4-4bf7-a70f-1e7a1f7164d1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:54.596471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40c52614-16e4-4bf7-a70f-1e7a1f7164d1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:54.604957 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40c52614-16e4-4bf7-a70f-1e7a1f7164d1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1362 microversion: 2.1 time: 0.156844 Sep 10 21:36:54.605642 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3397/6665] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:54 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:55.629443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2bd82b99-823f-456a-b9cb-ccab1358028a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:55.630168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2bd82b99-823f-456a-b9cb-ccab1358028a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:55.633131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:55.633802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:36:55.640602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bd82b99-823f-456a-b9cb-ccab1358028a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:55.641102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bd82b99-823f-456a-b9cb-ccab1358028a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:55.641538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bd82b99-823f-456a-b9cb-ccab1358028a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:55.642271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bd82b99-823f-456a-b9cb-ccab1358028a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:55.642729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bd82b99-823f-456a-b9cb-ccab1358028a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:55.643156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bd82b99-823f-456a-b9cb-ccab1358028a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:55.777947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2bd82b99-823f-456a-b9cb-ccab1358028a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:36:55.787012 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2bd82b99-823f-456a-b9cb-ccab1358028a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1548 microversion: 2.1 time: 0.161525 Sep 10 21:36:55.788189 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3269/6666] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:36:55 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:36:55.811288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9fbe3c04-0553-47fd-a06a-014d6bf44be7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:36:55.812006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9fbe3c04-0553-47fd-a06a-014d6bf44be7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:36:55.820069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fbe3c04-0553-47fd-a06a-014d6bf44be7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:55.820564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fbe3c04-0553-47fd-a06a-014d6bf44be7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:55.821001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fbe3c04-0553-47fd-a06a-014d6bf44be7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:55.821702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fbe3c04-0553-47fd-a06a-014d6bf44be7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:55.822201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fbe3c04-0553-47fd-a06a-014d6bf44be7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:55.822630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9fbe3c04-0553-47fd-a06a-014d6bf44be7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:55.910139 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9fbe3c04-0553-47fd-a06a-014d6bf44be7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102695 Sep 10 21:36:55.910733 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3398/6667] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:36:55 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:36:56.853659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e9cc51f1-f5e7-45f1-92b1-169223f67834 req-4a7c20e1-9aec-4be6-b594-3589c37ed3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3df5ff7-de71-4849-a0d0-00003135f363", "tag": "1c786c6f-1930-482d-b775-9e3f73c235a4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:36:56.864870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e9cc51f1-f5e7-45f1-92b1-169223f67834 req-4a7c20e1-9aec-4be6-b594-3589c37ed3c4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:36:56.865383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e9cc51f1-f5e7-45f1-92b1-169223f67834 req-4a7c20e1-9aec-4be6-b594-3589c37ed3c4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:36:56.865939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e9cc51f1-f5e7-45f1-92b1-169223f67834 req-4a7c20e1-9aec-4be6-b594-3589c37ed3c4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:36:56.877004 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e9cc51f1-f5e7-45f1-92b1-169223f67834 req-4a7c20e1-9aec-4be6-b594-3589c37ed3c4 service nova] Creating event network-changed:1c786c6f-1930-482d-b775-9e3f73c235a4 for instance c3df5ff7-de71-4849-a0d0-00003135f363 on nch1-master-1 Sep 10 21:36:56.883821 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e9cc51f1-f5e7-45f1-92b1-169223f67834 req-4a7c20e1-9aec-4be6-b594-3589c37ed3c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033613 Sep 10 21:36:56.884440 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3270/6668] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:37:58.579007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=21 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:37:58.579766 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:37:58.585051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-59640b5c-0738-405d-b5c1-880187ecf460 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:37:58.592456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59640b5c-0738-405d-b5c1-880187ecf460 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:37:58.592942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59640b5c-0738-405d-b5c1-880187ecf460 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:37:58.593391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-59640b5c-0738-405d-b5c1-880187ecf460 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:37:58.617214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-59640b5c-0738-405d-b5c1-880187ecf460 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Going to try to stop instance {{(pid=145772) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 21:37:58.660173 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-59640b5c-0738-405d-b5c1-880187ecf460 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363/action" status: 202 len: 0 microversion: 2.1 time: 0.083337 Sep 10 21:37:58.660863 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3399/6669] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:37:58 2022] POST /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:37:58.668097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:37:58.668851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=50 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:37:58.673211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-743aa753-6b2c-4e8a-ac82-2f79434449de tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:37:58.673954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-743aa753-6b2c-4e8a-ac82-2f79434449de tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:37:58.682330 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743aa753-6b2c-4e8a-ac82-2f79434449de tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:37:58.682830 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743aa753-6b2c-4e8a-ac82-2f79434449de tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:37:58.683274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743aa753-6b2c-4e8a-ac82-2f79434449de tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:37:58.683981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743aa753-6b2c-4e8a-ac82-2f79434449de tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:37:58.684442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743aa753-6b2c-4e8a-ac82-2f79434449de tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:37:58.684874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-743aa753-6b2c-4e8a-ac82-2f79434449de tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:37:58.824937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-743aa753-6b2c-4e8a-ac82-2f79434449de tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:37:58.832743 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-743aa753-6b2c-4e8a-ac82-2f79434449de tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.166712 Sep 10 21:37:58.833267 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3271/6670] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:37:58 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:37:59.857718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0ed64bd0-4975-4e8e-b8f2-4cbc61e984f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:37:59.858433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0ed64bd0-4975-4e8e-b8f2-4cbc61e984f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:37:59.866144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed64bd0-4975-4e8e-b8f2-4cbc61e984f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:37:59.866872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed64bd0-4975-4e8e-b8f2-4cbc61e984f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:37:59.867311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed64bd0-4975-4e8e-b8f2-4cbc61e984f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:37:59.868007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed64bd0-4975-4e8e-b8f2-4cbc61e984f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:37:59.868454 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed64bd0-4975-4e8e-b8f2-4cbc61e984f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:37:59.868877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed64bd0-4975-4e8e-b8f2-4cbc61e984f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:00.000654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0ed64bd0-4975-4e8e-b8f2-4cbc61e984f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:00.009144 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0ed64bd0-4975-4e8e-b8f2-4cbc61e984f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.155531 Sep 10 21:38:00.009723 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3400/6671] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:37:59 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:01.035098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-60c4a219-bae3-47fa-9f92-2db6dd740e5e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:01.035664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-60c4a219-bae3-47fa-9f92-2db6dd740e5e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:01.038752 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 21:38:01.038907 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 21:38:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 (ip 10.222.0.33) !!! Sep 10 21:38:01.045704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60c4a219-bae3-47fa-9f92-2db6dd740e5e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:01.046221 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60c4a219-bae3-47fa-9f92-2db6dd740e5e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:01.046659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60c4a219-bae3-47fa-9f92-2db6dd740e5e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:01.047354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60c4a219-bae3-47fa-9f92-2db6dd740e5e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:01.047812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60c4a219-bae3-47fa-9f92-2db6dd740e5e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:01.048244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-60c4a219-bae3-47fa-9f92-2db6dd740e5e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:01.177591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-60c4a219-bae3-47fa-9f92-2db6dd740e5e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:01.185417 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-60c4a219-bae3-47fa-9f92-2db6dd740e5e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.154308 Sep 10 21:38:01.186041 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3272/6672] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:01 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:02.208592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4164d76d-d48f-4533-9c83-1ecdf2ce6314 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:02.210421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4164d76d-d48f-4533-9c83-1ecdf2ce6314 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:02.217235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4164d76d-d48f-4533-9c83-1ecdf2ce6314 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:02.217716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4164d76d-d48f-4533-9c83-1ecdf2ce6314 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:02.218184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4164d76d-d48f-4533-9c83-1ecdf2ce6314 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:02.218873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4164d76d-d48f-4533-9c83-1ecdf2ce6314 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:02.219325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4164d76d-d48f-4533-9c83-1ecdf2ce6314 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:02.219758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4164d76d-d48f-4533-9c83-1ecdf2ce6314 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:02.362663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4164d76d-d48f-4533-9c83-1ecdf2ce6314 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:02.370700 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4164d76d-d48f-4533-9c83-1ecdf2ce6314 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.166076 Sep 10 21:38:02.371278 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3401/6673] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:02 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:03.395007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e3105a70-0971-41c0-b62b-33fb8fb9250f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:03.395624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e3105a70-0971-41c0-b62b-33fb8fb9250f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:03.402527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3105a70-0971-41c0-b62b-33fb8fb9250f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:03.403016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3105a70-0971-41c0-b62b-33fb8fb9250f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:03.403456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3105a70-0971-41c0-b62b-33fb8fb9250f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:03.404150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3105a70-0971-41c0-b62b-33fb8fb9250f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:03.404612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3105a70-0971-41c0-b62b-33fb8fb9250f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:03.405038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e3105a70-0971-41c0-b62b-33fb8fb9250f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:03.537369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e3105a70-0971-41c0-b62b-33fb8fb9250f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:03.545403 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e3105a70-0971-41c0-b62b-33fb8fb9250f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.154384 Sep 10 21:38:03.546046 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3273/6674] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:03 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:38:04.568791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-40d38013-c204-4f7f-9c6e-058c2b96b06e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:04.569446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-40d38013-c204-4f7f-9c6e-058c2b96b06e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:04.576300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d38013-c204-4f7f-9c6e-058c2b96b06e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:04.576785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d38013-c204-4f7f-9c6e-058c2b96b06e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:04.577493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d38013-c204-4f7f-9c6e-058c2b96b06e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:04.578471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d38013-c204-4f7f-9c6e-058c2b96b06e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:04.578935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d38013-c204-4f7f-9c6e-058c2b96b06e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:04.579362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-40d38013-c204-4f7f-9c6e-058c2b96b06e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:04.710469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-40d38013-c204-4f7f-9c6e-058c2b96b06e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:04.718393 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-40d38013-c204-4f7f-9c6e-058c2b96b06e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.153540 Sep 10 21:38:04.718974 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3402/6675] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:04 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:05.742900 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cb14ea9f-72e8-44f0-81e0-5c102cf8ecb9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:05.743517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cb14ea9f-72e8-44f0-81e0-5c102cf8ecb9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:05.750420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb14ea9f-72e8-44f0-81e0-5c102cf8ecb9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:05.750909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb14ea9f-72e8-44f0-81e0-5c102cf8ecb9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:05.751348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb14ea9f-72e8-44f0-81e0-5c102cf8ecb9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:05.752056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb14ea9f-72e8-44f0-81e0-5c102cf8ecb9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:05.752499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb14ea9f-72e8-44f0-81e0-5c102cf8ecb9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:05.752924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cb14ea9f-72e8-44f0-81e0-5c102cf8ecb9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:05.880585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cb14ea9f-72e8-44f0-81e0-5c102cf8ecb9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:05.889161 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cb14ea9f-72e8-44f0-81e0-5c102cf8ecb9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.150263 Sep 10 21:38:05.889742 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3274/6676] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:05 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:06.914351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c0e50060-509b-47ba-9f5e-eb8e5991c7f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:06.914957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c0e50060-509b-47ba-9f5e-eb8e5991c7f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:06.921730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0e50060-509b-47ba-9f5e-eb8e5991c7f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:06.922361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0e50060-509b-47ba-9f5e-eb8e5991c7f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:06.922804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0e50060-509b-47ba-9f5e-eb8e5991c7f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:06.923490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0e50060-509b-47ba-9f5e-eb8e5991c7f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:06.924145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0e50060-509b-47ba-9f5e-eb8e5991c7f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:06.924574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0e50060-509b-47ba-9f5e-eb8e5991c7f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:07.054516 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c0e50060-509b-47ba-9f5e-eb8e5991c7f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:07.062186 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c0e50060-509b-47ba-9f5e-eb8e5991c7f7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.152627 Sep 10 21:38:07.062757 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3403/6677] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:06 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:08.085855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eb1d1701-c720-4761-9bbd-ab667fef13dd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:08.086473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eb1d1701-c720-4761-9bbd-ab667fef13dd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:08.093234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb1d1701-c720-4761-9bbd-ab667fef13dd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:08.093718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb1d1701-c720-4761-9bbd-ab667fef13dd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:08.094282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb1d1701-c720-4761-9bbd-ab667fef13dd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:08.094980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb1d1701-c720-4761-9bbd-ab667fef13dd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:08.095466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb1d1701-c720-4761-9bbd-ab667fef13dd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:08.095892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb1d1701-c720-4761-9bbd-ab667fef13dd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:08.227983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eb1d1701-c720-4761-9bbd-ab667fef13dd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:08.236016 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eb1d1701-c720-4761-9bbd-ab667fef13dd tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.154107 Sep 10 21:38:08.236588 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3275/6678] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:08 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:09.260581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5bb3f3c4-9e92-48cb-bdab-6736012db359 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:09.261216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5bb3f3c4-9e92-48cb-bdab-6736012db359 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:09.268168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bb3f3c4-9e92-48cb-bdab-6736012db359 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:09.268648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bb3f3c4-9e92-48cb-bdab-6736012db359 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:09.269081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bb3f3c4-9e92-48cb-bdab-6736012db359 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:09.269767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bb3f3c4-9e92-48cb-bdab-6736012db359 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:09.270243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bb3f3c4-9e92-48cb-bdab-6736012db359 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:09.270666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5bb3f3c4-9e92-48cb-bdab-6736012db359 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:09.412692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5bb3f3c4-9e92-48cb-bdab-6736012db359 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:09.420598 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5bb3f3c4-9e92-48cb-bdab-6736012db359 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1654 microversion: 2.1 time: 0.164034 Sep 10 21:38:09.421168 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3404/6679] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:09 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1654 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:09.449093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:09.451412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:09.458565 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:09.459731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:09.460373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:09.461087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:09.461570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:09.462047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:09.493060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:09.498749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Old instance type m1.heat2, new instance type m1.heat {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:38:09.505286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:38:09.505849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:38:09.506455 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:38:09.506874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:38:09.507292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:38:09.570283 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9d2a0348-04ec-4796-8521-b33eda7e9a7d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363/action" status: 202 len: 0 microversion: 2.1 time: 0.125092 Sep 10 21:38:09.570922 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3276/6680] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:38:09 2022] POST /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:38:09.578959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d827ce2c-3b67-4514-b790-02307ad44907 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:09.579568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d827ce2c-3b67-4514-b790-02307ad44907 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:09.586524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d827ce2c-3b67-4514-b790-02307ad44907 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:09.587023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d827ce2c-3b67-4514-b790-02307ad44907 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:09.587449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d827ce2c-3b67-4514-b790-02307ad44907 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:09.588146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d827ce2c-3b67-4514-b790-02307ad44907 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:09.588628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d827ce2c-3b67-4514-b790-02307ad44907 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:09.589058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d827ce2c-3b67-4514-b790-02307ad44907 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:09.759683 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d827ce2c-3b67-4514-b790-02307ad44907 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:09.767701 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d827ce2c-3b67-4514-b790-02307ad44907 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.192595 Sep 10 21:38:09.768276 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3405/6681] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:09 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:10.794166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5049ff16-a1cc-4a51-b939-db9d0b375c11 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:10.794927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5049ff16-a1cc-4a51-b939-db9d0b375c11 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:10.804989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5049ff16-a1cc-4a51-b939-db9d0b375c11 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:10.805487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5049ff16-a1cc-4a51-b939-db9d0b375c11 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:10.805970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5049ff16-a1cc-4a51-b939-db9d0b375c11 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:10.806679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5049ff16-a1cc-4a51-b939-db9d0b375c11 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:10.807324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5049ff16-a1cc-4a51-b939-db9d0b375c11 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:10.807759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5049ff16-a1cc-4a51-b939-db9d0b375c11 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:10.936805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5049ff16-a1cc-4a51-b939-db9d0b375c11 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:10.944838 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5049ff16-a1cc-4a51-b939-db9d0b375c11 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1677 microversion: 2.1 time: 0.155910 Sep 10 21:38:10.945414 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3277/6682] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:10 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:38:11.968470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f8cec627-7813-48f7-9043-3607391ff868 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:11.969057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f8cec627-7813-48f7-9043-3607391ff868 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:11.977200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8cec627-7813-48f7-9043-3607391ff868 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:11.977571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8cec627-7813-48f7-9043-3607391ff868 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:11.978032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8cec627-7813-48f7-9043-3607391ff868 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:11.978732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8cec627-7813-48f7-9043-3607391ff868 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:11.979181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8cec627-7813-48f7-9043-3607391ff868 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:11.979607 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f8cec627-7813-48f7-9043-3607391ff868 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:12.107975 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f8cec627-7813-48f7-9043-3607391ff868 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:12.116251 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f8cec627-7813-48f7-9043-3607391ff868 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1682 microversion: 2.1 time: 0.151604 Sep 10 21:38:12.116828 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3406/6683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:11 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:13.139871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e102b324-1ad5-4cab-911e-e30362134701 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:13.140483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e102b324-1ad5-4cab-911e-e30362134701 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:13.147892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e102b324-1ad5-4cab-911e-e30362134701 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:13.148373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e102b324-1ad5-4cab-911e-e30362134701 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:13.148806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e102b324-1ad5-4cab-911e-e30362134701 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:13.149491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e102b324-1ad5-4cab-911e-e30362134701 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:13.149971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e102b324-1ad5-4cab-911e-e30362134701 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:13.150396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e102b324-1ad5-4cab-911e-e30362134701 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:13.282689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e102b324-1ad5-4cab-911e-e30362134701 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:13.291813 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e102b324-1ad5-4cab-911e-e30362134701 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1682 microversion: 2.1 time: 0.155724 Sep 10 21:38:13.292925 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3278/6684] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:13 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:14.316799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ec66e762-41df-4e1d-91ba-ce411acffd28 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:14.317758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ec66e762-41df-4e1d-91ba-ce411acffd28 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:14.325457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-43c63a59-7362-40dc-b8e7-865f99971b28 req-dcfc678c-2714-47bb-a77e-78083e4dbc99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3df5ff7-de71-4849-a0d0-00003135f363", "name": "network-vif-unplugged", "status": "completed", "tag": "1c786c6f-1930-482d-b775-9e3f73c235a4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:14.325959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec66e762-41df-4e1d-91ba-ce411acffd28 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:14.326479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec66e762-41df-4e1d-91ba-ce411acffd28 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:14.327013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec66e762-41df-4e1d-91ba-ce411acffd28 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:14.327949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec66e762-41df-4e1d-91ba-ce411acffd28 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:14.328512 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec66e762-41df-4e1d-91ba-ce411acffd28 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:14.329018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec66e762-41df-4e1d-91ba-ce411acffd28 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:14.335661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-43c63a59-7362-40dc-b8e7-865f99971b28 req-dcfc678c-2714-47bb-a77e-78083e4dbc99 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:14.336142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-43c63a59-7362-40dc-b8e7-865f99971b28 req-dcfc678c-2714-47bb-a77e-78083e4dbc99 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:14.336687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-43c63a59-7362-40dc-b8e7-865f99971b28 req-dcfc678c-2714-47bb-a77e-78083e4dbc99 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:14.349304 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-43c63a59-7362-40dc-b8e7-865f99971b28 req-dcfc678c-2714-47bb-a77e-78083e4dbc99 service nova] Creating event network-vif-unplugged:1c786c6f-1930-482d-b775-9e3f73c235a4 for instance c3df5ff7-de71-4849-a0d0-00003135f363 on nch2-master-1 Sep 10 21:38:14.355750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-43c63a59-7362-40dc-b8e7-865f99971b28 req-dcfc678c-2714-47bb-a77e-78083e4dbc99 service nova] Instance c3df5ff7-de71-4849-a0d0-00003135f363 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:38:14.369743 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-43c63a59-7362-40dc-b8e7-865f99971b28 req-dcfc678c-2714-47bb-a77e-78083e4dbc99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136066 Sep 10 21:38:14.370679 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3407/6685] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:38:14.474887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ec66e762-41df-4e1d-91ba-ce411acffd28 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:14.483604 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ec66e762-41df-4e1d-91ba-ce411acffd28 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1681 microversion: 2.1 time: 0.170722 Sep 10 21:38:14.484457 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3279/6686] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:14 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:15.510362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5de0e3cd-2173-4c65-91a8-6df095eeb867 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:15.510998 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5de0e3cd-2173-4c65-91a8-6df095eeb867 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:15.517181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5de0e3cd-2173-4c65-91a8-6df095eeb867 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:15.517676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5de0e3cd-2173-4c65-91a8-6df095eeb867 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:15.518164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5de0e3cd-2173-4c65-91a8-6df095eeb867 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:15.518861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5de0e3cd-2173-4c65-91a8-6df095eeb867 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:15.519323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5de0e3cd-2173-4c65-91a8-6df095eeb867 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:15.519754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5de0e3cd-2173-4c65-91a8-6df095eeb867 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:15.651177 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5de0e3cd-2173-4c65-91a8-6df095eeb867 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:15.658886 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5de0e3cd-2173-4c65-91a8-6df095eeb867 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1679 microversion: 2.1 time: 0.153738 Sep 10 21:38:15.659457 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3408/6687] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:15 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:38:16.395936 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-0704c112-c600-48e5-bd83-abd71cd90ffe req-6c40d9ba-391b-4d02-855b-feddbd0375cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3df5ff7-de71-4849-a0d0-00003135f363", "tag": "1c786c6f-1930-482d-b775-9e3f73c235a4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:16.406374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0704c112-c600-48e5-bd83-abd71cd90ffe req-6c40d9ba-391b-4d02-855b-feddbd0375cc service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:16.406851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0704c112-c600-48e5-bd83-abd71cd90ffe req-6c40d9ba-391b-4d02-855b-feddbd0375cc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:16.407284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-0704c112-c600-48e5-bd83-abd71cd90ffe req-6c40d9ba-391b-4d02-855b-feddbd0375cc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:16.419274 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-0704c112-c600-48e5-bd83-abd71cd90ffe req-6c40d9ba-391b-4d02-855b-feddbd0375cc service nova] Creating event network-changed:1c786c6f-1930-482d-b775-9e3f73c235a4 for instance c3df5ff7-de71-4849-a0d0-00003135f363 on nch2-master-1 Sep 10 21:38:16.424517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-0704c112-c600-48e5-bd83-abd71cd90ffe req-6c40d9ba-391b-4d02-855b-feddbd0375cc service nova] Instance c3df5ff7-de71-4849-a0d0-00003135f363 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:38:16.436156 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-0704c112-c600-48e5-bd83-abd71cd90ffe req-6c40d9ba-391b-4d02-855b-feddbd0375cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044240 Sep 10 21:38:16.436891 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3280/6688] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:38:16.684040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-833c006c-f38b-49cd-abfc-b50546c8e8e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:16.684657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-833c006c-f38b-49cd-abfc-b50546c8e8e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:16.694517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-833c006c-f38b-49cd-abfc-b50546c8e8e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:16.695043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-833c006c-f38b-49cd-abfc-b50546c8e8e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:16.695485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-833c006c-f38b-49cd-abfc-b50546c8e8e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:16.696203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-833c006c-f38b-49cd-abfc-b50546c8e8e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:16.696662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-833c006c-f38b-49cd-abfc-b50546c8e8e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:16.697136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-833c006c-f38b-49cd-abfc-b50546c8e8e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:16.949641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-833c006c-f38b-49cd-abfc-b50546c8e8e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:16.959030 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-833c006c-f38b-49cd-abfc-b50546c8e8e4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1679 microversion: 2.1 time: 0.278509 Sep 10 21:38:16.960175 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3409/6689] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:16 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1679 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:17.985696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-93f4c783-292b-44fb-8658-dabc8854739f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:17.986493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-93f4c783-292b-44fb-8658-dabc8854739f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:17.992768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93f4c783-292b-44fb-8658-dabc8854739f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:17.993260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93f4c783-292b-44fb-8658-dabc8854739f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:17.993695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93f4c783-292b-44fb-8658-dabc8854739f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:17.994430 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93f4c783-292b-44fb-8658-dabc8854739f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:17.994890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93f4c783-292b-44fb-8658-dabc8854739f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:17.995320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93f4c783-292b-44fb-8658-dabc8854739f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:18.128937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-93f4c783-292b-44fb-8658-dabc8854739f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:18.137715 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-93f4c783-292b-44fb-8658-dabc8854739f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1675 microversion: 2.1 time: 0.157472 Sep 10 21:38:18.138314 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3281/6690] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:17 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:18.161788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10d41765-0e1a-4bba-81cd-bf361a5c218a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:18.162515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10d41765-0e1a-4bba-81cd-bf361a5c218a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:18.169259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10d41765-0e1a-4bba-81cd-bf361a5c218a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:18.169753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10d41765-0e1a-4bba-81cd-bf361a5c218a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:18.170247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10d41765-0e1a-4bba-81cd-bf361a5c218a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:18.170958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10d41765-0e1a-4bba-81cd-bf361a5c218a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:18.171421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10d41765-0e1a-4bba-81cd-bf361a5c218a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:18.171855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10d41765-0e1a-4bba-81cd-bf361a5c218a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:18.229762 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10d41765-0e1a-4bba-81cd-bf361a5c218a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363/action" status: 204 len: 0 microversion: 2.1 time: 0.071625 Sep 10 21:38:18.230377 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3410/6691] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:38:18 2022] POST /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:38:18.238933 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9f3d8c7e-2637-464e-99e4-0e87c697e00c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:18.239549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9f3d8c7e-2637-464e-99e4-0e87c697e00c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:18.245620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3d8c7e-2637-464e-99e4-0e87c697e00c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:18.246143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3d8c7e-2637-464e-99e4-0e87c697e00c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:18.246589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3d8c7e-2637-464e-99e4-0e87c697e00c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:18.247325 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3d8c7e-2637-464e-99e4-0e87c697e00c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:18.247787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3d8c7e-2637-464e-99e4-0e87c697e00c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:18.248218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9f3d8c7e-2637-464e-99e4-0e87c697e00c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:18.464850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9f3d8c7e-2637-464e-99e4-0e87c697e00c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:18.472998 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9f3d8c7e-2637-464e-99e4-0e87c697e00c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1675 microversion: 2.1 time: 0.237933 Sep 10 21:38:18.473598 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3282/6692] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:18 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:19.498424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9ddecc5c-9aa2-4208-903d-6a61342e2ed7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:19.499914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9ddecc5c-9aa2-4208-903d-6a61342e2ed7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:19.506316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ddecc5c-9aa2-4208-903d-6a61342e2ed7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:19.506816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ddecc5c-9aa2-4208-903d-6a61342e2ed7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:19.507969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ddecc5c-9aa2-4208-903d-6a61342e2ed7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:19.508826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ddecc5c-9aa2-4208-903d-6a61342e2ed7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:19.509327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ddecc5c-9aa2-4208-903d-6a61342e2ed7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:19.509761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9ddecc5c-9aa2-4208-903d-6a61342e2ed7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:19.656350 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9ddecc5c-9aa2-4208-903d-6a61342e2ed7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:19.665444 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9ddecc5c-9aa2-4208-903d-6a61342e2ed7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1675 microversion: 2.1 time: 0.172241 Sep 10 21:38:19.676217 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3411/6693] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:19 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:19.752597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-95bb3db9-605f-4a9b-b204-fbe5558cc99f req-d7b7105f-0f75-4231-9663-7e81d8a3c1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3df5ff7-de71-4849-a0d0-00003135f363", "name": "network-vif-plugged", "status": "completed", "tag": "1c786c6f-1930-482d-b775-9e3f73c235a4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:19.762700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-95bb3db9-605f-4a9b-b204-fbe5558cc99f req-d7b7105f-0f75-4231-9663-7e81d8a3c1f4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:19.763181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-95bb3db9-605f-4a9b-b204-fbe5558cc99f req-d7b7105f-0f75-4231-9663-7e81d8a3c1f4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:19.763614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-95bb3db9-605f-4a9b-b204-fbe5558cc99f req-d7b7105f-0f75-4231-9663-7e81d8a3c1f4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:19.776048 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-95bb3db9-605f-4a9b-b204-fbe5558cc99f req-d7b7105f-0f75-4231-9663-7e81d8a3c1f4 service nova] Creating event network-vif-plugged:1c786c6f-1930-482d-b775-9e3f73c235a4 for instance c3df5ff7-de71-4849-a0d0-00003135f363 on nch2-master-1 Sep 10 21:38:19.780722 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-95bb3db9-605f-4a9b-b204-fbe5558cc99f req-d7b7105f-0f75-4231-9663-7e81d8a3c1f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129799 Sep 10 21:38:19.781317 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3283/6694] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:38:20.688600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a351ee52-7bc7-4fb8-b78b-07c3c31f0c40 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:20.689139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a351ee52-7bc7-4fb8-b78b-07c3c31f0c40 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:20.696753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a351ee52-7bc7-4fb8-b78b-07c3c31f0c40 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:20.697229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a351ee52-7bc7-4fb8-b78b-07c3c31f0c40 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:20.697669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a351ee52-7bc7-4fb8-b78b-07c3c31f0c40 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:20.698385 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a351ee52-7bc7-4fb8-b78b-07c3c31f0c40 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:20.698841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a351ee52-7bc7-4fb8-b78b-07c3c31f0c40 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:20.699266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a351ee52-7bc7-4fb8-b78b-07c3c31f0c40 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:20.837359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a351ee52-7bc7-4fb8-b78b-07c3c31f0c40 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:20.845120 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a351ee52-7bc7-4fb8-b78b-07c3c31f0c40 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1654 microversion: 2.1 time: 0.160521 Sep 10 21:38:20.845710 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3412/6695] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:20 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1654 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:20.870635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9fa30fad-3cd9-4f2b-b1c2-44ca1d70578b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:20.871334 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9fa30fad-3cd9-4f2b-b1c2-44ca1d70578b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:20.877568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fa30fad-3cd9-4f2b-b1c2-44ca1d70578b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:20.878103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fa30fad-3cd9-4f2b-b1c2-44ca1d70578b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:20.878541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fa30fad-3cd9-4f2b-b1c2-44ca1d70578b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:20.879233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fa30fad-3cd9-4f2b-b1c2-44ca1d70578b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:20.879687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fa30fad-3cd9-4f2b-b1c2-44ca1d70578b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:20.880111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9fa30fad-3cd9-4f2b-b1c2-44ca1d70578b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:21.012518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9fa30fad-3cd9-4f2b-b1c2-44ca1d70578b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:21.020340 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9fa30fad-3cd9-4f2b-b1c2-44ca1d70578b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1654 microversion: 2.1 time: 0.155494 Sep 10 21:38:21.020933 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3284/6696] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:20 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:21.044163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c4d22f4-4b2f-467b-bafe-dcd65b4fd18d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:21.050259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d22f4-4b2f-467b-bafe-dcd65b4fd18d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:21.050745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d22f4-4b2f-467b-bafe-dcd65b4fd18d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:21.051178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c4d22f4-4b2f-467b-bafe-dcd65b4fd18d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:21.074895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c4d22f4-4b2f-467b-bafe-dcd65b4fd18d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Going to try to start instance {{(pid=145772) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 21:38:21.079326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:38:21.125748 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c4d22f4-4b2f-467b-bafe-dcd65b4fd18d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363/action" status: 202 len: 0 microversion: 2.1 time: 0.085274 Sep 10 21:38:21.126394 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3413/6697] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:38:21 2022] POST /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:38:21.135393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9ca672a-fa75-4a9c-a75c-9767a595af1e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:21.136003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9ca672a-fa75-4a9c-a75c-9767a595af1e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:21.142393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ca672a-fa75-4a9c-a75c-9767a595af1e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:21.142875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ca672a-fa75-4a9c-a75c-9767a595af1e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:21.143314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ca672a-fa75-4a9c-a75c-9767a595af1e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:21.144107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ca672a-fa75-4a9c-a75c-9767a595af1e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:21.144971 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ca672a-fa75-4a9c-a75c-9767a595af1e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:21.145542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9ca672a-fa75-4a9c-a75c-9767a595af1e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:21.283576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a9ca672a-fa75-4a9c-a75c-9767a595af1e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:21.291549 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9ca672a-fa75-4a9c-a75c-9767a595af1e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1663 microversion: 2.1 time: 0.160824 Sep 10 21:38:21.292132 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3285/6698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:21 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:22.316881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-369c7d7a-4f77-4cc7-a4c4-bf6c0c9a00e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:22.317587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-369c7d7a-4f77-4cc7-a4c4-bf6c0c9a00e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:22.324542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369c7d7a-4f77-4cc7-a4c4-bf6c0c9a00e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:22.324970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369c7d7a-4f77-4cc7-a4c4-bf6c0c9a00e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:22.325409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369c7d7a-4f77-4cc7-a4c4-bf6c0c9a00e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:22.326146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369c7d7a-4f77-4cc7-a4c4-bf6c0c9a00e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:22.326605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369c7d7a-4f77-4cc7-a4c4-bf6c0c9a00e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:22.327035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-369c7d7a-4f77-4cc7-a4c4-bf6c0c9a00e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:22.458709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-369c7d7a-4f77-4cc7-a4c4-bf6c0c9a00e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:22.466653 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-369c7d7a-4f77-4cc7-a4c4-bf6c0c9a00e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1663 microversion: 2.1 time: 0.154893 Sep 10 21:38:22.467219 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3414/6699] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:22 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:23.492477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a80dd01f-c7ad-4ef7-ab23-556d0b0a47d4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:23.492996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a80dd01f-c7ad-4ef7-ab23-556d0b0a47d4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:23.499869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a80dd01f-c7ad-4ef7-ab23-556d0b0a47d4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:23.500351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a80dd01f-c7ad-4ef7-ab23-556d0b0a47d4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:23.500786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a80dd01f-c7ad-4ef7-ab23-556d0b0a47d4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:23.501484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a80dd01f-c7ad-4ef7-ab23-556d0b0a47d4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:23.501975 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a80dd01f-c7ad-4ef7-ab23-556d0b0a47d4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:23.502404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a80dd01f-c7ad-4ef7-ab23-556d0b0a47d4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:23.631360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a80dd01f-c7ad-4ef7-ab23-556d0b0a47d4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:23.639763 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a80dd01f-c7ad-4ef7-ab23-556d0b0a47d4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1667 microversion: 2.1 time: 0.151751 Sep 10 21:38:23.640349 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3286/6700] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:23 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:23.662412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-88a51cd6-b20a-44ee-b713-779c8f8bc1a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:23.662971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-88a51cd6-b20a-44ee-b713-779c8f8bc1a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:23.670182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88a51cd6-b20a-44ee-b713-779c8f8bc1a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:23.670666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88a51cd6-b20a-44ee-b713-779c8f8bc1a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:23.671138 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88a51cd6-b20a-44ee-b713-779c8f8bc1a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:23.671832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88a51cd6-b20a-44ee-b713-779c8f8bc1a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:23.672287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88a51cd6-b20a-44ee-b713-779c8f8bc1a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:23.672712 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-88a51cd6-b20a-44ee-b713-779c8f8bc1a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:23.698382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-88a51cd6-b20a-44ee-b713-779c8f8bc1a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:38:23.772369 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-88a51cd6-b20a-44ee-b713-779c8f8bc1a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 204 len: 0 microversion: 2.1 time: 0.113273 Sep 10 21:38:23.773110 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3415/6701] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:38:23 2022] DELETE /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:38:23.781643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca02f284-3f34-43ef-a0a9-b3406375efaa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:23.782286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ca02f284-3f34-43ef-a0a9-b3406375efaa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:23.788697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca02f284-3f34-43ef-a0a9-b3406375efaa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:23.789188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca02f284-3f34-43ef-a0a9-b3406375efaa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:23.789769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca02f284-3f34-43ef-a0a9-b3406375efaa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:23.790502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca02f284-3f34-43ef-a0a9-b3406375efaa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:23.790968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca02f284-3f34-43ef-a0a9-b3406375efaa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:23.791408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca02f284-3f34-43ef-a0a9-b3406375efaa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:23.795492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:38:23.925959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ca02f284-3f34-43ef-a0a9-b3406375efaa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:23.934390 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ca02f284-3f34-43ef-a0a9-b3406375efaa tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1673 microversion: 2.1 time: 0.156586 Sep 10 21:38:23.935006 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3287/6702] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:23 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:24.959469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a352845-d9b5-4be9-a2a4-944871bd9c62 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:24.960876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a352845-d9b5-4be9-a2a4-944871bd9c62 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:24.968456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a352845-d9b5-4be9-a2a4-944871bd9c62 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:24.968939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a352845-d9b5-4be9-a2a4-944871bd9c62 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:24.969374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a352845-d9b5-4be9-a2a4-944871bd9c62 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:24.970166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a352845-d9b5-4be9-a2a4-944871bd9c62 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:24.970624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a352845-d9b5-4be9-a2a4-944871bd9c62 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:24.971044 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a352845-d9b5-4be9-a2a4-944871bd9c62 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:25.101725 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7a352845-d9b5-4be9-a2a4-944871bd9c62 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:25.109754 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a352845-d9b5-4be9-a2a4-944871bd9c62 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1673 microversion: 2.1 time: 0.154759 Sep 10 21:38:25.110351 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3416/6703] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:24 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:26.074408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f29f6911-576e-4cb4-8faa-43ef36cf998e req-a8a447a9-f23d-4e15-ba80-fa9ee226cd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3df5ff7-de71-4849-a0d0-00003135f363", "name": "network-vif-deleted", "tag": "1c786c6f-1930-482d-b775-9e3f73c235a4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:26.086080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f29f6911-576e-4cb4-8faa-43ef36cf998e req-a8a447a9-f23d-4e15-ba80-fa9ee226cd07 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:26.086627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f29f6911-576e-4cb4-8faa-43ef36cf998e req-a8a447a9-f23d-4e15-ba80-fa9ee226cd07 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:26.087086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f29f6911-576e-4cb4-8faa-43ef36cf998e req-a8a447a9-f23d-4e15-ba80-fa9ee226cd07 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:26.099102 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f29f6911-576e-4cb4-8faa-43ef36cf998e req-a8a447a9-f23d-4e15-ba80-fa9ee226cd07 service nova] Creating event network-vif-deleted:1c786c6f-1930-482d-b775-9e3f73c235a4 for instance c3df5ff7-de71-4849-a0d0-00003135f363 on nch2-master-1 Sep 10 21:38:26.105498 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f29f6911-576e-4cb4-8faa-43ef36cf998e req-a8a447a9-f23d-4e15-ba80-fa9ee226cd07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034756 Sep 10 21:38:26.106296 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3288/6704] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:38:26.135538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ee4084af-9e5a-4228-993c-3466580b6f7b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:26.136878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ee4084af-9e5a-4228-993c-3466580b6f7b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:26.144935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4084af-9e5a-4228-993c-3466580b6f7b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:26.145920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4084af-9e5a-4228-993c-3466580b6f7b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:26.146535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4084af-9e5a-4228-993c-3466580b6f7b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:26.147421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4084af-9e5a-4228-993c-3466580b6f7b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:26.148470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4084af-9e5a-4228-993c-3466580b6f7b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:26.149488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ee4084af-9e5a-4228-993c-3466580b6f7b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:26.221047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ee4084af-9e5a-4228-993c-3466580b6f7b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:26.231928 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ee4084af-9e5a-4228-993c-3466580b6f7b tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 200 len: 1322 microversion: 2.1 time: 0.101365 Sep 10 21:38:26.232534 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3417/6705] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:26 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 1322 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:27.258366 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:27.259067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:27.265303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:27.265748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:27.266237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:27.266954 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:27.267392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:27.267817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:27.281848 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 HTTP/1.1 Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'c3df5ff7-de71-4849-a0d0-00003135f363'} Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:38:27.283448 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:38:27.288993 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:38:27.288993 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:38:27.288993 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:38:27.288993 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:38:27.288993 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:38:27.288993 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:38:27.288993 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:38:27.288993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:38:27.288993 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e50d246e-fcec-4aa2-a04b-ae375a54e27a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 404 len: 111 microversion: 2.1 time: 0.031966 Sep 10 21:38:27.288993 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3289/6706] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:27 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:38:27.302001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:27.302611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:27.309841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:27.310418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:27.310771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:27.311458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:27.311910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:27.312330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:27.325735 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 HTTP/1.1 Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c3df5ff7-de71-4849-a0d0-00003135f363'} Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:38:27.327367 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:38:27.332121 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:38:27.332121 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:38:27.332121 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:38:27.332121 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:38:27.332121 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:38:27.332121 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:38:27.332121 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:38:27.332121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:38:27.332121 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-582d6689-eaae-4f50-a5f1-30757ce007a1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 404 len: 111 microversion: 2.1 time: 0.030616 Sep 10 21:38:27.332121 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3418/6707] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:27 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:38:27.378309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1937476861", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "1cb3c97f-0c08-4804-b456-564eec6cad8b"}], "security_groups": [{"name": "tempest-securitygroup--309256126"}], "key_name": "tempest-keypair-955803444", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:27.483519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] validate_networks() for [('1cb3c97f-0c08-4804-b456-564eec6cad8b', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:38:27.904730 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:38:27.905158 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:38:27.905637 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:38:27.906082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:38:27.906499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:38:27.915880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:27.916359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:27.916799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:27.917523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:27.918019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:27.918445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:27.935669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for project e767567d02b24a5eb0a01b9ead34449f. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:38:27.941027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for user 5e00195042734152b7ab7a71fc7b9e3b and project e767567d02b24a5eb0a01b9ead34449f. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:38:27.953610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:38:27.955952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:38:28.003136 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7812393f-c820-4e70-ac99-a4b8a634b638 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.628621 Sep 10 21:38:28.004045 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3290/6708] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:38:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:38:28.015364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-62eb5368-06ce-451c-8e14-8a795a0bc649 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:28.015987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-62eb5368-06ce-451c-8e14-8a795a0bc649 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:28.071170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-62eb5368-06ce-451c-8e14-8a795a0bc649 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:28.078019 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-62eb5368-06ce-451c-8e14-8a795a0bc649 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1238 microversion: 2.1 time: 0.066431 Sep 10 21:38:28.078602 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3419/6709] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:28 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:29.104064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1385888-e954-4382-b0d2-7723c7afc0b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:29.105333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a1385888-e954-4382-b0d2-7723c7afc0b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:29.107542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:38:29.115610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1385888-e954-4382-b0d2-7723c7afc0b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:29.116540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1385888-e954-4382-b0d2-7723c7afc0b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:29.117058 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1385888-e954-4382-b0d2-7723c7afc0b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:29.118738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1385888-e954-4382-b0d2-7723c7afc0b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:29.119445 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1385888-e954-4382-b0d2-7723c7afc0b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:29.120212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1385888-e954-4382-b0d2-7723c7afc0b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:29.200957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a1385888-e954-4382-b0d2-7723c7afc0b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:29.208822 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a1385888-e954-4382-b0d2-7723c7afc0b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1308 microversion: 2.1 time: 0.110673 Sep 10 21:38:29.209400 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3291/6710] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:29 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:30.233162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d5b4f0b3-230d-4e92-a292-2d91b432aa4d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:30.234155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d5b4f0b3-230d-4e92-a292-2d91b432aa4d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:30.241173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:38:30.243621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5b4f0b3-230d-4e92-a292-2d91b432aa4d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:30.244420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5b4f0b3-230d-4e92-a292-2d91b432aa4d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:30.244982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5b4f0b3-230d-4e92-a292-2d91b432aa4d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:30.246370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5b4f0b3-230d-4e92-a292-2d91b432aa4d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:30.247180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5b4f0b3-230d-4e92-a292-2d91b432aa4d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:30.247791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5b4f0b3-230d-4e92-a292-2d91b432aa4d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:30.385525 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d5b4f0b3-230d-4e92-a292-2d91b432aa4d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:30.393330 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d5b4f0b3-230d-4e92-a292-2d91b432aa4d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1363 microversion: 2.1 time: 0.164069 Sep 10 21:38:30.394405 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3420/6711] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:30 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:30.509661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-6725cdaa-9cf9-4e29-8e85-72a9eb5ca5b7 req-24413587-a9a8-4068-a777-d9e9006e081f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189", "tag": "61e8259e-3246-4aa1-a438-a59c209f4df5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:30.521409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6725cdaa-9cf9-4e29-8e85-72a9eb5ca5b7 req-24413587-a9a8-4068-a777-d9e9006e081f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:30.522027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6725cdaa-9cf9-4e29-8e85-72a9eb5ca5b7 req-24413587-a9a8-4068-a777-d9e9006e081f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:30.522527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-6725cdaa-9cf9-4e29-8e85-72a9eb5ca5b7 req-24413587-a9a8-4068-a777-d9e9006e081f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:30.534695 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-6725cdaa-9cf9-4e29-8e85-72a9eb5ca5b7 req-24413587-a9a8-4068-a777-d9e9006e081f service nova] Creating event network-changed:61e8259e-3246-4aa1-a438-a59c209f4df5 for instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 on nch1-master-1 Sep 10 21:38:30.540391 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-6725cdaa-9cf9-4e29-8e85-72a9eb5ca5b7 req-24413587-a9a8-4068-a777-d9e9006e081f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034167 Sep 10 21:38:30.541063 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3292/6712] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:38:31.417576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9da24c3a-7329-45a4-8fe9-1e90c32f547f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:31.418233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9da24c3a-7329-45a4-8fe9-1e90c32f547f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:31.425132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9da24c3a-7329-45a4-8fe9-1e90c32f547f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:31.425618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9da24c3a-7329-45a4-8fe9-1e90c32f547f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:31.426102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9da24c3a-7329-45a4-8fe9-1e90c32f547f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:31.426801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9da24c3a-7329-45a4-8fe9-1e90c32f547f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:31.427269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9da24c3a-7329-45a4-8fe9-1e90c32f547f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:31.427699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9da24c3a-7329-45a4-8fe9-1e90c32f547f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:31.558336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9da24c3a-7329-45a4-8fe9-1e90c32f547f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:31.566354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9da24c3a-7329-45a4-8fe9-1e90c32f547f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1363 microversion: 2.1 time: 0.152599 Sep 10 21:38:31.566967 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3421/6713] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:31 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:32.591328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ad239d75-73b4-4f1a-82bb-e1bc5a46d8e1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:32.592030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ad239d75-73b4-4f1a-82bb-e1bc5a46d8e1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:32.598289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad239d75-73b4-4f1a-82bb-e1bc5a46d8e1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:32.598835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad239d75-73b4-4f1a-82bb-e1bc5a46d8e1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:32.599228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad239d75-73b4-4f1a-82bb-e1bc5a46d8e1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:32.599921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad239d75-73b4-4f1a-82bb-e1bc5a46d8e1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:32.600388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad239d75-73b4-4f1a-82bb-e1bc5a46d8e1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:32.600819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ad239d75-73b4-4f1a-82bb-e1bc5a46d8e1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:32.732493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ad239d75-73b4-4f1a-82bb-e1bc5a46d8e1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:32.740419 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ad239d75-73b4-4f1a-82bb-e1bc5a46d8e1 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1363 microversion: 2.1 time: 0.154359 Sep 10 21:38:32.741027 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3293/6714] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:32 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:33.765024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-16b6b75a-1a5b-419f-bbc8-2b91b0ea1d84 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:33.765635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-16b6b75a-1a5b-419f-bbc8-2b91b0ea1d84 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:33.772770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16b6b75a-1a5b-419f-bbc8-2b91b0ea1d84 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:33.773253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16b6b75a-1a5b-419f-bbc8-2b91b0ea1d84 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:33.773774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16b6b75a-1a5b-419f-bbc8-2b91b0ea1d84 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:33.774831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16b6b75a-1a5b-419f-bbc8-2b91b0ea1d84 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:33.775290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16b6b75a-1a5b-419f-bbc8-2b91b0ea1d84 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:33.775718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16b6b75a-1a5b-419f-bbc8-2b91b0ea1d84 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:33.907450 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-16b6b75a-1a5b-419f-bbc8-2b91b0ea1d84 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:33.916026 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-16b6b75a-1a5b-419f-bbc8-2b91b0ea1d84 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1363 microversion: 2.1 time: 0.154888 Sep 10 21:38:33.916590 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3422/6715] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:33 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:34.939862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-93a6d832-7d9f-4240-ada3-ee400963f2a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:34.940479 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-93a6d832-7d9f-4240-ada3-ee400963f2a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:34.948156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93a6d832-7d9f-4240-ada3-ee400963f2a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:34.948652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93a6d832-7d9f-4240-ada3-ee400963f2a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:34.949094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93a6d832-7d9f-4240-ada3-ee400963f2a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:34.949795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93a6d832-7d9f-4240-ada3-ee400963f2a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:34.950287 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93a6d832-7d9f-4240-ada3-ee400963f2a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:34.950726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-93a6d832-7d9f-4240-ada3-ee400963f2a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:35.079256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-93a6d832-7d9f-4240-ada3-ee400963f2a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:35.087357 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-93a6d832-7d9f-4240-ada3-ee400963f2a5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1363 microversion: 2.1 time: 0.151340 Sep 10 21:38:35.087938 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3294/6716] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:34 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:36.112337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-df0676f5-cab6-4521-87e9-3caa11f5aae7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:36.112943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-df0676f5-cab6-4521-87e9-3caa11f5aae7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:36.125363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df0676f5-cab6-4521-87e9-3caa11f5aae7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:36.128024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df0676f5-cab6-4521-87e9-3caa11f5aae7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:36.128462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df0676f5-cab6-4521-87e9-3caa11f5aae7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:36.129182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df0676f5-cab6-4521-87e9-3caa11f5aae7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:36.129630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df0676f5-cab6-4521-87e9-3caa11f5aae7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:36.130083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df0676f5-cab6-4521-87e9-3caa11f5aae7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:36.263839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df0676f5-cab6-4521-87e9-3caa11f5aae7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:36.271686 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-df0676f5-cab6-4521-87e9-3caa11f5aae7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1363 microversion: 2.1 time: 0.163466 Sep 10 21:38:36.272651 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3423/6717] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:36 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:37.295982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9c6d6441-57f2-4229-a48f-ee01e6d1297f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:37.296619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9c6d6441-57f2-4229-a48f-ee01e6d1297f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:37.303382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c6d6441-57f2-4229-a48f-ee01e6d1297f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:37.303869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c6d6441-57f2-4229-a48f-ee01e6d1297f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:37.304309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c6d6441-57f2-4229-a48f-ee01e6d1297f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:37.305646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c6d6441-57f2-4229-a48f-ee01e6d1297f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:37.306141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c6d6441-57f2-4229-a48f-ee01e6d1297f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:37.306573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9c6d6441-57f2-4229-a48f-ee01e6d1297f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:37.439972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9c6d6441-57f2-4229-a48f-ee01e6d1297f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:37.448082 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9c6d6441-57f2-4229-a48f-ee01e6d1297f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1363 microversion: 2.1 time: 0.156117 Sep 10 21:38:37.448660 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3295/6718] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:37 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:37.807738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-39acf3ad-b10f-4de9-ad1d-fe88552182b1 req-d97425bb-46a0-4e44-b7ed-10c642c932c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189", "name": "network-vif-plugged", "status": "completed", "tag": "61e8259e-3246-4aa1-a438-a59c209f4df5"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:37.818098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-39acf3ad-b10f-4de9-ad1d-fe88552182b1 req-d97425bb-46a0-4e44-b7ed-10c642c932c8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:37.818744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-39acf3ad-b10f-4de9-ad1d-fe88552182b1 req-d97425bb-46a0-4e44-b7ed-10c642c932c8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:37.819191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-39acf3ad-b10f-4de9-ad1d-fe88552182b1 req-d97425bb-46a0-4e44-b7ed-10c642c932c8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:37.830730 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-39acf3ad-b10f-4de9-ad1d-fe88552182b1 req-d97425bb-46a0-4e44-b7ed-10c642c932c8 service nova] Creating event network-vif-plugged:61e8259e-3246-4aa1-a438-a59c209f4df5 for instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 on nch1-master-1 Sep 10 21:38:37.835578 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-39acf3ad-b10f-4de9-ad1d-fe88552182b1 req-d97425bb-46a0-4e44-b7ed-10c642c932c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032024 Sep 10 21:38:37.836907 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3424/6719] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:38:38.472000 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6f97afc-9d72-41e5-8f53-76901f57f62e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:38.472620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6f97afc-9d72-41e5-8f53-76901f57f62e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:38.474754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:38:38.475473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:38:38.482350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6f97afc-9d72-41e5-8f53-76901f57f62e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:38.482843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6f97afc-9d72-41e5-8f53-76901f57f62e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:38.483284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6f97afc-9d72-41e5-8f53-76901f57f62e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:38.484250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6f97afc-9d72-41e5-8f53-76901f57f62e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:38.484711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6f97afc-9d72-41e5-8f53-76901f57f62e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:38.485141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6f97afc-9d72-41e5-8f53-76901f57f62e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:38.616486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c6f97afc-9d72-41e5-8f53-76901f57f62e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:38.624984 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6f97afc-9d72-41e5-8f53-76901f57f62e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1363 microversion: 2.1 time: 0.156884 Sep 10 21:38:38.625567 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3296/6720] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:38 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:38:39.646018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:38:39.651979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4c3845b9-332e-45b3-b9e8-aa92211f4535 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:39.652831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4c3845b9-332e-45b3-b9e8-aa92211f4535 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:39.659777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c3845b9-332e-45b3-b9e8-aa92211f4535 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:39.660263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c3845b9-332e-45b3-b9e8-aa92211f4535 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:39.660711 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c3845b9-332e-45b3-b9e8-aa92211f4535 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:39.661428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c3845b9-332e-45b3-b9e8-aa92211f4535 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:39.661901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c3845b9-332e-45b3-b9e8-aa92211f4535 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:39.662365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4c3845b9-332e-45b3-b9e8-aa92211f4535 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:39.806992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4c3845b9-332e-45b3-b9e8-aa92211f4535 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:38:39.814996 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4c3845b9-332e-45b3-b9e8-aa92211f4535 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1549 microversion: 2.1 time: 0.169974 Sep 10 21:38:39.815595 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3425/6721] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:38:39 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:38:39.839668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d9773ef7-ab98-4bed-81dc-796814a35da4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:38:39.840203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d9773ef7-ab98-4bed-81dc-796814a35da4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:38:39.851394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9773ef7-ab98-4bed-81dc-796814a35da4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:39.852517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9773ef7-ab98-4bed-81dc-796814a35da4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:39.852980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9773ef7-ab98-4bed-81dc-796814a35da4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:39.853688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9773ef7-ab98-4bed-81dc-796814a35da4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:39.854176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9773ef7-ab98-4bed-81dc-796814a35da4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:39.854606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d9773ef7-ab98-4bed-81dc-796814a35da4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:39.943635 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d9773ef7-ab98-4bed-81dc-796814a35da4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108558 Sep 10 21:38:39.944249 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3297/6722] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:38:39 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:38:41.161702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0352f703-b137-4720-aa39-acca7e828333 req-9fe5c7e3-2d72-4865-9a33-dafd229066a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189", "tag": "61e8259e-3246-4aa1-a438-a59c209f4df5"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:38:41.173440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0352f703-b137-4720-aa39-acca7e828333 req-9fe5c7e3-2d72-4865-9a33-dafd229066a8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:38:41.173940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0352f703-b137-4720-aa39-acca7e828333 req-9fe5c7e3-2d72-4865-9a33-dafd229066a8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:38:41.174369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0352f703-b137-4720-aa39-acca7e828333 req-9fe5c7e3-2d72-4865-9a33-dafd229066a8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:38:41.186665 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0352f703-b137-4720-aa39-acca7e828333 req-9fe5c7e3-2d72-4865-9a33-dafd229066a8 service nova] Creating event network-changed:61e8259e-3246-4aa1-a438-a59c209f4df5 for instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 on nch1-master-1 Sep 10 21:38:41.191766 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0352f703-b137-4720-aa39-acca7e828333 req-9fe5c7e3-2d72-4865-9a33-dafd229066a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033774 Sep 10 21:38:41.192386 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3426/6723] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:39:42.860658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=13 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:39:42.861443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=46 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:39:42.866937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:39:42.869766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:42.877255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:42.877749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:42.878216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:42.878913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:42.879377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:42.879805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:42.908425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:42.913775 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Old instance type m1.heat2, new instance type m1.heat {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:39:42.920868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:39:42.920984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:39:42.921517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:39:42.922006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:39:42.922498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:39:42.989283 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d8e29b4c-f78c-4c9e-874f-ec68d3517554 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189/action" status: 202 len: 0 microversion: 2.1 time: 0.131634 Sep 10 21:39:42.989939 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3298/6724] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:39:42 2022] POST /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:39:42.996990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=13 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:39:42.997737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:39:43.004565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2bafd6a2-eb1c-417d-bdb9-7e348284d56d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:43.005270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2bafd6a2-eb1c-417d-bdb9-7e348284d56d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:43.021862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bafd6a2-eb1c-417d-bdb9-7e348284d56d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:43.022395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bafd6a2-eb1c-417d-bdb9-7e348284d56d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:43.022842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bafd6a2-eb1c-417d-bdb9-7e348284d56d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:43.023568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bafd6a2-eb1c-417d-bdb9-7e348284d56d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:43.024030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bafd6a2-eb1c-417d-bdb9-7e348284d56d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:43.025059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2bafd6a2-eb1c-417d-bdb9-7e348284d56d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:43.189663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2bafd6a2-eb1c-417d-bdb9-7e348284d56d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:43.198443 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2bafd6a2-eb1c-417d-bdb9-7e348284d56d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1677 microversion: 2.1 time: 0.203341 Sep 10 21:39:43.199743 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3427/6725] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:42 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:44.223528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d4f1c748-eb99-4e10-a8d5-ed79a316a6b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:44.224268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4f1c748-eb99-4e10-a8d5-ed79a316a6b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:44.231973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4f1c748-eb99-4e10-a8d5-ed79a316a6b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:44.232466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4f1c748-eb99-4e10-a8d5-ed79a316a6b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:44.233406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4f1c748-eb99-4e10-a8d5-ed79a316a6b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:44.233605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4f1c748-eb99-4e10-a8d5-ed79a316a6b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:44.234098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4f1c748-eb99-4e10-a8d5-ed79a316a6b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:44.234791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4f1c748-eb99-4e10-a8d5-ed79a316a6b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:44.459687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d4f1c748-eb99-4e10-a8d5-ed79a316a6b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:44.468453 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d4f1c748-eb99-4e10-a8d5-ed79a316a6b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1677 microversion: 2.1 time: 0.249565 Sep 10 21:39:44.469129 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3299/6726] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:44 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:45.495070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ec00d73d-9356-47a7-8845-efc50cd94a53 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:45.495701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ec00d73d-9356-47a7-8845-efc50cd94a53 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:45.502620 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec00d73d-9356-47a7-8845-efc50cd94a53 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:45.503103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec00d73d-9356-47a7-8845-efc50cd94a53 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:45.503540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec00d73d-9356-47a7-8845-efc50cd94a53 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:45.504233 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec00d73d-9356-47a7-8845-efc50cd94a53 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:45.504724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec00d73d-9356-47a7-8845-efc50cd94a53 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:45.505154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ec00d73d-9356-47a7-8845-efc50cd94a53 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:45.634673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ec00d73d-9356-47a7-8845-efc50cd94a53 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:45.642433 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ec00d73d-9356-47a7-8845-efc50cd94a53 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1682 microversion: 2.1 time: 0.152074 Sep 10 21:39:45.643043 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3428/6727] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:45 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:46.667386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1b350eb1-6c74-4455-a0f5-90bd727b56ce tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:46.668026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1b350eb1-6c74-4455-a0f5-90bd727b56ce tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:46.674336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b350eb1-6c74-4455-a0f5-90bd727b56ce tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:46.674828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b350eb1-6c74-4455-a0f5-90bd727b56ce tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:46.675272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b350eb1-6c74-4455-a0f5-90bd727b56ce tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:46.675980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b350eb1-6c74-4455-a0f5-90bd727b56ce tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:46.676439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b350eb1-6c74-4455-a0f5-90bd727b56ce tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:46.676871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1b350eb1-6c74-4455-a0f5-90bd727b56ce tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:46.812108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1b350eb1-6c74-4455-a0f5-90bd727b56ce tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:46.819939 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1b350eb1-6c74-4455-a0f5-90bd727b56ce tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1682 microversion: 2.1 time: 0.157234 Sep 10 21:39:46.820525 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3300/6728] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:46 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:47.843661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f91eafb-4f73-43f1-b623-bfda263b660d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:47.844274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5f91eafb-4f73-43f1-b623-bfda263b660d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:47.850353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f91eafb-4f73-43f1-b623-bfda263b660d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:47.850841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f91eafb-4f73-43f1-b623-bfda263b660d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:47.851284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f91eafb-4f73-43f1-b623-bfda263b660d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:47.851977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f91eafb-4f73-43f1-b623-bfda263b660d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:47.852433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f91eafb-4f73-43f1-b623-bfda263b660d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:47.852862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f91eafb-4f73-43f1-b623-bfda263b660d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:47.987616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5f91eafb-4f73-43f1-b623-bfda263b660d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:47.996671 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f91eafb-4f73-43f1-b623-bfda263b660d tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1682 microversion: 2.1 time: 0.157345 Sep 10 21:39:47.997245 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3429/6729] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:47 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:49.020722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3e19b407-abe7-412a-b965-397ee891b7f5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:49.021338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3e19b407-abe7-412a-b965-397ee891b7f5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:49.028852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e19b407-abe7-412a-b965-397ee891b7f5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:49.029339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e19b407-abe7-412a-b965-397ee891b7f5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:49.029778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e19b407-abe7-412a-b965-397ee891b7f5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:49.030502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e19b407-abe7-412a-b965-397ee891b7f5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:49.030952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e19b407-abe7-412a-b965-397ee891b7f5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:49.031376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3e19b407-abe7-412a-b965-397ee891b7f5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:49.161393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3e19b407-abe7-412a-b965-397ee891b7f5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:49.169614 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3e19b407-abe7-412a-b965-397ee891b7f5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1682 microversion: 2.1 time: 0.152736 Sep 10 21:39:49.170225 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3301/6730] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:49 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:50.194213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-402eb0fb-c5fe-4f18-8a26-8ea9b8826ba5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:50.194823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-402eb0fb-c5fe-4f18-8a26-8ea9b8826ba5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:50.202503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-402eb0fb-c5fe-4f18-8a26-8ea9b8826ba5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:50.202984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-402eb0fb-c5fe-4f18-8a26-8ea9b8826ba5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:50.203417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-402eb0fb-c5fe-4f18-8a26-8ea9b8826ba5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:50.204101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-402eb0fb-c5fe-4f18-8a26-8ea9b8826ba5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:50.204553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-402eb0fb-c5fe-4f18-8a26-8ea9b8826ba5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:50.204976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-402eb0fb-c5fe-4f18-8a26-8ea9b8826ba5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:50.340103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-402eb0fb-c5fe-4f18-8a26-8ea9b8826ba5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:50.347896 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-402eb0fb-c5fe-4f18-8a26-8ea9b8826ba5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1682 microversion: 2.1 time: 0.157563 Sep 10 21:39:50.348474 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3430/6731] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:50 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:39:51.372593 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca1b7db1-f732-4caa-9749-f38ba1a6b8dc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:51.373201 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ca1b7db1-f732-4caa-9749-f38ba1a6b8dc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:51.380077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca1b7db1-f732-4caa-9749-f38ba1a6b8dc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:51.380556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca1b7db1-f732-4caa-9749-f38ba1a6b8dc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:51.380986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca1b7db1-f732-4caa-9749-f38ba1a6b8dc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:51.381670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca1b7db1-f732-4caa-9749-f38ba1a6b8dc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:51.382154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca1b7db1-f732-4caa-9749-f38ba1a6b8dc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:51.382581 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca1b7db1-f732-4caa-9749-f38ba1a6b8dc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:51.512709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ca1b7db1-f732-4caa-9749-f38ba1a6b8dc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:51.520540 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ca1b7db1-f732-4caa-9749-f38ba1a6b8dc tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1682 microversion: 2.1 time: 0.152574 Sep 10 21:39:51.521113 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3302/6732] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:51 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:52.544326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ecce1566-bc87-449f-8ff9-131b295a8fe2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:52.544947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ecce1566-bc87-449f-8ff9-131b295a8fe2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:52.552091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecce1566-bc87-449f-8ff9-131b295a8fe2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:52.552579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecce1566-bc87-449f-8ff9-131b295a8fe2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:52.553024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecce1566-bc87-449f-8ff9-131b295a8fe2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:52.553728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecce1566-bc87-449f-8ff9-131b295a8fe2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:52.554214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecce1566-bc87-449f-8ff9-131b295a8fe2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:52.554644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ecce1566-bc87-449f-8ff9-131b295a8fe2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:52.685556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ecce1566-bc87-449f-8ff9-131b295a8fe2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:52.693379 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ecce1566-bc87-449f-8ff9-131b295a8fe2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1682 microversion: 2.1 time: 0.153003 Sep 10 21:39:52.693990 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3431/6733] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:52 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:53.717289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-62bb7f35-e585-4654-bbc4-2da80fded5f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:53.717969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-62bb7f35-e585-4654-bbc4-2da80fded5f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:53.724832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62bb7f35-e585-4654-bbc4-2da80fded5f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:53.725321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62bb7f35-e585-4654-bbc4-2da80fded5f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:53.725762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62bb7f35-e585-4654-bbc4-2da80fded5f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:53.726489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62bb7f35-e585-4654-bbc4-2da80fded5f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:53.726973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62bb7f35-e585-4654-bbc4-2da80fded5f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:53.727401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-62bb7f35-e585-4654-bbc4-2da80fded5f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:53.859454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-62bb7f35-e585-4654-bbc4-2da80fded5f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:53.867169 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-62bb7f35-e585-4654-bbc4-2da80fded5f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1682 microversion: 2.1 time: 0.154586 Sep 10 21:39:53.867739 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3303/6734] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:53 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:54.891936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e9e7939-9160-4fb4-80bd-b9d58011d4f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:54.892553 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e9e7939-9160-4fb4-80bd-b9d58011d4f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:54.899532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9e7939-9160-4fb4-80bd-b9d58011d4f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:54.900019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9e7939-9160-4fb4-80bd-b9d58011d4f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:54.900487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9e7939-9160-4fb4-80bd-b9d58011d4f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:54.901212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9e7939-9160-4fb4-80bd-b9d58011d4f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:54.901669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9e7939-9160-4fb4-80bd-b9d58011d4f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:54.902128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e9e7939-9160-4fb4-80bd-b9d58011d4f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:55.306558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e9e7939-9160-4fb4-80bd-b9d58011d4f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:55.314479 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e9e7939-9160-4fb4-80bd-b9d58011d4f2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1682 microversion: 2.1 time: 0.426517 Sep 10 21:39:55.315044 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3432/6735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:54 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1682 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:56.339244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-792b0f96-9387-4e95-860a-00cd0fc485b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:56.339860 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-792b0f96-9387-4e95-860a-00cd0fc485b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:56.346756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792b0f96-9387-4e95-860a-00cd0fc485b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:56.347245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792b0f96-9387-4e95-860a-00cd0fc485b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:56.347693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792b0f96-9387-4e95-860a-00cd0fc485b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:56.348387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792b0f96-9387-4e95-860a-00cd0fc485b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:56.348848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792b0f96-9387-4e95-860a-00cd0fc485b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:56.349274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-792b0f96-9387-4e95-860a-00cd0fc485b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:56.477575 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-792b0f96-9387-4e95-860a-00cd0fc485b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:56.486883 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-792b0f96-9387-4e95-860a-00cd0fc485b4 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1682 microversion: 2.1 time: 0.152028 Sep 10 21:39:56.487470 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3304/6736] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:56 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:57.511475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dd778e3b-c887-4e4d-afec-05bb9b20a45a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:57.512086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dd778e3b-c887-4e4d-afec-05bb9b20a45a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:57.518956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd778e3b-c887-4e4d-afec-05bb9b20a45a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:57.519441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd778e3b-c887-4e4d-afec-05bb9b20a45a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:57.520667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd778e3b-c887-4e4d-afec-05bb9b20a45a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:57.521377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd778e3b-c887-4e4d-afec-05bb9b20a45a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:57.521847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd778e3b-c887-4e4d-afec-05bb9b20a45a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:57.522289 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dd778e3b-c887-4e4d-afec-05bb9b20a45a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:57.741666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dd778e3b-c887-4e4d-afec-05bb9b20a45a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:57.750199 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dd778e3b-c887-4e4d-afec-05bb9b20a45a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1681 microversion: 2.1 time: 0.242939 Sep 10 21:39:57.751086 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3433/6737] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:57 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:57.804353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d07c0e03-8161-4a1b-8994-89dfc41f68b4 req-c5c312db-2da8-4fe4-a6db-d29e824a92fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189", "name": "network-vif-unplugged", "status": "completed", "tag": "61e8259e-3246-4aa1-a438-a59c209f4df5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:39:57.815143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d07c0e03-8161-4a1b-8994-89dfc41f68b4 req-c5c312db-2da8-4fe4-a6db-d29e824a92fe service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:57.815913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d07c0e03-8161-4a1b-8994-89dfc41f68b4 req-c5c312db-2da8-4fe4-a6db-d29e824a92fe service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:57.816431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d07c0e03-8161-4a1b-8994-89dfc41f68b4 req-c5c312db-2da8-4fe4-a6db-d29e824a92fe service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:57.828987 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d07c0e03-8161-4a1b-8994-89dfc41f68b4 req-c5c312db-2da8-4fe4-a6db-d29e824a92fe service nova] Creating event network-vif-unplugged:61e8259e-3246-4aa1-a438-a59c209f4df5 for instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 on nch2-master-1 Sep 10 21:39:57.834854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-d07c0e03-8161-4a1b-8994-89dfc41f68b4 req-c5c312db-2da8-4fe4-a6db-d29e824a92fe service nova] Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:39:57.846577 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d07c0e03-8161-4a1b-8994-89dfc41f68b4 req-c5c312db-2da8-4fe4-a6db-d29e824a92fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045889 Sep 10 21:39:57.847192 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3305/6738] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:39:58.774938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dc906adc-11cb-4624-8324-34343c5265b2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:39:58.775657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dc906adc-11cb-4624-8324-34343c5265b2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:39:58.782883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc906adc-11cb-4624-8324-34343c5265b2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:58.783379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc906adc-11cb-4624-8324-34343c5265b2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:58.783818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc906adc-11cb-4624-8324-34343c5265b2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:58.784529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc906adc-11cb-4624-8324-34343c5265b2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:58.784987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc906adc-11cb-4624-8324-34343c5265b2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:58.785479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dc906adc-11cb-4624-8324-34343c5265b2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:59.178089 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dc906adc-11cb-4624-8324-34343c5265b2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:39:59.186797 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dc906adc-11cb-4624-8324-34343c5265b2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1681 microversion: 2.1 time: 0.415869 Sep 10 21:39:59.187592 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3434/6739] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:39:58 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1681 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:39:59.887380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-ac5c061e-952b-4b1b-9043-92acbb5aa93b req-b26bba6b-f765-40dc-8418-d9b8a5a1f7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189", "tag": "61e8259e-3246-4aa1-a438-a59c209f4df5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:39:59.896921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ac5c061e-952b-4b1b-9043-92acbb5aa93b req-b26bba6b-f765-40dc-8418-d9b8a5a1f7e9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:39:59.897395 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ac5c061e-952b-4b1b-9043-92acbb5aa93b req-b26bba6b-f765-40dc-8418-d9b8a5a1f7e9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:39:59.897851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ac5c061e-952b-4b1b-9043-92acbb5aa93b req-b26bba6b-f765-40dc-8418-d9b8a5a1f7e9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:39:59.909798 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-ac5c061e-952b-4b1b-9043-92acbb5aa93b req-b26bba6b-f765-40dc-8418-d9b8a5a1f7e9 service nova] Creating event network-changed:61e8259e-3246-4aa1-a438-a59c209f4df5 for instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 on nch2-master-1 Sep 10 21:39:59.914984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-ac5c061e-952b-4b1b-9043-92acbb5aa93b req-b26bba6b-f765-40dc-8418-d9b8a5a1f7e9 service nova] Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:39:59.925369 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-ac5c061e-952b-4b1b-9043-92acbb5aa93b req-b26bba6b-f765-40dc-8418-d9b8a5a1f7e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043629 Sep 10 21:39:59.925983 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3306/6740] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:40:00.210774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4e406753-3819-4a03-92c9-ec25f203277a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:00.211383 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4e406753-3819-4a03-92c9-ec25f203277a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:00.218634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e406753-3819-4a03-92c9-ec25f203277a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:00.219120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e406753-3819-4a03-92c9-ec25f203277a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:00.219554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e406753-3819-4a03-92c9-ec25f203277a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:00.220334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e406753-3819-4a03-92c9-ec25f203277a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:00.220959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e406753-3819-4a03-92c9-ec25f203277a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:00.221386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4e406753-3819-4a03-92c9-ec25f203277a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:00.358887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4e406753-3819-4a03-92c9-ec25f203277a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:00.368275 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4e406753-3819-4a03-92c9-ec25f203277a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1679 microversion: 2.1 time: 0.161387 Sep 10 21:40:00.369352 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3435/6741] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:00 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:01.396713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-795a7222-4e70-409f-9a5a-5e7606746c79 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:01.397410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-795a7222-4e70-409f-9a5a-5e7606746c79 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:01.403845 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-795a7222-4e70-409f-9a5a-5e7606746c79 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:01.404324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-795a7222-4e70-409f-9a5a-5e7606746c79 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:01.404758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-795a7222-4e70-409f-9a5a-5e7606746c79 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:01.405441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-795a7222-4e70-409f-9a5a-5e7606746c79 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:01.405921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-795a7222-4e70-409f-9a5a-5e7606746c79 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:01.406348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-795a7222-4e70-409f-9a5a-5e7606746c79 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:01.546091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-795a7222-4e70-409f-9a5a-5e7606746c79 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:01.553810 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-795a7222-4e70-409f-9a5a-5e7606746c79 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1676 microversion: 2.1 time: 0.162189 Sep 10 21:40:01.554416 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3307/6742] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:01 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:40:01.576920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:40:01.577463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:01.584373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:01.584858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:01.585295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:01.586032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:01.586489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:01.586916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:01.624915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:01.625397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:01.625849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:01.626589 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:01.627047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:01.627475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:01.647445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for project e767567d02b24a5eb0a01b9ead34449f. Resources: {'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:40:01.653220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for user 5e00195042734152b7ab7a71fc7b9e3b and project e767567d02b24a5eb0a01b9ead34449f. Resources: {'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:40:01.751103 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1df19386-042e-47a6-a8aa-7e753ba0b210 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189/action" status: 202 len: 0 microversion: 2.1 time: 0.178126 Sep 10 21:40:01.751717 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3436/6743] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:40:01 2022] POST /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:40:01.760001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f7136db8-f421-4aaa-8b07-5e868ca8b21e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:01.760623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f7136db8-f421-4aaa-8b07-5e868ca8b21e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:01.766934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7136db8-f421-4aaa-8b07-5e868ca8b21e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:01.767404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7136db8-f421-4aaa-8b07-5e868ca8b21e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:01.767858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7136db8-f421-4aaa-8b07-5e868ca8b21e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:01.768559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7136db8-f421-4aaa-8b07-5e868ca8b21e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:01.769094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7136db8-f421-4aaa-8b07-5e868ca8b21e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:01.769532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f7136db8-f421-4aaa-8b07-5e868ca8b21e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:01.902375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f7136db8-f421-4aaa-8b07-5e868ca8b21e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:01.911400 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f7136db8-f421-4aaa-8b07-5e868ca8b21e tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1675 microversion: 2.1 time: 0.155339 Sep 10 21:40:01.911989 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3308/6744] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:01 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:02.938550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5f170a18-a78f-429e-a8e7-ccee531c1d60 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:02.939256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5f170a18-a78f-429e-a8e7-ccee531c1d60 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:02.946321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f170a18-a78f-429e-a8e7-ccee531c1d60 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:02.946808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f170a18-a78f-429e-a8e7-ccee531c1d60 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:02.947250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f170a18-a78f-429e-a8e7-ccee531c1d60 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:02.947945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f170a18-a78f-429e-a8e7-ccee531c1d60 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:02.948437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f170a18-a78f-429e-a8e7-ccee531c1d60 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:02.948903 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5f170a18-a78f-429e-a8e7-ccee531c1d60 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:03.088944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5f170a18-a78f-429e-a8e7-ccee531c1d60 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:03.097025 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5f170a18-a78f-429e-a8e7-ccee531c1d60 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1675 microversion: 2.1 time: 0.164315 Sep 10 21:40:03.097602 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3437/6745] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:02 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:40:04.121247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e76e0cca-0a73-49ec-a437-6bc47e30128f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:04.121926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e76e0cca-0a73-49ec-a437-6bc47e30128f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:04.128977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e76e0cca-0a73-49ec-a437-6bc47e30128f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:04.129468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e76e0cca-0a73-49ec-a437-6bc47e30128f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:04.129945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e76e0cca-0a73-49ec-a437-6bc47e30128f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:04.130648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e76e0cca-0a73-49ec-a437-6bc47e30128f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:04.131122 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e76e0cca-0a73-49ec-a437-6bc47e30128f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:04.131535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e76e0cca-0a73-49ec-a437-6bc47e30128f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:04.262803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e76e0cca-0a73-49ec-a437-6bc47e30128f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:04.270907 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e76e0cca-0a73-49ec-a437-6bc47e30128f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1675 microversion: 2.1 time: 0.153649 Sep 10 21:40:04.271540 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3309/6746] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:04 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:05.297483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6189a25d-e342-4a69-b200-04afda911ee2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:05.298090 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6189a25d-e342-4a69-b200-04afda911ee2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:05.305506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6189a25d-e342-4a69-b200-04afda911ee2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:05.306039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6189a25d-e342-4a69-b200-04afda911ee2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:05.306492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6189a25d-e342-4a69-b200-04afda911ee2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:05.307213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6189a25d-e342-4a69-b200-04afda911ee2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:05.308342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6189a25d-e342-4a69-b200-04afda911ee2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:05.308936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6189a25d-e342-4a69-b200-04afda911ee2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:05.448381 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6189a25d-e342-4a69-b200-04afda911ee2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:05.456478 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6189a25d-e342-4a69-b200-04afda911ee2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1675 microversion: 2.1 time: 0.163395 Sep 10 21:40:05.457067 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3438/6747] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:05 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:05.753528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-f86c624f-02f5-4a14-b91d-ec5545ee16ce req-a19de246-7a7b-4fe0-8c46-9e458f619691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189", "tag": "61e8259e-3246-4aa1-a438-a59c209f4df5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:40:05.765794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f86c624f-02f5-4a14-b91d-ec5545ee16ce req-a19de246-7a7b-4fe0-8c46-9e458f619691 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:05.766384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f86c624f-02f5-4a14-b91d-ec5545ee16ce req-a19de246-7a7b-4fe0-8c46-9e458f619691 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:05.766813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-f86c624f-02f5-4a14-b91d-ec5545ee16ce req-a19de246-7a7b-4fe0-8c46-9e458f619691 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:05.779257 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-f86c624f-02f5-4a14-b91d-ec5545ee16ce req-a19de246-7a7b-4fe0-8c46-9e458f619691 service nova] Creating event network-changed:61e8259e-3246-4aa1-a438-a59c209f4df5 for instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 on nch1-master-1 Sep 10 21:40:05.784713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-f86c624f-02f5-4a14-b91d-ec5545ee16ce req-a19de246-7a7b-4fe0-8c46-9e458f619691 service nova] Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:40:05.796471 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-f86c624f-02f5-4a14-b91d-ec5545ee16ce req-a19de246-7a7b-4fe0-8c46-9e458f619691 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114932 Sep 10 21:40:05.797137 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3310/6748] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:40:06.480590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fd84d6be-85b6-4570-bc46-9daac142b65a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:06.481127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fd84d6be-85b6-4570-bc46-9daac142b65a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:06.488708 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd84d6be-85b6-4570-bc46-9daac142b65a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:06.489212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd84d6be-85b6-4570-bc46-9daac142b65a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:06.489662 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd84d6be-85b6-4570-bc46-9daac142b65a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:06.490433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd84d6be-85b6-4570-bc46-9daac142b65a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:06.490900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd84d6be-85b6-4570-bc46-9daac142b65a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:06.491331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd84d6be-85b6-4570-bc46-9daac142b65a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:06.620569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fd84d6be-85b6-4570-bc46-9daac142b65a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:06.628483 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fd84d6be-85b6-4570-bc46-9daac142b65a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1675 microversion: 2.1 time: 0.151926 Sep 10 21:40:06.629060 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3439/6749] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:06 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:07.653149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b3bd84f-275d-4321-9fc5-d2833a9ea5ee tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:07.653884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b3bd84f-275d-4321-9fc5-d2833a9ea5ee tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:07.660198 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3bd84f-275d-4321-9fc5-d2833a9ea5ee tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:07.660691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3bd84f-275d-4321-9fc5-d2833a9ea5ee tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:07.661138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3bd84f-275d-4321-9fc5-d2833a9ea5ee tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:07.661890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3bd84f-275d-4321-9fc5-d2833a9ea5ee tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:07.662353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3bd84f-275d-4321-9fc5-d2833a9ea5ee tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:07.662789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b3bd84f-275d-4321-9fc5-d2833a9ea5ee tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:07.793082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b3bd84f-275d-4321-9fc5-d2833a9ea5ee tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:07.800856 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6b3bd84f-275d-4321-9fc5-d2833a9ea5ee tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1675 microversion: 2.1 time: 0.152967 Sep 10 21:40:07.801469 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3311/6750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:07 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:08.824858 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2d860689-b826-42a6-a884-1e51b698fa37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:08.825471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2d860689-b826-42a6-a884-1e51b698fa37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:08.832564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d860689-b826-42a6-a884-1e51b698fa37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:08.833045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d860689-b826-42a6-a884-1e51b698fa37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:08.833475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d860689-b826-42a6-a884-1e51b698fa37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:08.834199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d860689-b826-42a6-a884-1e51b698fa37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:08.834653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d860689-b826-42a6-a884-1e51b698fa37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:08.835081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d860689-b826-42a6-a884-1e51b698fa37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:08.853308 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:40:08.975614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2d860689-b826-42a6-a884-1e51b698fa37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:08.984522 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2d860689-b826-42a6-a884-1e51b698fa37 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1675 microversion: 2.1 time: 0.163315 Sep 10 21:40:08.985104 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3440/6751] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:08 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:10.008327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5fdad33b-5724-4960-8117-e3fa0f133047 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:10.008940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5fdad33b-5724-4960-8117-e3fa0f133047 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:10.016186 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fdad33b-5724-4960-8117-e3fa0f133047 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:10.016663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fdad33b-5724-4960-8117-e3fa0f133047 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:10.017100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fdad33b-5724-4960-8117-e3fa0f133047 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:10.017783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fdad33b-5724-4960-8117-e3fa0f133047 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:10.018274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fdad33b-5724-4960-8117-e3fa0f133047 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:10.018697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5fdad33b-5724-4960-8117-e3fa0f133047 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:10.150938 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5fdad33b-5724-4960-8117-e3fa0f133047 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:10.159389 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5fdad33b-5724-4960-8117-e3fa0f133047 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1668 microversion: 2.1 time: 0.154963 Sep 10 21:40:10.159970 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3312/6752] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:10 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:10.183590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6c913126-436b-414e-93f8-f6fee4414a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:10.184208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6c913126-436b-414e-93f8-f6fee4414a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:10.191028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c913126-436b-414e-93f8-f6fee4414a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:10.191517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c913126-436b-414e-93f8-f6fee4414a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:10.191960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c913126-436b-414e-93f8-f6fee4414a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:10.192652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c913126-436b-414e-93f8-f6fee4414a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:10.193112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c913126-436b-414e-93f8-f6fee4414a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:10.193548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6c913126-436b-414e-93f8-f6fee4414a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:10.331335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6c913126-436b-414e-93f8-f6fee4414a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:10.339611 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6c913126-436b-414e-93f8-f6fee4414a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1668 microversion: 2.1 time: 0.159995 Sep 10 21:40:10.340183 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3441/6753] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:10 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:10.362998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cf27c991-181b-4d95-ab4c-4da51466c1f8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:10.363615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cf27c991-181b-4d95-ab4c-4da51466c1f8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:10.369700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf27c991-181b-4d95-ab4c-4da51466c1f8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:10.370799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf27c991-181b-4d95-ab4c-4da51466c1f8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:10.371240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf27c991-181b-4d95-ab4c-4da51466c1f8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:10.371947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf27c991-181b-4d95-ab4c-4da51466c1f8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:10.372407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf27c991-181b-4d95-ab4c-4da51466c1f8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:10.372835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf27c991-181b-4d95-ab4c-4da51466c1f8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:10.508920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cf27c991-181b-4d95-ab4c-4da51466c1f8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:10.517676 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cf27c991-181b-4d95-ab4c-4da51466c1f8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1668 microversion: 2.1 time: 0.159003 Sep 10 21:40:10.518309 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3313/6754] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:10 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:10.542835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4a2ccbbf-1035-46e1-ac97-22345d9ccbfe tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:10.543266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4a2ccbbf-1035-46e1-ac97-22345d9ccbfe tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:10.549578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a2ccbbf-1035-46e1-ac97-22345d9ccbfe tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:10.550110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a2ccbbf-1035-46e1-ac97-22345d9ccbfe tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:10.550555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a2ccbbf-1035-46e1-ac97-22345d9ccbfe tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:10.551279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a2ccbbf-1035-46e1-ac97-22345d9ccbfe tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:10.551736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a2ccbbf-1035-46e1-ac97-22345d9ccbfe tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:10.552161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4a2ccbbf-1035-46e1-ac97-22345d9ccbfe tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:10.576664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4a2ccbbf-1035-46e1-ac97-22345d9ccbfe tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:40:10.654255 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4a2ccbbf-1035-46e1-ac97-22345d9ccbfe tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 204 len: 0 microversion: 2.1 time: 0.115588 Sep 10 21:40:10.654802 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3442/6755] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:40:10 2022] DELETE /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:40:10.663077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f2f74261-be25-4ba8-8b22-68c66e3bbea2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:10.663800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f2f74261-be25-4ba8-8b22-68c66e3bbea2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:10.671136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2f74261-be25-4ba8-8b22-68c66e3bbea2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:10.671629 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2f74261-be25-4ba8-8b22-68c66e3bbea2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:10.672150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2f74261-be25-4ba8-8b22-68c66e3bbea2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:10.672851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2f74261-be25-4ba8-8b22-68c66e3bbea2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:10.673310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2f74261-be25-4ba8-8b22-68c66e3bbea2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:10.673742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f2f74261-be25-4ba8-8b22-68c66e3bbea2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:10.678077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:40:10.813206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f2f74261-be25-4ba8-8b22-68c66e3bbea2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:10.821130 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f2f74261-be25-4ba8-8b22-68c66e3bbea2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1674 microversion: 2.1 time: 0.161941 Sep 10 21:40:10.821710 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3314/6756] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:10 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:11.845215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-41787ccc-7758-4996-8fc2-bf5688946c02 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:11.845947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-41787ccc-7758-4996-8fc2-bf5688946c02 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:11.848714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:40:11.855076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41787ccc-7758-4996-8fc2-bf5688946c02 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:11.855567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41787ccc-7758-4996-8fc2-bf5688946c02 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:11.856007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41787ccc-7758-4996-8fc2-bf5688946c02 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:11.856736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41787ccc-7758-4996-8fc2-bf5688946c02 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:11.857193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41787ccc-7758-4996-8fc2-bf5688946c02 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:11.857622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-41787ccc-7758-4996-8fc2-bf5688946c02 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:11.992394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-41787ccc-7758-4996-8fc2-bf5688946c02 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:12.000929 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-41787ccc-7758-4996-8fc2-bf5688946c02 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1674 microversion: 2.1 time: 0.160012 Sep 10 21:40:12.001467 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3443/6757] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:11 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:12.387071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-5dea89a1-137c-4ee5-a67c-9dbd17e4c490 req-ff960b0d-90a7-4e9f-a9f7-68270d8985c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189", "name": "network-vif-plugged", "status": "completed", "tag": "61e8259e-3246-4aa1-a438-a59c209f4df5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:40:12.398188 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5dea89a1-137c-4ee5-a67c-9dbd17e4c490 req-ff960b0d-90a7-4e9f-a9f7-68270d8985c2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:12.398877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5dea89a1-137c-4ee5-a67c-9dbd17e4c490 req-ff960b0d-90a7-4e9f-a9f7-68270d8985c2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:12.399318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-5dea89a1-137c-4ee5-a67c-9dbd17e4c490 req-ff960b0d-90a7-4e9f-a9f7-68270d8985c2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:12.413975 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-5dea89a1-137c-4ee5-a67c-9dbd17e4c490 req-ff960b0d-90a7-4e9f-a9f7-68270d8985c2 service nova] Creating event network-vif-plugged:61e8259e-3246-4aa1-a438-a59c209f4df5 for instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 on nch1-master-1 Sep 10 21:40:12.420164 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-5dea89a1-137c-4ee5-a67c-9dbd17e4c490 req-ff960b0d-90a7-4e9f-a9f7-68270d8985c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Sep 10 21:40:12.421326 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3315/6758] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:40:13.025025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c1247db2-f91a-4430-9399-98ae174fe6e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:13.027302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c1247db2-f91a-4430-9399-98ae174fe6e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:13.030518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:40:13.036054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1247db2-f91a-4430-9399-98ae174fe6e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:13.036554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1247db2-f91a-4430-9399-98ae174fe6e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:13.037258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1247db2-f91a-4430-9399-98ae174fe6e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:13.038228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1247db2-f91a-4430-9399-98ae174fe6e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:13.038688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1247db2-f91a-4430-9399-98ae174fe6e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:13.039120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1247db2-f91a-4430-9399-98ae174fe6e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:13.122677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c1247db2-f91a-4430-9399-98ae174fe6e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:13.131099 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c1247db2-f91a-4430-9399-98ae174fe6e5 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 200 len: 1607 microversion: 2.1 time: 0.110315 Sep 10 21:40:13.131938 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3444/6759] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:13 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 1607 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:13.210278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-96c1851c-f075-40b3-a060-1cc335612917 req-72615fdd-5c3b-4fa6-b971-86334d615845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189", "name": "network-vif-deleted", "tag": "61e8259e-3246-4aa1-a438-a59c209f4df5"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:40:13.218081 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=41 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:40:13.224558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-96c1851c-f075-40b3-a060-1cc335612917 req-72615fdd-5c3b-4fa6-b971-86334d615845 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:13.225036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-96c1851c-f075-40b3-a060-1cc335612917 req-72615fdd-5c3b-4fa6-b971-86334d615845 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:13.225471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-96c1851c-f075-40b3-a060-1cc335612917 req-72615fdd-5c3b-4fa6-b971-86334d615845 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:13.239548 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-96c1851c-f075-40b3-a060-1cc335612917 req-72615fdd-5c3b-4fa6-b971-86334d615845 service nova] Creating event network-vif-deleted:61e8259e-3246-4aa1-a438-a59c209f4df5 for instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 on nch1-master-1 Sep 10 21:40:13.245701 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-96c1851c-f075-40b3-a060-1cc335612917 req-72615fdd-5c3b-4fa6-b971-86334d615845 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039481 Sep 10 21:40:13.247154 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3316/6760] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:40:14.156515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:14.157041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:14.163831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:14.164351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:14.164793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:14.165492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:14.165977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:14.166406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:14.181286 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 HTTP/1.1 Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189'} Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:40:14.183003 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:40:14.187498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:40:14.187498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:40:14.187498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:40:14.187498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:40:14.187498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:40:14.187498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:40:14.187498 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:40:14.187498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:40:14.187498 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10de0e3e-d715-4267-887d-61c19f3caceb tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 404 len: 111 microversion: 2.1 time: 0.032136 Sep 10 21:40:14.187498 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3445/6761] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:14 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:40:14.202930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:14.203810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:14.211748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:14.212238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:14.212674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:14.213375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:14.214580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:14.215273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:14.229221 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 HTTP/1.1 Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189'} Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:40:14.231573 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:40:14.242304 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:40:14.242304 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:40:14.242304 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:40:14.242304 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:40:14.242304 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:40:14.242304 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:40:14.242304 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:40:14.242304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:40:14.242304 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3acf6aa3-f97f-42f3-a87d-bfb7be085f36 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 404 len: 111 microversion: 2.1 time: 0.035436 Sep 10 21:40:14.242304 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3317/6762] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:14 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:40:14.284076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-586177861", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "1cb3c97f-0c08-4804-b456-564eec6cad8b"}], "security_groups": [{"name": "tempest-securitygroup--309256126"}], "key_name": "tempest-keypair-955803444", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:40:14.399689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] validate_networks() for [('1cb3c97f-0c08-4804-b456-564eec6cad8b', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:40:14.818724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:40:14.819148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:40:14.819622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:40:14.820031 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:40:14.820439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:40:14.829351 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:14.829849 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:14.830288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:14.831015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:14.831469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:14.831891 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:14.848378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for project e767567d02b24a5eb0a01b9ead34449f. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:40:14.853491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Getting quotas for user 5e00195042734152b7ab7a71fc7b9e3b and project e767567d02b24a5eb0a01b9ead34449f. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:40:14.867577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:40:14.870558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:40:14.914368 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [7d969640-c4e0-4355-a0f5-03bb24fa3ea2] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:40:15.922746 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [7d969640-c4e0-4355-a0f5-03bb24fa3ea2] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 39236. Sep 10 21:40:15.926708 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-96da0dca-c5e6-4f3e-968e-4bb30600c417 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.646544 Sep 10 21:40:15.927369 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3446/6763] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:40:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:40:15.939669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ee621038-4219-47ea-bed8-701438fc67b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:15.940288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ee621038-4219-47ea-bed8-701438fc67b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:15.996137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ee621038-4219-47ea-bed8-701438fc67b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:16.003903 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ee621038-4219-47ea-bed8-701438fc67b0 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1237 microversion: 2.1 time: 0.068957 Sep 10 21:40:16.004472 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3318/6764] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:15 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:17.030306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-473793dd-d907-4bb8-988f-d4b1d7e87835 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:17.031091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-473793dd-d907-4bb8-988f-d4b1d7e87835 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:17.037814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-473793dd-d907-4bb8-988f-d4b1d7e87835 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:17.038497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-473793dd-d907-4bb8-988f-d4b1d7e87835 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:17.039070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-473793dd-d907-4bb8-988f-d4b1d7e87835 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:17.039887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-473793dd-d907-4bb8-988f-d4b1d7e87835 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:17.040584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-473793dd-d907-4bb8-988f-d4b1d7e87835 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:17.041110 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-473793dd-d907-4bb8-988f-d4b1d7e87835 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:17.126587 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-473793dd-d907-4bb8-988f-d4b1d7e87835 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:17.136114 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-473793dd-d907-4bb8-988f-d4b1d7e87835 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1297 microversion: 2.1 time: 0.111307 Sep 10 21:40:17.136800 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3447/6765] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:17 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:18.161416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1e39525-3bc2-47f7-8c2d-b8a88b686403 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:18.162093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a1e39525-3bc2-47f7-8c2d-b8a88b686403 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:18.169618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1e39525-3bc2-47f7-8c2d-b8a88b686403 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:18.170211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1e39525-3bc2-47f7-8c2d-b8a88b686403 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:18.170663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1e39525-3bc2-47f7-8c2d-b8a88b686403 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:18.171478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1e39525-3bc2-47f7-8c2d-b8a88b686403 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:18.171925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1e39525-3bc2-47f7-8c2d-b8a88b686403 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:18.172359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1e39525-3bc2-47f7-8c2d-b8a88b686403 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:18.309939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a1e39525-3bc2-47f7-8c2d-b8a88b686403 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:18.317773 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a1e39525-3bc2-47f7-8c2d-b8a88b686403 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1362 microversion: 2.1 time: 0.160829 Sep 10 21:40:18.318390 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3319/6766] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:18 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:18.475001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-ae362251-8766-487a-b5d9-4c7adb72d28d req-d87a4917-eb16-4e24-826b-56e6d43bf89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a5fa10-4305-4c6a-b4c1-351c672a3e0a", "tag": "57ca3b2c-1920-425f-abb1-1410166e1cb4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:40:18.486694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ae362251-8766-487a-b5d9-4c7adb72d28d req-d87a4917-eb16-4e24-826b-56e6d43bf89d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:18.487900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ae362251-8766-487a-b5d9-4c7adb72d28d req-d87a4917-eb16-4e24-826b-56e6d43bf89d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:18.488419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-ae362251-8766-487a-b5d9-4c7adb72d28d req-d87a4917-eb16-4e24-826b-56e6d43bf89d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:18.500964 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-ae362251-8766-487a-b5d9-4c7adb72d28d req-d87a4917-eb16-4e24-826b-56e6d43bf89d service nova] Creating event network-changed:57ca3b2c-1920-425f-abb1-1410166e1cb4 for instance 24a5fa10-4305-4c6a-b4c1-351c672a3e0a on nch2-master-1 Sep 10 21:40:18.507095 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-ae362251-8766-487a-b5d9-4c7adb72d28d req-d87a4917-eb16-4e24-826b-56e6d43bf89d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037727 Sep 10 21:40:18.508919 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3448/6767] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:40:19.341793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0ddf88f-7f1c-4559-9925-4c28da083435 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:19.342426 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0ddf88f-7f1c-4559-9925-4c28da083435 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:19.349469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0ddf88f-7f1c-4559-9925-4c28da083435 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:19.350001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0ddf88f-7f1c-4559-9925-4c28da083435 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:19.350442 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0ddf88f-7f1c-4559-9925-4c28da083435 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:19.351162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0ddf88f-7f1c-4559-9925-4c28da083435 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:19.351618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0ddf88f-7f1c-4559-9925-4c28da083435 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:19.352047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0ddf88f-7f1c-4559-9925-4c28da083435 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:19.486147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c0ddf88f-7f1c-4559-9925-4c28da083435 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:19.493856 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0ddf88f-7f1c-4559-9925-4c28da083435 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1362 microversion: 2.1 time: 0.155946 Sep 10 21:40:19.494376 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3320/6768] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:19 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:20.523993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3f1e055a-faea-42ee-a2a2-2896cba907a7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:20.524898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3f1e055a-faea-42ee-a2a2-2896cba907a7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:20.533700 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f1e055a-faea-42ee-a2a2-2896cba907a7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:20.534622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f1e055a-faea-42ee-a2a2-2896cba907a7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:20.535178 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f1e055a-faea-42ee-a2a2-2896cba907a7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:20.536052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f1e055a-faea-42ee-a2a2-2896cba907a7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:20.536565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f1e055a-faea-42ee-a2a2-2896cba907a7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:20.537145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3f1e055a-faea-42ee-a2a2-2896cba907a7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:20.693960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3f1e055a-faea-42ee-a2a2-2896cba907a7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:20.701998 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3f1e055a-faea-42ee-a2a2-2896cba907a7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1362 microversion: 2.1 time: 0.185047 Sep 10 21:40:20.702584 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3449/6769] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:20 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:21.724831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-071ddd96-0c47-4a44-a18c-a454231b4a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:21.725429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-071ddd96-0c47-4a44-a18c-a454231b4a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:21.732984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071ddd96-0c47-4a44-a18c-a454231b4a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:21.733465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071ddd96-0c47-4a44-a18c-a454231b4a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:21.733926 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071ddd96-0c47-4a44-a18c-a454231b4a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:21.734867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071ddd96-0c47-4a44-a18c-a454231b4a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:21.735317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071ddd96-0c47-4a44-a18c-a454231b4a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:21.735744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-071ddd96-0c47-4a44-a18c-a454231b4a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:21.865564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-071ddd96-0c47-4a44-a18c-a454231b4a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:21.873547 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-071ddd96-0c47-4a44-a18c-a454231b4a1c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1362 microversion: 2.1 time: 0.152556 Sep 10 21:40:21.874162 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3321/6770] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:21 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:22.175718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-a8c1bd8d-a156-49e5-ae12-20902af93b04 req-d7465d05-6341-4a29-8602-d616b1687817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a5fa10-4305-4c6a-b4c1-351c672a3e0a", "name": "network-vif-plugged", "status": "completed", "tag": "57ca3b2c-1920-425f-abb1-1410166e1cb4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:40:22.186823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a8c1bd8d-a156-49e5-ae12-20902af93b04 req-d7465d05-6341-4a29-8602-d616b1687817 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:22.187323 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a8c1bd8d-a156-49e5-ae12-20902af93b04 req-d7465d05-6341-4a29-8602-d616b1687817 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:22.187761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-a8c1bd8d-a156-49e5-ae12-20902af93b04 req-d7465d05-6341-4a29-8602-d616b1687817 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:22.200347 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-a8c1bd8d-a156-49e5-ae12-20902af93b04 req-d7465d05-6341-4a29-8602-d616b1687817 service nova] Creating event network-vif-plugged:57ca3b2c-1920-425f-abb1-1410166e1cb4 for instance 24a5fa10-4305-4c6a-b4c1-351c672a3e0a on nch2-master-1 Sep 10 21:40:22.205257 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-a8c1bd8d-a156-49e5-ae12-20902af93b04 req-d7465d05-6341-4a29-8602-d616b1687817 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033422 Sep 10 21:40:22.205881 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3450/6771] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:40:22.946648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a502e78e-16da-4347-adf9-34599c6c1e2a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:22.947266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a502e78e-16da-4347-adf9-34599c6c1e2a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:22.953408 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a502e78e-16da-4347-adf9-34599c6c1e2a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:22.953973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a502e78e-16da-4347-adf9-34599c6c1e2a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:22.954412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a502e78e-16da-4347-adf9-34599c6c1e2a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:22.955104 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a502e78e-16da-4347-adf9-34599c6c1e2a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:22.955558 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a502e78e-16da-4347-adf9-34599c6c1e2a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:22.955986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a502e78e-16da-4347-adf9-34599c6c1e2a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:23.095670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a502e78e-16da-4347-adf9-34599c6c1e2a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:23.103464 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a502e78e-16da-4347-adf9-34599c6c1e2a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1362 microversion: 2.1 time: 0.210254 Sep 10 21:40:23.104599 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3322/6772] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:22 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:24.130154 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1b068229-823a-41dc-8209-c4aae1709fc2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:24.130866 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1b068229-823a-41dc-8209-c4aae1709fc2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:24.137913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b068229-823a-41dc-8209-c4aae1709fc2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:24.138409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b068229-823a-41dc-8209-c4aae1709fc2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:24.138853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b068229-823a-41dc-8209-c4aae1709fc2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:24.139554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b068229-823a-41dc-8209-c4aae1709fc2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:24.140020 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b068229-823a-41dc-8209-c4aae1709fc2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:24.140458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1b068229-823a-41dc-8209-c4aae1709fc2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:24.275557 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1b068229-823a-41dc-8209-c4aae1709fc2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:40:24.284157 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1b068229-823a-41dc-8209-c4aae1709fc2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1548 microversion: 2.1 time: 0.159214 Sep 10 21:40:24.284748 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3451/6773] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:40:24 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:40:24.308412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e9d0259f-4e6e-49d8-b3c0-85ffe029a9e2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:40:24.308942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e9d0259f-4e6e-49d8-b3c0-85ffe029a9e2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:40:24.315899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0259f-4e6e-49d8-b3c0-85ffe029a9e2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:24.316390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0259f-4e6e-49d8-b3c0-85ffe029a9e2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:24.316831 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0259f-4e6e-49d8-b3c0-85ffe029a9e2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:24.317527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0259f-4e6e-49d8-b3c0-85ffe029a9e2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:24.318037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0259f-4e6e-49d8-b3c0-85ffe029a9e2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:24.318450 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0259f-4e6e-49d8-b3c0-85ffe029a9e2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:24.400353 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e9d0259f-4e6e-49d8-b3c0-85ffe029a9e2 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095969 Sep 10 21:40:24.401525 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3323/6774] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Sep 10 21:40:24 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:40:25.329768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-1cc0e871-f946-4870-a3ab-03c5fd29b741 req-6d9c97b0-2e63-404a-a150-50a8ffa156b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a5fa10-4305-4c6a-b4c1-351c672a3e0a", "tag": "57ca3b2c-1920-425f-abb1-1410166e1cb4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:40:25.334785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:40:25.335536 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:40:25.342960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1cc0e871-f946-4870-a3ab-03c5fd29b741 req-6d9c97b0-2e63-404a-a150-50a8ffa156b8 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:40:25.343446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1cc0e871-f946-4870-a3ab-03c5fd29b741 req-6d9c97b0-2e63-404a-a150-50a8ffa156b8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:40:25.343887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1cc0e871-f946-4870-a3ab-03c5fd29b741 req-6d9c97b0-2e63-404a-a150-50a8ffa156b8 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:40:25.355581 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-1cc0e871-f946-4870-a3ab-03c5fd29b741 req-6d9c97b0-2e63-404a-a150-50a8ffa156b8 service nova] Creating event network-changed:57ca3b2c-1920-425f-abb1-1410166e1cb4 for instance 24a5fa10-4305-4c6a-b4c1-351c672a3e0a on nch2-master-1 Sep 10 21:40:25.361210 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-1cc0e871-f946-4870-a3ab-03c5fd29b741 req-6d9c97b0-2e63-404a-a150-50a8ffa156b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035158 Sep 10 21:40:25.362227 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3452/6775] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:41:04.694272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:04.695603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=17 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:04.696621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=38 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:04.700856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-da14c4f0-97d1-4273-97d0-5f38fabb6c7c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:04.701746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-da14c4f0-97d1-4273-97d0-5f38fabb6c7c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:04.709331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da14c4f0-97d1-4273-97d0-5f38fabb6c7c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:04.709818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da14c4f0-97d1-4273-97d0-5f38fabb6c7c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:04.710286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da14c4f0-97d1-4273-97d0-5f38fabb6c7c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:04.710981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da14c4f0-97d1-4273-97d0-5f38fabb6c7c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:04.711438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da14c4f0-97d1-4273-97d0-5f38fabb6c7c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:04.711865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-da14c4f0-97d1-4273-97d0-5f38fabb6c7c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:05.351137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-da14c4f0-97d1-4273-97d0-5f38fabb6c7c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:05.359886 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-da14c4f0-97d1-4273-97d0-5f38fabb6c7c tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1667 microversion: 2.1 time: 0.667329 Sep 10 21:41:05.360463 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3324/6776] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:04 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1667 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:05.514992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:05.515843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:05.520307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d91ee659-aa35-417e-bbdc-b59b25be148a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:05.520919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d91ee659-aa35-417e-bbdc-b59b25be148a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:05.529472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91ee659-aa35-417e-bbdc-b59b25be148a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:05.529995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91ee659-aa35-417e-bbdc-b59b25be148a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:05.530435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91ee659-aa35-417e-bbdc-b59b25be148a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:05.531125 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91ee659-aa35-417e-bbdc-b59b25be148a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:05.531577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91ee659-aa35-417e-bbdc-b59b25be148a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:05.532001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d91ee659-aa35-417e-bbdc-b59b25be148a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:05.558486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d91ee659-aa35-417e-bbdc-b59b25be148a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:41:05.631472 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d91ee659-aa35-417e-bbdc-b59b25be148a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 204 len: 0 microversion: 2.1 time: 0.118308 Sep 10 21:41:05.632088 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3453/6777] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:41:05 2022] DELETE /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:41:05.641024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3ceacdc1-894f-4bc4-913d-37738367c174 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:05.641754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3ceacdc1-894f-4bc4-913d-37738367c174 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:05.647719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ceacdc1-894f-4bc4-913d-37738367c174 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:05.648206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ceacdc1-894f-4bc4-913d-37738367c174 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:05.648640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ceacdc1-894f-4bc4-913d-37738367c174 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:05.649365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ceacdc1-894f-4bc4-913d-37738367c174 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:05.649851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ceacdc1-894f-4bc4-913d-37738367c174 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:05.650280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3ceacdc1-894f-4bc4-913d-37738367c174 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:05.780219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3ceacdc1-894f-4bc4-913d-37738367c174 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:05.788177 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3ceacdc1-894f-4bc4-913d-37738367c174 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1673 microversion: 2.1 time: 0.151322 Sep 10 21:41:05.788738 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3325/6778] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:05 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:06.811899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5ed39e63-8a22-474d-b573-e0366b601a87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:06.812598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5ed39e63-8a22-474d-b573-e0366b601a87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:06.819648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ed39e63-8a22-474d-b573-e0366b601a87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:06.820130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ed39e63-8a22-474d-b573-e0366b601a87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:06.820561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ed39e63-8a22-474d-b573-e0366b601a87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:06.821249 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ed39e63-8a22-474d-b573-e0366b601a87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:06.821702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ed39e63-8a22-474d-b573-e0366b601a87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:06.822151 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5ed39e63-8a22-474d-b573-e0366b601a87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:06.957273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5ed39e63-8a22-474d-b573-e0366b601a87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:06.965675 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5ed39e63-8a22-474d-b573-e0366b601a87 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1673 microversion: 2.1 time: 0.158241 Sep 10 21:41:06.966289 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3454/6779] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:06 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:07.914709 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-bf3fe23d-e260-44af-89ce-3b5a73411394 req-23c4d90c-1451-4059-adf9-7efe0c2c0f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a5fa10-4305-4c6a-b4c1-351c672a3e0a", "name": "network-vif-deleted", "tag": "57ca3b2c-1920-425f-abb1-1410166e1cb4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:07.926742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bf3fe23d-e260-44af-89ce-3b5a73411394 req-23c4d90c-1451-4059-adf9-7efe0c2c0f8b service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:07.927415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bf3fe23d-e260-44af-89ce-3b5a73411394 req-23c4d90c-1451-4059-adf9-7efe0c2c0f8b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:07.928092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bf3fe23d-e260-44af-89ce-3b5a73411394 req-23c4d90c-1451-4059-adf9-7efe0c2c0f8b service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:07.939178 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-bf3fe23d-e260-44af-89ce-3b5a73411394 req-23c4d90c-1451-4059-adf9-7efe0c2c0f8b service nova] Creating event network-vif-deleted:57ca3b2c-1920-425f-abb1-1410166e1cb4 for instance 24a5fa10-4305-4c6a-b4c1-351c672a3e0a on nch2-master-1 Sep 10 21:41:07.944735 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-bf3fe23d-e260-44af-89ce-3b5a73411394 req-23c4d90c-1451-4059-adf9-7efe0c2c0f8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033668 Sep 10 21:41:07.945738 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3326/6780] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:41:07.990248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:07.992337 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:08.002228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:08.004737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:08.005709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:08.006733 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:08.007597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:08.008966 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:08.051704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:08.052196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:08.052829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:08.053291 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lazy-loading 'fault' on Instance uuid 24a5fa10-4305-4c6a-b4c1-351c672a3e0a {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:41:08.108646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e00195042734152b7ab7a71fc7b9e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e767567d02b24a5eb0a01b9ead34449f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:08.117219 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5a91aedb-000b-4964-957d-f01cb384f442 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 200 len: 1327 microversion: 2.1 time: 0.131602 Sep 10 21:41:08.118219 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3455/6781] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:07 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 1327 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:09.142216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:09.142932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 24a5fa10-4305-4c6a-b4c1-351c672a3e0a] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:09.149311 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.149809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.150286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.151616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.152086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.152556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.165802 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance 24a5fa10-4305-4c6a-b4c1-351c672a3e0a could not be found. Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a HTTP/1.1 Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 24a5fa10-4305-4c6a-b4c1-351c672a3e0a could not be found. Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '24a5fa10-4305-4c6a-b4c1-351c672a3e0a'} Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a5fa10-4305-4c6a-b4c1-351c672a3e0a could not be found. Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a5fa10-4305-4c6a-b4c1-351c672a3e0a could not be found. Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.168106 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.172743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.172743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.172743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.172743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:09.172743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:09.172743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a5fa10-4305-4c6a-b4c1-351c672a3e0a could not be found. Sep 10 21:41:09.172743 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.172743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance 24a5fa10-4305-4c6a-b4c1-351c672a3e0a could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:09.172743 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a906a818-cabb-4ede-affb-4867e0592bb7 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a" status: 404 len: 111 microversion: 2.1 time: 0.032439 Sep 10 21:41:09.172743 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3327/6782] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:09 2022] GET /compute/v2.1/servers/24a5fa10-4305-4c6a-b4c1-351c672a3e0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:41:09.179139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:09.179825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:09.187030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.187514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.188246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.188946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.189402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.189881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.203505 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 HTTP/1.1 Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189'} Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:09.205167 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1df6c493-1098-4826-aa77-ad4b46df8fd8 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 404 len: 111 microversion: 2.1 time: 0.032129 Sep 10 21:41:09.209764 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3456/6783] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:41:09 2022] DELETE /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:41:09.215689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:09.216304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:09.222418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.222899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.223331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.224351 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.224809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.225234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.239298 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 HTTP/1.1 Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189'} Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.241070 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.245168 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.245168 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.245168 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.245168 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:09.245168 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:09.245168 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. Sep 10 21:41:09.245168 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.245168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance 0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:09.245168 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-88b83583-9b2c-494e-b0c6-2336f4d465ff tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189" status: 404 len: 111 microversion: 2.1 time: 0.031226 Sep 10 21:41:09.245168 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3328/6784] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:09 2022] GET /compute/v2.1/servers/0cb8b6c2-2177-40d1-aa47-6ef5b4c6d189 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:41:09.251081 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:09.251579 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:09.257552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.258070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.258510 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.259201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.259653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.260075 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.273300 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 HTTP/1.1 Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c3df5ff7-de71-4849-a0d0-00003135f363'} Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:09.274856 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2192fcee-1b27-45b6-9786-55a4b8816629 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 404 len: 111 microversion: 2.1 time: 0.029019 Sep 10 21:41:09.280146 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3457/6785] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:41:09 2022] DELETE /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:41:09.285884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:09.286507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: c3df5ff7-de71-4849-a0d0-00003135f363] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:09.293463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.293998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.294446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.295151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.295616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.296051 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.309592 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 HTTP/1.1 Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'c3df5ff7-de71-4849-a0d0-00003135f363'} Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.311138 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.316511 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.316511 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.316511 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.316511 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:09.316511 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:09.316511 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. Sep 10 21:41:09.316511 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.316511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance c3df5ff7-de71-4849-a0d0-00003135f363 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:09.316511 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-73834298-025e-40d9-b2ce-d873d2efbf5f tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363" status: 404 len: 111 microversion: 2.1 time: 0.030555 Sep 10 21:41:09.316511 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3329/6786] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:09 2022] GET /compute/v2.1/servers/c3df5ff7-de71-4849-a0d0-00003135f363 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:41:09.321074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:09.321573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:09.327798 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.328279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.328826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.329773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.330610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.331378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.347727 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 HTTP/1.1 Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'a7c54fd1-9552-4f3e-89d4-14273e79bd57'} Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:09.349278 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-44ab1594-60e0-4a31-a44d-ea03ab3cd3f9 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 404 len: 111 microversion: 2.1 time: 0.033532 Sep 10 21:41:09.353622 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3458/6787] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:41:09 2022] DELETE /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:41:09.360384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:09.361001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [instance: a7c54fd1-9552-4f3e-89d4-14273e79bd57] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:09.367017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.367539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.367978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.368665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:09.369120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:09.369547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:09.382702 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] HTTP exception thrown: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Request method failure captured: Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 HTTP/1.1 Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQMa2hYzxyghgn0IpkDaioRq6aBOzeiSdOYtB_Irb4zigKi_xkdDP-liu2xVp0s1no1zVcmljMwbjnYfd4ST8eyJyeFaMa8o4xwuN9derhOTBfu_OgLqTQwvn-DXzNJ9E9Li6Tx1UBgOvtKcw6xTCtWq29ou1-EGWwb_FS0aTx_2gdc Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e767567d02b24a5eb0a01b9ead34449f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e767567d02b24a5eb0a01b9ead34449f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e767567d02b24a5eb0a01b9ead34449f"}]}] Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: e767567d02b24a5eb0a01b9ead34449f Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServerActionsTestJSON-1674567907 Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 5e00195042734152b7ab7a71fc7b9e3b Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServerActionsTestJSON-1674567907-project Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'a7c54fd1-9552-4f3e-89d4-14273e79bd57'} Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:09.384199 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.390439 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:09.390439 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:09.390439 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:09.390439 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:09.390439 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:09.390439 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. Sep 10 21:41:09.390439 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:09.390439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Returning 404 to user: Instance a7c54fd1-9552-4f3e-89d4-14273e79bd57 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:09.390439 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-278b41a9-8297-4e5e-a89c-0a98cc4c8a4a tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57" status: 404 len: 111 microversion: 2.1 time: 0.029386 Sep 10 21:41:09.390439 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3330/6788] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:09 2022] GET /compute/v2.1/servers/a7c54fd1-9552-4f3e-89d4-14273e79bd57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 21:41:09.396347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e5924a48-a8d2-49c2-b5af-594bec907ea3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] Calling method '.version_select at 0x7f993f71cc10>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:09.400660 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5924a48-a8d2-49c2-b5af-594bec907ea3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [80ac8596-1959-43fe-97fe-8b193e3e5de9] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:41:10.408053 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5924a48-a8d2-49c2-b5af-594bec907ea3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] [80ac8596-1959-43fe-97fe-8b193e3e5de9] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 39328. Sep 10 21:41:10.431800 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e5924a48-a8d2-49c2-b5af-594bec907ea3 tempest-ServerActionsTestJSON-1674567907 tempest-ServerActionsTestJSON-1674567907-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955803444" status: 202 len: 0 microversion: 2.1 time: 1.039387 Sep 10 21:41:10.432570 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3459/6789] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Sep 10 21:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955803444 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:41:19.786772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=14 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:19.787977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=22 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:19.934027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-456357981", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "9f132050-b38c-4956-9c1c-a693f1ba42a9"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:20.148787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] validate_networks() for [('9f132050-b38c-4956-9c1c-a693f1ba42a9', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:41:20.528820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:41:20.529247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:41:20.529729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:41:20.530169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:41:20.530597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:41:20.540391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:20.540887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:20.542150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:20.542897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:20.543361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:20.543794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:20.560777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Getting quotas for project 9d69ccced5e14a43b40de853fcae7ae3. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:41:20.566151 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Getting quotas for user 58891ebd588c439a8c02f7e26ac4b6ee and project 9d69ccced5e14a43b40de853fcae7ae3. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:41:20.578913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:41:20.581293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:41:20.630265 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-04f9408a-ff1f-43a3-b7b6-e6e2d67190ad tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848518 Sep 10 21:41:20.631168 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3331/6790] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:41:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:41:20.643770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:20.644606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:20.648716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-416c53aa-42d7-48f9-a1b1-d1a76b9b3466 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:20.649576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-416c53aa-42d7-48f9-a1b1-d1a76b9b3466 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:20.779390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-416c53aa-42d7-48f9-a1b1-d1a76b9b3466 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:20.786917 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-416c53aa-42d7-48f9-a1b1-d1a76b9b3466 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1216 microversion: 2.1 time: 0.145862 Sep 10 21:41:20.798771 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3460/6791] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:20 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:21.814841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c5c7e4ba-38d3-41f1-b8c0-adabe71ae19c tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:21.816490 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c5c7e4ba-38d3-41f1-b8c0-adabe71ae19c tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:21.825082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5c7e4ba-38d3-41f1-b8c0-adabe71ae19c tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:21.826258 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5c7e4ba-38d3-41f1-b8c0-adabe71ae19c tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:21.826834 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5c7e4ba-38d3-41f1-b8c0-adabe71ae19c tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:21.828846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5c7e4ba-38d3-41f1-b8c0-adabe71ae19c tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:21.829421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5c7e4ba-38d3-41f1-b8c0-adabe71ae19c tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:21.829998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c5c7e4ba-38d3-41f1-b8c0-adabe71ae19c tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:21.896787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c5c7e4ba-38d3-41f1-b8c0-adabe71ae19c tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:21.906640 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c5c7e4ba-38d3-41f1-b8c0-adabe71ae19c tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1268 microversion: 2.1 time: 0.099553 Sep 10 21:41:21.922033 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3332/6792] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:21 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1268 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:22.931456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6aa03655-9bce-4498-95e5-cf6817725eba tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:22.934088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6aa03655-9bce-4498-95e5-cf6817725eba tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:22.942739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6aa03655-9bce-4498-95e5-cf6817725eba tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:22.943258 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6aa03655-9bce-4498-95e5-cf6817725eba tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:22.943699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6aa03655-9bce-4498-95e5-cf6817725eba tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:22.944404 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6aa03655-9bce-4498-95e5-cf6817725eba tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:22.944854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6aa03655-9bce-4498-95e5-cf6817725eba tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:22.950588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6aa03655-9bce-4498-95e5-cf6817725eba tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:23.212752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6aa03655-9bce-4498-95e5-cf6817725eba tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:23.223020 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6aa03655-9bce-4498-95e5-cf6817725eba tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1316 microversion: 2.1 time: 0.295762 Sep 10 21:41:23.223985 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3461/6793] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:22 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:23.551478 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-141c68f9-fb53-4e50-bd64-f408d1ecd089 req-c7ed6d88-74f6-4bc4-8858-4bcfd4f8071d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bbe155c-5bf1-4e63-a26e-9f6275dfeef4", "tag": "bb89e905-13ad-4d1f-828b-212bf551b4a9"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:23.558800 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 21:41:23.559170 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 21:41:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 10 21:41:23.573590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-141c68f9-fb53-4e50-bd64-f408d1ecd089 req-c7ed6d88-74f6-4bc4-8858-4bcfd4f8071d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:23.574405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-141c68f9-fb53-4e50-bd64-f408d1ecd089 req-c7ed6d88-74f6-4bc4-8858-4bcfd4f8071d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:23.575015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-141c68f9-fb53-4e50-bd64-f408d1ecd089 req-c7ed6d88-74f6-4bc4-8858-4bcfd4f8071d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:23.586675 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-141c68f9-fb53-4e50-bd64-f408d1ecd089 req-c7ed6d88-74f6-4bc4-8858-4bcfd4f8071d service nova] Creating event network-changed:bb89e905-13ad-4d1f-828b-212bf551b4a9 for instance 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 on nch2-master-1 Sep 10 21:41:23.604075 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-141c68f9-fb53-4e50-bd64-f408d1ecd089 req-c7ed6d88-74f6-4bc4-8858-4bcfd4f8071d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055776 Sep 10 21:41:23.605310 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3333/6794] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:41:24.247644 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-00632fc5-c3bf-4f03-b109-abb54a2df19d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:24.248164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-00632fc5-c3bf-4f03-b109-abb54a2df19d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:24.255045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00632fc5-c3bf-4f03-b109-abb54a2df19d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:24.255537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00632fc5-c3bf-4f03-b109-abb54a2df19d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:24.255980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00632fc5-c3bf-4f03-b109-abb54a2df19d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:24.256685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00632fc5-c3bf-4f03-b109-abb54a2df19d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:24.257168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00632fc5-c3bf-4f03-b109-abb54a2df19d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:24.257608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-00632fc5-c3bf-4f03-b109-abb54a2df19d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:24.389937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-00632fc5-c3bf-4f03-b109-abb54a2df19d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:24.397804 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-00632fc5-c3bf-4f03-b109-abb54a2df19d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1316 microversion: 2.1 time: 0.154758 Sep 10 21:41:24.398404 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3462/6795] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:24 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:25.423505 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-922b9115-fc02-4db3-9cf6-7e782aee06b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:25.424120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-922b9115-fc02-4db3-9cf6-7e782aee06b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:25.430521 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-922b9115-fc02-4db3-9cf6-7e782aee06b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:25.431014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-922b9115-fc02-4db3-9cf6-7e782aee06b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:25.431456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-922b9115-fc02-4db3-9cf6-7e782aee06b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:25.432797 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-922b9115-fc02-4db3-9cf6-7e782aee06b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:25.433298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-922b9115-fc02-4db3-9cf6-7e782aee06b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:25.433690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-922b9115-fc02-4db3-9cf6-7e782aee06b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:25.570400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-922b9115-fc02-4db3-9cf6-7e782aee06b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:25.578362 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-922b9115-fc02-4db3-9cf6-7e782aee06b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1316 microversion: 2.1 time: 0.160027 Sep 10 21:41:25.578932 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3334/6796] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:25 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:26.602234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-819e808d-bf6b-4afb-b835-f2f8c74b9d03 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:26.602779 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-819e808d-bf6b-4afb-b835-f2f8c74b9d03 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:26.610563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-819e808d-bf6b-4afb-b835-f2f8c74b9d03 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:26.611048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-819e808d-bf6b-4afb-b835-f2f8c74b9d03 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:26.611486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-819e808d-bf6b-4afb-b835-f2f8c74b9d03 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:26.612215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-819e808d-bf6b-4afb-b835-f2f8c74b9d03 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:26.612673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-819e808d-bf6b-4afb-b835-f2f8c74b9d03 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:26.613102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-819e808d-bf6b-4afb-b835-f2f8c74b9d03 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:26.743882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-819e808d-bf6b-4afb-b835-f2f8c74b9d03 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:26.752247 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-819e808d-bf6b-4afb-b835-f2f8c74b9d03 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1316 microversion: 2.1 time: 0.154193 Sep 10 21:41:26.752828 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3463/6797] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:26 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:27.775148 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4c93e54b-25a5-4943-8e10-134eea16d149 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:27.776052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4c93e54b-25a5-4943-8e10-134eea16d149 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:27.782904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c93e54b-25a5-4943-8e10-134eea16d149 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:27.783420 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c93e54b-25a5-4943-8e10-134eea16d149 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:27.783859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c93e54b-25a5-4943-8e10-134eea16d149 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:27.784557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c93e54b-25a5-4943-8e10-134eea16d149 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:27.785014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c93e54b-25a5-4943-8e10-134eea16d149 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:27.785443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4c93e54b-25a5-4943-8e10-134eea16d149 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:27.914234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4c93e54b-25a5-4943-8e10-134eea16d149 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:27.922531 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4c93e54b-25a5-4943-8e10-134eea16d149 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1316 microversion: 2.1 time: 0.151344 Sep 10 21:41:27.923096 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3335/6798] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:27 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:28.488915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-82458531-8e82-47bc-a767-62c8720cc305 req-0e548770-4074-41b9-8207-e202a52dd1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbe155c-5bf1-4e63-a26e-9f6275dfeef4", "name": "network-vif-plugged", "status": "completed", "tag": "bb89e905-13ad-4d1f-828b-212bf551b4a9"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:28.500854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-82458531-8e82-47bc-a767-62c8720cc305 req-0e548770-4074-41b9-8207-e202a52dd1d7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:28.501474 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-82458531-8e82-47bc-a767-62c8720cc305 req-0e548770-4074-41b9-8207-e202a52dd1d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:28.501944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-82458531-8e82-47bc-a767-62c8720cc305 req-0e548770-4074-41b9-8207-e202a52dd1d7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:28.514211 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-82458531-8e82-47bc-a767-62c8720cc305 req-0e548770-4074-41b9-8207-e202a52dd1d7 service nova] Creating event network-vif-plugged:bb89e905-13ad-4d1f-828b-212bf551b4a9 for instance 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 on nch2-master-1 Sep 10 21:41:28.521158 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-82458531-8e82-47bc-a767-62c8720cc305 req-0e548770-4074-41b9-8207-e202a52dd1d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036188 Sep 10 21:41:28.521995 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3464/6799] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:41:28.944561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-23890143-6196-4c67-ba25-9693dde3d96d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:28.945179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-23890143-6196-4c67-ba25-9693dde3d96d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:28.952607 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23890143-6196-4c67-ba25-9693dde3d96d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:28.953097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23890143-6196-4c67-ba25-9693dde3d96d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:28.953527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23890143-6196-4c67-ba25-9693dde3d96d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:28.954269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23890143-6196-4c67-ba25-9693dde3d96d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:28.954725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23890143-6196-4c67-ba25-9693dde3d96d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:28.955154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-23890143-6196-4c67-ba25-9693dde3d96d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:29.090391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-23890143-6196-4c67-ba25-9693dde3d96d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:29.098116 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-23890143-6196-4c67-ba25-9693dde3d96d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1316 microversion: 2.1 time: 0.157416 Sep 10 21:41:29.098698 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3336/6800] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:28 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:30.122598 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-09709fdf-6186-4bb6-9316-a8ac96b311ff tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:30.123297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-09709fdf-6186-4bb6-9316-a8ac96b311ff tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:30.129872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09709fdf-6186-4bb6-9316-a8ac96b311ff tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:30.130364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09709fdf-6186-4bb6-9316-a8ac96b311ff tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:30.130804 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09709fdf-6186-4bb6-9316-a8ac96b311ff tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:30.131493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09709fdf-6186-4bb6-9316-a8ac96b311ff tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:30.131945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09709fdf-6186-4bb6-9316-a8ac96b311ff tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:30.132389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-09709fdf-6186-4bb6-9316-a8ac96b311ff tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:30.268382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-09709fdf-6186-4bb6-9316-a8ac96b311ff tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:30.276927 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-09709fdf-6186-4bb6-9316-a8ac96b311ff tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1505 microversion: 2.1 time: 0.159587 Sep 10 21:41:30.277514 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3465/6801] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:30 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:30.339708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1311130000", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "9f132050-b38c-4956-9c1c-a693f1ba42a9"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:30.393756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] validate_networks() for [('9f132050-b38c-4956-9c1c-a693f1ba42a9', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:41:30.551713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:30.572597 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:30.760296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:41:30.760725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:41:30.761202 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:41:30.761616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:41:30.762137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:41:30.771240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:30.771678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:30.772098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:30.772828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:30.773314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:30.773743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:30.791650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Getting quotas for project 9d69ccced5e14a43b40de853fcae7ae3. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:41:30.796913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Getting quotas for user 58891ebd588c439a8c02f7e26ac4b6ee and project 9d69ccced5e14a43b40de853fcae7ae3. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:41:30.809159 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:41:30.811522 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:41:30.856489 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6c7ee858-f7ec-4b9c-915e-6d41f4d67743 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521345 Sep 10 21:41:30.857144 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3337/6802] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:41:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:41:30.868977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c64cb62-acc2-43ff-aebe-c508a18ba828 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:30.870471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1c64cb62-acc2-43ff-aebe-c508a18ba828 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:30.873604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:30.927476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1c64cb62-acc2-43ff-aebe-c508a18ba828 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:30.935309 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1c64cb62-acc2-43ff-aebe-c508a18ba828 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1217 microversion: 2.1 time: 0.070618 Sep 10 21:41:30.935883 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3466/6803] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:30 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:31.959410 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d4a6d14a-1b3e-4dea-a1bc-0e458d24888b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:31.960062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d4a6d14a-1b3e-4dea-a1bc-0e458d24888b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:31.966910 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4a6d14a-1b3e-4dea-a1bc-0e458d24888b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:31.967680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4a6d14a-1b3e-4dea-a1bc-0e458d24888b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:31.968286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4a6d14a-1b3e-4dea-a1bc-0e458d24888b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:31.969161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4a6d14a-1b3e-4dea-a1bc-0e458d24888b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:31.969782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4a6d14a-1b3e-4dea-a1bc-0e458d24888b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:31.970437 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d4a6d14a-1b3e-4dea-a1bc-0e458d24888b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:32.047788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d4a6d14a-1b3e-4dea-a1bc-0e458d24888b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:32.061530 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d4a6d14a-1b3e-4dea-a1bc-0e458d24888b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1277 microversion: 2.1 time: 0.106486 Sep 10 21:41:32.062939 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3338/6804] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:31 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:33.092192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-72e443db-7c32-485f-b016-99cacc727438 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:33.092993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-72e443db-7c32-485f-b016-99cacc727438 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:33.102909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72e443db-7c32-485f-b016-99cacc727438 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:33.103461 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72e443db-7c32-485f-b016-99cacc727438 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:33.103906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72e443db-7c32-485f-b016-99cacc727438 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:33.104819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72e443db-7c32-485f-b016-99cacc727438 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:33.105473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72e443db-7c32-485f-b016-99cacc727438 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:33.105939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72e443db-7c32-485f-b016-99cacc727438 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:33.244638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-72e443db-7c32-485f-b016-99cacc727438 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:33.252726 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-72e443db-7c32-485f-b016-99cacc727438 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1317 microversion: 2.1 time: 0.165159 Sep 10 21:41:33.253310 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3467/6805] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:33 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:33.683358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e3f8e9a8-1bd4-44e9-afcf-b11804586d4a req-5f507ddf-5de9-4561-a1ad-8bfd4a2b9fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5e09e4-bae0-458c-abf0-7034b9daea7d", "tag": "3dca182e-6573-4701-ac9d-e389f8910d39"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:33.694723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e3f8e9a8-1bd4-44e9-afcf-b11804586d4a req-5f507ddf-5de9-4561-a1ad-8bfd4a2b9fe4 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:33.695214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e3f8e9a8-1bd4-44e9-afcf-b11804586d4a req-5f507ddf-5de9-4561-a1ad-8bfd4a2b9fe4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:33.695650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e3f8e9a8-1bd4-44e9-afcf-b11804586d4a req-5f507ddf-5de9-4561-a1ad-8bfd4a2b9fe4 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:33.707702 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e3f8e9a8-1bd4-44e9-afcf-b11804586d4a req-5f507ddf-5de9-4561-a1ad-8bfd4a2b9fe4 service nova] Creating event network-changed:3dca182e-6573-4701-ac9d-e389f8910d39 for instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d on nch1-master-1 Sep 10 21:41:33.714011 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e3f8e9a8-1bd4-44e9-afcf-b11804586d4a req-5f507ddf-5de9-4561-a1ad-8bfd4a2b9fe4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033705 Sep 10 21:41:33.714640 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3339/6806] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:41:34.277577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bdebb704-3ff8-42f6-aeb9-3d676c24b7b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:34.278157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bdebb704-3ff8-42f6-aeb9-3d676c24b7b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:34.284984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdebb704-3ff8-42f6-aeb9-3d676c24b7b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:34.285465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdebb704-3ff8-42f6-aeb9-3d676c24b7b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:34.285926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdebb704-3ff8-42f6-aeb9-3d676c24b7b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:34.286615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdebb704-3ff8-42f6-aeb9-3d676c24b7b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:34.287069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdebb704-3ff8-42f6-aeb9-3d676c24b7b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:34.287503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bdebb704-3ff8-42f6-aeb9-3d676c24b7b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:34.420617 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bdebb704-3ff8-42f6-aeb9-3d676c24b7b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:34.428378 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bdebb704-3ff8-42f6-aeb9-3d676c24b7b6 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1317 microversion: 2.1 time: 0.155149 Sep 10 21:41:34.429722 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3468/6807] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:34 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:35.454381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-fcc9d43d-e6ff-43b5-a641-9e727ca1c647 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:35.455135 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-fcc9d43d-e6ff-43b5-a641-9e727ca1c647 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:35.461360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcc9d43d-e6ff-43b5-a641-9e727ca1c647 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:35.461882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcc9d43d-e6ff-43b5-a641-9e727ca1c647 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:35.462337 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcc9d43d-e6ff-43b5-a641-9e727ca1c647 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:35.463283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcc9d43d-e6ff-43b5-a641-9e727ca1c647 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:35.463767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcc9d43d-e6ff-43b5-a641-9e727ca1c647 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:35.464209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-fcc9d43d-e6ff-43b5-a641-9e727ca1c647 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:35.598171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-fcc9d43d-e6ff-43b5-a641-9e727ca1c647 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:35.606422 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-fcc9d43d-e6ff-43b5-a641-9e727ca1c647 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1317 microversion: 2.1 time: 0.157344 Sep 10 21:41:35.607012 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3340/6808] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:35 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:41:36.630424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d90822cf-1668-4285-979d-0408c3857354 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:36.631162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d90822cf-1668-4285-979d-0408c3857354 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:36.638821 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d90822cf-1668-4285-979d-0408c3857354 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:36.639325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d90822cf-1668-4285-979d-0408c3857354 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:36.639774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d90822cf-1668-4285-979d-0408c3857354 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:36.640487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d90822cf-1668-4285-979d-0408c3857354 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:36.640957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d90822cf-1668-4285-979d-0408c3857354 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:36.641524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d90822cf-1668-4285-979d-0408c3857354 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:36.782201 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d90822cf-1668-4285-979d-0408c3857354 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:36.789919 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d90822cf-1668-4285-979d-0408c3857354 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1317 microversion: 2.1 time: 0.163416 Sep 10 21:41:36.790509 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3469/6809] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:36 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:37.813535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-65bc6ae3-649f-4444-ace7-3d516b31a006 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:37.814196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-65bc6ae3-649f-4444-ace7-3d516b31a006 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:37.821053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65bc6ae3-649f-4444-ace7-3d516b31a006 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:37.821531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65bc6ae3-649f-4444-ace7-3d516b31a006 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:37.822603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65bc6ae3-649f-4444-ace7-3d516b31a006 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:37.823298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65bc6ae3-649f-4444-ace7-3d516b31a006 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:37.823749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65bc6ae3-649f-4444-ace7-3d516b31a006 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:37.824175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-65bc6ae3-649f-4444-ace7-3d516b31a006 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:37.954713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-65bc6ae3-649f-4444-ace7-3d516b31a006 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:37.962574 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-65bc6ae3-649f-4444-ace7-3d516b31a006 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1317 microversion: 2.1 time: 0.152879 Sep 10 21:41:37.963230 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3341/6810] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:37 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:38.984952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4172fc11-4fa9-4f8a-9a48-e6154fb2eb82 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:38.985673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4172fc11-4fa9-4f8a-9a48-e6154fb2eb82 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:38.992479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4172fc11-4fa9-4f8a-9a48-e6154fb2eb82 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:38.992958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4172fc11-4fa9-4f8a-9a48-e6154fb2eb82 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:38.993396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4172fc11-4fa9-4f8a-9a48-e6154fb2eb82 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:38.994911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4172fc11-4fa9-4f8a-9a48-e6154fb2eb82 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:38.995483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4172fc11-4fa9-4f8a-9a48-e6154fb2eb82 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:38.995912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4172fc11-4fa9-4f8a-9a48-e6154fb2eb82 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:39.127035 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4172fc11-4fa9-4f8a-9a48-e6154fb2eb82 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:39.135241 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4172fc11-4fa9-4f8a-9a48-e6154fb2eb82 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1317 microversion: 2.1 time: 0.153926 Sep 10 21:41:39.135818 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3470/6811] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:38 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:40.160096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c133001d-aa31-42bd-a33c-4aaffc968b7a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:40.160711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c133001d-aa31-42bd-a33c-4aaffc968b7a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:40.168364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c133001d-aa31-42bd-a33c-4aaffc968b7a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:40.168854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c133001d-aa31-42bd-a33c-4aaffc968b7a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:40.169293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c133001d-aa31-42bd-a33c-4aaffc968b7a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:40.170092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c133001d-aa31-42bd-a33c-4aaffc968b7a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:40.170550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c133001d-aa31-42bd-a33c-4aaffc968b7a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:40.170979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c133001d-aa31-42bd-a33c-4aaffc968b7a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:40.309336 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c133001d-aa31-42bd-a33c-4aaffc968b7a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:40.317132 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c133001d-aa31-42bd-a33c-4aaffc968b7a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1317 microversion: 2.1 time: 0.160939 Sep 10 21:41:40.317710 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3342/6812] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:40 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:40.839028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e95f5410-9cc6-405c-ac80-27aa713146af req-27b62ff1-bf0e-45d9-9f11-a730e3081500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5e09e4-bae0-458c-abf0-7034b9daea7d", "name": "network-vif-plugged", "status": "completed", "tag": "3dca182e-6573-4701-ac9d-e389f8910d39"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:40.850457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e95f5410-9cc6-405c-ac80-27aa713146af req-27b62ff1-bf0e-45d9-9f11-a730e3081500 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:40.850971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e95f5410-9cc6-405c-ac80-27aa713146af req-27b62ff1-bf0e-45d9-9f11-a730e3081500 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:40.851488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e95f5410-9cc6-405c-ac80-27aa713146af req-27b62ff1-bf0e-45d9-9f11-a730e3081500 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:40.864541 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e95f5410-9cc6-405c-ac80-27aa713146af req-27b62ff1-bf0e-45d9-9f11-a730e3081500 service nova] Creating event network-vif-plugged:3dca182e-6573-4701-ac9d-e389f8910d39 for instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d on nch1-master-1 Sep 10 21:41:40.869868 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e95f5410-9cc6-405c-ac80-27aa713146af req-27b62ff1-bf0e-45d9-9f11-a730e3081500 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035273 Sep 10 21:41:40.870477 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3471/6813] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:41:41.340327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-47c97cde-1e51-419f-97c6-f133e5e97b20 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:41.340947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-47c97cde-1e51-419f-97c6-f133e5e97b20 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:41.342951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:41.343611 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:41.350127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c97cde-1e51-419f-97c6-f133e5e97b20 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:41.350614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c97cde-1e51-419f-97c6-f133e5e97b20 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:41.351054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c97cde-1e51-419f-97c6-f133e5e97b20 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:41.351752 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c97cde-1e51-419f-97c6-f133e5e97b20 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:41.352242 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c97cde-1e51-419f-97c6-f133e5e97b20 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:41.352673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-47c97cde-1e51-419f-97c6-f133e5e97b20 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:41.482326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-47c97cde-1e51-419f-97c6-f133e5e97b20 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:41.490302 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-47c97cde-1e51-419f-97c6-f133e5e97b20 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1317 microversion: 2.1 time: 0.154053 Sep 10 21:41:41.490877 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3343/6814] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:41 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:42.511070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:42.516842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0bc90cc5-0019-48d6-84d8-5ca4ad97d01a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:42.517547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0bc90cc5-0019-48d6-84d8-5ca4ad97d01a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:42.524316 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bc90cc5-0019-48d6-84d8-5ca4ad97d01a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:42.524811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bc90cc5-0019-48d6-84d8-5ca4ad97d01a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:42.525296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bc90cc5-0019-48d6-84d8-5ca4ad97d01a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:42.526067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bc90cc5-0019-48d6-84d8-5ca4ad97d01a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:42.526527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bc90cc5-0019-48d6-84d8-5ca4ad97d01a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:42.526964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bc90cc5-0019-48d6-84d8-5ca4ad97d01a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:42.668152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0bc90cc5-0019-48d6-84d8-5ca4ad97d01a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:42.676020 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0bc90cc5-0019-48d6-84d8-5ca4ad97d01a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1507 microversion: 2.1 time: 0.166387 Sep 10 21:41:42.676612 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3472/6815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:42 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:42.702441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9e03801-c7cf-48d4-9276-df2fad5f6977 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:42.703266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9e03801-c7cf-48d4-9276-df2fad5f6977 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:42.716089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9e03801-c7cf-48d4-9276-df2fad5f6977 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:42.716969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9e03801-c7cf-48d4-9276-df2fad5f6977 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:42.717664 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9e03801-c7cf-48d4-9276-df2fad5f6977 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:42.718540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9e03801-c7cf-48d4-9276-df2fad5f6977 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:42.719101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9e03801-c7cf-48d4-9276-df2fad5f6977 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:42.719634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9e03801-c7cf-48d4-9276-df2fad5f6977 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:42.754854 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9e03801-c7cf-48d4-9276-df2fad5f6977 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:41:42.852735 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9e03801-c7cf-48d4-9276-df2fad5f6977 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 204 len: 0 microversion: 2.1 time: 0.154009 Sep 10 21:41:42.854017 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3344/6816] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:41:42 2022] DELETE /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:41:42.864155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7b5eb85b-43ae-4733-9c3c-980223b4932a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:42.864778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7b5eb85b-43ae-4733-9c3c-980223b4932a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:42.871508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b5eb85b-43ae-4733-9c3c-980223b4932a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:42.872012 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b5eb85b-43ae-4733-9c3c-980223b4932a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:42.872463 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b5eb85b-43ae-4733-9c3c-980223b4932a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:42.873546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b5eb85b-43ae-4733-9c3c-980223b4932a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:42.874051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b5eb85b-43ae-4733-9c3c-980223b4932a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:42.874492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7b5eb85b-43ae-4733-9c3c-980223b4932a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:43.023736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7b5eb85b-43ae-4733-9c3c-980223b4932a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:43.033697 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7b5eb85b-43ae-4733-9c3c-980223b4932a tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1513 microversion: 2.1 time: 0.174422 Sep 10 21:41:43.034668 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3473/6817] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:42 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:44.059161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a713429d-98ca-4051-9cc4-058548f04b2d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:44.059956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a713429d-98ca-4051-9cc4-058548f04b2d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:44.067386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a713429d-98ca-4051-9cc4-058548f04b2d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:44.068217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a713429d-98ca-4051-9cc4-058548f04b2d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:44.068892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a713429d-98ca-4051-9cc4-058548f04b2d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:44.069868 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a713429d-98ca-4051-9cc4-058548f04b2d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:44.070552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a713429d-98ca-4051-9cc4-058548f04b2d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:44.071226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a713429d-98ca-4051-9cc4-058548f04b2d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:44.232567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a713429d-98ca-4051-9cc4-058548f04b2d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:44.240695 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a713429d-98ca-4051-9cc4-058548f04b2d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1513 microversion: 2.1 time: 0.186282 Sep 10 21:41:44.241480 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3345/6818] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:44 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:44.886142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d77acf73-6c28-4046-baf5-5e49ceaade13 req-b55e68b9-c0ac-4df3-b1f3-23a6ae0e887d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5e09e4-bae0-458c-abf0-7034b9daea7d", "name": "network-vif-deleted", "tag": "3dca182e-6573-4701-ac9d-e389f8910d39"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:44.900552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d77acf73-6c28-4046-baf5-5e49ceaade13 req-b55e68b9-c0ac-4df3-b1f3-23a6ae0e887d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:44.901728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d77acf73-6c28-4046-baf5-5e49ceaade13 req-b55e68b9-c0ac-4df3-b1f3-23a6ae0e887d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:44.902255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d77acf73-6c28-4046-baf5-5e49ceaade13 req-b55e68b9-c0ac-4df3-b1f3-23a6ae0e887d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:44.929526 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d77acf73-6c28-4046-baf5-5e49ceaade13 req-b55e68b9-c0ac-4df3-b1f3-23a6ae0e887d service nova] Creating event network-vif-deleted:3dca182e-6573-4701-ac9d-e389f8910d39 for instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d on nch1-master-1 Sep 10 21:41:44.935572 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d77acf73-6c28-4046-baf5-5e49ceaade13 req-b55e68b9-c0ac-4df3-b1f3-23a6ae0e887d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053613 Sep 10 21:41:44.936376 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3474/6819] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:41:45.265569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:45.266212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:45.273061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:45.273550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:45.274025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:45.274722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:45.275795 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:45.276224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:45.308033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:45.308510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:45.308942 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:45.309388 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lazy-loading 'fault' on Instance uuid 4d5e09e4-bae0-458c-abf0-7034b9daea7d {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:41:45.350392 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:45.359090 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-82115bf9-79e8-4926-a43a-f0860a2c8847 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 200 len: 1307 microversion: 2.1 time: 0.097759 Sep 10 21:41:45.359913 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3346/6820] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:45 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:46.384880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:46.385873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:46.392095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:46.392578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:46.393014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:46.393697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:46.394179 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:46.394606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:46.408768 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] HTTP exception thrown: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Request method failure captured: Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d HTTP/1.1 Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQR_lZcHdYDf2B1Ml_ukfZReZtQySH_O28_sbhff9zmvrW5eUq3656djQtyQxU0WtiNUIEhJ820Kd_VJJanZjfXw1pTCuGcJydlxuC3IlIIUDhFHKFI1SuVMPTsor66XtPQWXqZRk9D0QSf0VNFtUVDnb6VCfWVCh-8gRC0dV5dF4dw Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d69ccced5e14a43b40de853fcae7ae3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d69ccced5e14a43b40de853fcae7ae3"}]}] Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 58891ebd588c439a8c02f7e26ac4b6ee Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '4d5e09e4-bae0-458c-abf0-7034b9daea7d'} Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:46.410466 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:46.415440 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:46.415440 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:46.415440 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:46.415440 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:46.415440 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:46.415440 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:46.415440 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:46.415440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Returning 404 to user: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:46.415440 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1c14ff8d-92b1-4b43-93ef-71f3d30f297b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 404 len: 111 microversion: 2.1 time: 0.032775 Sep 10 21:41:46.415440 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3475/6821] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:46 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:41:46.421030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e9d0297b-27e9-4408-890e-abbefd8d946d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:46.421650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e9d0297b-27e9-4408-890e-abbefd8d946d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:46.428612 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0297b-27e9-4408-890e-abbefd8d946d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:46.429097 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0297b-27e9-4408-890e-abbefd8d946d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:46.429539 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0297b-27e9-4408-890e-abbefd8d946d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:46.430267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0297b-27e9-4408-890e-abbefd8d946d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:46.430724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0297b-27e9-4408-890e-abbefd8d946d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:46.431262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9d0297b-27e9-4408-890e-abbefd8d946d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:46.565433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e9d0297b-27e9-4408-890e-abbefd8d946d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:46.574192 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e9d0297b-27e9-4408-890e-abbefd8d946d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1505 microversion: 2.1 time: 0.156969 Sep 10 21:41:46.574774 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3347/6822] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:46 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:46.596681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42974d30-f3d5-4519-bbd3-6cd3b462cffa tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:46.598960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-42974d30-f3d5-4519-bbd3-6cd3b462cffa tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: e72f97c3-12a7-484f-aac6-1ff7d0db26be] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:46.604408 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-42974d30-f3d5-4519-bbd3-6cd3b462cffa tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] HTTP exception thrown: Instance e72f97c3-12a7-484f-aac6-1ff7d0db26be could not be found. Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42974d30-f3d5-4519-bbd3-6cd3b462cffa tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Request method failure captured: Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/e72f97c3-12a7-484f-aac6-1ff7d0db26be/action HTTP/1.1 Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 32 Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQR_lZcHdYDf2B1Ml_ukfZReZtQySH_O28_sbhff9zmvrW5eUq3656djQtyQxU0WtiNUIEhJ820Kd_VJJanZjfXw1pTCuGcJydlxuC3IlIIUDhFHKFI1SuVMPTsor66XtPQWXqZRk9D0QSf0VNFtUVDnb6VCfWVCh-8gRC0dV5dF4dw Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d69ccced5e14a43b40de853fcae7ae3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d69ccced5e14a43b40de853fcae7ae3"}]}] Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 58891ebd588c439a8c02f7e26ac4b6ee Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: {"resize": {"flavorRef": "452"}} Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance e72f97c3-12a7-484f-aac6-1ff7d0db26be could not be found. Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'e72f97c3-12a7-484f-aac6-1ff7d0db26be', 'body': {'resize': {'flavorRef': '452'}}} Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72f97c3-12a7-484f-aac6-1ff7d0db26be could not be found. Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:46.606002 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72f97c3-12a7-484f-aac6-1ff7d0db26be could not be found. Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72f97c3-12a7-484f-aac6-1ff7d0db26be could not be found. Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42974d30-f3d5-4519-bbd3-6cd3b462cffa tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Returning 404 to user: Instance e72f97c3-12a7-484f-aac6-1ff7d0db26be could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-42974d30-f3d5-4519-bbd3-6cd3b462cffa tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "POST /compute/v2.1/servers/e72f97c3-12a7-484f-aac6-1ff7d0db26be/action" status: 404 len: 111 microversion: 2.1 time: 0.014689 Sep 10 21:41:46.610565 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3476/6823] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:41:46 2022] POST /compute/v2.1/servers/e72f97c3-12a7-484f-aac6-1ff7d0db26be/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:41:46.616322 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ca4656fa-f8a7-437f-abcc-05518fed21d0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:46.616960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ca4656fa-f8a7-437f-abcc-05518fed21d0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:46.623754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca4656fa-f8a7-437f-abcc-05518fed21d0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:46.624240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca4656fa-f8a7-437f-abcc-05518fed21d0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:46.624674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca4656fa-f8a7-437f-abcc-05518fed21d0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:46.625362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca4656fa-f8a7-437f-abcc-05518fed21d0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:46.625814 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca4656fa-f8a7-437f-abcc-05518fed21d0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:46.626267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ca4656fa-f8a7-437f-abcc-05518fed21d0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:46.630661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:46.762794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ca4656fa-f8a7-437f-abcc-05518fed21d0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:46.770593 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ca4656fa-f8a7-437f-abcc-05518fed21d0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1505 microversion: 2.1 time: 0.158274 Sep 10 21:41:46.771178 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3348/6824] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:46 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:46.793982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-21e45862-0b82-4859-bb6b-e9a81901c967 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:46.798387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-21e45862-0b82-4859-bb6b-e9a81901c967 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:46.804491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e45862-0b82-4859-bb6b-e9a81901c967 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:46.804976 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e45862-0b82-4859-bb6b-e9a81901c967 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:46.805413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e45862-0b82-4859-bb6b-e9a81901c967 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:46.806709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e45862-0b82-4859-bb6b-e9a81901c967 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:46.807171 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e45862-0b82-4859-bb6b-e9a81901c967 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:46.807595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-21e45862-0b82-4859-bb6b-e9a81901c967 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:46.939803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-21e45862-0b82-4859-bb6b-e9a81901c967 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:46.948325 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-21e45862-0b82-4859-bb6b-e9a81901c967 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1505 microversion: 2.1 time: 0.158142 Sep 10 21:41:46.948836 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3477/6825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:46 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:46.987270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "b67e8de5-5b98-41ad-9431-8a93c02f481d"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:46.989643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:46.996728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:46.997233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:46.997674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:46.998391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:46.998843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:46.999266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.027462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:47.032167 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] HTTP exception thrown: Flavor b67e8de5-5b98-41ad-9431-8a93c02f481d could not be found. Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Request method failure captured: Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: request: POST /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4/action HTTP/1.1 Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 65 Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQR_lZcHdYDf2B1Ml_ukfZReZtQySH_O28_sbhff9zmvrW5eUq3656djQtyQxU0WtiNUIEhJ820Kd_VJJanZjfXw1pTCuGcJydlxuC3IlIIUDhFHKFI1SuVMPTsor66XtPQWXqZRk9D0QSf0VNFtUVDnb6VCfWVCh-8gRC0dV5dF4dw Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d69ccced5e14a43b40de853fcae7ae3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d69ccced5e14a43b40de853fcae7ae3"}]}] Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 58891ebd588c439a8c02f7e26ac4b6ee Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: {"resize": {"flavorRef": "b67e8de5-5b98-41ad-9431-8a93c02f481d"}} Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: exception: Flavor b67e8de5-5b98-41ad-9431-8a93c02f481d could not be found. Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2bbe155c-5bf1-4e63-a26e-9f6275dfeef4', 'body': {'resize': {'flavorRef': 'b67e8de5-5b98-41ad-9431-8a93c02f481d'}}} Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:47.037026 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b67e8de5-5b98-41ad-9431-8a93c02f481d could not be found. Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor b67e8de5-5b98-41ad-9431-8a93c02f481d could not be found. Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b67e8de5-5b98-41ad-9431-8a93c02f481d could not be found. Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Returning 400 to user: Flavor b67e8de5-5b98-41ad-9431-8a93c02f481d could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7c784141-cffb-46b4-87e7-3c874b5681a0 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "POST /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4/action" status: 400 len: 107 microversion: 2.1 time: 0.055480 Sep 10 21:41:47.042562 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3349/6826] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:41:46 2022] POST /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4/action => generated 107 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:41:47.047862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7249deba-c6bc-44be-b067-0f8ada0e33ed tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:47.048470 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7249deba-c6bc-44be-b067-0f8ada0e33ed tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:47.054458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7249deba-c6bc-44be-b067-0f8ada0e33ed tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.054939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7249deba-c6bc-44be-b067-0f8ada0e33ed tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.055376 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7249deba-c6bc-44be-b067-0f8ada0e33ed tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.056168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7249deba-c6bc-44be-b067-0f8ada0e33ed tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.057497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7249deba-c6bc-44be-b067-0f8ada0e33ed tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.058028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7249deba-c6bc-44be-b067-0f8ada0e33ed tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.190395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7249deba-c6bc-44be-b067-0f8ada0e33ed tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:47.198643 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7249deba-c6bc-44be-b067-0f8ada0e33ed tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1505 microversion: 2.1 time: 0.154577 Sep 10 21:41:47.199144 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3478/6827] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:47 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:41:47.221542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c17f41c6-8eed-4114-acc8-0a8feea4a3e2 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:47.222213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c17f41c6-8eed-4114-acc8-0a8feea4a3e2 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:47.228783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c17f41c6-8eed-4114-acc8-0a8feea4a3e2 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.229503 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c17f41c6-8eed-4114-acc8-0a8feea4a3e2 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.229991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c17f41c6-8eed-4114-acc8-0a8feea4a3e2 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.230688 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c17f41c6-8eed-4114-acc8-0a8feea4a3e2 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.231139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c17f41c6-8eed-4114-acc8-0a8feea4a3e2 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.231566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c17f41c6-8eed-4114-acc8-0a8feea4a3e2 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.367995 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c17f41c6-8eed-4114-acc8-0a8feea4a3e2 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:47.375760 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c17f41c6-8eed-4114-acc8-0a8feea4a3e2 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1505 microversion: 2.1 time: 0.158102 Sep 10 21:41:47.376336 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3350/6828] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:47 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:47.398010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-46a00842-515f-434f-8497-7dc45bbd13e4 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-46a00842-515f-434f-8497-7dc45bbd13e4 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Request method failure captured: Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: request: POST /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4/action HTTP/1.1 Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 29 Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQR_lZcHdYDf2B1Ml_ukfZReZtQySH_O28_sbhff9zmvrW5eUq3656djQtyQxU0WtiNUIEhJ820Kd_VJJanZjfXw1pTCuGcJydlxuC3IlIIUDhFHKFI1SuVMPTsor66XtPQWXqZRk9D0QSf0VNFtUVDnb6VCfWVCh-8gRC0dV5dF4dw Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d69ccced5e14a43b40de853fcae7ae3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d69ccced5e14a43b40de853fcae7ae3"}]}] Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 58891ebd588c439a8c02f7e26ac4b6ee Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: {"resize": {"flavorRef": ""}} Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2bbe155c-5bf1-4e63-a26e-9f6275dfeef4', 'body': {'resize': {'flavorRef': ''}}} Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise error Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi '' Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.402176 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-46a00842-515f-434f-8497-7dc45bbd13e4 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-46a00842-515f-434f-8497-7dc45bbd13e4 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "POST /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4/action" status: 400 len: 113 microversion: 2.1 time: 0.009681 Sep 10 21:41:47.407812 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3479/6829] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:41:47 2022] POST /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 21:41:47.411753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ffe232ea-1d51-441c-ab2a-4b5db7a3ed8b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:47.412393 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ffe232ea-1d51-441c-ab2a-4b5db7a3ed8b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:47.419087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffe232ea-1d51-441c-ab2a-4b5db7a3ed8b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.419563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffe232ea-1d51-441c-ab2a-4b5db7a3ed8b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.420002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffe232ea-1d51-441c-ab2a-4b5db7a3ed8b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.420690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffe232ea-1d51-441c-ab2a-4b5db7a3ed8b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.421143 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffe232ea-1d51-441c-ab2a-4b5db7a3ed8b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.421659 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffe232ea-1d51-441c-ab2a-4b5db7a3ed8b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.557167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ffe232ea-1d51-441c-ab2a-4b5db7a3ed8b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:47.565068 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ffe232ea-1d51-441c-ab2a-4b5db7a3ed8b tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1505 microversion: 2.1 time: 0.157060 Sep 10 21:41:47.565644 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3351/6830] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:47 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:47.592915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:47.593417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:47.600855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.601330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.601764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.602491 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.603541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.603980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.617380 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] HTTP exception thrown: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Request method failure captured: Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: request: DELETE /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d HTTP/1.1 Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQR_lZcHdYDf2B1Ml_ukfZReZtQySH_O28_sbhff9zmvrW5eUq3656djQtyQxU0WtiNUIEhJ820Kd_VJJanZjfXw1pTCuGcJydlxuC3IlIIUDhFHKFI1SuVMPTsor66XtPQWXqZRk9D0QSf0VNFtUVDnb6VCfWVCh-8gRC0dV5dF4dw Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d69ccced5e14a43b40de853fcae7ae3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d69ccced5e14a43b40de853fcae7ae3"}]}] Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 58891ebd588c439a8c02f7e26ac4b6ee Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '4d5e09e4-bae0-458c-abf0-7034b9daea7d'} Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:47.619425 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Returning 404 to user: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6e953bd1-d21c-4986-a9bd-55717babc500 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 404 len: 111 microversion: 2.1 time: 0.034079 Sep 10 21:41:47.623646 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3480/6831] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:41:47 2022] DELETE /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:41:47.629720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:47.630376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 4d5e09e4-bae0-458c-abf0-7034b9daea7d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:47.638210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.638699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.639140 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.639837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.640298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.640728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.655093 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] HTTP exception thrown: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Request method failure captured: Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d HTTP/1.1 Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQR_lZcHdYDf2B1Ml_ukfZReZtQySH_O28_sbhff9zmvrW5eUq3656djQtyQxU0WtiNUIEhJ820Kd_VJJanZjfXw1pTCuGcJydlxuC3IlIIUDhFHKFI1SuVMPTsor66XtPQWXqZRk9D0QSf0VNFtUVDnb6VCfWVCh-8gRC0dV5dF4dw Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d69ccced5e14a43b40de853fcae7ae3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d69ccced5e14a43b40de853fcae7ae3"}]}] Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 58891ebd588c439a8c02f7e26ac4b6ee Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '4d5e09e4-bae0-458c-abf0-7034b9daea7d'} Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:47.656657 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.660902 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:47.660902 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:47.660902 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:47.660902 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:47.660902 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:47.660902 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. Sep 10 21:41:47.660902 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:47.660902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Returning 404 to user: Instance 4d5e09e4-bae0-458c-abf0-7034b9daea7d could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:47.660902 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38fc3392-4514-4ad2-b229-236865179a6d tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d" status: 404 len: 111 microversion: 2.1 time: 0.032168 Sep 10 21:41:47.660902 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3352/6832] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:47 2022] GET /compute/v2.1/servers/4d5e09e4-bae0-458c-abf0-7034b9daea7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:41:47.666660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9590a074-6893-446a-8a30-f61b9203937f tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:47.667167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9590a074-6893-446a-8a30-f61b9203937f tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:47.673093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9590a074-6893-446a-8a30-f61b9203937f tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.673580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9590a074-6893-446a-8a30-f61b9203937f tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.674061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9590a074-6893-446a-8a30-f61b9203937f tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.674757 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9590a074-6893-446a-8a30-f61b9203937f tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.675211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9590a074-6893-446a-8a30-f61b9203937f tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.675639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9590a074-6893-446a-8a30-f61b9203937f tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.700894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9590a074-6893-446a-8a30-f61b9203937f tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:41:47.775998 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9590a074-6893-446a-8a30-f61b9203937f tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 204 len: 0 microversion: 2.1 time: 0.112840 Sep 10 21:41:47.777276 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3481/6833] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:41:47 2022] DELETE /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:41:47.785689 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0711891b-1a75-4e15-91c5-f8a705d46dde tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:47.786537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0711891b-1a75-4e15-91c5-f8a705d46dde tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:47.792918 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0711891b-1a75-4e15-91c5-f8a705d46dde tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.793407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0711891b-1a75-4e15-91c5-f8a705d46dde tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.793882 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0711891b-1a75-4e15-91c5-f8a705d46dde tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.794584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0711891b-1a75-4e15-91c5-f8a705d46dde tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:47.795038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0711891b-1a75-4e15-91c5-f8a705d46dde tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:47.795461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0711891b-1a75-4e15-91c5-f8a705d46dde tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:47.927796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0711891b-1a75-4e15-91c5-f8a705d46dde tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:47.935706 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0711891b-1a75-4e15-91c5-f8a705d46dde tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1511 microversion: 2.1 time: 0.154428 Sep 10 21:41:47.936280 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3353/6834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:47 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:48.960436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4b9da139-639d-4d40-9ada-926cbe9d8173 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:48.961074 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4b9da139-639d-4d40-9ada-926cbe9d8173 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:48.968499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b9da139-639d-4d40-9ada-926cbe9d8173 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:48.968990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b9da139-639d-4d40-9ada-926cbe9d8173 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:48.969422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b9da139-639d-4d40-9ada-926cbe9d8173 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:48.970149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b9da139-639d-4d40-9ada-926cbe9d8173 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:48.970609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b9da139-639d-4d40-9ada-926cbe9d8173 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:48.971068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b9da139-639d-4d40-9ada-926cbe9d8173 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:48.976091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:49.108916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b9da139-639d-4d40-9ada-926cbe9d8173 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:49.117253 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4b9da139-639d-4d40-9ada-926cbe9d8173 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1511 microversion: 2.1 time: 0.161171 Sep 10 21:41:49.117847 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3482/6835] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:48 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:49.719956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d51a599e-7843-4d90-abce-f9293eca74ca req-ce0c58f1-fc1c-4824-b433-383940da8961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbe155c-5bf1-4e63-a26e-9f6275dfeef4", "name": "network-vif-deleted", "tag": "bb89e905-13ad-4d1f-828b-212bf551b4a9"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:41:49.731928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d51a599e-7843-4d90-abce-f9293eca74ca req-ce0c58f1-fc1c-4824-b433-383940da8961 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:49.732456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d51a599e-7843-4d90-abce-f9293eca74ca req-ce0c58f1-fc1c-4824-b433-383940da8961 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:49.732903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d51a599e-7843-4d90-abce-f9293eca74ca req-ce0c58f1-fc1c-4824-b433-383940da8961 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:49.748196 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d51a599e-7843-4d90-abce-f9293eca74ca req-ce0c58f1-fc1c-4824-b433-383940da8961 service nova] Creating event network-vif-deleted:bb89e905-13ad-4d1f-828b-212bf551b4a9 for instance 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 on nch2-master-1 Sep 10 21:41:49.754764 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d51a599e-7843-4d90-abce-f9293eca74ca req-ce0c58f1-fc1c-4824-b433-383940da8961 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038483 Sep 10 21:41:49.755676 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3354/6836] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:41:50.140770 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:50.141344 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:50.148255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:50.148742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:50.149183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:50.150107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:50.150668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:50.151105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:50.184076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:50.184564 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:50.185006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:50.185469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lazy-loading 'fault' on Instance uuid 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:41:50.227235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58891ebd588c439a8c02f7e26ac4b6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69ccced5e14a43b40de853fcae7ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:41:50.236669 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-13a20749-b47b-4551-9ec5-4483ebe776f1 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 200 len: 1306 microversion: 2.1 time: 0.099890 Sep 10 21:41:50.237386 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3483/6837] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:50 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:41:51.263149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:41:51.263791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] [instance: 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:41:51.266718 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:41:51.273017 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:51.273501 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:51.274048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:51.274763 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:41:51.275257 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:41:51.275740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:41:51.290154 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] HTTP exception thrown: Instance 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 could not be found. Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Request method failure captured: Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 HTTP/1.1 Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQR_lZcHdYDf2B1Ml_ukfZReZtQySH_O28_sbhff9zmvrW5eUq3656djQtyQxU0WtiNUIEhJ820Kd_VJJanZjfXw1pTCuGcJydlxuC3IlIIUDhFHKFI1SuVMPTsor66XtPQWXqZRk9D0QSf0VNFtUVDnb6VCfWVCh-8gRC0dV5dF4dw Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d69ccced5e14a43b40de853fcae7ae3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d69ccced5e14a43b40de853fcae7ae3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d69ccced5e14a43b40de853fcae7ae3"}]}] Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 9d69ccced5e14a43b40de853fcae7ae3 Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2033046195 Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 58891ebd588c439a8c02f7e26ac4b6ee Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-ServersNegativeTestJSON-2033046195-project Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 could not be found. Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '2bbe155c-5bf1-4e63-a26e-9f6275dfeef4'} Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 could not be found. Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 could not be found. Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:41:51.291941 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:51.296699 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:41:51.296699 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:41:51.296699 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:41:51.296699 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:41:51.296699 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:41:51.296699 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 could not be found. Sep 10 21:41:51.296699 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:41:51.296699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] Returning 404 to user: Instance 2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:41:51.296699 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-108371a6-3c50-4ec2-8ce1-0307e1231196 tempest-ServersNegativeTestJSON-2033046195 tempest-ServersNegativeTestJSON-2033046195-project] 10.222.0.33 "GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4" status: 404 len: 111 microversion: 2.1 time: 0.035275 Sep 10 21:41:51.296699 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3355/6838] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:41:51 2022] GET /compute/v2.1/servers/2bbe155c-5bf1-4e63-a26e-9f6275dfeef4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:42:34.674634 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e9176320-6282-47b2-bcb5-64e0a8cb2da6 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Action: 'create', calling method: .version_select at 0x7f993fcbd310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1255560388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp+EyDrY7+En2ZmaIov7Xk/YiLwhz205G6AYvXtaRfyec5RNKIuuMPvb7Sk+zFaqSsOwkhRTb5dEhMhQjKlmDwyGN8tR0YaWtiQhIUgOkugLMq7ROY2IF4cAC+Iqj0ZxQ=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:42:34.680661 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:42:34.681342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:42:34.694518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e9176320-6282-47b2-bcb5-64e0a8cb2da6 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Getting quotas for project 2bf5303213324a9591812e0b4debf54e. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:42:34.699739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-e9176320-6282-47b2-bcb5-64e0a8cb2da6 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Getting quotas for user 4086db48df2640109c3ef0f8720c36c8 and project 2bf5303213324a9591812e0b4debf54e. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:42:34.724481 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e9176320-6282-47b2-bcb5-64e0a8cb2da6 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053686 Sep 10 21:42:34.725088 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3484/6839] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:42:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:42:34.775466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1493811315", "imageRef": "e00a207d-887a-42de-b623-753d9c3204e1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1255560388", "networks": [{"uuid": "3a5081bd-ac9e-41d0-8cc7-b32f0f367b3b"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:42:34.784431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=32 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:42:34.785065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:42:34.830532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] validate_networks() for [('3a5081bd-ac9e-41d0-8cc7-b32f0f367b3b', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:42:35.201314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:42:35.201743 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:42:35.202256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:42:35.202670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:42:35.203087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:42:35.212239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:35.212734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:35.213174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:35.214038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:35.214499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:35.214927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:35.232669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Getting quotas for project 2bf5303213324a9591812e0b4debf54e. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:42:35.238589 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Getting quotas for user 4086db48df2640109c3ef0f8720c36c8 and project 2bf5303213324a9591812e0b4debf54e. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:42:35.252263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:42:35.254546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e00a207d-887a-42de-b623-753d9c3204e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:42:35.299669 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f26699ce-0f36-4ed0-8572-4bc953c2a13c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528530 Sep 10 21:42:35.300317 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3356/6840] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:42:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:42:35.312103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e21aa334-7cb2-4673-b6b8-62de71e8a6d3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:35.312750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e21aa334-7cb2-4673-b6b8-62de71e8a6d3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:35.369390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e21aa334-7cb2-4673-b6b8-62de71e8a6d3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:35.376521 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e21aa334-7cb2-4673-b6b8-62de71e8a6d3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1259 microversion: 2.1 time: 0.068601 Sep 10 21:42:35.377103 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3485/6841] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:35 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:36.400239 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8e115c70-b312-48da-8089-06cda9bfb423 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:36.400858 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8e115c70-b312-48da-8089-06cda9bfb423 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:36.407817 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e115c70-b312-48da-8089-06cda9bfb423 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:36.408308 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e115c70-b312-48da-8089-06cda9bfb423 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:36.408745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e115c70-b312-48da-8089-06cda9bfb423 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:36.409443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e115c70-b312-48da-8089-06cda9bfb423 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:36.409923 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e115c70-b312-48da-8089-06cda9bfb423 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:36.410357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8e115c70-b312-48da-8089-06cda9bfb423 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:36.481136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8e115c70-b312-48da-8089-06cda9bfb423 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:36.490326 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8e115c70-b312-48da-8089-06cda9bfb423 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1319 microversion: 2.1 time: 0.095064 Sep 10 21:42:36.490914 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3357/6842] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:36 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:37.515881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-890c8568-40d8-4b27-a6cc-d5f92bbfbac3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:37.516492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-890c8568-40d8-4b27-a6cc-d5f92bbfbac3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:37.528298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-890c8568-40d8-4b27-a6cc-d5f92bbfbac3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:37.528888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-890c8568-40d8-4b27-a6cc-d5f92bbfbac3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:37.529335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-890c8568-40d8-4b27-a6cc-d5f92bbfbac3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:37.530077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-890c8568-40d8-4b27-a6cc-d5f92bbfbac3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:37.530537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-890c8568-40d8-4b27-a6cc-d5f92bbfbac3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:37.530969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-890c8568-40d8-4b27-a6cc-d5f92bbfbac3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:37.705971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-890c8568-40d8-4b27-a6cc-d5f92bbfbac3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:37.716179 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-890c8568-40d8-4b27-a6cc-d5f92bbfbac3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.204130 Sep 10 21:42:37.716777 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3486/6843] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:37 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:38.741376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-614169a5-9518-4954-8bed-6e7591698257 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:38.744300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-614169a5-9518-4954-8bed-6e7591698257 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:38.752439 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-614169a5-9518-4954-8bed-6e7591698257 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:38.753841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-614169a5-9518-4954-8bed-6e7591698257 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:38.754724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-614169a5-9518-4954-8bed-6e7591698257 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:38.755928 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-614169a5-9518-4954-8bed-6e7591698257 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:38.756693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-614169a5-9518-4954-8bed-6e7591698257 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:38.757391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-614169a5-9518-4954-8bed-6e7591698257 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:38.923191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-614169a5-9518-4954-8bed-6e7591698257 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:38.938494 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-614169a5-9518-4954-8bed-6e7591698257 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.201140 Sep 10 21:42:38.941176 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3358/6844] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:38 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:39.969571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b1a5f3ca-d505-44c8-9886-a0e259fbcd40 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:39.970409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b1a5f3ca-d505-44c8-9886-a0e259fbcd40 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:39.978967 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1a5f3ca-d505-44c8-9886-a0e259fbcd40 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:39.979917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1a5f3ca-d505-44c8-9886-a0e259fbcd40 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:39.979917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1a5f3ca-d505-44c8-9886-a0e259fbcd40 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:39.980604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1a5f3ca-d505-44c8-9886-a0e259fbcd40 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:39.981067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1a5f3ca-d505-44c8-9886-a0e259fbcd40 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:39.981501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b1a5f3ca-d505-44c8-9886-a0e259fbcd40 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:40.134238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b1a5f3ca-d505-44c8-9886-a0e259fbcd40 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:40.142117 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b1a5f3ca-d505-44c8-9886-a0e259fbcd40 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.178904 Sep 10 21:42:40.142691 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3487/6845] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:39 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:41.167230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-38a99181-d60e-4faa-8a1e-45f43acf368e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:41.167841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-38a99181-d60e-4faa-8a1e-45f43acf368e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:41.175069 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38a99181-d60e-4faa-8a1e-45f43acf368e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:41.175520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38a99181-d60e-4faa-8a1e-45f43acf368e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:41.175958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38a99181-d60e-4faa-8a1e-45f43acf368e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:41.176669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38a99181-d60e-4faa-8a1e-45f43acf368e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:41.177121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38a99181-d60e-4faa-8a1e-45f43acf368e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:41.177742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-38a99181-d60e-4faa-8a1e-45f43acf368e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:41.331350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-38a99181-d60e-4faa-8a1e-45f43acf368e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:41.340509 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-38a99181-d60e-4faa-8a1e-45f43acf368e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.177428 Sep 10 21:42:41.342162 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3359/6846] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:41 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:42.369783 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b8694b58-ad67-470a-8d7e-0fe588b8c353 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:42.370825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b8694b58-ad67-470a-8d7e-0fe588b8c353 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:42.379103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8694b58-ad67-470a-8d7e-0fe588b8c353 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:42.379764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8694b58-ad67-470a-8d7e-0fe588b8c353 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:42.380473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8694b58-ad67-470a-8d7e-0fe588b8c353 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:42.381417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8694b58-ad67-470a-8d7e-0fe588b8c353 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:42.382191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8694b58-ad67-470a-8d7e-0fe588b8c353 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:42.383583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8694b58-ad67-470a-8d7e-0fe588b8c353 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:42.529023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b8694b58-ad67-470a-8d7e-0fe588b8c353 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:42.539022 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b8694b58-ad67-470a-8d7e-0fe588b8c353 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.173429 Sep 10 21:42:42.540094 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3488/6847] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:42 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:43.564731 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bf35f404-6b87-4031-bdb7-44a2f6b40334 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:43.565468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bf35f404-6b87-4031-bdb7-44a2f6b40334 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:43.573310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf35f404-6b87-4031-bdb7-44a2f6b40334 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:43.573808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf35f404-6b87-4031-bdb7-44a2f6b40334 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:43.574342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf35f404-6b87-4031-bdb7-44a2f6b40334 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:43.575061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf35f404-6b87-4031-bdb7-44a2f6b40334 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:43.575523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf35f404-6b87-4031-bdb7-44a2f6b40334 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:43.575955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf35f404-6b87-4031-bdb7-44a2f6b40334 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:43.756837 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bf35f404-6b87-4031-bdb7-44a2f6b40334 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:43.766765 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bf35f404-6b87-4031-bdb7-44a2f6b40334 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.206504 Sep 10 21:42:43.767498 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3360/6848] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:43 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:44.792690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-30cf4d35-89ff-4587-a039-a11a66447ab7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:44.793272 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-30cf4d35-89ff-4587-a039-a11a66447ab7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:44.800153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30cf4d35-89ff-4587-a039-a11a66447ab7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:44.800638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30cf4d35-89ff-4587-a039-a11a66447ab7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:44.801087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30cf4d35-89ff-4587-a039-a11a66447ab7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:44.801780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30cf4d35-89ff-4587-a039-a11a66447ab7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:44.802265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30cf4d35-89ff-4587-a039-a11a66447ab7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:44.802697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-30cf4d35-89ff-4587-a039-a11a66447ab7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:44.935743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-30cf4d35-89ff-4587-a039-a11a66447ab7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:44.943500 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-30cf4d35-89ff-4587-a039-a11a66447ab7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.154925 Sep 10 21:42:44.944072 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3489/6849] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:44 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:45.900715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-16e233a9-9a09-45bd-8a91-074880e35e8c req-1404211d-4263-4ed1-b799-daed0f4a2bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "318f9d55-016e-49d5-ac18-fdfebd13a9cc", "tag": "956f5d5f-52e1-4fb3-8f1d-589443397fdb"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:42:45.908580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:42:45.909353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:42:45.915610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-16e233a9-9a09-45bd-8a91-074880e35e8c req-1404211d-4263-4ed1-b799-daed0f4a2bef service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:45.916096 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-16e233a9-9a09-45bd-8a91-074880e35e8c req-1404211d-4263-4ed1-b799-daed0f4a2bef service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:45.917235 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-16e233a9-9a09-45bd-8a91-074880e35e8c req-1404211d-4263-4ed1-b799-daed0f4a2bef service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:45.929030 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-16e233a9-9a09-45bd-8a91-074880e35e8c req-1404211d-4263-4ed1-b799-daed0f4a2bef service nova] Creating event network-changed:956f5d5f-52e1-4fb3-8f1d-589443397fdb for instance 318f9d55-016e-49d5-ac18-fdfebd13a9cc on nch2-master-1 Sep 10 21:42:45.934810 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-16e233a9-9a09-45bd-8a91-074880e35e8c req-1404211d-4263-4ed1-b799-daed0f4a2bef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038529 Sep 10 21:42:45.935456 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3361/6850] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:42:45.967595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93156b76-9f71-4ce9-a9c9-370ff1c4e4c9 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:45.968927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-93156b76-9f71-4ce9-a9c9-370ff1c4e4c9 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:45.972236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:42:45.977913 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93156b76-9f71-4ce9-a9c9-370ff1c4e4c9 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:45.979152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93156b76-9f71-4ce9-a9c9-370ff1c4e4c9 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:45.979152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93156b76-9f71-4ce9-a9c9-370ff1c4e4c9 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:45.979853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93156b76-9f71-4ce9-a9c9-370ff1c4e4c9 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:45.980243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93156b76-9f71-4ce9-a9c9-370ff1c4e4c9 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:45.980677 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93156b76-9f71-4ce9-a9c9-370ff1c4e4c9 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:46.213439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93156b76-9f71-4ce9-a9c9-370ff1c4e4c9 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:46.221326 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93156b76-9f71-4ce9-a9c9-370ff1c4e4c9 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.257618 Sep 10 21:42:46.221931 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3490/6851] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:45 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:47.247174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-d52fbcd4-f942-4f3f-a5c8-2da624b7bb1e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:47.247805 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-d52fbcd4-f942-4f3f-a5c8-2da624b7bb1e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:47.254129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d52fbcd4-f942-4f3f-a5c8-2da624b7bb1e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:47.254627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d52fbcd4-f942-4f3f-a5c8-2da624b7bb1e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:47.255072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d52fbcd4-f942-4f3f-a5c8-2da624b7bb1e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:47.255772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d52fbcd4-f942-4f3f-a5c8-2da624b7bb1e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:47.256237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d52fbcd4-f942-4f3f-a5c8-2da624b7bb1e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:47.256700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-d52fbcd4-f942-4f3f-a5c8-2da624b7bb1e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:47.385852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-d52fbcd4-f942-4f3f-a5c8-2da624b7bb1e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:47.394002 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-d52fbcd4-f942-4f3f-a5c8-2da624b7bb1e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.152434 Sep 10 21:42:47.394590 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3362/6852] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:47 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:48.418219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f1b08fbb-2d02-41d2-aa08-1799ef2a1829 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:48.418837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f1b08fbb-2d02-41d2-aa08-1799ef2a1829 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:48.424928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1b08fbb-2d02-41d2-aa08-1799ef2a1829 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:48.425422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1b08fbb-2d02-41d2-aa08-1799ef2a1829 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:48.425901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1b08fbb-2d02-41d2-aa08-1799ef2a1829 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:48.426614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1b08fbb-2d02-41d2-aa08-1799ef2a1829 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:48.427148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1b08fbb-2d02-41d2-aa08-1799ef2a1829 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:48.427590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1b08fbb-2d02-41d2-aa08-1799ef2a1829 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:48.559367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f1b08fbb-2d02-41d2-aa08-1799ef2a1829 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:48.567390 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f1b08fbb-2d02-41d2-aa08-1799ef2a1829 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.153535 Sep 10 21:42:48.567981 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3491/6853] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:48 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:49.591144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3787003f-0e76-47e8-8d76-bae08f9c02b5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:49.591796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3787003f-0e76-47e8-8d76-bae08f9c02b5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:49.598758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3787003f-0e76-47e8-8d76-bae08f9c02b5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:49.599250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3787003f-0e76-47e8-8d76-bae08f9c02b5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:49.599722 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3787003f-0e76-47e8-8d76-bae08f9c02b5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:49.600415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3787003f-0e76-47e8-8d76-bae08f9c02b5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:49.600874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3787003f-0e76-47e8-8d76-bae08f9c02b5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:49.601317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3787003f-0e76-47e8-8d76-bae08f9c02b5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:49.735218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3787003f-0e76-47e8-8d76-bae08f9c02b5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:49.744231 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3787003f-0e76-47e8-8d76-bae08f9c02b5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.157099 Sep 10 21:42:49.744811 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3363/6854] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:49 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:50.768705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2d0ff83d-2524-46c1-9a3c-3db2e6c7808a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:50.769324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2d0ff83d-2524-46c1-9a3c-3db2e6c7808a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:50.776429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d0ff83d-2524-46c1-9a3c-3db2e6c7808a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:50.776917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d0ff83d-2524-46c1-9a3c-3db2e6c7808a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:50.777360 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d0ff83d-2524-46c1-9a3c-3db2e6c7808a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:50.778091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d0ff83d-2524-46c1-9a3c-3db2e6c7808a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:50.778554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d0ff83d-2524-46c1-9a3c-3db2e6c7808a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:50.778985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2d0ff83d-2524-46c1-9a3c-3db2e6c7808a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:50.914791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2d0ff83d-2524-46c1-9a3c-3db2e6c7808a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:50.922547 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2d0ff83d-2524-46c1-9a3c-3db2e6c7808a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.157854 Sep 10 21:42:50.923126 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3492/6855] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:50 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:42:51.946394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5a23b214-bd10-45d4-9c7c-78449d93c04e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:51.947015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5a23b214-bd10-45d4-9c7c-78449d93c04e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:51.953894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a23b214-bd10-45d4-9c7c-78449d93c04e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:51.954382 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a23b214-bd10-45d4-9c7c-78449d93c04e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:51.954822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a23b214-bd10-45d4-9c7c-78449d93c04e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:51.955510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a23b214-bd10-45d4-9c7c-78449d93c04e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:51.955963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a23b214-bd10-45d4-9c7c-78449d93c04e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:51.956389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5a23b214-bd10-45d4-9c7c-78449d93c04e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:52.088018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5a23b214-bd10-45d4-9c7c-78449d93c04e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:52.095786 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5a23b214-bd10-45d4-9c7c-78449d93c04e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.153707 Sep 10 21:42:52.096366 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3364/6856] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:51 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:52.686560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-18b6e416-b71f-46df-ac9d-67067d548b5a req-7ef3808a-3d6e-4b67-a4be-c47319276353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318f9d55-016e-49d5-ac18-fdfebd13a9cc", "name": "network-vif-plugged", "status": "completed", "tag": "956f5d5f-52e1-4fb3-8f1d-589443397fdb"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:42:52.700775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-18b6e416-b71f-46df-ac9d-67067d548b5a req-7ef3808a-3d6e-4b67-a4be-c47319276353 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:52.701262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-18b6e416-b71f-46df-ac9d-67067d548b5a req-7ef3808a-3d6e-4b67-a4be-c47319276353 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:52.701699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-18b6e416-b71f-46df-ac9d-67067d548b5a req-7ef3808a-3d6e-4b67-a4be-c47319276353 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:52.713405 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-18b6e416-b71f-46df-ac9d-67067d548b5a req-7ef3808a-3d6e-4b67-a4be-c47319276353 service nova] Creating event network-vif-plugged:956f5d5f-52e1-4fb3-8f1d-589443397fdb for instance 318f9d55-016e-49d5-ac18-fdfebd13a9cc on nch2-master-1 Sep 10 21:42:52.718675 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-18b6e416-b71f-46df-ac9d-67067d548b5a req-7ef3808a-3d6e-4b67-a4be-c47319276353 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035873 Sep 10 21:42:52.719280 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3493/6857] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:42:53.120980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ee0e6158-c066-455f-899d-ef39982399fe tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:53.121535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ee0e6158-c066-455f-899d-ef39982399fe tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:53.128433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee0e6158-c066-455f-899d-ef39982399fe tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:53.128920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee0e6158-c066-455f-899d-ef39982399fe tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:53.129364 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee0e6158-c066-455f-899d-ef39982399fe tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:53.130088 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee0e6158-c066-455f-899d-ef39982399fe tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:53.130552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee0e6158-c066-455f-899d-ef39982399fe tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:53.130980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ee0e6158-c066-455f-899d-ef39982399fe tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:53.264783 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ee0e6158-c066-455f-899d-ef39982399fe tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:53.273766 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ee0e6158-c066-455f-899d-ef39982399fe tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1359 microversion: 2.1 time: 0.157356 Sep 10 21:42:53.274548 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3365/6858] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:53 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:54.298984 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-502e3226-cd37-42fe-b765-e8ea075eb0b1 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:54.300273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-502e3226-cd37-42fe-b765-e8ea075eb0b1 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:54.308570 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-502e3226-cd37-42fe-b765-e8ea075eb0b1 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:54.309049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-502e3226-cd37-42fe-b765-e8ea075eb0b1 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:54.309487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-502e3226-cd37-42fe-b765-e8ea075eb0b1 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:54.310229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-502e3226-cd37-42fe-b765-e8ea075eb0b1 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:54.310680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-502e3226-cd37-42fe-b765-e8ea075eb0b1 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:54.311107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-502e3226-cd37-42fe-b765-e8ea075eb0b1 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:54.444833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-502e3226-cd37-42fe-b765-e8ea075eb0b1 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:54.455352 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-502e3226-cd37-42fe-b765-e8ea075eb0b1 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1548 microversion: 2.1 time: 0.160742 Sep 10 21:42:54.456036 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3494/6859] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:54 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:54.478537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-156ada4f-84a5-44e0-b110-2501a2554031 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:54.479160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-156ada4f-84a5-44e0-b110-2501a2554031 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:54.486380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-156ada4f-84a5-44e0-b110-2501a2554031 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:54.486872 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-156ada4f-84a5-44e0-b110-2501a2554031 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:54.487321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-156ada4f-84a5-44e0-b110-2501a2554031 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:54.488022 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-156ada4f-84a5-44e0-b110-2501a2554031 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:54.488480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-156ada4f-84a5-44e0-b110-2501a2554031 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:54.488913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-156ada4f-84a5-44e0-b110-2501a2554031 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:54.623290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-156ada4f-84a5-44e0-b110-2501a2554031 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:54.631106 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-156ada4f-84a5-44e0-b110-2501a2554031 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1548 microversion: 2.1 time: 0.156541 Sep 10 21:42:54.631705 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3366/6860] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:54 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:54.654067 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:54.658714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:54.659478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Searching by: {'deleted': False, 'project_id': '2bf5303213324a9591812e0b4debf54e'} {{(pid=145772) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:42:54.665066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:54.665565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:54.666055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:54.666787 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:54.667238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:54.667664 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:54.690732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.multi_cell_list [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145772) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:42:54.719300 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f99ceada-58cd-4f16-9392-0dcf5862caf3 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068917 Sep 10 21:42:54.720075 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3495/6861] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 21:42:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:42:54.731803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-68fc92cc-94c1-4c33-a5e7-4f0bff2d9c9a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:54.732422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-68fc92cc-94c1-4c33-a5e7-4f0bff2d9c9a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:54.738782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68fc92cc-94c1-4c33-a5e7-4f0bff2d9c9a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:54.739276 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68fc92cc-94c1-4c33-a5e7-4f0bff2d9c9a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:54.739728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68fc92cc-94c1-4c33-a5e7-4f0bff2d9c9a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:54.740634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68fc92cc-94c1-4c33-a5e7-4f0bff2d9c9a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:54.741179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68fc92cc-94c1-4c33-a5e7-4f0bff2d9c9a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:54.741566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-68fc92cc-94c1-4c33-a5e7-4f0bff2d9c9a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:54.870600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-68fc92cc-94c1-4c33-a5e7-4f0bff2d9c9a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:54.878393 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-68fc92cc-94c1-4c33-a5e7-4f0bff2d9c9a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1548 microversion: 2.1 time: 0.150554 Sep 10 21:42:54.878997 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3367/6862] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:54 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:56.400149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fec60477-1e6e-45a0-b0ed-ee6bb4bde42c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:56.400676 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fec60477-1e6e-45a0-b0ed-ee6bb4bde42c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:56.407660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fec60477-1e6e-45a0-b0ed-ee6bb4bde42c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:56.408159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fec60477-1e6e-45a0-b0ed-ee6bb4bde42c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:56.408613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fec60477-1e6e-45a0-b0ed-ee6bb4bde42c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:56.409328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fec60477-1e6e-45a0-b0ed-ee6bb4bde42c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:56.409800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fec60477-1e6e-45a0-b0ed-ee6bb4bde42c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:56.410298 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fec60477-1e6e-45a0-b0ed-ee6bb4bde42c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:56.435719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fec60477-1e6e-45a0-b0ed-ee6bb4bde42c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:42:56.509704 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fec60477-1e6e-45a0-b0ed-ee6bb4bde42c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "DELETE /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 204 len: 0 microversion: 2.1 time: 0.113247 Sep 10 21:42:56.510433 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3496/6863] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:42:56 2022] DELETE /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:42:56.518970 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-084631fc-c43b-414a-a092-112cf6ab5c35 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:56.519583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-084631fc-c43b-414a-a092-112cf6ab5c35 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:56.526720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-084631fc-c43b-414a-a092-112cf6ab5c35 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:56.527205 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-084631fc-c43b-414a-a092-112cf6ab5c35 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:56.527646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-084631fc-c43b-414a-a092-112cf6ab5c35 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:56.528347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-084631fc-c43b-414a-a092-112cf6ab5c35 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:56.528803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-084631fc-c43b-414a-a092-112cf6ab5c35 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:56.529231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-084631fc-c43b-414a-a092-112cf6ab5c35 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:56.662897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-084631fc-c43b-414a-a092-112cf6ab5c35 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:56.671322 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-084631fc-c43b-414a-a092-112cf6ab5c35 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1554 microversion: 2.1 time: 0.156224 Sep 10 21:42:56.671938 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3368/6864] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:56 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:57.696879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-847afafc-eb67-4fed-a77f-dcd24a903a4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:57.697593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-847afafc-eb67-4fed-a77f-dcd24a903a4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:57.705123 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-847afafc-eb67-4fed-a77f-dcd24a903a4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:57.705608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-847afafc-eb67-4fed-a77f-dcd24a903a4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:57.706167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-847afafc-eb67-4fed-a77f-dcd24a903a4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:57.707080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-847afafc-eb67-4fed-a77f-dcd24a903a4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:57.707573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-847afafc-eb67-4fed-a77f-dcd24a903a4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:57.708236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-847afafc-eb67-4fed-a77f-dcd24a903a4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:57.849135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-847afafc-eb67-4fed-a77f-dcd24a903a4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:57.857233 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-847afafc-eb67-4fed-a77f-dcd24a903a4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1554 microversion: 2.1 time: 0.165714 Sep 10 21:42:57.857814 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3497/6865] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:57 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:42:58.357793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-b827e1a7-89e5-4d8f-bfd4-047310e724a6 req-cf844d82-11de-4f4e-9a5b-45550b3dbcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318f9d55-016e-49d5-ac18-fdfebd13a9cc", "name": "network-vif-deleted", "tag": "956f5d5f-52e1-4fb3-8f1d-589443397fdb"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:42:58.369121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b827e1a7-89e5-4d8f-bfd4-047310e724a6 req-cf844d82-11de-4f4e-9a5b-45550b3dbcd2 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:58.369614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b827e1a7-89e5-4d8f-bfd4-047310e724a6 req-cf844d82-11de-4f4e-9a5b-45550b3dbcd2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:58.370223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-b827e1a7-89e5-4d8f-bfd4-047310e724a6 req-cf844d82-11de-4f4e-9a5b-45550b3dbcd2 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:58.382810 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-b827e1a7-89e5-4d8f-bfd4-047310e724a6 req-cf844d82-11de-4f4e-9a5b-45550b3dbcd2 service nova] Creating event network-vif-deleted:956f5d5f-52e1-4fb3-8f1d-589443397fdb for instance 318f9d55-016e-49d5-ac18-fdfebd13a9cc on nch2-master-1 Sep 10 21:42:58.388033 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-b827e1a7-89e5-4d8f-bfd4-047310e724a6 req-cf844d82-11de-4f4e-9a5b-45550b3dbcd2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035038 Sep 10 21:42:58.388655 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3369/6866] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:42:58.880698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:42:58.881418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:42:58.888468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:58.888957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:58.889452 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:58.890260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:58.890713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:58.891145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:58.931927 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:42:58.932412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:42:58.932850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:42:58.933306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lazy-loading 'fault' on Instance uuid 318f9d55-016e-49d5-ac18-fdfebd13a9cc {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:42:58.982150 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:42:58.989554 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-284aa946-a5e8-4121-9a0c-c9e01e3141ce tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 200 len: 1349 microversion: 2.1 time: 0.112878 Sep 10 21:42:58.990160 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3498/6867] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:42:58 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 1349 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:00.014684 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:00.015314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: 318f9d55-016e-49d5-ac18-fdfebd13a9cc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:00.021585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:00.022111 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:00.022546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:00.024109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:00.024585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:00.025016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:00.039550 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] HTTP exception thrown: Instance 318f9d55-016e-49d5-ac18-fdfebd13a9cc could not be found. Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Request method failure captured: Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc HTTP/1.1 Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQS7UmgSHw7yFvkkoh_LKzl1PH34Yp9Zr553AKKitOGjmQwuiq4BweTrT0dNxh2QQCBDcXMf3gv5v-AFVFA-8N3I4AYXG1XMKabDp5yo0aw15GuAk1NTGomZJa4MY9fByGRrlPZNVlXCNorkCG5ULByshR4DsdrLppg2PAwF52HDtx0 Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 2bf5303213324a9591812e0b4debf54e Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TestMinimumBasicScenario-1754636393 Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2bf5303213324a9591812e0b4debf54e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2bf5303213324a9591812e0b4debf54e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2bf5303213324a9591812e0b4debf54e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2bf5303213324a9591812e0b4debf54e"}]}] Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TestMinimumBasicScenario-1754636393 Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 2bf5303213324a9591812e0b4debf54e Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1754636393 Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TestMinimumBasicScenario-1754636393-project Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 4086db48df2640109c3ef0f8720c36c8 Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TestMinimumBasicScenario-1754636393-project Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 318f9d55-016e-49d5-ac18-fdfebd13a9cc could not be found. Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '318f9d55-016e-49d5-ac18-fdfebd13a9cc'} Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 318f9d55-016e-49d5-ac18-fdfebd13a9cc could not be found. Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 318f9d55-016e-49d5-ac18-fdfebd13a9cc could not be found. Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:43:00.041219 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:43:00.046181 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:43:00.046181 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:43:00.046181 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:43:00.046181 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:43:00.046181 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:43:00.046181 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 318f9d55-016e-49d5-ac18-fdfebd13a9cc could not be found. Sep 10 21:43:00.046181 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:43:00.046181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Returning 404 to user: Instance 318f9d55-016e-49d5-ac18-fdfebd13a9cc could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:43:00.046181 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f598964a-4396-4e52-ad76-bac79cad977c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc" status: 404 len: 111 microversion: 2.1 time: 0.033244 Sep 10 21:43:00.046181 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3370/6868] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:00 2022] GET /compute/v2.1/servers/318f9d55-016e-49d5-ac18-fdfebd13a9cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:43:00.051471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-334aaa7b-79a6-4d8b-9f5f-466607bba279 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '.version_select at 0x7f993fc99670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:00.070980 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-334aaa7b-79a6-4d8b-9f5f-466607bba279 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1255560388" status: 202 len: 0 microversion: 2.1 time: 0.023335 Sep 10 21:43:00.071564 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3499/6869] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:43:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1255560388 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:43:09.271310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4595e2bf-9ab2-47ff-9f6e-a6d0d9ccfb7f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Action: 'create', calling method: .version_select at 0x7f993f8b7790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2011710182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIggJX1w58R/dopiLTBIHr+lnd37GCy9ufs+8cbi6l1lpSjvIeFjJ+Hp/7NlOxkFa8G9cImj+kxgzfL8xL+w4Kl4n+DxKg/sY3DPwDq2BLzHs7bx56agUoIGqPi2fEqpbg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:43:09.279026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:09.293218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-4595e2bf-9ab2-47ff-9f6e-a6d0d9ccfb7f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Getting quotas for project 2bf5303213324a9591812e0b4debf54e. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:43:09.298476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-4595e2bf-9ab2-47ff-9f6e-a6d0d9ccfb7f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Getting quotas for user 4086db48df2640109c3ef0f8720c36c8 and project 2bf5303213324a9591812e0b4debf54e. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:43:09.324312 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4595e2bf-9ab2-47ff-9f6e-a6d0d9ccfb7f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056900 Sep 10 21:43:09.324922 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3371/6870] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:43:09 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:43:09.375604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:09.376528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:09.380476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1219688985", "imageRef": "ce05f83e-699a-40b4-ab4f-2d058747e96b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2011710182", "networks": [{"uuid": "3a5081bd-ac9e-41d0-8cc7-b32f0f367b3b"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:43:09.390455 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:09.434880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] validate_networks() for [('3a5081bd-ac9e-41d0-8cc7-b32f0f367b3b', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:43:09.812806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:43:09.813269 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:43:09.813750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:43:09.814213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:43:09.814657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:43:09.824215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:09.824698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:09.825140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:09.825912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:09.826458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:09.827024 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:09.848896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Getting quotas for project 2bf5303213324a9591812e0b4debf54e. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:43:09.854321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Getting quotas for user 4086db48df2640109c3ef0f8720c36c8 and project 2bf5303213324a9591812e0b4debf54e. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:43:09.866955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:43:09.869206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ce05f83e-699a-40b4-ab4f-2d058747e96b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:43:09.915636 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0d0b2c11-d541-49ad-8ea9-24a872517139 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542464 Sep 10 21:43:09.916292 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3500/6871] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:43:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:43:09.927339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7308962a-c7c9-4656-ae90-82ef8677e448 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:09.927957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7308962a-c7c9-4656-ae90-82ef8677e448 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:09.985405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7308962a-c7c9-4656-ae90-82ef8677e448 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:09.993429 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7308962a-c7c9-4656-ae90-82ef8677e448 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1259 microversion: 2.1 time: 0.070037 Sep 10 21:43:09.994190 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3372/6872] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:09 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:11.017569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4b244e96-dcd2-4a43-a886-6a33f8743883 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:11.018236 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4b244e96-dcd2-4a43-a886-6a33f8743883 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:11.025252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b244e96-dcd2-4a43-a886-6a33f8743883 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:11.025746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b244e96-dcd2-4a43-a886-6a33f8743883 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:11.026238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b244e96-dcd2-4a43-a886-6a33f8743883 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:11.026938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b244e96-dcd2-4a43-a886-6a33f8743883 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:11.027399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b244e96-dcd2-4a43-a886-6a33f8743883 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:11.027833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b244e96-dcd2-4a43-a886-6a33f8743883 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:11.107893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b244e96-dcd2-4a43-a886-6a33f8743883 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:11.116297 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4b244e96-dcd2-4a43-a886-6a33f8743883 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1311 microversion: 2.1 time: 0.103606 Sep 10 21:43:11.118857 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3501/6873] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:11 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:12.143620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ae775262-d5ea-4cb8-84a5-99a19e2a6ac5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:12.145582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ae775262-d5ea-4cb8-84a5-99a19e2a6ac5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:12.153617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=74 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:12.157422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae775262-d5ea-4cb8-84a5-99a19e2a6ac5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:12.158010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae775262-d5ea-4cb8-84a5-99a19e2a6ac5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:12.158690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae775262-d5ea-4cb8-84a5-99a19e2a6ac5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:12.159786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae775262-d5ea-4cb8-84a5-99a19e2a6ac5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:12.160710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae775262-d5ea-4cb8-84a5-99a19e2a6ac5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:12.161253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ae775262-d5ea-4cb8-84a5-99a19e2a6ac5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:12.323178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ae775262-d5ea-4cb8-84a5-99a19e2a6ac5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:12.331310 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ae775262-d5ea-4cb8-84a5-99a19e2a6ac5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.193181 Sep 10 21:43:12.331999 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3373/6874] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:12 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:13.355613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a4c4e9fb-5bc8-4e9a-99fb-872dc7695a80 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:13.356253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a4c4e9fb-5bc8-4e9a-99fb-872dc7695a80 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:13.363745 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c4e9fb-5bc8-4e9a-99fb-872dc7695a80 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:13.364229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c4e9fb-5bc8-4e9a-99fb-872dc7695a80 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:13.364670 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c4e9fb-5bc8-4e9a-99fb-872dc7695a80 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:13.365369 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c4e9fb-5bc8-4e9a-99fb-872dc7695a80 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:13.365856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c4e9fb-5bc8-4e9a-99fb-872dc7695a80 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:13.366294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a4c4e9fb-5bc8-4e9a-99fb-872dc7695a80 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:13.512780 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a4c4e9fb-5bc8-4e9a-99fb-872dc7695a80 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:13.520598 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a4c4e9fb-5bc8-4e9a-99fb-872dc7695a80 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.168926 Sep 10 21:43:13.521185 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3502/6875] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:13 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:14.544371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a9a8fa35-7f76-4d12-8214-ae1d8792e91e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:14.545290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a9a8fa35-7f76-4d12-8214-ae1d8792e91e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:14.552948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a8fa35-7f76-4d12-8214-ae1d8792e91e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:14.553493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a8fa35-7f76-4d12-8214-ae1d8792e91e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:14.554019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a8fa35-7f76-4d12-8214-ae1d8792e91e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:14.554751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a8fa35-7f76-4d12-8214-ae1d8792e91e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:14.555217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a8fa35-7f76-4d12-8214-ae1d8792e91e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:14.555657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a9a8fa35-7f76-4d12-8214-ae1d8792e91e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:14.701016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a9a8fa35-7f76-4d12-8214-ae1d8792e91e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:14.709052 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a9a8fa35-7f76-4d12-8214-ae1d8792e91e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.168804 Sep 10 21:43:14.709986 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3374/6876] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:14 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:15.733615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0ed07d0d-b44f-4961-8dcc-07a389ac0563 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:15.734295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0ed07d0d-b44f-4961-8dcc-07a389ac0563 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:15.742445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed07d0d-b44f-4961-8dcc-07a389ac0563 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:15.746156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed07d0d-b44f-4961-8dcc-07a389ac0563 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:15.746156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed07d0d-b44f-4961-8dcc-07a389ac0563 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:15.746156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed07d0d-b44f-4961-8dcc-07a389ac0563 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:15.746156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed07d0d-b44f-4961-8dcc-07a389ac0563 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:15.746156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0ed07d0d-b44f-4961-8dcc-07a389ac0563 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:15.887430 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0ed07d0d-b44f-4961-8dcc-07a389ac0563 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:15.895491 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0ed07d0d-b44f-4961-8dcc-07a389ac0563 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.165954 Sep 10 21:43:15.896285 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3503/6877] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:15 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:16.921118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-78239a5d-2530-408a-9512-6be67a55a8c2 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:16.921801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-78239a5d-2530-408a-9512-6be67a55a8c2 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:16.928726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78239a5d-2530-408a-9512-6be67a55a8c2 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:16.929362 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78239a5d-2530-408a-9512-6be67a55a8c2 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:16.930056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78239a5d-2530-408a-9512-6be67a55a8c2 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:16.930996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78239a5d-2530-408a-9512-6be67a55a8c2 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:16.931528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78239a5d-2530-408a-9512-6be67a55a8c2 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:16.932039 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-78239a5d-2530-408a-9512-6be67a55a8c2 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:17.074244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-78239a5d-2530-408a-9512-6be67a55a8c2 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:17.083729 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-78239a5d-2530-408a-9512-6be67a55a8c2 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.167172 Sep 10 21:43:17.084697 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3375/6878] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:16 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:18.111112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cac0947f-9cbc-4746-acfe-a03bc55f9536 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:18.112636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cac0947f-9cbc-4746-acfe-a03bc55f9536 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:18.121761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cac0947f-9cbc-4746-acfe-a03bc55f9536 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:18.122459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cac0947f-9cbc-4746-acfe-a03bc55f9536 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:18.122915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cac0947f-9cbc-4746-acfe-a03bc55f9536 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:18.123641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cac0947f-9cbc-4746-acfe-a03bc55f9536 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:18.124104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cac0947f-9cbc-4746-acfe-a03bc55f9536 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:18.124539 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cac0947f-9cbc-4746-acfe-a03bc55f9536 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:18.275176 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cac0947f-9cbc-4746-acfe-a03bc55f9536 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:18.283154 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cac0947f-9cbc-4746-acfe-a03bc55f9536 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.179220 Sep 10 21:43:18.283737 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3504/6879] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:18 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:19.309094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6ab162ce-3d75-4c0e-979f-fc075bdbcf4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:19.309719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6ab162ce-3d75-4c0e-979f-fc075bdbcf4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:19.316818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ab162ce-3d75-4c0e-979f-fc075bdbcf4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:19.317313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ab162ce-3d75-4c0e-979f-fc075bdbcf4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:19.317757 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ab162ce-3d75-4c0e-979f-fc075bdbcf4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:19.318527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ab162ce-3d75-4c0e-979f-fc075bdbcf4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:19.318987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ab162ce-3d75-4c0e-979f-fc075bdbcf4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:19.319416 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6ab162ce-3d75-4c0e-979f-fc075bdbcf4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:19.461061 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6ab162ce-3d75-4c0e-979f-fc075bdbcf4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:19.470139 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6ab162ce-3d75-4c0e-979f-fc075bdbcf4f tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.166162 Sep 10 21:43:19.471412 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3376/6880] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:19 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:20.495175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8a79385a-4570-4316-be7d-543ca5079064 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:20.495777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8a79385a-4570-4316-be7d-543ca5079064 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:20.498596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:20.499273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:20.504735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a79385a-4570-4316-be7d-543ca5079064 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:20.505232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a79385a-4570-4316-be7d-543ca5079064 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:20.505692 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a79385a-4570-4316-be7d-543ca5079064 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:20.506409 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a79385a-4570-4316-be7d-543ca5079064 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:20.506867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a79385a-4570-4316-be7d-543ca5079064 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:20.507300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8a79385a-4570-4316-be7d-543ca5079064 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:20.726465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8a79385a-4570-4316-be7d-543ca5079064 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:20.735516 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8a79385a-4570-4316-be7d-543ca5079064 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.244075 Sep 10 21:43:20.736121 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3505/6881] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:20 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:43:21.107003 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:21.252915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d7daae53-eb91-4454-a202-9926c7c56070 req-30af7415-9c65-4b01-81f7-ae851f5d9812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5c327c4-e20f-4714-8323-30bda74994bf", "tag": "bdd34dda-a92e-4bef-85b9-d6ced35306ce"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:43:21.265288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d7daae53-eb91-4454-a202-9926c7c56070 req-30af7415-9c65-4b01-81f7-ae851f5d9812 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:21.266116 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d7daae53-eb91-4454-a202-9926c7c56070 req-30af7415-9c65-4b01-81f7-ae851f5d9812 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:21.266840 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d7daae53-eb91-4454-a202-9926c7c56070 req-30af7415-9c65-4b01-81f7-ae851f5d9812 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:21.283319 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d7daae53-eb91-4454-a202-9926c7c56070 req-30af7415-9c65-4b01-81f7-ae851f5d9812 service nova] Creating event network-changed:bdd34dda-a92e-4bef-85b9-d6ced35306ce for instance c5c327c4-e20f-4714-8323-30bda74994bf on nch2-master-1 Sep 10 21:43:21.288435 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d7daae53-eb91-4454-a202-9926c7c56070 req-30af7415-9c65-4b01-81f7-ae851f5d9812 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186026 Sep 10 21:43:21.289220 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3377/6882] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:43:21.761283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-feb8491f-9aa2-418f-8e25-d395c6fb5fb7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:21.761841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-feb8491f-9aa2-418f-8e25-d395c6fb5fb7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:21.768713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feb8491f-9aa2-418f-8e25-d395c6fb5fb7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:21.769198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feb8491f-9aa2-418f-8e25-d395c6fb5fb7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:21.769636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feb8491f-9aa2-418f-8e25-d395c6fb5fb7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:21.770378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feb8491f-9aa2-418f-8e25-d395c6fb5fb7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:21.770894 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feb8491f-9aa2-418f-8e25-d395c6fb5fb7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:21.771524 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-feb8491f-9aa2-418f-8e25-d395c6fb5fb7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:22.189945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-feb8491f-9aa2-418f-8e25-d395c6fb5fb7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:22.198308 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-feb8491f-9aa2-418f-8e25-d395c6fb5fb7 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.441801 Sep 10 21:43:22.198882 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3506/6883] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:21 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:23.221848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-719150d7-02de-462a-b317-7206a03d6bc5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:23.222513 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-719150d7-02de-462a-b317-7206a03d6bc5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:23.230263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719150d7-02de-462a-b317-7206a03d6bc5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:23.230750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719150d7-02de-462a-b317-7206a03d6bc5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:23.231428 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719150d7-02de-462a-b317-7206a03d6bc5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:23.232121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719150d7-02de-462a-b317-7206a03d6bc5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:23.232576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719150d7-02de-462a-b317-7206a03d6bc5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:23.233006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-719150d7-02de-462a-b317-7206a03d6bc5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:23.364623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-719150d7-02de-462a-b317-7206a03d6bc5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:23.373214 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-719150d7-02de-462a-b317-7206a03d6bc5 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.155735 Sep 10 21:43:23.373797 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3378/6884] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:23 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:24.396919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-72437ef0-6740-4281-81c6-c28f4a00b45a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:24.397530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-72437ef0-6740-4281-81c6-c28f4a00b45a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:24.405175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72437ef0-6740-4281-81c6-c28f4a00b45a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:24.405655 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72437ef0-6740-4281-81c6-c28f4a00b45a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:24.406132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72437ef0-6740-4281-81c6-c28f4a00b45a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:24.406823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72437ef0-6740-4281-81c6-c28f4a00b45a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:24.407276 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72437ef0-6740-4281-81c6-c28f4a00b45a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:24.407702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-72437ef0-6740-4281-81c6-c28f4a00b45a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:24.540506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-72437ef0-6740-4281-81c6-c28f4a00b45a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:24.548835 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-72437ef0-6740-4281-81c6-c28f4a00b45a tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.155799 Sep 10 21:43:24.549410 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3507/6885] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:24 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:25.572544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e6175d50-f11c-41ec-965b-2ab292044eac tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:25.573171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e6175d50-f11c-41ec-965b-2ab292044eac tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:25.580163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6175d50-f11c-41ec-965b-2ab292044eac tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:25.580676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6175d50-f11c-41ec-965b-2ab292044eac tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:25.581120 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6175d50-f11c-41ec-965b-2ab292044eac tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:25.581815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6175d50-f11c-41ec-965b-2ab292044eac tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:25.582295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6175d50-f11c-41ec-965b-2ab292044eac tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:25.582725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e6175d50-f11c-41ec-965b-2ab292044eac tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:25.711596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e6175d50-f11c-41ec-965b-2ab292044eac tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:25.719661 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e6175d50-f11c-41ec-965b-2ab292044eac tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.151627 Sep 10 21:43:25.720239 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3379/6886] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:25 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:26.742870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c8f35300-653d-4ee8-b7d2-2905ead2cbaa tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:26.744182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c8f35300-653d-4ee8-b7d2-2905ead2cbaa tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:26.751475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8f35300-653d-4ee8-b7d2-2905ead2cbaa tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:26.751959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8f35300-653d-4ee8-b7d2-2905ead2cbaa tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:26.752397 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8f35300-653d-4ee8-b7d2-2905ead2cbaa tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:26.753101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8f35300-653d-4ee8-b7d2-2905ead2cbaa tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:26.753699 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8f35300-653d-4ee8-b7d2-2905ead2cbaa tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:26.754163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c8f35300-653d-4ee8-b7d2-2905ead2cbaa tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:26.896271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c8f35300-653d-4ee8-b7d2-2905ead2cbaa tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:26.905209 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c8f35300-653d-4ee8-b7d2-2905ead2cbaa tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.166276 Sep 10 21:43:26.905788 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3508/6887] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:26 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:26.947762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2e3c4323-4df8-4d53-9e4a-29d7dceba8a8 req-81af02ab-db89-4aee-842b-3823a39f9ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5c327c4-e20f-4714-8323-30bda74994bf", "name": "network-vif-plugged", "status": "completed", "tag": "bdd34dda-a92e-4bef-85b9-d6ced35306ce"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:43:26.957493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2e3c4323-4df8-4d53-9e4a-29d7dceba8a8 req-81af02ab-db89-4aee-842b-3823a39f9ddc service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:26.958020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2e3c4323-4df8-4d53-9e4a-29d7dceba8a8 req-81af02ab-db89-4aee-842b-3823a39f9ddc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:26.958451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2e3c4323-4df8-4d53-9e4a-29d7dceba8a8 req-81af02ab-db89-4aee-842b-3823a39f9ddc service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:26.969959 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2e3c4323-4df8-4d53-9e4a-29d7dceba8a8 req-81af02ab-db89-4aee-842b-3823a39f9ddc service nova] Creating event network-vif-plugged:bdd34dda-a92e-4bef-85b9-d6ced35306ce for instance c5c327c4-e20f-4714-8323-30bda74994bf on nch2-master-1 Sep 10 21:43:26.975005 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2e3c4323-4df8-4d53-9e4a-29d7dceba8a8 req-81af02ab-db89-4aee-842b-3823a39f9ddc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173778 Sep 10 21:43:26.975565 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3380/6888] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:43:27.928665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b3e2ea64-ef9e-4793-8b2b-718f6641b47e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:27.929281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b3e2ea64-ef9e-4793-8b2b-718f6641b47e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:27.936933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3e2ea64-ef9e-4793-8b2b-718f6641b47e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:27.937421 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3e2ea64-ef9e-4793-8b2b-718f6641b47e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:27.937885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3e2ea64-ef9e-4793-8b2b-718f6641b47e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:27.938594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3e2ea64-ef9e-4793-8b2b-718f6641b47e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:27.939052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3e2ea64-ef9e-4793-8b2b-718f6641b47e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:27.939483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b3e2ea64-ef9e-4793-8b2b-718f6641b47e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:28.070809 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b3e2ea64-ef9e-4793-8b2b-718f6641b47e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:28.078658 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b3e2ea64-ef9e-4793-8b2b-718f6641b47e tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1359 microversion: 2.1 time: 0.153927 Sep 10 21:43:28.079231 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3509/6889] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:27 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:29.104231 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4a62a2a2-d75a-418d-a3d3-befc5cdac8f4 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:29.104953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4a62a2a2-d75a-418d-a3d3-befc5cdac8f4 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:29.111466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a62a2a2-d75a-418d-a3d3-befc5cdac8f4 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:29.111951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a62a2a2-d75a-418d-a3d3-befc5cdac8f4 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:29.112396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a62a2a2-d75a-418d-a3d3-befc5cdac8f4 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:29.113090 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a62a2a2-d75a-418d-a3d3-befc5cdac8f4 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:29.113554 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a62a2a2-d75a-418d-a3d3-befc5cdac8f4 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:29.114031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4a62a2a2-d75a-418d-a3d3-befc5cdac8f4 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:29.247531 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4a62a2a2-d75a-418d-a3d3-befc5cdac8f4 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:29.255485 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4a62a2a2-d75a-418d-a3d3-befc5cdac8f4 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1548 microversion: 2.1 time: 0.157012 Sep 10 21:43:29.256067 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3381/6890] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:29 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:29.278144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-34c74ef1-e892-41c6-bc9e-380deab5b70b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:29.278754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-34c74ef1-e892-41c6-bc9e-380deab5b70b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:29.285559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34c74ef1-e892-41c6-bc9e-380deab5b70b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:29.286084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34c74ef1-e892-41c6-bc9e-380deab5b70b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:29.286521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34c74ef1-e892-41c6-bc9e-380deab5b70b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:29.287307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34c74ef1-e892-41c6-bc9e-380deab5b70b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:29.287765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34c74ef1-e892-41c6-bc9e-380deab5b70b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:29.288186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-34c74ef1-e892-41c6-bc9e-380deab5b70b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:29.418434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-34c74ef1-e892-41c6-bc9e-380deab5b70b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:29.426235 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-34c74ef1-e892-41c6-bc9e-380deab5b70b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1548 microversion: 2.1 time: 0.152292 Sep 10 21:43:29.426819 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3510/6891] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:29 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:29.449035 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:29.453939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:29.454708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Searching by: {'deleted': False, 'project_id': '2bf5303213324a9591812e0b4debf54e'} {{(pid=145771) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 21:43:29.460124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:29.460606 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:29.461043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:29.461774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:29.462310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:29.462782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:29.486623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.multi_cell_list [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=145771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 21:43:29.516325 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-85b5e615-2473-4a85-ab28-3d07ef5de84c tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071234 Sep 10 21:43:29.516851 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3382/6892] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Sep 10 21:43:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:43:29.528721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f6b52853-a397-4ef7-a407-337a11078d03 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:29.529332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f6b52853-a397-4ef7-a407-337a11078d03 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:29.535312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b52853-a397-4ef7-a407-337a11078d03 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:29.535870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b52853-a397-4ef7-a407-337a11078d03 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:29.536320 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b52853-a397-4ef7-a407-337a11078d03 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:29.537014 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b52853-a397-4ef7-a407-337a11078d03 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:29.537477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b52853-a397-4ef7-a407-337a11078d03 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:29.537934 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f6b52853-a397-4ef7-a407-337a11078d03 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:29.673447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f6b52853-a397-4ef7-a407-337a11078d03 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:29.681621 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f6b52853-a397-4ef7-a407-337a11078d03 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1548 microversion: 2.1 time: 0.156450 Sep 10 21:43:29.682355 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3511/6893] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:29 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:31.160350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0007c8bf-8310-4559-ab66-403f155cef59 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:31.160862 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0007c8bf-8310-4559-ab66-403f155cef59 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:31.167802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0007c8bf-8310-4559-ab66-403f155cef59 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:31.168293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0007c8bf-8310-4559-ab66-403f155cef59 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:31.168739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0007c8bf-8310-4559-ab66-403f155cef59 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:31.169441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0007c8bf-8310-4559-ab66-403f155cef59 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:31.169961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0007c8bf-8310-4559-ab66-403f155cef59 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:31.170396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0007c8bf-8310-4559-ab66-403f155cef59 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:31.197613 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0007c8bf-8310-4559-ab66-403f155cef59 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:43:31.272062 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0007c8bf-8310-4559-ab66-403f155cef59 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 204 len: 0 microversion: 2.1 time: 0.115166 Sep 10 21:43:31.272690 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3383/6894] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:43:31 2022] DELETE /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:43:31.282086 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-025dbc36-6537-4a53-abe2-fa78feb728ed tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:31.282691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-025dbc36-6537-4a53-abe2-fa78feb728ed tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:31.289731 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-025dbc36-6537-4a53-abe2-fa78feb728ed tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:31.290241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-025dbc36-6537-4a53-abe2-fa78feb728ed tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:31.291122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-025dbc36-6537-4a53-abe2-fa78feb728ed tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:31.292944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-025dbc36-6537-4a53-abe2-fa78feb728ed tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:31.293412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-025dbc36-6537-4a53-abe2-fa78feb728ed tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:31.293896 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-025dbc36-6537-4a53-abe2-fa78feb728ed tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:31.423591 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-025dbc36-6537-4a53-abe2-fa78feb728ed tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:31.432194 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-025dbc36-6537-4a53-abe2-fa78feb728ed tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1554 microversion: 2.1 time: 0.153358 Sep 10 21:43:31.432761 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3512/6895] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:31 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:32.456461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6a987d84-220d-41c7-9a92-a3d544e1e040 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:32.457169 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6a987d84-220d-41c7-9a92-a3d544e1e040 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:32.464078 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a987d84-220d-41c7-9a92-a3d544e1e040 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:32.464564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a987d84-220d-41c7-9a92-a3d544e1e040 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:32.465004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a987d84-220d-41c7-9a92-a3d544e1e040 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:32.465695 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a987d84-220d-41c7-9a92-a3d544e1e040 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:32.466190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a987d84-220d-41c7-9a92-a3d544e1e040 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:32.466621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6a987d84-220d-41c7-9a92-a3d544e1e040 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:32.597527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6a987d84-220d-41c7-9a92-a3d544e1e040 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:32.606394 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6a987d84-220d-41c7-9a92-a3d544e1e040 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1554 microversion: 2.1 time: 0.154241 Sep 10 21:43:32.606975 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3384/6896] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:32 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:33.121879 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-1daf8299-f378-4757-ba42-a666403c2bd8 req-7c8738d2-7aea-4696-ba78-49577d73a2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5c327c4-e20f-4714-8323-30bda74994bf", "name": "network-vif-deleted", "tag": "bdd34dda-a92e-4bef-85b9-d6ced35306ce"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:43:33.143367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1daf8299-f378-4757-ba42-a666403c2bd8 req-7c8738d2-7aea-4696-ba78-49577d73a2ef service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:33.143895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1daf8299-f378-4757-ba42-a666403c2bd8 req-7c8738d2-7aea-4696-ba78-49577d73a2ef service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:33.144335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-1daf8299-f378-4757-ba42-a666403c2bd8 req-7c8738d2-7aea-4696-ba78-49577d73a2ef service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:33.158956 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-1daf8299-f378-4757-ba42-a666403c2bd8 req-7c8738d2-7aea-4696-ba78-49577d73a2ef service nova] Creating event network-vif-deleted:bdd34dda-a92e-4bef-85b9-d6ced35306ce for instance c5c327c4-e20f-4714-8323-30bda74994bf on nch2-master-1 Sep 10 21:43:33.165216 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-1daf8299-f378-4757-ba42-a666403c2bd8 req-7c8738d2-7aea-4696-ba78-49577d73a2ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047553 Sep 10 21:43:33.166715 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3513/6897] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:43:33.629467 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:33.630108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:33.637552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:33.638083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:33.638557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:33.639284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:33.639746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:33.640178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:33.673436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:33.673959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:33.674411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:33.674861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lazy-loading 'fault' on Instance uuid c5c327c4-e20f-4714-8323-30bda74994bf {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:43:33.721979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4086db48df2640109c3ef0f8720c36c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf5303213324a9591812e0b4debf54e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:33.729168 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8c0855f-1e62-4167-8338-e0dc732ab457 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 200 len: 1349 microversion: 2.1 time: 0.103640 Sep 10 21:43:33.729755 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3385/6898] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:33 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:34.752599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:34.753296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] [instance: c5c327c4-e20f-4714-8323-30bda74994bf] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:34.761161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:34.761641 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:34.762103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:34.762800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:34.763252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:34.763678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:34.777439 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] HTTP exception thrown: Instance c5c327c4-e20f-4714-8323-30bda74994bf could not be found. Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Request method failure captured: Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf HTTP/1.1 Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQS7UmgSHw7yFvkkoh_LKzl1PH34Yp9Zr553AKKitOGjmQwuiq4BweTrT0dNxh2QQCBDcXMf3gv5v-AFVFA-8N3I4AYXG1XMKabDp5yo0aw15GuAk1NTGomZJa4MY9fByGRrlPZNVlXCNorkCG5ULByshR4DsdrLppg2PAwF52HDtx0 Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 2bf5303213324a9591812e0b4debf54e Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestMinimumBasicScenario-1754636393 Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2bf5303213324a9591812e0b4debf54e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2bf5303213324a9591812e0b4debf54e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2bf5303213324a9591812e0b4debf54e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2bf5303213324a9591812e0b4debf54e"}]}] Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestMinimumBasicScenario-1754636393 Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 2bf5303213324a9591812e0b4debf54e Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1754636393 Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestMinimumBasicScenario-1754636393-project Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 4086db48df2640109c3ef0f8720c36c8 Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestMinimumBasicScenario-1754636393-project Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance c5c327c4-e20f-4714-8323-30bda74994bf could not be found. Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c5c327c4-e20f-4714-8323-30bda74994bf'} Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5c327c4-e20f-4714-8323-30bda74994bf could not be found. Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5c327c4-e20f-4714-8323-30bda74994bf could not be found. Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:43:34.779082 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:43:34.784288 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:43:34.784288 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:43:34.784288 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:43:34.784288 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:43:34.784288 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:43:34.784288 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5c327c4-e20f-4714-8323-30bda74994bf could not be found. Sep 10 21:43:34.784288 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:43:34.784288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Returning 404 to user: Instance c5c327c4-e20f-4714-8323-30bda74994bf could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:43:34.784288 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f1f67bf9-bc1c-4589-84bc-7b98df391b9b tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf" status: 404 len: 111 microversion: 2.1 time: 0.032403 Sep 10 21:43:34.784288 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3514/6899] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:34 2022] GET /compute/v2.1/servers/c5c327c4-e20f-4714-8323-30bda74994bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:43:34.789511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-841eebaa-8805-4622-b546-2f31f74f8559 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] Calling method '.version_select at 0x7f993f4daf70>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:34.810009 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-841eebaa-8805-4622-b546-2f31f74f8559 tempest-TestMinimumBasicScenario-1754636393 tempest-TestMinimumBasicScenario-1754636393-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2011710182" status: 202 len: 0 microversion: 2.1 time: 0.024371 Sep 10 21:43:34.810621 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3386/6900] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Sep 10 21:43:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2011710182 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:43:43.750741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-95d076ec-1dac-4280-a746-08fc83cd74ba tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'create', calling method: .version_select at 0x7f993fcbd430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1009863992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUM5pralh46zTqeIG66p8JJRtaj8XPGyUZk6nKhghf4WxLcxVzXnKavE+JYPWFtL4QW6bvQWI1mzFNkFDFnW/ulsAy8vb3p5VxgETLMDIF5ssEtYKV78SHEXU7CxS4x+g=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:43:43.756221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:43.769295 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-95d076ec-1dac-4280-a746-08fc83cd74ba tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for project 89de7e77cc234d14943dc99d02388c45. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:43:43.774462 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-95d076ec-1dac-4280-a746-08fc83cd74ba tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for user 2db198ac8f2842638e0edd931ca8d26d and project 89de7e77cc234d14943dc99d02388c45. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:43:43.798470 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-95d076ec-1dac-4280-a746-08fc83cd74ba tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.215754 Sep 10 21:43:43.799074 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3515/6901] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:43:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:43:50.504772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1254418382", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "92798df9-a870-4bb5-aca4-eca239e1bc1d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1009863992", "security_groups": [{"name": "tempest-secgroup-smoke-1332966562"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:43:50.536825 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:50.538050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:50.538675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:50.634769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] validate_networks() for [('92798df9-a870-4bb5-aca4-eca239e1bc1d', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:43:51.160390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:43:51.161053 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:43:51.161819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:43:51.162481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:43:51.162899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:43:51.178530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:51.179025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:51.179665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:51.180407 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:51.180871 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:51.181300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:51.200345 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for project 89de7e77cc234d14943dc99d02388c45. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:43:51.206044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for user 2db198ac8f2842638e0edd931ca8d26d and project 89de7e77cc234d14943dc99d02388c45. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:43:51.220466 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:43:51.223297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:43:51.274235 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bb0234cd-4074-4b56-a310-57ff91df7c99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.773965 Sep 10 21:43:51.275336 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3387/6902] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:43:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:43:51.286943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bcb06611-ba3c-4be6-96b0-24c4fc3af765 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:51.288237 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bcb06611-ba3c-4be6-96b0-24c4fc3af765 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:51.292875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=78 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:43:51.413718 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-bcb06611-ba3c-4be6-96b0-24c4fc3af765 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:51.425648 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bcb06611-ba3c-4be6-96b0-24c4fc3af765 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1267 microversion: 2.1 time: 0.141600 Sep 10 21:43:51.427139 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3516/6903] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:51 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:52.451279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f82995e3-b0ad-4498-a39e-a39bc50bb799 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:52.452012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f82995e3-b0ad-4498-a39e-a39bc50bb799 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:52.460621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82995e3-b0ad-4498-a39e-a39bc50bb799 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:52.461208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82995e3-b0ad-4498-a39e-a39bc50bb799 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:52.461719 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82995e3-b0ad-4498-a39e-a39bc50bb799 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:52.462555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82995e3-b0ad-4498-a39e-a39bc50bb799 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:52.463086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82995e3-b0ad-4498-a39e-a39bc50bb799 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:52.464139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f82995e3-b0ad-4498-a39e-a39bc50bb799 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:52.533144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f82995e3-b0ad-4498-a39e-a39bc50bb799 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:52.541446 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f82995e3-b0ad-4498-a39e-a39bc50bb799 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1319 microversion: 2.1 time: 0.094641 Sep 10 21:43:52.542087 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3388/6904] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:52 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:53.565019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0868240c-02dd-4ab2-a648-f63f3688d7f8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:53.566367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0868240c-02dd-4ab2-a648-f63f3688d7f8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:53.575188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0868240c-02dd-4ab2-a648-f63f3688d7f8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:53.576418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0868240c-02dd-4ab2-a648-f63f3688d7f8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:53.576936 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0868240c-02dd-4ab2-a648-f63f3688d7f8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:53.577905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0868240c-02dd-4ab2-a648-f63f3688d7f8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:53.578379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0868240c-02dd-4ab2-a648-f63f3688d7f8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:53.578823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0868240c-02dd-4ab2-a648-f63f3688d7f8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:53.820954 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0868240c-02dd-4ab2-a648-f63f3688d7f8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:53.829510 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0868240c-02dd-4ab2-a648-f63f3688d7f8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1393 microversion: 2.1 time: 0.268555 Sep 10 21:43:53.830138 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3517/6905] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:53 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1393 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:54.291754 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e291e4a0-ce8b-4aed-9397-0210daab5235 req-29b372e7-14ed-410e-a719-8d40d1ed76af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4325057b-76dd-4c9a-a40a-1c5525fde80e", "tag": "8a5d8cf9-2e1f-4507-b619-7113e71f0319"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:43:54.303204 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e291e4a0-ce8b-4aed-9397-0210daab5235 req-29b372e7-14ed-410e-a719-8d40d1ed76af service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:54.303692 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e291e4a0-ce8b-4aed-9397-0210daab5235 req-29b372e7-14ed-410e-a719-8d40d1ed76af service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:54.304134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e291e4a0-ce8b-4aed-9397-0210daab5235 req-29b372e7-14ed-410e-a719-8d40d1ed76af service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:54.316974 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e291e4a0-ce8b-4aed-9397-0210daab5235 req-29b372e7-14ed-410e-a719-8d40d1ed76af service nova] Creating event network-changed:8a5d8cf9-2e1f-4507-b619-7113e71f0319 for instance 4325057b-76dd-4c9a-a40a-1c5525fde80e on nch2-master-1 Sep 10 21:43:54.322293 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e291e4a0-ce8b-4aed-9397-0210daab5235 req-29b372e7-14ed-410e-a719-8d40d1ed76af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034237 Sep 10 21:43:54.323627 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3389/6906] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:43:54.854200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d5d4b7e2-d6cf-412d-a26f-9ac8341b3ff6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:54.854999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d5d4b7e2-d6cf-412d-a26f-9ac8341b3ff6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:54.862128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5d4b7e2-d6cf-412d-a26f-9ac8341b3ff6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:54.862612 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5d4b7e2-d6cf-412d-a26f-9ac8341b3ff6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:54.863048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5d4b7e2-d6cf-412d-a26f-9ac8341b3ff6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:54.863737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5d4b7e2-d6cf-412d-a26f-9ac8341b3ff6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:54.864219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5d4b7e2-d6cf-412d-a26f-9ac8341b3ff6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:54.864639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5d4b7e2-d6cf-412d-a26f-9ac8341b3ff6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:55.006206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d5d4b7e2-d6cf-412d-a26f-9ac8341b3ff6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:55.014319 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d5d4b7e2-d6cf-412d-a26f-9ac8341b3ff6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1393 microversion: 2.1 time: 0.164425 Sep 10 21:43:55.014922 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3518/6907] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:54 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:56.039457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b030ced3-00bd-4f32-8320-8874f60ff4cb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:56.040317 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b030ced3-00bd-4f32-8320-8874f60ff4cb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:56.047072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b030ced3-00bd-4f32-8320-8874f60ff4cb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:56.047562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b030ced3-00bd-4f32-8320-8874f60ff4cb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:56.048002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b030ced3-00bd-4f32-8320-8874f60ff4cb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:56.048705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b030ced3-00bd-4f32-8320-8874f60ff4cb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:56.049187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b030ced3-00bd-4f32-8320-8874f60ff4cb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:56.049617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b030ced3-00bd-4f32-8320-8874f60ff4cb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:56.192125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b030ced3-00bd-4f32-8320-8874f60ff4cb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:56.200540 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b030ced3-00bd-4f32-8320-8874f60ff4cb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1393 microversion: 2.1 time: 0.166361 Sep 10 21:43:56.201245 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3390/6908] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:56 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:57.224111 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c0c89b65-42ce-4247-8e5d-04a27863cda5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:57.224726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c0c89b65-42ce-4247-8e5d-04a27863cda5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:57.231728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0c89b65-42ce-4247-8e5d-04a27863cda5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:57.232153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0c89b65-42ce-4247-8e5d-04a27863cda5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:57.232592 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0c89b65-42ce-4247-8e5d-04a27863cda5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:57.233288 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0c89b65-42ce-4247-8e5d-04a27863cda5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:57.233748 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0c89b65-42ce-4247-8e5d-04a27863cda5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:57.234216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c0c89b65-42ce-4247-8e5d-04a27863cda5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:57.375354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c0c89b65-42ce-4247-8e5d-04a27863cda5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:57.383057 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c0c89b65-42ce-4247-8e5d-04a27863cda5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1393 microversion: 2.1 time: 0.162962 Sep 10 21:43:57.383644 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3519/6909] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:57 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:58.406849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-596c476b-d04e-4d45-bfe9-904040faf92e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:58.407496 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-596c476b-d04e-4d45-bfe9-904040faf92e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:58.414431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-596c476b-d04e-4d45-bfe9-904040faf92e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:58.414920 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-596c476b-d04e-4d45-bfe9-904040faf92e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:58.415386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-596c476b-d04e-4d45-bfe9-904040faf92e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:58.416626 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-596c476b-d04e-4d45-bfe9-904040faf92e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:58.417167 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-596c476b-d04e-4d45-bfe9-904040faf92e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:58.417528 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-596c476b-d04e-4d45-bfe9-904040faf92e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:58.549237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-596c476b-d04e-4d45-bfe9-904040faf92e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:58.557804 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-596c476b-d04e-4d45-bfe9-904040faf92e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1393 microversion: 2.1 time: 0.154233 Sep 10 21:43:58.558404 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3391/6910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:58 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:43:59.580635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0fd3a5a0-caef-41b8-b890-acf518557de3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:43:59.581281 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0fd3a5a0-caef-41b8-b890-acf518557de3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:43:59.588797 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3a5a0-caef-41b8-b890-acf518557de3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:59.589401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3a5a0-caef-41b8-b890-acf518557de3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:59.589867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3a5a0-caef-41b8-b890-acf518557de3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:59.590577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3a5a0-caef-41b8-b890-acf518557de3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:43:59.591041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3a5a0-caef-41b8-b890-acf518557de3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:43:59.591475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0fd3a5a0-caef-41b8-b890-acf518557de3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:43:59.734143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0fd3a5a0-caef-41b8-b890-acf518557de3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:43:59.742570 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0fd3a5a0-caef-41b8-b890-acf518557de3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1393 microversion: 2.1 time: 0.165897 Sep 10 21:43:59.743381 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3520/6911] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:43:59 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:00.768046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-baf8fc13-054c-458f-b1e6-26a42d0c45dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:00.768700 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-baf8fc13-054c-458f-b1e6-26a42d0c45dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:00.775885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf8fc13-054c-458f-b1e6-26a42d0c45dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:00.776377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf8fc13-054c-458f-b1e6-26a42d0c45dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:00.776815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf8fc13-054c-458f-b1e6-26a42d0c45dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:00.778131 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf8fc13-054c-458f-b1e6-26a42d0c45dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:00.778592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf8fc13-054c-458f-b1e6-26a42d0c45dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:00.779020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-baf8fc13-054c-458f-b1e6-26a42d0c45dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:00.922683 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-baf8fc13-054c-458f-b1e6-26a42d0c45dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:00.930511 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-baf8fc13-054c-458f-b1e6-26a42d0c45dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1393 microversion: 2.1 time: 0.166371 Sep 10 21:44:00.931101 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3392/6912] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:00 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:01.075309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-b5b2d8aa-bcc5-4f92-98b8-89dcd3b6ba2b req-62fa9ea1-5b26-4d78-b923-ae1d1dadfbfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4325057b-76dd-4c9a-a40a-1c5525fde80e", "name": "network-vif-plugged", "status": "completed", "tag": "8a5d8cf9-2e1f-4507-b619-7113e71f0319"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:01.086083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b5b2d8aa-bcc5-4f92-98b8-89dcd3b6ba2b req-62fa9ea1-5b26-4d78-b923-ae1d1dadfbfa service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:01.086487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b5b2d8aa-bcc5-4f92-98b8-89dcd3b6ba2b req-62fa9ea1-5b26-4d78-b923-ae1d1dadfbfa service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:01.086929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-b5b2d8aa-bcc5-4f92-98b8-89dcd3b6ba2b req-62fa9ea1-5b26-4d78-b923-ae1d1dadfbfa service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:01.099785 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-b5b2d8aa-bcc5-4f92-98b8-89dcd3b6ba2b req-62fa9ea1-5b26-4d78-b923-ae1d1dadfbfa service nova] Creating event network-vif-plugged:8a5d8cf9-2e1f-4507-b619-7113e71f0319 for instance 4325057b-76dd-4c9a-a40a-1c5525fde80e on nch2-master-1 Sep 10 21:44:01.104727 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-b5b2d8aa-bcc5-4f92-98b8-89dcd3b6ba2b req-62fa9ea1-5b26-4d78-b923-ae1d1dadfbfa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034055 Sep 10 21:44:01.105511 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3521/6913] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:44:01.954101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-248e3950-90ae-43a2-b514-923804e2d737 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:01.954747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-248e3950-90ae-43a2-b514-923804e2d737 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:01.956788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:01.957468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:01.964750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-248e3950-90ae-43a2-b514-923804e2d737 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:01.965256 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-248e3950-90ae-43a2-b514-923804e2d737 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:01.965712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-248e3950-90ae-43a2-b514-923804e2d737 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:01.966456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-248e3950-90ae-43a2-b514-923804e2d737 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:01.966929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-248e3950-90ae-43a2-b514-923804e2d737 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:01.967367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-248e3950-90ae-43a2-b514-923804e2d737 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:02.102849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-248e3950-90ae-43a2-b514-923804e2d737 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:02.111442 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-248e3950-90ae-43a2-b514-923804e2d737 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1393 microversion: 2.1 time: 0.161387 Sep 10 21:44:02.112014 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3393/6914] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:01 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:03.131992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:03.137764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-39244162-0846-4807-b047-3a12c3c4c055 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:03.138496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-39244162-0846-4807-b047-3a12c3c4c055 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:03.145195 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39244162-0846-4807-b047-3a12c3c4c055 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:03.145690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39244162-0846-4807-b047-3a12c3c4c055 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:03.146194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39244162-0846-4807-b047-3a12c3c4c055 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:03.146985 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39244162-0846-4807-b047-3a12c3c4c055 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:03.147449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39244162-0846-4807-b047-3a12c3c4c055 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:03.147992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-39244162-0846-4807-b047-3a12c3c4c055 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:03.286485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-39244162-0846-4807-b047-3a12c3c4c055 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:03.294342 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-39244162-0846-4807-b047-3a12c3c4c055 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1565 microversion: 2.1 time: 0.163370 Sep 10 21:44:03.294917 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3522/6915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:03 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:03.317425 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-13ab3be1-3cdf-489f-980b-4aa5d8dd3d88 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:03.318068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-13ab3be1-3cdf-489f-980b-4aa5d8dd3d88 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:03.327075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13ab3be1-3cdf-489f-980b-4aa5d8dd3d88 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:03.327568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13ab3be1-3cdf-489f-980b-4aa5d8dd3d88 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:03.328011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13ab3be1-3cdf-489f-980b-4aa5d8dd3d88 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:03.328706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13ab3be1-3cdf-489f-980b-4aa5d8dd3d88 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:03.329171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13ab3be1-3cdf-489f-980b-4aa5d8dd3d88 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:03.329598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-13ab3be1-3cdf-489f-980b-4aa5d8dd3d88 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:03.460859 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-13ab3be1-3cdf-489f-980b-4aa5d8dd3d88 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:03.468918 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-13ab3be1-3cdf-489f-980b-4aa5d8dd3d88 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1565 microversion: 2.1 time: 0.155315 Sep 10 21:44:03.469505 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3394/6916] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:03 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:05.310957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-43a06385-7e4a-4155-81a2-b6a8450ede38 req-ea907473-cd63-4146-8129-f4f54000cb2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4325057b-76dd-4c9a-a40a-1c5525fde80e", "tag": "8a5d8cf9-2e1f-4507-b619-7113e71f0319"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:05.319172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3439da26-cfeb-4d61-a814-3f375761d53e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:05.319895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3439da26-cfeb-4d61-a814-3f375761d53e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:05.322483 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-43a06385-7e4a-4155-81a2-b6a8450ede38 req-ea907473-cd63-4146-8129-f4f54000cb2d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:05.322976 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-43a06385-7e4a-4155-81a2-b6a8450ede38 req-ea907473-cd63-4146-8129-f4f54000cb2d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:05.323617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-43a06385-7e4a-4155-81a2-b6a8450ede38 req-ea907473-cd63-4146-8129-f4f54000cb2d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:05.328949 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3439da26-cfeb-4d61-a814-3f375761d53e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:05.329449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3439da26-cfeb-4d61-a814-3f375761d53e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:05.329909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3439da26-cfeb-4d61-a814-3f375761d53e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:05.331023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3439da26-cfeb-4d61-a814-3f375761d53e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:05.331902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3439da26-cfeb-4d61-a814-3f375761d53e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:05.332400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3439da26-cfeb-4d61-a814-3f375761d53e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:05.336047 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-43a06385-7e4a-4155-81a2-b6a8450ede38 req-ea907473-cd63-4146-8129-f4f54000cb2d service nova] Creating event network-changed:8a5d8cf9-2e1f-4507-b619-7113e71f0319 for instance 4325057b-76dd-4c9a-a40a-1c5525fde80e on nch2-master-1 Sep 10 21:44:05.341444 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-43a06385-7e4a-4155-81a2-b6a8450ede38 req-ea907473-cd63-4146-8129-f4f54000cb2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037528 Sep 10 21:44:05.342434 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3395/6917] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:44:05.571628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3439da26-cfeb-4d61-a814-3f375761d53e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:05.580306 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3439da26-cfeb-4d61-a814-3f375761d53e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1565 microversion: 2.1 time: 0.278864 Sep 10 21:44:05.581358 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3523/6918] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:05 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1565 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:28.834237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:28.835002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=42 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:28.839353 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-40a88e48-8880-454b-aa99-feb8458a49c9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:28.841667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-40a88e48-8880-454b-aa99-feb8458a49c9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:28.849030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40a88e48-8880-454b-aa99-feb8458a49c9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:28.849525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40a88e48-8880-454b-aa99-feb8458a49c9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:28.850021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40a88e48-8880-454b-aa99-feb8458a49c9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:28.850732 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40a88e48-8880-454b-aa99-feb8458a49c9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:28.851196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40a88e48-8880-454b-aa99-feb8458a49c9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:28.851633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-40a88e48-8880-454b-aa99-feb8458a49c9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:28.914986 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-40a88e48-8880-454b-aa99-feb8458a49c9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e/action" status: 200 len: 24535 microversion: 2.1 time: 0.082620 Sep 10 21:44:28.915646 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3396/6919] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:44:28 2022] POST /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e/action => generated 24535 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:44:40.021181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-37a1a180-bf28-4d03-8c9b-9215cd39b64a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:40.021716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-37a1a180-bf28-4d03-8c9b-9215cd39b64a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:40.024100 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:40.024769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=38 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:40.032072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a1a180-bf28-4d03-8c9b-9215cd39b64a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:40.032764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a1a180-bf28-4d03-8c9b-9215cd39b64a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:40.033346 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a1a180-bf28-4d03-8c9b-9215cd39b64a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:40.034088 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a1a180-bf28-4d03-8c9b-9215cd39b64a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:40.034556 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a1a180-bf28-4d03-8c9b-9215cd39b64a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:40.034991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37a1a180-bf28-4d03-8c9b-9215cd39b64a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:40.102049 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-37a1a180-bf28-4d03-8c9b-9215cd39b64a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e/action" status: 202 len: 0 microversion: 2.1 time: 0.084663 Sep 10 21:44:40.102701 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3524/6920] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:44:40 2022] POST /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:44:40.112398 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3526d661-a20b-4c05-bede-35a61d684b72 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:40.113101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3526d661-a20b-4c05-bede-35a61d684b72 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:40.116043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:40.116702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:40.122879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3526d661-a20b-4c05-bede-35a61d684b72 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:40.123422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3526d661-a20b-4c05-bede-35a61d684b72 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:40.124020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3526d661-a20b-4c05-bede-35a61d684b72 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:40.124843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3526d661-a20b-4c05-bede-35a61d684b72 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:40.125310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3526d661-a20b-4c05-bede-35a61d684b72 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:40.125788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3526d661-a20b-4c05-bede-35a61d684b72 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:40.265036 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3526d661-a20b-4c05-bede-35a61d684b72 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:40.273423 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3526d661-a20b-4c05-bede-35a61d684b72 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1688 microversion: 2.1 time: 0.164954 Sep 10 21:44:40.273423 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3397/6921] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:40 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:41.299479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a9d38f0c-83dc-4e1f-b2a7-38cb7035d85d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:41.300120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a9d38f0c-83dc-4e1f-b2a7-38cb7035d85d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:41.306433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d38f0c-83dc-4e1f-b2a7-38cb7035d85d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:41.306917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d38f0c-83dc-4e1f-b2a7-38cb7035d85d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:41.307387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d38f0c-83dc-4e1f-b2a7-38cb7035d85d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:41.308079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d38f0c-83dc-4e1f-b2a7-38cb7035d85d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:41.308542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d38f0c-83dc-4e1f-b2a7-38cb7035d85d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:41.310416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a9d38f0c-83dc-4e1f-b2a7-38cb7035d85d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:41.449004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a9d38f0c-83dc-4e1f-b2a7-38cb7035d85d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:41.457263 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a9d38f0c-83dc-4e1f-b2a7-38cb7035d85d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1668 microversion: 2.1 time: 0.163581 Sep 10 21:44:41.457854 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3525/6922] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:41 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:42.552751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-99d7699a-8168-4ef6-9c51-b3559b68cd9d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:42.554980 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-99d7699a-8168-4ef6-9c51-b3559b68cd9d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:42.562828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99d7699a-8168-4ef6-9c51-b3559b68cd9d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:42.563316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99d7699a-8168-4ef6-9c51-b3559b68cd9d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:42.563751 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99d7699a-8168-4ef6-9c51-b3559b68cd9d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:42.564440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99d7699a-8168-4ef6-9c51-b3559b68cd9d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:42.564893 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99d7699a-8168-4ef6-9c51-b3559b68cd9d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:42.565316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-99d7699a-8168-4ef6-9c51-b3559b68cd9d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:42.631581 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-99d7699a-8168-4ef6-9c51-b3559b68cd9d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e/action" status: 200 len: 32611 microversion: 2.1 time: 0.082604 Sep 10 21:44:42.632269 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3398/6923] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:44:42 2022] POST /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e/action => generated 32611 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:44:42.644835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7789475c-d8e3-42e5-9263-1ebb3bdedc7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:42.645414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7789475c-d8e3-42e5-9263-1ebb3bdedc7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:42.652375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7789475c-d8e3-42e5-9263-1ebb3bdedc7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:42.653577 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7789475c-d8e3-42e5-9263-1ebb3bdedc7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:42.654069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7789475c-d8e3-42e5-9263-1ebb3bdedc7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:42.654774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7789475c-d8e3-42e5-9263-1ebb3bdedc7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:42.655239 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7789475c-d8e3-42e5-9263-1ebb3bdedc7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:42.655673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7789475c-d8e3-42e5-9263-1ebb3bdedc7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:42.724093 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7789475c-d8e3-42e5-9263-1ebb3bdedc7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e/action" status: 202 len: 0 microversion: 2.1 time: 0.082973 Sep 10 21:44:42.724749 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3526/6924] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:44:42 2022] POST /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:44:42.734099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55126087-36c3-4006-9d9f-ceeccaeccfb1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:42.734789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55126087-36c3-4006-9d9f-ceeccaeccfb1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:42.742208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55126087-36c3-4006-9d9f-ceeccaeccfb1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:42.742705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55126087-36c3-4006-9d9f-ceeccaeccfb1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:42.743141 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55126087-36c3-4006-9d9f-ceeccaeccfb1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:42.743935 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55126087-36c3-4006-9d9f-ceeccaeccfb1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:42.744397 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55126087-36c3-4006-9d9f-ceeccaeccfb1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:42.744832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55126087-36c3-4006-9d9f-ceeccaeccfb1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:42.881781 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-55126087-36c3-4006-9d9f-ceeccaeccfb1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:42.890433 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55126087-36c3-4006-9d9f-ceeccaeccfb1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1675 microversion: 2.1 time: 0.160832 Sep 10 21:44:42.891012 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3399/6925] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:42 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:43.915837 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-22739758-e5a1-4bfc-af6c-ab6dff40677c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:43.916555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-22739758-e5a1-4bfc-af6c-ab6dff40677c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:43.923148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22739758-e5a1-4bfc-af6c-ab6dff40677c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:43.923636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22739758-e5a1-4bfc-af6c-ab6dff40677c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:43.924076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22739758-e5a1-4bfc-af6c-ab6dff40677c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:43.924772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22739758-e5a1-4bfc-af6c-ab6dff40677c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:43.925228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22739758-e5a1-4bfc-af6c-ab6dff40677c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:43.925659 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-22739758-e5a1-4bfc-af6c-ab6dff40677c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:44.063000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-22739758-e5a1-4bfc-af6c-ab6dff40677c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:44.070840 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-22739758-e5a1-4bfc-af6c-ab6dff40677c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1683 microversion: 2.1 time: 0.160087 Sep 10 21:44:44.071419 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3527/6926] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:43 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:44.169561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0809ffc-6d04-4108-8574-e59e205e8691 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:44.171788 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0809ffc-6d04-4108-8574-e59e205e8691 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:44.180354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0809ffc-6d04-4108-8574-e59e205e8691 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:44.180852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0809ffc-6d04-4108-8574-e59e205e8691 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:44.181297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0809ffc-6d04-4108-8574-e59e205e8691 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:44.182091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0809ffc-6d04-4108-8574-e59e205e8691 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:44.182745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0809ffc-6d04-4108-8574-e59e205e8691 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:44.183211 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0809ffc-6d04-4108-8574-e59e205e8691 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:44.248475 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0809ffc-6d04-4108-8574-e59e205e8691 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e/action" status: 200 len: 38415 microversion: 2.1 time: 0.083352 Sep 10 21:44:44.249131 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3400/6927] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:44:44 2022] POST /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e/action => generated 38415 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:44:45.364983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-492367ee-f32b-4096-9956-c3f9a1697ff2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:45.366322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-492367ee-f32b-4096-9956-c3f9a1697ff2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:45.367476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-ffed1100-72a8-4db2-8858-46a9978c89e7 req-9e3e48b6-e88a-46b5-afee-8693f99b17a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4325057b-76dd-4c9a-a40a-1c5525fde80e", "tag": "8a5d8cf9-2e1f-4507-b619-7113e71f0319"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:45.373863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-492367ee-f32b-4096-9956-c3f9a1697ff2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:45.374365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-492367ee-f32b-4096-9956-c3f9a1697ff2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:45.374881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-492367ee-f32b-4096-9956-c3f9a1697ff2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:45.375807 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-492367ee-f32b-4096-9956-c3f9a1697ff2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:45.376338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-492367ee-f32b-4096-9956-c3f9a1697ff2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:45.376870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-492367ee-f32b-4096-9956-c3f9a1697ff2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:45.383823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ffed1100-72a8-4db2-8858-46a9978c89e7 req-9e3e48b6-e88a-46b5-afee-8693f99b17a3 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:45.384324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ffed1100-72a8-4db2-8858-46a9978c89e7 req-9e3e48b6-e88a-46b5-afee-8693f99b17a3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:45.384769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ffed1100-72a8-4db2-8858-46a9978c89e7 req-9e3e48b6-e88a-46b5-afee-8693f99b17a3 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:45.403882 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-ffed1100-72a8-4db2-8858-46a9978c89e7 req-9e3e48b6-e88a-46b5-afee-8693f99b17a3 service nova] Creating event network-changed:8a5d8cf9-2e1f-4507-b619-7113e71f0319 for instance 4325057b-76dd-4c9a-a40a-1c5525fde80e on nch2-master-1 Sep 10 21:44:45.409508 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-ffed1100-72a8-4db2-8858-46a9978c89e7 req-9e3e48b6-e88a-46b5-afee-8693f99b17a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046069 Sep 10 21:44:45.410392 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3401/6928] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:44:45.414528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-492367ee-f32b-4096-9956-c3f9a1697ff2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:44:45.532022 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-492367ee-f32b-4096-9956-c3f9a1697ff2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 204 len: 0 microversion: 2.1 time: 0.171364 Sep 10 21:44:45.533280 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3528/6929] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:44:45 2022] DELETE /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:44:45.544421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ec7a357b-ef75-4431-a668-0c16ed29c587 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:45.545176 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ec7a357b-ef75-4431-a668-0c16ed29c587 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:45.553264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec7a357b-ef75-4431-a668-0c16ed29c587 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:45.553779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec7a357b-ef75-4431-a668-0c16ed29c587 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:45.554268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec7a357b-ef75-4431-a668-0c16ed29c587 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:45.555790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec7a357b-ef75-4431-a668-0c16ed29c587 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:45.555790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec7a357b-ef75-4431-a668-0c16ed29c587 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:45.556014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ec7a357b-ef75-4431-a668-0c16ed29c587 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:45.695764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ec7a357b-ef75-4431-a668-0c16ed29c587 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:45.704050 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ec7a357b-ef75-4431-a668-0c16ed29c587 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1689 microversion: 2.1 time: 0.166172 Sep 10 21:44:45.704835 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3402/6930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:45 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:46.729508 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9092f526-3caf-4731-ba1b-8afca82f9692 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:46.730240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9092f526-3caf-4731-ba1b-8afca82f9692 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:46.736907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9092f526-3caf-4731-ba1b-8afca82f9692 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:46.737389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9092f526-3caf-4731-ba1b-8afca82f9692 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:46.737851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9092f526-3caf-4731-ba1b-8afca82f9692 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:46.738541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9092f526-3caf-4731-ba1b-8afca82f9692 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:46.738995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9092f526-3caf-4731-ba1b-8afca82f9692 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:46.739416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9092f526-3caf-4731-ba1b-8afca82f9692 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:46.872537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9092f526-3caf-4731-ba1b-8afca82f9692 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:46.880385 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9092f526-3caf-4731-ba1b-8afca82f9692 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1689 microversion: 2.1 time: 0.155270 Sep 10 21:44:46.880968 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3529/6931] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:46 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:47.723767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-175032cb-b18a-4c81-a5e0-323da52bf556 req-de671527-bfd1-4a8e-ac10-bca6b87b06e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4325057b-76dd-4c9a-a40a-1c5525fde80e", "name": "network-vif-deleted", "tag": "8a5d8cf9-2e1f-4507-b619-7113e71f0319"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:47.736272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-175032cb-b18a-4c81-a5e0-323da52bf556 req-de671527-bfd1-4a8e-ac10-bca6b87b06e7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:47.736745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-175032cb-b18a-4c81-a5e0-323da52bf556 req-de671527-bfd1-4a8e-ac10-bca6b87b06e7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:47.737179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-175032cb-b18a-4c81-a5e0-323da52bf556 req-de671527-bfd1-4a8e-ac10-bca6b87b06e7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:47.752549 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-175032cb-b18a-4c81-a5e0-323da52bf556 req-de671527-bfd1-4a8e-ac10-bca6b87b06e7 service nova] Creating event network-vif-deleted:8a5d8cf9-2e1f-4507-b619-7113e71f0319 for instance 4325057b-76dd-4c9a-a40a-1c5525fde80e on nch2-master-1 Sep 10 21:44:47.757260 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-175032cb-b18a-4c81-a5e0-323da52bf556 req-de671527-bfd1-4a8e-ac10-bca6b87b06e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037320 Sep 10 21:44:47.757911 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3403/6932] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:44:47.904834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:47.905446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:47.912238 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:47.912721 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:47.913155 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:47.913862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:47.914322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:47.914746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:47.947919 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:47.948327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:47.948763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:47.949211 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lazy-loading 'fault' on Instance uuid 4325057b-76dd-4c9a-a40a-1c5525fde80e {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:44:47.992254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:48.001594 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7215152c-9da0-4c6e-8c92-bcde768efe8b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 200 len: 1357 microversion: 2.1 time: 0.100973 Sep 10 21:44:48.002696 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3530/6933] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:47 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:44:49.026663 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:49.027371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 4325057b-76dd-4c9a-a40a-1c5525fde80e] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:49.034542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:49.035032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:49.035474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:49.036168 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:49.036630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:49.037062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:49.051107 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] HTTP exception thrown: Instance 4325057b-76dd-4c9a-a40a-1c5525fde80e could not be found. Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Request method failure captured: Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e HTTP/1.1 Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQUOmtTgV6K-BMoGYvxDxchioERSmqpfPLuUt3LGJfKR4DSKjq6mGKscCmiof0_FepwQHW1VdfGPuuOEuA3gCoWYmo51trMKNExzTnWdvX3v_alk8XXirr1x7LoluSy5vAtxzU4HCU1achY04W8MWdDNvGA_vmwlrmERJSDYC4X8UZc Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 89de7e77cc234d14943dc99d02388c45 Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89de7e77cc234d14943dc99d02388c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89de7e77cc234d14943dc99d02388c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89de7e77cc234d14943dc99d02388c45", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89de7e77cc234d14943dc99d02388c45"}]}] Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 89de7e77cc234d14943dc99d02388c45 Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TestNetworkAdvancedServerOps-253226799-project Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2db198ac8f2842638e0edd931ca8d26d Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-253226799-project Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 4325057b-76dd-4c9a-a40a-1c5525fde80e could not be found. Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '4325057b-76dd-4c9a-a40a-1c5525fde80e'} Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4325057b-76dd-4c9a-a40a-1c5525fde80e could not be found. Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4325057b-76dd-4c9a-a40a-1c5525fde80e could not be found. Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:44:49.052739 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4325057b-76dd-4c9a-a40a-1c5525fde80e could not be found. Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Returning 404 to user: Instance 4325057b-76dd-4c9a-a40a-1c5525fde80e could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-81621095-42b2-4f43-ad26-2789d8d83443 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e" status: 404 len: 111 microversion: 2.1 time: 0.032619 Sep 10 21:44:49.058028 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3404/6934] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:49 2022] GET /compute/v2.1/servers/4325057b-76dd-4c9a-a40a-1c5525fde80e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:44:52.328011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-22a7996a-3981-49d8-8b91-74c5dc2a7da6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '.version_select at 0x7f993fcbd820>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:52.352535 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-22a7996a-3981-49d8-8b91-74c5dc2a7da6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1009863992" status: 202 len: 0 microversion: 2.1 time: 0.029164 Sep 10 21:44:52.353337 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3531/6935] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Sep 10 21:44:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1009863992 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:44:52.379261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-205a42ee-70c0-49fb-9de1-e482088796ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'create', calling method: .version_select at 0x7f993fab18b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-581986325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWiFt+RS2fXDkkL4VmxfphQyVyPAtSRI5Dax0oVvqBFbNVe8e+67oMDAiwb8jnwEiP5IzCjFA6ViniZ1/Vm9UbdlL8mFuJsNuaS9sMvCJVs+jI2qiSy2yCIpy2C7nS9kg=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:52.397955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-205a42ee-70c0-49fb-9de1-e482088796ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for project 89de7e77cc234d14943dc99d02388c45. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:44:52.403207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-205a42ee-70c0-49fb-9de1-e482088796ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for user 2db198ac8f2842638e0edd931ca8d26d and project 89de7e77cc234d14943dc99d02388c45. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:44:52.427225 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-205a42ee-70c0-49fb-9de1-e482088796ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051926 Sep 10 21:44:52.427847 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3405/6936] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:44:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:44:58.351429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:58.357140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1631381991", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "f4a993e5-d8c0-4e95-9b40-b379b1659c61"}], "key_name": "tempest-TestNetworkAdvancedServerOps-581986325", "security_groups": [{"name": "tempest-secgroup-smoke-565918556"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:44:58.478473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] validate_networks() for [('f4a993e5-d8c0-4e95-9b40-b379b1659c61', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:44:58.876561 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:44:58.876994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:44:58.877479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:44:58.877922 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:44:58.878347 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:44:58.888246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:58.888738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:58.889185 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:58.889960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:44:58.890440 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:44:58.890883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:44:58.909806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for project 89de7e77cc234d14943dc99d02388c45. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:44:58.915189 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for user 2db198ac8f2842638e0edd931ca8d26d and project 89de7e77cc234d14943dc99d02388c45. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:44:58.928143 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:44:58.930456 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:44:58.984862 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-49550dcc-c9f4-4a51-9696-8ab1fa0219d4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.635166 Sep 10 21:44:58.992243 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3532/6937] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:44:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:44:59.001704 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-038d18af-bfe5-4711-963c-e45e979c2e7e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:44:59.002493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-038d18af-bfe5-4711-963c-e45e979c2e7e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:44:59.041889 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=32 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:44:59.061551 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-038d18af-bfe5-4711-963c-e45e979c2e7e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:44:59.071395 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-038d18af-bfe5-4711-963c-e45e979c2e7e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1266 microversion: 2.1 time: 0.078035 Sep 10 21:44:59.083266 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3406/6938] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:44:58 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:45:00.097206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93d51687-1dcd-4c5f-8050-1d0bf92435f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:00.098447 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-93d51687-1dcd-4c5f-8050-1d0bf92435f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:00.105945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93d51687-1dcd-4c5f-8050-1d0bf92435f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:00.106442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93d51687-1dcd-4c5f-8050-1d0bf92435f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:00.107105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93d51687-1dcd-4c5f-8050-1d0bf92435f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:00.108175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93d51687-1dcd-4c5f-8050-1d0bf92435f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:00.108690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93d51687-1dcd-4c5f-8050-1d0bf92435f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:00.109194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-93d51687-1dcd-4c5f-8050-1d0bf92435f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:00.191600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-93d51687-1dcd-4c5f-8050-1d0bf92435f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:00.201782 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93d51687-1dcd-4c5f-8050-1d0bf92435f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1326 microversion: 2.1 time: 0.108685 Sep 10 21:45:00.202878 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3533/6939] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:00 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:45:01.228370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dd3c1adc-6292-4c40-be56-117795117b3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:01.228996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dd3c1adc-6292-4c40-be56-117795117b3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:01.243004 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd3c1adc-6292-4c40-be56-117795117b3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:01.244099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd3c1adc-6292-4c40-be56-117795117b3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:01.244485 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd3c1adc-6292-4c40-be56-117795117b3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:01.245492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd3c1adc-6292-4c40-be56-117795117b3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:01.246230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd3c1adc-6292-4c40-be56-117795117b3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:01.246922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dd3c1adc-6292-4c40-be56-117795117b3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:01.507092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dd3c1adc-6292-4c40-be56-117795117b3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:01.515986 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dd3c1adc-6292-4c40-be56-117795117b3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1391 microversion: 2.1 time: 0.292229 Sep 10 21:45:01.517068 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3407/6940] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:01 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1391 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:45:01.978652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-9861191a-01d0-48f1-85d1-5777d4f020f7 req-20887027-3ae3-4255-910b-3fb5e39c1bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c3d471b-e3f5-4561-817b-eba1f92dfc0d", "tag": "46328b56-8098-4e28-8419-5fd49b7d0d0b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:45:01.990108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9861191a-01d0-48f1-85d1-5777d4f020f7 req-20887027-3ae3-4255-910b-3fb5e39c1bbd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:01.990571 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9861191a-01d0-48f1-85d1-5777d4f020f7 req-20887027-3ae3-4255-910b-3fb5e39c1bbd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:01.991004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-9861191a-01d0-48f1-85d1-5777d4f020f7 req-20887027-3ae3-4255-910b-3fb5e39c1bbd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:02.002935 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-9861191a-01d0-48f1-85d1-5777d4f020f7 req-20887027-3ae3-4255-910b-3fb5e39c1bbd service nova] Creating event network-changed:46328b56-8098-4e28-8419-5fd49b7d0d0b for instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d on nch1-master-1 Sep 10 21:45:02.007950 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-9861191a-01d0-48f1-85d1-5777d4f020f7 req-20887027-3ae3-4255-910b-3fb5e39c1bbd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038464 Sep 10 21:45:02.008760 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3534/6941] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:45:02.539798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0243f966-2535-49bd-b291-d1e6b9830945 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:02.540421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0243f966-2535-49bd-b291-d1e6b9830945 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:02.547518 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0243f966-2535-49bd-b291-d1e6b9830945 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:02.548033 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0243f966-2535-49bd-b291-d1e6b9830945 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:02.548459 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0243f966-2535-49bd-b291-d1e6b9830945 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:02.549161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0243f966-2535-49bd-b291-d1e6b9830945 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:02.549623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0243f966-2535-49bd-b291-d1e6b9830945 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:02.550082 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0243f966-2535-49bd-b291-d1e6b9830945 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:02.682734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0243f966-2535-49bd-b291-d1e6b9830945 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:02.691660 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0243f966-2535-49bd-b291-d1e6b9830945 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1391 microversion: 2.1 time: 0.155808 Sep 10 21:45:02.692244 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3408/6942] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:02 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:45:03.716457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8581b8fc-0c14-47e7-839d-d066f8fcb1d9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:03.717105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8581b8fc-0c14-47e7-839d-d066f8fcb1d9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:03.723417 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8581b8fc-0c14-47e7-839d-d066f8fcb1d9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:03.723909 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8581b8fc-0c14-47e7-839d-d066f8fcb1d9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:03.724357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8581b8fc-0c14-47e7-839d-d066f8fcb1d9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:03.725079 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8581b8fc-0c14-47e7-839d-d066f8fcb1d9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:03.725528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8581b8fc-0c14-47e7-839d-d066f8fcb1d9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:03.726001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8581b8fc-0c14-47e7-839d-d066f8fcb1d9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:03.859068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8581b8fc-0c14-47e7-839d-d066f8fcb1d9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:03.867053 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8581b8fc-0c14-47e7-839d-d066f8fcb1d9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1391 microversion: 2.1 time: 0.155922 Sep 10 21:45:03.867625 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3535/6943] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:03 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:45:04.891400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-45b86c2e-96cd-4b9d-b982-e56ad9e115e8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:04.892016 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-45b86c2e-96cd-4b9d-b982-e56ad9e115e8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:04.899225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b86c2e-96cd-4b9d-b982-e56ad9e115e8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:04.899715 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b86c2e-96cd-4b9d-b982-e56ad9e115e8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:04.900162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b86c2e-96cd-4b9d-b982-e56ad9e115e8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:04.900869 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b86c2e-96cd-4b9d-b982-e56ad9e115e8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:04.901329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b86c2e-96cd-4b9d-b982-e56ad9e115e8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:04.901762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-45b86c2e-96cd-4b9d-b982-e56ad9e115e8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:05.062381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-45b86c2e-96cd-4b9d-b982-e56ad9e115e8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:05.070199 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-45b86c2e-96cd-4b9d-b982-e56ad9e115e8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1391 microversion: 2.1 time: 0.182775 Sep 10 21:45:05.070776 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3409/6944] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:04 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:45:06.094738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-972fa5fa-eb59-4061-9182-1384e5070187 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:06.095513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-972fa5fa-eb59-4061-9182-1384e5070187 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:06.102547 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-972fa5fa-eb59-4061-9182-1384e5070187 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:06.103040 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-972fa5fa-eb59-4061-9182-1384e5070187 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:06.103483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-972fa5fa-eb59-4061-9182-1384e5070187 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:06.104191 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-972fa5fa-eb59-4061-9182-1384e5070187 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:06.104651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-972fa5fa-eb59-4061-9182-1384e5070187 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:06.105186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-972fa5fa-eb59-4061-9182-1384e5070187 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:06.242122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-972fa5fa-eb59-4061-9182-1384e5070187 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:06.250549 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-972fa5fa-eb59-4061-9182-1384e5070187 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1391 microversion: 2.1 time: 0.159829 Sep 10 21:45:06.251141 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3536/6945] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:06 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:45:07.274092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7126432a-d376-4ec1-a67a-21e164e97bb8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:07.274640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7126432a-d376-4ec1-a67a-21e164e97bb8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:07.282029 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7126432a-d376-4ec1-a67a-21e164e97bb8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:07.282516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7126432a-d376-4ec1-a67a-21e164e97bb8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:07.282952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7126432a-d376-4ec1-a67a-21e164e97bb8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:07.283643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7126432a-d376-4ec1-a67a-21e164e97bb8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:07.284098 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7126432a-d376-4ec1-a67a-21e164e97bb8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:07.284524 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7126432a-d376-4ec1-a67a-21e164e97bb8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:07.419108 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7126432a-d376-4ec1-a67a-21e164e97bb8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:07.426834 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7126432a-d376-4ec1-a67a-21e164e97bb8 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1391 microversion: 2.1 time: 0.156821 Sep 10 21:45:07.427406 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3410/6946] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:07 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:45:07.686672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-f3e10e4a-deda-4951-95d7-9dc98c0b1b50 req-ccc4cf2b-b185-460f-a1f2-549324fa59ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3d471b-e3f5-4561-817b-eba1f92dfc0d", "name": "network-vif-plugged", "status": "completed", "tag": "46328b56-8098-4e28-8419-5fd49b7d0d0b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:45:07.697182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f3e10e4a-deda-4951-95d7-9dc98c0b1b50 req-ccc4cf2b-b185-460f-a1f2-549324fa59ab service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:07.697657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f3e10e4a-deda-4951-95d7-9dc98c0b1b50 req-ccc4cf2b-b185-460f-a1f2-549324fa59ab service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:07.698117 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-f3e10e4a-deda-4951-95d7-9dc98c0b1b50 req-ccc4cf2b-b185-460f-a1f2-549324fa59ab service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:07.710992 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-f3e10e4a-deda-4951-95d7-9dc98c0b1b50 req-ccc4cf2b-b185-460f-a1f2-549324fa59ab service nova] Creating event network-vif-plugged:46328b56-8098-4e28-8419-5fd49b7d0d0b for instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d on nch1-master-1 Sep 10 21:45:07.716795 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-f3e10e4a-deda-4951-95d7-9dc98c0b1b50 req-ccc4cf2b-b185-460f-a1f2-549324fa59ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034577 Sep 10 21:45:07.717412 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3537/6947] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:45:08.449615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-beace03c-f00d-4443-a165-94d663890a17 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:08.450268 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-beace03c-f00d-4443-a165-94d663890a17 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:08.457129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-beace03c-f00d-4443-a165-94d663890a17 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:08.457621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-beace03c-f00d-4443-a165-94d663890a17 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:08.458094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-beace03c-f00d-4443-a165-94d663890a17 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:08.458800 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-beace03c-f00d-4443-a165-94d663890a17 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:08.459261 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-beace03c-f00d-4443-a165-94d663890a17 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:08.459691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-beace03c-f00d-4443-a165-94d663890a17 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:08.595870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-beace03c-f00d-4443-a165-94d663890a17 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:08.603711 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-beace03c-f00d-4443-a165-94d663890a17 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1391 microversion: 2.1 time: 0.158016 Sep 10 21:45:08.604292 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3411/6948] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:08 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:45:09.628530 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-60998da9-e0cf-4ede-add3-714b81392e3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:09.629287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-60998da9-e0cf-4ede-add3-714b81392e3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:09.632137 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:45:09.632941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:45:09.639951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60998da9-e0cf-4ede-add3-714b81392e3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:09.640476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60998da9-e0cf-4ede-add3-714b81392e3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:09.640929 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60998da9-e0cf-4ede-add3-714b81392e3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:09.641649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60998da9-e0cf-4ede-add3-714b81392e3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:09.642146 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60998da9-e0cf-4ede-add3-714b81392e3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:09.642580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-60998da9-e0cf-4ede-add3-714b81392e3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:09.781252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-60998da9-e0cf-4ede-add3-714b81392e3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:09.789280 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-60998da9-e0cf-4ede-add3-714b81392e3f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1562 microversion: 2.1 time: 0.165060 Sep 10 21:45:09.789882 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3538/6949] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:09 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:45:09.812446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-605fb9e9-f590-4262-91b6-9095dce95db2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:09.813150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-605fb9e9-f590-4262-91b6-9095dce95db2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:09.815056 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:45:09.821146 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-605fb9e9-f590-4262-91b6-9095dce95db2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:09.821635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-605fb9e9-f590-4262-91b6-9095dce95db2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:09.822109 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-605fb9e9-f590-4262-91b6-9095dce95db2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:09.822832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-605fb9e9-f590-4262-91b6-9095dce95db2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:09.823323 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-605fb9e9-f590-4262-91b6-9095dce95db2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:09.824284 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-605fb9e9-f590-4262-91b6-9095dce95db2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:09.958747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-605fb9e9-f590-4262-91b6-9095dce95db2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:09.967187 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-605fb9e9-f590-4262-91b6-9095dce95db2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1562 microversion: 2.1 time: 0.158741 Sep 10 21:45:09.967773 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3412/6950] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:09 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:45:11.813719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-07a35a22-e99b-473d-bd2a-92a0fb709538 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:45:11.814645 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-07a35a22-e99b-473d-bd2a-92a0fb709538 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:11.817408 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:45:11.824270 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07a35a22-e99b-473d-bd2a-92a0fb709538 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:11.825025 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07a35a22-e99b-473d-bd2a-92a0fb709538 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:11.825476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07a35a22-e99b-473d-bd2a-92a0fb709538 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:11.826228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07a35a22-e99b-473d-bd2a-92a0fb709538 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:11.826698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07a35a22-e99b-473d-bd2a-92a0fb709538 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:11.827327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-07a35a22-e99b-473d-bd2a-92a0fb709538 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:11.893019 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1b9b8863-4228-45b5-bced-cc6a4da6e1b4 req-a9792af9-566b-4f03-b375-217660392fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c3d471b-e3f5-4561-817b-eba1f92dfc0d", "tag": "46328b56-8098-4e28-8419-5fd49b7d0d0b"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:45:11.898823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:45:11.905567 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1b9b8863-4228-45b5-bced-cc6a4da6e1b4 req-a9792af9-566b-4f03-b375-217660392fc1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:11.906085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1b9b8863-4228-45b5-bced-cc6a4da6e1b4 req-a9792af9-566b-4f03-b375-217660392fc1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:11.906735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1b9b8863-4228-45b5-bced-cc6a4da6e1b4 req-a9792af9-566b-4f03-b375-217660392fc1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:11.919881 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1b9b8863-4228-45b5-bced-cc6a4da6e1b4 req-a9792af9-566b-4f03-b375-217660392fc1 service nova] Creating event network-changed:46328b56-8098-4e28-8419-5fd49b7d0d0b for instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d on nch1-master-1 Sep 10 21:45:11.925469 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1b9b8863-4228-45b5-bced-cc6a4da6e1b4 req-a9792af9-566b-4f03-b375-217660392fc1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120164 Sep 10 21:45:11.926299 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3413/6951] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:45:11.974812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-07a35a22-e99b-473d-bd2a-92a0fb709538 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:45:11.984277 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-07a35a22-e99b-473d-bd2a-92a0fb709538 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1562 microversion: 2.1 time: 0.181408 Sep 10 21:45:11.984871 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3539/6952] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:45:11 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1562 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:45:45.280341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=38 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:45:45.281089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:45:45.286032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-308ad815-20cf-4033-9df5-aac7ebad26ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:45:45.288293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-308ad815-20cf-4033-9df5-aac7ebad26ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:45:45.295679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308ad815-20cf-4033-9df5-aac7ebad26ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:45.296164 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308ad815-20cf-4033-9df5-aac7ebad26ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:45.296599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308ad815-20cf-4033-9df5-aac7ebad26ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:45.297285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308ad815-20cf-4033-9df5-aac7ebad26ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:45:45.297738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308ad815-20cf-4033-9df5-aac7ebad26ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:45:45.298185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-308ad815-20cf-4033-9df5-aac7ebad26ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:45:45.369629 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-308ad815-20cf-4033-9df5-aac7ebad26ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d/action" status: 200 len: 24572 microversion: 2.1 time: 0.091151 Sep 10 21:45:45.370595 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3414/6953] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:45:45 2022] POST /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d/action => generated 24572 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:46:15.817245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:46:15.818019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=36 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:46:15.822052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-66bd00a3-8865-468e-8940-2bb262039cce tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:46:15.825059 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-66bd00a3-8865-468e-8940-2bb262039cce tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:15.831941 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66bd00a3-8865-468e-8940-2bb262039cce tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:15.832435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66bd00a3-8865-468e-8940-2bb262039cce tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:15.832883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66bd00a3-8865-468e-8940-2bb262039cce tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:15.833594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66bd00a3-8865-468e-8940-2bb262039cce tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:15.834095 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66bd00a3-8865-468e-8940-2bb262039cce tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:15.834532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66bd00a3-8865-468e-8940-2bb262039cce tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:15.911419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-66bd00a3-8865-468e-8940-2bb262039cce tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d/action" status: 202 len: 0 microversion: 2.1 time: 0.095755 Sep 10 21:46:15.912067 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3540/6954] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:46:15 2022] POST /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:46:15.921627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a55b9cc2-c449-4811-811a-7f1e520601dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:15.922367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a55b9cc2-c449-4811-811a-7f1e520601dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:15.924902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:46:15.925569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:46:15.931998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a55b9cc2-c449-4811-811a-7f1e520601dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:15.932595 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a55b9cc2-c449-4811-811a-7f1e520601dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:15.933552 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a55b9cc2-c449-4811-811a-7f1e520601dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:15.934482 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a55b9cc2-c449-4811-811a-7f1e520601dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:15.934948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a55b9cc2-c449-4811-811a-7f1e520601dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:15.935381 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a55b9cc2-c449-4811-811a-7f1e520601dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:16.341007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a55b9cc2-c449-4811-811a-7f1e520601dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:16.349007 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a55b9cc2-c449-4811-811a-7f1e520601dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1673 microversion: 2.1 time: 0.432312 Sep 10 21:46:16.349851 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3415/6955] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:15 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1673 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:46:17.374266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ab69fd77-39a6-49e3-8210-a63816cae389 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:17.374969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ab69fd77-39a6-49e3-8210-a63816cae389 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:17.381286 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab69fd77-39a6-49e3-8210-a63816cae389 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:17.381771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab69fd77-39a6-49e3-8210-a63816cae389 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:17.382247 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab69fd77-39a6-49e3-8210-a63816cae389 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:17.382944 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab69fd77-39a6-49e3-8210-a63816cae389 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:17.383405 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab69fd77-39a6-49e3-8210-a63816cae389 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:17.383839 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ab69fd77-39a6-49e3-8210-a63816cae389 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:17.642833 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ab69fd77-39a6-49e3-8210-a63816cae389 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:17.650558 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ab69fd77-39a6-49e3-8210-a63816cae389 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1678 microversion: 2.1 time: 0.281739 Sep 10 21:46:17.651135 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3541/6956] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:17 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:46:18.676339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6e361163-134a-4881-b0a2-4451c5158ff3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:18.676953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6e361163-134a-4881-b0a2-4451c5158ff3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:18.683584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e361163-134a-4881-b0a2-4451c5158ff3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:18.684073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e361163-134a-4881-b0a2-4451c5158ff3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:18.684516 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e361163-134a-4881-b0a2-4451c5158ff3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:18.685212 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e361163-134a-4881-b0a2-4451c5158ff3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:18.685672 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e361163-134a-4881-b0a2-4451c5158ff3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:18.686134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6e361163-134a-4881-b0a2-4451c5158ff3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:18.821765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6e361163-134a-4881-b0a2-4451c5158ff3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:18.829706 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6e361163-134a-4881-b0a2-4451c5158ff3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1678 microversion: 2.1 time: 0.157311 Sep 10 21:46:18.830308 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3416/6957] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:18 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:46:19.854214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9c3c03c3-d90c-49bd-a8f5-e989f7e27b68 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:19.854847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9c3c03c3-d90c-49bd-a8f5-e989f7e27b68 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:19.862920 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c3c03c3-d90c-49bd-a8f5-e989f7e27b68 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:19.863407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c3c03c3-d90c-49bd-a8f5-e989f7e27b68 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:19.863843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c3c03c3-d90c-49bd-a8f5-e989f7e27b68 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:19.864538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c3c03c3-d90c-49bd-a8f5-e989f7e27b68 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:19.864986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c3c03c3-d90c-49bd-a8f5-e989f7e27b68 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:19.865419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9c3c03c3-d90c-49bd-a8f5-e989f7e27b68 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:20.000032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9c3c03c3-d90c-49bd-a8f5-e989f7e27b68 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:20.007821 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9c3c03c3-d90c-49bd-a8f5-e989f7e27b68 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1678 microversion: 2.1 time: 0.157497 Sep 10 21:46:20.008390 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3542/6958] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:19 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:46:21.031456 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8cb633e6-cc1d-41e8-9498-63d27d2a6f61 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:21.032077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8cb633e6-cc1d-41e8-9498-63d27d2a6f61 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:21.039124 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cb633e6-cc1d-41e8-9498-63d27d2a6f61 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:21.039622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cb633e6-cc1d-41e8-9498-63d27d2a6f61 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:21.040067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cb633e6-cc1d-41e8-9498-63d27d2a6f61 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:21.040780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cb633e6-cc1d-41e8-9498-63d27d2a6f61 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:21.041224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cb633e6-cc1d-41e8-9498-63d27d2a6f61 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:21.041653 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8cb633e6-cc1d-41e8-9498-63d27d2a6f61 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:21.171823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8cb633e6-cc1d-41e8-9498-63d27d2a6f61 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:21.179726 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8cb633e6-cc1d-41e8-9498-63d27d2a6f61 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1678 microversion: 2.1 time: 0.152336 Sep 10 21:46:21.180295 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3417/6959] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:21 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:46:22.203899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-17c820ac-f6db-4722-b6a7-f9da5b9e8d6b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:22.204522 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-17c820ac-f6db-4722-b6a7-f9da5b9e8d6b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:22.211406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17c820ac-f6db-4722-b6a7-f9da5b9e8d6b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:22.211901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17c820ac-f6db-4722-b6a7-f9da5b9e8d6b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:22.212352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17c820ac-f6db-4722-b6a7-f9da5b9e8d6b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:22.213055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17c820ac-f6db-4722-b6a7-f9da5b9e8d6b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:22.213521 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17c820ac-f6db-4722-b6a7-f9da5b9e8d6b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:22.213987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-17c820ac-f6db-4722-b6a7-f9da5b9e8d6b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:22.344955 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-17c820ac-f6db-4722-b6a7-f9da5b9e8d6b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:22.352914 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-17c820ac-f6db-4722-b6a7-f9da5b9e8d6b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1678 microversion: 2.1 time: 0.153647 Sep 10 21:46:22.353502 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3543/6960] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:22 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:46:23.377842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-59228b0b-98ad-40f4-8c52-19fa884b1174 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:23.378471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-59228b0b-98ad-40f4-8c52-19fa884b1174 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:23.385324 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59228b0b-98ad-40f4-8c52-19fa884b1174 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:23.385810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59228b0b-98ad-40f4-8c52-19fa884b1174 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:23.386293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59228b0b-98ad-40f4-8c52-19fa884b1174 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:23.387185 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59228b0b-98ad-40f4-8c52-19fa884b1174 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:23.387993 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59228b0b-98ad-40f4-8c52-19fa884b1174 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:23.388429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-59228b0b-98ad-40f4-8c52-19fa884b1174 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:23.528216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-59228b0b-98ad-40f4-8c52-19fa884b1174 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:23.536211 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-59228b0b-98ad-40f4-8c52-19fa884b1174 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1678 microversion: 2.1 time: 0.162311 Sep 10 21:46:23.536807 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3418/6961] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:23 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:46:24.561196 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-27fdf178-3cfd-4ab9-acc0-6cf18808ba64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:24.561874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-27fdf178-3cfd-4ab9-acc0-6cf18808ba64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:24.568810 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27fdf178-3cfd-4ab9-acc0-6cf18808ba64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:24.569306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27fdf178-3cfd-4ab9-acc0-6cf18808ba64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:24.569752 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27fdf178-3cfd-4ab9-acc0-6cf18808ba64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:24.570486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27fdf178-3cfd-4ab9-acc0-6cf18808ba64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:24.570952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27fdf178-3cfd-4ab9-acc0-6cf18808ba64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:24.571389 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27fdf178-3cfd-4ab9-acc0-6cf18808ba64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:24.705673 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-27fdf178-3cfd-4ab9-acc0-6cf18808ba64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:24.714131 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-27fdf178-3cfd-4ab9-acc0-6cf18808ba64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1678 microversion: 2.1 time: 0.157482 Sep 10 21:46:24.714712 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3544/6962] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:24 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:46:25.738666 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-427939ea-e27d-4dfc-99b4-1f38213cf96d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:25.739280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-427939ea-e27d-4dfc-99b4-1f38213cf96d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:25.746107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-427939ea-e27d-4dfc-99b4-1f38213cf96d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:25.747305 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-427939ea-e27d-4dfc-99b4-1f38213cf96d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:25.747750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-427939ea-e27d-4dfc-99b4-1f38213cf96d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:25.748470 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-427939ea-e27d-4dfc-99b4-1f38213cf96d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:25.748932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-427939ea-e27d-4dfc-99b4-1f38213cf96d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:25.749359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-427939ea-e27d-4dfc-99b4-1f38213cf96d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:25.883707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-427939ea-e27d-4dfc-99b4-1f38213cf96d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:25.892381 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-427939ea-e27d-4dfc-99b4-1f38213cf96d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1678 microversion: 2.1 time: 0.158136 Sep 10 21:46:25.892956 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3419/6963] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:25 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:46:26.916693 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e0200b82-3b31-48c8-882d-34e5cc23663e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:26.917342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e0200b82-3b31-48c8-882d-34e5cc23663e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:26.925669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0200b82-3b31-48c8-882d-34e5cc23663e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:26.926186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0200b82-3b31-48c8-882d-34e5cc23663e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:26.926627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0200b82-3b31-48c8-882d-34e5cc23663e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:26.927333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0200b82-3b31-48c8-882d-34e5cc23663e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:26.927792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0200b82-3b31-48c8-882d-34e5cc23663e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:26.928225 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e0200b82-3b31-48c8-882d-34e5cc23663e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:27.062371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e0200b82-3b31-48c8-882d-34e5cc23663e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:27.070140 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e0200b82-3b31-48c8-882d-34e5cc23663e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1678 microversion: 2.1 time: 0.157412 Sep 10 21:46:27.070716 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3545/6964] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:26 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:46:28.095095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1ceb928d-31b5-48c1-83ec-b756f79d0d8f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:46:28.095759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1ceb928d-31b5-48c1-83ec-b756f79d0d8f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:46:28.102735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ceb928d-31b5-48c1-83ec-b756f79d0d8f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:28.103210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ceb928d-31b5-48c1-83ec-b756f79d0d8f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:28.103651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ceb928d-31b5-48c1-83ec-b756f79d0d8f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:28.104339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ceb928d-31b5-48c1-83ec-b756f79d0d8f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:46:28.104794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ceb928d-31b5-48c1-83ec-b756f79d0d8f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:46:28.105226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1ceb928d-31b5-48c1-83ec-b756f79d0d8f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:46:28.238375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1ceb928d-31b5-48c1-83ec-b756f79d0d8f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:46:28.246161 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1ceb928d-31b5-48c1-83ec-b756f79d0d8f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1681 microversion: 2.1 time: 0.155639 Sep 10 21:46:28.247403 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3420/6965] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:46:28 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:00.470542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7a09da5c-31d5-4d0d-989c-08053cdf17de tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:47:00.472856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7a09da5c-31d5-4d0d-989c-08053cdf17de tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:00.476061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:00.476737 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:00.483685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a09da5c-31d5-4d0d-989c-08053cdf17de tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:00.484175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a09da5c-31d5-4d0d-989c-08053cdf17de tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:00.484614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a09da5c-31d5-4d0d-989c-08053cdf17de tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:00.485317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a09da5c-31d5-4d0d-989c-08053cdf17de tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:00.485776 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a09da5c-31d5-4d0d-989c-08053cdf17de tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:00.486611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7a09da5c-31d5-4d0d-989c-08053cdf17de tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:00.563134 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7a09da5c-31d5-4d0d-989c-08053cdf17de tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d/action" status: 200 len: 69117 microversion: 2.1 time: 0.096404 Sep 10 21:47:00.563819 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3546/6966] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:47:00 2022] POST /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d/action => generated 69117 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:47:17.845302 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e042dd2b-1aaa-4eea-94c4-400fa4ae3766 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:17.845895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e042dd2b-1aaa-4eea-94c4-400fa4ae3766 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:17.848270 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 21:47:17.848401 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 21:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d (ip 10.222.0.33) !!! Sep 10 21:47:17.850389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=12 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:17.851127 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=36 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:17.860857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e042dd2b-1aaa-4eea-94c4-400fa4ae3766 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:17.861729 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e042dd2b-1aaa-4eea-94c4-400fa4ae3766 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:17.862282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e042dd2b-1aaa-4eea-94c4-400fa4ae3766 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:17.863066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e042dd2b-1aaa-4eea-94c4-400fa4ae3766 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:17.863590 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e042dd2b-1aaa-4eea-94c4-400fa4ae3766 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:17.864086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e042dd2b-1aaa-4eea-94c4-400fa4ae3766 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:17.890983 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:17.892107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:17.904431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e042dd2b-1aaa-4eea-94c4-400fa4ae3766 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:47:17.948129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-bf2a03b0-dc54-44a7-b280-009c655de868 req-bad1c6e8-d4a5-4649-89e0-227209c47e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c3d471b-e3f5-4561-817b-eba1f92dfc0d", "tag": "46328b56-8098-4e28-8419-5fd49b7d0d0b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:47:17.961306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bf2a03b0-dc54-44a7-b280-009c655de868 req-bad1c6e8-d4a5-4649-89e0-227209c47e0e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:17.961769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bf2a03b0-dc54-44a7-b280-009c655de868 req-bad1c6e8-d4a5-4649-89e0-227209c47e0e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:17.962336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-bf2a03b0-dc54-44a7-b280-009c655de868 req-bad1c6e8-d4a5-4649-89e0-227209c47e0e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:17.975663 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-bf2a03b0-dc54-44a7-b280-009c655de868 req-bad1c6e8-d4a5-4649-89e0-227209c47e0e service nova] Creating event network-changed:46328b56-8098-4e28-8419-5fd49b7d0d0b for instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d on nch1-master-1 Sep 10 21:47:17.982778 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-bf2a03b0-dc54-44a7-b280-009c655de868 req-bad1c6e8-d4a5-4649-89e0-227209c47e0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097678 Sep 10 21:47:17.983481 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3547/6967] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:47:18.000379 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e042dd2b-1aaa-4eea-94c4-400fa4ae3766 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 204 len: 0 microversion: 2.1 time: 0.159325 Sep 10 21:47:18.001201 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3421/6968] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:47:17 2022] DELETE /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 21:47:18.009786 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c1293467-3297-4de5-bb03-1c5b3928a070 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:18.010642 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c1293467-3297-4de5-bb03-1c5b3928a070 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:18.017580 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1293467-3297-4de5-bb03-1c5b3928a070 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:18.018183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1293467-3297-4de5-bb03-1c5b3928a070 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:18.018689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1293467-3297-4de5-bb03-1c5b3928a070 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:18.019458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1293467-3297-4de5-bb03-1c5b3928a070 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:18.019986 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1293467-3297-4de5-bb03-1c5b3928a070 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:18.020552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c1293467-3297-4de5-bb03-1c5b3928a070 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:18.171987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c1293467-3297-4de5-bb03-1c5b3928a070 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:18.179819 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c1293467-3297-4de5-bb03-1c5b3928a070 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1687 microversion: 2.1 time: 0.174343 Sep 10 21:47:18.180408 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3548/6969] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:18 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:19.206163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7bfd7214-f426-4318-a54b-62be86191582 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:19.207014 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7bfd7214-f426-4318-a54b-62be86191582 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:19.214100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bfd7214-f426-4318-a54b-62be86191582 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:19.214698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bfd7214-f426-4318-a54b-62be86191582 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:19.215241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bfd7214-f426-4318-a54b-62be86191582 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:19.215981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bfd7214-f426-4318-a54b-62be86191582 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:19.216443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bfd7214-f426-4318-a54b-62be86191582 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:19.216879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7bfd7214-f426-4318-a54b-62be86191582 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:19.436007 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7bfd7214-f426-4318-a54b-62be86191582 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:19.443947 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7bfd7214-f426-4318-a54b-62be86191582 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1687 microversion: 2.1 time: 0.242460 Sep 10 21:47:19.444796 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3422/6970] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:19 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1687 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:20.284384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d9d7d18c-c276-414f-972f-425cdcf15922 req-b3b4474d-a75d-4abb-93d8-58a1aa2fd46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3d471b-e3f5-4561-817b-eba1f92dfc0d", "name": "network-vif-deleted", "tag": "46328b56-8098-4e28-8419-5fd49b7d0d0b"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:47:20.295464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d9d7d18c-c276-414f-972f-425cdcf15922 req-b3b4474d-a75d-4abb-93d8-58a1aa2fd46a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:20.295878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d9d7d18c-c276-414f-972f-425cdcf15922 req-b3b4474d-a75d-4abb-93d8-58a1aa2fd46a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:20.296317 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d9d7d18c-c276-414f-972f-425cdcf15922 req-b3b4474d-a75d-4abb-93d8-58a1aa2fd46a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:20.307901 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d9d7d18c-c276-414f-972f-425cdcf15922 req-b3b4474d-a75d-4abb-93d8-58a1aa2fd46a service nova] Creating event network-vif-deleted:46328b56-8098-4e28-8419-5fd49b7d0d0b for instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d on nch1-master-1 Sep 10 21:47:20.313730 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d9d7d18c-c276-414f-972f-425cdcf15922 req-b3b4474d-a75d-4abb-93d8-58a1aa2fd46a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033180 Sep 10 21:47:20.314418 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3549/6971] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:47:20.469579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:20.470234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:20.477390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:20.477924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:20.478377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:20.479085 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:20.479547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:20.479981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:20.513673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:20.514203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:20.514646 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:20.515101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lazy-loading 'fault' on Instance uuid 2c3d471b-e3f5-4561-817b-eba1f92dfc0d {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:47:20.556820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:20.567672 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-09f63513-e4e9-401c-930a-7a55eed4db5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 200 len: 1356 microversion: 2.1 time: 0.102573 Sep 10 21:47:20.568267 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3423/6972] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:20 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:21.593562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:21.594242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 2c3d471b-e3f5-4561-817b-eba1f92dfc0d] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:21.600444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:21.600935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:21.601378 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:21.602112 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:21.602574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:21.603006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:21.616645 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] HTTP exception thrown: Instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d could not be found. Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Request method failure captured: Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d HTTP/1.1 Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQUOmtTgV6K-BMoGYvxDxchioERSmqpfPLuUt3LGJfKR4DSKjq6mGKscCmiof0_FepwQHW1VdfGPuuOEuA3gCoWYmo51trMKNExzTnWdvX3v_alk8XXirr1x7LoluSy5vAtxzU4HCU1achY04W8MWdDNvGA_vmwlrmERJSDYC4X8UZc Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 89de7e77cc234d14943dc99d02388c45 Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89de7e77cc234d14943dc99d02388c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89de7e77cc234d14943dc99d02388c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89de7e77cc234d14943dc99d02388c45", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89de7e77cc234d14943dc99d02388c45"}]}] Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 89de7e77cc234d14943dc99d02388c45 Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestNetworkAdvancedServerOps-253226799-project Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2db198ac8f2842638e0edd931ca8d26d Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestNetworkAdvancedServerOps-253226799-project Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d could not be found. Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '2c3d471b-e3f5-4561-817b-eba1f92dfc0d'} Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d could not be found. Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d could not be found. Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:47:21.618321 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d could not be found. Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Returning 404 to user: Instance 2c3d471b-e3f5-4561-817b-eba1f92dfc0d could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d5dc8b3a-fcf6-475c-9b87-2f9c221c606f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d" status: 404 len: 111 microversion: 2.1 time: 0.032094 Sep 10 21:47:21.623869 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3550/6973] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:21 2022] GET /compute/v2.1/servers/2c3d471b-e3f5-4561-817b-eba1f92dfc0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:47:24.900232 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-beb44195-2e1e-45cf-aa49-45dfa3cd368f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '.version_select at 0x7f99445bd820>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:24.905766 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [None req-beb44195-2e1e-45cf-aa49-45dfa3cd368f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [a9c96e39-1220-4d2e-ba7b-61e5a6215d33] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:47:25.917295 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [None req-beb44195-2e1e-45cf-aa49-45dfa3cd368f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [a9c96e39-1220-4d2e-ba7b-61e5a6215d33] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 40656. Sep 10 21:47:25.940251 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-beb44195-2e1e-45cf-aa49-45dfa3cd368f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-581986325" status: 202 len: 0 microversion: 2.1 time: 1.043923 Sep 10 21:47:25.940850 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3424/6974] 10.222.0.33 () {58 vars in 1281 bytes} [Sat Sep 10 21:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-581986325 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:47:25.969504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ef5c9c0-b6ee-4f5b-b147-1442635dfdc9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'create', calling method: .version_select at 0x7f993fc700d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1941398165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9z/DGSYuVkp/0KOV+LmPkLL37VO1eLCunsP7cmq2tZ+xsV3PFgPG6bHMl/zjy9YsoRrmu+LdIrM2ZgJ69bmJMJ1ZeEJ0PqewTypRt4HA+VmX7G+0RcMwS1qEMWjm6WnA=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:47:25.992855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2ef5c9c0-b6ee-4f5b-b147-1442635dfdc9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for project 89de7e77cc234d14943dc99d02388c45. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:47:25.998188 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-2ef5c9c0-b6ee-4f5b-b147-1442635dfdc9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for user 2db198ac8f2842638e0edd931ca8d26d and project 89de7e77cc234d14943dc99d02388c45. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:47:26.012186 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ef5c9c0-b6ee-4f5b-b147-1442635dfdc9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [80ac8596-1959-43fe-97fe-8b193e3e5de9] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:47:27.018949 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ef5c9c0-b6ee-4f5b-b147-1442635dfdc9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [80ac8596-1959-43fe-97fe-8b193e3e5de9] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 40666. Sep 10 21:47:27.034709 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ef5c9c0-b6ee-4f5b-b147-1442635dfdc9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.069294 Sep 10 21:47:27.035312 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3551/6975] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:47:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:47:32.622823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:32.627209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-500653663", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "49e5a018-652a-46db-8ad2-8c72d8f7fc61"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1941398165", "security_groups": [{"name": "tempest-secgroup-smoke-314421490"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:47:32.757142 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] validate_networks() for [('49e5a018-652a-46db-8ad2-8c72d8f7fc61', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:47:33.371603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:47:33.372265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:47:33.372913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:47:33.373440 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:47:33.374021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:47:33.390477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:33.391136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:33.391725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:33.392648 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:33.393228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:33.393897 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:33.422863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for project 89de7e77cc234d14943dc99d02388c45. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:47:33.429610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for user 2db198ac8f2842638e0edd931ca8d26d and project 89de7e77cc234d14943dc99d02388c45. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:47:33.449713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:47:33.452866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:47:33.521106 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f4ab4b45-76c7-45da-a20f-d2881bfbc32f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.898484 Sep 10 21:47:33.529956 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3425/6976] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:47:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:47:33.532773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:33.538702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7d3d8a0a-8873-4a2d-979a-3d7b57e508ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:33.539331 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7d3d8a0a-8873-4a2d-979a-3d7b57e508ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:33.631697 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7d3d8a0a-8873-4a2d-979a-3d7b57e508ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:33.639964 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7d3d8a0a-8873-4a2d-979a-3d7b57e508ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1266 microversion: 2.1 time: 0.108938 Sep 10 21:47:33.641047 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3552/6977] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:33 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:34.678941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-46ec796d-6d31-4fba-96ef-bf45e30c2e40 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:34.681898 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-46ec796d-6d31-4fba-96ef-bf45e30c2e40 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:34.694633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46ec796d-6d31-4fba-96ef-bf45e30c2e40 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:34.695070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46ec796d-6d31-4fba-96ef-bf45e30c2e40 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:34.695517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46ec796d-6d31-4fba-96ef-bf45e30c2e40 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:34.696583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46ec796d-6d31-4fba-96ef-bf45e30c2e40 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:34.697316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46ec796d-6d31-4fba-96ef-bf45e30c2e40 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:34.697759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-46ec796d-6d31-4fba-96ef-bf45e30c2e40 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:34.805429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-46ec796d-6d31-4fba-96ef-bf45e30c2e40 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:34.814882 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-46ec796d-6d31-4fba-96ef-bf45e30c2e40 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1326 microversion: 2.1 time: 0.145555 Sep 10 21:47:34.816340 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3426/6978] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:34 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:35.840883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3fd206e6-b138-4009-8637-498da00f87b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:35.841497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3fd206e6-b138-4009-8637-498da00f87b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:35.849200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fd206e6-b138-4009-8637-498da00f87b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:35.849691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fd206e6-b138-4009-8637-498da00f87b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:35.850182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fd206e6-b138-4009-8637-498da00f87b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:35.850893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fd206e6-b138-4009-8637-498da00f87b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:35.851363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fd206e6-b138-4009-8637-498da00f87b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:35.851982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3fd206e6-b138-4009-8637-498da00f87b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:36.023668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3fd206e6-b138-4009-8637-498da00f87b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:36.032584 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3fd206e6-b138-4009-8637-498da00f87b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1391 microversion: 2.1 time: 0.196003 Sep 10 21:47:36.033326 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3553/6979] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:35 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1391 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:36.806071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-af19a332-e5a8-4ba3-8347-1224d48b9c00 req-1f141744-b1e7-481f-8596-40bea59e6bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49742eac-7612-4399-9a3a-e4ba25132742", "tag": "49575a4d-8905-49cc-991d-74d23e011309"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:47:36.816145 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-af19a332-e5a8-4ba3-8347-1224d48b9c00 req-1f141744-b1e7-481f-8596-40bea59e6bdd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:36.816627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-af19a332-e5a8-4ba3-8347-1224d48b9c00 req-1f141744-b1e7-481f-8596-40bea59e6bdd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:36.817065 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-af19a332-e5a8-4ba3-8347-1224d48b9c00 req-1f141744-b1e7-481f-8596-40bea59e6bdd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:36.830998 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-af19a332-e5a8-4ba3-8347-1224d48b9c00 req-1f141744-b1e7-481f-8596-40bea59e6bdd service nova] Creating event network-changed:49575a4d-8905-49cc-991d-74d23e011309 for instance 49742eac-7612-4399-9a3a-e4ba25132742 on nch2-master-1 Sep 10 21:47:36.836671 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-af19a332-e5a8-4ba3-8347-1224d48b9c00 req-1f141744-b1e7-481f-8596-40bea59e6bdd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088118 Sep 10 21:47:36.837293 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3427/6980] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:47:37.056630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0240611-3cdb-4313-8ae1-d2d579ef3d31 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:37.057259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0240611-3cdb-4313-8ae1-d2d579ef3d31 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:37.065326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0240611-3cdb-4313-8ae1-d2d579ef3d31 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:37.065819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0240611-3cdb-4313-8ae1-d2d579ef3d31 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:37.066777 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0240611-3cdb-4313-8ae1-d2d579ef3d31 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:37.067091 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0240611-3cdb-4313-8ae1-d2d579ef3d31 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:37.067550 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0240611-3cdb-4313-8ae1-d2d579ef3d31 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:37.067982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0240611-3cdb-4313-8ae1-d2d579ef3d31 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:37.214043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0240611-3cdb-4313-8ae1-d2d579ef3d31 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:37.223169 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0240611-3cdb-4313-8ae1-d2d579ef3d31 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1391 microversion: 2.1 time: 0.170402 Sep 10 21:47:37.224099 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3554/6981] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:37 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:38.247867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-310d35c1-778f-4d5d-9661-199d5633145e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:38.248571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-310d35c1-778f-4d5d-9661-199d5633145e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:38.255767 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310d35c1-778f-4d5d-9661-199d5633145e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:38.256246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310d35c1-778f-4d5d-9661-199d5633145e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:38.256686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310d35c1-778f-4d5d-9661-199d5633145e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:38.257387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310d35c1-778f-4d5d-9661-199d5633145e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:38.257861 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310d35c1-778f-4d5d-9661-199d5633145e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:38.258290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-310d35c1-778f-4d5d-9661-199d5633145e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:38.463667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-310d35c1-778f-4d5d-9661-199d5633145e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:38.471838 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-310d35c1-778f-4d5d-9661-199d5633145e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1391 microversion: 2.1 time: 0.228587 Sep 10 21:47:38.472636 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3428/6982] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:38 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1391 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:39.497970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-16f3d502-5134-418f-93e5-522e76f39a24 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:39.498584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-16f3d502-5134-418f-93e5-522e76f39a24 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:39.505363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16f3d502-5134-418f-93e5-522e76f39a24 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:39.505872 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16f3d502-5134-418f-93e5-522e76f39a24 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:39.506315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16f3d502-5134-418f-93e5-522e76f39a24 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:39.507010 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16f3d502-5134-418f-93e5-522e76f39a24 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:39.507468 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16f3d502-5134-418f-93e5-522e76f39a24 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:39.507899 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-16f3d502-5134-418f-93e5-522e76f39a24 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:39.646394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-16f3d502-5134-418f-93e5-522e76f39a24 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:39.654842 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-16f3d502-5134-418f-93e5-522e76f39a24 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1391 microversion: 2.1 time: 0.160840 Sep 10 21:47:39.655622 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3555/6983] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:39 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:40.678956 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ddaf2a12-f0b5-402f-a1da-0d1382f3f1ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:40.679555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ddaf2a12-f0b5-402f-a1da-0d1382f3f1ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:40.686780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddaf2a12-f0b5-402f-a1da-0d1382f3f1ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:40.687265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddaf2a12-f0b5-402f-a1da-0d1382f3f1ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:40.687725 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddaf2a12-f0b5-402f-a1da-0d1382f3f1ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:40.688423 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddaf2a12-f0b5-402f-a1da-0d1382f3f1ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:40.688876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddaf2a12-f0b5-402f-a1da-0d1382f3f1ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:40.689304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ddaf2a12-f0b5-402f-a1da-0d1382f3f1ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:40.826299 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ddaf2a12-f0b5-402f-a1da-0d1382f3f1ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:40.834041 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ddaf2a12-f0b5-402f-a1da-0d1382f3f1ae tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1391 microversion: 2.1 time: 0.159028 Sep 10 21:47:40.834635 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3429/6984] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:40 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:41.858639 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-84afc6b5-f46e-44c5-b85b-f477258f9881 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:41.859324 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-84afc6b5-f46e-44c5-b85b-f477258f9881 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:41.866279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84afc6b5-f46e-44c5-b85b-f477258f9881 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:41.866760 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84afc6b5-f46e-44c5-b85b-f477258f9881 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:41.867228 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84afc6b5-f46e-44c5-b85b-f477258f9881 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:41.867942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84afc6b5-f46e-44c5-b85b-f477258f9881 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:41.868394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84afc6b5-f46e-44c5-b85b-f477258f9881 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:41.868825 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84afc6b5-f46e-44c5-b85b-f477258f9881 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:42.011374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84afc6b5-f46e-44c5-b85b-f477258f9881 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:42.019244 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-84afc6b5-f46e-44c5-b85b-f477258f9881 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1391 microversion: 2.1 time: 0.165278 Sep 10 21:47:42.019841 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3556/6985] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:41 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:42.175640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e883ee4f-3ba2-4fa4-8044-75f5407d1bdc req-907fcf03-6a09-4f1f-8be3-1573e20f6ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49742eac-7612-4399-9a3a-e4ba25132742", "name": "network-vif-plugged", "status": "completed", "tag": "49575a4d-8905-49cc-991d-74d23e011309"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:47:42.185892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e883ee4f-3ba2-4fa4-8044-75f5407d1bdc req-907fcf03-6a09-4f1f-8be3-1573e20f6ca6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:42.186474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e883ee4f-3ba2-4fa4-8044-75f5407d1bdc req-907fcf03-6a09-4f1f-8be3-1573e20f6ca6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:42.186914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e883ee4f-3ba2-4fa4-8044-75f5407d1bdc req-907fcf03-6a09-4f1f-8be3-1573e20f6ca6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:42.197931 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e883ee4f-3ba2-4fa4-8044-75f5407d1bdc req-907fcf03-6a09-4f1f-8be3-1573e20f6ca6 service nova] Creating event network-vif-plugged:49575a4d-8905-49cc-991d-74d23e011309 for instance 49742eac-7612-4399-9a3a-e4ba25132742 on nch2-master-1 Sep 10 21:47:42.203679 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e883ee4f-3ba2-4fa4-8044-75f5407d1bdc req-907fcf03-6a09-4f1f-8be3-1573e20f6ca6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081457 Sep 10 21:47:42.204317 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3430/6986] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:47:43.044222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1f0146d3-1c03-40c4-800c-f7d8ad5d3a54 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:43.044828 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1f0146d3-1c03-40c4-800c-f7d8ad5d3a54 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:43.051742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f0146d3-1c03-40c4-800c-f7d8ad5d3a54 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:43.052227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f0146d3-1c03-40c4-800c-f7d8ad5d3a54 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:43.052665 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f0146d3-1c03-40c4-800c-f7d8ad5d3a54 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:43.053359 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f0146d3-1c03-40c4-800c-f7d8ad5d3a54 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:43.053812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f0146d3-1c03-40c4-800c-f7d8ad5d3a54 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:43.054279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f0146d3-1c03-40c4-800c-f7d8ad5d3a54 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:43.189554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1f0146d3-1c03-40c4-800c-f7d8ad5d3a54 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:43.197236 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1f0146d3-1c03-40c4-800c-f7d8ad5d3a54 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1391 microversion: 2.1 time: 0.157652 Sep 10 21:47:43.197845 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3557/6987] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:43 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:44.222380 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:44.223230 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:44.227605 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a0d5bf56-baa7-44d4-b8ed-f4d1528b3314 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:44.228282 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a0d5bf56-baa7-44d4-b8ed-f4d1528b3314 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:44.235550 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0d5bf56-baa7-44d4-b8ed-f4d1528b3314 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:44.236043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0d5bf56-baa7-44d4-b8ed-f4d1528b3314 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:44.236756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0d5bf56-baa7-44d4-b8ed-f4d1528b3314 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:44.237462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0d5bf56-baa7-44d4-b8ed-f4d1528b3314 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:44.237966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0d5bf56-baa7-44d4-b8ed-f4d1528b3314 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:44.238399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a0d5bf56-baa7-44d4-b8ed-f4d1528b3314 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:44.371888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a0d5bf56-baa7-44d4-b8ed-f4d1528b3314 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:44.379794 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a0d5bf56-baa7-44d4-b8ed-f4d1528b3314 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1562 microversion: 2.1 time: 0.159284 Sep 10 21:47:44.380477 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3431/6988] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:44 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:44.403354 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-37786bf8-3318-45e0-8bed-3193cc3ad993 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:44.403972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-37786bf8-3318-45e0-8bed-3193cc3ad993 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:44.405939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:47:44.412039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37786bf8-3318-45e0-8bed-3193cc3ad993 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:44.412529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37786bf8-3318-45e0-8bed-3193cc3ad993 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:44.412971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37786bf8-3318-45e0-8bed-3193cc3ad993 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:44.413671 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37786bf8-3318-45e0-8bed-3193cc3ad993 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:44.414159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37786bf8-3318-45e0-8bed-3193cc3ad993 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:44.414597 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37786bf8-3318-45e0-8bed-3193cc3ad993 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:44.550379 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-37786bf8-3318-45e0-8bed-3193cc3ad993 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:44.558200 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-37786bf8-3318-45e0-8bed-3193cc3ad993 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1562 microversion: 2.1 time: 0.159029 Sep 10 21:47:44.559405 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3558/6989] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:44 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:47:46.175591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-31fa5ea3-4d76-4c43-9d36-4db12189e3f3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:47:46.176361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-31fa5ea3-4d76-4c43-9d36-4db12189e3f3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:47:46.178418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-700d9b8e-da21-4f85-94e1-8740f5999fa7 req-b7d1f7f2-d3ee-4c6d-b2a1-547db2d41c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49742eac-7612-4399-9a3a-e4ba25132742", "tag": "49575a4d-8905-49cc-991d-74d23e011309"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:47:46.183826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31fa5ea3-4d76-4c43-9d36-4db12189e3f3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:46.184328 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31fa5ea3-4d76-4c43-9d36-4db12189e3f3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:46.184972 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31fa5ea3-4d76-4c43-9d36-4db12189e3f3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:46.185799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31fa5ea3-4d76-4c43-9d36-4db12189e3f3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:46.186355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31fa5ea3-4d76-4c43-9d36-4db12189e3f3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:46.186997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31fa5ea3-4d76-4c43-9d36-4db12189e3f3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:46.191472 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-700d9b8e-da21-4f85-94e1-8740f5999fa7 req-b7d1f7f2-d3ee-4c6d-b2a1-547db2d41c37 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:47:46.192130 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-700d9b8e-da21-4f85-94e1-8740f5999fa7 req-b7d1f7f2-d3ee-4c6d-b2a1-547db2d41c37 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:47:46.192623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-700d9b8e-da21-4f85-94e1-8740f5999fa7 req-b7d1f7f2-d3ee-4c6d-b2a1-547db2d41c37 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:47:46.205025 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-700d9b8e-da21-4f85-94e1-8740f5999fa7 req-b7d1f7f2-d3ee-4c6d-b2a1-547db2d41c37 service nova] Creating event network-changed:49575a4d-8905-49cc-991d-74d23e011309 for instance 49742eac-7612-4399-9a3a-e4ba25132742 on nch2-master-1 Sep 10 21:47:46.211157 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-700d9b8e-da21-4f85-94e1-8740f5999fa7 req-b7d1f7f2-d3ee-4c6d-b2a1-547db2d41c37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036615 Sep 10 21:47:46.212237 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3559/6990] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:47:46.416175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-31fa5ea3-4d76-4c43-9d36-4db12189e3f3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:47:46.424695 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-31fa5ea3-4d76-4c43-9d36-4db12189e3f3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1562 microversion: 2.1 time: 0.253524 Sep 10 21:47:46.425309 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3432/6991] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:47:46 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1562 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:48:09.675793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:48:09.676546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=38 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:48:09.681558 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fd23ea62-20a2-4e3c-a934-b9feb496c8cf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:48:09.684640 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fd23ea62-20a2-4e3c-a934-b9feb496c8cf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:09.695049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd23ea62-20a2-4e3c-a934-b9feb496c8cf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:09.695538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd23ea62-20a2-4e3c-a934-b9feb496c8cf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:09.695980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd23ea62-20a2-4e3c-a934-b9feb496c8cf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:09.696684 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd23ea62-20a2-4e3c-a934-b9feb496c8cf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:09.697142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd23ea62-20a2-4e3c-a934-b9feb496c8cf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:09.697576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd23ea62-20a2-4e3c-a934-b9feb496c8cf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:09.749226 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fd23ea62-20a2-4e3c-a934-b9feb496c8cf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742/action" status: 200 len: 24572 microversion: 2.1 time: 0.075365 Sep 10 21:48:09.749895 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3560/6992] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:48:09 2022] POST /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:48:20.763911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:48:20.766254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:20.768481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:48:20.769280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=36 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:48:20.776018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:20.776881 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:20.777333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:20.778059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:20.778517 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:20.778945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:20.821599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:20.830448 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Old instance type m1.heat2, new instance type m1.heat {{(pid=145771) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 21:48:20.837134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:48:20.837556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:48:20.838064 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:48:20.838511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:48:20.839237 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:48:20.907986 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-77c1b674-cfd4-42bf-a56a-620bc50a58fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742/action" status: 202 len: 0 microversion: 2.1 time: 0.149267 Sep 10 21:48:20.908614 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3433/6993] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:48:20 2022] POST /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:48:20.918113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e6647096-1bc1-4a96-a41a-c14598d9482d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:20.918829 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e6647096-1bc1-4a96-a41a-c14598d9482d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:20.921367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:48:20.922052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:48:20.928806 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6647096-1bc1-4a96-a41a-c14598d9482d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:20.929301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6647096-1bc1-4a96-a41a-c14598d9482d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:20.929746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6647096-1bc1-4a96-a41a-c14598d9482d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:20.930496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6647096-1bc1-4a96-a41a-c14598d9482d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:20.930959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6647096-1bc1-4a96-a41a-c14598d9482d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:20.931394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e6647096-1bc1-4a96-a41a-c14598d9482d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:21.077714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e6647096-1bc1-4a96-a41a-c14598d9482d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:21.085861 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e6647096-1bc1-4a96-a41a-c14598d9482d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1690 microversion: 2.1 time: 0.172748 Sep 10 21:48:21.086448 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3561/6994] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:20 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:22.113806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b13869b7-d18c-4831-b27c-cc7608097e57 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:22.114476 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b13869b7-d18c-4831-b27c-cc7608097e57 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:22.123764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b13869b7-d18c-4831-b27c-cc7608097e57 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:22.124260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b13869b7-d18c-4831-b27c-cc7608097e57 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:22.124701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b13869b7-d18c-4831-b27c-cc7608097e57 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:22.125418 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b13869b7-d18c-4831-b27c-cc7608097e57 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:22.125876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b13869b7-d18c-4831-b27c-cc7608097e57 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:22.126304 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b13869b7-d18c-4831-b27c-cc7608097e57 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:22.286778 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b13869b7-d18c-4831-b27c-cc7608097e57 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:22.295709 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b13869b7-d18c-4831-b27c-cc7608097e57 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1690 microversion: 2.1 time: 0.187961 Sep 10 21:48:22.296227 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3434/6995] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:22 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:23.319361 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-9239288a-674d-4d82-ac62-b7ac65947b23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:23.320094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-9239288a-674d-4d82-ac62-b7ac65947b23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:23.331403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9239288a-674d-4d82-ac62-b7ac65947b23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:23.332051 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9239288a-674d-4d82-ac62-b7ac65947b23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:23.332500 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9239288a-674d-4d82-ac62-b7ac65947b23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:23.333206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9239288a-674d-4d82-ac62-b7ac65947b23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:23.333690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9239288a-674d-4d82-ac62-b7ac65947b23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:23.334147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-9239288a-674d-4d82-ac62-b7ac65947b23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:23.474911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-9239288a-674d-4d82-ac62-b7ac65947b23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:23.483399 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-9239288a-674d-4d82-ac62-b7ac65947b23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1690 microversion: 2.1 time: 0.168455 Sep 10 21:48:23.483966 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3562/6996] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:23 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:24.506107 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-91119308-13b0-4060-af91-9e11ac7aa04f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:24.506738 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-91119308-13b0-4060-af91-9e11ac7aa04f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:24.514296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91119308-13b0-4060-af91-9e11ac7aa04f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:24.514780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91119308-13b0-4060-af91-9e11ac7aa04f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:24.515216 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91119308-13b0-4060-af91-9e11ac7aa04f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:24.515909 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91119308-13b0-4060-af91-9e11ac7aa04f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:24.516365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91119308-13b0-4060-af91-9e11ac7aa04f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:24.516793 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-91119308-13b0-4060-af91-9e11ac7aa04f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:24.648669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-91119308-13b0-4060-af91-9e11ac7aa04f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:24.656671 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-91119308-13b0-4060-af91-9e11ac7aa04f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.154437 Sep 10 21:48:24.657214 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3435/6997] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:24 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:25.682512 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-498af31c-7a52-4970-b4ca-85c3f3d0ebeb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:25.683173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-498af31c-7a52-4970-b4ca-85c3f3d0ebeb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:25.690352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-498af31c-7a52-4970-b4ca-85c3f3d0ebeb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:25.690840 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-498af31c-7a52-4970-b4ca-85c3f3d0ebeb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:25.691283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-498af31c-7a52-4970-b4ca-85c3f3d0ebeb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:25.691980 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-498af31c-7a52-4970-b4ca-85c3f3d0ebeb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:25.692441 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-498af31c-7a52-4970-b4ca-85c3f3d0ebeb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:25.692873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-498af31c-7a52-4970-b4ca-85c3f3d0ebeb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:25.830759 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-498af31c-7a52-4970-b4ca-85c3f3d0ebeb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:25.840021 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-498af31c-7a52-4970-b4ca-85c3f3d0ebeb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.161930 Sep 10 21:48:25.840798 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3563/6998] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:25 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:26.865024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1000436b-b1f4-4b7b-a15a-04a142303a03 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:26.865639 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1000436b-b1f4-4b7b-a15a-04a142303a03 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:26.872870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1000436b-b1f4-4b7b-a15a-04a142303a03 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:26.873361 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1000436b-b1f4-4b7b-a15a-04a142303a03 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:26.873809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1000436b-b1f4-4b7b-a15a-04a142303a03 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:26.874537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1000436b-b1f4-4b7b-a15a-04a142303a03 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:26.875002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1000436b-b1f4-4b7b-a15a-04a142303a03 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:26.875435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1000436b-b1f4-4b7b-a15a-04a142303a03 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:27.014253 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1000436b-b1f4-4b7b-a15a-04a142303a03 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:27.022595 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1000436b-b1f4-4b7b-a15a-04a142303a03 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.161780 Sep 10 21:48:27.023183 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3436/6999] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:26 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:28.047262 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7ee3568e-7181-41b2-a3ff-0f9c1f60ac04 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:28.047875 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7ee3568e-7181-41b2-a3ff-0f9c1f60ac04 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:28.054724 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ee3568e-7181-41b2-a3ff-0f9c1f60ac04 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:28.055208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ee3568e-7181-41b2-a3ff-0f9c1f60ac04 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:28.055649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ee3568e-7181-41b2-a3ff-0f9c1f60ac04 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:28.056341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ee3568e-7181-41b2-a3ff-0f9c1f60ac04 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:28.056815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ee3568e-7181-41b2-a3ff-0f9c1f60ac04 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:28.057243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ee3568e-7181-41b2-a3ff-0f9c1f60ac04 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:28.188282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7ee3568e-7181-41b2-a3ff-0f9c1f60ac04 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:28.196110 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7ee3568e-7181-41b2-a3ff-0f9c1f60ac04 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.153721 Sep 10 21:48:28.196691 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3564/7000] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:28 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:29.220779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f5313dbe-56f6-492a-95ed-e7515197cdcb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:29.221401 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f5313dbe-56f6-492a-95ed-e7515197cdcb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:29.228451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5313dbe-56f6-492a-95ed-e7515197cdcb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:29.228885 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5313dbe-56f6-492a-95ed-e7515197cdcb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:29.229332 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5313dbe-56f6-492a-95ed-e7515197cdcb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:29.230118 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5313dbe-56f6-492a-95ed-e7515197cdcb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:29.230584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5313dbe-56f6-492a-95ed-e7515197cdcb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:29.231021 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5313dbe-56f6-492a-95ed-e7515197cdcb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:29.366966 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f5313dbe-56f6-492a-95ed-e7515197cdcb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:29.375565 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f5313dbe-56f6-492a-95ed-e7515197cdcb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.158761 Sep 10 21:48:29.376152 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3437/7001] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:29 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:30.399880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b12f4aa8-21a9-43ce-b24c-57b4b99a490e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:30.400497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b12f4aa8-21a9-43ce-b24c-57b4b99a490e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:30.407614 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12f4aa8-21a9-43ce-b24c-57b4b99a490e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:30.408103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12f4aa8-21a9-43ce-b24c-57b4b99a490e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:30.408542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12f4aa8-21a9-43ce-b24c-57b4b99a490e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:30.409241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12f4aa8-21a9-43ce-b24c-57b4b99a490e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:30.409698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12f4aa8-21a9-43ce-b24c-57b4b99a490e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:30.410312 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b12f4aa8-21a9-43ce-b24c-57b4b99a490e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:30.551751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b12f4aa8-21a9-43ce-b24c-57b4b99a490e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:30.560419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b12f4aa8-21a9-43ce-b24c-57b4b99a490e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.164445 Sep 10 21:48:30.560998 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3565/7002] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:30 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:31.584270 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8ad54d5-75c8-465a-a133-28efd731a61b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:31.584884 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8ad54d5-75c8-465a-a133-28efd731a61b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:31.593193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ad54d5-75c8-465a-a133-28efd731a61b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:31.593678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ad54d5-75c8-465a-a133-28efd731a61b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:31.594155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ad54d5-75c8-465a-a133-28efd731a61b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:31.594875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ad54d5-75c8-465a-a133-28efd731a61b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:31.595333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ad54d5-75c8-465a-a133-28efd731a61b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:31.595760 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8ad54d5-75c8-465a-a133-28efd731a61b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:31.731077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8ad54d5-75c8-465a-a133-28efd731a61b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:31.739134 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8ad54d5-75c8-465a-a133-28efd731a61b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.158824 Sep 10 21:48:31.739730 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3438/7003] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:31 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:32.763499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cfaf689e-615c-4d23-8b98-fb5c1113eed1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:32.764039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cfaf689e-615c-4d23-8b98-fb5c1113eed1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:32.771069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfaf689e-615c-4d23-8b98-fb5c1113eed1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:32.771562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfaf689e-615c-4d23-8b98-fb5c1113eed1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:32.772008 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfaf689e-615c-4d23-8b98-fb5c1113eed1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:32.772709 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfaf689e-615c-4d23-8b98-fb5c1113eed1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:32.773172 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfaf689e-615c-4d23-8b98-fb5c1113eed1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:32.773605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfaf689e-615c-4d23-8b98-fb5c1113eed1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:32.911058 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cfaf689e-615c-4d23-8b98-fb5c1113eed1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:32.919061 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cfaf689e-615c-4d23-8b98-fb5c1113eed1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.160300 Sep 10 21:48:32.919638 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3566/7004] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:32 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:33.942300 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8496165a-0709-44bb-bfd8-99ca63d36f51 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:33.942915 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8496165a-0709-44bb-bfd8-99ca63d36f51 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:33.950569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8496165a-0709-44bb-bfd8-99ca63d36f51 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:33.951075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8496165a-0709-44bb-bfd8-99ca63d36f51 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:33.951520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8496165a-0709-44bb-bfd8-99ca63d36f51 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:33.952217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8496165a-0709-44bb-bfd8-99ca63d36f51 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:33.952675 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8496165a-0709-44bb-bfd8-99ca63d36f51 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:33.953105 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8496165a-0709-44bb-bfd8-99ca63d36f51 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:34.085249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8496165a-0709-44bb-bfd8-99ca63d36f51 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:34.093270 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8496165a-0709-44bb-bfd8-99ca63d36f51 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.154930 Sep 10 21:48:34.093872 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3439/7005] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:33 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:35.117127 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-675f5a26-2587-4704-84ec-34cd5166e010 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:35.117749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-675f5a26-2587-4704-84ec-34cd5166e010 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:35.125336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-675f5a26-2587-4704-84ec-34cd5166e010 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:35.125856 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-675f5a26-2587-4704-84ec-34cd5166e010 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:35.126302 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-675f5a26-2587-4704-84ec-34cd5166e010 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:35.127006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-675f5a26-2587-4704-84ec-34cd5166e010 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:35.127469 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-675f5a26-2587-4704-84ec-34cd5166e010 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:35.127905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-675f5a26-2587-4704-84ec-34cd5166e010 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:35.263052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-675f5a26-2587-4704-84ec-34cd5166e010 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:35.270886 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-675f5a26-2587-4704-84ec-34cd5166e010 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.157782 Sep 10 21:48:35.271479 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3567/7006] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:35 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:36.295187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-20b6f3ef-3850-4a8f-b703-e1a1b15a7d1e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:36.295740 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-20b6f3ef-3850-4a8f-b703-e1a1b15a7d1e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:36.302766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20b6f3ef-3850-4a8f-b703-e1a1b15a7d1e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:36.303246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20b6f3ef-3850-4a8f-b703-e1a1b15a7d1e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:36.303681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20b6f3ef-3850-4a8f-b703-e1a1b15a7d1e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:36.304371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20b6f3ef-3850-4a8f-b703-e1a1b15a7d1e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:36.304823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20b6f3ef-3850-4a8f-b703-e1a1b15a7d1e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:36.305246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-20b6f3ef-3850-4a8f-b703-e1a1b15a7d1e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:36.436982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-20b6f3ef-3850-4a8f-b703-e1a1b15a7d1e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:36.445001 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-20b6f3ef-3850-4a8f-b703-e1a1b15a7d1e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.154424 Sep 10 21:48:36.445577 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3440/7007] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:36 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:37.468863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-7ccd2ab5-de82-4342-84cb-bb04b52f26cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:37.469483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-7ccd2ab5-de82-4342-84cb-bb04b52f26cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:37.476466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ccd2ab5-de82-4342-84cb-bb04b52f26cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:37.476958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ccd2ab5-de82-4342-84cb-bb04b52f26cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:37.477399 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ccd2ab5-de82-4342-84cb-bb04b52f26cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:37.478135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ccd2ab5-de82-4342-84cb-bb04b52f26cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:37.478599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ccd2ab5-de82-4342-84cb-bb04b52f26cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:37.479032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-7ccd2ab5-de82-4342-84cb-bb04b52f26cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:37.615488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-7ccd2ab5-de82-4342-84cb-bb04b52f26cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:37.623509 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-7ccd2ab5-de82-4342-84cb-bb04b52f26cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.158674 Sep 10 21:48:37.624086 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3568/7008] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:37 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:38.647060 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6b5d6485-b217-4f6a-883f-6122596cb8dc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:38.647699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6b5d6485-b217-4f6a-883f-6122596cb8dc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:38.654904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5d6485-b217-4f6a-883f-6122596cb8dc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:38.655406 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5d6485-b217-4f6a-883f-6122596cb8dc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:38.655857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5d6485-b217-4f6a-883f-6122596cb8dc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:38.656603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5d6485-b217-4f6a-883f-6122596cb8dc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:38.657067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5d6485-b217-4f6a-883f-6122596cb8dc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:38.657507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6b5d6485-b217-4f6a-883f-6122596cb8dc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:38.793917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6b5d6485-b217-4f6a-883f-6122596cb8dc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:38.801886 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6b5d6485-b217-4f6a-883f-6122596cb8dc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.158694 Sep 10 21:48:38.802468 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3441/7009] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:38 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:39.826275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f7fae4f1-43c4-4725-b5b0-171aee64ef8d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:39.826924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f7fae4f1-43c4-4725-b5b0-171aee64ef8d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:39.833713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7fae4f1-43c4-4725-b5b0-171aee64ef8d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:39.834241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7fae4f1-43c4-4725-b5b0-171aee64ef8d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:39.834715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7fae4f1-43c4-4725-b5b0-171aee64ef8d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:39.835420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7fae4f1-43c4-4725-b5b0-171aee64ef8d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:39.835887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7fae4f1-43c4-4725-b5b0-171aee64ef8d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:39.836322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f7fae4f1-43c4-4725-b5b0-171aee64ef8d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:39.970243 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f7fae4f1-43c4-4725-b5b0-171aee64ef8d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:39.978164 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f7fae4f1-43c4-4725-b5b0-171aee64ef8d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1695 microversion: 2.1 time: 0.155907 Sep 10 21:48:39.978779 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3569/7010] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:39 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:41.007671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b8aa5ce1-d042-42e6-b259-acb287f78f99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:41.008329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b8aa5ce1-d042-42e6-b259-acb287f78f99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:41.014977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-e4c20abc-57fd-4f96-abc4-af04a719991d req-58f7bb73-63ca-41ce-bdf2-26bb236702c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49742eac-7612-4399-9a3a-e4ba25132742", "name": "network-vif-unplugged", "status": "completed", "tag": "49575a4d-8905-49cc-991d-74d23e011309"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:48:41.016742 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8aa5ce1-d042-42e6-b259-acb287f78f99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:41.017244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8aa5ce1-d042-42e6-b259-acb287f78f99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:41.017697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8aa5ce1-d042-42e6-b259-acb287f78f99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:41.018441 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8aa5ce1-d042-42e6-b259-acb287f78f99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:41.018913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8aa5ce1-d042-42e6-b259-acb287f78f99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:41.019350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b8aa5ce1-d042-42e6-b259-acb287f78f99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:41.021305 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 21:48:41.021546 ncdv-master-1 devstack@n-api.service[145772]: Sat Sep 10 21:48:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 10 21:48:41.032396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e4c20abc-57fd-4f96-abc4-af04a719991d req-58f7bb73-63ca-41ce-bdf2-26bb236702c6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:41.033087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e4c20abc-57fd-4f96-abc4-af04a719991d req-58f7bb73-63ca-41ce-bdf2-26bb236702c6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:41.033750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-e4c20abc-57fd-4f96-abc4-af04a719991d req-58f7bb73-63ca-41ce-bdf2-26bb236702c6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:41.047023 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-e4c20abc-57fd-4f96-abc4-af04a719991d req-58f7bb73-63ca-41ce-bdf2-26bb236702c6 service nova] Creating event network-vif-unplugged:49575a4d-8905-49cc-991d-74d23e011309 for instance 49742eac-7612-4399-9a3a-e4ba25132742 on nch1-master-1 Sep 10 21:48:41.053459 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [req-e4c20abc-57fd-4f96-abc4-af04a719991d req-58f7bb73-63ca-41ce-bdf2-26bb236702c6 service nova] Instance 49742eac-7612-4399-9a3a-e4ba25132742 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145772) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:48:41.065745 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-e4c20abc-57fd-4f96-abc4-af04a719991d req-58f7bb73-63ca-41ce-bdf2-26bb236702c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055443 Sep 10 21:48:41.066842 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3570/7011] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:48:41.165849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b8aa5ce1-d042-42e6-b259-acb287f78f99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:41.174617 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b8aa5ce1-d042-42e6-b259-acb287f78f99 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1694 microversion: 2.1 time: 0.170984 Sep 10 21:48:41.175204 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3442/7012] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:41 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:42.201141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d63aeafa-3f3b-406b-9024-6390c5ebec70 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:42.201805 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d63aeafa-3f3b-406b-9024-6390c5ebec70 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:42.208062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63aeafa-3f3b-406b-9024-6390c5ebec70 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:42.208436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63aeafa-3f3b-406b-9024-6390c5ebec70 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:42.208874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63aeafa-3f3b-406b-9024-6390c5ebec70 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:42.209573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63aeafa-3f3b-406b-9024-6390c5ebec70 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:42.210055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63aeafa-3f3b-406b-9024-6390c5ebec70 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:42.210515 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d63aeafa-3f3b-406b-9024-6390c5ebec70 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:42.390047 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-d63aeafa-3f3b-406b-9024-6390c5ebec70 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:42.398730 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d63aeafa-3f3b-406b-9024-6390c5ebec70 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1694 microversion: 2.1 time: 0.203073 Sep 10 21:48:42.399314 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3571/7013] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:42 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:43.081973 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-ffd39a0c-d0ff-463b-94cc-5c55f3a565ec req-50d8286d-d9bb-4c90-baae-c523e19e80e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49742eac-7612-4399-9a3a-e4ba25132742", "tag": "49575a4d-8905-49cc-991d-74d23e011309"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:48:43.094643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ffd39a0c-d0ff-463b-94cc-5c55f3a565ec req-50d8286d-d9bb-4c90-baae-c523e19e80e6 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:43.095469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ffd39a0c-d0ff-463b-94cc-5c55f3a565ec req-50d8286d-d9bb-4c90-baae-c523e19e80e6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:43.096030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-ffd39a0c-d0ff-463b-94cc-5c55f3a565ec req-50d8286d-d9bb-4c90-baae-c523e19e80e6 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:43.110350 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-ffd39a0c-d0ff-463b-94cc-5c55f3a565ec req-50d8286d-d9bb-4c90-baae-c523e19e80e6 service nova] Creating event network-changed:49575a4d-8905-49cc-991d-74d23e011309 for instance 49742eac-7612-4399-9a3a-e4ba25132742 on nch1-master-1 Sep 10 21:48:43.115996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [req-ffd39a0c-d0ff-463b-94cc-5c55f3a565ec req-50d8286d-d9bb-4c90-baae-c523e19e80e6 service nova] Instance 49742eac-7612-4399-9a3a-e4ba25132742 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=145771) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 21:48:43.127048 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-ffd39a0c-d0ff-463b-94cc-5c55f3a565ec req-50d8286d-d9bb-4c90-baae-c523e19e80e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048943 Sep 10 21:48:43.127652 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3443/7014] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:48:43.470303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0920a0fa-64fb-4f49-a94b-5e8eddbca19f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:43.470950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0920a0fa-64fb-4f49-a94b-5e8eddbca19f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:43.477021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0920a0fa-64fb-4f49-a94b-5e8eddbca19f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:43.477507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0920a0fa-64fb-4f49-a94b-5e8eddbca19f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:43.477970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0920a0fa-64fb-4f49-a94b-5e8eddbca19f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:43.478668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0920a0fa-64fb-4f49-a94b-5e8eddbca19f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:43.479169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0920a0fa-64fb-4f49-a94b-5e8eddbca19f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:43.479595 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0920a0fa-64fb-4f49-a94b-5e8eddbca19f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:43.615626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0920a0fa-64fb-4f49-a94b-5e8eddbca19f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:43.624375 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0920a0fa-64fb-4f49-a94b-5e8eddbca19f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1692 microversion: 2.1 time: 0.205448 Sep 10 21:48:43.624962 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3572/7015] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:43 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:44.650052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0dba60a5-0dce-427a-a87b-9c44b1e4d48f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:44.650880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0dba60a5-0dce-427a-a87b-9c44b1e4d48f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:44.658384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dba60a5-0dce-427a-a87b-9c44b1e4d48f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:44.658887 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dba60a5-0dce-427a-a87b-9c44b1e4d48f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:44.659329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dba60a5-0dce-427a-a87b-9c44b1e4d48f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:44.660031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dba60a5-0dce-427a-a87b-9c44b1e4d48f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:44.660486 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dba60a5-0dce-427a-a87b-9c44b1e4d48f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:44.660911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0dba60a5-0dce-427a-a87b-9c44b1e4d48f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:44.816412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0dba60a5-0dce-427a-a87b-9c44b1e4d48f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:44.834587 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0dba60a5-0dce-427a-a87b-9c44b1e4d48f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1692 microversion: 2.1 time: 0.189651 Sep 10 21:48:44.837892 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3444/7016] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:44 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:45.858999 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a5667bb5-b6ac-4338-8de5-9cc5cac711cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:45.859615 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a5667bb5-b6ac-4338-8de5-9cc5cac711cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:45.866803 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5667bb5-b6ac-4338-8de5-9cc5cac711cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:45.867287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5667bb5-b6ac-4338-8de5-9cc5cac711cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:45.867728 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5667bb5-b6ac-4338-8de5-9cc5cac711cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:45.868423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5667bb5-b6ac-4338-8de5-9cc5cac711cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:45.868883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5667bb5-b6ac-4338-8de5-9cc5cac711cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:45.869315 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a5667bb5-b6ac-4338-8de5-9cc5cac711cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:46.007104 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a5667bb5-b6ac-4338-8de5-9cc5cac711cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:46.015732 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a5667bb5-b6ac-4338-8de5-9cc5cac711cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1689 microversion: 2.1 time: 0.160837 Sep 10 21:48:46.016344 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3573/7017] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:45 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:46.039745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-86e3fcf8-4c95-4a0f-b226-f3698bb496cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:48:46.040286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-86e3fcf8-4c95-4a0f-b226-f3698bb496cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:46.047415 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86e3fcf8-4c95-4a0f-b226-f3698bb496cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:46.047901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86e3fcf8-4c95-4a0f-b226-f3698bb496cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:46.048341 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86e3fcf8-4c95-4a0f-b226-f3698bb496cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:46.049071 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86e3fcf8-4c95-4a0f-b226-f3698bb496cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:46.049527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86e3fcf8-4c95-4a0f-b226-f3698bb496cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:46.050027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-86e3fcf8-4c95-4a0f-b226-f3698bb496cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:46.108332 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-86e3fcf8-4c95-4a0f-b226-f3698bb496cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742/action" status: 204 len: 0 microversion: 2.1 time: 0.072592 Sep 10 21:48:46.108988 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3445/7018] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:48:46 2022] POST /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:48:46.117431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3790db37-6d20-481c-919e-e2072e22dc35 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:46.118070 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3790db37-6d20-481c-919e-e2072e22dc35 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:46.124939 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3790db37-6d20-481c-919e-e2072e22dc35 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:46.125432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3790db37-6d20-481c-919e-e2072e22dc35 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:46.125897 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3790db37-6d20-481c-919e-e2072e22dc35 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:46.126611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3790db37-6d20-481c-919e-e2072e22dc35 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:46.127076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3790db37-6d20-481c-919e-e2072e22dc35 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:46.127514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3790db37-6d20-481c-919e-e2072e22dc35 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:46.272970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3790db37-6d20-481c-919e-e2072e22dc35 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:46.281157 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3790db37-6d20-481c-919e-e2072e22dc35 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1689 microversion: 2.1 time: 0.167584 Sep 10 21:48:46.282134 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3574/7019] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:46 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:46.306471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a4cd36ed-0279-4ad4-a59b-3cc7631e483d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:46.307286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a4cd36ed-0279-4ad4-a59b-3cc7631e483d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:46.316187 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4cd36ed-0279-4ad4-a59b-3cc7631e483d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:46.317008 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4cd36ed-0279-4ad4-a59b-3cc7631e483d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:46.317510 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4cd36ed-0279-4ad4-a59b-3cc7631e483d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:46.319015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4cd36ed-0279-4ad4-a59b-3cc7631e483d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:46.319015 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4cd36ed-0279-4ad4-a59b-3cc7631e483d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:46.319580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a4cd36ed-0279-4ad4-a59b-3cc7631e483d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:46.550813 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a4cd36ed-0279-4ad4-a59b-3cc7631e483d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:46.560970 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a4cd36ed-0279-4ad4-a59b-3cc7631e483d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1689 microversion: 2.1 time: 0.259586 Sep 10 21:48:46.561807 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3446/7020] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:46 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1689 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:47.587593 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c6139fc5-de6f-4727-9a05-efa3e5b946e2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:48:47.588477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c6139fc5-de6f-4727-9a05-efa3e5b946e2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:48:47.599565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6139fc5-de6f-4727-9a05-efa3e5b946e2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:47.600471 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6139fc5-de6f-4727-9a05-efa3e5b946e2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:47.601209 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6139fc5-de6f-4727-9a05-efa3e5b946e2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:47.602419 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6139fc5-de6f-4727-9a05-efa3e5b946e2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:47.603193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6139fc5-de6f-4727-9a05-efa3e5b946e2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:47.603914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6139fc5-de6f-4727-9a05-efa3e5b946e2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:47.830912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c6139fc5-de6f-4727-9a05-efa3e5b946e2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:48:47.838663 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c6139fc5-de6f-4727-9a05-efa3e5b946e2 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1681 microversion: 2.1 time: 0.257314 Sep 10 21:48:47.844394 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3575/7021] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:48:47 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:48:48.794378 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-040fb858-8028-4420-947d-1113d506f117 req-e3f6aa8e-cef7-4148-b599-0cd3360a0e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49742eac-7612-4399-9a3a-e4ba25132742", "name": "network-vif-plugged", "status": "completed", "tag": "49575a4d-8905-49cc-991d-74d23e011309"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:48:48.810890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-040fb858-8028-4420-947d-1113d506f117 req-e3f6aa8e-cef7-4148-b599-0cd3360a0e6e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:48:48.811403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-040fb858-8028-4420-947d-1113d506f117 req-e3f6aa8e-cef7-4148-b599-0cd3360a0e6e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:48:48.812184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-040fb858-8028-4420-947d-1113d506f117 req-e3f6aa8e-cef7-4148-b599-0cd3360a0e6e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:48:48.829592 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-040fb858-8028-4420-947d-1113d506f117 req-e3f6aa8e-cef7-4148-b599-0cd3360a0e6e service nova] Creating event network-vif-plugged:49575a4d-8905-49cc-991d-74d23e011309 for instance 49742eac-7612-4399-9a3a-e4ba25132742 on nch1-master-1 Sep 10 21:48:48.835653 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-040fb858-8028-4420-947d-1113d506f117 req-e3f6aa8e-cef7-4148-b599-0cd3360a0e6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045938 Sep 10 21:48:48.836280 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3447/7022] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:49:18.052987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2271593b-5e39-45cb-ad4d-74c2c441ffd5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:49:18.055423 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2271593b-5e39-45cb-ad4d-74c2c441ffd5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:18.057977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=30 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:49:18.059352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=88 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:49:18.065181 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271593b-5e39-45cb-ad4d-74c2c441ffd5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:18.065681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271593b-5e39-45cb-ad4d-74c2c441ffd5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:18.066152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271593b-5e39-45cb-ad4d-74c2c441ffd5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:18.066862 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271593b-5e39-45cb-ad4d-74c2c441ffd5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:18.067319 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271593b-5e39-45cb-ad4d-74c2c441ffd5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:18.067753 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2271593b-5e39-45cb-ad4d-74c2c441ffd5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:18.136310 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2271593b-5e39-45cb-ad4d-74c2c441ffd5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742/action" status: 200 len: 24574 microversion: 2.1 time: 0.087063 Sep 10 21:49:18.136873 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3576/7023] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:49:18 2022] POST /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742/action => generated 24574 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:49:35.173519 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-98e4002c-2b25-40bc-9fad-84991eb9485b req-18536d3d-28c2-403a-bf2d-841dcec53fce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49742eac-7612-4399-9a3a-e4ba25132742", "tag": "49575a4d-8905-49cc-991d-74d23e011309"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:49:35.175951 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f81932dc-f9ee-4b90-afe5-a587ac501907 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:35.177133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f81932dc-f9ee-4b90-afe5-a587ac501907 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:35.179988 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:49:35.180170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=34 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:49:35.180807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:49:35.181618 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:49:35.187500 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f81932dc-f9ee-4b90-afe5-a587ac501907 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:35.188043 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f81932dc-f9ee-4b90-afe5-a587ac501907 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:35.188436 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f81932dc-f9ee-4b90-afe5-a587ac501907 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:35.189161 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f81932dc-f9ee-4b90-afe5-a587ac501907 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:35.189786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f81932dc-f9ee-4b90-afe5-a587ac501907 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:35.190246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f81932dc-f9ee-4b90-afe5-a587ac501907 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:35.191705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-98e4002c-2b25-40bc-9fad-84991eb9485b req-18536d3d-28c2-403a-bf2d-841dcec53fce service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:35.192192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-98e4002c-2b25-40bc-9fad-84991eb9485b req-18536d3d-28c2-403a-bf2d-841dcec53fce service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:35.192621 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-98e4002c-2b25-40bc-9fad-84991eb9485b req-18536d3d-28c2-403a-bf2d-841dcec53fce service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:35.208133 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-98e4002c-2b25-40bc-9fad-84991eb9485b req-18536d3d-28c2-403a-bf2d-841dcec53fce service nova] Creating event network-changed:49575a4d-8905-49cc-991d-74d23e011309 for instance 49742eac-7612-4399-9a3a-e4ba25132742 on nch1-master-1 Sep 10 21:49:35.213653 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-98e4002c-2b25-40bc-9fad-84991eb9485b req-18536d3d-28c2-403a-bf2d-841dcec53fce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044103 Sep 10 21:49:35.214503 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3577/7024] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:49:35.223755 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f81932dc-f9ee-4b90-afe5-a587ac501907 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:49:35.317854 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f81932dc-f9ee-4b90-afe5-a587ac501907 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "DELETE /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 204 len: 0 microversion: 2.1 time: 0.152234 Sep 10 21:49:35.318475 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3448/7025] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:49:35 2022] DELETE /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:49:35.328356 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-531964ee-4efe-400e-ac8f-0785e3dee3bf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:35.329406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-531964ee-4efe-400e-ac8f-0785e3dee3bf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:35.337120 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-531964ee-4efe-400e-ac8f-0785e3dee3bf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:35.337616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-531964ee-4efe-400e-ac8f-0785e3dee3bf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:35.338098 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-531964ee-4efe-400e-ac8f-0785e3dee3bf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:35.338937 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-531964ee-4efe-400e-ac8f-0785e3dee3bf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:35.340160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-531964ee-4efe-400e-ac8f-0785e3dee3bf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:35.340160 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-531964ee-4efe-400e-ac8f-0785e3dee3bf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:35.522582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-531964ee-4efe-400e-ac8f-0785e3dee3bf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:35.531042 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-531964ee-4efe-400e-ac8f-0785e3dee3bf tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1687 microversion: 2.1 time: 0.208018 Sep 10 21:49:35.531630 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3578/7026] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:35 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1687 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:36.556046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1369d070-c240-47a1-a1b9-7250956e4a7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:36.556744 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1369d070-c240-47a1-a1b9-7250956e4a7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:36.564178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1369d070-c240-47a1-a1b9-7250956e4a7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:36.564658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1369d070-c240-47a1-a1b9-7250956e4a7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:36.565092 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1369d070-c240-47a1-a1b9-7250956e4a7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:36.565787 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1369d070-c240-47a1-a1b9-7250956e4a7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:36.566269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1369d070-c240-47a1-a1b9-7250956e4a7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:36.566693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1369d070-c240-47a1-a1b9-7250956e4a7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:36.708610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1369d070-c240-47a1-a1b9-7250956e4a7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:36.717405 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1369d070-c240-47a1-a1b9-7250956e4a7f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1687 microversion: 2.1 time: 0.165766 Sep 10 21:49:36.718018 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3449/7027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:36 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:37.483573 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d07341a9-7d42-4bc4-ae39-805c2512bed4 req-9c0be564-5a4f-404f-84d2-14ce2c2bef31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49742eac-7612-4399-9a3a-e4ba25132742", "name": "network-vif-deleted", "tag": "49575a4d-8905-49cc-991d-74d23e011309"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:49:37.494170 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d07341a9-7d42-4bc4-ae39-805c2512bed4 req-9c0be564-5a4f-404f-84d2-14ce2c2bef31 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:37.494651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d07341a9-7d42-4bc4-ae39-805c2512bed4 req-9c0be564-5a4f-404f-84d2-14ce2c2bef31 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:37.495082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d07341a9-7d42-4bc4-ae39-805c2512bed4 req-9c0be564-5a4f-404f-84d2-14ce2c2bef31 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:37.506869 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d07341a9-7d42-4bc4-ae39-805c2512bed4 req-9c0be564-5a4f-404f-84d2-14ce2c2bef31 service nova] Creating event network-vif-deleted:49575a4d-8905-49cc-991d-74d23e011309 for instance 49742eac-7612-4399-9a3a-e4ba25132742 on nch1-master-1 Sep 10 21:49:37.512921 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d07341a9-7d42-4bc4-ae39-805c2512bed4 req-9c0be564-5a4f-404f-84d2-14ce2c2bef31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033474 Sep 10 21:49:37.513534 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3579/7028] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:49:37.740977 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:37.741651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:37.748713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:37.749217 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:37.749662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:37.750411 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:37.750878 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:37.751343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:37.788555 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:37.788968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:37.789412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:37.789905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lazy-loading 'fault' on Instance uuid 49742eac-7612-4399-9a3a-e4ba25132742 {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:49:37.833372 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:37.842407 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-71d974a1-b326-4829-8cd3-d8cbc2b3270a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 200 len: 1356 microversion: 2.1 time: 0.105555 Sep 10 21:49:37.843017 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3450/7029] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:37 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:38.867739 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:38.868464 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 49742eac-7612-4399-9a3a-e4ba25132742] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:38.875232 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:38.875715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:38.876148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:38.876845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:38.877301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:38.877727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:38.891176 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] HTTP exception thrown: Instance 49742eac-7612-4399-9a3a-e4ba25132742 could not be found. Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Request method failure captured: Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 HTTP/1.1 Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQUOmtTgV6K-BMoGYvxDxchioERSmqpfPLuUt3LGJfKR4DSKjq6mGKscCmiof0_FepwQHW1VdfGPuuOEuA3gCoWYmo51trMKNExzTnWdvX3v_alk8XXirr1x7LoluSy5vAtxzU4HCU1achY04W8MWdDNvGA_vmwlrmERJSDYC4X8UZc Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: 89de7e77cc234d14943dc99d02388c45 Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89de7e77cc234d14943dc99d02388c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89de7e77cc234d14943dc99d02388c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89de7e77cc234d14943dc99d02388c45", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89de7e77cc234d14943dc99d02388c45"}]}] Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: 89de7e77cc234d14943dc99d02388c45 Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestNetworkAdvancedServerOps-253226799-project Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 2db198ac8f2842638e0edd931ca8d26d Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestNetworkAdvancedServerOps-253226799-project Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 49742eac-7612-4399-9a3a-e4ba25132742 could not be found. Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '49742eac-7612-4399-9a3a-e4ba25132742'} Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49742eac-7612-4399-9a3a-e4ba25132742 could not be found. Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49742eac-7612-4399-9a3a-e4ba25132742 could not be found. Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:49:38.892794 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49742eac-7612-4399-9a3a-e4ba25132742 could not be found. Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Returning 404 to user: Instance 49742eac-7612-4399-9a3a-e4ba25132742 could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5280e4e-3a22-4e92-9df1-6fc74cf7587d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742" status: 404 len: 111 microversion: 2.1 time: 0.031615 Sep 10 21:49:38.898687 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3580/7030] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:38 2022] GET /compute/v2.1/servers/49742eac-7612-4399-9a3a-e4ba25132742 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:49:42.190207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-318e2d4a-e4c7-4255-b136-73e9041c75cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '.version_select at 0x7f993f519a60>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:42.224700 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-318e2d4a-e4c7-4255-b136-73e9041c75cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1941398165" status: 202 len: 0 microversion: 2.1 time: 0.038312 Sep 10 21:49:42.225344 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3451/7031] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Sep 10 21:49:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1941398165 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:49:42.254466 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-558ab604-8863-4e59-b27e-e97367a9bed5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'create', calling method: .version_select at 0x7f993ff2b8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-199297027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzyTHILXymw+VRm1y8wwzdM/1UCBr0QFMlU84OYacxI5qphrCzGnaBGeDSCGphlFSgtPDWU2/Qd0x7OMbbMIjt2MNIGkEsb6EepkhPtWerb48wsGPdhH4UuZZ+VqxF7RA=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:49:42.272773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-558ab604-8863-4e59-b27e-e97367a9bed5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for project 89de7e77cc234d14943dc99d02388c45. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:49:42.278910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-558ab604-8863-4e59-b27e-e97367a9bed5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for user 2db198ac8f2842638e0edd931ca8d26d and project 89de7e77cc234d14943dc99d02388c45. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:49:42.303799 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-558ab604-8863-4e59-b27e-e97367a9bed5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053201 Sep 10 21:49:42.304393 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3581/7032] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:49:42 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:49:47.932870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:49:47.937990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-614741169", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "eeb7fd7b-e92a-4462-8dce-ae33009a9c85"}], "key_name": "tempest-TestNetworkAdvancedServerOps-199297027", "security_groups": [{"name": "tempest-secgroup-smoke-1514365198"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:49:48.065223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] validate_networks() for [('eeb7fd7b-e92a-4462-8dce-ae33009a9c85', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:49:48.518368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:49:48.518983 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:49:48.519602 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:49:48.520040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:49:48.520696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:49:48.531339 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:48.532101 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:48.532616 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:48.533464 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:48.534038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:48.534728 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:48.554984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for project 89de7e77cc234d14943dc99d02388c45. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:49:48.560811 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for user 2db198ac8f2842638e0edd931ca8d26d and project 89de7e77cc234d14943dc99d02388c45. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:49:48.575662 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:49:48.578293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:49:48.640709 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e87d50dd-257f-4943-a21a-6e619ccc35b9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.709613 Sep 10 21:49:48.641495 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3452/7033] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:49:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:49:48.658847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-415a011b-2af7-44e2-9cb0-266c53b7591d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:48.660868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-415a011b-2af7-44e2-9cb0-266c53b7591d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:48.724448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-415a011b-2af7-44e2-9cb0-266c53b7591d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:48.732379 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-415a011b-2af7-44e2-9cb0-266c53b7591d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1265 microversion: 2.1 time: 0.082624 Sep 10 21:49:48.732996 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3582/7034] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:48 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:49.758585 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7c549ae6-13c3-4d5e-8038-781bbd3b9f58 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:49.759370 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7c549ae6-13c3-4d5e-8038-781bbd3b9f58 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:49.828835 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7c549ae6-13c3-4d5e-8038-781bbd3b9f58 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:49.836533 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7c549ae6-13c3-4d5e-8038-781bbd3b9f58 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1265 microversion: 2.1 time: 0.082772 Sep 10 21:49:49.837212 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3453/7035] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:49 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:50.860905 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0118c402-ff1f-488b-ab92-d2ea4413e7d0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:50.861606 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0118c402-ff1f-488b-ab92-d2ea4413e7d0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:50.865343 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:49:50.928030 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0118c402-ff1f-488b-ab92-d2ea4413e7d0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:50.935741 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0118c402-ff1f-488b-ab92-d2ea4413e7d0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1265 microversion: 2.1 time: 0.079380 Sep 10 21:49:50.936346 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3583/7036] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:50 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:51.959564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7aa29c6d-b0eb-4a92-8220-45a17ce7f1ef tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:51.960213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7aa29c6d-b0eb-4a92-8220-45a17ce7f1ef tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:52.016349 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7aa29c6d-b0eb-4a92-8220-45a17ce7f1ef tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:52.023632 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7aa29c6d-b0eb-4a92-8220-45a17ce7f1ef tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1265 microversion: 2.1 time: 0.068007 Sep 10 21:49:52.024221 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3454/7037] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:51 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1265 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:53.048072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-28b3feec-9f76-4d5c-a0b6-5664514c3bdc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:53.048682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-28b3feec-9f76-4d5c-a0b6-5664514c3bdc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:53.055616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28b3feec-9f76-4d5c-a0b6-5664514c3bdc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:53.056099 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28b3feec-9f76-4d5c-a0b6-5664514c3bdc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:53.056538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28b3feec-9f76-4d5c-a0b6-5664514c3bdc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:53.057229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28b3feec-9f76-4d5c-a0b6-5664514c3bdc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:53.057713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28b3feec-9f76-4d5c-a0b6-5664514c3bdc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:53.058167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-28b3feec-9f76-4d5c-a0b6-5664514c3bdc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:53.127220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-28b3feec-9f76-4d5c-a0b6-5664514c3bdc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:53.135021 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-28b3feec-9f76-4d5c-a0b6-5664514c3bdc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1269 microversion: 2.1 time: 0.091062 Sep 10 21:49:53.135603 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3584/7038] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:53 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:54.158941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4148794d-5029-493f-a93a-ad17f64c6bf5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:54.159594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4148794d-5029-493f-a93a-ad17f64c6bf5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:54.166461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4148794d-5029-493f-a93a-ad17f64c6bf5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:54.166994 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4148794d-5029-493f-a93a-ad17f64c6bf5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:54.167405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4148794d-5029-493f-a93a-ad17f64c6bf5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:54.168113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4148794d-5029-493f-a93a-ad17f64c6bf5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:54.168579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4148794d-5029-493f-a93a-ad17f64c6bf5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:54.169013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4148794d-5029-493f-a93a-ad17f64c6bf5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:54.248427 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4148794d-5029-493f-a93a-ad17f64c6bf5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:54.256274 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4148794d-5029-493f-a93a-ad17f64c6bf5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1323 microversion: 2.1 time: 0.101388 Sep 10 21:49:54.256863 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3455/7039] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:54 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1323 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:55.259053 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3a0923d2-3d15-40ca-93bf-57aaeab3c660 req-d880a68a-9446-438e-97f0-6663c21d5aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd6ef9d-5761-423c-a36d-497b44d6d7d9", "tag": "ff459b90-9dc3-411a-90a6-4c9c4c3b39ca"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:49:55.269933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3a0923d2-3d15-40ca-93bf-57aaeab3c660 req-d880a68a-9446-438e-97f0-6663c21d5aac service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:55.270339 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3a0923d2-3d15-40ca-93bf-57aaeab3c660 req-d880a68a-9446-438e-97f0-6663c21d5aac service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:55.270775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3a0923d2-3d15-40ca-93bf-57aaeab3c660 req-d880a68a-9446-438e-97f0-6663c21d5aac service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:55.283169 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3a0923d2-3d15-40ca-93bf-57aaeab3c660 req-d880a68a-9446-438e-97f0-6663c21d5aac service nova] Creating event network-changed:ff459b90-9dc3-411a-90a6-4c9c4c3b39ca for instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 on nch2-master-1 Sep 10 21:49:55.288238 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3a0923d2-3d15-40ca-93bf-57aaeab3c660 req-d880a68a-9446-438e-97f0-6663c21d5aac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032950 Sep 10 21:49:55.289028 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3585/7040] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:49:55.289162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f5802be5-b7fb-47b7-b751-f2a02699f808 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:55.289716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f5802be5-b7fb-47b7-b751-f2a02699f808 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:55.304155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5802be5-b7fb-47b7-b751-f2a02699f808 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:55.304566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5802be5-b7fb-47b7-b751-f2a02699f808 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:55.305005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5802be5-b7fb-47b7-b751-f2a02699f808 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:55.305716 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5802be5-b7fb-47b7-b751-f2a02699f808 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:55.306203 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5802be5-b7fb-47b7-b751-f2a02699f808 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:55.306630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f5802be5-b7fb-47b7-b751-f2a02699f808 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:55.514367 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f5802be5-b7fb-47b7-b751-f2a02699f808 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:55.522404 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f5802be5-b7fb-47b7-b751-f2a02699f808 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1391 microversion: 2.1 time: 0.245681 Sep 10 21:49:55.523002 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3456/7041] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:55 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:49:56.547429 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e2f60b4d-b4af-4d1e-8723-440d6f4d420f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:56.548134 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e2f60b4d-b4af-4d1e-8723-440d6f4d420f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:56.554370 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f60b4d-b4af-4d1e-8723-440d6f4d420f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:56.554855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f60b4d-b4af-4d1e-8723-440d6f4d420f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:56.555294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f60b4d-b4af-4d1e-8723-440d6f4d420f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:56.555982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f60b4d-b4af-4d1e-8723-440d6f4d420f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:56.556446 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f60b4d-b4af-4d1e-8723-440d6f4d420f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:56.556877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e2f60b4d-b4af-4d1e-8723-440d6f4d420f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:56.690197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-e2f60b4d-b4af-4d1e-8723-440d6f4d420f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:56.698245 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e2f60b4d-b4af-4d1e-8723-440d6f4d420f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1391 microversion: 2.1 time: 0.156044 Sep 10 21:49:56.698832 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3586/7042] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:56 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:57.722493 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-100714a6-6758-4b0e-ac8c-7fb9578137b6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:57.723121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-100714a6-6758-4b0e-ac8c-7fb9578137b6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:57.730621 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-100714a6-6758-4b0e-ac8c-7fb9578137b6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:57.731114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-100714a6-6758-4b0e-ac8c-7fb9578137b6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:57.731560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-100714a6-6758-4b0e-ac8c-7fb9578137b6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:57.732931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-100714a6-6758-4b0e-ac8c-7fb9578137b6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:57.733434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-100714a6-6758-4b0e-ac8c-7fb9578137b6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:57.733894 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-100714a6-6758-4b0e-ac8c-7fb9578137b6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:57.868001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-100714a6-6758-4b0e-ac8c-7fb9578137b6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:57.875698 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-100714a6-6758-4b0e-ac8c-7fb9578137b6 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1391 microversion: 2.1 time: 0.157195 Sep 10 21:49:57.876284 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3457/7043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:57 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:49:58.900192 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-35d96979-5082-4be3-b8d3-d84c64dcc9bc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:49:58.900791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-35d96979-5082-4be3-b8d3-d84c64dcc9bc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:49:58.908066 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d96979-5082-4be3-b8d3-d84c64dcc9bc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:58.908568 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d96979-5082-4be3-b8d3-d84c64dcc9bc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:58.909039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d96979-5082-4be3-b8d3-d84c64dcc9bc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:58.909746 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d96979-5082-4be3-b8d3-d84c64dcc9bc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:49:58.910234 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d96979-5082-4be3-b8d3-d84c64dcc9bc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:49:58.910669 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-35d96979-5082-4be3-b8d3-d84c64dcc9bc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:49:59.050206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-35d96979-5082-4be3-b8d3-d84c64dcc9bc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:49:59.058023 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-35d96979-5082-4be3-b8d3-d84c64dcc9bc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1391 microversion: 2.1 time: 0.161926 Sep 10 21:49:59.058616 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3587/7044] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:49:58 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:00.082707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-eb18e75e-47e0-4b11-b849-badb4916132f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:00.083358 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-eb18e75e-47e0-4b11-b849-badb4916132f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:00.085265 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:50:00.091419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb18e75e-47e0-4b11-b849-badb4916132f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:00.091913 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb18e75e-47e0-4b11-b849-badb4916132f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:00.092360 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb18e75e-47e0-4b11-b849-badb4916132f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:00.093062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb18e75e-47e0-4b11-b849-badb4916132f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:00.093523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb18e75e-47e0-4b11-b849-badb4916132f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:00.093990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-eb18e75e-47e0-4b11-b849-badb4916132f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:00.232005 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-eb18e75e-47e0-4b11-b849-badb4916132f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:00.240735 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-eb18e75e-47e0-4b11-b849-badb4916132f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1391 microversion: 2.1 time: 0.161943 Sep 10 21:50:00.241338 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3458/7045] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:00 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:00.731069 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-0f25a293-eb46-41ee-b5cf-89920a32b55e req-6eeb7a41-6f11-49a5-9d10-b87789dcbe59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd6ef9d-5761-423c-a36d-497b44d6d7d9", "name": "network-vif-plugged", "status": "completed", "tag": "ff459b90-9dc3-411a-90a6-4c9c4c3b39ca"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:50:00.743880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0f25a293-eb46-41ee-b5cf-89920a32b55e req-6eeb7a41-6f11-49a5-9d10-b87789dcbe59 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:00.744375 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0f25a293-eb46-41ee-b5cf-89920a32b55e req-6eeb7a41-6f11-49a5-9d10-b87789dcbe59 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:00.744816 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-0f25a293-eb46-41ee-b5cf-89920a32b55e req-6eeb7a41-6f11-49a5-9d10-b87789dcbe59 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:00.757018 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-0f25a293-eb46-41ee-b5cf-89920a32b55e req-6eeb7a41-6f11-49a5-9d10-b87789dcbe59 service nova] Creating event network-vif-plugged:ff459b90-9dc3-411a-90a6-4c9c4c3b39ca for instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 on nch2-master-1 Sep 10 21:50:00.762160 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-0f25a293-eb46-41ee-b5cf-89920a32b55e req-6eeb7a41-6f11-49a5-9d10-b87789dcbe59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034982 Sep 10 21:50:00.762778 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3588/7046] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:50:01.265978 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-824a6c76-5830-43e4-8842-4e637f6a66c3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:01.266636 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-824a6c76-5830-43e4-8842-4e637f6a66c3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:01.273489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-824a6c76-5830-43e4-8842-4e637f6a66c3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:01.274027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-824a6c76-5830-43e4-8842-4e637f6a66c3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:01.274481 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-824a6c76-5830-43e4-8842-4e637f6a66c3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:01.275181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-824a6c76-5830-43e4-8842-4e637f6a66c3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:01.275640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-824a6c76-5830-43e4-8842-4e637f6a66c3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:01.276072 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-824a6c76-5830-43e4-8842-4e637f6a66c3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:01.411011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-824a6c76-5830-43e4-8842-4e637f6a66c3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:01.418767 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-824a6c76-5830-43e4-8842-4e637f6a66c3 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1391 microversion: 2.1 time: 0.157614 Sep 10 21:50:01.419340 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3459/7047] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:01 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:02.442951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-554ce431-72b6-45ec-9da4-e3a430b3d4cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:02.443576 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-554ce431-72b6-45ec-9da4-e3a430b3d4cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:02.445532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=8 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:50:02.452342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-554ce431-72b6-45ec-9da4-e3a430b3d4cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:02.452818 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-554ce431-72b6-45ec-9da4-e3a430b3d4cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:02.453253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-554ce431-72b6-45ec-9da4-e3a430b3d4cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:02.453974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-554ce431-72b6-45ec-9da4-e3a430b3d4cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:02.454428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-554ce431-72b6-45ec-9da4-e3a430b3d4cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:02.454855 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-554ce431-72b6-45ec-9da4-e3a430b3d4cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:02.587253 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-554ce431-72b6-45ec-9da4-e3a430b3d4cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:02.595853 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-554ce431-72b6-45ec-9da4-e3a430b3d4cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1563 microversion: 2.1 time: 0.157332 Sep 10 21:50:02.596436 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3589/7048] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:02 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:02.618660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e32a0410-c944-4659-9892-d0fd338e4c23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:02.619275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e32a0410-c944-4659-9892-d0fd338e4c23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:02.621133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=10 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:50:02.627632 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e32a0410-c944-4659-9892-d0fd338e4c23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:02.628121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e32a0410-c944-4659-9892-d0fd338e4c23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:02.628556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e32a0410-c944-4659-9892-d0fd338e4c23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:02.629250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e32a0410-c944-4659-9892-d0fd338e4c23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:02.629706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e32a0410-c944-4659-9892-d0fd338e4c23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:02.630160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e32a0410-c944-4659-9892-d0fd338e4c23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:02.760697 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e32a0410-c944-4659-9892-d0fd338e4c23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:02.769335 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e32a0410-c944-4659-9892-d0fd338e4c23 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1563 microversion: 2.1 time: 0.154593 Sep 10 21:50:02.769930 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3460/7049] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:02 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:04.688311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-caac066a-89c1-4e76-a67e-a5d474d8758c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:04.689626 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-caac066a-89c1-4e76-a67e-a5d474d8758c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:04.690921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-cb0aac4c-2d06-4204-87ce-0f9e737807a8 req-08700c56-758e-4010-a6e9-2b22aae090d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd6ef9d-5761-423c-a36d-497b44d6d7d9", "tag": "ff459b90-9dc3-411a-90a6-4c9c4c3b39ca"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:50:04.697352 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caac066a-89c1-4e76-a67e-a5d474d8758c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:04.697993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caac066a-89c1-4e76-a67e-a5d474d8758c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:04.698560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caac066a-89c1-4e76-a67e-a5d474d8758c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:04.699368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caac066a-89c1-4e76-a67e-a5d474d8758c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:04.699889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caac066a-89c1-4e76-a67e-a5d474d8758c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:04.700667 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-caac066a-89c1-4e76-a67e-a5d474d8758c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:04.703405 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cb0aac4c-2d06-4204-87ce-0f9e737807a8 req-08700c56-758e-4010-a6e9-2b22aae090d9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:04.703892 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cb0aac4c-2d06-4204-87ce-0f9e737807a8 req-08700c56-758e-4010-a6e9-2b22aae090d9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:04.704327 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-cb0aac4c-2d06-4204-87ce-0f9e737807a8 req-08700c56-758e-4010-a6e9-2b22aae090d9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:04.717403 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-cb0aac4c-2d06-4204-87ce-0f9e737807a8 req-08700c56-758e-4010-a6e9-2b22aae090d9 service nova] Creating event network-changed:ff459b90-9dc3-411a-90a6-4c9c4c3b39ca for instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 on nch2-master-1 Sep 10 21:50:04.722676 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-cb0aac4c-2d06-4204-87ce-0f9e737807a8 req-08700c56-758e-4010-a6e9-2b22aae090d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037019 Sep 10 21:50:04.723522 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3461/7050] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:50:04.851982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-caac066a-89c1-4e76-a67e-a5d474d8758c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:04.861095 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-caac066a-89c1-4e76-a67e-a5d474d8758c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1563 microversion: 2.1 time: 0.177969 Sep 10 21:50:04.862604 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3590/7051] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:04 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:28.111852 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:50:28.112879 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=40 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:50:28.117114 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1295c9a0-4c8b-4281-af1a-4befed23a50b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:50:28.119545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1295c9a0-4c8b-4281-af1a-4befed23a50b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:28.127579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1295c9a0-4c8b-4281-af1a-4befed23a50b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:28.128080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1295c9a0-4c8b-4281-af1a-4befed23a50b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:28.128526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1295c9a0-4c8b-4281-af1a-4befed23a50b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:28.129260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1295c9a0-4c8b-4281-af1a-4befed23a50b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:28.129724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1295c9a0-4c8b-4281-af1a-4befed23a50b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:28.130209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1295c9a0-4c8b-4281-af1a-4befed23a50b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:28.185091 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1295c9a0-4c8b-4281-af1a-4befed23a50b tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9/action" status: 200 len: 24564 microversion: 2.1 time: 0.075116 Sep 10 21:50:28.185734 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3462/7052] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:50:28 2022] POST /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9/action => generated 24564 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:50:39.289056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-eaf3ffaa-af87-410d-8abf-420c04470ba1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:50:39.291182 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:50:39.291868 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=34 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:50:39.301080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaf3ffaa-af87-410d-8abf-420c04470ba1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:39.301853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaf3ffaa-af87-410d-8abf-420c04470ba1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:39.302306 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-eaf3ffaa-af87-410d-8abf-420c04470ba1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:39.325043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-eaf3ffaa-af87-410d-8abf-420c04470ba1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Going to try to stop instance {{(pid=145772) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 21:50:39.369966 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-eaf3ffaa-af87-410d-8abf-420c04470ba1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9/action" status: 202 len: 0 microversion: 2.1 time: 0.085451 Sep 10 21:50:39.370602 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3591/7053] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:50:39 2022] POST /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:50:39.379921 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-88d13c36-daa4-4e3c-af56-ceabf8f54284 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:39.380630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-88d13c36-daa4-4e3c-af56-ceabf8f54284 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:39.383674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:50:39.384316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:50:39.391359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88d13c36-daa4-4e3c-af56-ceabf8f54284 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:39.391856 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88d13c36-daa4-4e3c-af56-ceabf8f54284 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:39.392315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88d13c36-daa4-4e3c-af56-ceabf8f54284 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:39.393028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88d13c36-daa4-4e3c-af56-ceabf8f54284 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:39.393487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88d13c36-daa4-4e3c-af56-ceabf8f54284 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:39.393945 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-88d13c36-daa4-4e3c-af56-ceabf8f54284 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:39.528655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-88d13c36-daa4-4e3c-af56-ceabf8f54284 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:39.537048 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-88d13c36-daa4-4e3c-af56-ceabf8f54284 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1691 microversion: 2.1 time: 0.161602 Sep 10 21:50:39.537623 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3463/7054] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:39 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:40.562877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5fc4a6de-5700-43dc-8a42-e88cc164b84a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:40.563605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5fc4a6de-5700-43dc-8a42-e88cc164b84a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:40.569784 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fc4a6de-5700-43dc-8a42-e88cc164b84a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:40.570305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fc4a6de-5700-43dc-8a42-e88cc164b84a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:40.570749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fc4a6de-5700-43dc-8a42-e88cc164b84a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:40.571449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fc4a6de-5700-43dc-8a42-e88cc164b84a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:40.571906 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fc4a6de-5700-43dc-8a42-e88cc164b84a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:40.572335 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5fc4a6de-5700-43dc-8a42-e88cc164b84a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:40.709483 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5fc4a6de-5700-43dc-8a42-e88cc164b84a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:40.717416 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5fc4a6de-5700-43dc-8a42-e88cc164b84a tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1691 microversion: 2.1 time: 0.159929 Sep 10 21:50:40.718607 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3592/7055] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:40 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:41.742984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c6bd9025-b077-4375-8011-787a65e4d0ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:41.743530 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c6bd9025-b077-4375-8011-787a65e4d0ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:41.753523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6bd9025-b077-4375-8011-787a65e4d0ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:41.754048 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6bd9025-b077-4375-8011-787a65e4d0ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:41.754527 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6bd9025-b077-4375-8011-787a65e4d0ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:41.755228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6bd9025-b077-4375-8011-787a65e4d0ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:41.755686 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6bd9025-b077-4375-8011-787a65e4d0ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:41.756115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c6bd9025-b077-4375-8011-787a65e4d0ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:41.892965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c6bd9025-b077-4375-8011-787a65e4d0ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:41.901143 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c6bd9025-b077-4375-8011-787a65e4d0ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1691 microversion: 2.1 time: 0.162161 Sep 10 21:50:41.901733 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3464/7056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:41 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:42.925326 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ace0520b-f3b7-46c7-9378-b7d1e276f97f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:42.925970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ace0520b-f3b7-46c7-9378-b7d1e276f97f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:42.933113 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ace0520b-f3b7-46c7-9378-b7d1e276f97f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:42.933616 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ace0520b-f3b7-46c7-9378-b7d1e276f97f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:42.934087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ace0520b-f3b7-46c7-9378-b7d1e276f97f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:42.934800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ace0520b-f3b7-46c7-9378-b7d1e276f97f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:42.935273 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ace0520b-f3b7-46c7-9378-b7d1e276f97f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:42.935713 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ace0520b-f3b7-46c7-9378-b7d1e276f97f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:43.069387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ace0520b-f3b7-46c7-9378-b7d1e276f97f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:43.077998 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ace0520b-f3b7-46c7-9378-b7d1e276f97f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1691 microversion: 2.1 time: 0.157055 Sep 10 21:50:43.078582 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3593/7057] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:42 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:44.101842 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7acc1cb8-6fe4-4067-8cfd-e0d64d4bac07 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:44.102491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7acc1cb8-6fe4-4067-8cfd-e0d64d4bac07 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:44.109315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acc1cb8-6fe4-4067-8cfd-e0d64d4bac07 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:44.109808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acc1cb8-6fe4-4067-8cfd-e0d64d4bac07 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:44.110279 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acc1cb8-6fe4-4067-8cfd-e0d64d4bac07 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:44.111050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acc1cb8-6fe4-4067-8cfd-e0d64d4bac07 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:44.111514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acc1cb8-6fe4-4067-8cfd-e0d64d4bac07 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:44.111946 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7acc1cb8-6fe4-4067-8cfd-e0d64d4bac07 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:44.246093 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7acc1cb8-6fe4-4067-8cfd-e0d64d4bac07 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:44.254590 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7acc1cb8-6fe4-4067-8cfd-e0d64d4bac07 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1691 microversion: 2.1 time: 0.156745 Sep 10 21:50:44.255180 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3465/7058] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:44 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:45.278465 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5a97a48b-1d3e-45bb-9f3c-f31dee74059d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:45.278995 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5a97a48b-1d3e-45bb-9f3c-f31dee74059d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:45.285895 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a97a48b-1d3e-45bb-9f3c-f31dee74059d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:45.286387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a97a48b-1d3e-45bb-9f3c-f31dee74059d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:45.286832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a97a48b-1d3e-45bb-9f3c-f31dee74059d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:45.287545 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a97a48b-1d3e-45bb-9f3c-f31dee74059d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:45.288009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a97a48b-1d3e-45bb-9f3c-f31dee74059d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:45.288444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5a97a48b-1d3e-45bb-9f3c-f31dee74059d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:45.427330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5a97a48b-1d3e-45bb-9f3c-f31dee74059d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:45.435070 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5a97a48b-1d3e-45bb-9f3c-f31dee74059d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1691 microversion: 2.1 time: 0.160650 Sep 10 21:50:45.435645 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3594/7059] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:45 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:46.459079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5baa88cf-2f56-4886-883b-49f91a746c09 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:46.459705 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5baa88cf-2f56-4886-883b-49f91a746c09 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:46.466542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5baa88cf-2f56-4886-883b-49f91a746c09 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:46.467038 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5baa88cf-2f56-4886-883b-49f91a746c09 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:46.468278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5baa88cf-2f56-4886-883b-49f91a746c09 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:46.469045 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5baa88cf-2f56-4886-883b-49f91a746c09 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:46.469534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5baa88cf-2f56-4886-883b-49f91a746c09 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:46.469996 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5baa88cf-2f56-4886-883b-49f91a746c09 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:46.601508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5baa88cf-2f56-4886-883b-49f91a746c09 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:46.609497 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5baa88cf-2f56-4886-883b-49f91a746c09 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1691 microversion: 2.1 time: 0.154356 Sep 10 21:50:46.610115 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3466/7060] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:46 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:47.633668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-37b38a80-aa60-48cf-a834-d71d6da00076 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:47.634294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-37b38a80-aa60-48cf-a834-d71d6da00076 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:47.640925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37b38a80-aa60-48cf-a834-d71d6da00076 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:47.641415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37b38a80-aa60-48cf-a834-d71d6da00076 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:47.641877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37b38a80-aa60-48cf-a834-d71d6da00076 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:47.642581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37b38a80-aa60-48cf-a834-d71d6da00076 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:47.643042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37b38a80-aa60-48cf-a834-d71d6da00076 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:47.643475 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-37b38a80-aa60-48cf-a834-d71d6da00076 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:47.778586 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-37b38a80-aa60-48cf-a834-d71d6da00076 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:47.786490 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-37b38a80-aa60-48cf-a834-d71d6da00076 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1691 microversion: 2.1 time: 0.157075 Sep 10 21:50:47.787068 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3595/7061] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:47 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:48.810924 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6caded4c-814a-4dac-89ae-9e3e72f7c976 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:48.811647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6caded4c-814a-4dac-89ae-9e3e72f7c976 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:48.818794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6caded4c-814a-4dac-89ae-9e3e72f7c976 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:48.819296 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6caded4c-814a-4dac-89ae-9e3e72f7c976 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:48.819768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6caded4c-814a-4dac-89ae-9e3e72f7c976 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:48.820474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6caded4c-814a-4dac-89ae-9e3e72f7c976 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:48.820930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6caded4c-814a-4dac-89ae-9e3e72f7c976 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:48.821497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6caded4c-814a-4dac-89ae-9e3e72f7c976 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:48.991982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6caded4c-814a-4dac-89ae-9e3e72f7c976 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:49.001181 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6caded4c-814a-4dac-89ae-9e3e72f7c976 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1691 microversion: 2.1 time: 0.194193 Sep 10 21:50:49.001772 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3467/7062] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:48 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1691 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:50.025685 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c6be9421-e99a-45fa-baa0-23ce9a329f38 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:50.026325 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c6be9421-e99a-45fa-baa0-23ce9a329f38 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:50.033910 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6be9421-e99a-45fa-baa0-23ce9a329f38 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:50.034394 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6be9421-e99a-45fa-baa0-23ce9a329f38 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:50.034878 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6be9421-e99a-45fa-baa0-23ce9a329f38 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:50.035554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6be9421-e99a-45fa-baa0-23ce9a329f38 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:50.036005 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6be9421-e99a-45fa-baa0-23ce9a329f38 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:50.036431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c6be9421-e99a-45fa-baa0-23ce9a329f38 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:50.168348 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c6be9421-e99a-45fa-baa0-23ce9a329f38 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:50.176559 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c6be9421-e99a-45fa-baa0-23ce9a329f38 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1668 microversion: 2.1 time: 0.154620 Sep 10 21:50:50.177406 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3596/7063] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:50 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:51.276930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b6db21c2-f1c7-4ffb-a0c7-2e4add8273fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:50:51.279206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b6db21c2-f1c7-4ffb-a0c7-2e4add8273fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:51.286347 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6db21c2-f1c7-4ffb-a0c7-2e4add8273fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:51.286846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6db21c2-f1c7-4ffb-a0c7-2e4add8273fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:51.287295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6db21c2-f1c7-4ffb-a0c7-2e4add8273fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:51.287997 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6db21c2-f1c7-4ffb-a0c7-2e4add8273fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:51.288461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6db21c2-f1c7-4ffb-a0c7-2e4add8273fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:51.288895 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b6db21c2-f1c7-4ffb-a0c7-2e4add8273fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:51.349224 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b6db21c2-f1c7-4ffb-a0c7-2e4add8273fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9/action" status: 200 len: 38379 microversion: 2.1 time: 0.076117 Sep 10 21:50:51.350164 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3468/7064] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:50:51 2022] POST /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9/action => generated 38379 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:50:51.362719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-bc90191d-9bcf-4ea6-9870-b13b7804a8ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:50:51.373487 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc90191d-9bcf-4ea6-9870-b13b7804a8ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:51.374042 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc90191d-9bcf-4ea6-9870-b13b7804a8ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:51.374485 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-bc90191d-9bcf-4ea6-9870-b13b7804a8ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:51.396761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-bc90191d-9bcf-4ea6-9870-b13b7804a8ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Going to try to start instance {{(pid=145772) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 21:50:51.443760 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-bc90191d-9bcf-4ea6-9870-b13b7804a8ca tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9/action" status: 202 len: 0 microversion: 2.1 time: 0.085582 Sep 10 21:50:51.444368 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3597/7065] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:50:51 2022] POST /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:50:51.454289 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f9292d79-4294-461a-98c5-8365ec97d771 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:51.455009 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f9292d79-4294-461a-98c5-8365ec97d771 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:51.463233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9292d79-4294-461a-98c5-8365ec97d771 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:51.463771 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9292d79-4294-461a-98c5-8365ec97d771 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:51.464948 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9292d79-4294-461a-98c5-8365ec97d771 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:51.465617 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9292d79-4294-461a-98c5-8365ec97d771 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:51.466152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9292d79-4294-461a-98c5-8365ec97d771 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:51.466596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f9292d79-4294-461a-98c5-8365ec97d771 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:51.687102 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f9292d79-4294-461a-98c5-8365ec97d771 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:51.695176 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f9292d79-4294-461a-98c5-8365ec97d771 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1677 microversion: 2.1 time: 0.246181 Sep 10 21:50:51.695870 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3469/7066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:51 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:50:52.720792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-52c7ec35-4a2f-48b9-9c39-df3e8d2ae8fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:50:52.722362 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-52c7ec35-4a2f-48b9-9c39-df3e8d2ae8fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:50:52.730116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c7ec35-4a2f-48b9-9c39-df3e8d2ae8fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:52.730608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c7ec35-4a2f-48b9-9c39-df3e8d2ae8fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:52.731050 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c7ec35-4a2f-48b9-9c39-df3e8d2ae8fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:52.731758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c7ec35-4a2f-48b9-9c39-df3e8d2ae8fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:50:52.732219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c7ec35-4a2f-48b9-9c39-df3e8d2ae8fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:50:52.732648 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-52c7ec35-4a2f-48b9-9c39-df3e8d2ae8fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:50:52.874479 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-52c7ec35-4a2f-48b9-9c39-df3e8d2ae8fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:50:52.882710 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-52c7ec35-4a2f-48b9-9c39-df3e8d2ae8fa tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1681 microversion: 2.1 time: 0.166302 Sep 10 21:50:52.883229 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3598/7067] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:50:52 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:19.082387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a5d0fe4e-d119-4c8d-a796-c9ba387d0784 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:51:19.084604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a5d0fe4e-d119-4c8d-a796-c9ba387d0784 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:19.087526 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=14 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:51:19.088200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=40 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:51:19.096087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5d0fe4e-d119-4c8d-a796-c9ba387d0784 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:19.096580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5d0fe4e-d119-4c8d-a796-c9ba387d0784 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:19.097028 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5d0fe4e-d119-4c8d-a796-c9ba387d0784 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:19.097736 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5d0fe4e-d119-4c8d-a796-c9ba387d0784 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:19.098247 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5d0fe4e-d119-4c8d-a796-c9ba387d0784 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:19.098678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a5d0fe4e-d119-4c8d-a796-c9ba387d0784 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:19.151341 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a5d0fe4e-d119-4c8d-a796-c9ba387d0784 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9/action" status: 200 len: 62932 microversion: 2.1 time: 0.072930 Sep 10 21:51:19.152291 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3470/7068] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:51:19 2022] POST /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9/action => generated 62932 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:51:26.188802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-e3b9a28b-e5c4-41d8-84ba-bce169be8d6c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:26.189345 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e3b9a28b-e5c4-41d8-84ba-bce169be8d6c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:26.190446 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-38414617-937c-4bfc-afc0-038a1c3cdccc req-254b2b42-ca99-4d44-9e5e-c3f5cd23c832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd6ef9d-5761-423c-a36d-497b44d6d7d9", "tag": "ff459b90-9dc3-411a-90a6-4c9c4c3b39ca"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:51:26.195528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=16 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:51:26.196227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:51:26.197898 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3b9a28b-e5c4-41d8-84ba-bce169be8d6c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:26.198489 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3b9a28b-e5c4-41d8-84ba-bce169be8d6c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:26.198841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3b9a28b-e5c4-41d8-84ba-bce169be8d6c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:26.200246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3b9a28b-e5c4-41d8-84ba-bce169be8d6c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:26.200246 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3b9a28b-e5c4-41d8-84ba-bce169be8d6c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:26.201283 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-e3b9a28b-e5c4-41d8-84ba-bce169be8d6c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:26.203301 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-38414617-937c-4bfc-afc0-038a1c3cdccc req-254b2b42-ca99-4d44-9e5e-c3f5cd23c832 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:26.203799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-38414617-937c-4bfc-afc0-038a1c3cdccc req-254b2b42-ca99-4d44-9e5e-c3f5cd23c832 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:26.204240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-38414617-937c-4bfc-afc0-038a1c3cdccc req-254b2b42-ca99-4d44-9e5e-c3f5cd23c832 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:26.217756 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-38414617-937c-4bfc-afc0-038a1c3cdccc req-254b2b42-ca99-4d44-9e5e-c3f5cd23c832 service nova] Creating event network-changed:ff459b90-9dc3-411a-90a6-4c9c4c3b39ca for instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 on nch2-master-1 Sep 10 21:51:26.224088 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-38414617-937c-4bfc-afc0-038a1c3cdccc req-254b2b42-ca99-4d44-9e5e-c3f5cd23c832 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037509 Sep 10 21:51:26.225067 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3471/7069] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:51:26.234219 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-e3b9a28b-e5c4-41d8-84ba-bce169be8d6c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:51:26.318786 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-e3b9a28b-e5c4-41d8-84ba-bce169be8d6c tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 204 len: 0 microversion: 2.1 time: 0.135260 Sep 10 21:51:26.319415 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3599/7070] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:51:26 2022] DELETE /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:51:26.329206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c28d6a08-0320-4553-aa69-60e80edf4b2d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:26.329969 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c28d6a08-0320-4553-aa69-60e80edf4b2d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:26.337209 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c28d6a08-0320-4553-aa69-60e80edf4b2d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:26.337711 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c28d6a08-0320-4553-aa69-60e80edf4b2d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:26.338184 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c28d6a08-0320-4553-aa69-60e80edf4b2d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:26.338905 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c28d6a08-0320-4553-aa69-60e80edf4b2d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:26.339374 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c28d6a08-0320-4553-aa69-60e80edf4b2d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:26.339812 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c28d6a08-0320-4553-aa69-60e80edf4b2d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:26.564627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c28d6a08-0320-4553-aa69-60e80edf4b2d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:26.572636 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c28d6a08-0320-4553-aa69-60e80edf4b2d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1687 microversion: 2.1 time: 0.248508 Sep 10 21:51:26.573218 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3472/7071] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:26 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1687 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:51:27.598940 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e5ad1eb-6a3e-414c-8885-cec5f9a2c116 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:27.599646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3e5ad1eb-6a3e-414c-8885-cec5f9a2c116 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:27.606569 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e5ad1eb-6a3e-414c-8885-cec5f9a2c116 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:27.607657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e5ad1eb-6a3e-414c-8885-cec5f9a2c116 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:27.608094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e5ad1eb-6a3e-414c-8885-cec5f9a2c116 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:27.608790 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e5ad1eb-6a3e-414c-8885-cec5f9a2c116 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:27.609250 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e5ad1eb-6a3e-414c-8885-cec5f9a2c116 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:27.609680 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e5ad1eb-6a3e-414c-8885-cec5f9a2c116 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:27.791197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3e5ad1eb-6a3e-414c-8885-cec5f9a2c116 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:27.799166 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3e5ad1eb-6a3e-414c-8885-cec5f9a2c116 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1687 microversion: 2.1 time: 0.204557 Sep 10 21:51:27.799753 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3600/7072] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:27 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1687 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:28.500534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-2a12a0b8-2007-47a0-8c64-f716859ec9cf req-969c385d-69e7-4e36-8f28-4b0dd4c58618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd6ef9d-5761-423c-a36d-497b44d6d7d9", "name": "network-vif-deleted", "tag": "ff459b90-9dc3-411a-90a6-4c9c4c3b39ca"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:51:28.511890 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2a12a0b8-2007-47a0-8c64-f716859ec9cf req-969c385d-69e7-4e36-8f28-4b0dd4c58618 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:28.512371 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2a12a0b8-2007-47a0-8c64-f716859ec9cf req-969c385d-69e7-4e36-8f28-4b0dd4c58618 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:28.512808 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-2a12a0b8-2007-47a0-8c64-f716859ec9cf req-969c385d-69e7-4e36-8f28-4b0dd4c58618 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:28.525390 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-2a12a0b8-2007-47a0-8c64-f716859ec9cf req-969c385d-69e7-4e36-8f28-4b0dd4c58618 service nova] Creating event network-vif-deleted:ff459b90-9dc3-411a-90a6-4c9c4c3b39ca for instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 on nch2-master-1 Sep 10 21:51:28.531574 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-2a12a0b8-2007-47a0-8c64-f716859ec9cf req-969c385d-69e7-4e36-8f28-4b0dd4c58618 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035489 Sep 10 21:51:28.532389 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3473/7073] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:51:28.822886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:28.823478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:28.830796 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:28.831301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:28.831778 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:28.832497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:28.832961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:28.833398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:28.870371 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:28.870870 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:28.871322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:28.871785 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lazy-loading 'fault' on Instance uuid 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:51:28.914490 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:28.922740 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ce01403e-5dff-40af-87fa-855f07c92feb tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 200 len: 1355 microversion: 2.1 time: 0.103767 Sep 10 21:51:28.923336 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3601/7074] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:28 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:29.948412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:29.949126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: 0fd6ef9d-5761-423c-a36d-497b44d6d7d9] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:29.956047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:29.956541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:29.956991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:29.957690 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:29.958191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:29.958631 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:29.972560 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] HTTP exception thrown: Instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 could not be found. Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Request method failure captured: Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 HTTP/1.1 Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQUOmtTgV6K-BMoGYvxDxchioERSmqpfPLuUt3LGJfKR4DSKjq6mGKscCmiof0_FepwQHW1VdfGPuuOEuA3gCoWYmo51trMKNExzTnWdvX3v_alk8XXirr1x7LoluSy5vAtxzU4HCU1achY04W8MWdDNvGA_vmwlrmERJSDYC4X8UZc Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 89de7e77cc234d14943dc99d02388c45 Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89de7e77cc234d14943dc99d02388c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89de7e77cc234d14943dc99d02388c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89de7e77cc234d14943dc99d02388c45", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89de7e77cc234d14943dc99d02388c45"}]}] Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 89de7e77cc234d14943dc99d02388c45 Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TestNetworkAdvancedServerOps-253226799-project Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2db198ac8f2842638e0edd931ca8d26d Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-253226799-project Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 could not be found. Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '0fd6ef9d-5761-423c-a36d-497b44d6d7d9'} Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 could not be found. Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 could not be found. Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:51:29.974255 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 could not be found. Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Returning 404 to user: Instance 0fd6ef9d-5761-423c-a36d-497b44d6d7d9 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ce1000a5-d873-426d-87b8-7de7b6b29fc5 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9" status: 404 len: 111 microversion: 2.1 time: 0.032552 Sep 10 21:51:29.979178 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3474/7075] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:29 2022] GET /compute/v2.1/servers/0fd6ef9d-5761-423c-a36d-497b44d6d7d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:51:33.315559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-93f11c98-9a09-4083-a771-aa44e364e2ea tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '.version_select at 0x7f993f968040>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:33.341752 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-93f11c98-9a09-4083-a771-aa44e364e2ea tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-199297027" status: 202 len: 0 microversion: 2.1 time: 0.029516 Sep 10 21:51:33.342761 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3602/7076] 10.222.0.33 () {58 vars in 1281 bytes} [Sat Sep 10 21:51:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-199297027 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:51:33.378139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-48e663ad-b8eb-4e16-afe4-62a454c11082 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'create', calling method: .version_select at 0x7f9944624ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-558878758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3w0+euNlKjU+L0akoBGu6UKkP3uua7b/eaoZdk9DXAV8Gm0bNvrPf7r1xryND0gaGnQfEqS1Woc1wG753jHDsFzoSThzl5fuSx88w++ApdT+ahBtw0nrjp1UyuNAe1Kw=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:51:33.395280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-48e663ad-b8eb-4e16-afe4-62a454c11082 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for project 89de7e77cc234d14943dc99d02388c45. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:51:33.401634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-48e663ad-b8eb-4e16-afe4-62a454c11082 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for user 2db198ac8f2842638e0edd931ca8d26d and project 89de7e77cc234d14943dc99d02388c45. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:51:33.428609 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-48e663ad-b8eb-4e16-afe4-62a454c11082 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054933 Sep 10 21:51:33.429235 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3475/7077] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:51:33 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:51:38.788065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1849388317", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "networks": [{"uuid": "1841f4e2-098d-4871-98d6-c30cb4229663"}], "key_name": "tempest-TestNetworkAdvancedServerOps-558878758", "security_groups": [{"name": "tempest-secgroup-smoke-239037608"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:51:38.912054 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] validate_networks() for [('1841f4e2-098d-4871-98d6-c30cb4229663', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:51:38.918578 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:51:39.414977 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:51:39.415651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:51:39.416139 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:51:39.416562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:51:39.416982 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:51:39.427841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:39.429084 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:39.429907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:39.431107 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:39.431854 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:39.433507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:39.459518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for project 89de7e77cc234d14943dc99d02388c45. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:51:39.464863 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Getting quotas for user 2db198ac8f2842638e0edd931ca8d26d and project 89de7e77cc234d14943dc99d02388c45. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:51:39.478741 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:51:39.481093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:51:39.540186 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-85b22a10-2036-429a-a3a2-f0d30f16d488 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756999 Sep 10 21:51:39.541537 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3603/7078] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:51:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:51:39.558633 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4d1d90b5-bb05-4e0d-a22d-2c3a858c5a29 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:39.559982 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4d1d90b5-bb05-4e0d-a22d-2c3a858c5a29 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:39.639438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4d1d90b5-bb05-4e0d-a22d-2c3a858c5a29 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:39.648207 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4d1d90b5-bb05-4e0d-a22d-2c3a858c5a29 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1266 microversion: 2.1 time: 0.098615 Sep 10 21:51:39.649671 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3476/7079] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:39 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:51:40.674600 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f4cca406-88ca-4e27-a7ef-40092471bd5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:40.675877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f4cca406-88ca-4e27-a7ef-40092471bd5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:40.682610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4cca406-88ca-4e27-a7ef-40092471bd5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:40.683096 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4cca406-88ca-4e27-a7ef-40092471bd5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:40.683535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4cca406-88ca-4e27-a7ef-40092471bd5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:40.684240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4cca406-88ca-4e27-a7ef-40092471bd5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:40.685531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4cca406-88ca-4e27-a7ef-40092471bd5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:40.686206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f4cca406-88ca-4e27-a7ef-40092471bd5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:40.759420 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f4cca406-88ca-4e27-a7ef-40092471bd5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:40.768791 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f4cca406-88ca-4e27-a7ef-40092471bd5e tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1318 microversion: 2.1 time: 0.099946 Sep 10 21:51:40.769634 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3604/7080] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:40 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:41.792750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-166fa95a-edc3-4cae-b387-9547d20560ec tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:41.793801 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-166fa95a-edc3-4cae-b387-9547d20560ec tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:41.800823 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=16 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:51:41.804782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-166fa95a-edc3-4cae-b387-9547d20560ec tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:41.805614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-166fa95a-edc3-4cae-b387-9547d20560ec tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:41.806544 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-166fa95a-edc3-4cae-b387-9547d20560ec tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:41.807457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-166fa95a-edc3-4cae-b387-9547d20560ec tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:41.808310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-166fa95a-edc3-4cae-b387-9547d20560ec tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:41.808927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-166fa95a-edc3-4cae-b387-9547d20560ec tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:41.967147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-166fa95a-edc3-4cae-b387-9547d20560ec tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:41.979439 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-166fa95a-edc3-4cae-b387-9547d20560ec tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1391 microversion: 2.1 time: 0.190520 Sep 10 21:51:42.001922 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3477/7081] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:41 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:42.474538 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6bb9ff74-d65e-4e3d-926c-99e05350382d req-dff5cd60-70f5-4ad6-9539-90bb23769ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d6381e-eeaf-4c7b-be5a-d1301c4235b0", "tag": "a8a405f4-1d04-4c4e-b6f3-f4c70efe10b4"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:51:42.487611 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6bb9ff74-d65e-4e3d-926c-99e05350382d req-dff5cd60-70f5-4ad6-9539-90bb23769ab5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:42.488039 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6bb9ff74-d65e-4e3d-926c-99e05350382d req-dff5cd60-70f5-4ad6-9539-90bb23769ab5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:42.488478 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6bb9ff74-d65e-4e3d-926c-99e05350382d req-dff5cd60-70f5-4ad6-9539-90bb23769ab5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:42.502107 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6bb9ff74-d65e-4e3d-926c-99e05350382d req-dff5cd60-70f5-4ad6-9539-90bb23769ab5 service nova] Creating event network-changed:a8a405f4-1d04-4c4e-b6f3-f4c70efe10b4 for instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 on nch1-master-1 Sep 10 21:51:42.507283 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6bb9ff74-d65e-4e3d-926c-99e05350382d req-dff5cd60-70f5-4ad6-9539-90bb23769ab5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037544 Sep 10 21:51:42.508210 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3605/7082] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:51:43.004123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-73bb78f3-f6f9-4b9d-b335-f3bdb1bffb41 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:43.004843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-73bb78f3-f6f9-4b9d-b335-f3bdb1bffb41 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:43.012067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73bb78f3-f6f9-4b9d-b335-f3bdb1bffb41 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:43.012661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73bb78f3-f6f9-4b9d-b335-f3bdb1bffb41 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:43.013183 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73bb78f3-f6f9-4b9d-b335-f3bdb1bffb41 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:43.013931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73bb78f3-f6f9-4b9d-b335-f3bdb1bffb41 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:43.014377 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73bb78f3-f6f9-4b9d-b335-f3bdb1bffb41 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:43.014804 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-73bb78f3-f6f9-4b9d-b335-f3bdb1bffb41 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:43.155074 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-73bb78f3-f6f9-4b9d-b335-f3bdb1bffb41 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:43.162896 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-73bb78f3-f6f9-4b9d-b335-f3bdb1bffb41 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1391 microversion: 2.1 time: 0.162715 Sep 10 21:51:43.163482 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3478/7083] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:42 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:44.188457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a77b169f-795b-4ff8-ac8a-71449dcf0040 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:44.189156 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a77b169f-795b-4ff8-ac8a-71449dcf0040 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:44.195318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a77b169f-795b-4ff8-ac8a-71449dcf0040 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:44.195822 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a77b169f-795b-4ff8-ac8a-71449dcf0040 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:44.196257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a77b169f-795b-4ff8-ac8a-71449dcf0040 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:44.196943 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a77b169f-795b-4ff8-ac8a-71449dcf0040 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:44.197396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a77b169f-795b-4ff8-ac8a-71449dcf0040 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:44.197843 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a77b169f-795b-4ff8-ac8a-71449dcf0040 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:44.335363 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a77b169f-795b-4ff8-ac8a-71449dcf0040 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:44.343297 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a77b169f-795b-4ff8-ac8a-71449dcf0040 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1391 microversion: 2.1 time: 0.161034 Sep 10 21:51:44.343873 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3606/7084] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:44 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:45.367529 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c54af18f-8049-4c35-b6bd-83e3d7890038 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:45.368174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c54af18f-8049-4c35-b6bd-83e3d7890038 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:45.376050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c54af18f-8049-4c35-b6bd-83e3d7890038 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:45.376537 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c54af18f-8049-4c35-b6bd-83e3d7890038 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:45.376974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c54af18f-8049-4c35-b6bd-83e3d7890038 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:45.377674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c54af18f-8049-4c35-b6bd-83e3d7890038 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:45.378155 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c54af18f-8049-4c35-b6bd-83e3d7890038 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:45.378584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c54af18f-8049-4c35-b6bd-83e3d7890038 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:45.511487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c54af18f-8049-4c35-b6bd-83e3d7890038 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:45.520042 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c54af18f-8049-4c35-b6bd-83e3d7890038 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1391 microversion: 2.1 time: 0.156930 Sep 10 21:51:45.520635 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3479/7085] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:45 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:46.545492 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e38eda5-8a83-4b6f-8513-043e6affc2f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:46.546153 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3e38eda5-8a83-4b6f-8513-043e6affc2f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:46.552473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e38eda5-8a83-4b6f-8513-043e6affc2f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:46.553064 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e38eda5-8a83-4b6f-8513-043e6affc2f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:46.553511 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e38eda5-8a83-4b6f-8513-043e6affc2f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:46.554256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e38eda5-8a83-4b6f-8513-043e6affc2f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:46.554715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e38eda5-8a83-4b6f-8513-043e6affc2f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:46.555141 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e38eda5-8a83-4b6f-8513-043e6affc2f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:46.689056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3e38eda5-8a83-4b6f-8513-043e6affc2f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:46.696820 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3e38eda5-8a83-4b6f-8513-043e6affc2f0 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1391 microversion: 2.1 time: 0.155958 Sep 10 21:51:46.697396 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3607/7086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:46 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:47.675157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1325e5b8-ce9d-4d66-8cf9-48db20277278 req-7d45aeaf-b66e-4c72-a056-8ab435e7ab2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d6381e-eeaf-4c7b-be5a-d1301c4235b0", "name": "network-vif-plugged", "status": "completed", "tag": "a8a405f4-1d04-4c4e-b6f3-f4c70efe10b4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:51:47.686519 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1325e5b8-ce9d-4d66-8cf9-48db20277278 req-7d45aeaf-b66e-4c72-a056-8ab435e7ab2a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:47.688063 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1325e5b8-ce9d-4d66-8cf9-48db20277278 req-7d45aeaf-b66e-4c72-a056-8ab435e7ab2a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:47.688506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1325e5b8-ce9d-4d66-8cf9-48db20277278 req-7d45aeaf-b66e-4c72-a056-8ab435e7ab2a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:47.701040 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1325e5b8-ce9d-4d66-8cf9-48db20277278 req-7d45aeaf-b66e-4c72-a056-8ab435e7ab2a service nova] Creating event network-vif-plugged:a8a405f4-1d04-4c4e-b6f3-f4c70efe10b4 for instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 on nch1-master-1 Sep 10 21:51:47.706397 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1325e5b8-ce9d-4d66-8cf9-48db20277278 req-7d45aeaf-b66e-4c72-a056-8ab435e7ab2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035268 Sep 10 21:51:47.707381 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3480/7087] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:51:47.721004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b723f8b1-3c72-486c-b967-1611133d9049 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:47.721765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b723f8b1-3c72-486c-b967-1611133d9049 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:47.728743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b723f8b1-3c72-486c-b967-1611133d9049 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:47.729287 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b723f8b1-3c72-486c-b967-1611133d9049 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:47.729743 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b723f8b1-3c72-486c-b967-1611133d9049 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:47.730473 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b723f8b1-3c72-486c-b967-1611133d9049 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:47.730938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b723f8b1-3c72-486c-b967-1611133d9049 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:47.731992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b723f8b1-3c72-486c-b967-1611133d9049 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:47.916963 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-b723f8b1-3c72-486c-b967-1611133d9049 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:47.925248 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b723f8b1-3c72-486c-b967-1611133d9049 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1391 microversion: 2.1 time: 0.208087 Sep 10 21:51:47.925857 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3608/7088] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:47 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1391 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:48.949267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-7e2479f4-2a9a-4c04-8e9b-e5dda27d0594 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:48.950532 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-7e2479f4-2a9a-4c04-8e9b-e5dda27d0594 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:48.957594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e2479f4-2a9a-4c04-8e9b-e5dda27d0594 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:48.958121 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e2479f4-2a9a-4c04-8e9b-e5dda27d0594 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:48.958561 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e2479f4-2a9a-4c04-8e9b-e5dda27d0594 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:48.959254 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e2479f4-2a9a-4c04-8e9b-e5dda27d0594 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:48.959706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e2479f4-2a9a-4c04-8e9b-e5dda27d0594 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:48.960129 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-7e2479f4-2a9a-4c04-8e9b-e5dda27d0594 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:49.101564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-7e2479f4-2a9a-4c04-8e9b-e5dda27d0594 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:49.110209 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-7e2479f4-2a9a-4c04-8e9b-e5dda27d0594 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1391 microversion: 2.1 time: 0.165385 Sep 10 21:51:49.110803 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3481/7089] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:48 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:50.135527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5c2d8fa1-034b-4a34-a015-a2f3492cecc4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:50.137062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5c2d8fa1-034b-4a34-a015-a2f3492cecc4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:50.139330 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:51:50.140015 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:51:50.145418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c2d8fa1-034b-4a34-a015-a2f3492cecc4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:50.145952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c2d8fa1-034b-4a34-a015-a2f3492cecc4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:50.146993 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c2d8fa1-034b-4a34-a015-a2f3492cecc4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:50.147158 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c2d8fa1-034b-4a34-a015-a2f3492cecc4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:50.147672 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c2d8fa1-034b-4a34-a015-a2f3492cecc4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:50.148038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5c2d8fa1-034b-4a34-a015-a2f3492cecc4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:50.299309 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5c2d8fa1-034b-4a34-a015-a2f3492cecc4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:50.308250 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5c2d8fa1-034b-4a34-a015-a2f3492cecc4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1562 microversion: 2.1 time: 0.177480 Sep 10 21:51:50.308760 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3609/7090] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:50 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1562 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:50.335278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3b99d977-80ce-4264-862a-7ab39357350f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:50.335903 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3b99d977-80ce-4264-862a-7ab39357350f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:50.337937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:51:50.339665 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:51:50.346832 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b99d977-80ce-4264-862a-7ab39357350f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:50.347335 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b99d977-80ce-4264-862a-7ab39357350f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:50.347785 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b99d977-80ce-4264-862a-7ab39357350f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:50.348498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b99d977-80ce-4264-862a-7ab39357350f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:50.348963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b99d977-80ce-4264-862a-7ab39357350f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:50.349399 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3b99d977-80ce-4264-862a-7ab39357350f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:50.495243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-3b99d977-80ce-4264-862a-7ab39357350f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:50.503316 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3b99d977-80ce-4264-862a-7ab39357350f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1562 microversion: 2.1 time: 0.172049 Sep 10 21:51:50.503945 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3482/7091] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:50 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:51:52.382635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-bd3cda73-819f-4a0a-b664-ba7b06f544dc req-8269aad6-d84c-42a3-8b92-8bd52fa6b658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d6381e-eeaf-4c7b-be5a-d1301c4235b0", "tag": "a8a405f4-1d04-4c4e-b6f3-f4c70efe10b4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:51:52.386391 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c5baacc3-bf9f-4228-892e-59edd38d1b60 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:51:52.387082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c5baacc3-bf9f-4228-892e-59edd38d1b60 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:51:52.400608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5baacc3-bf9f-4228-892e-59edd38d1b60 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:52.401218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5baacc3-bf9f-4228-892e-59edd38d1b60 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:52.401734 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5baacc3-bf9f-4228-892e-59edd38d1b60 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:52.401914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bd3cda73-819f-4a0a-b664-ba7b06f544dc req-8269aad6-d84c-42a3-8b92-8bd52fa6b658 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:52.402315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bd3cda73-819f-4a0a-b664-ba7b06f544dc req-8269aad6-d84c-42a3-8b92-8bd52fa6b658 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:52.402613 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5baacc3-bf9f-4228-892e-59edd38d1b60 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:51:52.402756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-bd3cda73-819f-4a0a-b664-ba7b06f544dc req-8269aad6-d84c-42a3-8b92-8bd52fa6b658 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:52.403210 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5baacc3-bf9f-4228-892e-59edd38d1b60 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:51:52.403714 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c5baacc3-bf9f-4228-892e-59edd38d1b60 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:51:52.416685 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-bd3cda73-819f-4a0a-b664-ba7b06f544dc req-8269aad6-d84c-42a3-8b92-8bd52fa6b658 service nova] Creating event network-changed:a8a405f4-1d04-4c4e-b6f3-f4c70efe10b4 for instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 on nch1-master-1 Sep 10 21:51:52.422138 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-bd3cda73-819f-4a0a-b664-ba7b06f544dc req-8269aad6-d84c-42a3-8b92-8bd52fa6b658 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043071 Sep 10 21:51:52.423187 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3483/7092] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:51:52.635902 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c5baacc3-bf9f-4228-892e-59edd38d1b60 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:51:52.643816 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c5baacc3-bf9f-4228-892e-59edd38d1b60 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1562 microversion: 2.1 time: 0.267329 Sep 10 21:51:52.644397 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3610/7093] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:51:52 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1562 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:52:23.922880 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:52:23.923640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=34 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:52:23.927916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8b128d78-e325-4aa3-90cb-825b495ed57d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:52:23.930329 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8b128d78-e325-4aa3-90cb-825b495ed57d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:52:23.938281 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b128d78-e325-4aa3-90cb-825b495ed57d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:23.938779 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b128d78-e325-4aa3-90cb-825b495ed57d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:23.939228 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b128d78-e325-4aa3-90cb-825b495ed57d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:23.939939 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b128d78-e325-4aa3-90cb-825b495ed57d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:23.940409 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b128d78-e325-4aa3-90cb-825b495ed57d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:23.940848 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b128d78-e325-4aa3-90cb-825b495ed57d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:24.009385 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8b128d78-e325-4aa3-90cb-825b495ed57d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0/action" status: 200 len: 24574 microversion: 2.1 time: 0.088425 Sep 10 21:52:24.010209 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3484/7094] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:52:23 2022] POST /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0/action => generated 24574 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:52:54.396476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:52:54.397334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=40 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:52:54.402560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3e418d7d-c992-4af1-8b1c-4924cfe30fe4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:52:54.403093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3e418d7d-c992-4af1-8b1c-4924cfe30fe4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:52:54.411149 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e418d7d-c992-4af1-8b1c-4924cfe30fe4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:54.411635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e418d7d-c992-4af1-8b1c-4924cfe30fe4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:54.412072 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e418d7d-c992-4af1-8b1c-4924cfe30fe4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:54.412767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e418d7d-c992-4af1-8b1c-4924cfe30fe4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:54.413215 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e418d7d-c992-4af1-8b1c-4924cfe30fe4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:54.413638 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3e418d7d-c992-4af1-8b1c-4924cfe30fe4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:54.438946 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-3e418d7d-c992-4af1-8b1c-4924cfe30fe4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lazy-loading 'flavor' on Instance uuid e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:52:54.509204 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3e418d7d-c992-4af1-8b1c-4924cfe30fe4 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0/action" status: 202 len: 0 microversion: 2.1 time: 0.114340 Sep 10 21:52:54.510095 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3611/7095] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:52:54 2022] POST /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:52:54.519807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f3a36f1b-602a-4f06-a855-ee70903655cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:52:54.520525 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f3a36f1b-602a-4f06-a855-ee70903655cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:52:54.523175 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:52:54.523896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=4 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:52:54.531568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a36f1b-602a-4f06-a855-ee70903655cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:54.531568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a36f1b-602a-4f06-a855-ee70903655cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:54.531965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a36f1b-602a-4f06-a855-ee70903655cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:54.532748 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a36f1b-602a-4f06-a855-ee70903655cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:54.533223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a36f1b-602a-4f06-a855-ee70903655cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:54.533657 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f3a36f1b-602a-4f06-a855-ee70903655cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:54.671777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f3a36f1b-602a-4f06-a855-ee70903655cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:52:54.679631 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f3a36f1b-602a-4f06-a855-ee70903655cc tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1688 microversion: 2.1 time: 0.164984 Sep 10 21:52:54.680206 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3485/7096] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:52:54 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:52:55.704845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cfb0890c-dff9-4d85-8f58-edc655110e64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:52:55.705541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cfb0890c-dff9-4d85-8f58-edc655110e64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:52:55.715340 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb0890c-dff9-4d85-8f58-edc655110e64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:55.715826 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb0890c-dff9-4d85-8f58-edc655110e64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:55.716310 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb0890c-dff9-4d85-8f58-edc655110e64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:55.717003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb0890c-dff9-4d85-8f58-edc655110e64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:55.718205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb0890c-dff9-4d85-8f58-edc655110e64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:55.718808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cfb0890c-dff9-4d85-8f58-edc655110e64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:55.857924 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cfb0890c-dff9-4d85-8f58-edc655110e64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:52:55.866262 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cfb0890c-dff9-4d85-8f58-edc655110e64 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1688 microversion: 2.1 time: 0.166154 Sep 10 21:52:55.866837 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3612/7097] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:52:55 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:52:56.891701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cf88474b-07c4-4bbc-9c50-f6820ec1fda9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:52:56.892321 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cf88474b-07c4-4bbc-9c50-f6820ec1fda9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:52:56.900001 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf88474b-07c4-4bbc-9c50-f6820ec1fda9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:56.900491 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf88474b-07c4-4bbc-9c50-f6820ec1fda9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:56.900934 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf88474b-07c4-4bbc-9c50-f6820ec1fda9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:56.901634 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf88474b-07c4-4bbc-9c50-f6820ec1fda9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:56.902125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf88474b-07c4-4bbc-9c50-f6820ec1fda9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:56.902557 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-cf88474b-07c4-4bbc-9c50-f6820ec1fda9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:57.036390 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cf88474b-07c4-4bbc-9c50-f6820ec1fda9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:52:57.044127 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cf88474b-07c4-4bbc-9c50-f6820ec1fda9 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1671 microversion: 2.1 time: 0.156955 Sep 10 21:52:57.044704 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3486/7098] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:52:56 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:52:58.138726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-83ed41ed-bcc3-4376-916c-448f34af1744 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:52:58.141555 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-83ed41ed-bcc3-4376-916c-448f34af1744 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:52:58.148513 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83ed41ed-bcc3-4376-916c-448f34af1744 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:58.148992 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83ed41ed-bcc3-4376-916c-448f34af1744 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:58.149458 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83ed41ed-bcc3-4376-916c-448f34af1744 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:58.150180 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83ed41ed-bcc3-4376-916c-448f34af1744 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:58.150633 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83ed41ed-bcc3-4376-916c-448f34af1744 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:58.151056 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-83ed41ed-bcc3-4376-916c-448f34af1744 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:58.211461 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-83ed41ed-bcc3-4376-916c-448f34af1744 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0/action" status: 200 len: 36017 microversion: 2.1 time: 0.076500 Sep 10 21:52:58.212095 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3613/7099] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:52:58 2022] POST /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0/action => generated 36017 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:52:58.223932 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a642ac7b-ba0b-424f-b2f9-0474cb6b2d28 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:52:58.224514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a642ac7b-ba0b-424f-b2f9-0474cb6b2d28 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:52:58.231515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a642ac7b-ba0b-424f-b2f9-0474cb6b2d28 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:58.231955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a642ac7b-ba0b-424f-b2f9-0474cb6b2d28 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:58.232480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a642ac7b-ba0b-424f-b2f9-0474cb6b2d28 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:58.233618 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a642ac7b-ba0b-424f-b2f9-0474cb6b2d28 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:58.234389 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a642ac7b-ba0b-424f-b2f9-0474cb6b2d28 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:58.234774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a642ac7b-ba0b-424f-b2f9-0474cb6b2d28 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:58.300948 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a642ac7b-ba0b-424f-b2f9-0474cb6b2d28 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0/action" status: 202 len: 0 microversion: 2.1 time: 0.080747 Sep 10 21:52:58.301623 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3487/7100] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:52:58 2022] POST /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:52:58.310705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0bdbbc75-16b3-4efb-8fc3-cbe623c2b241 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:52:58.312026 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0bdbbc75-16b3-4efb-8fc3-cbe623c2b241 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:52:58.319817 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc75-16b3-4efb-8fc3-cbe623c2b241 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:58.320416 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc75-16b3-4efb-8fc3-cbe623c2b241 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:58.321057 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc75-16b3-4efb-8fc3-cbe623c2b241 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:58.321768 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc75-16b3-4efb-8fc3-cbe623c2b241 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:58.322318 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc75-16b3-4efb-8fc3-cbe623c2b241 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:58.322911 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc75-16b3-4efb-8fc3-cbe623c2b241 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:58.496551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0bdbbc75-16b3-4efb-8fc3-cbe623c2b241 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:52:58.504626 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0bdbbc75-16b3-4efb-8fc3-cbe623c2b241 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1677 microversion: 2.1 time: 0.198193 Sep 10 21:52:58.505293 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3614/7101] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:52:58 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:52:59.527088 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 21:52:59.527623 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 21:52:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 (ip 10.222.0.33) !!! Sep 10 21:52:59.532331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0548ea56-4627-4bf7-a954-80a12de63d12 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:52:59.533025 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0548ea56-4627-4bf7-a954-80a12de63d12 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:52:59.544147 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0548ea56-4627-4bf7-a954-80a12de63d12 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:59.544638 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0548ea56-4627-4bf7-a954-80a12de63d12 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:59.545080 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0548ea56-4627-4bf7-a954-80a12de63d12 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:59.546354 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0548ea56-4627-4bf7-a954-80a12de63d12 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:52:59.546850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0548ea56-4627-4bf7-a954-80a12de63d12 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:52:59.547285 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0548ea56-4627-4bf7-a954-80a12de63d12 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:52:59.682959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0548ea56-4627-4bf7-a954-80a12de63d12 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:52:59.691423 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0548ea56-4627-4bf7-a954-80a12de63d12 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1677 microversion: 2.1 time: 0.166259 Sep 10 21:52:59.692024 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3488/7102] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:52:59 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:00.715660 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-646baafa-c3c5-4264-a6ee-8f9ae74e166f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:00.716268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-646baafa-c3c5-4264-a6ee-8f9ae74e166f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:00.723140 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-646baafa-c3c5-4264-a6ee-8f9ae74e166f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:00.723608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-646baafa-c3c5-4264-a6ee-8f9ae74e166f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:00.724055 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-646baafa-c3c5-4264-a6ee-8f9ae74e166f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:00.724751 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-646baafa-c3c5-4264-a6ee-8f9ae74e166f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:00.725214 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-646baafa-c3c5-4264-a6ee-8f9ae74e166f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:00.725646 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-646baafa-c3c5-4264-a6ee-8f9ae74e166f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:00.857815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-646baafa-c3c5-4264-a6ee-8f9ae74e166f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:00.865968 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-646baafa-c3c5-4264-a6ee-8f9ae74e166f tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1680 microversion: 2.1 time: 0.154398 Sep 10 21:53:00.866539 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3615/7103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:00 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:00.973614 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-257fb0bd-560e-4083-85c3-ff8dc3c3ab4d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:53:00.975904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-257fb0bd-560e-4083-85c3-ff8dc3c3ab4d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:00.982911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-257fb0bd-560e-4083-85c3-ff8dc3c3ab4d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:00.983400 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-257fb0bd-560e-4083-85c3-ff8dc3c3ab4d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:00.984350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-257fb0bd-560e-4083-85c3-ff8dc3c3ab4d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:00.985208 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-257fb0bd-560e-4083-85c3-ff8dc3c3ab4d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:00.985660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-257fb0bd-560e-4083-85c3-ff8dc3c3ab4d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:00.986113 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-257fb0bd-560e-4083-85c3-ff8dc3c3ab4d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:01.049175 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-257fb0bd-560e-4083-85c3-ff8dc3c3ab4d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "POST /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0/action" status: 200 len: 36017 microversion: 2.1 time: 0.079701 Sep 10 21:53:01.049838 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3489/7104] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:53:00 2022] POST /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0/action => generated 36017 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 21:53:02.063021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-94b00a3d-2d3c-4e28-955f-fbc4484e8d42 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:02.064108 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-94b00a3d-2d3c-4e28-955f-fbc4484e8d42 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:02.071184 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b00a3d-2d3c-4e28-955f-fbc4484e8d42 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:02.071668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b00a3d-2d3c-4e28-955f-fbc4484e8d42 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:02.072321 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b00a3d-2d3c-4e28-955f-fbc4484e8d42 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:02.073028 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b00a3d-2d3c-4e28-955f-fbc4484e8d42 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:02.073647 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b00a3d-2d3c-4e28-955f-fbc4484e8d42 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:02.074261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-94b00a3d-2d3c-4e28-955f-fbc4484e8d42 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:02.103434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-94b00a3d-2d3c-4e28-955f-fbc4484e8d42 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:53:02.127947 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-dfff0f54-1e29-457b-90c8-a56b15546ed9 req-a365bc16-ac3d-40e3-851b-8fcd8b8436b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d6381e-eeaf-4c7b-be5a-d1301c4235b0", "tag": "a8a405f4-1d04-4c4e-b6f3-f4c70efe10b4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:53:02.139876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dfff0f54-1e29-457b-90c8-a56b15546ed9 req-a365bc16-ac3d-40e3-851b-8fcd8b8436b0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:02.140579 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dfff0f54-1e29-457b-90c8-a56b15546ed9 req-a365bc16-ac3d-40e3-851b-8fcd8b8436b0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:02.141083 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-dfff0f54-1e29-457b-90c8-a56b15546ed9 req-a365bc16-ac3d-40e3-851b-8fcd8b8436b0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:02.152487 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-dfff0f54-1e29-457b-90c8-a56b15546ed9 req-a365bc16-ac3d-40e3-851b-8fcd8b8436b0 service nova] Creating event network-changed:a8a405f4-1d04-4c4e-b6f3-f4c70efe10b4 for instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 on nch1-master-1 Sep 10 21:53:02.159284 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-dfff0f54-1e29-457b-90c8-a56b15546ed9 req-a365bc16-ac3d-40e3-851b-8fcd8b8436b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097880 Sep 10 21:53:02.160166 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3490/7105] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:53:02.183844 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-94b00a3d-2d3c-4e28-955f-fbc4484e8d42 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 204 len: 0 microversion: 2.1 time: 0.124906 Sep 10 21:53:02.184391 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3616/7106] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:53:02 2022] DELETE /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:53:02.193931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c0848342-b9e9-409f-9167-75b0c8efa749 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:02.194734 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c0848342-b9e9-409f-9167-75b0c8efa749 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:02.201624 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0848342-b9e9-409f-9167-75b0c8efa749 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:02.202549 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0848342-b9e9-409f-9167-75b0c8efa749 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:02.203735 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0848342-b9e9-409f-9167-75b0c8efa749 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:02.204641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0848342-b9e9-409f-9167-75b0c8efa749 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:02.205273 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0848342-b9e9-409f-9167-75b0c8efa749 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:02.205901 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c0848342-b9e9-409f-9167-75b0c8efa749 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:02.347292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c0848342-b9e9-409f-9167-75b0c8efa749 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:02.355536 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c0848342-b9e9-409f-9167-75b0c8efa749 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1686 microversion: 2.1 time: 0.165902 Sep 10 21:53:02.356127 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3491/7107] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:02 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:03.383241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6b71b2c5-7c3f-4cf9-9a3f-11685032b2f1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:03.383994 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6b71b2c5-7c3f-4cf9-9a3f-11685032b2f1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:03.391087 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b71b2c5-7c3f-4cf9-9a3f-11685032b2f1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:03.391582 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b71b2c5-7c3f-4cf9-9a3f-11685032b2f1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:03.392032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b71b2c5-7c3f-4cf9-9a3f-11685032b2f1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:03.392735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b71b2c5-7c3f-4cf9-9a3f-11685032b2f1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:03.393199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b71b2c5-7c3f-4cf9-9a3f-11685032b2f1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:03.393636 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6b71b2c5-7c3f-4cf9-9a3f-11685032b2f1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:03.528152 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6b71b2c5-7c3f-4cf9-9a3f-11685032b2f1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:03.536166 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6b71b2c5-7c3f-4cf9-9a3f-11685032b2f1 tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1686 microversion: 2.1 time: 0.157215 Sep 10 21:53:03.536823 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3617/7108] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:03 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:04.560631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-de0d94e4-1c98-46fc-b29b-7ac94769699d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:04.561382 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de0d94e4-1c98-46fc-b29b-7ac94769699d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:04.566497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-a73e39d7-d178-4422-9e4b-a54a6b7ecaa9 req-a654f28b-3b77-4592-aa05-1112508caebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d6381e-eeaf-4c7b-be5a-d1301c4235b0", "name": "network-vif-deleted", "tag": "a8a405f4-1d04-4c4e-b6f3-f4c70efe10b4"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:53:04.569437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0d94e4-1c98-46fc-b29b-7ac94769699d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:04.570223 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0d94e4-1c98-46fc-b29b-7ac94769699d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:04.570991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0d94e4-1c98-46fc-b29b-7ac94769699d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:04.572174 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0d94e4-1c98-46fc-b29b-7ac94769699d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:04.572841 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0d94e4-1c98-46fc-b29b-7ac94769699d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:04.573477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de0d94e4-1c98-46fc-b29b-7ac94769699d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:04.576863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a73e39d7-d178-4422-9e4b-a54a6b7ecaa9 req-a654f28b-3b77-4592-aa05-1112508caebd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:04.577356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a73e39d7-d178-4422-9e4b-a54a6b7ecaa9 req-a654f28b-3b77-4592-aa05-1112508caebd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:04.578650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-a73e39d7-d178-4422-9e4b-a54a6b7ecaa9 req-a654f28b-3b77-4592-aa05-1112508caebd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:04.592290 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-a73e39d7-d178-4422-9e4b-a54a6b7ecaa9 req-a654f28b-3b77-4592-aa05-1112508caebd service nova] Creating event network-vif-deleted:a8a405f4-1d04-4c4e-b6f3-f4c70efe10b4 for instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 on nch1-master-1 Sep 10 21:53:04.597983 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-a73e39d7-d178-4422-9e4b-a54a6b7ecaa9 req-a654f28b-3b77-4592-aa05-1112508caebd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091075 Sep 10 21:53:04.599515 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3492/7109] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:53:04.643041 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-de0d94e4-1c98-46fc-b29b-7ac94769699d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db198ac8f2842638e0edd931ca8d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89de7e77cc234d14943dc99d02388c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:04.651680 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-de0d94e4-1c98-46fc-b29b-7ac94769699d tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 200 len: 1351 microversion: 2.1 time: 0.095226 Sep 10 21:53:04.652269 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3618/7110] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:04 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:53:05.677545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:05.678275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] [instance: e0d6381e-eeaf-4c7b-be5a-d1301c4235b0] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:05.684534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:05.685020 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:05.685465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:05.686193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:05.686658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:05.687150 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:05.700541 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] HTTP exception thrown: Instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 could not be found. Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Request method failure captured: Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 HTTP/1.1 Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQUOmtTgV6K-BMoGYvxDxchioERSmqpfPLuUt3LGJfKR4DSKjq6mGKscCmiof0_FepwQHW1VdfGPuuOEuA3gCoWYmo51trMKNExzTnWdvX3v_alk8XXirr1x7LoluSy5vAtxzU4HCU1achY04W8MWdDNvGA_vmwlrmERJSDYC4X8UZc Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: 89de7e77cc234d14943dc99d02388c45 Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89de7e77cc234d14943dc99d02388c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89de7e77cc234d14943dc99d02388c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89de7e77cc234d14943dc99d02388c45", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89de7e77cc234d14943dc99d02388c45"}]}] Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: 89de7e77cc234d14943dc99d02388c45 Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-253226799 Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TestNetworkAdvancedServerOps-253226799-project Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 2db198ac8f2842638e0edd931ca8d26d Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TestNetworkAdvancedServerOps-253226799-project Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 could not be found. Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': 'e0d6381e-eeaf-4c7b-be5a-d1301c4235b0'} Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 could not be found. Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 could not be found. Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:53:05.702190 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 could not be found. Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Returning 404 to user: Instance e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5b70b402-7412-4780-925f-d51335b638dd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0" status: 404 len: 111 microversion: 2.1 time: 0.032059 Sep 10 21:53:05.708472 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3493/7111] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:05 2022] GET /compute/v2.1/servers/e0d6381e-eeaf-4c7b-be5a-d1301c4235b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:53:08.951333 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d028548b-6e58-4b38-ba50-d07d1d6739cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] Calling method '.version_select at 0x7f9944aee670>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:08.982112 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d028548b-6e58-4b38-ba50-d07d1d6739cd tempest-TestNetworkAdvancedServerOps-253226799 tempest-TestNetworkAdvancedServerOps-253226799-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-558878758" status: 202 len: 0 microversion: 2.1 time: 0.034955 Sep 10 21:53:08.982912 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3619/7112] 10.222.0.33 () {58 vars in 1281 bytes} [Sat Sep 10 21:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-558878758 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:53:20.348849 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=18 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:53:20.350340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:53:20.578190 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-be28c5d2-cc20-48d4-994e-dca99c33d32d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Action: 'create', calling method: .version_select at 0x7f99494e2af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-298002039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGASo81XvpgXLWu2hWQFp3CGvC4mgAFXdHiz+oPOTH1YJYF1RVblfGSL9LwMo+6UIvxPlBh12lZ/B2TmH114u2CSB1iz+BfPawsOKJxw8k9mcQx6H/Bg3PWMfYtuzie0Ww=="}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:53:20.598157 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-be28c5d2-cc20-48d4-994e-dca99c33d32d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Getting quotas for project f6fed94219e94a079adb19e226519d93. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:53:20.604904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-be28c5d2-cc20-48d4-994e-dca99c33d32d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Getting quotas for user e8f20ab4946f4ad6ac5637b10b9b7e2a and project f6fed94219e94a079adb19e226519d93. Resources: {'key_pairs'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:53:20.634713 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-be28c5d2-cc20-48d4-994e-dca99c33d32d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.301010 Sep 10 21:53:20.635334 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3494/7113] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:53:20 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:53:21.678953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:53:21.679719 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:53:21.683971 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1331141232", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-298002039", "security_groups": [{"name": "tempest-secgroup-smoke-196752821"}], "networks": [{"uuid": "4887d8c2-7e03-4554-82f3-29bb86e76bd9"}]}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:53:21.800183 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.network.neutron [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] validate_networks() for [('4887d8c2-7e03-4554-82f3-29bb86e76bd9', None, None, None, None, None)] {{(pid=145772) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:53:22.204533 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Flavor limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:53:22.204964 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Image limits 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:53:22.205444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Flavor pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:53:22.205885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Image pref 0:0:0 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:53:22.206349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.virt.hardware [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:53:22.215387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:22.215874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:22.216311 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:22.217242 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:22.218427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:22.218859 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:22.237393 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Getting quotas for project f6fed94219e94a079adb19e226519d93. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:53:22.243535 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Getting quotas for user e8f20ab4946f4ad6ac5637b10b9b7e2a and project f6fed94219e94a079adb19e226519d93. Resources: {'instances', 'cores', 'ram'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:53:22.255888 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Going to run 1 instances... {{(pid=145772) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:53:22.258256 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:53:22.308379 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-d52249ea-690f-4aa1-bb55-cf286911a239 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.631334 Sep 10 21:53:22.315848 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3620/7114] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:53:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 21:53:22.322040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-cc8f5fe5-3b8f-4503-bd95-f64187597530 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:22.322671 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-cc8f5fe5-3b8f-4503-bd95-f64187597530 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:22.383584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-cc8f5fe5-3b8f-4503-bd95-f64187597530 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:22.392030 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-cc8f5fe5-3b8f-4503-bd95-f64187597530 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1246 microversion: 2.1 time: 0.074856 Sep 10 21:53:22.393397 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3495/7115] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:22 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:23.420145 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2e1ca8f6-9a54-44c2-8dc5-d459a05031d5 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:23.422136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2e1ca8f6-9a54-44c2-8dc5-d459a05031d5 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:23.430652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e1ca8f6-9a54-44c2-8dc5-d459a05031d5 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:23.431537 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e1ca8f6-9a54-44c2-8dc5-d459a05031d5 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:23.432202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e1ca8f6-9a54-44c2-8dc5-d459a05031d5 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:23.433285 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e1ca8f6-9a54-44c2-8dc5-d459a05031d5 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:23.434652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e1ca8f6-9a54-44c2-8dc5-d459a05031d5 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:23.435307 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2e1ca8f6-9a54-44c2-8dc5-d459a05031d5 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:23.565077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2e1ca8f6-9a54-44c2-8dc5-d459a05031d5 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:23.574051 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2e1ca8f6-9a54-44c2-8dc5-d459a05031d5 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1306 microversion: 2.1 time: 0.161955 Sep 10 21:53:23.575468 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3621/7116] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:23 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1306 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:24.602386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2ea01ab1-8c80-4f89-b919-30893e6f04a1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:24.603030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2ea01ab1-8c80-4f89-b919-30893e6f04a1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:24.611419 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ea01ab1-8c80-4f89-b919-30893e6f04a1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:24.611912 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ea01ab1-8c80-4f89-b919-30893e6f04a1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:24.612357 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ea01ab1-8c80-4f89-b919-30893e6f04a1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:24.613315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ea01ab1-8c80-4f89-b919-30893e6f04a1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:24.613773 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ea01ab1-8c80-4f89-b919-30893e6f04a1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:24.614227 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2ea01ab1-8c80-4f89-b919-30893e6f04a1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:24.754919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2ea01ab1-8c80-4f89-b919-30893e6f04a1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:24.763133 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2ea01ab1-8c80-4f89-b919-30893e6f04a1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1371 microversion: 2.1 time: 0.164665 Sep 10 21:53:24.763811 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3496/7117] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:24 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:25.094801 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-6b485bb4-d305-4307-b554-b135945d54a2 req-777f408e-0a35-4f3a-bec6-045ef079987e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c3e082-a22b-4c43-86c3-1b737d4b24cb", "tag": "8754ad0b-50c6-4c32-bb7f-1de179a10ddd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:53:25.106038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6b485bb4-d305-4307-b554-b135945d54a2 req-777f408e-0a35-4f3a-bec6-045ef079987e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:25.106531 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6b485bb4-d305-4307-b554-b135945d54a2 req-777f408e-0a35-4f3a-bec6-045ef079987e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:25.107068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-6b485bb4-d305-4307-b554-b135945d54a2 req-777f408e-0a35-4f3a-bec6-045ef079987e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:25.121382 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-6b485bb4-d305-4307-b554-b135945d54a2 req-777f408e-0a35-4f3a-bec6-045ef079987e service nova] Creating event network-changed:8754ad0b-50c6-4c32-bb7f-1de179a10ddd for instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb on nch2-master-1 Sep 10 21:53:25.128355 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-6b485bb4-d305-4307-b554-b135945d54a2 req-777f408e-0a35-4f3a-bec6-045ef079987e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037598 Sep 10 21:53:25.129309 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3622/7118] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:53:25.787338 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c9cfb06b-7745-49d4-a7e8-8b1937dfcd5e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:25.787958 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c9cfb06b-7745-49d4-a7e8-8b1937dfcd5e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:25.795119 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9cfb06b-7745-49d4-a7e8-8b1937dfcd5e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:25.796200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9cfb06b-7745-49d4-a7e8-8b1937dfcd5e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:25.796756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9cfb06b-7745-49d4-a7e8-8b1937dfcd5e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:25.797756 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9cfb06b-7745-49d4-a7e8-8b1937dfcd5e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:25.798274 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9cfb06b-7745-49d4-a7e8-8b1937dfcd5e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:25.798702 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9cfb06b-7745-49d4-a7e8-8b1937dfcd5e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:25.947472 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c9cfb06b-7745-49d4-a7e8-8b1937dfcd5e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:25.956055 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c9cfb06b-7745-49d4-a7e8-8b1937dfcd5e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1371 microversion: 2.1 time: 0.172570 Sep 10 21:53:25.956665 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3497/7119] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:25 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:26.980883 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-05a16a1e-1f04-40de-8fb7-bfb53f826c0b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:26.981590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-05a16a1e-1f04-40de-8fb7-bfb53f826c0b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:26.988885 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05a16a1e-1f04-40de-8fb7-bfb53f826c0b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:26.989372 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05a16a1e-1f04-40de-8fb7-bfb53f826c0b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:26.989813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05a16a1e-1f04-40de-8fb7-bfb53f826c0b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:26.990540 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05a16a1e-1f04-40de-8fb7-bfb53f826c0b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:26.991000 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05a16a1e-1f04-40de-8fb7-bfb53f826c0b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:26.991431 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-05a16a1e-1f04-40de-8fb7-bfb53f826c0b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:27.126814 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-05a16a1e-1f04-40de-8fb7-bfb53f826c0b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:27.134615 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-05a16a1e-1f04-40de-8fb7-bfb53f826c0b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1371 microversion: 2.1 time: 0.158891 Sep 10 21:53:27.135194 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3623/7120] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:26 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:28.158822 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c8c8e9f1-95ed-4db5-ab9e-80bf771946c4 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:28.159431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c8c8e9f1-95ed-4db5-ab9e-80bf771946c4 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:28.166431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c8e9f1-95ed-4db5-ab9e-80bf771946c4 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:28.166908 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c8e9f1-95ed-4db5-ab9e-80bf771946c4 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:28.167342 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c8e9f1-95ed-4db5-ab9e-80bf771946c4 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:28.168030 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c8e9f1-95ed-4db5-ab9e-80bf771946c4 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:28.168484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c8e9f1-95ed-4db5-ab9e-80bf771946c4 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:28.168904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c8c8e9f1-95ed-4db5-ab9e-80bf771946c4 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:28.300499 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c8c8e9f1-95ed-4db5-ab9e-80bf771946c4 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:28.308378 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c8c8e9f1-95ed-4db5-ab9e-80bf771946c4 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1371 microversion: 2.1 time: 0.154271 Sep 10 21:53:28.308965 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3498/7121] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:28 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:29.332882 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c46f2035-7eb0-4d5d-a987-5ef249b52717 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:29.333497 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c46f2035-7eb0-4d5d-a987-5ef249b52717 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:29.340366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c46f2035-7eb0-4d5d-a987-5ef249b52717 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:29.340847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c46f2035-7eb0-4d5d-a987-5ef249b52717 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:29.341284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c46f2035-7eb0-4d5d-a987-5ef249b52717 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:29.342011 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c46f2035-7eb0-4d5d-a987-5ef249b52717 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:29.342554 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c46f2035-7eb0-4d5d-a987-5ef249b52717 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:29.343038 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c46f2035-7eb0-4d5d-a987-5ef249b52717 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:29.480477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c46f2035-7eb0-4d5d-a987-5ef249b52717 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:29.489573 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c46f2035-7eb0-4d5d-a987-5ef249b52717 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1371 microversion: 2.1 time: 0.160657 Sep 10 21:53:29.490187 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3624/7122] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:29 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:53:30.513037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-31d79909-bf08-4c78-9000-c25978880e56 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:30.513564 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-31d79909-bf08-4c78-9000-c25978880e56 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:30.521149 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31d79909-bf08-4c78-9000-c25978880e56 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:30.521643 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31d79909-bf08-4c78-9000-c25978880e56 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:30.522123 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31d79909-bf08-4c78-9000-c25978880e56 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:30.522828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31d79909-bf08-4c78-9000-c25978880e56 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:30.523290 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31d79909-bf08-4c78-9000-c25978880e56 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:30.523723 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-31d79909-bf08-4c78-9000-c25978880e56 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:30.661541 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-31d79909-bf08-4c78-9000-c25978880e56 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:30.669339 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-31d79909-bf08-4c78-9000-c25978880e56 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1371 microversion: 2.1 time: 0.160372 Sep 10 21:53:30.669935 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3499/7123] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:30 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:31.693884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2b7424d9-e81d-4903-b366-37be01e0ac02 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:31.694505 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2b7424d9-e81d-4903-b366-37be01e0ac02 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:31.701368 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7424d9-e81d-4903-b366-37be01e0ac02 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:31.702552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7424d9-e81d-4903-b366-37be01e0ac02 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:31.703080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7424d9-e81d-4903-b366-37be01e0ac02 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:31.703800 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7424d9-e81d-4903-b366-37be01e0ac02 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:31.704264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7424d9-e81d-4903-b366-37be01e0ac02 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:31.704698 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2b7424d9-e81d-4903-b366-37be01e0ac02 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:31.848386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2b7424d9-e81d-4903-b366-37be01e0ac02 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:31.849375 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d9c14b17-9f03-42af-8591-43cca98f3186 req-b1b8286b-d03b-4086-9d0f-2e70c15e19fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c3e082-a22b-4c43-86c3-1b737d4b24cb", "name": "network-vif-plugged", "status": "completed", "tag": "8754ad0b-50c6-4c32-bb7f-1de179a10ddd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:53:31.856252 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2b7424d9-e81d-4903-b366-37be01e0ac02 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1371 microversion: 2.1 time: 0.166586 Sep 10 21:53:31.856835 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3625/7124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:31 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:31.860011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d9c14b17-9f03-42af-8591-43cca98f3186 req-b1b8286b-d03b-4086-9d0f-2e70c15e19fd service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:31.860492 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d9c14b17-9f03-42af-8591-43cca98f3186 req-b1b8286b-d03b-4086-9d0f-2e70c15e19fd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:31.860927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d9c14b17-9f03-42af-8591-43cca98f3186 req-b1b8286b-d03b-4086-9d0f-2e70c15e19fd service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:31.872532 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d9c14b17-9f03-42af-8591-43cca98f3186 req-b1b8286b-d03b-4086-9d0f-2e70c15e19fd service nova] Creating event network-vif-plugged:8754ad0b-50c6-4c32-bb7f-1de179a10ddd for instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb on nch2-master-1 Sep 10 21:53:31.877948 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d9c14b17-9f03-42af-8591-43cca98f3186 req-b1b8286b-d03b-4086-9d0f-2e70c15e19fd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156603 Sep 10 21:53:31.878541 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3500/7125] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:53:32.880627 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-33f0ec1d-bb86-4ea2-9b0a-62b6cb4330cd tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:32.881265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-33f0ec1d-bb86-4ea2-9b0a-62b6cb4330cd tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:32.883266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:53:32.883925 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:53:32.891279 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33f0ec1d-bb86-4ea2-9b0a-62b6cb4330cd tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:32.891763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33f0ec1d-bb86-4ea2-9b0a-62b6cb4330cd tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:32.892198 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33f0ec1d-bb86-4ea2-9b0a-62b6cb4330cd tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:32.892889 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33f0ec1d-bb86-4ea2-9b0a-62b6cb4330cd tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:32.893342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33f0ec1d-bb86-4ea2-9b0a-62b6cb4330cd tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:32.893767 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-33f0ec1d-bb86-4ea2-9b0a-62b6cb4330cd tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:33.031157 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-33f0ec1d-bb86-4ea2-9b0a-62b6cb4330cd tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:33.038992 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-33f0ec1d-bb86-4ea2-9b0a-62b6cb4330cd tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1371 microversion: 2.1 time: 0.162360 Sep 10 21:53:33.039572 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3626/7126] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:32 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:34.059674 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:53:34.065002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-599c10e5-a689-49dc-9ccb-c5942237d262 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:34.065699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-599c10e5-a689-49dc-9ccb-c5942237d262 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:34.072133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-599c10e5-a689-49dc-9ccb-c5942237d262 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:34.072615 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-599c10e5-a689-49dc-9ccb-c5942237d262 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:34.073052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-599c10e5-a689-49dc-9ccb-c5942237d262 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:34.073741 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-599c10e5-a689-49dc-9ccb-c5942237d262 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:34.074220 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-599c10e5-a689-49dc-9ccb-c5942237d262 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:34.074649 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-599c10e5-a689-49dc-9ccb-c5942237d262 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:34.209899 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-599c10e5-a689-49dc-9ccb-c5942237d262 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:34.218444 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-599c10e5-a689-49dc-9ccb-c5942237d262 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1556 microversion: 2.1 time: 0.159715 Sep 10 21:53:34.219025 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3501/7127] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:34 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:34.242275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1f494781-990e-4d47-bbd1-b71a7a5e5ff2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:53:34.242853 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1f494781-990e-4d47-bbd1-b71a7a5e5ff2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:53:34.250221 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f494781-990e-4d47-bbd1-b71a7a5e5ff2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:34.250815 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f494781-990e-4d47-bbd1-b71a7a5e5ff2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:34.251384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f494781-990e-4d47-bbd1-b71a7a5e5ff2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:34.252162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f494781-990e-4d47-bbd1-b71a7a5e5ff2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:34.252723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f494781-990e-4d47-bbd1-b71a7a5e5ff2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:34.253208 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f494781-990e-4d47-bbd1-b71a7a5e5ff2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:34.385282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1f494781-990e-4d47-bbd1-b71a7a5e5ff2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:53:34.393680 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1f494781-990e-4d47-bbd1-b71a7a5e5ff2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1556 microversion: 2.1 time: 0.156649 Sep 10 21:53:34.394292 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3627/7128] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:53:34 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:53:36.331630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-47635d4e-b022-4cb1-8b02-4cf34186b401 req-9ef02e78-a3ae-475d-ac60-68731cc14bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c3e082-a22b-4c43-86c3-1b737d4b24cb", "tag": "8754ad0b-50c6-4c32-bb7f-1de179a10ddd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:53:36.342987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-47635d4e-b022-4cb1-8b02-4cf34186b401 req-9ef02e78-a3ae-475d-ac60-68731cc14bf7 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:53:36.343489 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-47635d4e-b022-4cb1-8b02-4cf34186b401 req-9ef02e78-a3ae-475d-ac60-68731cc14bf7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:53:36.343929 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-47635d4e-b022-4cb1-8b02-4cf34186b401 req-9ef02e78-a3ae-475d-ac60-68731cc14bf7 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:53:36.355330 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-47635d4e-b022-4cb1-8b02-4cf34186b401 req-9ef02e78-a3ae-475d-ac60-68731cc14bf7 service nova] Creating event network-changed:8754ad0b-50c6-4c32-bb7f-1de179a10ddd for instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb on nch2-master-1 Sep 10 21:53:36.360659 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-47635d4e-b022-4cb1-8b02-4cf34186b401 req-9ef02e78-a3ae-475d-ac60-68731cc14bf7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033705 Sep 10 21:53:36.361333 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3502/7129] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:55:33.829037 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b1f4ed7-24bd-4569-af9f-d6241352bd2e] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 21:55:33.829999 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c8ac8451-8bb7-4c61-8ae1-41d1ffcbab32] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 21:55:33.831019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:55:33.831775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=40 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:55:33.833066 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 21:55:33.833216 ncdv-master-1 devstack@n-api.service[145772]: Sat Sep 10 21:55:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb/action (ip 10.222.0.33) !!! Sep 10 21:55:33.839048 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6819f1dc-fc09-4bf6-9af9-7180c793d6df tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:55:33.839584 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6819f1dc-fc09-4bf6-9af9-7180c793d6df tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:33.850341 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6819f1dc-fc09-4bf6-9af9-7180c793d6df tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:33.850831 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6819f1dc-fc09-4bf6-9af9-7180c793d6df tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:33.851268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6819f1dc-fc09-4bf6-9af9-7180c793d6df tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:33.851961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6819f1dc-fc09-4bf6-9af9-7180c793d6df tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:33.852412 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6819f1dc-fc09-4bf6-9af9-7180c793d6df tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:33.852835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6819f1dc-fc09-4bf6-9af9-7180c793d6df tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:33.877585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.objects.instance [None req-6819f1dc-fc09-4bf6-9af9-7180c793d6df tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lazy-loading 'flavor' on Instance uuid c6c3e082-a22b-4c43-86c3-1b737d4b24cb {{(pid=145772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:55:34.071599 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6819f1dc-fc09-4bf6-9af9-7180c793d6df tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "POST /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb/action" status: 202 len: 0 microversion: 2.1 time: 0.244090 Sep 10 21:55:34.072284 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3628/7130] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:55:33 2022] POST /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 21:55:34.079292 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9be06a9-4f21-4508-84c9-22f4b31441dc] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:55:34.080064 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d92fd74e-3a75-4708-a33b-c44a50e0eba4] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:55:34.080677 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:55:34.081431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=34 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:55:34.082689 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 21:55:34.082840 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 21:55:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb (ip 10.222.0.33) !!! Sep 10 21:55:34.089979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e9cbf492-97fb-42f1-b9cd-39129655a52f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:34.090750 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e9cbf492-97fb-42f1-b9cd-39129655a52f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:34.100435 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9cbf492-97fb-42f1-b9cd-39129655a52f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:34.100927 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9cbf492-97fb-42f1-b9cd-39129655a52f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:34.101368 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9cbf492-97fb-42f1-b9cd-39129655a52f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:34.102100 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9cbf492-97fb-42f1-b9cd-39129655a52f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:34.102560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9cbf492-97fb-42f1-b9cd-39129655a52f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:34.102990 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e9cbf492-97fb-42f1-b9cd-39129655a52f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:34.242457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e9cbf492-97fb-42f1-b9cd-39129655a52f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:34.251232 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e9cbf492-97fb-42f1-b9cd-39129655a52f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.173935 Sep 10 21:55:34.251842 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3503/7131] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:34 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:35.278938 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4232decc-c64a-45cb-8484-19a67aabfaba tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:35.279635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4232decc-c64a-45cb-8484-19a67aabfaba tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:35.293068 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b1f4ed7-24bd-4569-af9f-d6241352bd2e] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 41640. Sep 10 21:55:35.295263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4232decc-c64a-45cb-8484-19a67aabfaba tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:35.295750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4232decc-c64a-45cb-8484-19a67aabfaba tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:35.296194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4232decc-c64a-45cb-8484-19a67aabfaba tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:35.296886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4232decc-c64a-45cb-8484-19a67aabfaba tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:35.297338 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4232decc-c64a-45cb-8484-19a67aabfaba tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:35.297762 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4232decc-c64a-45cb-8484-19a67aabfaba tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:35.303854 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] [c8ac8451-8bb7-4c61-8ae1-41d1ffcbab32] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 41642. Sep 10 21:55:35.437132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4232decc-c64a-45cb-8484-19a67aabfaba tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:35.444924 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4232decc-c64a-45cb-8484-19a67aabfaba tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.173833 Sep 10 21:55:35.445500 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3629/7132] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:35 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:36.469710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0b14b367-70ef-40b6-b4b2-43157b018713 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:36.470331 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0b14b367-70ef-40b6-b4b2-43157b018713 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:36.479103 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b14b367-70ef-40b6-b4b2-43157b018713 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:36.480280 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b14b367-70ef-40b6-b4b2-43157b018713 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:36.481062 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b14b367-70ef-40b6-b4b2-43157b018713 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:36.481791 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b14b367-70ef-40b6-b4b2-43157b018713 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:36.482271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b14b367-70ef-40b6-b4b2-43157b018713 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:36.482698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0b14b367-70ef-40b6-b4b2-43157b018713 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:36.488937 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9be06a9-4f21-4508-84c9-22f4b31441dc] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 41646. Sep 10 21:55:36.504312 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] [d92fd74e-3a75-4708-a33b-c44a50e0eba4] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 41648. Sep 10 21:55:36.625059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0b14b367-70ef-40b6-b4b2-43157b018713 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:36.632868 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0b14b367-70ef-40b6-b4b2-43157b018713 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.167139 Sep 10 21:55:36.633468 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3504/7133] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:36 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:37.657414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-84e1ff75-281a-44da-a929-3424790c5c7a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:37.658023 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-84e1ff75-281a-44da-a929-3424790c5c7a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:37.664861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84e1ff75-281a-44da-a929-3424790c5c7a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:37.665349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84e1ff75-281a-44da-a929-3424790c5c7a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:37.665791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84e1ff75-281a-44da-a929-3424790c5c7a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:37.666517 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84e1ff75-281a-44da-a929-3424790c5c7a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:37.667027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84e1ff75-281a-44da-a929-3424790c5c7a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:37.667437 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-84e1ff75-281a-44da-a929-3424790c5c7a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:37.801436 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-84e1ff75-281a-44da-a929-3424790c5c7a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:37.810806 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-84e1ff75-281a-44da-a929-3424790c5c7a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.157394 Sep 10 21:55:37.811389 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3630/7134] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:37 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:38.835137 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ba796e6c-72f2-4d8f-bed9-240e5e415a13 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:38.835758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ba796e6c-72f2-4d8f-bed9-240e5e415a13 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:38.843356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba796e6c-72f2-4d8f-bed9-240e5e415a13 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:38.843846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba796e6c-72f2-4d8f-bed9-240e5e415a13 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:38.844293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba796e6c-72f2-4d8f-bed9-240e5e415a13 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:38.844992 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba796e6c-72f2-4d8f-bed9-240e5e415a13 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:38.845457 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba796e6c-72f2-4d8f-bed9-240e5e415a13 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:38.845916 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ba796e6c-72f2-4d8f-bed9-240e5e415a13 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:38.979867 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ba796e6c-72f2-4d8f-bed9-240e5e415a13 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:38.987841 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ba796e6c-72f2-4d8f-bed9-240e5e415a13 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.156693 Sep 10 21:55:38.988426 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3505/7135] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:38 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:40.012945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-df3d9f3d-5914-49a1-b3b2-c66674d86e4b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:40.013581 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-df3d9f3d-5914-49a1-b3b2-c66674d86e4b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:40.020434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d9f3d-5914-49a1-b3b2-c66674d86e4b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:40.020917 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d9f3d-5914-49a1-b3b2-c66674d86e4b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:40.021353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d9f3d-5914-49a1-b3b2-c66674d86e4b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:40.022077 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d9f3d-5914-49a1-b3b2-c66674d86e4b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:40.022532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d9f3d-5914-49a1-b3b2-c66674d86e4b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:40.022958 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-df3d9f3d-5914-49a1-b3b2-c66674d86e4b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:40.159575 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-df3d9f3d-5914-49a1-b3b2-c66674d86e4b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:40.167399 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-df3d9f3d-5914-49a1-b3b2-c66674d86e4b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.159301 Sep 10 21:55:40.167971 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3631/7136] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:40 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:41.190950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-957218b0-3286-42d9-928d-4eca74936659 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:41.191546 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-957218b0-3286-42d9-928d-4eca74936659 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:41.198582 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-957218b0-3286-42d9-928d-4eca74936659 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:41.199073 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-957218b0-3286-42d9-928d-4eca74936659 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:41.199506 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-957218b0-3286-42d9-928d-4eca74936659 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:41.200197 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-957218b0-3286-42d9-928d-4eca74936659 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:41.200652 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-957218b0-3286-42d9-928d-4eca74936659 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:41.201077 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-957218b0-3286-42d9-928d-4eca74936659 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:41.337559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-957218b0-3286-42d9-928d-4eca74936659 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:41.345381 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-957218b0-3286-42d9-928d-4eca74936659 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.158368 Sep 10 21:55:41.345990 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3506/7137] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:41 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:55:42.371297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c783a6d2-fc98-49a6-a550-d514c3554d40 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:42.371912 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c783a6d2-fc98-49a6-a550-d514c3554d40 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:42.378918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c783a6d2-fc98-49a6-a550-d514c3554d40 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:42.379402 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c783a6d2-fc98-49a6-a550-d514c3554d40 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:42.379842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c783a6d2-fc98-49a6-a550-d514c3554d40 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:42.380541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c783a6d2-fc98-49a6-a550-d514c3554d40 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:42.381009 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c783a6d2-fc98-49a6-a550-d514c3554d40 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:42.381439 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c783a6d2-fc98-49a6-a550-d514c3554d40 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:42.513503 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c783a6d2-fc98-49a6-a550-d514c3554d40 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:42.521310 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c783a6d2-fc98-49a6-a550-d514c3554d40 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.154602 Sep 10 21:55:42.521907 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3632/7138] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:42 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:43.544917 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0ba67251-e624-4f7b-a447-db5a41363c1d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:43.545712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0ba67251-e624-4f7b-a447-db5a41363c1d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:43.552774 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ba67251-e624-4f7b-a447-db5a41363c1d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:43.553260 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ba67251-e624-4f7b-a447-db5a41363c1d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:43.553710 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ba67251-e624-4f7b-a447-db5a41363c1d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:43.554433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ba67251-e624-4f7b-a447-db5a41363c1d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:43.554888 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ba67251-e624-4f7b-a447-db5a41363c1d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:43.555316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0ba67251-e624-4f7b-a447-db5a41363c1d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:43.686678 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0ba67251-e624-4f7b-a447-db5a41363c1d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:43.694492 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0ba67251-e624-4f7b-a447-db5a41363c1d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.154077 Sep 10 21:55:43.695071 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3507/7139] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:43 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:44.718583 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-993eaec0-f616-41b2-9b3b-97ca878cbba1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:44.719200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-993eaec0-f616-41b2-9b3b-97ca878cbba1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:44.726206 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993eaec0-f616-41b2-9b3b-97ca878cbba1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:44.726694 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993eaec0-f616-41b2-9b3b-97ca878cbba1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:44.727136 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993eaec0-f616-41b2-9b3b-97ca878cbba1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:44.727832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993eaec0-f616-41b2-9b3b-97ca878cbba1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:44.728290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993eaec0-f616-41b2-9b3b-97ca878cbba1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:44.728726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-993eaec0-f616-41b2-9b3b-97ca878cbba1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:44.867630 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-993eaec0-f616-41b2-9b3b-97ca878cbba1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:44.876192 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-993eaec0-f616-41b2-9b3b-97ca878cbba1 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1702 microversion: 2.1 time: 0.161585 Sep 10 21:55:44.876773 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3633/7140] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:44 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1702 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:45.900244 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4f1eaede-701b-4ca2-9877-61bb47f45a49 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:45.900943 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4f1eaede-701b-4ca2-9877-61bb47f45a49 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:45.908758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f1eaede-701b-4ca2-9877-61bb47f45a49 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:45.909236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f1eaede-701b-4ca2-9877-61bb47f45a49 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:45.909668 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f1eaede-701b-4ca2-9877-61bb47f45a49 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:45.910387 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f1eaede-701b-4ca2-9877-61bb47f45a49 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:45.910851 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f1eaede-701b-4ca2-9877-61bb47f45a49 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:45.911278 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4f1eaede-701b-4ca2-9877-61bb47f45a49 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:46.046326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-4f1eaede-701b-4ca2-9877-61bb47f45a49 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:46.054102 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4f1eaede-701b-4ca2-9877-61bb47f45a49 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1702 microversion: 2.1 time: 0.157871 Sep 10 21:55:46.054688 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3508/7141] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:45 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1702 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:47.078169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-10b9f2e9-b703-469d-8b9e-034b8c8c99da tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:47.078773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-10b9f2e9-b703-469d-8b9e-034b8c8c99da tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:47.085881 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10b9f2e9-b703-469d-8b9e-034b8c8c99da tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:47.086377 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10b9f2e9-b703-469d-8b9e-034b8c8c99da tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:47.086820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10b9f2e9-b703-469d-8b9e-034b8c8c99da tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:47.087528 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10b9f2e9-b703-469d-8b9e-034b8c8c99da tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:47.087987 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10b9f2e9-b703-469d-8b9e-034b8c8c99da tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:47.088418 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-10b9f2e9-b703-469d-8b9e-034b8c8c99da tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:47.226548 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-10b9f2e9-b703-469d-8b9e-034b8c8c99da tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:47.235819 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-10b9f2e9-b703-469d-8b9e-034b8c8c99da tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1697 microversion: 2.1 time: 0.161707 Sep 10 21:55:47.236396 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3634/7142] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:47 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:48.262042 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a665a408-5e12-4b60-982a-43c934fe8145 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:48.263698 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a665a408-5e12-4b60-982a-43c934fe8145 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:48.271295 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a665a408-5e12-4b60-982a-43c934fe8145 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:48.272054 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a665a408-5e12-4b60-982a-43c934fe8145 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:48.272696 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a665a408-5e12-4b60-982a-43c934fe8145 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:48.273714 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a665a408-5e12-4b60-982a-43c934fe8145 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:48.274172 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a665a408-5e12-4b60-982a-43c934fe8145 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:48.274794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a665a408-5e12-4b60-982a-43c934fe8145 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:48.462241 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a665a408-5e12-4b60-982a-43c934fe8145 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:48.472003 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a665a408-5e12-4b60-982a-43c934fe8145 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1697 microversion: 2.1 time: 0.214149 Sep 10 21:55:48.472598 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3509/7143] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:48 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1697 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:48.595599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-25ae77d6-c522-4b0d-ab4f-73c7d94039cb req-85d04c02-497a-483d-9fff-b666bed9014a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c3e082-a22b-4c43-86c3-1b737d4b24cb", "name": "network-vif-plugged", "status": "completed", "tag": "8754ad0b-50c6-4c32-bb7f-1de179a10ddd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:55:48.613071 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-25ae77d6-c522-4b0d-ab4f-73c7d94039cb req-85d04c02-497a-483d-9fff-b666bed9014a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:48.613559 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-25ae77d6-c522-4b0d-ab4f-73c7d94039cb req-85d04c02-497a-483d-9fff-b666bed9014a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:48.614410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-25ae77d6-c522-4b0d-ab4f-73c7d94039cb req-85d04c02-497a-483d-9fff-b666bed9014a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:48.627953 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-25ae77d6-c522-4b0d-ab4f-73c7d94039cb req-85d04c02-497a-483d-9fff-b666bed9014a service nova] Creating event network-vif-plugged:8754ad0b-50c6-4c32-bb7f-1de179a10ddd for instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb on nch2-master-1 Sep 10 21:55:48.633863 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-25ae77d6-c522-4b0d-ab4f-73c7d94039cb req-85d04c02-497a-483d-9fff-b666bed9014a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044625 Sep 10 21:55:48.635366 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3635/7144] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:55:49.496191 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a32bc310-a9a4-4818-87b3-f3d8e7c30b2d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:49.496870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a32bc310-a9a4-4818-87b3-f3d8e7c30b2d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:49.504055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32bc310-a9a4-4818-87b3-f3d8e7c30b2d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:49.504563 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32bc310-a9a4-4818-87b3-f3d8e7c30b2d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:49.505031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32bc310-a9a4-4818-87b3-f3d8e7c30b2d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:49.505772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32bc310-a9a4-4818-87b3-f3d8e7c30b2d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:49.506386 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32bc310-a9a4-4818-87b3-f3d8e7c30b2d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:49.506706 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a32bc310-a9a4-4818-87b3-f3d8e7c30b2d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:49.667156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a32bc310-a9a4-4818-87b3-f3d8e7c30b2d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:49.677115 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a32bc310-a9a4-4818-87b3-f3d8e7c30b2d tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1697 microversion: 2.1 time: 0.184804 Sep 10 21:55:49.678047 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3510/7145] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:49 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:50.707290 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-14c19c79-f691-4373-a06a-0da1620c3886 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:50.707904 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-14c19c79-f691-4373-a06a-0da1620c3886 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:50.720518 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14c19c79-f691-4373-a06a-0da1620c3886 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:50.721449 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14c19c79-f691-4373-a06a-0da1620c3886 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:50.722105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14c19c79-f691-4373-a06a-0da1620c3886 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:50.723018 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14c19c79-f691-4373-a06a-0da1620c3886 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:50.723657 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14c19c79-f691-4373-a06a-0da1620c3886 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:50.724255 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-14c19c79-f691-4373-a06a-0da1620c3886 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:50.884103 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-14c19c79-f691-4373-a06a-0da1620c3886 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:50.894219 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-14c19c79-f691-4373-a06a-0da1620c3886 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1697 microversion: 2.1 time: 0.191238 Sep 10 21:55:50.895692 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3636/7146] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:50 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:51.924091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-acce0af6-2d4b-4f1e-bf8c-b2b08edfc324 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:51.925498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-acce0af6-2d4b-4f1e-bf8c-b2b08edfc324 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:51.933138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acce0af6-2d4b-4f1e-bf8c-b2b08edfc324 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:51.933641 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acce0af6-2d4b-4f1e-bf8c-b2b08edfc324 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:51.935132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acce0af6-2d4b-4f1e-bf8c-b2b08edfc324 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:51.938222 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acce0af6-2d4b-4f1e-bf8c-b2b08edfc324 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:51.938759 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acce0af6-2d4b-4f1e-bf8c-b2b08edfc324 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:51.939214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-acce0af6-2d4b-4f1e-bf8c-b2b08edfc324 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:52.093303 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-acce0af6-2d4b-4f1e-bf8c-b2b08edfc324 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:52.104744 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-acce0af6-2d4b-4f1e-bf8c-b2b08edfc324 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1697 microversion: 2.1 time: 0.185286 Sep 10 21:55:52.105343 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3511/7147] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:51 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:53.132414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-085b337b-06ec-40d6-a109-1b20180c4b7f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:53.134701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-085b337b-06ec-40d6-a109-1b20180c4b7f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:53.142653 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-085b337b-06ec-40d6-a109-1b20180c4b7f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:53.143147 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-085b337b-06ec-40d6-a109-1b20180c4b7f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:53.143601 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-085b337b-06ec-40d6-a109-1b20180c4b7f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:53.144374 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-085b337b-06ec-40d6-a109-1b20180c4b7f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:53.144867 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-085b337b-06ec-40d6-a109-1b20180c4b7f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:53.145301 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-085b337b-06ec-40d6-a109-1b20180c4b7f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:53.294224 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-085b337b-06ec-40d6-a109-1b20180c4b7f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:53.304897 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-085b337b-06ec-40d6-a109-1b20180c4b7f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1697 microversion: 2.1 time: 0.177543 Sep 10 21:55:53.305812 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3637/7148] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:53 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:54.329340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-96293059-4d87-4037-8cbb-7eca84c22746 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:54.330922 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-96293059-4d87-4037-8cbb-7eca84c22746 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:54.338052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96293059-4d87-4037-8cbb-7eca84c22746 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:54.338553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96293059-4d87-4037-8cbb-7eca84c22746 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:54.339163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96293059-4d87-4037-8cbb-7eca84c22746 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:54.342963 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96293059-4d87-4037-8cbb-7eca84c22746 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:54.343484 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96293059-4d87-4037-8cbb-7eca84c22746 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:54.343937 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-96293059-4d87-4037-8cbb-7eca84c22746 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:54.499568 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-96293059-4d87-4037-8cbb-7eca84c22746 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:54.508889 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-96293059-4d87-4037-8cbb-7eca84c22746 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1697 microversion: 2.1 time: 0.183579 Sep 10 21:55:54.509663 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3512/7149] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:54 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:55.537164 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a375dcaa-2e3c-4820-b29a-c28038cef753 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:55.538438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a375dcaa-2e3c-4820-b29a-c28038cef753 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:55.545695 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a375dcaa-2e3c-4820-b29a-c28038cef753 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:55.546212 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a375dcaa-2e3c-4820-b29a-c28038cef753 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:55.546650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a375dcaa-2e3c-4820-b29a-c28038cef753 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:55.547357 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a375dcaa-2e3c-4820-b29a-c28038cef753 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:55.547812 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a375dcaa-2e3c-4820-b29a-c28038cef753 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:55.548241 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a375dcaa-2e3c-4820-b29a-c28038cef753 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:55.704914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a375dcaa-2e3c-4820-b29a-c28038cef753 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:55.719105 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a375dcaa-2e3c-4820-b29a-c28038cef753 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1697 microversion: 2.1 time: 0.185849 Sep 10 21:55:55.720162 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3638/7150] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:55 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:56.743680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-dbc8dec7-ab8b-4803-8227-40237a74006f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:56.744298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-dbc8dec7-ab8b-4803-8227-40237a74006f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:56.751326 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc8dec7-ab8b-4803-8227-40237a74006f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:56.751815 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc8dec7-ab8b-4803-8227-40237a74006f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:56.752283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc8dec7-ab8b-4803-8227-40237a74006f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:56.752981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc8dec7-ab8b-4803-8227-40237a74006f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:56.753443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc8dec7-ab8b-4803-8227-40237a74006f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:56.753902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-dbc8dec7-ab8b-4803-8227-40237a74006f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:56.894576 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-dbc8dec7-ab8b-4803-8227-40237a74006f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:56.903826 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-dbc8dec7-ab8b-4803-8227-40237a74006f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1697 microversion: 2.1 time: 0.163893 Sep 10 21:55:56.904413 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3513/7151] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:56 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:57.927704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-99950dfe-97f5-4c73-bf82-aab7babbfaaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:57.928355 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-99950dfe-97f5-4c73-bf82-aab7babbfaaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:57.935880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99950dfe-97f5-4c73-bf82-aab7babbfaaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:57.936387 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99950dfe-97f5-4c73-bf82-aab7babbfaaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:57.937060 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99950dfe-97f5-4c73-bf82-aab7babbfaaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:57.937773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99950dfe-97f5-4c73-bf82-aab7babbfaaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:57.938268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99950dfe-97f5-4c73-bf82-aab7babbfaaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:57.938716 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-99950dfe-97f5-4c73-bf82-aab7babbfaaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:58.074398 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-99950dfe-97f5-4c73-bf82-aab7babbfaaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:58.082225 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-99950dfe-97f5-4c73-bf82-aab7babbfaaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1679 microversion: 2.1 time: 0.158480 Sep 10 21:55:58.082807 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3639/7152] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:57 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:55:59.105463 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-9cee54be-51f5-417e-a811-300adc9e3e31 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:55:59.106286 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-9cee54be-51f5-417e-a811-300adc9e3e31 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:55:59.113193 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9cee54be-51f5-417e-a811-300adc9e3e31 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:59.113679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9cee54be-51f5-417e-a811-300adc9e3e31 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:59.114412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9cee54be-51f5-417e-a811-300adc9e3e31 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:59.115106 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9cee54be-51f5-417e-a811-300adc9e3e31 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:55:59.115560 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9cee54be-51f5-417e-a811-300adc9e3e31 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:55:59.115987 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-9cee54be-51f5-417e-a811-300adc9e3e31 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:55:59.248876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-9cee54be-51f5-417e-a811-300adc9e3e31 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:55:59.256710 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-9cee54be-51f5-417e-a811-300adc9e3e31 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1679 microversion: 2.1 time: 0.155163 Sep 10 21:55:59.257287 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3514/7153] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:55:59 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:00.281300 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f99f7916-97c0-4063-bf33-65250fad2d44 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:00.281861 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f99f7916-97c0-4063-bf33-65250fad2d44 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:00.288604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f7916-97c0-4063-bf33-65250fad2d44 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:00.289082 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f7916-97c0-4063-bf33-65250fad2d44 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:00.289514 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f7916-97c0-4063-bf33-65250fad2d44 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:00.290235 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f7916-97c0-4063-bf33-65250fad2d44 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:00.290690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f7916-97c0-4063-bf33-65250fad2d44 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:00.291116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-f99f7916-97c0-4063-bf33-65250fad2d44 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:00.434052 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f99f7916-97c0-4063-bf33-65250fad2d44 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:00.442082 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f99f7916-97c0-4063-bf33-65250fad2d44 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1622 microversion: 2.1 time: 0.165534 Sep 10 21:56:00.442750 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3640/7154] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:00 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1622 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:00.465863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:56:00.466667 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:00.473594 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:00.474132 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:00.474586 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:00.475298 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:00.475764 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:00.476200 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:00.566116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c5abcdb4-a354-448d-8d59-30479617fce0 req-5ebc3c81-9c34-4797-8628-fdc15e8bf3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c3e082-a22b-4c43-86c3-1b737d4b24cb", "name": "network-vif-unplugged", "status": "completed", "tag": "8754ad0b-50c6-4c32-bb7f-1de179a10ddd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:56:00.578229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c5abcdb4-a354-448d-8d59-30479617fce0 req-5ebc3c81-9c34-4797-8628-fdc15e8bf3c0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:00.578950 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c5abcdb4-a354-448d-8d59-30479617fce0 req-5ebc3c81-9c34-4797-8628-fdc15e8bf3c0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:00.579414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c5abcdb4-a354-448d-8d59-30479617fce0 req-5ebc3c81-9c34-4797-8628-fdc15e8bf3c0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:00.596011 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=145771) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 21:56:00.597424 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.compute.server_external_events [req-c5abcdb4-a354-448d-8d59-30479617fce0 req-5ebc3c81-9c34-4797-8628-fdc15e8bf3c0 service nova] Unable to find a host for instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb. Dropping event network-vif-unplugged {{(pid=145772) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 21:56:00.598524 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c5abcdb4-a354-448d-8d59-30479617fce0 req-5ebc3c81-9c34-4797-8628-fdc15e8bf3c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036292 Sep 10 21:56:00.599293 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3641/7155] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 10 21:56:00.664623 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [c2425482-0410-4dae-a4e4-53f889d5d91e] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 21:56:01.671183 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [c2425482-0410-4dae-a4e4-53f889d5d91e] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 41752. Sep 10 21:56:01.674376 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-4ff4eb79-b9b2-4497-bc39-7dcc49590714 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "POST /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb/action" status: 202 len: 0 microversion: 2.1 time: 1.213170 Sep 10 21:56:01.675040 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3515/7156] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 21:56:00 2022] POST /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb/action => generated 0 bytes in 1214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:56:01.683342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-a0dfb800-942c-4916-b00c-5e2ca27047d2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:01.684824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-a0dfb800-942c-4916-b00c-5e2ca27047d2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:01.692162 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb800-942c-4916-b00c-5e2ca27047d2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:01.692654 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb800-942c-4916-b00c-5e2ca27047d2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:01.693102 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb800-942c-4916-b00c-5e2ca27047d2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:01.693813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb800-942c-4916-b00c-5e2ca27047d2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:01.694303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb800-942c-4916-b00c-5e2ca27047d2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:01.694802 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-a0dfb800-942c-4916-b00c-5e2ca27047d2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:01.829314 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-a0dfb800-942c-4916-b00c-5e2ca27047d2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:01.837110 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-a0dfb800-942c-4916-b00c-5e2ca27047d2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1630 microversion: 2.1 time: 0.157820 Sep 10 21:56:01.837697 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3642/7157] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:01 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1630 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:02.862125 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-55548ffe-c33b-4b4a-b168-6c6e0a58df39 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:02.862747 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-55548ffe-c33b-4b4a-b168-6c6e0a58df39 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:02.874059 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55548ffe-c33b-4b4a-b168-6c6e0a58df39 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:02.874547 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55548ffe-c33b-4b4a-b168-6c6e0a58df39 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:02.874991 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55548ffe-c33b-4b4a-b168-6c6e0a58df39 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:02.875693 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55548ffe-c33b-4b4a-b168-6c6e0a58df39 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:02.876154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55548ffe-c33b-4b4a-b168-6c6e0a58df39 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:02.876588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-55548ffe-c33b-4b4a-b168-6c6e0a58df39 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:03.009275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-55548ffe-c33b-4b4a-b168-6c6e0a58df39 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:03.017470 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-55548ffe-c33b-4b4a-b168-6c6e0a58df39 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.160199 Sep 10 21:56:03.018112 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3516/7158] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:02 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 21:56:04.042101 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8077d211-6ed2-471f-920f-3e69f5d7a15b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:04.042678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8077d211-6ed2-471f-920f-3e69f5d7a15b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:04.046788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=31 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:56:04.052322 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8077d211-6ed2-471f-920f-3e69f5d7a15b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:04.052813 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8077d211-6ed2-471f-920f-3e69f5d7a15b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:04.053251 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8077d211-6ed2-471f-920f-3e69f5d7a15b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:04.053990 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8077d211-6ed2-471f-920f-3e69f5d7a15b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:04.054445 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8077d211-6ed2-471f-920f-3e69f5d7a15b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:04.054873 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8077d211-6ed2-471f-920f-3e69f5d7a15b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:04.057857 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:56:04.195262 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d39d2dcf-4948-486d-a056-56a69f937ba6 req-8545ac15-d48a-4592-a967-21c57d18d80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c3e082-a22b-4c43-86c3-1b737d4b24cb", "tag": "8754ad0b-50c6-4c32-bb7f-1de179a10ddd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:56:04.202567 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8077d211-6ed2-471f-920f-3e69f5d7a15b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:04.206556 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:56:04.208865 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d39d2dcf-4948-486d-a056-56a69f937ba6 req-8545ac15-d48a-4592-a967-21c57d18d80a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:04.209863 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d39d2dcf-4948-486d-a056-56a69f937ba6 req-8545ac15-d48a-4592-a967-21c57d18d80a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:04.210534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d39d2dcf-4948-486d-a056-56a69f937ba6 req-8545ac15-d48a-4592-a967-21c57d18d80a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:04.212583 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8077d211-6ed2-471f-920f-3e69f5d7a15b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.174478 Sep 10 21:56:04.225851 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3643/7159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:04 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:04.228866 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:56:04.243857 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d39d2dcf-4948-486d-a056-56a69f937ba6 req-8545ac15-d48a-4592-a967-21c57d18d80a service nova] Creating event network-changed:8754ad0b-50c6-4c32-bb7f-1de179a10ddd for instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb on nch1-master-1 Sep 10 21:56:04.250368 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d39d2dcf-4948-486d-a056-56a69f937ba6 req-8545ac15-d48a-4592-a967-21c57d18d80a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058842 Sep 10 21:56:04.250987 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3517/7160] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:56:05.243736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ac667ff-9276-4225-91e0-e027f6b6485e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:05.245168 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2ac667ff-9276-4225-91e0-e027f6b6485e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:05.253772 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ac667ff-9276-4225-91e0-e027f6b6485e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:05.254775 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ac667ff-9276-4225-91e0-e027f6b6485e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:05.255501 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ac667ff-9276-4225-91e0-e027f6b6485e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:05.256560 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ac667ff-9276-4225-91e0-e027f6b6485e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:05.257264 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ac667ff-9276-4225-91e0-e027f6b6485e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:05.257970 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ac667ff-9276-4225-91e0-e027f6b6485e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:05.417167 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ac667ff-9276-4225-91e0-e027f6b6485e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:05.426090 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ac667ff-9276-4225-91e0-e027f6b6485e tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.186482 Sep 10 21:56:05.427102 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3644/7161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:05 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:06.455487 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5198d144-0eb1-4842-9cdf-e7b06cb160ed tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:06.456365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5198d144-0eb1-4842-9cdf-e7b06cb160ed tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:06.465630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5198d144-0eb1-4842-9cdf-e7b06cb160ed tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:06.466152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5198d144-0eb1-4842-9cdf-e7b06cb160ed tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:06.466598 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5198d144-0eb1-4842-9cdf-e7b06cb160ed tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:06.467316 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5198d144-0eb1-4842-9cdf-e7b06cb160ed tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:06.467776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5198d144-0eb1-4842-9cdf-e7b06cb160ed tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:06.468207 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5198d144-0eb1-4842-9cdf-e7b06cb160ed tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:06.627877 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5198d144-0eb1-4842-9cdf-e7b06cb160ed tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:06.638236 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5198d144-0eb1-4842-9cdf-e7b06cb160ed tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.187871 Sep 10 21:56:06.638236 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3518/7162] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:06 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:07.662605 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-c11cccae-83ca-45ce-ad8a-5cb0e53f5dc7 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:07.663161 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-c11cccae-83ca-45ce-ad8a-5cb0e53f5dc7 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:07.671406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11cccae-83ca-45ce-ad8a-5cb0e53f5dc7 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:07.671900 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11cccae-83ca-45ce-ad8a-5cb0e53f5dc7 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:07.672332 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11cccae-83ca-45ce-ad8a-5cb0e53f5dc7 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:07.673043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11cccae-83ca-45ce-ad8a-5cb0e53f5dc7 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:07.673527 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11cccae-83ca-45ce-ad8a-5cb0e53f5dc7 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:07.673979 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-c11cccae-83ca-45ce-ad8a-5cb0e53f5dc7 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:07.821203 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-c11cccae-83ca-45ce-ad8a-5cb0e53f5dc7 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:07.830471 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-c11cccae-83ca-45ce-ad8a-5cb0e53f5dc7 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.171832 Sep 10 21:56:07.831042 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3645/7163] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:07 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:08.857383 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-b4466cf6-8e6c-47a2-a5b6-b9e136d43a48 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:08.858214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-b4466cf6-8e6c-47a2-a5b6-b9e136d43a48 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:08.865886 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4466cf6-8e6c-47a2-a5b6-b9e136d43a48 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:08.866553 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4466cf6-8e6c-47a2-a5b6-b9e136d43a48 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:08.866999 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4466cf6-8e6c-47a2-a5b6-b9e136d43a48 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:08.867707 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4466cf6-8e6c-47a2-a5b6-b9e136d43a48 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:08.868166 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4466cf6-8e6c-47a2-a5b6-b9e136d43a48 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:08.868591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-b4466cf6-8e6c-47a2-a5b6-b9e136d43a48 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:09.023225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-b4466cf6-8e6c-47a2-a5b6-b9e136d43a48 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:09.032214 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-b4466cf6-8e6c-47a2-a5b6-b9e136d43a48 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.180476 Sep 10 21:56:09.032811 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3519/7164] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:08 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:10.059761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8e6c5abd-0dfd-48af-8986-e2d14ea8b74b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:10.059761 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8e6c5abd-0dfd-48af-8986-e2d14ea8b74b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:10.067186 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e6c5abd-0dfd-48af-8986-e2d14ea8b74b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:10.067678 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e6c5abd-0dfd-48af-8986-e2d14ea8b74b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:10.068116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e6c5abd-0dfd-48af-8986-e2d14ea8b74b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:10.068824 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e6c5abd-0dfd-48af-8986-e2d14ea8b74b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:10.069277 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e6c5abd-0dfd-48af-8986-e2d14ea8b74b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:10.069701 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-8e6c5abd-0dfd-48af-8986-e2d14ea8b74b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:10.232795 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8e6c5abd-0dfd-48af-8986-e2d14ea8b74b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:10.241077 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8e6c5abd-0dfd-48af-8986-e2d14ea8b74b tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.187811 Sep 10 21:56:10.253920 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3646/7165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:10 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:11.266679 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8b79d559-1b67-4028-ab3e-0d8a89e4bb2f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:11.268196 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8b79d559-1b67-4028-ab3e-0d8a89e4bb2f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:11.275691 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b79d559-1b67-4028-ab3e-0d8a89e4bb2f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:11.276283 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b79d559-1b67-4028-ab3e-0d8a89e4bb2f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:11.276802 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b79d559-1b67-4028-ab3e-0d8a89e4bb2f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:11.278451 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b79d559-1b67-4028-ab3e-0d8a89e4bb2f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:11.278965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b79d559-1b67-4028-ab3e-0d8a89e4bb2f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:11.279462 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8b79d559-1b67-4028-ab3e-0d8a89e4bb2f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:11.425087 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8b79d559-1b67-4028-ab3e-0d8a89e4bb2f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:11.433692 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8b79d559-1b67-4028-ab3e-0d8a89e4bb2f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.171652 Sep 10 21:56:11.435073 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3520/7166] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:11 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:12.457918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-dad04140-a716-425f-9f16-66cc883ed04a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:12.459271 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-dad04140-a716-425f-9f16-66cc883ed04a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:12.467076 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad04140-a716-425f-9f16-66cc883ed04a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:12.467563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad04140-a716-425f-9f16-66cc883ed04a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:12.468002 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad04140-a716-425f-9f16-66cc883ed04a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:12.468705 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad04140-a716-425f-9f16-66cc883ed04a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:12.469165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad04140-a716-425f-9f16-66cc883ed04a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:12.469590 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-dad04140-a716-425f-9f16-66cc883ed04a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:12.610252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-dad04140-a716-425f-9f16-66cc883ed04a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:12.618415 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-dad04140-a716-425f-9f16-66cc883ed04a tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.164560 Sep 10 21:56:12.618993 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3647/7167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:12 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:13.642350 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e87b1ecc-88c7-48a2-a4ef-97b5e8dd694c tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:13.642974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e87b1ecc-88c7-48a2-a4ef-97b5e8dd694c tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:13.649799 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87b1ecc-88c7-48a2-a4ef-97b5e8dd694c tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:13.650318 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87b1ecc-88c7-48a2-a4ef-97b5e8dd694c tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:13.650761 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87b1ecc-88c7-48a2-a4ef-97b5e8dd694c tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:13.651460 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87b1ecc-88c7-48a2-a4ef-97b5e8dd694c tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:13.651986 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87b1ecc-88c7-48a2-a4ef-97b5e8dd694c tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:13.652957 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e87b1ecc-88c7-48a2-a4ef-97b5e8dd694c tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:13.788438 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e87b1ecc-88c7-48a2-a4ef-97b5e8dd694c tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:13.796431 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e87b1ecc-88c7-48a2-a4ef-97b5e8dd694c tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.158191 Sep 10 21:56:13.797013 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3521/7168] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:13 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:14.820819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-27046637-c534-4b9d-af3b-1ce43581b405 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:14.821428 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-27046637-c534-4b9d-af3b-1ce43581b405 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:14.829169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27046637-c534-4b9d-af3b-1ce43581b405 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:14.829652 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27046637-c534-4b9d-af3b-1ce43581b405 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:14.830116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27046637-c534-4b9d-af3b-1ce43581b405 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:14.830808 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27046637-c534-4b9d-af3b-1ce43581b405 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:14.831259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27046637-c534-4b9d-af3b-1ce43581b405 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:14.831682 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-27046637-c534-4b9d-af3b-1ce43581b405 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:14.967163 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-27046637-c534-4b9d-af3b-1ce43581b405 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:14.975288 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-27046637-c534-4b9d-af3b-1ce43581b405 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.158597 Sep 10 21:56:14.975878 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3648/7169] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:14 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:15.999562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-6fc68208-d277-4a76-a0a4-6b36a6ab0f01 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:16.000181 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-6fc68208-d277-4a76-a0a4-6b36a6ab0f01 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:16.007047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fc68208-d277-4a76-a0a4-6b36a6ab0f01 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:16.007538 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fc68208-d277-4a76-a0a4-6b36a6ab0f01 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:16.007979 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fc68208-d277-4a76-a0a4-6b36a6ab0f01 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:16.008676 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fc68208-d277-4a76-a0a4-6b36a6ab0f01 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:16.009138 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fc68208-d277-4a76-a0a4-6b36a6ab0f01 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:16.009571 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-6fc68208-d277-4a76-a0a4-6b36a6ab0f01 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:16.144577 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-6fc68208-d277-4a76-a0a4-6b36a6ab0f01 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:16.152979 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-6fc68208-d277-4a76-a0a4-6b36a6ab0f01 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.157651 Sep 10 21:56:16.153624 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3522/7170] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:15 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:17.177257 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-cc9d2339-a28c-4732-baa9-be37568ec1bb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:17.177874 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-cc9d2339-a28c-4732-baa9-be37568ec1bb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:17.185433 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9d2339-a28c-4732-baa9-be37568ec1bb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:17.185960 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9d2339-a28c-4732-baa9-be37568ec1bb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:17.186395 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9d2339-a28c-4732-baa9-be37568ec1bb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:17.187092 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9d2339-a28c-4732-baa9-be37568ec1bb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:17.187546 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9d2339-a28c-4732-baa9-be37568ec1bb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:17.188240 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-cc9d2339-a28c-4732-baa9-be37568ec1bb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:17.324834 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-cc9d2339-a28c-4732-baa9-be37568ec1bb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:17.333049 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-cc9d2339-a28c-4732-baa9-be37568ec1bb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.159573 Sep 10 21:56:17.333651 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3649/7171] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:17 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:18.356215 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-58346451-b4f6-4d91-9da6-4f2978780b37 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:18.356836 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-58346451-b4f6-4d91-9da6-4f2978780b37 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:18.364669 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58346451-b4f6-4d91-9da6-4f2978780b37 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:18.365156 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58346451-b4f6-4d91-9da6-4f2978780b37 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:18.365592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58346451-b4f6-4d91-9da6-4f2978780b37 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:18.366313 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58346451-b4f6-4d91-9da6-4f2978780b37 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:18.366768 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58346451-b4f6-4d91-9da6-4f2978780b37 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:18.367194 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-58346451-b4f6-4d91-9da6-4f2978780b37 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:18.500480 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-58346451-b4f6-4d91-9da6-4f2978780b37 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:18.508172 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-58346451-b4f6-4d91-9da6-4f2978780b37 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.156088 Sep 10 21:56:18.508743 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3523/7172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:18 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:19.531566 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4326a43f-310e-46f8-abcc-a48365dbb0c3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:19.532116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4326a43f-310e-46f8-abcc-a48365dbb0c3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:19.539165 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4326a43f-310e-46f8-abcc-a48365dbb0c3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:19.539651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4326a43f-310e-46f8-abcc-a48365dbb0c3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:19.540094 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4326a43f-310e-46f8-abcc-a48365dbb0c3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:19.540792 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4326a43f-310e-46f8-abcc-a48365dbb0c3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:19.541254 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4326a43f-310e-46f8-abcc-a48365dbb0c3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:19.541689 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4326a43f-310e-46f8-abcc-a48365dbb0c3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:19.673142 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4326a43f-310e-46f8-abcc-a48365dbb0c3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:19.680937 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4326a43f-310e-46f8-abcc-a48365dbb0c3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.153432 Sep 10 21:56:19.681510 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3650/7173] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:19 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:20.704794 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-c9421d10-3c1a-451e-84ac-e84c4d56edaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:20.705412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-c9421d10-3c1a-451e-84ac-e84c4d56edaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:20.712394 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9421d10-3c1a-451e-84ac-e84c4d56edaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:20.712876 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9421d10-3c1a-451e-84ac-e84c4d56edaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:20.713310 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9421d10-3c1a-451e-84ac-e84c4d56edaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:20.714044 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9421d10-3c1a-451e-84ac-e84c4d56edaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:20.715225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9421d10-3c1a-451e-84ac-e84c4d56edaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:20.715753 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-c9421d10-3c1a-451e-84ac-e84c4d56edaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:20.853218 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-c9421d10-3c1a-451e-84ac-e84c4d56edaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:20.861286 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-c9421d10-3c1a-451e-84ac-e84c4d56edaa tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.160444 Sep 10 21:56:20.861894 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3524/7174] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:20 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:21.885962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6edd06a8-dc5b-4edd-b6c1-27cbc11f8e29 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:21.887129 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6edd06a8-dc5b-4edd-b6c1-27cbc11f8e29 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:21.894006 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6edd06a8-dc5b-4edd-b6c1-27cbc11f8e29 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:21.894493 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6edd06a8-dc5b-4edd-b6c1-27cbc11f8e29 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:21.894928 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6edd06a8-dc5b-4edd-b6c1-27cbc11f8e29 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:21.895623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6edd06a8-dc5b-4edd-b6c1-27cbc11f8e29 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:21.896078 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6edd06a8-dc5b-4edd-b6c1-27cbc11f8e29 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:21.896506 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6edd06a8-dc5b-4edd-b6c1-27cbc11f8e29 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:22.036884 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6edd06a8-dc5b-4edd-b6c1-27cbc11f8e29 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:22.044762 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6edd06a8-dc5b-4edd-b6c1-27cbc11f8e29 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.162767 Sep 10 21:56:22.045346 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3651/7175] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:21 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:22.974006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-204be4df-12fc-47fb-ba9b-d3e20d59706e req-ce901d20-305b-4ee2-8009-a032b2258541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c3e082-a22b-4c43-86c3-1b737d4b24cb", "name": "network-vif-plugged", "status": "completed", "tag": "8754ad0b-50c6-4c32-bb7f-1de179a10ddd"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:56:22.985720 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-204be4df-12fc-47fb-ba9b-d3e20d59706e req-ce901d20-305b-4ee2-8009-a032b2258541 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:22.986369 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-204be4df-12fc-47fb-ba9b-d3e20d59706e req-ce901d20-305b-4ee2-8009-a032b2258541 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:22.986806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-204be4df-12fc-47fb-ba9b-d3e20d59706e req-ce901d20-305b-4ee2-8009-a032b2258541 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:22.999271 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-204be4df-12fc-47fb-ba9b-d3e20d59706e req-ce901d20-305b-4ee2-8009-a032b2258541 service nova] Creating event network-vif-plugged:8754ad0b-50c6-4c32-bb7f-1de179a10ddd for instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb on nch1-master-1 Sep 10 21:56:23.004445 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-204be4df-12fc-47fb-ba9b-d3e20d59706e req-ce901d20-305b-4ee2-8009-a032b2258541 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034548 Sep 10 21:56:23.005051 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3525/7176] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:56:23.068823 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-fd0767b2-9cf1-4e06-8786-de55d35a1c86 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:23.069366 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-fd0767b2-9cf1-4e06-8786-de55d35a1c86 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:23.076353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd0767b2-9cf1-4e06-8786-de55d35a1c86 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:23.076842 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd0767b2-9cf1-4e06-8786-de55d35a1c86 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:23.077282 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd0767b2-9cf1-4e06-8786-de55d35a1c86 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:23.078032 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd0767b2-9cf1-4e06-8786-de55d35a1c86 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:23.078498 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd0767b2-9cf1-4e06-8786-de55d35a1c86 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:23.078926 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-fd0767b2-9cf1-4e06-8786-de55d35a1c86 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:23.219205 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-fd0767b2-9cf1-4e06-8786-de55d35a1c86 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:23.227442 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-fd0767b2-9cf1-4e06-8786-de55d35a1c86 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.162640 Sep 10 21:56:23.228035 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3652/7177] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:23 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:24.252431 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2bbb5950-b776-45d3-8990-b8232c8668a6 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:24.253047 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2bbb5950-b776-45d3-8990-b8232c8668a6 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:24.259269 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bbb5950-b776-45d3-8990-b8232c8668a6 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:24.259746 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bbb5950-b776-45d3-8990-b8232c8668a6 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:24.260214 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bbb5950-b776-45d3-8990-b8232c8668a6 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:24.260902 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bbb5950-b776-45d3-8990-b8232c8668a6 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:24.261356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bbb5950-b776-45d3-8990-b8232c8668a6 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:24.261780 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2bbb5950-b776-45d3-8990-b8232c8668a6 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:24.396275 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2bbb5950-b776-45d3-8990-b8232c8668a6 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:24.404798 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2bbb5950-b776-45d3-8990-b8232c8668a6 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1688 microversion: 2.1 time: 0.157993 Sep 10 21:56:24.405379 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3526/7178] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:24 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:56:25.428218 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-66ce6979-b590-4574-ad09-53ca512606ef tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:56:25.428847 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-66ce6979-b590-4574-ad09-53ca512606ef tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:56:25.436735 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66ce6979-b590-4574-ad09-53ca512606ef tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:25.437216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66ce6979-b590-4574-ad09-53ca512606ef tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:25.437651 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66ce6979-b590-4574-ad09-53ca512606ef tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:25.438384 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66ce6979-b590-4574-ad09-53ca512606ef tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:56:25.438838 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66ce6979-b590-4574-ad09-53ca512606ef tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:56:25.439265 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66ce6979-b590-4574-ad09-53ca512606ef tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:56:25.572688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-66ce6979-b590-4574-ad09-53ca512606ef tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:56:25.580531 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-66ce6979-b590-4574-ad09-53ca512606ef tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1675 microversion: 2.1 time: 0.156269 Sep 10 21:56:25.581118 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3653/7179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:56:25 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:03.159819 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=21 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:58:03.160454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ecc71201-2a76-4757-81f4-c37728cd2797 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:03.160965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ecc71201-2a76-4757-81f4-c37728cd2797 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:03.161093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=65 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:58:03.162467 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 21:58:03.162883 ncdv-master-1 devstack@n-api.service[145772]: Sat Sep 10 21:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 10 21:58:03.166765 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=19 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:58:03.167930 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=51 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:58:03.171160 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecc71201-2a76-4757-81f4-c37728cd2797 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:03.172264 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecc71201-2a76-4757-81f4-c37728cd2797 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:03.172896 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecc71201-2a76-4757-81f4-c37728cd2797 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:03.173955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecc71201-2a76-4757-81f4-c37728cd2797 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:03.174545 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecc71201-2a76-4757-81f4-c37728cd2797 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:03.174855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ecc71201-2a76-4757-81f4-c37728cd2797 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:03.203828 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ecc71201-2a76-4757-81f4-c37728cd2797 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 21:58:03.238691 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-449dcfef-103e-41b3-ba9e-8d6a96a65db7 req-020067f8-bddc-45b3-b29a-13205789f480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c3e082-a22b-4c43-86c3-1b737d4b24cb", "tag": "8754ad0b-50c6-4c32-bb7f-1de179a10ddd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:58:03.249358 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-449dcfef-103e-41b3-ba9e-8d6a96a65db7 req-020067f8-bddc-45b3-b29a-13205789f480 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:03.250623 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-449dcfef-103e-41b3-ba9e-8d6a96a65db7 req-020067f8-bddc-45b3-b29a-13205789f480 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:03.251144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-449dcfef-103e-41b3-ba9e-8d6a96a65db7 req-020067f8-bddc-45b3-b29a-13205789f480 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:03.263300 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-449dcfef-103e-41b3-ba9e-8d6a96a65db7 req-020067f8-bddc-45b3-b29a-13205789f480 service nova] Creating event network-changed:8754ad0b-50c6-4c32-bb7f-1de179a10ddd for instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb on nch1-master-1 Sep 10 21:58:03.269335 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-449dcfef-103e-41b3-ba9e-8d6a96a65db7 req-020067f8-bddc-45b3-b29a-13205789f480 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111584 Sep 10 21:58:03.270248 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3654/7180] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:58:03.294394 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ecc71201-2a76-4757-81f4-c37728cd2797 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 204 len: 0 microversion: 2.1 time: 0.139681 Sep 10 21:58:03.297882 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3527/7181] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 21:58:03 2022] DELETE /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 21:58:03.303916 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-aa33744c-f973-4660-b4ca-0bda51fe8f1f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:03.304951 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-aa33744c-f973-4660-b4ca-0bda51fe8f1f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:03.311609 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa33744c-f973-4660-b4ca-0bda51fe8f1f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:03.313019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa33744c-f973-4660-b4ca-0bda51fe8f1f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:03.314328 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa33744c-f973-4660-b4ca-0bda51fe8f1f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:03.315422 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa33744c-f973-4660-b4ca-0bda51fe8f1f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:03.316266 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa33744c-f973-4660-b4ca-0bda51fe8f1f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:03.316956 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-aa33744c-f973-4660-b4ca-0bda51fe8f1f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:03.514200 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-aa33744c-f973-4660-b4ca-0bda51fe8f1f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:03.522913 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-aa33744c-f973-4660-b4ca-0bda51fe8f1f tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.223236 Sep 10 21:58:03.523641 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3655/7182] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:03 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:04.549162 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e23223da-97ea-41ec-82f4-4ffc37ad49cb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:04.549949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e23223da-97ea-41ec-82f4-4ffc37ad49cb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:04.557095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e23223da-97ea-41ec-82f4-4ffc37ad49cb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:04.557588 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e23223da-97ea-41ec-82f4-4ffc37ad49cb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:04.558066 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e23223da-97ea-41ec-82f4-4ffc37ad49cb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:04.558777 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e23223da-97ea-41ec-82f4-4ffc37ad49cb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:04.559240 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e23223da-97ea-41ec-82f4-4ffc37ad49cb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:04.559670 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e23223da-97ea-41ec-82f4-4ffc37ad49cb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:04.824422 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e23223da-97ea-41ec-82f4-4ffc37ad49cb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:04.832541 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e23223da-97ea-41ec-82f4-4ffc37ad49cb tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1681 microversion: 2.1 time: 0.288870 Sep 10 21:58:04.833151 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3528/7183] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:04 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:05.348496 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d6fba017-c1af-43fb-838b-3cb88d0bf7af req-73ab1a0a-5f25-4f43-93a1-4fce9908f0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c3e082-a22b-4c43-86c3-1b737d4b24cb", "name": "network-vif-deleted", "tag": "8754ad0b-50c6-4c32-bb7f-1de179a10ddd"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:58:05.360274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d6fba017-c1af-43fb-838b-3cb88d0bf7af req-73ab1a0a-5f25-4f43-93a1-4fce9908f0e5 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:05.360668 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d6fba017-c1af-43fb-838b-3cb88d0bf7af req-73ab1a0a-5f25-4f43-93a1-4fce9908f0e5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:05.361788 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d6fba017-c1af-43fb-838b-3cb88d0bf7af req-73ab1a0a-5f25-4f43-93a1-4fce9908f0e5 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:05.377765 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d6fba017-c1af-43fb-838b-3cb88d0bf7af req-73ab1a0a-5f25-4f43-93a1-4fce9908f0e5 service nova] Creating event network-vif-deleted:8754ad0b-50c6-4c32-bb7f-1de179a10ddd for instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb on nch1-master-1 Sep 10 21:58:05.382792 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d6fba017-c1af-43fb-838b-3cb88d0bf7af req-73ab1a0a-5f25-4f43-93a1-4fce9908f0e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038392 Sep 10 21:58:05.383415 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3656/7184] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:58:05.857179 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:05.857941 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:05.865701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:05.866306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:05.866820 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:05.867656 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:05.868224 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:05.868680 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:05.905165 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:05.905620 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:05.906319 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:05.906786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lazy-loading 'fault' on Instance uuid c6c3e082-a22b-4c43-86c3-1b737d4b24cb {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 21:58:05.952974 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f20ab4946f4ad6ac5637b10b9b7e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fed94219e94a079adb19e226519d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:05.960461 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8f140179-b24e-4d8e-9923-34ae61e15c66 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 200 len: 1336 microversion: 2.1 time: 0.107338 Sep 10 21:58:05.961058 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3529/7185] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:05 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:06.985793 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:06.986811 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] [instance: c6c3e082-a22b-4c43-86c3-1b737d4b24cb] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:06.993278 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:06.993765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:06.994245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:06.994945 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:06.995415 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:06.995850 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:07.009789 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] HTTP exception thrown: Instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb could not be found. Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Request method failure captured: Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb HTTP/1.1 Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQdLQNOtt4hkMJX4W7QbdnKS92NPK8jpQX5sSOQg9GQjwRz9xZCe5WaJxmnj81BVHp3CE2erMfsAtB8eaB-1BZowgd9b58uxSQbBH3F-4mgXY4dtAVDHfl7nu3b8T6Z1YuOIr0Yl3cXxfMeOOVQ9W4z3my70rosTvSI1eNLlPYrzwX8 Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: f6fed94219e94a079adb19e226519d93 Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestShelveInstance-1402421168 Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f6fed94219e94a079adb19e226519d93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f6fed94219e94a079adb19e226519d93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f6fed94219e94a079adb19e226519d93", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f6fed94219e94a079adb19e226519d93"}]}] Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestShelveInstance-1402421168 Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: f6fed94219e94a079adb19e226519d93 Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestShelveInstance-1402421168 Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestShelveInstance-1402421168-project Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: e8f20ab4946f4ad6ac5637b10b9b7e2a Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestShelveInstance-1402421168-project Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb could not be found. Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': 'c6c3e082-a22b-4c43-86c3-1b737d4b24cb'} Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb could not be found. Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb could not be found. Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 21:58:07.011432 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:58:07.017604 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 21:58:07.017604 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 21:58:07.017604 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 21:58:07.017604 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 21:58:07.017604 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 21:58:07.017604 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb could not be found. Sep 10 21:58:07.017604 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 21:58:07.017604 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Returning 404 to user: Instance c6c3e082-a22b-4c43-86c3-1b737d4b24cb could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 21:58:07.017604 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-b8d551e5-4d34-425e-970a-4938320d3da3 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb" status: 404 len: 111 microversion: 2.1 time: 0.032499 Sep 10 21:58:07.017604 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3657/7186] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:06 2022] GET /compute/v2.1/servers/c6c3e082-a22b-4c43-86c3-1b737d4b24cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 21:58:07.174660 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2fa76c07-b0a1-4cde-887f-dd97dab9ccb8 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '.version_select at 0x7f993f4da5e0>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:07.202032 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2fa76c07-b0a1-4cde-887f-dd97dab9ccb8 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-298002039" status: 202 len: 0 microversion: 2.1 time: 0.031992 Sep 10 21:58:07.203007 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3530/7187] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 21:58:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-298002039 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:58:07.221877 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-32f695dc-5b48-4c6f-8424-e064f02452e9 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Action: 'create', calling method: .version_select at 0x7f99448af0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-496094730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl8kXOFchIJMelj9rKVLAmJ2XKJMevO9g3U9lnbFQlMiJu/s7gFbjeJ4XzcPQT18I/jzB3I2XG9jiSsFPsYPrYM+KCnQC/q/qp5llsKdj4dn8NvcTuIx0Msz3L/XpwUFg=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:58:07.238851 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-32f695dc-5b48-4c6f-8424-e064f02452e9 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Getting quotas for project f6fed94219e94a079adb19e226519d93. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:58:07.244230 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-32f695dc-5b48-4c6f-8424-e064f02452e9 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Getting quotas for user e8f20ab4946f4ad6ac5637b10b9b7e2a and project f6fed94219e94a079adb19e226519d93. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:58:07.272506 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-32f695dc-5b48-4c6f-8424-e064f02452e9 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.054855 Sep 10 21:58:07.273131 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3658/7188] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:58:07 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:58:09.998523 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-95c30b29-e0c8-4f43-9d9a-b033a2ad0ee2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] Calling method '.version_select at 0x7f9944de7e50>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:10.019336 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-95c30b29-e0c8-4f43-9d9a-b033a2ad0ee2 tempest-TestShelveInstance-1402421168 tempest-TestShelveInstance-1402421168-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-496094730" status: 202 len: 0 microversion: 2.1 time: 0.025534 Sep 10 21:58:10.020062 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3531/7189] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Sep 10 21:58:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-496094730 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 21:58:27.356400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=12 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:58:27.360260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=4 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:58:27.361738 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:58:27.552702 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-99994300-1f7e-4378-af4f-d47232e01d8f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Action: 'create', calling method: .version_select at 0x7f99448e4d30>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-921880638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjgm4H5CKHdzUuFMDsiD2CfFejd6FcjxEJQF9Zic3UOvvYSHR8Zk/5aeFHCpV6Hc7daDeFfYbj4T5p+IuWdJgeAWTIyD5tOMk2NHoR2dLnlNUc6icG8mSt7+GLmHy9/9A=="}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:58:27.574194 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-99994300-1f7e-4378-af4f-d47232e01d8f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Getting quotas for project c19c892be2ee4051a0a59def52561c8d. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:58:27.581624 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.quota [None req-99994300-1f7e-4378-af4f-d47232e01d8f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Getting quotas for user 86134247af5940d6b3011c490cdf6d13 and project c19c892be2ee4051a0a59def52561c8d. Resources: {'key_pairs'} {{(pid=145772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:58:27.631854 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-99994300-1f7e-4378-af4f-d47232e01d8f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.281144 Sep 10 21:58:27.632476 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3659/7190] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Sep 10 21:58:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:58:28.665139 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:58:28.665925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:58:28.670170 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1233842356", "imageRef": "b43a7a8a-2616-430e-9e50-ef93c087ed12", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-921880638", "security_groups": [{"name": "tempest-secgroup-smoke-556415554"}], "networks": [{"uuid": "2acc7a23-4650-4852-a1cb-cfde0671e954"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:58:28.783095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] validate_networks() for [('2acc7a23-4650-4852-a1cb-cfde0671e954', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 21:58:29.184032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 21:58:29.184540 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 21:58:29.185027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 21:58:29.185443 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 21:58:29.185925 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 21:58:29.196306 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:29.196806 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:29.197259 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:29.198055 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:29.198520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:29.198953 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:29.217790 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Getting quotas for project c19c892be2ee4051a0a59def52561c8d. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 21:58:29.223343 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Getting quotas for user 86134247af5940d6b3011c490cdf6d13 and project c19c892be2ee4051a0a59def52561c8d. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 21:58:29.236314 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 21:58:29.238699 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43a7a8a-2616-430e-9e50-ef93c087ed12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 21:58:29.288036 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1866fc11-642b-4c38-a0b9-b9b36f06c107 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.624540 Sep 10 21:58:29.288936 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3532/7191] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 21:58:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 21:58:29.301268 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-f5c544eb-1845-420a-845b-a0ba7ed7605b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:29.301952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-f5c544eb-1845-420a-845b-a0ba7ed7605b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:29.364438 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-f5c544eb-1845-420a-845b-a0ba7ed7605b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:29.372889 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-f5c544eb-1845-420a-845b-a0ba7ed7605b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1248 microversion: 2.1 time: 0.076706 Sep 10 21:58:29.373797 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3660/7192] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:29 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1248 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:30.397569 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a8a32353-2cfd-42bf-b1dc-6611405427d3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:30.398225 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a8a32353-2cfd-42bf-b1dc-6611405427d3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:30.405272 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8a32353-2cfd-42bf-b1dc-6611405427d3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:30.405766 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8a32353-2cfd-42bf-b1dc-6611405427d3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:30.406243 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8a32353-2cfd-42bf-b1dc-6611405427d3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:30.407115 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8a32353-2cfd-42bf-b1dc-6611405427d3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:30.407580 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8a32353-2cfd-42bf-b1dc-6611405427d3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:30.408013 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a8a32353-2cfd-42bf-b1dc-6611405427d3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:30.485433 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a8a32353-2cfd-42bf-b1dc-6611405427d3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:30.494786 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a8a32353-2cfd-42bf-b1dc-6611405427d3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1300 microversion: 2.1 time: 0.101945 Sep 10 21:58:30.495639 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3533/7193] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:30 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:31.519105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-85c29983-d4b3-4324-b48e-75972ee664e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:31.520442 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-85c29983-d4b3-4324-b48e-75972ee664e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:31.528723 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85c29983-d4b3-4324-b48e-75972ee664e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:31.529245 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85c29983-d4b3-4324-b48e-75972ee664e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:31.529763 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85c29983-d4b3-4324-b48e-75972ee664e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:31.530574 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85c29983-d4b3-4324-b48e-75972ee664e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:31.531663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85c29983-d4b3-4324-b48e-75972ee664e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:31.532173 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-85c29983-d4b3-4324-b48e-75972ee664e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:31.774294 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-85c29983-d4b3-4324-b48e-75972ee664e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:31.783368 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-85c29983-d4b3-4324-b48e-75972ee664e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1373 microversion: 2.1 time: 0.267892 Sep 10 21:58:31.797184 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3661/7194] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:31 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1373 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:32.241037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-c9b2a596-0e5b-42f8-b3e4-f490ffa0ce59 req-d372b0de-5d64-4ce0-8a68-3a17d093e14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3ec73e-9aa1-44d9-a21b-6da8204f613c", "tag": "9fb68888-0bfe-4ae8-985e-92a04f648c3a"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:58:32.253661 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c9b2a596-0e5b-42f8-b3e4-f490ffa0ce59 req-d372b0de-5d64-4ce0-8a68-3a17d093e14f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:32.254434 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c9b2a596-0e5b-42f8-b3e4-f490ffa0ce59 req-d372b0de-5d64-4ce0-8a68-3a17d093e14f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:32.255818 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-c9b2a596-0e5b-42f8-b3e4-f490ffa0ce59 req-d372b0de-5d64-4ce0-8a68-3a17d093e14f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:32.269962 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-c9b2a596-0e5b-42f8-b3e4-f490ffa0ce59 req-d372b0de-5d64-4ce0-8a68-3a17d093e14f service nova] Creating event network-changed:9fb68888-0bfe-4ae8-985e-92a04f648c3a for instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c on nch2-master-1 Sep 10 21:58:32.275293 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-c9b2a596-0e5b-42f8-b3e4-f490ffa0ce59 req-d372b0de-5d64-4ce0-8a68-3a17d093e14f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041531 Sep 10 21:58:32.276012 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3534/7195] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 21:58:32.807303 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-65f941fb-84ff-45d4-b4af-2e0e93606eb8 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:32.807933 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-65f941fb-84ff-45d4-b4af-2e0e93606eb8 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:32.815274 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65f941fb-84ff-45d4-b4af-2e0e93606eb8 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:32.815774 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65f941fb-84ff-45d4-b4af-2e0e93606eb8 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:32.816229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65f941fb-84ff-45d4-b4af-2e0e93606eb8 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:32.816948 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65f941fb-84ff-45d4-b4af-2e0e93606eb8 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:32.817414 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65f941fb-84ff-45d4-b4af-2e0e93606eb8 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:32.817876 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-65f941fb-84ff-45d4-b4af-2e0e93606eb8 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:32.966390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-65f941fb-84ff-45d4-b4af-2e0e93606eb8 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:32.975419 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-65f941fb-84ff-45d4-b4af-2e0e93606eb8 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1373 microversion: 2.1 time: 0.172004 Sep 10 21:58:32.976124 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3662/7196] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:32 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:34.001079 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-5d976b35-5011-4245-a18f-4d5f40bde57c tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:34.001782 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-5d976b35-5011-4245-a18f-4d5f40bde57c tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:34.008070 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d976b35-5011-4245-a18f-4d5f40bde57c tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:34.008562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d976b35-5011-4245-a18f-4d5f40bde57c tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:34.009006 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d976b35-5011-4245-a18f-4d5f40bde57c tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:34.009713 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d976b35-5011-4245-a18f-4d5f40bde57c tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:34.010199 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d976b35-5011-4245-a18f-4d5f40bde57c tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:34.010635 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-5d976b35-5011-4245-a18f-4d5f40bde57c tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:34.148504 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-5d976b35-5011-4245-a18f-4d5f40bde57c tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:34.157047 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-5d976b35-5011-4245-a18f-4d5f40bde57c tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1373 microversion: 2.1 time: 0.161201 Sep 10 21:58:34.157881 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3535/7197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:33 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:35.180400 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-3873a246-d1da-471a-a8f3-3e503470c37a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:35.181021 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-3873a246-d1da-471a-a8f3-3e503470c37a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:35.188260 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3873a246-d1da-471a-a8f3-3e503470c37a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:35.188758 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3873a246-d1da-471a-a8f3-3e503470c37a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:35.189204 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3873a246-d1da-471a-a8f3-3e503470c37a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:35.189942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3873a246-d1da-471a-a8f3-3e503470c37a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:35.190410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3873a246-d1da-471a-a8f3-3e503470c37a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:35.190845 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-3873a246-d1da-471a-a8f3-3e503470c37a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:35.327003 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-3873a246-d1da-471a-a8f3-3e503470c37a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:35.336791 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-3873a246-d1da-471a-a8f3-3e503470c37a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1373 microversion: 2.1 time: 0.160295 Sep 10 21:58:35.337395 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3663/7198] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:35 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:36.361136 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-ffbe4ccb-42b6-4cc4-a728-10b3c0fd3235 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:36.361762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-ffbe4ccb-42b6-4cc4-a728-10b3c0fd3235 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:36.369245 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffbe4ccb-42b6-4cc4-a728-10b3c0fd3235 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:36.369559 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffbe4ccb-42b6-4cc4-a728-10b3c0fd3235 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:36.370032 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffbe4ccb-42b6-4cc4-a728-10b3c0fd3235 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:36.370749 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffbe4ccb-42b6-4cc4-a728-10b3c0fd3235 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:36.371213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffbe4ccb-42b6-4cc4-a728-10b3c0fd3235 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:36.371647 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-ffbe4ccb-42b6-4cc4-a728-10b3c0fd3235 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:36.506819 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-ffbe4ccb-42b6-4cc4-a728-10b3c0fd3235 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:36.514770 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-ffbe4ccb-42b6-4cc4-a728-10b3c0fd3235 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1373 microversion: 2.1 time: 0.158030 Sep 10 21:58:36.516068 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3536/7199] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:36 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:37.503827 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-892e2579-9e50-4570-a0f7-bef22491f099 req-c12dc168-efe8-457b-b71a-d2d61e40aa0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3ec73e-9aa1-44d9-a21b-6da8204f613c", "name": "network-vif-plugged", "status": "completed", "tag": "9fb68888-0bfe-4ae8-985e-92a04f648c3a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:58:37.513562 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-892e2579-9e50-4570-a0f7-bef22491f099 req-c12dc168-efe8-457b-b71a-d2d61e40aa0a service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:37.514073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-892e2579-9e50-4570-a0f7-bef22491f099 req-c12dc168-efe8-457b-b71a-d2d61e40aa0a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:37.514507 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-892e2579-9e50-4570-a0f7-bef22491f099 req-c12dc168-efe8-457b-b71a-d2d61e40aa0a service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:37.525541 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-892e2579-9e50-4570-a0f7-bef22491f099 req-c12dc168-efe8-457b-b71a-d2d61e40aa0a service nova] Creating event network-vif-plugged:9fb68888-0bfe-4ae8-985e-92a04f648c3a for instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c on nch2-master-1 Sep 10 21:58:37.530660 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-892e2579-9e50-4570-a0f7-bef22491f099 req-c12dc168-efe8-457b-b71a-d2d61e40aa0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091313 Sep 10 21:58:37.531812 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3664/7200] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 21:58:37.538772 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-0489a88f-e425-4999-bfe2-8882291553f1 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:37.539391 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-0489a88f-e425-4999-bfe2-8882291553f1 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:37.546421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0489a88f-e425-4999-bfe2-8882291553f1 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:37.547497 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0489a88f-e425-4999-bfe2-8882291553f1 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:37.548031 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0489a88f-e425-4999-bfe2-8882291553f1 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:37.548762 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0489a88f-e425-4999-bfe2-8882291553f1 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:37.549223 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0489a88f-e425-4999-bfe2-8882291553f1 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:37.549655 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-0489a88f-e425-4999-bfe2-8882291553f1 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:37.689297 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-0489a88f-e425-4999-bfe2-8882291553f1 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:37.697265 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-0489a88f-e425-4999-bfe2-8882291553f1 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1373 microversion: 2.1 time: 0.162724 Sep 10 21:58:37.697880 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3537/7201] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:37 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:38.799687 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-0751a424-ef6c-46e0-b29f-40a58b06b70e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:38.800390 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-0751a424-ef6c-46e0-b29f-40a58b06b70e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:38.806765 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0751a424-ef6c-46e0-b29f-40a58b06b70e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:38.807252 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0751a424-ef6c-46e0-b29f-40a58b06b70e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:38.807696 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0751a424-ef6c-46e0-b29f-40a58b06b70e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:38.808427 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0751a424-ef6c-46e0-b29f-40a58b06b70e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:38.808887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0751a424-ef6c-46e0-b29f-40a58b06b70e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:38.809349 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-0751a424-ef6c-46e0-b29f-40a58b06b70e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:38.947248 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-0751a424-ef6c-46e0-b29f-40a58b06b70e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:38.955237 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-0751a424-ef6c-46e0-b29f-40a58b06b70e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1557 microversion: 2.1 time: 0.161275 Sep 10 21:58:38.955822 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3665/7202] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:38 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:38.978846 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2074a268-05cc-4b18-b433-07e69f34db6f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 21:58:38.979468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2074a268-05cc-4b18-b433-07e69f34db6f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 21:58:38.987040 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2074a268-05cc-4b18-b433-07e69f34db6f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:38.987534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2074a268-05cc-4b18-b433-07e69f34db6f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:38.987981 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2074a268-05cc-4b18-b433-07e69f34db6f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:38.988708 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2074a268-05cc-4b18-b433-07e69f34db6f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:38.989171 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2074a268-05cc-4b18-b433-07e69f34db6f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:38.989603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2074a268-05cc-4b18-b433-07e69f34db6f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:39.124960 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2074a268-05cc-4b18-b433-07e69f34db6f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 21:58:39.133067 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2074a268-05cc-4b18-b433-07e69f34db6f tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1557 microversion: 2.1 time: 0.158163 Sep 10 21:58:39.133646 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3538/7203] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 21:58:38 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 21:58:41.045952 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 21:58:41.107880 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-d2cdc494-a59d-4fc0-b679-7e562a0c0c31 req-17c4ad39-d2eb-4d3d-ab80-e33b2c8ee5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3ec73e-9aa1-44d9-a21b-6da8204f613c", "tag": "9fb68888-0bfe-4ae8-985e-92a04f648c3a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 21:58:41.118744 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d2cdc494-a59d-4fc0-b679-7e562a0c0c31 req-17c4ad39-d2eb-4d3d-ab80-e33b2c8ee5b9 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 21:58:41.119222 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d2cdc494-a59d-4fc0-b679-7e562a0c0c31 req-17c4ad39-d2eb-4d3d-ab80-e33b2c8ee5b9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 21:58:41.119649 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-d2cdc494-a59d-4fc0-b679-7e562a0c0c31 req-17c4ad39-d2eb-4d3d-ab80-e33b2c8ee5b9 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 21:58:41.134364 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-d2cdc494-a59d-4fc0-b679-7e562a0c0c31 req-17c4ad39-d2eb-4d3d-ab80-e33b2c8ee5b9 service nova] Creating event network-changed:9fb68888-0bfe-4ae8-985e-92a04f648c3a for instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c on nch2-master-1 Sep 10 21:58:41.139493 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-d2cdc494-a59d-4fc0-b679-7e562a0c0c31 req-17c4ad39-d2eb-4d3d-ab80-e33b2c8ee5b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097944 Sep 10 21:58:41.140398 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3666/7204] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 21:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:00:38.541712 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9be06a9-4f21-4508-84c9-22f4b31441dc] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 22:00:38.542916 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d92fd74e-3a75-4708-a33b-c44a50e0eba4] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 22:00:38.543288 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:00:38.544050 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=6 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:00:38.544789 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:00:38.545421 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=34 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:00:38.546899 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 22:00:38.547057 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 22:00:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c/action (ip 10.222.0.33) !!! Sep 10 22:00:38.552206 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f288a91c-0e55-4583-8856-8393fb906857 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-895692626"}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:00:38.554610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f288a91c-0e55-4583-8856-8393fb906857 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:00:38.566068 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f288a91c-0e55-4583-8856-8393fb906857 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:38.566562 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f288a91c-0e55-4583-8856-8393fb906857 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:38.567002 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f288a91c-0e55-4583-8856-8393fb906857 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:38.567703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f288a91c-0e55-4583-8856-8393fb906857 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:38.568249 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f288a91c-0e55-4583-8856-8393fb906857 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:38.568687 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f288a91c-0e55-4583-8856-8393fb906857 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:38.771617 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f288a91c-0e55-4583-8856-8393fb906857 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "POST /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c/action" status: 202 len: 0 microversion: 2.1 time: 0.230446 Sep 10 22:00:38.772260 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3539/7205] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 22:00:38 2022] POST /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 22:00:44.107801 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c8ac8451-8bb7-4c61-8ae1-41d1ffcbab32] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 22:00:44.109250 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7b1f4ed7-24bd-4569-af9f-d6241352bd2e] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 22:00:44.110062 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:00:44.111045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=28 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:00:44.112554 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 22:00:44.112872 ncdv-master-1 devstack@n-api.service[145772]: Sat Sep 10 22:00:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 10 22:00:44.122773 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-82e992f1-3f2f-4dcf-9c35-101a9559f962 req-8de55bbf-9cf0-45f3-aac5-aa48e7462d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3ec73e-9aa1-44d9-a21b-6da8204f613c", "name": "network-vif-plugged", "status": "completed", "tag": "9fb68888-0bfe-4ae8-985e-92a04f648c3a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:00:44.140124 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-82e992f1-3f2f-4dcf-9c35-101a9559f962 req-8de55bbf-9cf0-45f3-aac5-aa48e7462d30 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:44.140935 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-82e992f1-3f2f-4dcf-9c35-101a9559f962 req-8de55bbf-9cf0-45f3-aac5-aa48e7462d30 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:44.141610 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-82e992f1-3f2f-4dcf-9c35-101a9559f962 req-8de55bbf-9cf0-45f3-aac5-aa48e7462d30 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:44.157367 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-82e992f1-3f2f-4dcf-9c35-101a9559f962 req-8de55bbf-9cf0-45f3-aac5-aa48e7462d30 service nova] Creating event network-vif-plugged:9fb68888-0bfe-4ae8-985e-92a04f648c3a for instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c on nch2-master-1 Sep 10 22:00:44.163354 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-82e992f1-3f2f-4dcf-9c35-101a9559f962 req-8de55bbf-9cf0-45f3-aac5-aa48e7462d30 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057285 Sep 10 22:00:44.165022 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3667/7206] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:00:52.328454 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1669133645", "imageRef": "f17b4acf-947f-4842-8f61-715440245363", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-921880638", "security_groups": [{"name": "tempest-secgroup-smoke-556415554"}], "networks": [{"uuid": "2acc7a23-4650-4852-a1cb-cfde0671e954"}]}} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:00:52.341468 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:00:52.342226 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:00:52.359713 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] [d92fd74e-3a75-4708-a33b-c44a50e0eba4] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 42366. Sep 10 22:00:52.360703 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9be06a9-4f21-4508-84c9-22f4b31441dc] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 42364. Sep 10 22:00:52.445989 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.network.neutron [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] validate_networks() for [('2acc7a23-4650-4852-a1cb-cfde0671e954', None, None, None, None, None)] {{(pid=145771) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 22:00:52.816333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Flavor limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 22:00:52.816758 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Image limits 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 22:00:52.817233 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Flavor pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 22:00:52.817644 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Image pref 0:0:0 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 22:00:52.818086 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.virt.hardware [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=145771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 22:00:52.827309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:52.827792 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:52.828234 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:52.828955 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:52.829412 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:52.829855 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:52.847630 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Getting quotas for project c19c892be2ee4051a0a59def52561c8d. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 22:00:52.853875 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.quota [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Getting quotas for user 86134247af5940d6b3011c490cdf6d13 and project c19c892be2ee4051a0a59def52561c8d. Resources: {'instances', 'cores', 'ram'} {{(pid=145771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 22:00:52.866681 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Going to run 1 instances... {{(pid=145771) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 22:00:52.869154 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17b4acf-947f-4842-8f61-715440245363',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=145771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 22:00:52.917511 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3d6dcaad-ff90-43af-ab76-60d9c80d0f88 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.593134 Sep 10 22:00:52.918283 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3540/7207] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Sep 10 22:00:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 22:00:52.939728 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] [c8ac8451-8bb7-4c61-8ae1-41d1ffcbab32] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 42380. Sep 10 22:00:52.945448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-68ee5695-a91d-49da-b4e3-2e89ec702e45 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:00:52.946169 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-68ee5695-a91d-49da-b4e3-2e89ec702e45 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:00:52.950392 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] [7b1f4ed7-24bd-4569-af9f-d6241352bd2e] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 42382. Sep 10 22:00:53.010159 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-68ee5695-a91d-49da-b4e3-2e89ec702e45 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:00:53.017542 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-68ee5695-a91d-49da-b4e3-2e89ec702e45 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1248 microversion: 2.1 time: 0.091901 Sep 10 22:00:53.018147 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3668/7208] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:00:52 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:00:54.041263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-8ad75250-fb74-4e60-8978-cc38bc0bc1cf tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:00:54.041931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-8ad75250-fb74-4e60-8978-cc38bc0bc1cf tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:00:54.101046 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-8ad75250-fb74-4e60-8978-cc38bc0bc1cf tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:00:54.108849 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-8ad75250-fb74-4e60-8978-cc38bc0bc1cf tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1248 microversion: 2.1 time: 0.072232 Sep 10 22:00:54.109432 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3541/7209] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:00:54 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:00:55.131771 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-ca327001-ccd4-48dd-a101-84710c2d1dcf tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:00:55.132410 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-ca327001-ccd4-48dd-a101-84710c2d1dcf tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:00:55.136175 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:00:55.191542 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-ca327001-ccd4-48dd-a101-84710c2d1dcf tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:00:55.200088 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-ca327001-ccd4-48dd-a101-84710c2d1dcf tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1248 microversion: 2.1 time: 0.072133 Sep 10 22:00:55.200667 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3669/7210] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:00:55 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:00:56.104473 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-31d717b1-8517-4f8b-8246-00fe1c75533a req-269d2302-9032-444d-aa80-3b261d0ad7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3ec73e-9aa1-44d9-a21b-6da8204f613c", "name": "network-vif-unplugged", "status": "completed", "tag": "9fb68888-0bfe-4ae8-985e-92a04f648c3a"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:00:56.116841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-31d717b1-8517-4f8b-8246-00fe1c75533a req-269d2302-9032-444d-aa80-3b261d0ad7c0 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:56.117333 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-31d717b1-8517-4f8b-8246-00fe1c75533a req-269d2302-9032-444d-aa80-3b261d0ad7c0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:56.117803 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-31d717b1-8517-4f8b-8246-00fe1c75533a req-269d2302-9032-444d-aa80-3b261d0ad7c0 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:56.129279 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-31d717b1-8517-4f8b-8246-00fe1c75533a req-269d2302-9032-444d-aa80-3b261d0ad7c0 service nova] Creating event network-vif-unplugged:9fb68888-0bfe-4ae8-985e-92a04f648c3a for instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c on nch2-master-1 Sep 10 22:00:56.134384 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-31d717b1-8517-4f8b-8246-00fe1c75533a req-269d2302-9032-444d-aa80-3b261d0ad7c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033823 Sep 10 22:00:56.135571 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3542/7211] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:00:56.223453 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-8146fb3d-7f38-4a2c-9f90-71138934cb79 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:00:56.224105 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-8146fb3d-7f38-4a2c-9f90-71138934cb79 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:00:56.285499 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-8146fb3d-7f38-4a2c-9f90-71138934cb79 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:00:56.292866 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-8146fb3d-7f38-4a2c-9f90-71138934cb79 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1248 microversion: 2.1 time: 0.073343 Sep 10 22:00:56.293541 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3670/7212] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:00:56 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:00:57.318309 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-f885aa3e-ecf3-4c55-a9c8-f63a42e86491 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:00:57.319010 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-f885aa3e-ecf3-4c55-a9c8-f63a42e86491 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:00:57.325726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f885aa3e-ecf3-4c55-a9c8-f63a42e86491 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:57.326236 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f885aa3e-ecf3-4c55-a9c8-f63a42e86491 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:57.326673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f885aa3e-ecf3-4c55-a9c8-f63a42e86491 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:57.327359 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f885aa3e-ecf3-4c55-a9c8-f63a42e86491 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:57.327816 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f885aa3e-ecf3-4c55-a9c8-f63a42e86491 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:57.328363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-f885aa3e-ecf3-4c55-a9c8-f63a42e86491 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:57.393807 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-f885aa3e-ecf3-4c55-a9c8-f63a42e86491 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:00:57.406582 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-f885aa3e-ecf3-4c55-a9c8-f63a42e86491 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1252 microversion: 2.1 time: 0.093348 Sep 10 22:00:57.407171 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3543/7213] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:00:57 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1252 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:00:58.430284 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-5d52e9e0-9ae7-4633-b72c-166d6b1fc7e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:00:58.430887 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-5d52e9e0-9ae7-4633-b72c-166d6b1fc7e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:00:58.439457 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d52e9e0-9ae7-4633-b72c-166d6b1fc7e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:58.440213 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d52e9e0-9ae7-4633-b72c-166d6b1fc7e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:58.440663 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d52e9e0-9ae7-4633-b72c-166d6b1fc7e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:58.441407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d52e9e0-9ae7-4633-b72c-166d6b1fc7e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:58.441962 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d52e9e0-9ae7-4633-b72c-166d6b1fc7e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:58.442443 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-5d52e9e0-9ae7-4633-b72c-166d6b1fc7e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:58.532121 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-5d52e9e0-9ae7-4633-b72c-166d6b1fc7e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:00:58.542609 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-5d52e9e0-9ae7-4633-b72c-166d6b1fc7e2 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1306 microversion: 2.1 time: 0.116026 Sep 10 22:00:58.543953 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3671/7214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:00:58 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1306 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:00:59.569857 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-725f2cbb-205c-4be9-8902-c303ae3c7d0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:00:59.570507 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-725f2cbb-205c-4be9-8902-c303ae3c7d0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:00:59.578417 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725f2cbb-205c-4be9-8902-c303ae3c7d0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:59.579134 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725f2cbb-205c-4be9-8902-c303ae3c7d0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:59.579592 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725f2cbb-205c-4be9-8902-c303ae3c7d0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:59.580315 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725f2cbb-205c-4be9-8902-c303ae3c7d0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:00:59.580931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725f2cbb-205c-4be9-8902-c303ae3c7d0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:00:59.581520 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-725f2cbb-205c-4be9-8902-c303ae3c7d0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:00:59.726095 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-725f2cbb-205c-4be9-8902-c303ae3c7d0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:00:59.736013 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-725f2cbb-205c-4be9-8902-c303ae3c7d0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.170375 Sep 10 22:00:59.737292 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3544/7215] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:00:59 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:00.762365 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-1f911d35-5019-419a-b930-38fb1f643d01 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:00.763001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-1f911d35-5019-419a-b930-38fb1f643d01 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:00.778742 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f911d35-5019-419a-b930-38fb1f643d01 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:00.779541 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f911d35-5019-419a-b930-38fb1f643d01 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:00.780166 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f911d35-5019-419a-b930-38fb1f643d01 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:00.781073 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f911d35-5019-419a-b930-38fb1f643d01 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:00.781730 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f911d35-5019-419a-b930-38fb1f643d01 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:00.782187 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-1f911d35-5019-419a-b930-38fb1f643d01 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:00.977477 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-1f911d35-5019-419a-b930-38fb1f643d01 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:00.986343 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-1f911d35-5019-419a-b930-38fb1f643d01 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.229498 Sep 10 22:01:00.986952 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3672/7216] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:00 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:02.011396 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-69ca22ea-4d7c-4457-b30b-f94b19bd0040 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:02.012152 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-69ca22ea-4d7c-4457-b30b-f94b19bd0040 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:02.020292 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69ca22ea-4d7c-4457-b30b-f94b19bd0040 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:02.021174 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69ca22ea-4d7c-4457-b30b-f94b19bd0040 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:02.021883 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69ca22ea-4d7c-4457-b30b-f94b19bd0040 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:02.022798 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69ca22ea-4d7c-4457-b30b-f94b19bd0040 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:02.023267 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69ca22ea-4d7c-4457-b30b-f94b19bd0040 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:02.023701 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-69ca22ea-4d7c-4457-b30b-f94b19bd0040 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:02.206949 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-69ca22ea-4d7c-4457-b30b-f94b19bd0040 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:02.216445 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-69ca22ea-4d7c-4457-b30b-f94b19bd0040 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.209560 Sep 10 22:01:02.217394 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3545/7217] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:02 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:03.240942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-4b8ec19b-182b-47e0-b336-1873a9430b02 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:03.241588 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-4b8ec19b-182b-47e0-b336-1873a9430b02 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:03.248666 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b8ec19b-182b-47e0-b336-1873a9430b02 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:03.249448 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b8ec19b-182b-47e0-b336-1873a9430b02 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:03.250132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b8ec19b-182b-47e0-b336-1873a9430b02 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:03.251068 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b8ec19b-182b-47e0-b336-1873a9430b02 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:03.251704 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b8ec19b-182b-47e0-b336-1873a9430b02 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:03.252327 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-4b8ec19b-182b-47e0-b336-1873a9430b02 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:03.402832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-4b8ec19b-182b-47e0-b336-1873a9430b02 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:03.410782 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-4b8ec19b-182b-47e0-b336-1873a9430b02 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.174066 Sep 10 22:01:03.411382 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3673/7218] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:03 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:04.435320 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-1c344e49-857a-452b-9315-741ae5d1670d tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:04.436229 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-1c344e49-857a-452b-9315-741ae5d1670d tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:04.438404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:01:04.440307 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell0:SELECT=8 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:01:04.452128 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c344e49-857a-452b-9315-741ae5d1670d tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:04.453024 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c344e49-857a-452b-9315-741ae5d1670d tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:04.453658 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c344e49-857a-452b-9315-741ae5d1670d tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:04.454610 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c344e49-857a-452b-9315-741ae5d1670d tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:04.455745 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c344e49-857a-452b-9315-741ae5d1670d tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:04.456356 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-1c344e49-857a-452b-9315-741ae5d1670d tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:04.606126 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-1c344e49-857a-452b-9315-741ae5d1670d tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:04.615146 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-1c344e49-857a-452b-9315-741ae5d1670d tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.184755 Sep 10 22:01:04.617872 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3546/7219] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:04 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:05.640329 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-54329cd3-b14f-4393-84f2-b8b38ae2fd5e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:05.640969 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-54329cd3-b14f-4393-84f2-b8b38ae2fd5e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:05.648080 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54329cd3-b14f-4393-84f2-b8b38ae2fd5e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:05.648594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54329cd3-b14f-4393-84f2-b8b38ae2fd5e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:05.649043 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54329cd3-b14f-4393-84f2-b8b38ae2fd5e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:05.649750 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54329cd3-b14f-4393-84f2-b8b38ae2fd5e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:05.651001 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54329cd3-b14f-4393-84f2-b8b38ae2fd5e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:05.651532 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-54329cd3-b14f-4393-84f2-b8b38ae2fd5e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:05.797529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-54329cd3-b14f-4393-84f2-b8b38ae2fd5e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:05.805963 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-54329cd3-b14f-4393-84f2-b8b38ae2fd5e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.169419 Sep 10 22:01:05.807446 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3674/7220] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:05 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 22:01:06.830850 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-389f0903-8300-4298-9f5f-1bd2ce7efc4e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:06.831508 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-389f0903-8300-4298-9f5f-1bd2ce7efc4e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:06.838536 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-389f0903-8300-4298-9f5f-1bd2ce7efc4e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:06.839027 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-389f0903-8300-4298-9f5f-1bd2ce7efc4e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:06.839465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-389f0903-8300-4298-9f5f-1bd2ce7efc4e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:06.840163 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-389f0903-8300-4298-9f5f-1bd2ce7efc4e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:06.840623 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-389f0903-8300-4298-9f5f-1bd2ce7efc4e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:06.841052 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-389f0903-8300-4298-9f5f-1bd2ce7efc4e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:06.974238 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-389f0903-8300-4298-9f5f-1bd2ce7efc4e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:06.982742 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-389f0903-8300-4298-9f5f-1bd2ce7efc4e tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.155847 Sep 10 22:01:06.983329 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3547/7221] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:06 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:08.006435 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-2ba648ac-b041-43e7-9af0-7448c77546ee tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:08.007061 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-2ba648ac-b041-43e7-9af0-7448c77546ee tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:08.008942 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell0:SELECT=6 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:01:08.015650 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba648ac-b041-43e7-9af0-7448c77546ee tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:08.016144 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba648ac-b041-43e7-9af0-7448c77546ee tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:08.016594 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba648ac-b041-43e7-9af0-7448c77546ee tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:08.017305 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba648ac-b041-43e7-9af0-7448c77546ee tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:08.017764 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba648ac-b041-43e7-9af0-7448c77546ee tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:08.018229 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-2ba648ac-b041-43e7-9af0-7448c77546ee tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:08.154007 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-2ba648ac-b041-43e7-9af0-7448c77546ee tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:08.161680 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-2ba648ac-b041-43e7-9af0-7448c77546ee tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.159296 Sep 10 22:01:08.162300 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3675/7222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:08 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:08.842809 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-77bb63ff-aef4-468b-9208-989b05b8ca2a req-0a7d94a6-f4a1-40ce-9e90-25efed0beec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e223a9c-4f44-4e64-ba4c-c0bba806babc", "tag": "f8dc8a2d-b32f-4274-86d1-936cf474b2df"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:01:08.853277 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-77bb63ff-aef4-468b-9208-989b05b8ca2a req-0a7d94a6-f4a1-40ce-9e90-25efed0beec1 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:08.854363 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-77bb63ff-aef4-468b-9208-989b05b8ca2a req-0a7d94a6-f4a1-40ce-9e90-25efed0beec1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:08.855067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-77bb63ff-aef4-468b-9208-989b05b8ca2a req-0a7d94a6-f4a1-40ce-9e90-25efed0beec1 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:08.866957 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-77bb63ff-aef4-468b-9208-989b05b8ca2a req-0a7d94a6-f4a1-40ce-9e90-25efed0beec1 service nova] Creating event network-changed:f8dc8a2d-b32f-4274-86d1-936cf474b2df for instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc on nch1-master-1 Sep 10 22:01:08.878457 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-77bb63ff-aef4-468b-9208-989b05b8ca2a req-0a7d94a6-f4a1-40ce-9e90-25efed0beec1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039610 Sep 10 22:01:08.879177 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3548/7223] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:01:09.185434 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-42a6ab89-1a95-4e97-8f7c-531117945a0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:09.186116 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-42a6ab89-1a95-4e97-8f7c-531117945a0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:09.192997 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a6ab89-1a95-4e97-8f7c-531117945a0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:09.193488 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a6ab89-1a95-4e97-8f7c-531117945a0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:09.194027 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a6ab89-1a95-4e97-8f7c-531117945a0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:09.194732 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a6ab89-1a95-4e97-8f7c-531117945a0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:09.195193 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a6ab89-1a95-4e97-8f7c-531117945a0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:09.195625 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-42a6ab89-1a95-4e97-8f7c-531117945a0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:09.343261 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-42a6ab89-1a95-4e97-8f7c-531117945a0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:09.351041 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-42a6ab89-1a95-4e97-8f7c-531117945a0b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.170157 Sep 10 22:01:09.351620 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3676/7224] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:09 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:10.376075 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-e7351e47-76ea-4d87-8416-4c3925ccfaf0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:10.376786 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-e7351e47-76ea-4d87-8416-4c3925ccfaf0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:10.383110 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7351e47-76ea-4d87-8416-4c3925ccfaf0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:10.383603 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7351e47-76ea-4d87-8416-4c3925ccfaf0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:10.384599 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7351e47-76ea-4d87-8416-4c3925ccfaf0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:10.385591 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7351e47-76ea-4d87-8416-4c3925ccfaf0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:10.386089 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7351e47-76ea-4d87-8416-4c3925ccfaf0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:10.386534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-e7351e47-76ea-4d87-8416-4c3925ccfaf0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:10.527968 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-e7351e47-76ea-4d87-8416-4c3925ccfaf0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:10.535821 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-e7351e47-76ea-4d87-8416-4c3925ccfaf0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.164968 Sep 10 22:01:10.536430 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3549/7225] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:10 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:11.559907 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-404f1c99-5d31-498c-bbc0-38693a081f9b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:11.560563 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-404f1c99-5d31-498c-bbc0-38693a081f9b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:11.567401 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-404f1c99-5d31-498c-bbc0-38693a081f9b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:11.567890 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-404f1c99-5d31-498c-bbc0-38693a081f9b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:11.568353 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-404f1c99-5d31-498c-bbc0-38693a081f9b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:11.569049 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-404f1c99-5d31-498c-bbc0-38693a081f9b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:11.569504 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-404f1c99-5d31-498c-bbc0-38693a081f9b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:11.569989 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-404f1c99-5d31-498c-bbc0-38693a081f9b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:11.802119 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-404f1c99-5d31-498c-bbc0-38693a081f9b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:11.810478 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-404f1c99-5d31-498c-bbc0-38693a081f9b tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.255392 Sep 10 22:01:11.811075 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3677/7226] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:11 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:12.833535 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-860e7536-8ed4-43de-b8a5-9194d1d1b4c0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:12.834189 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-860e7536-8ed4-43de-b8a5-9194d1d1b4c0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:12.841673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860e7536-8ed4-43de-b8a5-9194d1d1b4c0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:12.842210 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860e7536-8ed4-43de-b8a5-9194d1d1b4c0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:12.842651 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860e7536-8ed4-43de-b8a5-9194d1d1b4c0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:12.843373 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860e7536-8ed4-43de-b8a5-9194d1d1b4c0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:12.843826 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860e7536-8ed4-43de-b8a5-9194d1d1b4c0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:12.844511 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-860e7536-8ed4-43de-b8a5-9194d1d1b4c0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:12.984911 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-860e7536-8ed4-43de-b8a5-9194d1d1b4c0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:12.993025 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-860e7536-8ed4-43de-b8a5-9194d1d1b4c0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.163862 Sep 10 22:01:12.994236 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3550/7227] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:12 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:14.017972 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6de051e6-f6d4-4fcd-a7d2-ec9c2774ae09 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:14.018596 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6de051e6-f6d4-4fcd-a7d2-ec9c2774ae09 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:14.026199 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de051e6-f6d4-4fcd-a7d2-ec9c2774ae09 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:14.026690 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de051e6-f6d4-4fcd-a7d2-ec9c2774ae09 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:14.027132 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de051e6-f6d4-4fcd-a7d2-ec9c2774ae09 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:14.027835 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de051e6-f6d4-4fcd-a7d2-ec9c2774ae09 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:14.028297 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de051e6-f6d4-4fcd-a7d2-ec9c2774ae09 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:14.028727 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6de051e6-f6d4-4fcd-a7d2-ec9c2774ae09 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:14.163426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-6de051e6-f6d4-4fcd-a7d2-ec9c2774ae09 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:14.177517 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6de051e6-f6d4-4fcd-a7d2-ec9c2774ae09 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.163067 Sep 10 22:01:14.178626 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3678/7228] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:14 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:14.295542 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-8f6c5fb0-5384-4506-8ff6-afadb4bff60d req-03d202a6-0b81-4ce0-8e5c-7d5f114dc537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e223a9c-4f44-4e64-ba4c-c0bba806babc", "name": "network-vif-plugged", "status": "completed", "tag": "f8dc8a2d-b32f-4274-86d1-936cf474b2df"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:01:14.307726 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8f6c5fb0-5384-4506-8ff6-afadb4bff60d req-03d202a6-0b81-4ce0-8e5c-7d5f114dc537 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:14.308213 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8f6c5fb0-5384-4506-8ff6-afadb4bff60d req-03d202a6-0b81-4ce0-8e5c-7d5f114dc537 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:14.309498 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-8f6c5fb0-5384-4506-8ff6-afadb4bff60d req-03d202a6-0b81-4ce0-8e5c-7d5f114dc537 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:14.322978 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-8f6c5fb0-5384-4506-8ff6-afadb4bff60d req-03d202a6-0b81-4ce0-8e5c-7d5f114dc537 service nova] Creating event network-vif-plugged:f8dc8a2d-b32f-4274-86d1-936cf474b2df for instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc on nch1-master-1 Sep 10 22:01:14.328430 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-8f6c5fb0-5384-4506-8ff6-afadb4bff60d req-03d202a6-0b81-4ce0-8e5c-7d5f114dc537 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036754 Sep 10 22:01:14.329893 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3551/7229] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 22:01:15.202608 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-717c7dc8-f785-41bc-8b7e-bfbfe7481172 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:15.203226 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-717c7dc8-f785-41bc-8b7e-bfbfe7481172 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:15.205957 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=31 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:01:15.211631 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717c7dc8-f785-41bc-8b7e-bfbfe7481172 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:15.212122 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717c7dc8-f785-41bc-8b7e-bfbfe7481172 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:15.212565 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717c7dc8-f785-41bc-8b7e-bfbfe7481172 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:15.214019 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717c7dc8-f785-41bc-8b7e-bfbfe7481172 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:15.214486 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717c7dc8-f785-41bc-8b7e-bfbfe7481172 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:15.214947 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-717c7dc8-f785-41bc-8b7e-bfbfe7481172 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:15.350974 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-717c7dc8-f785-41bc-8b7e-bfbfe7481172 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:15.359607 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-717c7dc8-f785-41bc-8b7e-bfbfe7481172 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1373 microversion: 2.1 time: 0.162958 Sep 10 22:01:15.360176 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3679/7230] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:15 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:16.383712 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-a1203030-c69a-4c87-a6d2-61d0deb40448 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:16.384429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-a1203030-c69a-4c87-a6d2-61d0deb40448 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:16.392650 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1203030-c69a-4c87-a6d2-61d0deb40448 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:16.393144 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1203030-c69a-4c87-a6d2-61d0deb40448 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:16.393596 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1203030-c69a-4c87-a6d2-61d0deb40448 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:16.394340 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1203030-c69a-4c87-a6d2-61d0deb40448 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:16.394810 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1203030-c69a-4c87-a6d2-61d0deb40448 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:16.395246 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-a1203030-c69a-4c87-a6d2-61d0deb40448 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:16.535600 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-a1203030-c69a-4c87-a6d2-61d0deb40448 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:16.544093 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-a1203030-c69a-4c87-a6d2-61d0deb40448 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1557 microversion: 2.1 time: 0.164713 Sep 10 22:01:16.544675 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3552/7231] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:16 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:01:16.567128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-584ec22e-239d-4442-a46b-19b356dbe894 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:01:16.567749 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-584ec22e-239d-4442-a46b-19b356dbe894 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:01:16.574953 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-584ec22e-239d-4442-a46b-19b356dbe894 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:16.575444 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-584ec22e-239d-4442-a46b-19b356dbe894 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:16.575886 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-584ec22e-239d-4442-a46b-19b356dbe894 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:16.576585 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-584ec22e-239d-4442-a46b-19b356dbe894 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:16.577045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-584ec22e-239d-4442-a46b-19b356dbe894 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:16.577476 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-584ec22e-239d-4442-a46b-19b356dbe894 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:16.709628 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-584ec22e-239d-4442-a46b-19b356dbe894 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:01:16.718037 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-584ec22e-239d-4442-a46b-19b356dbe894 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1557 microversion: 2.1 time: 0.155007 Sep 10 22:01:16.718615 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3680/7232] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:01:16 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 22:01:18.327931 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-52fcc353-79a1-44bf-9819-95d1619fdae5 req-36f03a2f-940f-48fb-85ec-58d04dbaaa53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e223a9c-4f44-4e64-ba4c-c0bba806babc", "tag": "f8dc8a2d-b32f-4274-86d1-936cf474b2df"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:01:18.339293 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-52fcc353-79a1-44bf-9819-95d1619fdae5 req-36f03a2f-940f-48fb-85ec-58d04dbaaa53 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:01:18.339870 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-52fcc353-79a1-44bf-9819-95d1619fdae5 req-36f03a2f-940f-48fb-85ec-58d04dbaaa53 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:01:18.340355 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-52fcc353-79a1-44bf-9819-95d1619fdae5 req-36f03a2f-940f-48fb-85ec-58d04dbaaa53 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:01:18.351859 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-52fcc353-79a1-44bf-9819-95d1619fdae5 req-36f03a2f-940f-48fb-85ec-58d04dbaaa53 service nova] Creating event network-changed:f8dc8a2d-b32f-4274-86d1-936cf474b2df for instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc on nch1-master-1 Sep 10 22:01:18.358223 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-52fcc353-79a1-44bf-9819-95d1619fdae5 req-36f03a2f-940f-48fb-85ec-58d04dbaaa53 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034107 Sep 10 22:01:18.358956 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3553/7233] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:03:31.635386 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=3 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:03:31.636148 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=60 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:03:31.637132 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 22:03:31.637288 ncdv-master-1 devstack@n-api.service[145772]: Sat Sep 10 22:03:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc/action (ip 10.222.0.33) !!! Sep 10 22:03:31.638379 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 22:03:31.638529 ncdv-master-1 devstack@n-api.service[145772]: Sat Sep 10 22:03:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc/action (ip 10.222.0.33) !!! Sep 10 22:03:31.709726 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-66244306-3e45-486a-b01a-0101a3797623 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1503370448"}} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:03:31.712227 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-66244306-3e45-486a-b01a-0101a3797623 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:03:31.718426 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66244306-3e45-486a-b01a-0101a3797623 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:31.718918 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66244306-3e45-486a-b01a-0101a3797623 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:31.719364 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66244306-3e45-486a-b01a-0101a3797623 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:31.720065 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66244306-3e45-486a-b01a-0101a3797623 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:31.720529 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66244306-3e45-486a-b01a-0101a3797623 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:31.720959 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-66244306-3e45-486a-b01a-0101a3797623 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:32.079829 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-66244306-3e45-486a-b01a-0101a3797623 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "POST /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc/action" status: 202 len: 0 microversion: 2.1 time: 0.446333 Sep 10 22:03:32.080511 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3681/7234] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Sep 10 22:03:31 2022] POST /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 22:03:38.824178 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d92fd74e-3a75-4708-a33b-c44a50e0eba4] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 10 22:03:38.825260 ncdv-master-1 devstack@n-api.service[145771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9be06a9-4f21-4508-84c9-22f4b31441dc] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 10 22:03:38.826091 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:03:38.827012 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=58 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:03:38.828119 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 22:03:38.828266 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 22:03:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 10 22:03:38.829466 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 22:03:38.829466 ncdv-master-1 devstack@n-api.service[145771]: Sat Sep 10 22:03:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 10 22:03:38.930514 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-e081883a-7ef0-4234-a710-6361842e2102 req-0bf659c3-58a2-469d-8875-c4c53591114e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e223a9c-4f44-4e64-ba4c-c0bba806babc", "name": "network-vif-plugged", "status": "completed", "tag": "f8dc8a2d-b32f-4274-86d1-936cf474b2df"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:03:38.941026 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e081883a-7ef0-4234-a710-6361842e2102 req-0bf659c3-58a2-469d-8875-c4c53591114e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:38.941502 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e081883a-7ef0-4234-a710-6361842e2102 req-0bf659c3-58a2-469d-8875-c4c53591114e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:38.941959 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-e081883a-7ef0-4234-a710-6361842e2102 req-0bf659c3-58a2-469d-8875-c4c53591114e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:38.952263 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-e081883a-7ef0-4234-a710-6361842e2102 req-0bf659c3-58a2-469d-8875-c4c53591114e service nova] Creating event network-vif-plugged:f8dc8a2d-b32f-4274-86d1-936cf474b2df for instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc on nch1-master-1 Sep 10 22:03:38.957984 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-e081883a-7ef0-4234-a710-6361842e2102 req-0bf659c3-58a2-469d-8875-c4c53591114e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135990 Sep 10 22:03:38.958590 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3554/7235] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:03:51.130965 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_api:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:03:51.131724 ncdv-master-1 devstack@n-api.service[145771]: DEBUG dbcounter [-] [145771] Writing DB stats nova_cell1:SELECT=2 {{(pid=145771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:03:51.134202 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-de10eae7-ce57-48d5-978f-81a4f810ab47 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:03:51.135334 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de10eae7-ce57-48d5-978f-81a4f810ab47 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:03:51.139259 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_api:SELECT=2 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:03:51.139996 ncdv-master-1 devstack@n-api.service[145772]: DEBUG dbcounter [-] [145772] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=145772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 22:03:51.149685 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] [d92fd74e-3a75-4708-a33b-c44a50e0eba4] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 42726. Sep 10 22:03:51.150797 ncdv-master-1 devstack@n-api.service[145771]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9be06a9-4f21-4508-84c9-22f4b31441dc] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 42728. Sep 10 22:03:51.154216 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de10eae7-ce57-48d5-978f-81a4f810ab47 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:51.154991 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de10eae7-ce57-48d5-978f-81a4f810ab47 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:51.155460 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de10eae7-ce57-48d5-978f-81a4f810ab47 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:51.156406 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de10eae7-ce57-48d5-978f-81a4f810ab47 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:51.156865 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de10eae7-ce57-48d5-978f-81a4f810ab47 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:51.157296 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-de10eae7-ce57-48d5-978f-81a4f810ab47 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:51.191135 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-de10eae7-ce57-48d5-978f-81a4f810ab47 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Going to try to terminate instance {{(pid=145772) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 22:03:51.201385 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-d1b0a4fe-9a24-47b2-9a3e-82a4f823f7ed req-28623599-10fa-4ce0-a940-cbddfeeb0f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e223a9c-4f44-4e64-ba4c-c0bba806babc", "tag": "f8dc8a2d-b32f-4274-86d1-936cf474b2df"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:03:51.212619 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d1b0a4fe-9a24-47b2-9a3e-82a4f823f7ed req-28623599-10fa-4ce0-a940-cbddfeeb0f13 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:51.213266 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d1b0a4fe-9a24-47b2-9a3e-82a4f823f7ed req-28623599-10fa-4ce0-a940-cbddfeeb0f13 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:51.213874 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-d1b0a4fe-9a24-47b2-9a3e-82a4f823f7ed req-28623599-10fa-4ce0-a940-cbddfeeb0f13 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:51.225560 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-d1b0a4fe-9a24-47b2-9a3e-82a4f823f7ed req-28623599-10fa-4ce0-a940-cbddfeeb0f13 service nova] Creating event network-changed:f8dc8a2d-b32f-4274-86d1-936cf474b2df for instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc on nch1-master-1 Sep 10 22:03:51.231102 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-d1b0a4fe-9a24-47b2-9a3e-82a4f823f7ed req-28623599-10fa-4ce0-a940-cbddfeeb0f13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102105 Sep 10 22:03:51.231972 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3555/7236] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:03:51.277058 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-de10eae7-ce57-48d5-978f-81a4f810ab47 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 204 len: 0 microversion: 2.1 time: 0.150818 Sep 10 22:03:51.277668 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3682/7237] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 22:03:51 2022] DELETE /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 22:03:51.293365 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-51a8948a-ad63-4800-8294-8b1aea5f2ec3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:03:51.307177 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-51a8948a-ad63-4800-8294-8b1aea5f2ec3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:03:51.316843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8948a-ad63-4800-8294-8b1aea5f2ec3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:51.317348 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8948a-ad63-4800-8294-8b1aea5f2ec3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:51.317796 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8948a-ad63-4800-8294-8b1aea5f2ec3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:51.318570 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8948a-ad63-4800-8294-8b1aea5f2ec3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:51.319037 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8948a-ad63-4800-8294-8b1aea5f2ec3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:51.319474 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-51a8948a-ad63-4800-8294-8b1aea5f2ec3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:51.525515 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-51a8948a-ad63-4800-8294-8b1aea5f2ec3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:03:51.533705 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-51a8948a-ad63-4800-8294-8b1aea5f2ec3 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1681 microversion: 2.1 time: 0.251296 Sep 10 22:03:51.534324 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3556/7238] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:03:51 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:03:52.558413 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-86d75ab5-cc24-4378-9885-0afb96257d41 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:03:52.559128 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-86d75ab5-cc24-4378-9885-0afb96257d41 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:03:52.566551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86d75ab5-cc24-4378-9885-0afb96257d41 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:52.567045 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86d75ab5-cc24-4378-9885-0afb96257d41 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:52.567552 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86d75ab5-cc24-4378-9885-0afb96257d41 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:52.568263 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86d75ab5-cc24-4378-9885-0afb96257d41 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:52.568769 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86d75ab5-cc24-4378-9885-0afb96257d41 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:52.569207 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-86d75ab5-cc24-4378-9885-0afb96257d41 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:52.783715 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-86d75ab5-cc24-4378-9885-0afb96257d41 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:03:52.794303 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-86d75ab5-cc24-4378-9885-0afb96257d41 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1681 microversion: 2.1 time: 0.240140 Sep 10 22:03:52.794914 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3683/7239] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:03:52 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:03:52.878703 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [req-1db1b410-b647-4c08-a568-9eb0a8a7c00b req-d1c2d974-790f-4b40-82c2-ff502b108a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e223a9c-4f44-4e64-ba4c-c0bba806babc", "name": "network-vif-unplugged", "status": "completed", "tag": "f8dc8a2d-b32f-4274-86d1-936cf474b2df"}]} {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:03:52.888640 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1db1b410-b647-4c08-a568-9eb0a8a7c00b req-d1c2d974-790f-4b40-82c2-ff502b108a8d service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:52.889133 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1db1b410-b647-4c08-a568-9eb0a8a7c00b req-d1c2d974-790f-4b40-82c2-ff502b108a8d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:52.889566 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [req-1db1b410-b647-4c08-a568-9eb0a8a7c00b req-d1c2d974-790f-4b40-82c2-ff502b108a8d service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:52.902355 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.compute.server_external_events [req-1db1b410-b647-4c08-a568-9eb0a8a7c00b req-d1c2d974-790f-4b40-82c2-ff502b108a8d service nova] Creating event network-vif-unplugged:f8dc8a2d-b32f-4274-86d1-936cf474b2df for instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc on nch1-master-1 Sep 10 22:03:52.908117 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [req-1db1b410-b647-4c08-a568-9eb0a8a7c00b req-d1c2d974-790f-4b40-82c2-ff502b108a8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034913 Sep 10 22:03:52.908734 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3557/7240] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:03:53.591914 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-14938330-3f93-4353-ab1d-b8a5b207a08f req-6d1d53c1-9fc2-4715-8458-aa9a7f86f824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e223a9c-4f44-4e64-ba4c-c0bba806babc", "name": "network-vif-deleted", "tag": "f8dc8a2d-b32f-4274-86d1-936cf474b2df"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:03:53.603342 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-14938330-3f93-4353-ab1d-b8a5b207a08f req-6d1d53c1-9fc2-4715-8458-aa9a7f86f824 service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:53.603832 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-14938330-3f93-4353-ab1d-b8a5b207a08f req-6d1d53c1-9fc2-4715-8458-aa9a7f86f824 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:53.604275 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-14938330-3f93-4353-ab1d-b8a5b207a08f req-6d1d53c1-9fc2-4715-8458-aa9a7f86f824 service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:53.616127 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-14938330-3f93-4353-ab1d-b8a5b207a08f req-6d1d53c1-9fc2-4715-8458-aa9a7f86f824 service nova] Creating event network-vif-deleted:f8dc8a2d-b32f-4274-86d1-936cf474b2df for instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc on nch1-master-1 Sep 10 22:03:53.621507 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-14938330-3f93-4353-ab1d-b8a5b207a08f req-6d1d53c1-9fc2-4715-8458-aa9a7f86f824 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033506 Sep 10 22:03:53.622579 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3684/7241] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:03:53.819250 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:03:53.819952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:03:53.826099 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:53.826583 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:53.827018 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:53.828627 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:53.829094 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:53.829534 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:53.861914 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:53.862404 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:53.862843 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:53.863429 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.objects.instance [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lazy-loading 'fault' on Instance uuid 0e223a9c-4f44-4e64-ba4c-c0bba806babc {{(pid=145771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 22:03:53.907873 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:03:53.916252 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-bf0fb1df-e809-4b5a-998c-588e9687c026 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 200 len: 1338 microversion: 2.1 time: 0.101127 Sep 10 22:03:53.916863 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3558/7242] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:03:53 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:03:54.941599 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:03:54.942407 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 0e223a9c-4f44-4e64-ba4c-c0bba806babc] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:03:54.949658 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:54.950197 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:54.950635 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:54.951336 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:54.951791 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:54.952220 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:54.966974 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.wsgi [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] HTTP exception thrown: Instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc could not be found. Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Request method failure captured: Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: request: GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc HTTP/1.1 Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: Accept: application/json Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: Accept-Encoding: identity Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: Connection: close Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: Content-Length: 0 Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: Content-Type: application/json Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: Host: 10.222.0.33 Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: Openstack-System-Scope: None Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: User-Agent: python-urllib3/1.26.12 Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Auth-Token: gAAAAABjHQh-PCsnv9HT_qmHu-o7RnWe1vdAI8JkLetWJcm9CSQN5_3-b39XyMLVzdqz94ncaDXtYQJlkPVpPaD-_uQHSJVZ81WDbW2uIo7fjQmXovXrCV2KhodUemUb2XukR9TNXzdw5IKvr4o0h7Ii5k6yOUXY6IFQsksSvV6ClStKH62_hvA Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Id: None Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Domain-Name: None Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Identity-Status: Confirmed Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Is-Admin-Project: True Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Id: default Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Domain-Name: Default Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Id: c19c892be2ee4051a0a59def52561c8d Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Project-Name: tempest-TestSnapshotPattern-1832891613 Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Role: member,reader Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Roles: member,reader Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c19c892be2ee4051a0a59def52561c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c19c892be2ee4051a0a59def52561c8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c19c892be2ee4051a0a59def52561c8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c19c892be2ee4051a0a59def52561c8d"}]}] Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant: tempest-TestSnapshotPattern-1832891613 Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Id: c19c892be2ee4051a0a59def52561c8d Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-Tenant-Name: tempest-TestSnapshotPattern-1832891613 Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-User: tempest-TestSnapshotPattern-1832891613-project Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Id: default Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-User-Domain-Name: Default Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-User-Id: 86134247af5940d6b3011c490cdf6d13 Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: X-User-Name: tempest-TestSnapshotPattern-1832891613-project Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: method: > Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: exception: Instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc could not be found. Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: action_args: {'id': '0e223a9c-4f44-4e64-ba4c-c0bba806babc'} Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc could not be found. Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc could not be found. Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 22:03:54.969688 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 22:03:54.975093 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 22:03:54.975093 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 22:03:54.975093 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 22:03:54.975093 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 22:03:54.975093 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 22:03:54.975093 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc could not be found. Sep 10 22:03:54.975093 ncdv-master-1 devstack@n-api.service[145772]: ERROR nova.api.openstack.wsgi Sep 10 22:03:54.975093 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Returning 404 to user: Instance 0e223a9c-4f44-4e64-ba4c-c0bba806babc could not be found. {{(pid=145772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 22:03:54.975093 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-6d91314c-db41-44fc-80b6-09b85e4caa28 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc" status: 404 len: 111 microversion: 2.1 time: 0.034616 Sep 10 22:03:54.975093 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3685/7243] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:03:54 2022] GET /compute/v2.1/servers/0e223a9c-4f44-4e64-ba4c-c0bba806babc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 22:03:56.303952 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-adf12b48-e6da-4099-bc56-9d31030d01ed tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:03:56.304477 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-adf12b48-e6da-4099-bc56-9d31030d01ed tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:03:56.305961 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-3e0b8ee7-78dd-4fdc-a8fa-6ebca7632442 req-a5299503-7bdd-424a-b4f3-5aad3404dc5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3ec73e-9aa1-44d9-a21b-6da8204f613c", "tag": "9fb68888-0bfe-4ae8-985e-92a04f648c3a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:03:56.311465 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adf12b48-e6da-4099-bc56-9d31030d01ed tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:56.312263 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adf12b48-e6da-4099-bc56-9d31030d01ed tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:56.312739 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adf12b48-e6da-4099-bc56-9d31030d01ed tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:56.313461 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adf12b48-e6da-4099-bc56-9d31030d01ed tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:56.313950 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adf12b48-e6da-4099-bc56-9d31030d01ed tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:56.314384 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-adf12b48-e6da-4099-bc56-9d31030d01ed tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:56.319820 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3e0b8ee7-78dd-4fdc-a8fa-6ebca7632442 req-a5299503-7bdd-424a-b4f3-5aad3404dc5e service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:56.320396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3e0b8ee7-78dd-4fdc-a8fa-6ebca7632442 req-a5299503-7bdd-424a-b4f3-5aad3404dc5e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:56.320915 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-3e0b8ee7-78dd-4fdc-a8fa-6ebca7632442 req-a5299503-7bdd-424a-b4f3-5aad3404dc5e service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:56.332523 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-3e0b8ee7-78dd-4fdc-a8fa-6ebca7632442 req-a5299503-7bdd-424a-b4f3-5aad3404dc5e service nova] Creating event network-changed:9fb68888-0bfe-4ae8-985e-92a04f648c3a for instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c on nch2-master-1 Sep 10 22:03:56.338635 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-3e0b8ee7-78dd-4fdc-a8fa-6ebca7632442 req-a5299503-7bdd-424a-b4f3-5aad3404dc5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036609 Sep 10 22:03:56.339711 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3686/7244] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:03:56.345984 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-adf12b48-e6da-4099-bc56-9d31030d01ed tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Going to try to terminate instance {{(pid=145771) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 22:03:56.440557 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-adf12b48-e6da-4099-bc56-9d31030d01ed tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 204 len: 0 microversion: 2.1 time: 0.140572 Sep 10 22:03:56.445652 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3559/7245] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Sep 10 22:03:56 2022] DELETE /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 22:03:56.456681 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-166ff5e2-c748-4927-9385-62671fe759d0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:03:56.457756 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.compute.api [None req-166ff5e2-c748-4927-9385-62671fe759d0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145772) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:03:56.464396 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-166ff5e2-c748-4927-9385-62671fe759d0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:56.465004 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-166ff5e2-c748-4927-9385-62671fe759d0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:56.465551 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-166ff5e2-c748-4927-9385-62671fe759d0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:56.466373 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-166ff5e2-c748-4927-9385-62671fe759d0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:56.466901 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-166ff5e2-c748-4927-9385-62671fe759d0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:56.467403 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [None req-166ff5e2-c748-4927-9385-62671fe759d0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:56.609754 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.policy [None req-166ff5e2-c748-4927-9385-62671fe759d0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145772) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:03:56.618030 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-166ff5e2-c748-4927-9385-62671fe759d0 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1682 microversion: 2.1 time: 0.166036 Sep 10 22:03:56.618617 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3687/7246] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:03:56 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:03:57.643940 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-2b00b62b-a8d7-4fc2-bd70-31eebe525bce tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:03:57.644776 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-2b00b62b-a8d7-4fc2-bd70-31eebe525bce tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:03:57.652961 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b00b62b-a8d7-4fc2-bd70-31eebe525bce tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:57.653449 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b00b62b-a8d7-4fc2-bd70-31eebe525bce tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:57.653904 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b00b62b-a8d7-4fc2-bd70-31eebe525bce tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:57.654604 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b00b62b-a8d7-4fc2-bd70-31eebe525bce tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:57.655067 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b00b62b-a8d7-4fc2-bd70-31eebe525bce tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:57.655584 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-2b00b62b-a8d7-4fc2-bd70-31eebe525bce tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:57.721622 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.policy [None req-2b00b62b-a8d7-4fc2-bd70-31eebe525bce tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86134247af5940d6b3011c490cdf6d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19c892be2ee4051a0a59def52561c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=145771) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 22:03:57.729707 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-2b00b62b-a8d7-4fc2-bd70-31eebe525bce tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 200 len: 1333 microversion: 2.1 time: 0.090986 Sep 10 22:03:57.730315 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3560/7247] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:03:57 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 22:03:58.353736 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [req-c2667438-149b-4fec-812d-b5f37a1a52f1 req-ffc54c5a-3103-4bd9-bd89-6f89f4f0605f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3ec73e-9aa1-44d9-a21b-6da8204f613c", "name": "network-vif-deleted", "tag": "9fb68888-0bfe-4ae8-985e-92a04f648c3a"}]} {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 22:03:58.364893 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c2667438-149b-4fec-812d-b5f37a1a52f1 req-ffc54c5a-3103-4bd9-bd89-6f89f4f0605f service nova] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:58.365367 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c2667438-149b-4fec-812d-b5f37a1a52f1 req-ffc54c5a-3103-4bd9-bd89-6f89f4f0605f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:58.366083 ncdv-master-1 devstack@n-api.service[145772]: DEBUG oslo_concurrency.lockutils [req-c2667438-149b-4fec-812d-b5f37a1a52f1 req-ffc54c5a-3103-4bd9-bd89-6f89f4f0605f service nova] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:58.380323 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.compute.server_external_events [req-c2667438-149b-4fec-812d-b5f37a1a52f1 req-ffc54c5a-3103-4bd9-bd89-6f89f4f0605f service nova] Creating event network-vif-deleted:9fb68888-0bfe-4ae8-985e-92a04f648c3a for instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c on nch2-master-1 Sep 10 22:03:58.385388 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [req-c2667438-149b-4fec-812d-b5f37a1a52f1 req-ffc54c5a-3103-4bd9-bd89-6f89f4f0605f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035411 Sep 10 22:03:58.386003 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3688/7248] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Sep 10 22:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 22:03:58.756469 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '>' {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:03:58.756998 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.compute.api [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [instance: 6a3ec73e-9aa1-44d9-a21b-6da8204f613c] Fetching instance by UUID {{(pid=145771) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 22:03:58.763919 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:58.764403 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:58.767673 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:58.768376 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Acquiring lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 22:03:58.768841 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 22:03:58.769271 ncdv-master-1 devstack@n-api.service[145771]: DEBUG oslo_concurrency.lockutils [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Lock "2d5686ab-1410-4524-a86f-a6b89a7f772a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=145771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 22:03:58.783809 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.wsgi [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] HTTP exception thrown: Instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c could not be found. Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Request method failure captured: Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: request: GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c HTTP/1.1 Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: Accept: application/json Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: Accept-Encoding: identity Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: Connection: close Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: Content-Length: 0 Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: Content-Type: application/json Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: Host: 10.222.0.33 Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: Openstack-System-Scope: None Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: User-Agent: python-urllib3/1.26.12 Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Auth-Token: gAAAAABjHQh-PCsnv9HT_qmHu-o7RnWe1vdAI8JkLetWJcm9CSQN5_3-b39XyMLVzdqz94ncaDXtYQJlkPVpPaD-_uQHSJVZ81WDbW2uIo7fjQmXovXrCV2KhodUemUb2XukR9TNXzdw5IKvr4o0h7Ii5k6yOUXY6IFQsksSvV6ClStKH62_hvA Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Id: None Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Domain-Name: None Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Identity-Status: Confirmed Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Is-Admin-Project: True Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Id: default Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Domain-Name: Default Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Id: c19c892be2ee4051a0a59def52561c8d Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Project-Name: tempest-TestSnapshotPattern-1832891613 Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Role: member,reader Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Roles: member,reader Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c19c892be2ee4051a0a59def52561c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c19c892be2ee4051a0a59def52561c8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c19c892be2ee4051a0a59def52561c8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c19c892be2ee4051a0a59def52561c8d"}]}] Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant: tempest-TestSnapshotPattern-1832891613 Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Id: c19c892be2ee4051a0a59def52561c8d Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-Tenant-Name: tempest-TestSnapshotPattern-1832891613 Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-User: tempest-TestSnapshotPattern-1832891613-project Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Id: default Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-User-Domain-Name: Default Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-User-Id: 86134247af5940d6b3011c490cdf6d13 Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: X-User-Name: tempest-TestSnapshotPattern-1832891613-project Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: method: > Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: exception: Instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c could not be found. Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: action_args: {'id': '6a3ec73e-9aa1-44d9-a21b-6da8204f613c'} Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: {{(pid=145771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c could not be found. Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c could not be found. Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 22:03:58.785471 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 22:03:58.790769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 22:03:58.790769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 22:03:58.790769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 22:03:58.790769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 22:03:58.790769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 22:03:58.790769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c could not be found. Sep 10 22:03:58.790769 ncdv-master-1 devstack@n-api.service[145771]: ERROR nova.api.openstack.wsgi Sep 10 22:03:58.790769 ncdv-master-1 devstack@n-api.service[145771]: DEBUG nova.api.openstack.wsgi [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Returning 404 to user: Instance 6a3ec73e-9aa1-44d9-a21b-6da8204f613c could not be found. {{(pid=145771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 22:03:58.790769 ncdv-master-1 devstack@n-api.service[145771]: INFO nova.api.openstack.requestlog [None req-3c8dba72-6c5b-4426-9493-704248443d5a tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c" status: 404 len: 111 microversion: 2.1 time: 0.034460 Sep 10 22:03:58.790769 ncdv-master-1 devstack@n-api.service[145771]: [pid: 145771|app: 0|req: 3561/7249] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Sep 10 22:03:58 2022] GET /compute/v2.1/servers/6a3ec73e-9aa1-44d9-a21b-6da8204f613c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 22:03:58.945722 ncdv-master-1 devstack@n-api.service[145772]: DEBUG nova.api.openstack.wsgi [None req-51317040-cd61-4520-8c51-c5b122726302 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] Calling method '.version_select at 0x7f99441c8c10>' {{(pid=145772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 22:03:58.950302 ncdv-master-1 devstack@n-api.service[145772]: ERROR oslo.messaging._drivers.impl_rabbit [None req-51317040-cd61-4520-8c51-c5b122726302 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [80ac8596-1959-43fe-97fe-8b193e3e5de9] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 22:03:59.959931 ncdv-master-1 devstack@n-api.service[145772]: INFO oslo.messaging._drivers.impl_rabbit [None req-51317040-cd61-4520-8c51-c5b122726302 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] [80ac8596-1959-43fe-97fe-8b193e3e5de9] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 42806. Sep 10 22:03:59.984309 ncdv-master-1 devstack@n-api.service[145772]: INFO nova.api.openstack.requestlog [None req-51317040-cd61-4520-8c51-c5b122726302 tempest-TestSnapshotPattern-1832891613 tempest-TestSnapshotPattern-1832891613-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-921880638" status: 202 len: 0 microversion: 2.1 time: 1.042839 Sep 10 22:03:59.984910 ncdv-master-1 devstack@n-api.service[145772]: [pid: 145772|app: 0|req: 3689/7250] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Sep 10 22:03:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-921880638 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)